00000400:00080000:1.0F:1788200803.964565:0:83818:0:(debug.c:456:libcfs_run_debug_log_upcall()) Invoked LNET debug log upcall /usr/lib/lustre/lnet_debug_log_upcall /tmp/lustre-log.1788200803.83411 00010000:02000000:3.0F:1788200803.964711:0:83411:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 3:07, of 2 clients 1 recovered and 1 was evicted. 00000004:00000080:3.0:1788200804.010248:0:83411:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa0dd486dfe10 00100000:10000000:3.0:1788200804.010270:0:83411:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1788200804.012219:0:83399:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x2a2:0x0] 00000100:00100000:1.0:1788200804.012279:0:83399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83399:1875060714999040:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788200804.012361:0:83399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200804.012406:0:83399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ce6900 going to sleep for 20 seconds 00000100:00100000:3.0:1788200804.012517:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060714999040 00000100:00100000:3.0:1788200804.012527:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060714999040 00000100:00100000:3.0:1788200804.012594:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5841 00000100:00100000:3.0:1788200804.012606:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:83399:x1875060714999040:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:3.0:1788200804.012614:0:26210:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:3.0:1788200804.012647:0:26210:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 705 -> diff = -31 00002000:02000040:3.0:1788200804.012652:0:26210:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:675 to 0x2c0000401:705) 00000004:00080000:0.0F:1788200804.013681:0:83397:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0xb0:0x0] 00000100:00100000:0.0:1788200804.013750:0:83397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11814ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83397:1875060714999168:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788200804.013807:0:83397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200804.013845:0:83397:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f739c0 going to sleep for 20 seconds 00000100:00100000:0.0:1788200804.013890:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060714999168 00000100:00100000:0.0:1788200804.013897:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060714999168 00000100:00100000:0.0:1788200804.013940:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5842 00000100:00100000:0.0:1788200804.013949:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11814d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:83397:x1875060714999168:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:0.0:1788200804.013954:0:8448:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:0.0:1788200804.013978:0:8448:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 705 -> diff = -529 00002000:02000040:0.0:1788200804.013983:0:8448:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:177 to 0x280000401:705) 00002000:00010000:3.0:1788200804.020292:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.020313:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab39a76d/0x96d0c9b8c9a1a1a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.020334:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c1:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.020339:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.020346:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab39a76d/0x96d0c9b8c9a1a1a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.020365:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab39a76d/0x96d0c9b8c9a1a1a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.020377:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab39a76d/0x96d0c9b8c9a1a1a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.020386:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab39a76d/0x96d0c9b8c9a1a1a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.020444:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788200804.020590:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.020595:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ccd9d4f/0x96d0c9b8c9a1a1a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.020604:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c0:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.020607:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.020611:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ccd9d4f/0x96d0c9b8c9a1a1a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.020618:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ccd9d4f/0x96d0c9b8c9a1a1a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.020626:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ccd9d4f/0x96d0c9b8c9a1a1a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.020633:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ccd9d4f/0x96d0c9b8c9a1a1a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.020656:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788200804.020697:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.020703:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1a1b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.020711:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bf:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.020721:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.020725:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1a1b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200804.020849:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788200804.020858:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab39a76d/0x96d0c9b8c9a1a1a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200804.020866:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200804.020872:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab39a76d/0x96d0c9b8c9a1a1a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200804.020882:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab39a76d/0x96d0c9b8c9a1a1a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200804.020903:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab39a76d/0x96d0c9b8c9a1a1a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200804.020911:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab39a76d/0x96d0c9b8c9a1a1a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200804.020937:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200804.020942:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ccd9d4f/0x96d0c9b8c9a1a1a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200804.020949:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200804.020960:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ccd9d4f/0x96d0c9b8c9a1a1a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200804.020968:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ccd9d4f/0x96d0c9b8c9a1a1a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200804.020978:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ccd9d4f/0x96d0c9b8c9a1a1a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200804.020985:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ccd9d4f/0x96d0c9b8c9a1a1a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200804.020998:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200804.020999:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200804.021001:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0F:1788200804.021174:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200804.021337:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1a1b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.021345:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1a1b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.021353:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1a1b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.021406:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788200804.021481:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.021486:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1a1b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.021494:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2be:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.021498:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.021503:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1a1b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.021511:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1a1b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.021518:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1a1b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.021531:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1a1b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.025856:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788200804.025879:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1a1b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.025897:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200804.025903:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1a1b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.025918:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1a1b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.025948:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1a1b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.025958:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1a1b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200804.026099:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200804.026107:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1a1b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200804.026115:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200804.026118:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1a1b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200804.026126:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1a1b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200804.026138:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1a1b7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200804.026170:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200804.026172:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200804.026175:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200804.026269:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788200804.026280:0:26210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1a1b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788200804.026470:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.026477:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095712262/0x96d0c9b8c9a1a1be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.026491:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bd:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.026497:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.026503:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095712262/0x96d0c9b8c9a1a1be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.026516:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095712262/0x96d0c9b8c9a1a1be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.026526:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095712262/0x96d0c9b8c9a1a1be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.026534:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095712262/0x96d0c9b8c9a1a1be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200804.026581:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200804.026587:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095712262/0x96d0c9b8c9a1a1be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200804.026595:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075eec00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200804.026599:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095712262/0x96d0c9b8c9a1a1be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200804.026607:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095712262/0x96d0c9b8c9a1a1be lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200804.026619:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095712262/0x96d0c9b8c9a1a1be lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200804.026628:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200804.026629:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200804.026631:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788200804.028113:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200804.028128:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084b651b2/0x96d0c9b8c9a1a1c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.028144:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c1:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788200804.028150:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200804.028156:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084b651b2/0x96d0c9b8c9a1a1c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.028172:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084b651b2/0x96d0c9b8c9a1a1c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.028336:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084b651b2/0x96d0c9b8c9a1a1c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.028346:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084b651b2/0x96d0c9b8c9a1a1c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.028428:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788200804.028546:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200804.028551:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e697d1a0/0x96d0c9b8c9a1a1cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.028559:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c0:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788200804.028562:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200804.028566:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e697d1a0/0x96d0c9b8c9a1a1cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.028576:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e697d1a0/0x96d0c9b8c9a1a1cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.028584:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e697d1a0/0x96d0c9b8c9a1a1cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.028592:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e697d1a0/0x96d0c9b8c9a1a1cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.028613:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788200804.028652:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200804.028657:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe3208bc/0x96d0c9b8c9a1a1d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.028664:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bf:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788200804.028673:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200804.028677:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3208bc/0x96d0c9b8c9a1a1d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.028688:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe3208bc/0x96d0c9b8c9a1a1d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.028695:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe3208bc/0x96d0c9b8c9a1a1d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.028703:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3208bc/0x96d0c9b8c9a1a1d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.028722:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788200804.028832:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200804.028838:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074aae315/0x96d0c9b8c9a1a1da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.028846:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2be:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788200804.028849:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200804.028853:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074aae315/0x96d0c9b8c9a1a1da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.028862:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074aae315/0x96d0c9b8c9a1a1da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.028870:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074aae315/0x96d0c9b8c9a1a1da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.028882:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074aae315/0x96d0c9b8c9a1a1da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.028900:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788200804.028912:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788200804.028918:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084b651b2/0x96d0c9b8c9a1a1c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.028926:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f338e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.028932:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084b651b2/0x96d0c9b8c9a1a1c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.028941:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084b651b2/0x96d0c9b8c9a1a1c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.028960:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084b651b2/0x96d0c9b8c9a1a1c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.028968:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084b651b2/0x96d0c9b8c9a1a1c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.028991:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788200804.028995:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e697d1a0/0x96d0c9b8c9a1a1cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029011:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.029053:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e697d1a0/0x96d0c9b8c9a1a1cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029061:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e697d1a0/0x96d0c9b8c9a1a1cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029072:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e697d1a0/0x96d0c9b8c9a1a1cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029078:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e697d1a0/0x96d0c9b8c9a1a1cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029090:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788200804.029093:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe3208bc/0x96d0c9b8c9a1a1d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029099:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.029102:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe3208bc/0x96d0c9b8c9a1a1d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029108:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe3208bc/0x96d0c9b8c9a1a1d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029116:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe3208bc/0x96d0c9b8c9a1a1d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029127:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe3208bc/0x96d0c9b8c9a1a1d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029137:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788200804.029140:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074aae315/0x96d0c9b8c9a1a1da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029146:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f338800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.029149:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074aae315/0x96d0c9b8c9a1a1da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029156:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074aae315/0x96d0c9b8c9a1a1da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029164:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074aae315/0x96d0c9b8c9a1a1da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029170:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074aae315/0x96d0c9b8c9a1a1da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029180:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.029181:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.029242:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788200804.029286:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200804.029291:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d8d2611/0x96d0c9b8c9a1a1e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029303:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bd:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788200804.029306:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200804.029310:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d8d2611/0x96d0c9b8c9a1a1e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029319:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d8d2611/0x96d0c9b8c9a1a1e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029327:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d8d2611/0x96d0c9b8c9a1a1e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029334:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d8d2611/0x96d0c9b8c9a1a1e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029345:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788200804.029351:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788200804.029355:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d8d2611/0x96d0c9b8c9a1a1e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029362:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f338600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.029365:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d8d2611/0x96d0c9b8c9a1a1e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029372:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d8d2611/0x96d0c9b8c9a1a1e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029390:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d8d2611/0x96d0c9b8c9a1a1e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029397:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d8d2611/0x96d0c9b8c9a1a1e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029408:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.029409:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.029411:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788200804.029462:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200804.029467:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdc72081/0x96d0c9b8c9a1a1e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029475:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bc:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788200804.029478:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200804.029482:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdc72081/0x96d0c9b8c9a1a1e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029491:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdc72081/0x96d0c9b8c9a1a1e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029499:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdc72081/0x96d0c9b8c9a1a1e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029505:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdc72081/0x96d0c9b8c9a1a1e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029528:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788200804.029686:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200804.029694:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdc72081/0x96d0c9b8c9a1a1e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.029702:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200804.029706:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdc72081/0x96d0c9b8c9a1a1e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.029714:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdc72081/0x96d0c9b8c9a1a1e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.029746:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdc72081/0x96d0c9b8c9a1a1e8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.029755:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200804.029756:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200804.029758:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200804.029786:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.029884:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdc72081/0x96d0c9b8c9a1a1e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029905:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788200804.029950:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200804.029955:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da34fe63/0x96d0c9b8c9a1a1ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029964:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bb:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788200804.029967:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200804.029971:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da34fe63/0x96d0c9b8c9a1a1ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029980:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da34fe63/0x96d0c9b8c9a1a1ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029988:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da34fe63/0x96d0c9b8c9a1a1ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.029995:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da34fe63/0x96d0c9b8c9a1a1ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.030083:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788200804.030123:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200804.030132:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffeeb63e/0x96d0c9b8c9a1a1f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.030140:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ba:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788200804.030143:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200804.030147:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffeeb63e/0x96d0c9b8c9a1a1f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.030157:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffeeb63e/0x96d0c9b8c9a1a1f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.030164:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffeeb63e/0x96d0c9b8c9a1a1f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.030171:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffeeb63e/0x96d0c9b8c9a1a1f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030322:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788200804.030330:0:26210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095712262/0x96d0c9b8c9a1a1be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788200804.030409:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.030414:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e751138/0x96d0c9b8c9a1a1fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030433:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bc:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.030436:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.030440:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e751138/0x96d0c9b8c9a1a1fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030451:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e751138/0x96d0c9b8c9a1a1fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030458:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e751138/0x96d0c9b8c9a1a1fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030465:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e751138/0x96d0c9b8c9a1a1fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030483:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788200804.030524:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.030529:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1a204 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030542:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bb:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.030545:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.030548:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1a204 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030557:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1a204 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030565:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1a204 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030573:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1a204 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030584:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788200804.030622:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.030626:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1a20b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030634:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ba:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.030636:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.030640:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1a20b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030648:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1a20b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030665:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1a20b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030671:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1a20b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030680:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788200804.030718:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.030723:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1a212 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030742:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b9:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.030745:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.030749:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1a212 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030758:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1a212 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030767:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1a212 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030774:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1a212 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030793:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788200804.030834:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.030838:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e01e130d/0x96d0c9b8c9a1a219 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030846:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b8:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.030848:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.030851:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e01e130d/0x96d0c9b8c9a1a219 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030859:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e01e130d/0x96d0c9b8c9a1a219 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030866:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e01e130d/0x96d0c9b8c9a1a219 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030873:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e01e130d/0x96d0c9b8c9a1a219 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030881:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1788200804.030912:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.030917:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088df804f/0x96d0c9b8c9a1a220 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030923:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b7:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.030932:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.030936:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088df804f/0x96d0c9b8c9a1a220 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030946:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088df804f/0x96d0c9b8c9a1a220 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030954:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088df804f/0x96d0c9b8c9a1a220 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030961:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088df804f/0x96d0c9b8c9a1a220 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.030970:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1788200804.031008:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.031012:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd87944c/0x96d0c9b8c9a1a227 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031040:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b6:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.031042:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.031046:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd87944c/0x96d0c9b8c9a1a227 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031053:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd87944c/0x96d0c9b8c9a1a227 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031061:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd87944c/0x96d0c9b8c9a1a227 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031073:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd87944c/0x96d0c9b8c9a1a227 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031081:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:3.0:1788200804.031118:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.031122:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dff0c9c0/0x96d0c9b8c9a1a22e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031130:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b5:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.031132:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.031136:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dff0c9c0/0x96d0c9b8c9a1a22e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031144:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dff0c9c0/0x96d0c9b8c9a1a22e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031151:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dff0c9c0/0x96d0c9b8c9a1a22e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031158:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dff0c9c0/0x96d0c9b8c9a1a22e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031166:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:3.0:1788200804.031331:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.031337:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af862cf6/0x96d0c9b8c9a1a235 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031350:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b4:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.031353:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.031357:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af862cf6/0x96d0c9b8c9a1a235 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031366:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af862cf6/0x96d0c9b8c9a1a235 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031373:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af862cf6/0x96d0c9b8c9a1a235 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031380:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af862cf6/0x96d0c9b8c9a1a235 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031389:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:3.0:1788200804.031440:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.031445:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ccbc01a/0x96d0c9b8c9a1a23c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031453:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b3:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.031456:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.031460:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ccbc01a/0x96d0c9b8c9a1a23c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031469:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ccbc01a/0x96d0c9b8c9a1a23c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031488:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ccbc01a/0x96d0c9b8c9a1a23c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031495:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ccbc01a/0x96d0c9b8c9a1a23c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031504:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:3.0:1788200804.031541:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.031546:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000083d94f3/0x96d0c9b8c9a1a243 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031553:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b2:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.031555:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.031558:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000083d94f3/0x96d0c9b8c9a1a243 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031566:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000083d94f3/0x96d0c9b8c9a1a243 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031574:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000083d94f3/0x96d0c9b8c9a1a243 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031581:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000083d94f3/0x96d0c9b8c9a1a243 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031601:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:3.0:1788200804.031630:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.031634:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f02c746/0x96d0c9b8c9a1a24a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031639:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b1:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.031641:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.031644:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f02c746/0x96d0c9b8c9a1a24a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031649:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f02c746/0x96d0c9b8c9a1a24a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031654:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f02c746/0x96d0c9b8c9a1a24a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031659:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f02c746/0x96d0c9b8c9a1a24a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031664:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:3.0:1788200804.031683:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.031685:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1a251 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031689:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b0:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.031695:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.031698:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1a251 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031704:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1a251 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031709:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1a251 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031714:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1a251 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031718:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:3.0:1788200804.031793:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.031796:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004755534c/0x96d0c9b8c9a1a258 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031800:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2af:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.031802:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.031804:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004755534c/0x96d0c9b8c9a1a258 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031810:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004755534c/0x96d0c9b8c9a1a258 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031815:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004755534c/0x96d0c9b8c9a1a258 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031824:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004755534c/0x96d0c9b8c9a1a258 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031830:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:3.0:1788200804.031855:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.031858:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000969d9351/0x96d0c9b8c9a1a25f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031862:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ae:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.031864:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.031867:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000969d9351/0x96d0c9b8c9a1a25f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031872:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000969d9351/0x96d0c9b8c9a1a25f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031876:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000969d9351/0x96d0c9b8c9a1a25f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031880:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000969d9351/0x96d0c9b8c9a1a25f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031885:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:3.0:1788200804.031912:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.031917:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004647d365/0x96d0c9b8c9a1a266 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031930:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ad:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.031933:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.031937:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004647d365/0x96d0c9b8c9a1a266 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031947:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004647d365/0x96d0c9b8c9a1a266 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031954:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004647d365/0x96d0c9b8c9a1a266 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031959:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004647d365/0x96d0c9b8c9a1a266 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031965:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:3.0:1788200804.031992:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.031995:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000911ffc6c/0x96d0c9b8c9a1a26d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.031999:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ac:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.032001:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.032003:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000911ffc6c/0x96d0c9b8c9a1a26d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.032009:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000911ffc6c/0x96d0c9b8c9a1a26d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.032050:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000911ffc6c/0x96d0c9b8c9a1a26d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.032055:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000911ffc6c/0x96d0c9b8c9a1a26d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.032060:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00002000:00010000:3.0:1788200804.032086:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.032089:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5135343/0x96d0c9b8c9a1a274 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.032094:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ab:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.032096:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.032099:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5135343/0x96d0c9b8c9a1a274 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.032104:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5135343/0x96d0c9b8c9a1a274 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.032110:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5135343/0x96d0c9b8c9a1a274 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.032114:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5135343/0x96d0c9b8c9a1a274 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.032126:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/20 locks to regular blp list, 20 blwis in pool 00002000:00010000:3.0:1788200804.032152:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.032155:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090d8cd0e/0x96d0c9b8c9a1a27b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.032160:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2aa:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.032162:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.032165:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090d8cd0e/0x96d0c9b8c9a1a27b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.032170:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090d8cd0e/0x96d0c9b8c9a1a27b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.032175:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090d8cd0e/0x96d0c9b8c9a1a27b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.032179:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090d8cd0e/0x96d0c9b8c9a1a27b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032255:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/20 locks to regular blp list, 20 blwis in pool 00010000:00010000:0.0:1788200804.032274:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 19 total in blp. (19 blwis in pool) 00010000:00010000:0.0:1788200804.032279:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da34fe63/0x96d0c9b8c9a1a1ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032286:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f338000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.032289:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da34fe63/0x96d0c9b8c9a1a1ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032295:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da34fe63/0x96d0c9b8c9a1a1ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032316:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da34fe63/0x96d0c9b8c9a1a1ef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032322:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da34fe63/0x96d0c9b8c9a1a1ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032341:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:0.0:1788200804.032344:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffeeb63e/0x96d0c9b8c9a1a1f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032348:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.032350:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffeeb63e/0x96d0c9b8c9a1a1f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032358:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffeeb63e/0x96d0c9b8c9a1a1f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032367:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffeeb63e/0x96d0c9b8c9a1a1f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032374:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffeeb63e/0x96d0c9b8c9a1a1f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032386:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:0.0:1788200804.032390:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e751138/0x96d0c9b8c9a1a1fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032402:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075ef200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.032405:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e751138/0x96d0c9b8c9a1a1fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032412:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e751138/0x96d0c9b8c9a1a1fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032434:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e751138/0x96d0c9b8c9a1a1fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032443:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e751138/0x96d0c9b8c9a1a1fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032461:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:0.0:1788200804.032465:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1a204 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032472:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075eea00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.032475:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1a204 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032483:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1a204 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032493:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1a204 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032506:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1a204 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032521:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:0.0:1788200804.032525:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1a20b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032532:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075ee800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.032535:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1a20b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032542:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1a20b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032553:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1a20b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032561:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1a20b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032573:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:0.0:1788200804.032577:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1a212 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032583:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075eee00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.032593:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1a212 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032600:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1a212 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032610:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1a212 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032616:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1a212 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032628:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:0.0:1788200804.032632:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e01e130d/0x96d0c9b8c9a1a219 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032638:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140759c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.032641:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e01e130d/0x96d0c9b8c9a1a219 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032648:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e01e130d/0x96d0c9b8c9a1a219 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032658:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e01e130d/0x96d0c9b8c9a1a219 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032665:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e01e130d/0x96d0c9b8c9a1a219 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032685:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:0.0:1788200804.032689:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088df804f/0x96d0c9b8c9a1a220 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032696:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140759a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.032698:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088df804f/0x96d0c9b8c9a1a220 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032704:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088df804f/0x96d0c9b8c9a1a220 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032710:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088df804f/0x96d0c9b8c9a1a220 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032714:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088df804f/0x96d0c9b8c9a1a220 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032722:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:0.0:1788200804.032724:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd87944c/0x96d0c9b8c9a1a227 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032779:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140759600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.032781:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd87944c/0x96d0c9b8c9a1a227 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032795:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd87944c/0x96d0c9b8c9a1a227 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032802:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd87944c/0x96d0c9b8c9a1a227 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032807:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd87944c/0x96d0c9b8c9a1a227 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032815:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1788200804.032817:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dff0c9c0/0x96d0c9b8c9a1a22e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032821:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fc000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.032823:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dff0c9c0/0x96d0c9b8c9a1a22e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032828:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dff0c9c0/0x96d0c9b8c9a1a22e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032832:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dff0c9c0/0x96d0c9b8c9a1a22e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032836:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dff0c9c0/0x96d0c9b8c9a1a22e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032850:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1788200804.032853:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af862cf6/0x96d0c9b8c9a1a235 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032857:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.032859:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af862cf6/0x96d0c9b8c9a1a235 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032863:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af862cf6/0x96d0c9b8c9a1a235 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032868:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af862cf6/0x96d0c9b8c9a1a235 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032872:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af862cf6/0x96d0c9b8c9a1a235 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032877:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788200804.032879:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ccbc01a/0x96d0c9b8c9a1a23c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032883:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fcc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.032884:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ccbc01a/0x96d0c9b8c9a1a23c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032897:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ccbc01a/0x96d0c9b8c9a1a23c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032906:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ccbc01a/0x96d0c9b8c9a1a23c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032913:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ccbc01a/0x96d0c9b8c9a1a23c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032925:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788200804.032929:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000083d94f3/0x96d0c9b8c9a1a243 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032936:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fce00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.032939:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000083d94f3/0x96d0c9b8c9a1a243 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032947:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000083d94f3/0x96d0c9b8c9a1a243 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032955:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000083d94f3/0x96d0c9b8c9a1a243 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032960:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000083d94f3/0x96d0c9b8c9a1a243 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032975:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788200804.032978:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f02c746/0x96d0c9b8c9a1a24a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032982:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fc800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.032985:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f02c746/0x96d0c9b8c9a1a24a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.032992:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f02c746/0x96d0c9b8c9a1a24a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033002:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f02c746/0x96d0c9b8c9a1a24a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033009:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f02c746/0x96d0c9b8c9a1a24a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033040:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788200804.033043:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1a251 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033047:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fc600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.033050:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1a251 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033062:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1a251 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033069:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1a251 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033074:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1a251 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033081:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788200804.033083:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004755534c/0x96d0c9b8c9a1a258 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033087:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.033089:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004755534c/0x96d0c9b8c9a1a258 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033094:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004755534c/0x96d0c9b8c9a1a258 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033098:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004755534c/0x96d0c9b8c9a1a258 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033102:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004755534c/0x96d0c9b8c9a1a258 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033115:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788200804.033117:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000969d9351/0x96d0c9b8c9a1a25f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033121:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.033123:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000969d9351/0x96d0c9b8c9a1a25f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033128:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000969d9351/0x96d0c9b8c9a1a25f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033132:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000969d9351/0x96d0c9b8c9a1a25f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033136:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000969d9351/0x96d0c9b8c9a1a25f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033142:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788200804.033144:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004647d365/0x96d0c9b8c9a1a266 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033147:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fda00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.033149:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004647d365/0x96d0c9b8c9a1a266 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033159:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004647d365/0x96d0c9b8c9a1a266 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033164:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004647d365/0x96d0c9b8c9a1a266 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033167:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004647d365/0x96d0c9b8c9a1a266 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033174:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788200804.033176:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000911ffc6c/0x96d0c9b8c9a1a26d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033179:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fc400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.033181:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000911ffc6c/0x96d0c9b8c9a1a26d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.033297:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200804.033301:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5135343/0x96d0c9b8c9a1a274 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.033306:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fc200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200804.033309:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5135343/0x96d0c9b8c9a1a274 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.033318:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5135343/0x96d0c9b8c9a1a274 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.033326:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5135343/0x96d0c9b8c9a1a274 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.033331:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5135343/0x96d0c9b8c9a1a274 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.033339:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200804.033340:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200804.033342:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200804.033353:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200804.033359:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200804.033361:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090d8cd0e/0x96d0c9b8c9a1a27b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.033366:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fde00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200804.033368:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090d8cd0e/0x96d0c9b8c9a1a27b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.033372:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090d8cd0e/0x96d0c9b8c9a1a27b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.033377:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090d8cd0e/0x96d0c9b8c9a1a27b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.033385:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090d8cd0e/0x96d0c9b8c9a1a27b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.033393:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200804.033394:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200804.033394:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200804.033487:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.033493:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1a282 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.033504:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a9:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.033509:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.033515:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1a282 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.033526:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1a282 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033683:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000911ffc6c/0x96d0c9b8c9a1a26d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033691:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000911ffc6c/0x96d0c9b8c9a1a26d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033696:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000911ffc6c/0x96d0c9b8c9a1a26d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033714:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.033715:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.033717:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788200804.033864:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200804.033870:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000515efff9/0x96d0c9b8c9a1a289 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033879:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b9:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788200804.033883:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200804.033887:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000515efff9/0x96d0c9b8c9a1a289 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033898:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000515efff9/0x96d0c9b8c9a1a289 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033906:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000515efff9/0x96d0c9b8c9a1a289 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033914:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000515efff9/0x96d0c9b8c9a1a289 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033937:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788200804.033972:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200804.033975:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014ef0705/0x96d0c9b8c9a1a290 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033988:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b8:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788200804.033990:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200804.033993:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014ef0705/0x96d0c9b8c9a1a290 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.033999:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014ef0705/0x96d0c9b8c9a1a290 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.034004:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014ef0705/0x96d0c9b8c9a1a290 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.034009:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014ef0705/0x96d0c9b8c9a1a290 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.034034:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788200804.034039:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788200804.034041:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000515efff9/0x96d0c9b8c9a1a289 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.034054:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f338c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.034057:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000515efff9/0x96d0c9b8c9a1a289 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.034062:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000515efff9/0x96d0c9b8c9a1a289 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.034076:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000515efff9/0x96d0c9b8c9a1a289 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.034081:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000515efff9/0x96d0c9b8c9a1a289 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.034092:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788200804.034094:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014ef0705/0x96d0c9b8c9a1a290 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.034097:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.034100:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014ef0705/0x96d0c9b8c9a1a290 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.034104:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014ef0705/0x96d0c9b8c9a1a290 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.034108:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014ef0705/0x96d0c9b8c9a1a290 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.034112:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014ef0705/0x96d0c9b8c9a1a290 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.034118:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.034119:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.034123:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788200804.034154:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200804.034157:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000870a30c3/0x96d0c9b8c9a1a297 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.034162:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b7:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788200804.034164:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200804.034167:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000870a30c3/0x96d0c9b8c9a1a297 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.034173:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000870a30c3/0x96d0c9b8c9a1a297 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.034177:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000870a30c3/0x96d0c9b8c9a1a297 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200804.034269:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200804.034701:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1a282 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.034706:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1a282 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.034714:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200804.034735:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788200804.034779:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.034782:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2d043ef/0x96d0c9b8c9a1a29e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.034788:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a8:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.034790:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.034793:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2d043ef/0x96d0c9b8c9a1a29e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.034799:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2d043ef/0x96d0c9b8c9a1a29e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.034804:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2d043ef/0x96d0c9b8c9a1a29e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.034809:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2d043ef/0x96d0c9b8c9a1a29e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.034817:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788200804.034838:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.034841:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032c6723a/0x96d0c9b8c9a1a2a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.034845:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a7:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.034847:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.034849:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032c6723a/0x96d0c9b8c9a1a2a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.034863:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032c6723a/0x96d0c9b8c9a1a2a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.034868:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032c6723a/0x96d0c9b8c9a1a2a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.034872:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032c6723a/0x96d0c9b8c9a1a2a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.034879:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788200804.034884:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788200804.034886:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1a282 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.034890:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fdc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200804.034893:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1a282 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.034901:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1a282 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.034913:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1a282 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.034920:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1a282 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.034943:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788200804.034946:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2d043ef/0x96d0c9b8c9a1a29e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.034952:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fca00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200804.034954:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2d043ef/0x96d0c9b8c9a1a29e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.034959:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2d043ef/0x96d0c9b8c9a1a29e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.034965:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2d043ef/0x96d0c9b8c9a1a29e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.034969:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2d043ef/0x96d0c9b8c9a1a29e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.034977:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200804.034979:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032c6723a/0x96d0c9b8c9a1a2a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.034983:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200804.034985:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032c6723a/0x96d0c9b8c9a1a2a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.034996:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032c6723a/0x96d0c9b8c9a1a2a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035002:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032c6723a/0x96d0c9b8c9a1a2a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035005:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032c6723a/0x96d0c9b8c9a1a2a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035027:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200804.035028:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200804.035030:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200804.035059:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.035062:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004309391d/0x96d0c9b8c9a1a2ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035068:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a6:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.035070:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.035072:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004309391d/0x96d0c9b8c9a1a2ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035078:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004309391d/0x96d0c9b8c9a1a2ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035082:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004309391d/0x96d0c9b8c9a1a2ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035091:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004309391d/0x96d0c9b8c9a1a2ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035099:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200804.035104:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200804.035106:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004309391d/0x96d0c9b8c9a1a2ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035110:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200804.035112:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004309391d/0x96d0c9b8c9a1a2ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035117:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004309391d/0x96d0c9b8c9a1a2ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035122:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004309391d/0x96d0c9b8c9a1a2ac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035126:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004309391d/0x96d0c9b8c9a1a2ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035133:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200804.035135:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200804.035136:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200804.035162:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.035169:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a534e104/0x96d0c9b8c9a1a2b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035174:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a5:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.035176:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.035179:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a534e104/0x96d0c9b8c9a1a2b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035275:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a534e104/0x96d0c9b8c9a1a2b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035280:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a534e104/0x96d0c9b8c9a1a2b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035285:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a534e104/0x96d0c9b8c9a1a2b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035294:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200804.035298:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200804.035300:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a534e104/0x96d0c9b8c9a1a2b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035304:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2c600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200804.035307:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a534e104/0x96d0c9b8c9a1a2b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035311:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a534e104/0x96d0c9b8c9a1a2b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035322:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a534e104/0x96d0c9b8c9a1a2b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035327:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a534e104/0x96d0c9b8c9a1a2b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035335:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200804.035336:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200804.035337:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200804.035369:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.035372:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004194fab/0x96d0c9b8c9a1a2ba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035377:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a4:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.035379:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.035382:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004194fab/0x96d0c9b8c9a1a2ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035388:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004194fab/0x96d0c9b8c9a1a2ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035392:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004194fab/0x96d0c9b8c9a1a2ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035397:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004194fab/0x96d0c9b8c9a1a2ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035412:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200804.035418:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200804.035430:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004194fab/0x96d0c9b8c9a1a2ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035437:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2c400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200804.035441:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004194fab/0x96d0c9b8c9a1a2ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035448:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004194fab/0x96d0c9b8c9a1a2ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035458:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004194fab/0x96d0c9b8c9a1a2ba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035465:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004194fab/0x96d0c9b8c9a1a2ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035477:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200804.035479:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200804.035481:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200804.035524:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.035529:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1a2c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035537:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a3:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.035546:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.035549:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1a2c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035556:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1a2c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035562:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1a2c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035570:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1a2c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035582:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200804.035588:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200804.035592:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1a2c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035598:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2d800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200804.035601:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1a2c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035608:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1a2c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035615:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1a2c1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035626:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1a2c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.035636:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200804.035637:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200804.035638:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788200804.035661:0:26210:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:674 00010000:00010000:0.0:1788200804.035793:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000870a30c3/0x96d0c9b8c9a1a297 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.035803:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.035813:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788200804.035856:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200804.035859:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1a2c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.035865:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b6:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788200804.035867:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200804.035869:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1a2c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.035882:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1a2c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.035887:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1a2c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.035892:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1a2c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.035903:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788200804.035910:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788200804.035914:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000870a30c3/0x96d0c9b8c9a1a297 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.035920:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f338a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.035923:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000870a30c3/0x96d0c9b8c9a1a297 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.035931:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000870a30c3/0x96d0c9b8c9a1a297 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.035942:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000870a30c3/0x96d0c9b8c9a1a297 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.035950:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000870a30c3/0x96d0c9b8c9a1a297 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.035968:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788200804.035970:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1a2c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.035974:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.035976:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1a2c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.035981:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1a2c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.035987:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1a2c8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.035992:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1a2c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.035998:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.035999:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.036009:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788200804.036051:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200804.036054:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081855616/0x96d0c9b8c9a1a2cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036059:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b5:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788200804.036065:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200804.036068:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081855616/0x96d0c9b8c9a1a2cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036074:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081855616/0x96d0c9b8c9a1a2cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036079:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081855616/0x96d0c9b8c9a1a2cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036084:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081855616/0x96d0c9b8c9a1a2cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036091:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788200804.036095:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788200804.036097:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081855616/0x96d0c9b8c9a1a2cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036102:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.036105:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081855616/0x96d0c9b8c9a1a2cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036113:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081855616/0x96d0c9b8c9a1a2cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036123:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081855616/0x96d0c9b8c9a1a2cf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036140:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081855616/0x96d0c9b8c9a1a2cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036152:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.036154:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.036156:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788200804.036200:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200804.036204:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1a2d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036209:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b4:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788200804.036211:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200804.036214:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1a2d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036220:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1a2d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036224:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1a2d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036229:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1a2d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036236:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788200804.036240:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788200804.036246:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1a2d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036251:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f338400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.036253:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1a2d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036257:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1a2d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036265:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1a2d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036272:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1a2d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036285:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.036287:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.036288:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788200804.036328:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200804.036332:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4377764/0x96d0c9b8c9a1a2dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036339:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b3:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788200804.036342:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200804.036346:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4377764/0x96d0c9b8c9a1a2dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036363:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4377764/0x96d0c9b8c9a1a2dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036370:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4377764/0x96d0c9b8c9a1a2dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036376:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4377764/0x96d0c9b8c9a1a2dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036388:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788200804.036395:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788200804.036398:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4377764/0x96d0c9b8c9a1a2dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036404:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.036407:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4377764/0x96d0c9b8c9a1a2dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036414:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4377764/0x96d0c9b8c9a1a2dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036435:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4377764/0x96d0c9b8c9a1a2dd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036442:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4377764/0x96d0c9b8c9a1a2dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036459:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.036461:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.036463:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788200804.036509:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200804.036514:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b668b7cd/0x96d0c9b8c9a1a2e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036521:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b2:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788200804.036524:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200804.036528:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b668b7cd/0x96d0c9b8c9a1a2e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036536:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b668b7cd/0x96d0c9b8c9a1a2e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036543:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b668b7cd/0x96d0c9b8c9a1a2e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036549:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b668b7cd/0x96d0c9b8c9a1a2e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036561:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788200804.036566:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788200804.036570:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b668b7cd/0x96d0c9b8c9a1a2e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036587:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce9400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.036590:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b668b7cd/0x96d0c9b8c9a1a2e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036597:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b668b7cd/0x96d0c9b8c9a1a2e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036607:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b668b7cd/0x96d0c9b8c9a1a2e4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036613:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b668b7cd/0x96d0c9b8c9a1a2e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036625:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.036627:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.036628:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788200804.036670:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200804.036675:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049ab2300/0x96d0c9b8c9a1a2eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036683:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b1:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788200804.036686:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200804.036689:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049ab2300/0x96d0c9b8c9a1a2eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036699:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049ab2300/0x96d0c9b8c9a1a2eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036712:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049ab2300/0x96d0c9b8c9a1a2eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.036719:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049ab2300/0x96d0c9b8c9a1a2eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037101:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788200804.037109:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788200804.037112:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049ab2300/0x96d0c9b8c9a1a2eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037117:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce9e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.037119:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049ab2300/0x96d0c9b8c9a1a2eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037125:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049ab2300/0x96d0c9b8c9a1a2eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037133:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049ab2300/0x96d0c9b8c9a1a2eb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037136:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049ab2300/0x96d0c9b8c9a1a2eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037147:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.037152:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.037153:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788200804.037233:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200804.037236:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056f7773b/0x96d0c9b8c9a1a2f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037242:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b0:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788200804.037245:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200804.037248:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056f7773b/0x96d0c9b8c9a1a2f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037253:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056f7773b/0x96d0c9b8c9a1a2f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037258:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056f7773b/0x96d0c9b8c9a1a2f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037263:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056f7773b/0x96d0c9b8c9a1a2f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037271:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788200804.037275:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788200804.037277:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056f7773b/0x96d0c9b8c9a1a2f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037281:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.037283:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056f7773b/0x96d0c9b8c9a1a2f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037295:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056f7773b/0x96d0c9b8c9a1a2f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037302:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056f7773b/0x96d0c9b8c9a1a2f2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037306:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056f7773b/0x96d0c9b8c9a1a2f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037314:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.037315:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.037317:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788200804.037347:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200804.037350:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9ce98e9/0x96d0c9b8c9a1a2f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037355:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2af:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788200804.037357:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200804.037360:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9ce98e9/0x96d0c9b8c9a1a2f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037365:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9ce98e9/0x96d0c9b8c9a1a2f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037370:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9ce98e9/0x96d0c9b8c9a1a2f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037378:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9ce98e9/0x96d0c9b8c9a1a2f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037386:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788200804.037390:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788200804.037392:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9ce98e9/0x96d0c9b8c9a1a2f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037396:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.037398:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9ce98e9/0x96d0c9b8c9a1a2f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037403:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9ce98e9/0x96d0c9b8c9a1a2f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037408:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9ce98e9/0x96d0c9b8c9a1a2f9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037413:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9ce98e9/0x96d0c9b8c9a1a2f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037434:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.037436:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.037439:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788200804.037479:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200804.037491:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fa2ed6b/0x96d0c9b8c9a1a300 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037499:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ae:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788200804.037502:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200804.037507:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fa2ed6b/0x96d0c9b8c9a1a300 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037516:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fa2ed6b/0x96d0c9b8c9a1a300 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037523:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fa2ed6b/0x96d0c9b8c9a1a300 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037529:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fa2ed6b/0x96d0c9b8c9a1a300 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037541:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788200804.037547:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788200804.037551:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fa2ed6b/0x96d0c9b8c9a1a300 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037556:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.037559:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fa2ed6b/0x96d0c9b8c9a1a300 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037567:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fa2ed6b/0x96d0c9b8c9a1a300 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037584:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fa2ed6b/0x96d0c9b8c9a1a300 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037591:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fa2ed6b/0x96d0c9b8c9a1a300 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037604:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.037605:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.037607:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788200804.037650:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200804.037654:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1df5e04/0x96d0c9b8c9a1a307 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037659:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ad:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:0.0:1788200804.037661:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200804.037664:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1df5e04/0x96d0c9b8c9a1a307 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037669:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1df5e04/0x96d0c9b8c9a1a307 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037674:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1df5e04/0x96d0c9b8c9a1a307 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037679:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1df5e04/0x96d0c9b8c9a1a307 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037694:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788200804.037698:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788200804.037701:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1df5e04/0x96d0c9b8c9a1a307 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037705:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200804.037707:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1df5e04/0x96d0c9b8c9a1a307 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037711:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1df5e04/0x96d0c9b8c9a1a307 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037718:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1df5e04/0x96d0c9b8c9a1a307 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.037723:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1df5e04/0x96d0c9b8c9a1a307 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.037810:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200804.037833:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788200804.037959:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:83399:x1875060714999040:12345-0@lo:5:osp-pre-1-0.0 Request processed in 25348us (25590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200804.037973:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5841 00000100:00100000:2.0:1788200804.038128:0:83399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83399:1875060714999040:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788200804.038147:0:83399:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x2c1:0x0] from OST, last_created [0x2c0000401:0x2c1:0x0]last_used is [0x2c0000401:0x2a2:0x0] 00000100:00100000:2.0:1788200804.038249:0:83399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb79500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83399:1875060714999424:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788200804.038304:0:83399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200804.038332:0:83399:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0071103c0 going to sleep for 20 seconds 00000100:00100000:2.0:1788200804.038354:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060714999424 00000100:00100000:2.0:1788200804.038362:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060714999424 00000100:00100000:2.0:1788200804.038411:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5843 00000100:00100000:2.0:1788200804.038430:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:83399:x1875060714999424:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:2.0:1788200804.038438:0:26208:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:2.0:1788200804.038486:0:26208:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 706 00000100:00100000:3.0:1788200804.038874:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060714999296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788200804.038907:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1788200804.039077:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.039084:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1a30e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039098:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ac:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.039103:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.039108:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1a30e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039120:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1a30e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039129:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1a30e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039147:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1a30e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039163:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788200804.039216:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.039220:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1a315 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039228:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ab:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.039232:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.039236:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1a315 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039244:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1a315 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039252:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1a315 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039259:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1a315 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039273:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788200804.039309:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.039314:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027372f9b/0x96d0c9b8c9a1a31c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039326:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2aa:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.039329:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.039333:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027372f9b/0x96d0c9b8c9a1a31c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039342:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027372f9b/0x96d0c9b8c9a1a31c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039349:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027372f9b/0x96d0c9b8c9a1a31c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039355:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027372f9b/0x96d0c9b8c9a1a31c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039364:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788200804.039401:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.039406:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9ea44f/0x96d0c9b8c9a1a323 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039414:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a9:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.039418:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.039431:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9ea44f/0x96d0c9b8c9a1a323 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039439:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9ea44f/0x96d0c9b8c9a1a323 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039457:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9ea44f/0x96d0c9b8c9a1a323 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039465:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9ea44f/0x96d0c9b8c9a1a323 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039474:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788200804.039513:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.039518:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc441ab6/0x96d0c9b8c9a1a32a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039526:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a8:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.039529:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.039533:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc441ab6/0x96d0c9b8c9a1a32a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039541:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc441ab6/0x96d0c9b8c9a1a32a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039548:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc441ab6/0x96d0c9b8c9a1a32a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039556:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc441ab6/0x96d0c9b8c9a1a32a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039576:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788200804.039615:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.039620:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fb5dba6/0x96d0c9b8c9a1a331 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039628:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a7:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.039630:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.039634:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fb5dba6/0x96d0c9b8c9a1a331 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039643:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fb5dba6/0x96d0c9b8c9a1a331 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039651:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fb5dba6/0x96d0c9b8c9a1a331 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039659:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fb5dba6/0x96d0c9b8c9a1a331 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039668:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788200804.039703:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.039707:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012988d5d/0x96d0c9b8c9a1a338 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039715:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a6:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.039722:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.039726:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012988d5d/0x96d0c9b8c9a1a338 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039854:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012988d5d/0x96d0c9b8c9a1a338 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039861:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012988d5d/0x96d0c9b8c9a1a338 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039867:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012988d5d/0x96d0c9b8c9a1a338 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039876:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1788200804.039919:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.039924:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1a33f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039932:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a5:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.039934:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.039938:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1a33f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039947:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1a33f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039955:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1a33f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039968:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1a33f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.039977:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1788200804.040045:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.040051:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1a346 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.040059:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a4:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.040062:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.040066:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1a346 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.040075:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1a346 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.040082:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1a346 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.040090:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1a346 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.040099:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:3.0:1788200804.040138:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200804.040143:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094e5585b/0x96d0c9b8c9a1a34d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.040156:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a3:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:3.0:1788200804.040159:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200804.040162:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094e5585b/0x96d0c9b8c9a1a34d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.040172:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094e5585b/0x96d0c9b8c9a1a34d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040306:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1788200804.040315:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1a30e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040322:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2dc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200804.040334:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1a30e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040343:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1a30e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040361:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1a30e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040369:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1a30e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040395:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1788200804.040399:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1a315 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040405:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2d600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200804.040408:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1a315 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040415:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1a315 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040433:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1a315 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040440:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1a315 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040459:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788200804.040463:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027372f9b/0x96d0c9b8c9a1a31c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040469:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2c200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200804.040473:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027372f9b/0x96d0c9b8c9a1a31c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040480:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027372f9b/0x96d0c9b8c9a1a31c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040489:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027372f9b/0x96d0c9b8c9a1a31c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040496:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027372f9b/0x96d0c9b8c9a1a31c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040506:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788200804.040510:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9ea44f/0x96d0c9b8c9a1a323 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040516:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2d000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200804.040520:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9ea44f/0x96d0c9b8c9a1a323 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040539:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9ea44f/0x96d0c9b8c9a1a323 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040549:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9ea44f/0x96d0c9b8c9a1a323 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040555:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9ea44f/0x96d0c9b8c9a1a323 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040567:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788200804.040570:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc441ab6/0x96d0c9b8c9a1a32a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040577:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2c000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200804.040580:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc441ab6/0x96d0c9b8c9a1a32a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040587:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc441ab6/0x96d0c9b8c9a1a32a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040596:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc441ab6/0x96d0c9b8c9a1a32a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040603:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc441ab6/0x96d0c9b8c9a1a32a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040626:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788200804.040630:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fb5dba6/0x96d0c9b8c9a1a331 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040637:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2ca00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200804.040640:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fb5dba6/0x96d0c9b8c9a1a331 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040648:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fb5dba6/0x96d0c9b8c9a1a331 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040658:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fb5dba6/0x96d0c9b8c9a1a331 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040665:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fb5dba6/0x96d0c9b8c9a1a331 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040677:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788200804.040681:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012988d5d/0x96d0c9b8c9a1a338 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040687:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2d400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200804.040691:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012988d5d/0x96d0c9b8c9a1a338 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040710:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012988d5d/0x96d0c9b8c9a1a338 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.040721:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012988d5d/0x96d0c9b8c9a1a338 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.040793:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094e5585b/0x96d0c9b8c9a1a34d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200804.040803:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094e5585b/0x96d0c9b8c9a1a34d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.041261:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012988d5d/0x96d0c9b8c9a1a338 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.041279:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788200804.041283:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1a33f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.041289:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2ce00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200804.041293:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1a33f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.041301:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1a33f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.041312:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1a33f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.041319:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1a33f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.041343:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200804.041346:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1a346 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.041353:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2cc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200804.041356:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1a346 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.041363:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1a346 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.041373:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1a346 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.041380:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1a346 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.041392:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200804.041394:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200804.041396:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200804.041405:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200804.041457:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788200804.041466:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200804.041470:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094e5585b/0x96d0c9b8c9a1a34d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.041488:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2d200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200804.041492:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094e5585b/0x96d0c9b8c9a1a34d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.041500:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094e5585b/0x96d0c9b8c9a1a34d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.041511:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094e5585b/0x96d0c9b8c9a1a34d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.041518:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094e5585b/0x96d0c9b8c9a1a34d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.041534:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200804.041536:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200804.041537:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788200804.041607:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200804.041613:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1a354 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.041624:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a2:0x0].0x0 since=3655s v=(0 0) 00010000:00010000:2.0:1788200804.041629:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200804.041635:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1a354 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.041646:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1a354 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.041660:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1a354 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.041668:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1a354 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.041682:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788200804.041688:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200804.041692:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1a354 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.041698:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064eda00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200804.041701:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1a354 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.041708:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1a354 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.041719:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1a354 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200804.041833:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.041837:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.041839:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200804.041869:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788200804.041895:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060714999296 00000100:00100000:0.0:1788200804.041906:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060714999296 00000100:00100000:0.0:1788200804.041962:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2034 00000100:00100000:0.0:1788200804.041974:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060714999296:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:0.0:1788200804.041989:0:8451:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1788200804.042035:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8654144 pending 896 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200804.042142:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060714999296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 170us (3233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200804.042150:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2034 00010000:00010000:2.0:1788200804.042822:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1a354 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200804.042849:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200804.042859:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200804.042861:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788200804.044002:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060714999296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788200804.046451:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:83399:x1875060714999424:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8022us (8136us total) trans 4294969447 rc 0/0 00000100:00100000:1.0:1788200804.046469:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5843 00000100:00100000:2.0:1788200804.046842:0:83399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb79500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83399:1875060714999424:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788200804.046862:0:83399:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x2c1:0x0]-[0x2c0000401:0x2e1:0x0] 00002000:00080000:0.0:1788200804.049925:0:8448:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:176 00000100:00100000:0.0:1788200804.050086:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11814d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:83397:x1875060714999168:12345-0@lo:5:osp-pre-0-0.0 Request processed in 36131us (36272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200804.050099:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5842 00000100:00100000:3.0:1788200804.050389:0:83397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11814ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83397:1875060714999168:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788200804.050409:0:83397:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x2c1:0x0] from OST, last_created [0x280000401:0x2c1:0x0]last_used is [0x280000401:0xb0:0x0] 00000100:00100000:3.0:1788200804.050506:0:83397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331b5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83397:1875060714999680:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788200804.050549:0:83397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200804.050579:0:83397:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140c24c00 going to sleep for 20 seconds 00000100:00100000:3.0:1788200804.050620:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060714999680 00000100:00100000:3.0:1788200804.050629:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060714999680 00000100:00100000:3.0:1788200804.050675:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5844 00000100:00100000:3.0:1788200804.050684:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:83397:x1875060714999680:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:3.0:1788200804.050691:0:8491:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:3.0:1788200804.050805:0:8491:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 706 00000100:00100000:1.0:1788200804.051299:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788200804.051313:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060714999552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788200804.051363:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200804.051512:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060714999552 00000100:00100000:1.0:1788200804.051518:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060714999552 00000100:00100000:1.0:1788200804.051550:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2035 00000100:00100000:1.0:1788200804.051557:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060714999552:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:1.0:1788200804.051563:0:8450:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1788200804.051578:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 216384 pending 896 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200804.051620:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060714999552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200804.051627:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2035 00000100:00100000:1.0:1788200804.051671:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060714999552:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788200804.052862:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788200804.055352:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:83397:x1875060714999680:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4660us (4795us total) trans 4294969448 rc 0/0 00000100:00100000:3.0:1788200804.055368:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5844 00000100:00100000:0.0:1788200804.055472:0:83397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331b5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83397:1875060714999680:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788200804.055491:0:83397:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x2c1:0x0]-[0x280000401:0x2e1:0x0] 00010000:00080000:0.0:1788200804.687294:0:8457:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc12fb7b100 x1875060714997760/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 224/0 e 0 to 0 dl 1788200813 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788200804.687505:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060714997760:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 1010371us (1011668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200804.687519:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3766 00000100:00080000:2.0:1788200804.687799:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1788200804.687813:0:3654:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8dc12fb7b800 x1875060714997760/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788200833 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788200804.687826:0:3654:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8dc12fb7b800 x1875060714997760/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788200833 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788200804.687834:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788200804.687853:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1788200804.687862:0:3654:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000059435209): req@ffff8dc125809f80 x1875060714914432/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788200626 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788200804.688212:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060714999936:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788200804.688217:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060714997760:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:3.0:1788200804.688272:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200804.688346:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060714999936 00000100:00100000:3.0:1788200804.688354:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060714999936 00000100:00100000:3.0:1788200804.688401:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2036 00000100:00100000:3.0:1788200804.688420:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060714999936:12345-0@lo:13:osp-pre-1-1.0 00000020:02000000:3.0:1788200804.688428:0:10112:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1788200804.688450:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200804.688493:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060714999936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200804.688500:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2036 00000100:00100000:3.0:1788200804.688549:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060714999936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788200804.688582:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715000064:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788200804.688626:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200804.688651:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788200804.688657:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11814d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060714999808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788200804.688683:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200804.688719:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715000064 00000100:00100000:3.0:1788200804.688723:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715000064 00000100:00100000:3.0:1788200804.688748:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3772 00000100:00100000:3.0:1788200804.688755:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715000064:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:3.0:1788200804.688760:0:83817:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:3.0:1788200804.688894:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444974592 avail 1298735104 00000100:00100000:3.0:1788200804.688939:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715000064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 183us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200804.688945:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3772 00000100:00100000:3.0:1788200804.688993:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715000064:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788200804.689045:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060714999808 00000100:00100000:3.0:1788200804.689048:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060714999808 00000100:00100000:3.0:1788200804.689078:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2037 00000100:00100000:3.0:1788200804.689086:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060714999808:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:3.0:1788200804.689091:0:8451:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1788200804.689102:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200804.689195:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11814d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060714999808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788200804.689280:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060714999808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 196us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200804.689285:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2037 00000100:00100000:1.0:1788200804.690351:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200804.690546:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060714914432 00000100:00100000:3.0:1788200804.690554:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060714914432 00000100:00100000:3.0:1788200804.690642:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3773 00000100:00100000:3.0:1788200804.690653:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060714914432:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:3.0:1788200804.690660:0:23728:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:3.0:1788200804.690684:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444974592 avail 1298735104 00000100:00100000:3.0:1788200804.690750:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060714914432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200804.690757:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3773 00000100:00100000:1.0:1788200804.690831:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060714914432:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788200805.071485:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200806.095256:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200806.736921:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788200806.736954:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715000192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788200806.737082:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200806.737349:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715000192 00000100:00100000:3.0:1788200806.737361:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715000192 00000100:00100000:3.0:1788200806.737444:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3774 00000100:00100000:3.0:1788200806.737457:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715000192:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:3.0:1788200806.737486:0:83817:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:3.0:1788200806.737538:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:3.0:1788200806.737610:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715000192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 155us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200806.737619:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3774 00000100:00100000:1.0:1788200806.738389:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715000192:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788200807.119684:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200808.144336:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788200808.783587:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715000704:0@lo:400:kworker.0 00000100:00100000:0.0:1788200808.783700:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200808.783758:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715001216:0@lo:400:kworker.0 00000100:00100000:0.0:1788200808.783790:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200808.783816:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715001728:0@lo:400:kworker.0 00000100:00100000:0.0:1788200808.783838:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200808.783878:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788200808.783884:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715000832:0@lo:400:kworker.0 00000100:00100000:0.0:1788200808.783910:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200808.783926:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715001344:0@lo:400:kworker.0 00000100:00100000:0.0:1788200808.783946:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200808.783961:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715001856:0@lo:400:kworker.0 00000100:00100000:0.0:1788200808.783980:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200808.784009:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715000576:0@lo:400:kworker.0 00000100:00100000:0.0:1788200808.784067:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200808.784085:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120023b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715001088:0@lo:400:kworker.0 00000100:00100000:0.0:1788200808.784107:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200808.784125:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715001600:0@lo:400:kworker.0 00000100:00100000:0.0:1788200808.784146:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200808.784166:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788200808.784172:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715000448:0@lo:400:kworker.0 00000100:00100000:0.0:1788200808.784193:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200808.784202:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715000960:0@lo:400:kworker.0 00000100:00100000:2.0:1788200808.784425:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715001216 00000100:00100000:2.0:1788200808.784439:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715001216 00000100:00100000:2.0:1788200808.784501:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715001728 00000100:00100000:2.0:1788200808.784504:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715001728 00000100:00100000:2.0:1788200808.784524:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715001088 00000100:00100000:2.0:1788200808.784526:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715001088 00000100:00100000:2.0:1788200808.784543:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715001600 00000100:00100000:2.0:1788200808.784545:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715001600 00000100:00100000:2.0:1788200808.784570:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2527 00000100:00100000:2.0:1788200808.784592:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11814f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715001216:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1788200808.784601:0:23974:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1788200808.784673:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11814f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715001216:12345-0@lo:400:kworker.0 Request processed in 84us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200808.784682:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2527 00000100:00100000:2.0:1788200808.784702:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2528 00000100:00100000:2.0:1788200808.784709:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11814dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715001728:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1788200808.784714:0:23974:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1788200808.784740:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11814dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715001728:12345-0@lo:400:kworker.0 Request processed in 32us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200808.784747:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2528 00000100:00100000:2.0:1788200808.784757:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2529 00000100:00100000:2.0:1788200808.784763:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11814c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715001088:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1788200808.784767:0:23974:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1788200808.784788:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11814c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715001088:12345-0@lo:400:kworker.0 Request processed in 26us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200808.784792:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2529 00000100:00100000:2.0:1788200808.784800:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2530 00000100:00100000:2.0:1788200808.784803:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11814c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715001600:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1788200808.784806:0:23974:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1788200808.784821:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11814c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715001600:12345-0@lo:400:kworker.0 Request processed in 18us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200808.784825:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2530 00000100:00100000:2.0:1788200808.784839:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715000704 00000100:00100000:2.0:1788200808.784842:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715000704 00000100:00100000:2.0:1788200808.784858:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715000832 00000100:00100000:2.0:1788200808.784860:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715000832 00000100:00100000:2.0:1788200808.784878:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715001344 00000100:00100000:2.0:1788200808.784881:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715001344 00000100:00100000:3.0:1788200808.784886:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715001856 00000100:00100000:2.0:1788200808.784890:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715000576 00000100:00100000:3.0:1788200808.784893:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715001856 00000100:00100000:2.0:1788200808.784894:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715000576 00000100:00100000:2.0:1788200808.784905:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715000448 00000100:00100000:2.0:1788200808.784907:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715000448 00000100:00100000:2.0:1788200808.784928:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:2.0:1788200808.784932:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11814d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715000704:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1788200808.784936:0:66314:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1788200808.784948:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200808.784958:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11814d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715000704:12345-0@lo:400:kworker.0 Request processed in 25us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200808.784981:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715001472:0@lo:400:kworker.0 00000100:00100000:0.0:1788200808.785011:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200808.785063:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715000320:0@lo:400:kworker.0 00000100:00100000:0.0:1788200808.785085:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120023b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715001088:0@lo:400:kworker.0 00000100:00100000:0.0:1788200808.785104:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715001600:0@lo:400:kworker.0 00000100:00100000:1.0:1788200808.785104:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200808.785153:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715000960 00000100:00100000:0.0:1788200808.785158:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715000960 00000100:00100000:1.0:1788200808.785174:0:83387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715000320 00000100:00100000:1.0:1788200808.785179:0:83387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715000320 00000100:00100000:1.0:1788200808.785207:0:83387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788200808.785212:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715001472 00000100:00100000:1.0:1788200808.785213:0:83387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715000320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200808.785219:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715001472 00000020:02000000:1.0:1788200808.785219:0:83387:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1788200808.785243:0:83387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715000320:12345-0@lo:400:kworker.0 Request processed in 31us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200808.785254:0:83387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788200808.785262:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3775 00000100:00100000:0.0:1788200808.785271:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11814ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715000960:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1788200808.785277:0:8457:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1788200808.785315:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11814ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715000960:12345-0@lo:400:kworker.0 Request processed in 46us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200808.785322:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3775 00000100:00100000:0.0:1788200808.785335:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3776 00000100:00100000:0.0:1788200808.785356:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11814e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715001472:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1788200808.785360:0:8457:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1788200808.785389:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11814e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715001472:12345-0@lo:400:kworker.0 Request processed in 34us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200808.785396:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3776 00000100:00100000:0.0:1788200808.785442:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715000704:0@lo:400:kworker.0 00000100:00100000:1.0:1788200808.786104:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715000320:0@lo:400:kworker.0 00000100:00100000:1.0:1788200808.786153:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715000960:0@lo:400:kworker.0 00000100:00100000:1.0:1788200808.786177:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715001472:0@lo:400:kworker.0 00000100:00080000:1.0:1788200808.786227:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788200808.786232:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788200808.786235:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788200808.786238:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788200808.788149:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715001216:0@lo:400:kworker.0 00000100:00100000:0.0:1788200808.788184:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715001728:0@lo:400:kworker.0 00000100:00100000:3.0:1788200808.788510:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:3.0:1788200808.788535:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11814ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715000832:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1788200808.788544:0:66757:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788200808.788664:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11814ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715000832:12345-0@lo:400:kworker.0 Request processed in 142us (4752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200808.788672:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00100000:3.0:1788200808.788704:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:3.0:1788200808.788712:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11814ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715001344:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1788200808.788717:0:66757:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788200808.788751:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11814ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715001344:12345-0@lo:400:kworker.0 Request processed in 41us (4804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200808.788758:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00100000:3.0:1788200808.788771:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:00100000:3.0:1788200808.788778:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11814fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715000576:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1788200808.788783:0:66757:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788200808.788820:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11814fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715000576:12345-0@lo:400:kworker.0 Request processed in 42us (4752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200808.788827:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00100000:3.0:1788200808.788840:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:3.0:1788200808.788847:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11814c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715001856:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1788200808.788869:0:66757:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788200808.788900:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11814c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715001856:12345-0@lo:400:kworker.0 Request processed in 53us (4919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200808.788906:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00100000:3.0:1788200808.788925:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:3.0:1788200808.788932:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11814ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715000448:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1788200808.788937:0:66757:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788200808.788969:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11814ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715000448:12345-0@lo:400:kworker.0 Request processed in 38us (4775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200808.788975:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00100000:3.0:1788200808.789037:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715000448:0@lo:400:kworker.0 00000100:00100000:3.0:1788200808.789054:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715000576:0@lo:400:kworker.0 00000100:00100000:2.0:1788200808.795431:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:3.0:1788200808.796126:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715000832:0@lo:400:kworker.0 00000100:00100000:3.0:1788200808.796150:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715001344:0@lo:400:kworker.0 00000100:00100000:3.0:1788200808.796167:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715001856:0@lo:400:kworker.0 00000100:00100000:1.0:1788200808.916504:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200808.916559:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200808.916651:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200808.916693:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200808.917258:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695318784 00000100:00100000:0.0:1788200808.917273:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695318784 00000100:00100000:0.0:1788200808.917364:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695318656 00000100:00100000:0.0:1788200808.917368:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695318656 00000100:00100000:0.0:1788200808.917391:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1017 00000100:00100000:0.0:1788200808.917403:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695318784:12345-192.168.201.20@tcp:400:kworker.0 00000020:02000000:0.0:1788200808.917413:0:66757:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1788200808.917514:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695318784:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 112us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200808.917542:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1017 00000100:00100000:0.0:1788200808.917563:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1026 00000100:00100000:0.0:1788200808.917569:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695318656:12345-192.168.201.20@tcp:38:kworker.0 00000020:02000000:0.0:1788200808.917573:0:66757:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:0.0:1788200808.917604:0:66757:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp t94489280513 exp 0000000000000000 cur 3660 last 0 00000020:00000080:0.0:1788200808.917667:0:66757:0:(genops.c:1385:class_connect()) connect: client 4292087e-fa00-4621-b681-837afc99ae35, cookie 0x96d0c9b8c9a1a35b 00000004:00100000:0.0:1788200808.917699:0:66757:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788200808.917821:0:66757:0:(import.c:65:import_set_state_nolock()) ffff8dc0078dc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788200808.917858:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2399:x1875060695318656:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 287us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200808.917865:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1026 00000100:00100000:3.0:1788200808.924075:0:83384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695318528 00000100:00100000:3.0:1788200808.924096:0:83384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695318528 00000100:00100000:3.0:1788200808.924191:0:83384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 153 00000100:00100000:3.0:1788200808.924202:0:83384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2403:x1875060695318528:12345-192.168.201.20@tcp:400:kworker.0 00000020:02000000:3.0:1788200808.924212:0:83384:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1788200808.924315:0:83384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2403:x1875060695318528:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 114us (7827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200808.924324:0:83384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 153 00000100:00080000:1.0:1788200808.924745:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788200808.928655:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695318912 00000100:00100000:2.0:1788200808.928678:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695318912 00000100:00100000:2.0:1788200808.928786:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2531 00000100:00100000:2.0:1788200808.928800:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695318912:12345-192.168.201.20@tcp:400:kworker.0 00000020:02000000:2.0:1788200808.928808:0:26212:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1788200808.928913:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695318912:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 116us (12353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200808.928921:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2531 00000100:00080000:3.0:1788200808.929270:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788200808.936254:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200808.936438:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695319040 00000100:00100000:3.0:1788200808.936452:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695319040 00000100:00100000:3.0:1788200808.936533:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1027 00000100:00100000:3.0:1788200808.936546:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:64099:x1875060695319040:12345-192.168.201.20@tcp:41:lfs.0 00000020:02000000:3.0:1788200808.936556:0:66312:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:3.0:1788200808.936602:0:66312:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:3.0:1788200808.936697:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:64099:x1875060695319040:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 153us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200808.936706:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1027 00000100:00100000:2.0:1788200808.945986:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200808.946157:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695319168 00000100:00100000:0.0:1788200808.946170:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695319168 00000100:00100000:0.0:1788200808.946223:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5845 00000100:00100000:0.0:1788200808.946233:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:2399:x1875060695319168:12345-192.168.201.20@tcp:8:lfs.0 00000020:02000000:0.0:1788200808.946242:0:26202:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:0.0:1788200808.946286:0:26202:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp t0 exp 0000000000000000 cur 3660 last 0 00000020:00000080:0.0:1788200808.946326:0:26202:0:(genops.c:1385:class_connect()) connect: client 4292087e-fa00-4621-b681-837afc99ae35, cookie 0x96d0c9b8c9a1a362 00002000:00100000:0.0:1788200808.946351:0:26202:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4292087e-fa00-4621-b681-837afc99ae35/ffff8dc0078dd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788200808.946375:0:26202:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788200808.946477:0:26202:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788200808.946535:0:26202:0:(import.c:65:import_set_state_nolock()) ffff8dc0078dd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788200808.946635:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4292087e-fa00-4621-b681-837afc99ae35+6:2399:x1875060695319168:12345-192.168.201.20@tcp:8:lfs.0 Request processed in 401us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200808.946660:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5845 00000100:00100000:2.0:1788200808.950367:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200808.950506:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695319296 00000100:00100000:3.0:1788200808.950529:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695319296 00000100:00100000:3.0:1788200808.950601:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2038 00000100:00100000:3.0:1788200808.950613:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+6:64099:x1875060695319296:12345-192.168.201.20@tcp:13:lfs.0 00000020:02000000:3.0:1788200808.950622:0:8450:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1788200808.950658:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200808.950756:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+6:64099:x1875060695319296:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 145us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200808.950763:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2038 00000100:00100000:2.0:1788200808.957952:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200808.958054:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695319424 00000100:00100000:3.0:1788200808.958067:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695319424 00000100:00100000:3.0:1788200808.958214:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2039 00000100:00100000:3.0:1788200808.958229:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+6:64099:x1875060695319424:12345-192.168.201.20@tcp:13:lfs.0 00000020:02000000:3.0:1788200808.958239:0:8451:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1788200808.958285:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200808.958385:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+6:64099:x1875060695319424:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 160us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200808.959605:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2039 00010000:00010000:0.0:1788200809.167226:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788200809.297700:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc139ba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715001984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788200809.300608:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200809.300633:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715002112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788200809.300694:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200809.300753:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715001984 00000100:00100000:3.0:1788200809.300764:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715001984 00000100:00100000:3.0:1788200809.300816:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715002112 00000100:00100000:3.0:1788200809.300819:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715002112 00000100:00100000:3.0:1788200809.300839:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2040 00000100:00100000:3.0:1788200809.300848:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715001984:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:3.0:1788200809.300856:0:8450:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1788200809.300914:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200809.300988:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715001984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200809.300997:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2040 00000100:00100000:3.0:1788200809.301047:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2041 00000100:00100000:3.0:1788200809.301056:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715002112:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:3.0:1788200809.301060:0:8450:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1788200809.301070:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200809.301109:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715002112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200809.301116:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2041 00000100:00100000:2.0:1788200809.301170:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc139ba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715001984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788200809.301267:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715002112:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788200809.307408:0:9526:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969447 is committed 00000001:00100000:0.0:1788200809.307965:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4292087e-fa00-4621-b681-837afc99ae35 00000001:00080000:0.0:1788200809.307979:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969448 is committed 00000100:00100000:3.0:1788200809.807314:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788200809.807373:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715002368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788200809.807587:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788200809.807600:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715002496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788200809.807652:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200809.807671:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200809.807724:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715002240:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788200809.807753:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200809.807782:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715002496 00000100:00100000:2.0:1788200809.807795:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715002496 00000100:00100000:2.0:1788200809.807861:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3777 00000100:00100000:2.0:1788200809.807874:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715002496:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:2.0:1788200809.807883:0:8457:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1788200809.807928:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444974592 avail 1298735104 00000100:00100000:1.0:1788200809.807959:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715002368 00000100:00100000:1.0:1788200809.807966:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715002368 00000100:00100000:2.0:1788200809.807990:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715002496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200809.807999:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3777 00000100:00100000:1.0:1788200809.808001:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715002240 00000100:00100000:1.0:1788200809.808099:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715002240 00000100:00100000:1.0:1788200809.808121:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2042 00000100:00100000:1.0:1788200809.808129:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118142d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715002368:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:1.0:1788200809.808135:0:8450:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1788200809.808151:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200809.808205:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118142d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715002368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200809.808213:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2043 00000100:00100000:0.0:1788200809.808224:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118142680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715002240:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788200809.808229:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2042 00000020:02000000:0.0:1788200809.808231:0:8451:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1788200809.808245:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200809.808282:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118142680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715002240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200809.808288:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715002368:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788200809.808300:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715002496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788200809.808305:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2043 00000100:00100000:3.0:1788200809.808313:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715002240:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788200810.191372:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788200810.330569:0:83379:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4292087e-fa00-4621-b681-837afc99ae35 00000100:00100000:2.0:1788200810.935324:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200810.935654:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695319552 00000100:00100000:0.0:1788200810.935667:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695319552 00000100:00100000:0.0:1788200810.935788:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1028 00000100:00100000:0.0:1788200810.935800:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+5:64191:x1875060695319552:12345-192.168.201.20@tcp:101:lfs.0 00000020:02000000:0.0:1788200810.935809:0:66314:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:0.0:1788200810.935834:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200810.935865:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8800/0x96d0c9b8c9a1a369 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786507 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788200810.940226:0:66314:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4291us 00010000:00010000:3.0:1788200810.968937:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1a370 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200810.968967:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1a370 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200810.968986:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1a370 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788200810.969087:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788200810.969092:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:3.0:1788200810.969139:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1a370 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200810.969185:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8800/0x96d0c9b8c9a1a369 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786507 expref: 7 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200810.969210:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1a370 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786507 expref: 6 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200810.969220:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc137d07300) 00010000:00010000:3.0:1788200810.969224:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788200810.969227:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2d800, rc 0) 00000100:00100000:3.0:1788200810.969332:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:64191:x1875060695319552:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 33532us (34033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200810.969366:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1028 00000100:00100000:2.0:1788200810.982857:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200810.982962:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695319680 00000100:00100000:1.0:1788200810.982993:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695319680 00000100:00100000:1.0:1788200810.983112:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1029 00000100:00100000:1.0:1788200810.983124:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f74d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+6:64191:x1875060695319680:12345-192.168.201.20@tcp:41:lfs.0 00000020:02000000:1.0:1788200810.983133:0:69485:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:1.0:1788200810.983182:0:69485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444974592 avail 1298735104 00000100:00100000:1.0:1788200810.983268:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f74d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+6:64191:x1875060695319680:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 145us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200810.983276:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1029 00000100:00100000:3.0:1788200810.988253:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200810.988387:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695319808 00000100:00100000:1.0:1788200810.988414:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695319808 00000100:00080000:3.0:1788200810.988967:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788200810.989146:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1030 00000100:00100000:1.0:1788200810.989165:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:64191:x1875060695319808:12345-192.168.201.20@tcp:41:lfs.0 00000020:02000000:1.0:1788200810.989175:0:66757:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:1.0:1788200810.989225:0:66757:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:1.0:1788200810.989330:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:64191:x1875060695319808:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 172us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200810.989338:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1030 00000100:00100000:2.0:1788200811.003755:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200811.003884:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695319936 00000100:00100000:1.0:1788200811.003898:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695319936 00000100:00100000:1.0:1788200811.003971:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2044 00000100:00100000:1.0:1788200811.003984:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f74d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:64191:x1875060695319936:12345-192.168.201.20@tcp:13:lfs.0 00000020:02000000:1.0:1788200811.003994:0:8450:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1788200811.004073:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200811.004168:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f74d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:64191:x1875060695319936:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 186us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200811.004177:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2044 00000100:00100000:2.0:1788200811.015802:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200811.020742:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695320064 00000100:00100000:0.0:1788200811.020790:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695320064 00000100:00100000:2.0:1788200811.021071:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2045 00000100:00100000:2.0:1788200811.021089:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f74df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+6:64191:x1875060695320064:12345-192.168.201.20@tcp:13:lfs.0 00000020:02000000:2.0:1788200811.021099:0:10112:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1788200811.021140:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788200811.021243:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f74df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+6:64191:x1875060695320064:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 160us (5455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200811.021252:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2045 00000100:00080000:3.0:1788200811.021940:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788200811.085458:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200811.085819:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695320192 00000100:00100000:2.0:1788200811.085833:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695320192 00000100:00100000:2.0:1788200811.085915:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1031 00000100:00100000:2.0:1788200811.085929:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:63707:x1875060695320192:12345-192.168.201.20@tcp:101:multiop.0 00000020:02000000:2.0:1788200811.085939:0:66314:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:2.0:1788200811.086296:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788200811.086339:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1a377 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78650e expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.086433:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a37e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.086452:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a37e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.086468:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a37e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.086486:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1a385 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.086493:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1a385 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.086499:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1a385 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.086896:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1a38c lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.086906:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1a38c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.086914:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1a38c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788200811.086954:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x1:0x0]: returning size 0 00000004:00200000:2.0:1788200811.086959:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1788200811.087337:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1a38c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.087354:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1a38c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.087365:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a37e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.087373:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a37e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.087380:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a37e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.087387:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a37e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.087393:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ede00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788200811.087399:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a37e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.087408:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a37e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.087424:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc137d07300) 00010000:00010000:2.0:1788200811.087428:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788200811.087433:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a37e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.087440:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a37e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.087457:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1a385 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.087471:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1a385 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.087477:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1a385 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.087483:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788200811.087486:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1a385 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.087493:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1a385 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.087501:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff8dc1115dff00) 00010000:00010000:2.0:1788200811.087504:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788200811.087507:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1a385 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.087513:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1a385 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.088522:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1a377 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78650e expref: 8 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.088552:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1a38c lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78650e expref: 7 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200811.088561:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff8dc1115df100) 00010000:00010000:2.0:1788200811.088564:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788200811.088580:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064eca00, rc 0) 00000100:00100000:2.0:1788200811.088694:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+7:63707:x1875060695320192:12345-192.168.201.20@tcp:101:multiop.0 Request processed in 2765us (3252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200811.088704:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1031 00010000:00010000:1.0:1788200811.216326:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788200811.859280:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788200811.859320:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f74ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715002624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788200811.859433:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200811.859505:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715002624 00000100:00100000:2.0:1788200811.859516:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715002624 00000100:00100000:2.0:1788200811.859572:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3778 00000100:00100000:2.0:1788200811.859582:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715002624:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:2.0:1788200811.859590:0:23728:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1788200811.859632:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:2.0:1788200811.859682:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715002624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200811.859689:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3778 00000100:00100000:2.0:1788200811.859742:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f74ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715002624:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788200812.239320:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200813.263669:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788200813.906103:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715003136:0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.906199:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200813.906243:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715003648:0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.906281:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200813.906300:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715004160:0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.906317:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200813.906344:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788200813.906348:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715002752:0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.906394:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200813.906421:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715003264:0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.906437:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200813.906455:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715003776:0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.906476:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200813.906494:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715004288:0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.906542:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200813.906578:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715002880:0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.906605:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200813.906620:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715003392:0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.906640:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200813.906654:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715003904:0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.906669:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200813.906686:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788200813.906690:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715003008:0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.906706:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200813.906714:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715003520:0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.906729:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200813.906743:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715004032:0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.906777:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200813.906814:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715003136 00000100:00100000:2.0:1788200813.906823:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715003136 00000100:00100000:2.0:1788200813.906887:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715003264 00000100:00100000:2.0:1788200813.906890:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715003264 00000100:00100000:2.0:1788200813.906904:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715003776 00000100:00100000:2.0:1788200813.906912:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715003776 00000100:00100000:2.0:1788200813.906925:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715004288 00000100:00100000:2.0:1788200813.906926:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715004288 00000100:00100000:2.0:1788200813.906935:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715002880 00000100:00100000:2.0:1788200813.906937:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715002880 00000100:00100000:2.0:1788200813.906947:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715003008 00000100:00100000:2.0:1788200813.906949:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715003008 00000100:00100000:2.0:1788200813.906964:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:2.0:1788200813.906972:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715003136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.907068:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715003136:12345-0@lo:400:kworker.0 Request processed in 96us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200813.907076:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:2.0:1788200813.907096:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:2.0:1788200813.907102:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715003264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.907129:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715003264:12345-0@lo:400:kworker.0 Request processed in 28us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200813.907134:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:2.0:1788200813.907145:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:2.0:1788200813.907151:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f74ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715003776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.907176:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f74ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715003776:12345-0@lo:400:kworker.0 Request processed in 25us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200813.907182:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00100000:2.0:1788200813.907192:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1788200813.907198:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715004288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.907223:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715004288:12345-0@lo:400:kworker.0 Request processed in 25us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200813.907228:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1788200813.907247:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:2.0:1788200813.907265:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715002880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.907294:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715002880:12345-0@lo:400:kworker.0 Request processed in 31us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200813.907299:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00100000:2.0:1788200813.907308:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:2.0:1788200813.907313:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715003008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.907332:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715003008:12345-0@lo:400:kworker.0 Request processed in 20us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200813.907337:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00100000:2.0:1788200813.907354:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715003648 00000100:00100000:2.0:1788200813.907357:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715003648 00000100:00100000:2.0:1788200813.907378:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715004160 00000100:00100000:2.0:1788200813.907380:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715004160 00000100:00100000:2.0:1788200813.907395:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715003520 00000100:00100000:2.0:1788200813.907397:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715003520 00000100:00100000:2.0:1788200813.907411:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715004032 00000100:00100000:2.0:1788200813.907414:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715004032 00000100:00100000:2.0:1788200813.907428:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2532 00000100:00100000:2.0:1788200813.907433:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715003648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.907462:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715003648:12345-0@lo:400:kworker.0 Request processed in 29us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200813.907467:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2532 00000100:00100000:2.0:1788200813.907477:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2533 00000100:00100000:2.0:1788200813.907483:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715004160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.907508:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715004160:12345-0@lo:400:kworker.0 Request processed in 25us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200813.907523:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2533 00000100:00100000:2.0:1788200813.907534:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2534 00000100:00100000:2.0:1788200813.907540:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715003520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.907567:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715003520:12345-0@lo:400:kworker.0 Request processed in 27us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200813.907573:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2534 00000100:00100000:2.0:1788200813.907583:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2535 00000100:00100000:2.0:1788200813.907588:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715004032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.907613:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715004032:12345-0@lo:400:kworker.0 Request processed in 25us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200813.907619:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2535 00000100:00100000:2.0:1788200813.907638:0:83387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715002752 00000100:00100000:2.0:1788200813.907642:0:83387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715002752 00000100:00100000:2.0:1788200813.907669:0:83387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788200813.907676:0:83387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715002752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.907707:0:83387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715002752:12345-0@lo:400:kworker.0 Request processed in 31us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200813.907712:0:83387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788200813.907767:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715003392 00000100:00100000:2.0:1788200813.907770:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715003392 00000100:00100000:2.0:1788200813.907793:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715003904 00000100:00100000:2.0:1788200813.907797:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715003904 00000100:00100000:2.0:1788200813.907815:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3779 00000100:00100000:2.0:1788200813.907822:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715003392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.907851:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715003392:12345-0@lo:400:kworker.0 Request processed in 29us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200813.907864:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3779 00000100:00100000:2.0:1788200813.907873:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3780 00000100:00100000:2.0:1788200813.907878:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715003904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.907901:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715003904:12345-0@lo:400:kworker.0 Request processed in 23us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200813.907906:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3780 00000100:00080000:2.0:1788200813.907933:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788200813.907937:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788200813.907940:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788200813.907942:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788200813.907997:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715003008:0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.908009:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715003520:0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.908050:0:3655:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969448 gen 2 00000100:00100000:2.0:1788200813.908069:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715004032:0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.908081:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715002880:0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.908091:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715003392:0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.908101:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715003904:0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.908153:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715002752:0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.908167:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715003264:0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.908177:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715003776:0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.908188:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715004288:0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.908215:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715003136:0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.908226:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715003648:0@lo:400:kworker.0 00000100:00100000:2.0:1788200813.908235:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969447 gen 2 00000100:00100000:2.0:1788200813.908247:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715004160:0@lo:400:kworker.0 00000100:00100000:2.0:1788200814.038184:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200814.038263:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200814.038291:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200814.038330:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200814.038356:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200814.038400:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695320832 00000100:00100000:2.0:1788200814.038413:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695320832 00000100:00100000:2.0:1788200814.038488:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695320704 00000100:00100000:2.0:1788200814.038492:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695320704 00000100:00100000:2.0:1788200814.038520:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2536 00000100:00100000:2.0:1788200814.038533:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695320832:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788200814.038628:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695320832:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 98us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200814.038636:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2536 00000100:00100000:2.0:1788200814.038655:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2537 00000100:00100000:2.0:1788200814.038663:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695320704:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788200814.038688:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695320704:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200814.038696:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2537 00000100:00080000:2.0:1788200814.038715:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788200814.039080:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695320448 00000100:00100000:0.0:1788200814.039088:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695320448 00000100:00100000:0.0:1788200814.039131:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695320576 00000100:00100000:0.0:1788200814.039134:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695320576 00000100:00100000:0.0:1788200814.039182:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1024 00000100:00100000:0.0:1788200814.039190:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+7:2403:x1875060695320448:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200814.039237:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+7:2403:x1875060695320448:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 48us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200814.039244:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1024 00000100:00100000:0.0:1788200814.039268:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1025 00000100:00100000:0.0:1788200814.039275:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695320576:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200814.039301:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695320576:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200814.039308:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1025 00000100:00080000:0.0:1788200814.039360:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788200814.040525:0:83384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695320320 00000100:00100000:1.0:1788200814.040538:0:83384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695320320 00000100:00100000:1.0:1788200814.040602:0:83384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 155 00000100:00100000:1.0:1788200814.040612:0:83384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2402:x1875060695320320:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788200814.040679:0:83384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2402:x1875060695320320:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 69us (2415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200814.040689:0:83384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 155 00010000:00010000:0.0:1788200814.287299:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788200814.395986:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200814.396871:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695321088 00000100:00100000:1.0:1788200814.396887:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695321088 00000100:00100000:1.0:1788200814.396991:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1032 00000100:00100000:1.0:1788200814.397036:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10318bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+7:64309:x1875060695321088:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:1.0:1788200814.397110:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788200814.397147:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1a38c lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78650e expref: 7 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.397171:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff8dc1115df100) 00010000:00010000:1.0:1788200814.397194:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1a370 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786507 expref: 6 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.397204:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc137d07300) 00010000:00010000:1.0:1788200814.397211:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788200814.397259:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1a393 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.397276:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1a393 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.397287:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1a393 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.397312:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1a39a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.397320:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1a39a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.397328:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1a39a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.397438:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1a3a1 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.397447:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1a3a1 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.397455:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1a3a1 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788200814.397677:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788200814.398436:0:66314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5e:0x0].2, 64 off8320 00000004:00080000:1.0:1788200814.398449:0:66314:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3665870431838ns, next at 3666870428888ns, rc = 0 00010000:00010000:1.0:1788200814.399207:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1a3a8 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.399228:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1a3a8 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.399252:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1a3a8 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.399260:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1a3a8 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.399278:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1a3a8 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.399284:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1a3a8 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.399817:0:66314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788200814.399874:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1a3a1 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.399882:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1a3a1 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.399889:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1a3a1 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.399896:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788200814.399901:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1a3a1 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.399908:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1a3a1 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.399924:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff8dc0048be800) 00010000:00010000:1.0:1788200814.399927:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788200814.399932:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1a3a1 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.399939:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1a3a1 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.399970:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1a393 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.399982:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1a393 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.399987:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1a393 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.399993:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1a393 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.399997:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788200814.400000:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1a393 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.400048:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1a393 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.400057:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048be700) 00010000:00010000:1.0:1788200814.400060:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788200814.400063:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1a393 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.400069:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1a393 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788200814.400090:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003012bb20 reply state 00000000bbfa843e transno 98784247809 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1a39a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.400102:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1a39a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200814.400109:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff8dc0048bed00) 00010000:00010000:1.0:1788200814.400117:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788200814.400121:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788200814.400259:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10318bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+7:64309:x1875060695321088:12345-192.168.201.20@tcp:36:rm.0 Request processed in 3241us (4272us total) trans 98784247809 rc 0/0 00000100:00100000:1.0:1788200814.400270:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1032 00010000:00010000:2.0:1788200814.406712:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200814.406734:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1a3a8 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200814.406812:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200814.406818:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1a3a8 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200814.406831:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1a3a8 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200814.406861:0:13349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff8dc0048be800) 00010000:00010000:2.0:1788200814.406865:0:13349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788200814.406872:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1a3a8 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200814.406878:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1a3a8 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200814.406908:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200814.406910:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200814.406913:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788200814.416261:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788200814.416294:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715004416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788200814.416392:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200814.416458:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715004416 00000100:00100000:0.0:1788200814.416468:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715004416 00000100:00100000:0.0:1788200814.416542:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2046 00000100:00100000:0.0:1788200814.416553:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715004416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788200814.416591:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200814.416644:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715004416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200814.416664:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2046 00000100:00080000:0.0:1788200814.416694:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788200814.416736:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715004416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788200814.427168:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715004544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788200814.427280:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200814.427392:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715004544 00000100:00100000:0.0:1788200814.427402:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715004544 00000100:00100000:0.0:1788200814.427481:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2047 00000100:00100000:0.0:1788200814.427494:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715004544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788200814.427534:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200814.427592:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715004544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200814.427600:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2047 00000100:00100000:0.0:1788200814.427664:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715004544:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788200814.427730:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788200814.928222:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715004672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788200814.928331:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200814.928689:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715004800:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788200814.928726:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200814.928810:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715004672 00000100:00100000:0.0:1788200814.928822:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715004672 00000100:00100000:0.0:1788200814.928904:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715004800 00000100:00100000:0.0:1788200814.928907:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715004800 00000100:00100000:0.0:1788200814.928932:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2048 00000100:00100000:0.0:1788200814.928944:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715004672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788200814.928976:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200814.929067:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715004672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200814.929077:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2048 00000100:00100000:0.0:1788200814.929101:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2049 00000100:00100000:0.0:1788200814.929108:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715004800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788200814.929120:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200814.929175:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715004800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200814.929182:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2049 00000100:00080000:1.0:1788200814.929264:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788200814.929270:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788200814.929312:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715004800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788200814.929475:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715004672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788200814.929599:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788200814.929613:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715004928:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788200814.929652:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200814.929974:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715004928 00000100:00100000:2.0:1788200814.929979:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715004928 00000100:00100000:2.0:1788200814.930068:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3781 00000100:00100000:2.0:1788200814.930077:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715004928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788200814.930119:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444974592 avail 1298735104 00000100:00100000:2.0:1788200814.930169:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715004928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200814.930176:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3781 00000100:00100000:1.0:1788200814.930266:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715004928:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788200815.311399:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200816.335193:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200816.976284:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715005056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788200816.976386:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200816.976676:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715005056 00000100:00100000:2.0:1788200816.976688:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715005056 00000100:00100000:2.0:1788200816.976762:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3782 00000100:00100000:2.0:1788200816.976774:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715005056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788200816.976825:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:2.0:1788200816.976895:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715005056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200816.976904:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3782 00000100:00100000:2.0:1788200816.976967:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715005056:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788200817.359506:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200818.386547:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788200819.026732:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715005312:0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.026808:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200819.026845:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715005824:0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.026874:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200819.026893:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715006336:0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.026914:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200819.026954:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788200819.026960:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715005184:0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.026991:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200819.027042:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715005696:0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.027067:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200819.027084:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715006208:0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.027464:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200819.027581:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715006720:0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.027609:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200819.027640:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715005440:0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.027664:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200819.027679:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715005952:0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.027701:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200819.027719:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715006464:0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.027737:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200819.027757:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788200819.027763:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715005568:0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.027785:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200819.027795:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715006080:0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.027816:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200819.027831:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715006592:0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.027851:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200819.027885:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715005312 00000100:00100000:2.0:1788200819.027892:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715005312 00000100:00100000:2.0:1788200819.027940:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715005696 00000100:00100000:2.0:1788200819.027952:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715005696 00000100:00100000:2.0:1788200819.027969:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715006208 00000100:00100000:2.0:1788200819.027971:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715006208 00000100:00100000:2.0:1788200819.027982:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715006720 00000100:00100000:2.0:1788200819.027984:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715006720 00000100:00100000:2.0:1788200819.027993:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715005440 00000100:00100000:2.0:1788200819.027995:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715005440 00000100:00100000:2.0:1788200819.028005:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715005568 00000100:00100000:2.0:1788200819.028008:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715005568 00000100:00100000:2.0:1788200819.028046:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:2.0:1788200819.028055:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715005312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.028107:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715005312:12345-0@lo:400:kworker.0 Request processed in 52us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200819.028114:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00100000:2.0:1788200819.028132:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:2.0:1788200819.028139:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715005696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.028182:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715005696:12345-0@lo:400:kworker.0 Request processed in 44us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200819.028189:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:2.0:1788200819.028202:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:2.0:1788200819.028208:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715006208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.028234:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715006208:12345-0@lo:400:kworker.0 Request processed in 27us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200819.028240:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00100000:2.0:1788200819.028251:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:2.0:1788200819.028257:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715006720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.028281:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715006720:12345-0@lo:400:kworker.0 Request processed in 24us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200819.028293:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:2.0:1788200819.028305:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:2.0:1788200819.028311:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715005440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.028345:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715005440:12345-0@lo:400:kworker.0 Request processed in 35us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200819.028351:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00100000:2.0:1788200819.028362:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:2.0:1788200819.028369:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715005568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.028394:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715005568:12345-0@lo:400:kworker.0 Request processed in 26us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200819.028400:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:2.0:1788200819.028420:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715005824 00000100:00100000:2.0:1788200819.028424:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715005824 00000100:00100000:2.0:1788200819.028445:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715006336 00000100:00100000:2.0:1788200819.028448:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715006336 00000100:00100000:2.0:1788200819.028463:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3783 00000100:00100000:2.0:1788200819.028468:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715005824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.028499:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715005824:12345-0@lo:400:kworker.0 Request processed in 30us (1624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200819.028505:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3783 00000100:00100000:2.0:1788200819.028516:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3784 00000100:00100000:2.0:1788200819.028522:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715006336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.028546:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715006336:12345-0@lo:400:kworker.0 Request processed in 25us (1631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200819.028552:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3784 00000100:00100000:2.0:1788200819.028577:0:83387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715005184 00000100:00100000:2.0:1788200819.028581:0:83387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715005184 00000100:00100000:2.0:1788200819.028607:0:83387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788200819.028613:0:83387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715005184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.028646:0:83387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715005184:12345-0@lo:400:kworker.0 Request processed in 32us (1653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200819.028652:0:83387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788200819.028682:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715005952 00000100:00100000:2.0:1788200819.028686:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715005952 00000100:00100000:2.0:1788200819.028712:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715006464 00000100:00100000:2.0:1788200819.028715:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715006464 00000100:00100000:2.0:1788200819.028729:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715006080 00000100:00100000:2.0:1788200819.028732:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715006080 00000100:00100000:2.0:1788200819.028746:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715006592 00000100:00100000:2.0:1788200819.028749:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715006592 00000100:00100000:2.0:1788200819.028766:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2538 00000100:00100000:2.0:1788200819.028772:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715005952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.028803:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715005952:12345-0@lo:400:kworker.0 Request processed in 31us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200819.028809:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2538 00000100:00100000:2.0:1788200819.028820:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2539 00000100:00100000:2.0:1788200819.028826:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715006464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.028849:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715006464:12345-0@lo:400:kworker.0 Request processed in 23us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200819.028855:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2539 00000100:00100000:2.0:1788200819.028865:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2540 00000100:00100000:2.0:1788200819.028870:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715006080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.028895:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715006080:12345-0@lo:400:kworker.0 Request processed in 24us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200819.028907:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2540 00000100:00100000:2.0:1788200819.028918:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2541 00000100:00100000:2.0:1788200819.028924:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715006592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.028952:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715006592:12345-0@lo:400:kworker.0 Request processed in 28us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200819.028958:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2541 00000100:00080000:2.0:1788200819.028981:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788200819.028985:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788200819.028988:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788200819.028991:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788200819.029058:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715005568:0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.029070:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715006080:0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.029080:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715006592:0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.029090:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715005440:0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.029099:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715005952:0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.029108:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715006464:0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.029147:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715005184:0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.029158:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715005696:0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.029185:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715006208:0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.029194:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715006720:0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.029205:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715005312:0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.029224:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715005824:0@lo:400:kworker.0 00000100:00100000:2.0:1788200819.029232:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715006336:0@lo:400:kworker.0 00000100:00100000:0.0:1788200819.171254:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200819.171288:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200819.171308:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200819.171321:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200819.171339:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200819.171370:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695321472 00000100:00100000:0.0:1788200819.171392:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695321472 00000100:00100000:0.0:1788200819.171454:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695321344 00000100:00100000:0.0:1788200819.171455:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695321344 00000100:00100000:0.0:1788200819.171474:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1032 00000100:00100000:0.0:1788200819.171483:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695321472:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200819.171561:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695321472:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 79us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200819.171566:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1032 00000100:00100000:0.0:1788200819.171581:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1033 00000100:00100000:0.0:1788200819.171585:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+7:2400:x1875060695321344:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200819.171600:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+7:2400:x1875060695321344:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 16us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200819.171604:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1033 00000100:00100000:0.0:1788200819.171618:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695321728 00000100:00100000:0.0:1788200819.171621:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695321728 00000100:00100000:0.0:1788200819.171640:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695321600 00000100:00100000:0.0:1788200819.171649:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695321600 00000100:00100000:0.0:1788200819.171667:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2542 00000100:00100000:0.0:1788200819.171671:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695321728:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200819.171692:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695321728:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 21us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200819.171696:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2542 00000100:00100000:0.0:1788200819.171702:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2543 00000100:00100000:0.0:1788200819.171706:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4292087e-fa00-4621-b681-837afc99ae35+5:2400:x1875060695321600:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200819.171717:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4292087e-fa00-4621-b681-837afc99ae35+5:2400:x1875060695321600:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 12us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200819.171721:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2543 00000100:00080000:0.0:1788200819.171737:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788200819.171740:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788200819.171742:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788200819.171744:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788200819.177263:0:83384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695321216 00000100:00100000:2.0:1788200819.177287:0:83384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695321216 00000100:00100000:2.0:1788200819.177391:0:83384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 157 00000100:00100000:2.0:1788200819.177404:0:83384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120180050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2400:x1875060695321216:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788200819.177514:0:83384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120180050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2400:x1875060695321216:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 112us (6270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200819.177523:0:83384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 157 00010000:00010000:2.0:1788200819.416968:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788200819.538631:0:83399:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3671010610838ns, next at 3672010607211ns, rc = 0 00000100:00100000:0.0:1788200819.538672:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788200819.538699:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715006848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788200819.538791:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200819.539141:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715006848 00000100:00100000:0.0:1788200819.541042:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715006848 00000100:00100000:0.0:1788200819.541140:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2050 00000100:00100000:0.0:1788200819.541166:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715006848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788200819.541222:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200819.541325:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715006848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 175us (2534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200819.541343:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2050 00000100:00100000:0.0:1788200819.541454:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715006848:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1788200819.541952:0:83379:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788200819.542064:0:83379:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247809 is committed 00000004:00080000:2.0:1788200819.542068:0:83379:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788200819.542208:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788200819.542222:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715006976:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788200819.542232:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1a39a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200819.542247:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1a39a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200819.542257:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1a39a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200819.542264:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782dc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788200819.542270:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1a39a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200819.542273:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788200819.542285:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1a39a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200819.542310:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff8dc0048bed00) 00000100:00100000:0.0:1788200819.542311:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715006976 00010000:00010000:3.0:1788200819.542316:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788200819.542319:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715006976 00010000:00010000:3.0:1788200819.542323:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1a39a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200819.542332:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1a39a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200819.542348:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5846 00000100:00100000:0.0:1788200819.542356:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140fa1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715006976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788200819.542377:0:8448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:674 count 1 00010000:00010000:0.0:1788200819.542408:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a8c53b9/0x96d0c9b8c9a1a3af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200819.542412:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715007104:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788200819.542435:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a19f56 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7864e4 expref: 5 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200819.542445:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a2:0x0].0x0 since=217s v=(0 0) 00010000:00010000:0.0:1788200819.542450:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200819.542454:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a8c53b9/0x96d0c9b8c9a1a3af lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200819.542487:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a19f56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7864e4 expref: 5 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200819.542503:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a19f56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7864e4 expref: 5 pid: 8446 timeout: 3771 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200819.542525:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8448:1875060715007232:192.168.201.20@tcp:104: 00000100:00100000:0.0:1788200819.542587:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140a45240 going to sleep for 11 seconds 00000100:00100000:3.0:1788200819.549869:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200819.549947:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715007104 00000100:00100000:0.0:1788200819.549962:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715007104 00000100:00100000:0.0:1788200819.550065:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2051 00000100:00100000:0.0:1788200819.550078:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715007104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788200819.550124:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200819.550232:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715007104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (7772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200819.550240:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2051 00000100:00100000:2.0:1788200819.550410:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715007104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788200819.556545:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200819.559141:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695321856 00000100:00100000:3.0:1788200819.559176:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695321856 00010000:00010000:3.0:1788200819.559253:0:26207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a19f56 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7864e4 expref: 6 pid: 8446 timeout: 3771 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200819.559310:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2546 00000100:00100000:3.0:1788200819.559323:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695321856:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788200819.559341:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788200819.559348:0:26207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a19f56 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7864e4 expref: 6 pid: 8446 timeout: 3771 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200819.559366:0:26207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a19f56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7864e4 expref: 6 pid: 8446 timeout: 3771 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200819.559403:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200819.559409:0:26207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200819.559416:0:26207:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000a8c53b9/0x96d0c9b8c9a1a3af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200819.559427:0:26207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a8c53b9/0x96d0c9b8c9a1a3af lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200819.559456:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788200819.559537:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695321856:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 217us (3009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200819.559639:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2546 00010000:00010000:3.0:1788200819.559905:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a19f56 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7864e4 expref: 5 pid: 8446 timeout: 3771 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200819.559921:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8448:1875060715007232:192.168.201.20@tcp:104: 00010000:00010000:3.0:1788200819.559948:0:8448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000a8c53b9/0x96d0c9b8c9a1a3af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200819.559960:0:8448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000a8c53b9/0x96d0c9b8c9a1a3af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200819.559968:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a8c53b9/0x96d0c9b8c9a1a3af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200819.559980:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a8c53b9/0x96d0c9b8c9a1a3af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200819.559989:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a8c53b9/0x96d0c9b8c9a1a3af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200819.560011:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788200819.560611:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140fa1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715006976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18253us (18335us total) trans 4294969448 rc 0/0 00000100:00100000:3.0:1788200819.560621:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5846 00010000:00010000:0.0:1788200819.560946:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788200819.560957:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a8c53b9/0x96d0c9b8c9a1a3af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200819.560969:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200819.560975:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a8c53b9/0x96d0c9b8c9a1a3af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200819.560985:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a8c53b9/0x96d0c9b8c9a1a3af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200819.561004:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a8c53b9/0x96d0c9b8c9a1a3af lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200819.561050:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a8c53b9/0x96d0c9b8c9a1a3af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200819.561073:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200819.561075:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200819.561077:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788200819.562232:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dc120091880/2, rc 0, transno 4294969448 00000100:00100000:3.0:1788200819.562257:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715006976:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788200820.047439:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715007616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788200820.047534:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200820.047545:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715007360:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788200820.047588:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200820.047620:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715007488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788200820.047716:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715007616 00000100:00100000:1.0:1788200820.047726:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715007616 00000100:00100000:1.0:1788200820.047782:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715007360 00000100:00100000:1.0:1788200820.047784:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715007360 00000100:00100000:1.0:1788200820.047797:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2052 00000100:00100000:1.0:1788200820.047804:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715007616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788200820.047830:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200820.047894:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2053 00000100:00100000:3.0:1788200820.047904:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715007360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788200820.047915:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200820.048073:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200820.048133:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715007488 00000100:00100000:1.0:1788200820.048134:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715007616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 328us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200820.048137:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715007488 00000100:00100000:3.0:1788200820.048226:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715007360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 324us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200820.048235:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2053 00000100:00100000:0.0:1788200820.048251:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3785 00000100:00100000:0.0:1788200820.048261:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715007488:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788200820.048279:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2052 00000004:00000024:0.0:1788200820.048295:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444974592 avail 1298735104 00000100:00100000:0.0:1788200820.048345:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715007488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200820.048351:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3785 00000100:00100000:1.0:1788200820.048402:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715007616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788200820.048483:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715007488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788200820.049174:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715007360:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788200820.431624:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200821.456398:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788200821.682606:0:84116:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130a: DoM file create (setstripe) replay ========================================================== 14:26:59 (1788200819) 00000100:00100000:2.0:1788200822.095219:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715007744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788200822.095314:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200822.095375:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715007744 00000100:00100000:2.0:1788200822.095384:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715007744 00000100:00100000:2.0:1788200822.095432:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3786 00000100:00100000:2.0:1788200822.095441:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715007744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788200822.095476:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:2.0:1788200822.095520:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715007744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200822.095534:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3786 00000100:00100000:2.0:1788200822.095578:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715007744:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788200822.497819:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788200822.813499:0:9526:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969448 is committed 00000100:00100000:1.0:1788200822.877935:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200822.878192:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695321984 00000100:00100000:0.0:1788200822.878201:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695321984 00000100:00100000:0.0:1788200822.878274:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1033 00000100:00100000:0.0:1788200822.878285:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+5:64898:x1875060695321984:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788200822.878305:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200822.878326:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a3b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786515 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200822.878410:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a3bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200822.878424:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a3bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200822.878437:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a3bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788200822.878486:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788200822.878490:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:0.0:1788200822.878513:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a3bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200822.878539:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a3b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786515 expref: 7 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200822.878555:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a3bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786515 expref: 6 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200822.878563:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc11248c400) 00010000:00010000:0.0:1788200822.878565:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788200822.878568:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ce8c00, rc 0) 00000100:00100000:0.0:1788200822.878623:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:64898:x1875060695321984:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 340us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200822.878630:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1033 00000100:00080000:1.0:1788200822.878959:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788200822.887200:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200822.887235:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695322112 00000100:00100000:3.0:1788200822.887244:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695322112 00000100:00100000:3.0:1788200822.887294:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1034 00000100:00100000:3.0:1788200822.887305:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:64898:x1875060695322112:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:3.0:1788200822.887342:0:66313:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444974592 avail 1298735104 00000100:00100000:3.0:1788200822.887407:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:64898:x1875060695322112:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 104us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200822.887415:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1034 00000100:00100000:0.0:1788200822.895432:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200822.895503:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695322240 00000100:00100000:1.0:1788200822.895513:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695322240 00000100:00100000:1.0:1788200822.895591:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1035 00000100:00100000:1.0:1788200822.895603:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:64898:x1875060695322240:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:1.0:1788200822.895639:0:66314:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:1.0:1788200822.895707:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:64898:x1875060695322240:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 106us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200822.895713:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1035 00000100:00080000:0.0:1788200822.896119:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788200822.904188:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200822.904606:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695322368 00000100:00100000:3.0:1788200822.904617:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695322368 00000100:00100000:3.0:1788200822.904685:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2054 00000100:00100000:3.0:1788200822.904697:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:64898:x1875060695322368:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:3.0:1788200822.904730:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200822.904810:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:64898:x1875060695322368:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 116us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200822.904828:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2054 00000100:00080000:1.0:1788200822.904976:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788200822.923383:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200822.923685:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695322496 00000100:00100000:0.0:1788200822.923695:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695322496 00000100:00100000:0.0:1788200822.923764:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2055 00000100:00100000:0.0:1788200822.923775:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:64898:x1875060695322496:12345-192.168.201.20@tcp:13:lfs.0 00000100:00080000:1.0:1788200822.923908:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1788200822.923951:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200822.924063:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:64898:x1875060695322496:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 289us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200822.924071:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2055 00000100:00100000:3.0:1788200823.052190:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200823.052406:0:66321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695322624 00000100:00100000:2.0:1788200823.052417:0:66321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695322624 00000100:00100000:2.0:1788200823.052478:0:66321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:2.0:1788200823.052488:0:66321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4292087e-fa00-4621-b681-837afc99ae35+6:64905:x1875060695322624:12345-192.168.201.20@tcp:700:mcreate.0 00000100:00100000:2.0:1788200823.052560:0:66321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4292087e-fa00-4621-b681-837afc99ae35+6:64905:x1875060695322624:12345-192.168.201.20@tcp:700:mcreate.0 Request processed in 74us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200823.052565:0:66321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:1.0:1788200823.058544:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200823.058807:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695322880 00000100:00100000:0.0:1788200823.058818:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695322880 00000100:00100000:0.0:1788200823.058879:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1036 00000100:00100000:0.0:1788200823.058889:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+6:64905:x1875060695322880:12345-192.168.201.20@tcp:36:mcreate.0 00010000:00010000:0.0:1788200823.058946:0:69485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788200823.058975:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a3bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786515 expref: 6 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.059150:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc11248c400) 00010000:00010000:0.0:1788200823.059230:0:69485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788200823.059301:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a3c4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.059315:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a3c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.059324:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a3c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.059336:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9e00/0x96d0c9b8c9a1a3cb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.059366:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9e00/0x96d0c9b8c9a1a3cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.059373:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9e00/0x96d0c9b8c9a1a3cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.059830:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a3c4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.059839:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a3c4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.059845:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a3c4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.059851:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a3c4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.059857:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788200823.059862:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a3c4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.059869:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a3c4 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.059879:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc11248c600) 00010000:00010000:0.0:1788200823.059881:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788200823.059885:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a3c4 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.059892:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a3c4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788200823.059916:0:69485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021f58351 reply state 00000000f600556f transno 98784247810 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9e00/0x96d0c9b8c9a1a3cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.059927:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9e00/0x96d0c9b8c9a1a3cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.059934:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc11248c500) 00010000:00010000:0.0:1788200823.059936:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788200823.059939:0:69485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788200823.060354:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+7:64905:x1875060695322880:12345-192.168.201.20@tcp:36:mcreate.0 Request processed in 1463us (1818us total) trans 98784247810 rc 0/0 00000100:00100000:0.0:1788200823.060363:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1036 00000100:00100000:3.0:1788200823.094609:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200823.094772:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695323008 00000100:00100000:0.0:1788200823.094782:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695323008 00000100:00100000:0.0:1788200823.094849:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1037 00000100:00100000:0.0:1788200823.094870:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+7:64908:x1875060695323008:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1788200823.094896:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200823.094919:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a3d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78651c expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.094994:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a3d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.095008:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.095271:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788200823.095330:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788200823.095333:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:0.0:1788200823.095353:0:66312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.095376:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a3d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78651c expref: 9 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.095393:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a3d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78651c expref: 8 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.095402:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc11248c600) 00010000:00010000:0.0:1788200823.095405:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788200823.095408:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ce8c00, rc 0) 00000100:00100000:0.0:1788200823.095516:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+8:64908:x1875060695323008:12345-192.168.201.20@tcp:101:rm.0 Request processed in 648us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200823.095523:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1037 00000100:00100000:0.0:1788200823.103489:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200823.103576:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695323136 00000100:00100000:2.0:1788200823.103593:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695323136 00000100:00100000:2.0:1788200823.103661:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1038 00000100:00100000:2.0:1788200823.103671:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+8:64908:x1875060695323136:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:2.0:1788200823.103692:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788200823.103714:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1a3e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786523 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.103776:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1a3e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.103791:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1a3e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.103802:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1a3e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.103831:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1a3ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.103840:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1a3ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.103847:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1a3ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.103942:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a3f5 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.103951:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a3f5 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.103958:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a3f5 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788200823.104010:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x1:0x0]: returning size 0 00000004:00200000:2.0:1788200823.104031:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1788200823.104066:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a3f5 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.104079:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a3f5 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.104116:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1a3e7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.104122:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1a3e7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.104137:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1a3e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.104143:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1a3e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.104148:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788200823.104151:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1a3e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.104158:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1a3e7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.104171:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc11248c600) 00010000:00010000:2.0:1788200823.104174:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788200823.104178:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1a3e7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.104184:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1a3e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.104198:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1a3ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.104204:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1a3ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.104209:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1a3ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.104214:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064eca00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788200823.104223:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1a3ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.104229:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1a3ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.104236:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc11248c500) 00010000:00010000:2.0:1788200823.104239:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788200823.104242:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1a3ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.104247:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1a3ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.104271:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1a3e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786523 expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.104283:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a3f5 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786523 expref: 9 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200823.104289:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff8dc12f13a900) 00010000:00010000:2.0:1788200823.104291:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788200823.104307:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ede00, rc 0) 00000100:00100000:2.0:1788200823.104373:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+9:64908:x1875060695323136:12345-192.168.201.20@tcp:101:rm.0 Request processed in 703us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200823.104380:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1038 00000100:00100000:0.0:1788200823.113218:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200823.113557:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695323392 00000100:00100000:3.0:1788200823.113569:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695323392 00000100:00100000:0.0:1788200823.113804:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1039 00000100:00100000:0.0:1788200823.113816:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+9:64908:x1875060695323392:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:0.0:1788200823.113883:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788200823.113912:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a3f5 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786523 expref: 9 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.113932:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff8dc12f13a900) 00010000:00010000:0.0:1788200823.113966:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a3d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78651c expref: 8 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.113987:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc11248c600) 00010000:00010000:0.0:1788200823.113994:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788200823.114106:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a3fc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.114118:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a3fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.114129:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a3fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.114141:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9400/0x96d0c9b8c9a1a403 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.114148:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9400/0x96d0c9b8c9a1a403 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.114155:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9400/0x96d0c9b8c9a1a403 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.114231:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8600/0x96d0c9b8c9a1a40a lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.114239:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8600/0x96d0c9b8c9a1a40a lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.114245:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8600/0x96d0c9b8c9a1a40a lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.114897:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a411 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.114919:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a411 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.114928:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a411 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.114935:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a411 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.114941:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a411 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.114946:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a411 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.115127:0:66313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788200823.115151:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8600/0x96d0c9b8c9a1a40a lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.115159:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8600/0x96d0c9b8c9a1a40a lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.115165:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8600/0x96d0c9b8c9a1a40a lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.115171:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788200823.115176:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8600/0x96d0c9b8c9a1a40a lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.115182:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8600/0x96d0c9b8c9a1a40a lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.115204:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff8dc11248c700) 00010000:00010000:0.0:1788200823.115207:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788200823.115211:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8600/0x96d0c9b8c9a1a40a lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.115216:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8600/0x96d0c9b8c9a1a40a lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.115236:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a3fc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.115242:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a3fc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.115248:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a3fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.115254:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a3fc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.115259:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788200823.115262:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a3fc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.115268:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a3fc lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.115276:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc11248c400) 00010000:00010000:0.0:1788200823.115278:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788200823.115281:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a3fc lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200823.115393:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200823.115408:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a411 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200823.115423:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200823.115426:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a411 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200823.115433:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a411 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200823.115442:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff8dc11248c700) 00010000:00010000:3.0:1788200823.115444:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788200823.115448:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a411 lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200823.115453:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a411 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200823.115470:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200823.115472:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200823.115473:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200823.115566:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a3fc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788200823.115708:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae174cfa reply state 000000006f6fb5be transno 98784247811 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9400/0x96d0c9b8c9a1a403 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.115723:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9400/0x96d0c9b8c9a1a403 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200823.115730:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc11248c500) 00010000:00010000:0.0:1788200823.115732:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788200823.115735:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788200823.115831:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+9:64908:x1875060695323392:12345-192.168.201.20@tcp:36:rm.0 Request processed in 2014us (2619us total) trans 98784247811 rc 0/0 00000100:00100000:0.0:1788200823.115840:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1039 00010000:00010000:0.0:1788200823.506736:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788200824.148958:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715008256:0@lo:400:kworker.0 00000100:00100000:0.0:1788200824.149041:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200824.149087:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715008768:0@lo:400:kworker.0 00000100:00100000:0.0:1788200824.149112:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200824.149132:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715009280:0@lo:400:kworker.0 00000100:00100000:0.0:1788200824.149153:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200824.149177:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788200824.149183:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715008128:0@lo:400:kworker.0 00000100:00100000:0.0:1788200824.149205:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200824.149224:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715008640:0@lo:400:kworker.0 00000100:00100000:0.0:1788200824.149269:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200824.149288:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715009152:0@lo:400:kworker.0 00000100:00100000:0.0:1788200824.149308:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200824.149412:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715007872:0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.149446:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200824.149474:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715008384:0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.149493:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200824.149507:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715008896:0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.149524:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200824.149538:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715009408:0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.149556:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200824.149581:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788200824.149587:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715008000:0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.149607:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200824.149617:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715008512:0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.149635:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200824.149651:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715009024:0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.149670:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200824.149703:0:83387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715007872 00000100:00100000:1.0:1788200824.149711:0:83387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715007872 00000100:00100000:1.0:1788200824.149754:0:83387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788200824.149763:0:83387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120182c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715007872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.149813:0:83387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120182c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715007872:12345-0@lo:400:kworker.0 Request processed in 50us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200824.149820:0:83387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788200824.149855:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715008256 00000100:00100000:1.0:1788200824.149859:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715008256 00000100:00100000:1.0:1788200824.149888:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715008128 00000100:00100000:1.0:1788200824.149891:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715008128 00000100:00100000:1.0:1788200824.149903:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715008384 00000100:00100000:1.0:1788200824.149905:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715008384 00000100:00100000:1.0:1788200824.149918:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:1.0:1788200824.149924:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715008256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.149961:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715008256:12345-0@lo:400:kworker.0 Request processed in 38us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200824.149967:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:1.0:1788200824.149979:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715008896 00000100:00100000:1.0:1788200824.149981:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715008896 00000100:00100000:1.0:1788200824.149991:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715009408 00000100:00100000:1.0:1788200824.150000:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715009408 00000100:00100000:1.0:1788200824.150040:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715008000 00000100:00100000:1.0:1788200824.150043:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715008000 00000100:00100000:1.0:1788200824.150057:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:1.0:1788200824.150063:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715008128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.150103:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715008128:12345-0@lo:400:kworker.0 Request processed in 40us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200824.150109:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:1.0:1788200824.150122:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:1.0:1788200824.150128:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715008384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.150152:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715008384:12345-0@lo:400:kworker.0 Request processed in 25us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200824.150157:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:1.0:1788200824.150167:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:1.0:1788200824.150172:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715008896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.150195:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715008896:12345-0@lo:400:kworker.0 Request processed in 23us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200824.150199:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:1.0:1788200824.150209:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:1.0:1788200824.150214:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715009408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.150237:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715009408:12345-0@lo:400:kworker.0 Request processed in 22us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200824.150241:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:1.0:1788200824.150252:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:1.0:1788200824.150259:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715008000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.150282:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715008000:12345-0@lo:400:kworker.0 Request processed in 25us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200824.150294:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00100000:1.0:1788200824.150324:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715008512 00000100:00100000:1.0:1788200824.150329:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715008512 00000100:00100000:1.0:1788200824.150351:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715009024 00000100:00100000:1.0:1788200824.150354:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715009024 00000100:00100000:1.0:1788200824.150370:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3787 00000100:00100000:1.0:1788200824.150376:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715008512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.150409:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715008512:12345-0@lo:400:kworker.0 Request processed in 32us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200824.150415:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3787 00000100:00100000:1.0:1788200824.150427:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3788 00000100:00100000:1.0:1788200824.150433:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715009024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.150459:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715009024:12345-0@lo:400:kworker.0 Request processed in 26us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200824.150465:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3788 00000100:00080000:1.0:1788200824.150488:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788200824.150492:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788200824.150550:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715008000:0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.150563:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715008512:0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.150572:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715009024:0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.150581:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715007872:0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.150591:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715008384:0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.150601:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715008896:0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.150623:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715009408:0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.150672:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715008128:0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.150684:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715008256:0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.152139:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715008768 00000100:00100000:1.0:1788200824.152152:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715008768 00000100:00100000:1.0:1788200824.152203:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715009280 00000100:00100000:1.0:1788200824.152207:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715009280 00000100:00100000:1.0:1788200824.152231:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715008640 00000100:00100000:1.0:1788200824.152234:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715008640 00000100:00100000:1.0:1788200824.152251:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715009152 00000100:00100000:1.0:1788200824.152254:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715009152 00000100:00100000:1.0:1788200824.152278:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2544 00000100:00100000:1.0:1788200824.152287:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715008768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.152358:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715008768:12345-0@lo:400:kworker.0 Request processed in 72us (3245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200824.152365:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2544 00000100:00100000:1.0:1788200824.152380:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2545 00000100:00100000:1.0:1788200824.152387:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715009280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.152417:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715009280:12345-0@lo:400:kworker.0 Request processed in 31us (3263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200824.152423:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2545 00000100:00100000:1.0:1788200824.152434:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2546 00000100:00100000:1.0:1788200824.152441:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715008640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.152467:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715008640:12345-0@lo:400:kworker.0 Request processed in 27us (3197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200824.152484:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2546 00000100:00100000:1.0:1788200824.152497:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2547 00000100:00100000:1.0:1788200824.152502:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715009152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.152532:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715009152:12345-0@lo:400:kworker.0 Request processed in 30us (3223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200824.152538:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2547 00000100:00080000:1.0:1788200824.158135:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788200824.158146:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788200824.158204:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715008640:0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.158221:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715009152:0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.158234:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715008768:0@lo:400:kworker.0 00000100:00100000:1.0:1788200824.158245:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969448 gen 2 00000004:00080000:1.0:1788200824.158250:0:3656:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dc120091880, transno 4294969448 00000100:00100000:1.0:1788200824.158270:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715009280:0@lo:400:kworker.0 00000100:00100000:0.0:1788200824.287191:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200824.287232:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200824.287262:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200824.287289:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200824.287305:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695324032 00000100:00100000:3.0:1788200824.287316:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695324032 00000100:00100000:0.0:1788200824.287319:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200824.287342:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695323776 00000100:00100000:0.0:1788200824.287347:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695323776 00000100:00100000:3.0:1788200824.287408:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695323904 00000100:00100000:3.0:1788200824.287412:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695323904 00000100:00100000:2.0:1788200824.287457:0:83384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695323520 00000100:00100000:2.0:1788200824.287462:0:83384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695323520 00000100:00100000:2.0:1788200824.287500:0:83384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 159 00000100:00100000:2.0:1788200824.287513:0:83384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2402:x1875060695323520:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788200824.287602:0:83384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2402:x1875060695323520:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 93us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200824.287608:0:83384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 159 00000100:00100000:0.0:1788200824.289519:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695323648 00000100:00100000:0.0:1788200824.289528:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695323648 00000100:00100000:3.0:1788200824.289555:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2548 00000100:00100000:3.0:1788200824.289581:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:4292087e-fa00-4621-b681-837afc99ae35+5:2402:x1875060695324032:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200824.289669:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:4292087e-fa00-4621-b681-837afc99ae35+5:2402:x1875060695324032:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 104us (2405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200824.289677:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2548 00000100:00100000:3.0:1788200824.289696:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2549 00000100:00100000:3.0:1788200824.289703:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:4292087e-fa00-4621-b681-837afc99ae35+5:2402:x1875060695323904:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200824.289727:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:4292087e-fa00-4621-b681-837afc99ae35+5:2402:x1875060695323904:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (2408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200824.289733:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2549 00000100:00100000:1.0:1788200824.290099:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1040 00000100:00100000:1.0:1788200824.290111:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695323776:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788200824.290141:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695323776:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 35us (2910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200824.290148:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1040 00000100:00100000:1.0:1788200824.290163:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1041 00000100:00100000:1.0:1788200824.290168:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+9:2402:x1875060695323648:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000080:1.0:1788200824.290183:0:66313:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12ee2d180 x1875060695323648/t0(0) o400->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:700/0 lens 224/224 e 0 to 0 dl 1788200835 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788200824.290213:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+9:2402:x1875060695323648:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 45us (2925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200824.290219:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1041 00000100:00080000:3.0:1788200824.290479:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788200824.290485:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788200824.290487:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788200824.290489:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788200824.527242:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788200824.658779:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715009536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788200824.658854:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200824.658886:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0073bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715009664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788200824.658924:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200824.658937:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715009536 00000100:00100000:3.0:1788200824.658946:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715009536 00000100:00100000:3.0:1788200824.659004:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715009664 00000100:00100000:3.0:1788200824.659007:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715009664 00000100:00100000:3.0:1788200824.659037:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2056 00000100:00100000:3.0:1788200824.659044:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715009536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788200824.659081:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200824.659168:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2057 00000100:00100000:1.0:1788200824.659180:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715009664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788200824.659200:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200824.659246:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715009664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200824.659258:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2057 00000100:00100000:3.0:1788200824.659258:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715009536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 210us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200824.659267:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2056 00000100:00100000:1.0:1788200824.659320:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0073bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715009664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788200824.659618:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715009536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788200825.167203:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788200825.167229:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0073bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715009792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788200825.167302:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200825.167388:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715009792 00000100:00100000:1.0:1788200825.167397:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715009792 00000100:00100000:1.0:1788200825.167446:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2058 00000100:00100000:1.0:1788200825.167456:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715009792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788200825.167478:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200825.167529:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715009792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200825.167536:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2058 00000100:00100000:0.0:1788200825.167686:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0073bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715009792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788200825.168305:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788200825.168318:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715009920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788200825.168357:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200825.168530:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715009920 00000100:00100000:1.0:1788200825.168535:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715009920 00000100:00100000:1.0:1788200825.168576:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3789 00000100:00100000:1.0:1788200825.168584:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715009920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788200825.168618:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444974592 avail 1298735104 00010000:00000080:1.0:1788200825.168632:0:23728:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004fa2a00 x1875060715009920/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:701/0 lens 224/368 e 0 to 0 dl 1788200836 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788200825.168672:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715009920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200825.168679:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3789 00000100:00100000:1.0:1788200825.168710:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715009920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788200825.172592:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788200825.172617:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715010048:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788200825.172691:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200825.172740:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715010048 00000100:00100000:1.0:1788200825.172748:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715010048 00000100:00100000:1.0:1788200825.172800:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2059 00000100:00100000:1.0:1788200825.172809:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715010048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788200825.172842:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200825.172887:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715010048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200825.172894:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2059 00000100:00100000:1.0:1788200825.172943:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715010048:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788200825.553129:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200826.575493:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200827.225604:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715010176:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788200827.225688:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200827.227166:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715010176 00000100:00100000:3.0:1788200827.227178:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715010176 00000100:00100000:3.0:1788200827.227224:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3790 00000100:00100000:3.0:1788200827.227233:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715010176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788200827.227634:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:3.0:1788200827.227706:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715010176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 472us (2016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200827.227713:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3790 00000100:00100000:0.0:1788200827.228511:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715010176:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788200827.599181:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788200828.247593:0:83379:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247811 is committed 00010000:00010000:1.0:1788200828.250390:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9e00/0x96d0c9b8c9a1a3cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200828.250407:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9e00/0x96d0c9b8c9a1a3cb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200828.250422:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9e00/0x96d0c9b8c9a1a3cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200828.250428:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce9e00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788200828.250433:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9e00/0x96d0c9b8c9a1a3cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200828.250515:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9e00/0x96d0c9b8c9a1a3cb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200828.250534:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc11248c500) 00010000:00010000:1.0:1788200828.250537:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788200828.250542:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9e00/0x96d0c9b8c9a1a3cb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200828.250549:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9e00/0x96d0c9b8c9a1a3cb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200828.250566:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9400/0x96d0c9b8c9a1a403 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200828.250572:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9400/0x96d0c9b8c9a1a403 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200828.250577:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9400/0x96d0c9b8c9a1a403 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200828.250582:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce9400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788200828.250585:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9400/0x96d0c9b8c9a1a403 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200828.250603:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9400/0x96d0c9b8c9a1a403 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200828.250612:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc11248c500) 00010000:00010000:1.0:1788200828.250614:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788200828.250617:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9400/0x96d0c9b8c9a1a403 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200828.250623:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9400/0x96d0c9b8c9a1a403 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200828.623505:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788200829.264235:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715010304:0@lo:400:kworker.0 00000100:00100000:0.0:1788200829.264305:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200829.264344:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120020700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715010816:0@lo:400:kworker.0 00000100:00100000:0.0:1788200829.264381:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200829.264401:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120023480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715011328:0@lo:400:kworker.0 00000100:00100000:2.0:1788200829.266093:0:83387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715010304 00000100:00100000:2.0:1788200829.266105:0:83387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715010304 00000100:00100000:0.0:1788200829.267612:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200829.279032:0:83387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788200829.279059:0:83387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120181050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715010304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200829.279151:0:83387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120181050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715010304:12345-0@lo:400:kworker.0 Request processed in 106us (14846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200829.279159:0:83387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788200829.279212:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715010560:0@lo:400:kworker.0 00000100:00100000:2.0:1788200829.279247:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715010432:0@lo:400:kworker.0 00000100:00100000:2.0:1788200829.279273:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120022a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715010688:0@lo:400:kworker.0 00000100:00100000:0.0:1788200829.286635:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120021180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715011840:0@lo:400:kworker.0 00000100:00100000:0.0:1788200829.286726:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200829.308437:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200829.309480:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715010816 00000100:00100000:1.0:1788200829.309492:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715010816 00000100:00100000:1.0:1788200829.309568:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715011328 00000100:00100000:1.0:1788200829.309571:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715011328 00000100:00100000:1.0:1788200829.309590:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715011840 00000100:00100000:1.0:1788200829.309593:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715011840 00000100:00100000:1.0:1788200829.309610:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:1.0:1788200829.309620:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120021500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715010816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200829.311551:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120021500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715010816:12345-0@lo:400:kworker.0 Request processed in 1922us (47159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200829.311564:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00100000:1.0:1788200829.311600:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:1.0:1788200829.311610:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715011328:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788200829.311626:0:66757:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc120022d80 x1875060715011328/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:705/0 lens 224/224 e 0 to 0 dl 1788200840 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788200829.311671:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715011328:12345-0@lo:400:kworker.0 Request processed in 65us (44065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200829.311692:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00100000:1.0:1788200829.311705:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:1.0:1788200829.313507:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715011840:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788200829.313538:0:66757:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc120023b80 x1875060715011840/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:705/0 lens 224/224 e 0 to 0 dl 1788200840 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788200829.313603:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715011840:12345-0@lo:400:kworker.0 Request processed in 1892us (26877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200829.313613:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:0.0:1788200829.314581:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715010304:0@lo:400:kworker.0 00000100:00100000:0.0:1788200829.314601:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120020700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715010816:0@lo:400:kworker.0 00000100:00100000:0.0:1788200829.314612:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120023480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715011328:0@lo:400:kworker.0 00000100:00100000:0.0:1788200829.314623:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120021180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715011840:0@lo:400:kworker.0 00000100:00080000:0.0:1788200829.319132:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788200829.319594:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715010432 00000100:00100000:1.0:1788200829.319605:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715010432 00000100:00100000:1.0:1788200829.319665:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:1.0:1788200829.319675:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715010432:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788200829.319702:0:66757:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc118142a00 x1875060715010432/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:705/0 lens 224/224 e 0 to 0 dl 1788200840 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788200829.319714:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200829.319751:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715011072:0@lo:400:kworker.0 00000100:00100000:1.0:1788200829.319762:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715010432:12345-0@lo:400:kworker.0 Request processed in 90us (11333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200829.319768:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:1.0:1788200829.319786:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715010560 00000100:00100000:2.0:1788200829.319788:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200829.319789:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715010560 00000100:00100000:1.0:1788200829.319810:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:1.0:1788200829.319815:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715010560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200829.319821:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120020000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715011584:0@lo:400:kworker.0 00000100:00100000:1.0:1788200829.319842:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715010560:12345-0@lo:400:kworker.0 Request processed in 27us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200829.319842:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200829.319848:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:2.0:1788200829.319882:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715010560:0@lo:400:kworker.0 00000100:00100000:0.0:1788200829.319906:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200829.319913:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715011072 00000100:00100000:2.0:1788200829.319917:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715011072 00000100:00100000:2.0:1788200829.319947:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715011584 00000100:00100000:2.0:1788200829.319950:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715011584 00000100:00100000:2.0:1788200829.319969:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550 00000100:00100000:2.0:1788200829.319975:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715011072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200829.320252:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715010432:0@lo:400:kworker.0 00000100:00100000:3.0:1788200829.320261:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715010944:0@lo:400:kworker.0 00000100:00100000:3.0:1788200829.320483:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200829.320512:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715010944 00000100:00100000:3.0:1788200829.320515:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715010944 00000100:00100000:3.0:1788200829.320544:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3791 00000100:00100000:3.0:1788200829.320551:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715010944:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788200829.320568:0:23728:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc118140700 x1875060715010944/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:705/0 lens 224/224 e 0 to 0 dl 1788200840 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788200829.320598:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715010944:12345-0@lo:400:kworker.0 Request processed in 47us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200829.320604:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3791 00000100:00100000:3.0:1788200829.320631:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715010944:0@lo:400:kworker.0 00000100:00100000:3.0:1788200829.320779:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120021c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715011456:0@lo:400:kworker.0 00000100:00100000:3.0:1788200829.320808:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200829.320833:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715011456 00000100:00100000:3.0:1788200829.320845:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715011456 00000100:00100000:3.0:1788200829.320873:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3792 00000100:00100000:3.0:1788200829.320879:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715011456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200829.320913:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715011456:12345-0@lo:400:kworker.0 Request processed in 34us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200829.320920:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3792 00000100:00100000:3.0:1788200829.320949:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120021c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715011456:0@lo:400:kworker.0 00000100:00100000:0.0:1788200829.321568:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120022680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715011200:0@lo:400:kworker.0 00000100:00100000:0.0:1788200829.321598:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200829.321620:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715011712:0@lo:400:kworker.0 00000100:00100000:0.0:1788200829.321643:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788200829.321679:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788200829.321685:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788200829.321687:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788200829.322535:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715011200 00000100:00100000:3.0:1788200829.322544:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715011200 00000100:00100000:3.0:1788200829.322591:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715011712 00000100:00100000:3.0:1788200829.322594:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715011712 00000100:00100000:3.0:1788200829.322617:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551 00000100:00100000:3.0:1788200829.322627:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715011584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200829.322897:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715010688 00000100:00100000:1.0:1788200829.322911:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715010688 00000100:00100000:1.0:1788200829.324098:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:1.0:1788200829.324109:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715010688:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788200829.324296:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc120021180 x1875060715010688/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:705/0 lens 224/224 e 0 to 0 dl 1788200840 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788200829.324351:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715010688:12345-0@lo:400:kworker.0 Request processed in 244us (4443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200829.324358:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:3.0:1788200829.324481:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715011584:12345-0@lo:400:kworker.0 Request processed in 1855us (4636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200829.324489:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551 00000100:00100000:3.0:1788200829.324508:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2552 00000100:00100000:3.0:1788200829.324518:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120023480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715011200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200829.324549:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120023480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715011200:12345-0@lo:400:kworker.0 Request processed in 35us (2950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200829.324555:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2552 00000100:00100000:3.0:1788200829.324569:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2553 00000100:00100000:3.0:1788200829.324576:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120020700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715011712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200829.324604:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120020700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715011712:12345-0@lo:400:kworker.0 Request processed in 29us (2961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200829.324610:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2553 00000100:00080000:0.0:1788200829.325066:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788200829.325072:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788200829.325108:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120022a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715010688:0@lo:400:kworker.0 00000100:00100000:0.0:1788200829.325254:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120022680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715011200:0@lo:400:kworker.0 00000100:00100000:0.0:1788200829.325265:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715011712:0@lo:400:kworker.0 00000100:00100000:0.0:1788200829.326085:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715011072:0@lo:400:kworker.0 00000100:00100000:0.0:1788200829.326098:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120020000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715011584:0@lo:400:kworker.0 00000100:00100000:2.0:1788200829.327928:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715011072:12345-0@lo:400:kworker.0 Request processed in 7944us (8129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200829.327943:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550 00000100:00100000:3.0:1788200829.399589:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200829.399629:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200829.399657:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200829.399696:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200829.399725:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200829.399772:0:83384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695324160 00000100:00100000:3.0:1788200829.399783:0:83384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695324160 00000100:00100000:3.0:1788200829.399843:0:83384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 161 00000100:00100000:3.0:1788200829.399854:0:83384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2403:x1875060695324160:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200829.399933:0:83384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2403:x1875060695324160:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 81us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200829.399942:0:83384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 161 00000100:00100000:3.0:1788200829.399994:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695324416 00000100:00100000:3.0:1788200829.399998:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695324416 00000100:00100000:3.0:1788200829.400057:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695324288 00000100:00100000:3.0:1788200829.400061:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695324288 00000100:00100000:3.0:1788200829.400088:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1048 00000100:00100000:3.0:1788200829.400095:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695324416:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200829.400131:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695324416:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 36us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200829.400138:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1048 00000100:00100000:3.0:1788200829.400153:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1049 00000100:00100000:3.0:1788200829.400160:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695324288:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000080:3.0:1788200829.400175:0:66313:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc118143480 x1875060695324288/t0(0) o400->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:705/0 lens 224/224 e 0 to 0 dl 1788200840 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788200829.400198:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695324288:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 39us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200829.400225:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1049 00000100:00100000:3.0:1788200829.400246:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695324672 00000100:00100000:3.0:1788200829.400249:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695324672 00000100:00100000:3.0:1788200829.400279:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695324544 00000100:00100000:3.0:1788200829.400282:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695324544 00000100:00100000:3.0:1788200829.400305:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2554 00000100:00100000:3.0:1788200829.400312:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695324672:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200829.400341:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695324672:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 29us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200829.400347:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2554 00000100:00100000:3.0:1788200829.400360:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2555 00000100:00100000:3.0:1788200829.400367:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695324544:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200829.400392:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695324544:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200829.400398:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2555 00000100:00080000:3.0:1788200829.400558:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788200829.400563:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788200829.400566:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788200829.400568:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:0.0:1788200829.581525:0:84513:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00010000:00010000:2.0:1788200829.647388:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200829.672857:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200829.674337:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695324800 00000100:00100000:3.0:1788200829.674352:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695324800 00000100:00100000:3.0:1788200829.674431:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1040 00000100:00100000:3.0:1788200829.674443:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+5:64975:x1875060695324800:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1788200829.674466:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788200829.674490:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c600/0x96d0c9b8c9a1a418 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78652a expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200829.674576:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1a41f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200829.674590:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1a41f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200829.674603:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1a41f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788200829.674652:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788200829.674656:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:3.0:1788200829.674675:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1a41f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200829.674699:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c600/0x96d0c9b8c9a1a418 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78652a expref: 7 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200829.674718:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1a41f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78652a expref: 6 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200829.674726:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc11d3a3a00) 00010000:00010000:3.0:1788200829.674729:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788200829.674733:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2c400, rc 0) 00010000:00000080:3.0:1788200829.674741:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc120091880 x1875060695324800/t0(0) o101->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:705/0 lens 576/688 e 0 to 0 dl 1788200840 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788200829.674803:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:64975:x1875060695324800:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 363us (1959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200829.674810:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1040 00000100:00100000:3.0:1788200829.677491:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200829.678140:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695324928 00000100:00100000:0.0:1788200829.678166:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695324928 00000100:00100000:0.0:1788200829.678230:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1041 00000100:00100000:0.0:1788200829.678240:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+6:64975:x1875060695324928:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788200829.678259:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200829.678287:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9a00/0x96d0c9b8c9a1a426 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786531 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200829.678623:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a42d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200829.678636:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a42d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200829.678648:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a42d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200829.678663:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a434 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200829.678670:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a434 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200829.678676:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a434 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200829.678718:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a42d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200829.678725:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a42d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200829.678731:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a42d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200829.678743:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a42d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200829.678749:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce9000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788200829.678753:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a42d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200829.678761:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a42d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200829.678773:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc11d3a3a00) 00010000:00010000:0.0:1788200829.678776:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788200829.678780:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a42d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200829.678786:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a42d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200829.678800:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a434 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200829.678806:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a434 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200829.678812:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a434 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200829.678817:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788200829.678820:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a434 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200829.678836:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a434 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200829.678845:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff8dc11248c600) 00010000:00010000:0.0:1788200829.678847:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788200829.678850:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a434 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200829.678855:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a434 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200829.678884:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9a00/0x96d0c9b8c9a1a426 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786531 expref: 7 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200829.678893:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc11d3a3a00) 00010000:00010000:0.0:1788200829.678896:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788200829.678899:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9a00/0x96d0c9b8c9a1a426 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786531 expref: 7 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200829.678908:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ce9a00, rc 0) 00010000:00000080:0.0:1788200829.678914:0:69485:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc118140000 x1875060695324928/t0(0) o101->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:705/0 lens 592/584 e 0 to 0 dl 1788200840 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788200829.678991:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+6:64975:x1875060695324928:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 752us (1512us total) trans 0 rc 301/301 00000100:00100000:0.0:1788200829.678999:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1041 00000100:00100000:3.0:1788200829.685100:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200829.685160:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695325184 00000100:00100000:1.0:1788200829.685170:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695325184 00000100:00100000:1.0:1788200829.685236:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1042 00000100:00100000:1.0:1788200829.685247:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:64975:x1875060695325184:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1788200829.685275:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788200829.685277:0:66312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788200829.685306:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1a41f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78652a expref: 6 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200829.685320:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc11d3a3a00) 00010000:00010000:1.0:1788200829.685330:0:66312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788200829.685341:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1a43b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786538 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200829.685422:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1a442 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200829.685432:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1a442 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200829.685446:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1a442 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200829.685455:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1a449 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200829.685459:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1a449 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200829.685463:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1a449 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200829.685822:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1a450 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200829.685830:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1a450 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200829.685834:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1a450 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788200829.685841:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788200829.685861:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1a442 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200829.685866:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1a442 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200829.685870:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1a442 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200829.685874:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1a442 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200829.685883:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782cc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788200829.685886:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1a442 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200829.685891:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1a442 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200829.685897:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048be500) 00010000:00010000:1.0:1788200829.685899:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788200829.685901:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1a442 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200829.685905:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1a442 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788200829.685912:0:66312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3e7d8a1 reply state 00000000cd85e4bb transno 98784247812 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1a449 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200829.685919:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1a449 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200829.685923:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff8dc0048bec00) 00010000:00010000:1.0:1788200829.685924:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788200829.685926:0:66312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788200829.685946:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1a43b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786538 expref: 8 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200829.685956:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1a450 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786538 expref: 7 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200829.685968:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff8dc0048be600) 00010000:00010000:1.0:1788200829.685969:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788200829.685971:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782d000, rc 0) 00010000:00000080:1.0:1788200829.685993:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc118141f80 x1875060695325184/t98784247812(0) o101->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:705/0 lens 536/608 e 0 to 0 dl 1788200840 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788200829.690958:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+8:64975:x1875060695325184:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 5696us (5848us total) trans 98784247812 rc 0/0 00000100:00100000:1.0:1788200829.690973:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1042 00000100:00100000:0.0:1788200829.697772:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200829.697844:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695325440 00000100:00100000:1.0:1788200829.697855:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695325440 00000100:00100000:1.0:1788200829.697921:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1043 00000100:00100000:1.0:1788200829.697932:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+8:64975:x1875060695325440:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1788200829.697958:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788200829.697992:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1a45e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78653f expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200829.698157:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1a465 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200829.698171:0:66313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1a450 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786538 expref: 9 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200829.698178:0:66313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1a465 lrc: 4/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200829.698223:0:66313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1a450 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786538 expref: 9 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200829.698245:0:66313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1a450 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786538 expref: 9 pid: 66312 timeout: 3781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788200829.698260:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66313:1875060715011968:192.168.201.20@tcp:104: 00000100:00100000:1.0:1788200829.698354:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005dfd480 going to sleep for 11 seconds 00000100:00100000:3.0:1788200829.702502:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200829.702679:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:66313:1875060715011968:192.168.201.20@tcp:104: 00010000:00010000:1.0:1788200829.702707:0:66313:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1a465 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200829.702764:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695325568 00000100:00100000:2.0:1788200829.702771:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695325568 00010000:00010000:2.0:1788200829.702807:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1a450 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786538 expref: 10 pid: 66312 timeout: 3781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200829.702892:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2547 00000100:00100000:2.0:1788200829.702905:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118143b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4292087e-fa00-4621-b681-837afc99ae35+10:2400:x1875060695325568:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788200829.702921:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788200829.702929:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1a450 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786538 expref: 10 pid: 66312 timeout: 3781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200829.702942:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1a450 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786538 expref: 10 pid: 66312 timeout: 3781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200829.702990:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1a450 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786538 expref: 10 pid: 66312 timeout: 3781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200829.703005:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff8dc0048be600) 00010000:00010000:2.0:1788200829.703010:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1a465 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200829.703083:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1a465 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200829.703090:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1a465 lrc: 4/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200829.703111:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788200829.703168:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118143b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4292087e-fa00-4621-b681-837afc99ae35+9:2400:x1875060695325568:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 265us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200829.703176:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2547 00010000:00010000:3.0:1788200829.703233:0:66313:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1a465 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200829.703240:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1a465 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788200829.703258:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788200829.703601:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1a465 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200829.703610:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1a465 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200829.703617:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1a465 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200829.703623:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788200829.703627:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1a465 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200829.703634:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1a465 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200829.703644:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff8dc0048be600) 00010000:00010000:3.0:1788200829.703647:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788200829.703651:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1a465 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200829.703657:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1a465 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200829.703717:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1a45e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78653f expref: 9 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200829.703727:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048bee00) 00010000:00010000:3.0:1788200829.703729:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788200829.703733:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1a45e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78653f expref: 9 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200829.703815:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782d200, rc 0) 00010000:00000080:3.0:1788200829.703824:0:66313:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc120020000 x1875060695325440/t98784247813(0) o101->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:705/0 lens 712/824 e 0 to 0 dl 1788200840 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788200829.703857:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+8:64975:x1875060695325440:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 5928us (6096us total) trans 98784247813 rc 301/301 00000100:00100000:3.0:1788200829.703864:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1043 00000100:00100000:3.0:1788200829.721951:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200829.722104:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695325824 00000100:00100000:1.0:1788200829.722120:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695325824 00000100:00100000:1.0:1788200829.722169:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 213 00000100:00100000:1.0:1788200829.722180:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4292087e-fa00-4621-b681-837afc99ae35+8:64975:x1875060695325824:12345-192.168.201.20@tcp:35:lfs.0 00010000:00000080:1.0:1788200829.724832:0:66316:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc003a70e00 x1875060695325824/t98784247814(0) o35->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:705/0 lens 392/456 e 0 to 0 dl 1788200840 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788200829.724939:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4292087e-fa00-4621-b681-837afc99ae35+9:64975:x1875060695325824:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 2760us (2997us total) trans 98784247814 rc 0/0 00000100:00100000:1.0:1788200829.724950:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 213 00000100:00100000:2.0:1788200829.732880:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200829.732970:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695326080 00000100:00100000:3.0:1788200829.732988:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695326080 00000100:00100000:3.0:1788200829.733066:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 214 00000100:00100000:3.0:1788200829.733077:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4292087e-fa00-4621-b681-837afc99ae35+9:64975:x1875060695326080:12345-192.168.201.20@tcp:35:lfs.0 00010000:00000080:3.0:1788200829.733272:0:79137:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004fa1880 x1875060695326080/t98784247815(0) o35->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:705/0 lens 392/456 e 0 to 0 dl 1788200840 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788200829.733335:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4292087e-fa00-4621-b681-837afc99ae35+10:64975:x1875060695326080:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 259us (465us total) trans 98784247815 rc 0/0 00000100:00100000:3.0:1788200829.733342:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 214 00000100:00100000:0.0:1788200829.788860:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788200829.788893:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715012096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788200829.788962:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200829.789046:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715012096 00000100:00100000:0.0:1788200829.789054:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715012096 00000100:00100000:0.0:1788200829.789104:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2060 00000100:00100000:0.0:1788200829.789113:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120023800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715012096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788200829.789143:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200829.789190:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120023800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715012096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200829.789197:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2060 00000100:00100000:0.0:1788200829.789247:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715012096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788200829.790941:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715012224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788200829.791007:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200829.791119:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715012224 00000100:00100000:0.0:1788200829.791126:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715012224 00000100:00100000:0.0:1788200829.791172:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2061 00000100:00100000:0.0:1788200829.791182:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715012224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788200829.791205:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200829.791252:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715012224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200829.791259:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2061 00000100:00100000:0.0:1788200829.791558:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715012224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788200830.287937:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788200830.287960:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715012352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788200830.288063:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200830.288116:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715012352 00000100:00100000:0.0:1788200830.288124:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715012352 00000100:00100000:0.0:1788200830.288175:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2062 00000100:00100000:0.0:1788200830.288202:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120022680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715012352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788200830.288226:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200830.288274:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120022680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715012352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200830.288281:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2062 00000100:00100000:0.0:1788200830.288346:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715012352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788200830.288544:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788200830.288555:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715012480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788200830.288587:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200830.288661:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715012480 00000100:00100000:1.0:1788200830.288666:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715012480 00000100:00100000:1.0:1788200830.288699:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2063 00000100:00100000:1.0:1788200830.288706:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715012480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788200830.288725:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200830.288777:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715012480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200830.288784:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2063 00000100:00100000:1.0:1788200830.288817:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715012480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788200830.295764:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715012608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788200830.295842:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200830.295907:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715012608 00000100:00100000:2.0:1788200830.295915:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715012608 00000100:00100000:2.0:1788200830.295979:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3793 00000100:00100000:2.0:1788200830.295990:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715012608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788200830.296042:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444974592 avail 1298735104 00010000:00000080:2.0:1788200830.296060:0:23728:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004fa1500 x1875060715012608/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:706/0 lens 224/368 e 0 to 0 dl 1788200841 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788200830.296123:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715012608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200830.296130:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3793 00000100:00100000:2.0:1788200830.296179:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715012608:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788200830.671663:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200831.695258:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788200831.942482:0:84610:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788200831.942546:0:84610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee000/0x96d0c9b8c9a1a06e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a075 expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200831.942561:0:84610:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee000/0x96d0c9b8c9a1a06e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a075 expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200831.942568:0:84610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee000/0x96d0c9b8c9a1a06e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1a075 expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200831.942575:0:84610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee000/0x96d0c9b8c9a1a06e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1a075 expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200831.942599:0:84610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788200831.942605:0:84610:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788200831.942633:0:84610:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788200831.942640:0:84610:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788200831.942647:0:84610:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788200831.942677:0:84610:0:(import.c:65:import_set_state_nolock()) ffff8dc001e28800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788200831.942829:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200831.942837:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee000/0x96d0c9b8c9a1a06e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1a075 expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.942845:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075ee000 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788200831.942850:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee000/0x96d0c9b8c9a1a06e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1a075 expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.942868:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee000/0x96d0c9b8c9a1a06e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1a075 expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788200831.942877:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee000/0x96d0c9b8c9a1a06e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1a075 expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788200831.942883:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788200831.942885:0:13349:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788200831.942888:0:13349:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788200831.942917:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee000/0x96d0c9b8c9a1a06e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1a075 expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.942923:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788200831.942951:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee000/0x96d0c9b8c9a1a06e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1a075 expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.942973:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee000/0x96d0c9b8c9a1a06e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1a075 expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.942985:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200831.942987:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200831.942989:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788200831.943007:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715012736:0@lo:39:umount.0 00000100:00100000:2.0:1788200831.943099:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200831.943346:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715012864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788200831.943376:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200831.943423:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715012736 00000100:00100000:2.0:1788200831.943429:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715012736 00000100:00100000:2.0:1788200831.943474:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:2.0:1788200831.943483:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875060715012736:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788200831.943510:0:66757:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a18d 00000100:00080000:2.0:1788200831.943519:0:66757:0:(import.c:65:import_set_state_nolock()) ffff8dc002a51800 : changing import state from FULL to CLOSED 00010000:00000080:2.0:1788200831.943545:0:66757:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004fa3b80 x1875060715012736/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:707/0 lens 224/224 e 0 to 0 dl 1788200842 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788200831.943584:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3654:x1875060715012736:12345-0@lo:39:umount.0 Request processed in 102us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200831.943591:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000020:00000080:2.0:1788200831.943601:0:66757:0:(genops.c:885:class_export_put()) final put ffff8dc110732800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:2.0:1788200831.943625:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715012864 00000100:00100000:2.0:1788200831.943629:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715012864 00000100:00100000:2.0:1788200831.943657:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:2.0:1788200831.943663:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715012864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788200831.943681:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788200831.943696:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140758a00/0x96d0c9b8c9a1a075 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a06e expref: 24 pid: 83383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.945297:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788200831.945368:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c9b18af6-fecc-4172-82c2-66531890fe11+23:3658:x1875060715012864:12345-0@lo:103:ldlm_bl.0 Request processed in 1702us (1989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200831.945377:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00010000:00010000:2.0:1788200831.945415:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788200831.945426:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110732800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788200831.945480:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc002a51800 for lustre-MDT0000 00000100:00100000:2.0:1788200831.945598:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715012864:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788200831.945639:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001e28800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788200831.945651:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715012736:0@lo:39:umount.0 00000100:00080000:2.0:1788200831.945688:0:84610:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788200831.945691:0:84610:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788200831.945695:0:84610:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788200831.946566:0:84610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a19f95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a19f9c expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.946580:0:84610:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a19f95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a19f9c expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.946587:0:84610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a19f95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a19f9c expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.946593:0:84610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a19f95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a19f9c expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.946625:0:84610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788200831.946637:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200831.946642:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a19f95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a19f9c expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.946650:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140758c00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788200831.946653:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a19f95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a19f9c expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.946662:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a19f95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a19f9c expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788200831.946668:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a19f95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a19f9c expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788200831.946674:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788200831.946676:0:6521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788200831.946703:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a19f95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a19f9c expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.946709:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788200831.946740:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a19f95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a19f9c expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.946747:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a19f95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a19f9c expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.946759:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200831.946761:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200831.946768:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200831.946781:0:84610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee600/0x96d0c9b8c9a1a098 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a09f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.946789:0:84610:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee600/0x96d0c9b8c9a1a098 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a09f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.946794:0:84610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee600/0x96d0c9b8c9a1a098 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1a09f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.946800:0:84610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee600/0x96d0c9b8c9a1a098 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1a09f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.946812:0:84610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788200831.946817:0:84610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140759800/0x96d0c9b8c9a1a060 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a067 expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.946824:0:84610:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140759800/0x96d0c9b8c9a1a060 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a067 expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.946830:0:84610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140759800/0x96d0c9b8c9a1a060 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1a067 expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.946836:0:84610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc140759800/0x96d0c9b8c9a1a060 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1a067 expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.946847:0:84610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788200831.946855:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788200831.946859:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee600/0x96d0c9b8c9a1a098 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1a09f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.946873:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075ee600 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788200831.946876:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee600/0x96d0c9b8c9a1a098 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1a09f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.946882:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee600/0x96d0c9b8c9a1a098 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1a09f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788200831.946888:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee600/0x96d0c9b8c9a1a098 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1a09f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788200831.946892:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788200831.946894:0:13349:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788200831.946896:0:13349:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788200831.946912:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee600/0x96d0c9b8c9a1a098 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1a09f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.946918:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788200831.946925:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee600/0x96d0c9b8c9a1a098 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1a09f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.946932:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee600/0x96d0c9b8c9a1a098 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1a09f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.946952:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200831.946955:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc140759800/0x96d0c9b8c9a1a060 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1a067 expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.946962:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140759800 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788200831.946965:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc140759800/0x96d0c9b8c9a1a060 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1a067 expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.946977:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc140759800/0x96d0c9b8c9a1a060 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1a067 expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788200831.946983:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc140759800/0x96d0c9b8c9a1a060 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1a067 expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788200831.946988:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788200831.946989:0:13349:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788200831.946992:0:13349:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788200831.947004:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc140759800/0x96d0c9b8c9a1a060 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1a067 expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.947010:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788200831.947042:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc140759800/0x96d0c9b8c9a1a060 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1a067 expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.947050:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc140759800/0x96d0c9b8c9a1a060 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1a067 expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.947059:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200831.947061:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200831.947063:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788200831.947077:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715013248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788200831.947131:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788200831.947193:0:84610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140758e00/0x96d0c9b8c9a19f87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a19f8e expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.947202:0:84610:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140758e00/0x96d0c9b8c9a19f87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a19f8e expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.947218:0:84610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140758e00/0x96d0c9b8c9a19f87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a19f8e expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.947225:0:84610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc140758e00/0x96d0c9b8c9a19f87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a19f8e expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.947237:0:84610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788200831.947241:0:84610:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788200831.947245:0:84610:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1788200831.947275:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200831.947280:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc140758e00/0x96d0c9b8c9a19f87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a19f8e expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.947287:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140758e00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788200831.947289:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc140758e00/0x96d0c9b8c9a19f87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a19f8e expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.947296:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc140758e00/0x96d0c9b8c9a19f87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a19f8e expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788200831.947303:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc140758e00/0x96d0c9b8c9a19f87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a19f8e expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788200831.947308:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788200831.947310:0:6520:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788200831.947312:0:6520:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788200831.947325:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc140758e00/0x96d0c9b8c9a19f87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a19f8e expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.947331:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788200831.947348:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc140758e00/0x96d0c9b8c9a19f87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a19f8e expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.947356:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc140758e00/0x96d0c9b8c9a19f87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a19f8e expref: -99 pid: 83378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200831.947364:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200831.947366:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200831.947368:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788200831.947376:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715013376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788200831.947403:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1788200831.947441:0:84610:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788200831.947445:0:84610:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1788200831.947450:0:84610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1788200831.947456:0:84610:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:3.0:1788200831.948216:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715013248 00000100:00100000:3.0:1788200831.948225:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715013248 00000100:00100000:3.0:1788200831.948284:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715013376 00000100:00100000:3.0:1788200831.948288:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715013376 00000100:00100000:3.0:1788200831.948311:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:3.0:1788200831.948320:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715013248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788200831.948333:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788200831.948348:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1a067 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a060 expref: 24 pid: 83384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200831.948362:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788200831.948411:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+23:3657:x1875060715013248:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200831.948418:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:3.0:1788200831.948438:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1788200831.948445:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10a10e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+22:3658:x1875060715013376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788200831.948452:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788200831.948461:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a19f8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a19f87 expref: 22 pid: 83385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200831.948469:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788200831.948500:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10a10e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+21:3658:x1875060715013376:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200831.948505:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1788200831.948645:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715013376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788200831.948684:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715013248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788200831.951009:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715012992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788200831.951088:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200831.951145:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788200831.951152:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715013120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788200831.952074:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200831.952116:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715012992 00000100:00100000:1.0:1788200831.952123:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715012992 00000100:00100000:1.0:1788200831.952321:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715013120 00000100:00100000:1.0:1788200831.952325:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715013120 00000100:00100000:1.0:1788200831.952360:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:1.0:1788200831.952369:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+22:3655:x1875060715012992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788200831.952382:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788200831.952401:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ece00/0x96d0c9b8c9a19f9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a19f95 expref: 22 pid: 83383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200831.952416:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788200831.952452:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+21:3655:x1875060715012992:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200831.952458:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:1.0:1788200831.952476:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:1.0:1788200831.952482:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+20:3655:x1875060715013120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788200831.952504:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788200831.952514:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1a09f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a098 expref: 20 pid: 83385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200831.952523:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788200831.952545:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+19:3655:x1875060715013120:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200831.952550:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:1.0:1788200831.952591:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715013120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788200831.952601:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715012992:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788200831.955964:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:2.0:1788200831.967750:0:84610:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:2.0:1788200831.968241:0:83379:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247815 is committed 00000020:00000080:2.0:1788200831.968298:0:84610:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:2.0:1788200831.968309:0:84610:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc0078de800 4292087e-fa00-4621-b681-837afc99ae35 192.168.201.20@tcp 5 (0 0 0) 0 0 0 1: ffff8dc0052a8000 98784247815 stale:0 00000020:00080000:2.0:1788200831.968316:0:84610:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc110731800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788200831.968320:0:84610:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc110731000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788200831.968324:0:84610:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc110734800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788200831.968329:0:84610:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc104284000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788200831.968334:0:84610:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff8dc004fd4d28) has exports, disconnecting them 00000020:00080000:2.0:1788200831.968339:0:84610:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.201.20@tcp (ffff8dc0078de800), last request at 1788200829 00000020:00000080:2.0:1788200831.968346:0:84610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a35b 00000100:00080000:2.0:1788200831.968355:0:84610:0:(import.c:65:import_set_state_nolock()) ffff8dc0078dc800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788200831.968387:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788200831.968397:0:84610:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.201.20@tcp (ffff8dc0078de800): rc 0 00000020:00080000:2.0:1788200831.968401:0:84610:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc110731800), last request at 1788200622 00000020:00000080:2.0:1788200831.968404:0:84610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a186 00000100:00080000:2.0:1788200831.968408:0:84610:0:(import.c:65:import_set_state_nolock()) ffff8dc110735800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788200831.968419:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788200831.968427:0:84610:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc110731800): rc 0 00000020:00000080:2.0:1788200831.968429:0:84610:0:(genops.c:885:class_export_put()) final put ffff8dc110731800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788200831.968437:0:84610:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc110731000), last request at 1788200829 00000020:00000080:2.0:1788200831.968440:0:84610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a17f 00000100:00080000:2.0:1788200831.968444:0:84610:0:(import.c:65:import_set_state_nolock()) ffff8dc110730000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788200831.968456:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110731800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788200831.968499:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc110735800 for lustre-MDT0000 00010000:00010000:2.0:1788200831.968507:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788200831.968516:0:84610:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc110731000): rc 0 00000020:00000080:2.0:1788200831.968519:0:84610:0:(genops.c:885:class_export_put()) final put ffff8dc110731000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788200831.968525:0:84610:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc110734800), last request at 1788200829 00000020:00000080:2.0:1788200831.968528:0:84610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a178 00000100:00080000:2.0:1788200831.968535:0:84610:0:(import.c:65:import_set_state_nolock()) ffff8dc110736000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788200831.968545:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110731000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788200831.968568:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc110730000 for lustre-MDT0000 00000020:00080000:2.0:1788200831.968591:0:84610:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc110734800): rc 0 00000020:00000080:2.0:1788200831.968593:0:84610:0:(genops.c:885:class_export_put()) final put ffff8dc110734800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788200831.968599:0:84610:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc104284000), last request at 1788200617 00000020:00000080:2.0:1788200831.968602:0:84610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a19fe2 00000100:00080000:2.0:1788200831.968611:0:84610:0:(import.c:65:import_set_state_nolock()) ffff8dc001e2a000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788200831.968620:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110734800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788200831.968640:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc110736000 for lustre-MDT0000 00010000:00010000:2.0:1788200831.968654:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788200831.968663:0:84610:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc104284000): rc 0 00000020:00000080:2.0:1788200831.968665:0:84610:0:(genops.c:885:class_export_put()) final put ffff8dc104284000/lustre-MDT0001-mdtlov_UUID 00000004:00000080:2.0:1788200831.968675:0:84610:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa0dd414ffae0 00000020:00000080:2.0:1788200831.968684:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc104284000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788200831.968716:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc001e2a000 for lustre-MDT0000 00000100:00080000:2.0:1788200831.968736:0:84610:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788200831.968740:0:84610:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411435 gen 3 00010000:00010000:0.0:1788200831.969722:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200831.970405:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1a449 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200831.970418:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1a449 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200831.970425:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1a449 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200831.970430:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788200831.970435:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1a449 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200831.970443:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1a449 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200831.970460:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff8dc0048bec00) 00010000:00010000:0.0:1788200831.970463:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788200831.970468:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1a449 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200831.970475:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1a449 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788200831.970493:0:3642:0:(genops.c:885:class_export_put()) final put ffff8dc0078de800/4292087e-fa00-4621-b681-837afc99ae35 00000020:00000080:0.0:1788200831.970537:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0078de800/4292087e-fa00-4621-b681-837afc99ae35 for lustre-MDT0000 00000020:00000080:0.0:1788200831.970593:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc0078dc800 for lustre-MDT0000 00000100:00080000:3.0:1788200831.975709:0:84610:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788200831.975750:0:84610:0:(import.c:65:import_set_state_nolock()) ffff8dc11d438000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788200831.976432:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715013504:0@lo:39:umount.0 00000100:00100000:2.0:1788200831.976508:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200831.976566:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715013504 00000100:00100000:2.0:1788200831.976574:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715013504 00000100:00100000:2.0:1788200831.976679:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3794 00000100:00100000:2.0:1788200831.976688:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13c271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715013504:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788200831.976782:0:83817:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a021 00000100:00080000:2.0:1788200831.976791:0:83817:0:(import.c:65:import_set_state_nolock()) ffff8dc006e30000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788200831.976813:0:83817:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411435 00000100:00100000:2.0:1788200831.977137:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13c271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3654:x1875060715013504:12345-0@lo:39:umount.0 Request processed in 449us (628us total) trans 77309411436 rc 0/0 00000100:00100000:2.0:1788200831.977145:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3794 00000100:00080000:1.0:1788200831.977452:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11d438000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788200831.977460:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715013504:0@lo:39:umount.0 00000100:00080000:3.0:1788200831.978056:0:84610:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788200831.978060:0:84610:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969448 gen 3 00000004:00080000:3.0:1788200831.978078:0:84610:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788200831.978140:0:84610:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788200831.978158:0:84610:0:(import.c:65:import_set_state_nolock()) ffff8dc11d63b000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788200831.979831:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788200831.979992:0:84610:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788200831.979996:0:84610:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969448 gen 3 00000100:00100000:1.0:1788200831.980078:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715013632:0@lo:9:umount.0 00000100:00100000:1.0:1788200831.980134:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200831.980251:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715013632 00000100:00100000:2.0:1788200831.980258:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715013632 00000100:00100000:2.0:1788200831.980315:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5847 00000100:00100000:2.0:1788200831.980324:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715013632:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788200831.980350:0:26204:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a03d 00000100:00080000:2.0:1788200831.980358:0:26204:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788200831.980395:0:26204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969448 00000100:00100000:2.0:1788200831.981078:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+2:3654:x1875060715013632:12345-0@lo:9:umount.0 Request processed in 752us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200831.981087:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5847 00010000:00010000:2.0:1788200831.981114:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788200831.981140:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11d63b000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788200831.981150:0:3654:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788200831.981152:0:3654:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788200831.981166:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715013632:0@lo:9:umount.0 00000100:00080000:1.0:1788200831.981621:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788200831.991284:0:84610:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788200831.992479:0:84610:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788200831.992511:0:84610:0:(import.c:65:import_set_state_nolock()) ffff8dc103483800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788200831.993841:0:84610:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8dc004fd4d28) has no exports 00000100:00100000:3.0:1788200831.995094:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715013760:0@lo:9:umount.0 00000100:00100000:3.0:1788200831.995368:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200831.995959:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715013760 00000100:00100000:0.0:1788200831.995970:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715013760 00000100:00100000:0.0:1788200831.996041:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5848 00000100:00100000:0.0:1788200831.996051:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715013760:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788200831.996093:0:26212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a04b 00000100:00080000:0.0:1788200831.996101:0:26212:0:(import.c:65:import_set_state_nolock()) ffff8dc103487000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788200831.996143:0:26212:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969448 00000100:00100000:0.0:1788200831.996302:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+2:3654:x1875060715013760:12345-0@lo:9:umount.0 Request processed in 252us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200831.996310:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5848 00010000:00010000:0.0:1788200831.996334:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788200831.996342:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788200831.996369:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc103483800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788200831.996382:0:3654:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788200831.996384:0:3654:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788200831.996387:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715013760:0@lo:9:umount.0 00000020:00080000:3.0:1788200831.997398:0:84610:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8dc004fd4d28) has no exports 00000020:00000080:3.0:1788200832.105209:0:84610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a19ff7 00000020:00000080:3.0:1788200832.105226:0:84610:0:(genops.c:885:class_export_put()) final put ffff8dc106308000/lustre-QMT0000_UUID 00000020:01000000:3.0:1788200832.105247:0:84610:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788200832.105714:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc106308000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788200832.105743:0:84610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788200832.105757:0:84610:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788200832.105762:0:84610:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8dc004044d28) has no exports 00000020:00000080:0.0:1788200832.106901:0:84610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a19ff0 00000020:00000080:0.0:1788200832.106911:0:84610:0:(genops.c:885:class_export_put()) final put ffff8dc137d36000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788200832.106973:0:84610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788200832.106984:0:84610:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788200832.106987:0:84610:0:(genops.c:885:class_export_put()) final put ffff8dc12e642000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788200832.106989:0:84610:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12e642000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788200832.106994:0:84610:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788200832.107187:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d36000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788200832.107424:0:84610:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc0055f8cc0 - data ffff8dc0020bf360/ffff8dc120147c00 00000020:01000000:0.0:1788200832.107561:0:84610:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc110106c60 - data ffff8dc11d9c16c0/ffff8dc1333a5800 00000100:00080000:3.0:1788200832.194382:0:84610:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788200832.194392:0:84610:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411435 gen 4 00000100:00100000:3.0:1788200832.194407:0:84610:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8dc003a70000 x1875060715013504/t77309411436(77309411436) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788200841 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788200832.194433:0:84610:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788200832.206442:0:84610:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788200832.206450:0:84610:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969448 gen 4 00000004:00080000:3.0:1788200832.206479:0:84610:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788200832.206481:0:84610:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788200832.207184:0:83396:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788200832.207190:0:83396:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5c:0x0] index 1 count 1 00000040:00080000:0.0:1788200832.207201:0:83396:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 23 count 2 00000100:00080000:3.0:1788200832.209596:0:84610:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788200832.209605:0:84610:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969448 gen 4 00000004:00080000:3.0:1788200832.209669:0:84610:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788200832.209672:0:84610:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788200832.216705:0:83398:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788200832.216728:0:83398:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5e:0x0] index 2 count 1 00000040:00080000:0.0:1788200832.216748:0:83398:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 23 count 2 00000020:00000080:3.0:1788200832.218113:0:84610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a19fb1 00000020:00000080:3.0:1788200832.218123:0:84610:0:(genops.c:885:class_export_put()) final put ffff8dc106075800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788200832.218252:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc106075800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788200832.219404:0:84610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a19fc6 00000020:00000080:3.0:1788200832.219413:0:84610:0:(genops.c:885:class_export_put()) final put ffff8dc13f80f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788200832.219463:0:84610:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788200832.219469:0:84610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788200832.219482:0:84610:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788200832.219486:0:84610:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8dc004fd19b8) has no exports 00000004:01000000:3.0:1788200832.219862:0:84610:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788200832.219872:0:84610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a044 00000020:00000080:3.0:1788200832.219877:0:84610:0:(genops.c:885:class_export_put()) final put ffff8dc1201cc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788200832.227112:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13f80f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788200832.227277:0:84610:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788200832.227288:0:84610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788200832.227303:0:84610:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788200832.227308:0:84610:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8dc12f308000) has no exports 00000020:00000080:3.0:1788200832.227317:0:84610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a036 00000020:00000080:3.0:1788200832.227325:0:84610:0:(genops.c:885:class_export_put()) final put ffff8dc103484800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788200832.227826:0:84610:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788200832.227831:0:84610:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788200832.227836:0:84610:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969448 gen 5 00000004:00080000:3.0:1788200832.227842:0:84610:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788200832.227844:0:84610:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788200832.227880:0:84610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788200832.227888:0:84610:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788200832.227894:0:84610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a028 00000020:00000080:3.0:1788200832.227899:0:84610:0:(genops.c:885:class_export_put()) final put ffff8dc1201cf000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788200832.227903:0:84610:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788200832.227920:0:84610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788200832.227924:0:84610:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788200832.227927:0:84610:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8dc1401b4d28) has no exports 00000020:00000080:3.0:1788200832.227958:0:84610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a01a 00000020:00000080:3.0:1788200832.227962:0:84610:0:(genops.c:885:class_export_put()) final put ffff8dc11d63f800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788200832.228445:0:84610:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788200832.228448:0:84610:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788200832.228451:0:84610:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969448 gen 5 00000004:00080000:3.0:1788200832.228455:0:84610:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788200832.228457:0:84610:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788200832.228485:0:84610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788200832.228491:0:84610:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788200832.228505:0:84610:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788200832.228511:0:84610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a00c 00000020:00000080:3.0:1788200832.228516:0:84610:0:(genops.c:885:class_export_put()) final put ffff8dc1201c9800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788200832.228519:0:84610:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788200832.228523:0:84610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788200832.228527:0:84610:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788200832.228529:0:84610:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8dc12f30cd28) has no exports 00000020:00000080:3.0:1788200832.228533:0:84610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a005 00000020:00000080:3.0:1788200832.228536:0:84610:0:(genops.c:885:class_export_put()) final put ffff8dc12f1af000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788200832.230199:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1201cc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788200832.230213:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc103484800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788200832.230219:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc103483800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788200832.230227:0:76267:0:(genops.c:885:class_export_put()) final put ffff8dc1201cd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788200832.230230:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1201cd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788200832.230234:0:76267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788200832.230318:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1201cf000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788200832.230334:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d63f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788200832.230338:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc11d63b000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788200832.230343:0:76267:0:(genops.c:885:class_export_put()) final put ffff8dc1201c9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788200832.230346:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1201c9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788200832.230349:0:76267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788200832.230381:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1201c9800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788200832.230386:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12f1af000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788200832.231243:0:84610:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788200832.231249:0:84610:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788200832.231252:0:84610:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 77309411435 gen 5 00000100:00100000:0.0:1788200832.231260:0:84610:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788200832.231312:0:84610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788200832.231325:0:84610:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788200832.231353:0:84610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788200832.231358:0:84610:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788200832.231362:0:84610:0:(genops.c:885:class_export_put()) final put ffff8dc13f80a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788200832.231365:0:84610:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13f80a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788200832.231373:0:84610:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788200832.231452:0:84610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a19fcd 00000020:00000080:0.0:1788200832.231458:0:84610:0:(genops.c:885:class_export_put()) final put ffff8dc13f80b000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788200832.231463:0:84610:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788200832.231466:0:84610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788200832.231471:0:84610:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788200832.231475:0:84610:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8dc004fd0000) has no exports 00000020:00000080:0.0:1788200832.231494:0:84610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788200832.231498:0:84610:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788200832.231501:0:84610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a19fd4 00000020:00000080:0.0:1788200832.231504:0:84610:0:(genops.c:885:class_export_put()) final put ffff8dc106071800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788200832.231511:0:84610:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc11d43f000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788200832.231515:0:84610:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc11d43f000 3 00000020:01000004:0.0:1788200832.231517:0:84610:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dc11d43f000 from lustre-MDT0000 00000020:00000080:0.0:1788200832.231533:0:84610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788200832.231537:0:84610:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788200832.231539:0:84610:0:(genops.c:885:class_export_put()) final put ffff8dc106071000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788200832.231542:0:84610:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc106071000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788200832.231549:0:84610:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788200832.231593:0:84610:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788200832.231605:0:84610:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788200832.231608:0:84610:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788200832.231611:0:84610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788200832.231613:0:84610:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788200832.231621:0:84610:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8dc110733000 0fa559bc-2180-4019-80c4-11831fedf9a9 192.168.201.20@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788200832.231627:0:84610:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8dc1031f9000 c9b18af6-fecc-4172-82c2-66531890fe11 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788200832.231631:0:84610:0:(genops.c:1553:class_disconnect_exports()) OBD device 3 (ffff8dc12f3099b8) has exports, disconnecting them 00000020:00080000:0.0:1788200832.231636:0:84610:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.201.20@tcp (ffff8dc110733000), last request at 1788200617 00000020:00000080:0.0:1788200832.231657:0:84610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a091 00000020:00010000:0.0:1788200832.231662:0:84610:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc110733000: total 2 00000100:00080000:0.0:1788200832.231665:0:84610:0:(import.c:65:import_set_state_nolock()) ffff8dc110732000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788200832.231678:0:84610:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.201.20@tcp (ffff8dc110733000): rc 0 00000020:00080000:0.0:1788200832.231681:0:84610:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8dc1031f9000), last request at 1788200616 00000020:00010000:0.0:1788200832.231964:0:24979:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc110733000: total 2 00010000:00010000:0.0:1788200832.231991:0:24979:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc110733000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1788200832.232039:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140759000/0x96d0c9b8c9a1a171 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786500 expref: 5 pid: 83383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200832.232055:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140759400/0x96d0c9b8c9a1a163 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7864f2 expref: 4 pid: 83383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200832.232068:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140758000/0x96d0c9b8c9a1a15c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7864eb expref: 3 pid: 83383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200832.232079:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae2800/0x96d0c9b8c9a1a16a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7864f9 expref: 2 pid: 83387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200832.232087:0:24979:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc110733000, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1788200832.232106:0:24979:0:(genops.c:885:class_export_put()) final put ffff8dc110733000/0fa559bc-2180-4019-80c4-11831fedf9a9 00010000:00010000:0.0:1788200832.232119:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200832.232121:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200832.232123:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788200832.232222:0:84610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a19f79 00000020:00010000:0.0:1788200832.232227:0:84610:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc1031f9000: total 3 00000100:00080000:0.0:1788200832.232230:0:84610:0:(import.c:65:import_set_state_nolock()) ffff8dc1031fa800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788200832.232241:0:84610:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc1031f9000): rc 0 00000020:00080000:0.0:1788200832.232246:0:84610:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8dc12f3099b8) has no exports 00000100:00100000:1.0:1788200832.232405:0:83385:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8dc108c73400:83385] 2 exiting: rc = 0 00000020:00000080:1.0:1788200832.232479:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc11d438000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788200832.232485:0:76267:0:(genops.c:885:class_export_put()) final put ffff8dc11d63d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788200832.232487:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d63d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788200832.232490:0:76267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788200832.232539:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13f80b000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788200832.232543:0:76267:0:(genops.c:885:class_export_put()) final put ffff8dc106073000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788200832.232545:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc106073000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788200832.232548:0:76267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788200832.232573:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc106071800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788200832.232593:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110733000/0fa559bc-2180-4019-80c4-11831fedf9a9 for MGS 00000020:00000080:1.0:1788200832.232621:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc110732000 for MGS 00000100:00100000:0.0:1788200832.236564:0:83387:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff8dc12f1d0e00:83387] 3 exiting: rc = 0 00000020:00010000:0.0:1788200832.236675:0:13349:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc1031f9000: total 0 00010000:00010000:0.0:1788200832.236868:0:13349:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc1031f9000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788200832.236904:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140759200/0x96d0c9b8c9a1a11d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a116 expref: 14 pid: 83387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200832.236922:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0075ee200/0x96d0c9b8c9a1a0ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a0a6 expref: 13 pid: 83383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200832.236943:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ec400/0x96d0c9b8c9a1a10f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a108 expref: 12 pid: 83383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200832.236954:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0075ef800/0x96d0c9b8c9a1a0c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a0c2 expref: 11 pid: 83384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200832.236965:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140758800/0x96d0c9b8c9a1a147 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a140 expref: 10 pid: 83384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200832.236978:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae3800/0x96d0c9b8c9a1a12b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a124 expref: 9 pid: 83384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200832.236989:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140759e00/0x96d0c9b8c9a1a0bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a0b4 expref: 8 pid: 83383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200832.237044:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ec800/0x96d0c9b8c9a1a139 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a132 expref: 7 pid: 83385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200832.237057:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0075efc00/0x96d0c9b8c9a1a0d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a0d0 expref: 6 pid: 83385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200832.237069:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140758600/0x96d0c9b8c9a1a155 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a14e expref: 5 pid: 83383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200832.237079:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0075efa00/0x96d0c9b8c9a1a0e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a0de expref: 4 pid: 83383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200832.237090:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0075efe00/0x96d0c9b8c9a1a0f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a0ec expref: 3 pid: 83385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200832.237099:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0075ef400/0x96d0c9b8c9a1a101 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a0fa expref: 2 pid: 83384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200832.237109:0:13349:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc1031f9000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788200832.237125:0:13349:0:(genops.c:885:class_export_put()) final put ffff8dc1031f9000/c9b18af6-fecc-4172-82c2-66531890fe11 00010000:00010000:0.0:1788200832.237140:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200832.237143:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200832.237145:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788200832.237254:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1031f9000/c9b18af6-fecc-4172-82c2-66531890fe11 for MGS 00000020:00000080:1.0:1788200832.237297:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1031fa800 for MGS 00000100:00100000:3.0:1788200832.253846:0:83384:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8dc108c73c00:83384] 1 exiting: rc = 0 00000100:00100000:3.0:1788200832.254001:0:83383:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8dc108c73a00:83383] 0 exiting: rc = 1 00000100:00100000:1.0:1788200832.254253:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254262:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254268:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254274:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254280:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254286:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254291:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254306:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254312:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254319:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254324:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254330:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254335:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254339:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254344:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254350:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254356:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254361:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254366:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254372:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254377:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254382:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254388:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254393:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254399:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254404:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254409:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254415:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254421:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254425:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254431:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254436:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254441:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254447:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254452:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254458:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254463:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254468:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254474:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254479:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254485:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254490:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254503:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254509:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254514:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254519:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254524:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254529:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254535:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254540:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254545:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254551:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254556:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254561:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254565:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254570:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254575:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254580:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254585:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254590:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254595:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254600:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254606:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200832.254611:0:84610:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1788200832.256831:0:84610:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc0055f83c0 - data ffff8dc1339a6948/ffff8dc120144c00 00000020:01000000:1.0:1788200832.256977:0:84610:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc0073e0e40 - data ffff8dc11d8a30d8/ffff8dc00795f000 00000020:00000080:1.0:1788200832.257590:0:84610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a19f72 00000020:00000080:1.0:1788200832.257600:0:84610:0:(genops.c:885:class_export_put()) final put ffff8dc11d63e800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788200832.257654:0:84610:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc11d43f000 from MGS, refs=2 00000020:01000004:1.0:1788200832.257658:0:84610:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc11d43f000 2 00000020:01000004:1.0:1788200832.257661:0:84610:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dc11d43f000 from MGS 00000020:00000080:1.0:1788200832.257683:0:84610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788200832.257690:0:84610:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788200832.257763:0:84610:0:(genops.c:885:class_export_put()) final put ffff8dc11d63c000/MGS 00000020:00000080:1.0:1788200832.257766:0:84610:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d63c000/MGS for MGS 00000020:01000000:1.0:1788200832.257773:0:84610:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788200832.257852:0:84610:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788200832.257856:0:84610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788200832.257866:0:84610:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788200832.257873:0:84610:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8dc109815800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788200832.257879:0:84610:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8dc004040000) has exports, disconnecting them 00000020:00080000:1.0:1788200832.257884:0:84610:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8dc109815800), last request at 1788200617 00000020:00000080:1.0:1788200832.257888:0:84610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a083 00000020:00080000:1.0:1788200832.257898:0:84610:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc109815800): rc 0 00000020:00000080:1.0:1788200832.257902:0:84610:0:(genops.c:885:class_export_put()) final put ffff8dc109815800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788200832.258323:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d63e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788200832.259088:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc109815800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788200832.260279:0:84610:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788200832.260284:0:84610:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788200832.260288:0:84610:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788200832.260294:0:84610:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788200832.260459:0:84610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788200832.260472:0:84610:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788200832.260477:0:84610:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc11d43f000 1 00000020:00000080:0.0:1788200832.260483:0:84610:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a19f64 00000020:00000080:0.0:1788200832.260491:0:84610:0:(genops.c:885:class_export_put()) final put ffff8dc11d63a800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788200832.260497:0:84610:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788200832.260502:0:84610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788200832.260505:0:84610:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788200832.260509:0:84610:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8dc1401b19b8) has no exports 00000020:00000080:3.0:1788200832.260772:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc001e28800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788200832.260780:0:76267:0:(genops.c:885:class_export_put()) final put ffff8dc11d63b800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788200832.260783:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d63b800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788200832.260787:0:76267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788200832.260859:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d63a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788200832.434387:0:84610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788200832.434415:0:84610:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788200832.434421:0:84610:0:(genops.c:885:class_export_put()) final put ffff8dc11d438800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788200832.434425:0:84610:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d438800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788200832.434435:0:84610:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788200832.434556:0:84610:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dc11d43e800 00000020:02000400:2.0:1788200832.434624:0:84610:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788200832.719400:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200833.743130:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200834.385281:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715013888:0@lo:400:kworker.0 00000400:00000100:1.0:1788200834.385337:0:3655:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715013888 offset 0 length 224: 4 00000100:00100000:2.0:1788200834.385523:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715014016:0@lo:400:kworker.0 00000100:00100000:2.0:1788200834.385564:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200834.385724:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715014016 00000100:00100000:2.0:1788200834.385731:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715014016 00000100:00100000:2.0:1788200834.387868:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:2.0:1788200834.387881:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1875060715014016:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788200834.387891:0:66312:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788200834.387998:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1875060715014016:12345-0@lo:400:kworker.0 Request processed in 117us (2433us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788200834.388006:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00080000:1.0:1788200834.388113:0:3656:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788200834.388119:0:3656:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788200834.388123:0:3656:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788200834.388129:0:3656:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200834.388132:0:3656:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3473 00000100:00080000:1.0:1788200834.388140:0:3656:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200834.388168:0:3656:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc120092680 x1875060715014144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788200834.388190:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715014016:0@lo:400:kworker.0 00000100:00100000:3.0:1788200834.389122:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715014272:0@lo:400:kworker.0 00000100:00100000:3.0:1788200834.389174:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200834.389670:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715014528:0@lo:400:kworker.0 00000100:00100000:3.0:1788200834.389994:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715014784:0@lo:400:kworker.0 00000100:00100000:3.0:1788200834.390046:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200834.390071:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788200834.390077:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715014400:0@lo:400:kworker.0 00000100:00100000:3.0:1788200834.390099:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200834.390673:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715014272 00000100:00100000:0.0:1788200834.390683:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715014272 00000100:00100000:0.0:1788200834.390744:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:0.0:1788200834.390753:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715014272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200834.390813:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715014272:12345-0@lo:400:kworker.0 Request processed in 61us (1639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200834.390820:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:0.0:1788200834.390846:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715014144:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788200834.390890:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715014784 00000100:00100000:0.0:1788200834.390904:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715014784 00000100:00100000:0.0:1788200834.390934:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:0.0:1788200834.390941:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715014784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200834.390974:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715014784:12345-0@lo:400:kworker.0 Request processed in 34us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200834.390995:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00000100:00080000:0.0:1788200834.391009:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788200834.391013:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788200834.391511:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715014912:0@lo:400:kworker.0 00000100:00100000:3.0:1788200834.391542:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200834.391576:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715014272:0@lo:400:kworker.0 00000100:00100000:3.0:1788200834.391589:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715014784:0@lo:400:kworker.0 00000100:00100000:3.0:1788200834.391622:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715014912 00000100:00100000:3.0:1788200834.391626:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715014912 00000100:00100000:3.0:1788200834.391673:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557 00000100:00100000:3.0:1788200834.391681:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715014912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200834.391718:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715014912:12345-0@lo:400:kworker.0 Request processed in 38us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200834.391724:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557 00000100:00100000:3.0:1788200834.391758:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715014912:0@lo:400:kworker.0 00000100:00100000:3.0:1788200834.391774:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200834.391793:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715015040:0@lo:400:kworker.0 00000100:00100000:3.0:1788200834.391814:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200834.391836:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788200834.391842:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715014656:0@lo:400:kworker.0 00000100:00100000:0.0:1788200834.392107:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715014400 00000100:00100000:0.0:1788200834.392123:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715014400 00000100:00100000:0.0:1788200834.392141:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715014528 00000100:00100000:0.0:1788200834.392143:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715014528 00000100:00100000:0.0:1788200834.392158:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715015040 00000100:00100000:0.0:1788200834.392160:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715015040 00000100:00100000:0.0:1788200834.392171:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:0.0:1788200834.392177:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715014528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200834.392211:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715014528:12345-0@lo:400:kworker.0 Request processed in 35us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200834.392217:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:0.0:1788200834.392229:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:0.0:1788200834.392233:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1875060715014400:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788200834.392238:0:66314:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788200834.392268:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1875060715014400:12345-0@lo:400:kworker.0 Request processed in 34us (2167us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788200834.392274:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:0.0:1788200834.392284:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:0.0:1788200834.392287:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3655:x1875060715015040:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788200834.392291:0:66314:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788200834.392309:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3655:x1875060715015040:12345-0@lo:400:kworker.0 Request processed in 20us (495us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788200834.392314:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:0.0:1788200834.392330:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788200834.392356:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788200834.392360:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788200834.392375:0:3657:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788200834.392379:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788200834.392383:0:3657:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788200834.392393:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200834.392398:0:3657:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3473 00000100:00080000:0.0:1788200834.392403:0:3657:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788200834.392428:0:3657:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc120020e00 x1875060715015168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788200834.392448:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715014400:0@lo:400:kworker.0 00000100:00100000:0.0:1788200834.392468:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120020e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715015168:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788200834.392493:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200834.392512:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715014144 00000100:00100000:0.0:1788200834.392515:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715014144 00000100:00100000:0.0:1788200834.392525:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715015168 00000100:00100000:0.0:1788200834.392527:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715015168 00000100:00100000:0.0:1788200834.392535:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:0.0:1788200834.392539:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120022a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715014144:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1788200834.392556:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788200834.395664:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200834.395747:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715014528:0@lo:400:kworker.0 00000100:00080000:3.0:1788200834.395762:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788200834.395781:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788200834.395785:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788200834.395790:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788200834.395794:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3473 00000100:00080000:3.0:1788200834.395802:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788200834.395831:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc003a71880 x1875060715015296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788200834.395867:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715015040:0@lo:400:kworker.0 00000100:00100000:2.0:1788200834.400136:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715014656 00000100:00100000:2.0:1788200834.400152:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715014656 00000100:00100000:2.0:1788200834.400210:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3795 00000100:00100000:2.0:1788200834.400218:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3655:x1875060715014656:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788200834.400237:0:23728:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788200834.400323:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3655:x1875060715014656:12345-0@lo:400:kworker.0 Request processed in 104us (4676us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788200834.400331:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3795 00000100:00100000:2.0:1788200834.400364:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:2.0:1788200834.400369:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120020a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715015168:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1788200834.400390:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788200834.400420:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120020a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715015168:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 49us (7926us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788200834.400426:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00080000:2.0:1788200834.400470:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788200834.400474:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788200834.400478:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788200834.400484:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788200834.400488:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3655 00000100:00080000:2.0:1788200834.400494:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788200834.400520:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12fb79f80 x1875060715015424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788200834.400537:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715014656:0@lo:400:kworker.0 00000100:00100000:3.0:1788200834.401110:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715015296:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788200834.401155:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200834.401180:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715015424:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788200834.401201:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788200834.401225:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200834.401230:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200834.401233:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120020e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715015168:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788200834.401258:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715015296 00000100:00100000:3.0:1788200834.401262:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715015296 00000100:00100000:3.0:1788200834.401285:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:3.0:1788200834.401289:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715015296:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1788200834.401302:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788200834.401330:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715015296:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 39us (175us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788200834.401335:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:3.0:1788200834.401364:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715015424 00000100:00100000:3.0:1788200834.401368:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715015424 00000100:00100000:3.0:1788200834.401386:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3796 00000100:00100000:3.0:1788200834.401391:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715015424:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1788200834.401400:0:83817:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788200834.401426:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715015424:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 34us (224us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788200834.401432:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3796 00000100:00080000:3.0:1788200834.401457:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200834.401460:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200834.401463:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715015296:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1788200834.401471:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200834.401475:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200834.401477:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715015424:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788200834.428162:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120022a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715014144:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 35614us (35823us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788200834.428178:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00080000:3.0:1788200834.428234:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200834.428240:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200834.428243:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715014144:0@lo:38:ptlrpcd_00_01.0 00000400:00000100:3.0:1788200834.518117:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695326208 offset 0 length 224: 4 00000100:00100000:3.0:1788200834.518158:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200834.518186:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200834.518216:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200834.518238:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200834.518272:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695326464 00000100:00100000:3.0:1788200834.518281:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695326464 00000100:00100000:3.0:1788200834.518336:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695326336 00000100:00100000:3.0:1788200834.518339:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695326336 00000100:00100000:3.0:1788200834.518357:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1052 00000100:00100000:3.0:1788200834.518498:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695326464:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200834.518575:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695326464:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 210us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200834.518582:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1052 00000100:00100000:3.0:1788200834.518605:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1051 00000100:00100000:3.0:1788200834.518610:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2400:x1875060695326336:12345-192.168.201.20@tcp:400:kworker.0 00000020:00080000:3.0:1788200834.518616:0:66757:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.20@tcp 00000100:00100000:3.0:1788200834.518641:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2400:x1875060695326336:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 31us (426us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788200834.518648:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1051 00000100:00100000:3.0:1788200834.518731:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695326720 00000100:00100000:3.0:1788200834.518735:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695326720 00000100:00100000:3.0:1788200834.518762:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695326592 00000100:00100000:3.0:1788200834.518765:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695326592 00000100:00100000:3.0:1788200834.518787:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2558 00000100:00100000:3.0:1788200834.518792:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4292087e-fa00-4621-b681-837afc99ae35+5:2400:x1875060695326720:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200834.518818:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4292087e-fa00-4621-b681-837afc99ae35+5:2400:x1875060695326720:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200834.518824:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2558 00000100:00100000:3.0:1788200834.518835:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2559 00000100:00100000:3.0:1788200834.518841:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4292087e-fa00-4621-b681-837afc99ae35+5:2400:x1875060695326592:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200834.518889:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4292087e-fa00-4621-b681-837afc99ae35+5:2400:x1875060695326592:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 48us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200834.518905:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2559 00000100:00080000:0.0:1788200834.525814:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788200834.525822:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788200834.525826:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788200834.559508:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200834.559583:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695326848 00000100:00100000:1.0:1788200834.559593:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695326848 00000100:00100000:1.0:1788200834.559642:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1052 00000100:00100000:1.0:1788200834.559660:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875060695326848:12345-192.168.201.20@tcp:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1788200834.559692:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200834.559753:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875060695326848:12345-192.168.201.20@tcp:38:ptlrpcd_00_00.0 Request processed in 102us (253us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788200834.559761:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1052 00010000:00010000:0.0:1788200834.767855:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200835.407449:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715015680:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788200835.407535:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200835.407633:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715015680 00000100:00100000:0.0:1788200835.407641:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715015680 00000100:00100000:0.0:1788200835.407695:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2064 00000100:00100000:0.0:1788200835.407705:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715015680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788200835.407731:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200835.407792:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715015680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200835.407817:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2064 00000100:00100000:0.0:1788200835.407892:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715015680:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788200835.408554:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715015552:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788200835.408591:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200835.408719:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715015552 00000100:00100000:0.0:1788200835.408724:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715015552 00000100:00100000:0.0:1788200835.408765:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2065 00000100:00100000:0.0:1788200835.408773:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715015552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788200835.408791:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200835.408833:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715015552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200835.408839:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2065 00000100:00100000:3.0:1788200835.409067:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715015552:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788200835.791240:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200836.815174:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788200837.462998:0:75739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788200837.463061:0:75739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411436 is committed 00000020:00000080:3.0:1788200837.463079:0:75739:0:(genops.c:885:class_export_put()) final put ffff8dc006e30800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788200837.463487:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc006e30800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788200837.463589:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc006e30000 for lustre-MDT0001 00000001:00100000:0.0:1788200837.464309:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788200837.464317:0:8442:0:(genops.c:885:class_export_put()) final put ffff8dc13f869000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788200837.464668:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13f869000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788200837.464738:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc13f86b800 for lustre-OST0000 00000001:00100000:3.0:1788200837.465774:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788200837.465782:0:9526:0:(genops.c:885:class_export_put()) final put ffff8dc103484000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788200837.467157:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc103484000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788200837.467235:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc103487000 for lustre-OST0001 00010000:00010000:0.0:1788200837.839656:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200838.863514:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788200839.503338:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788200839.503348:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788200839.503376:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788200839.503397:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3685 00000100:00080000:2.0:1788200839.503405:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788200839.503425:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788200839.503460:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12fb79500 x1875060715015936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788200839.503608:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788200839.503636:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715015808:0@lo:400:kworker.0 00000400:00000100:0.0:1788200839.503716:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715015808 offset 0 length 224: 4 00000100:00100000:1.0:1788200839.503982:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715015936:0@lo:38:kworker.0 00000100:00100000:1.0:1788200839.504071:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200839.504163:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715015936 00000100:00100000:0.0:1788200839.504174:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715015936 00000100:00100000:0.0:1788200839.504233:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:0.0:1788200839.504242:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715015936:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788200839.504268:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788200839.504323:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715015936:12345-0@lo:38:kworker.0 Request processed in 80us (251us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788200839.504340:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00080000:0.0:1788200839.504403:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788200839.504408:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788200839.504422:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715015936:0@lo:38:kworker.0 00000100:00080000:2.0:1788200839.504743:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788200839.504748:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788200839.504751:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788200839.504757:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3685 00000100:00080000:2.0:1788200839.504761:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788200839.504768:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788200839.504791:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12fb7a300 x1875060715016192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788200839.504829:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788200839.504833:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788200839.504835:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788200839.504840:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3685 00000100:00080000:2.0:1788200839.504842:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788200839.504847:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788200839.504860:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12fb7bb80 x1875060715016448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788200839.504891:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788200839.504895:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788200839.504904:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788200839.504908:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3685 00000100:00080000:2.0:1788200839.504911:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788200839.504915:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788200839.504929:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12fb79f80 x1875060715016832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788200839.504960:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715016576:0@lo:400:kworker.0 00000100:00100000:2.0:1788200839.505006:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200839.505053:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788200839.505060:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715016704:0@lo:400:kworker.0 00000100:00100000:2.0:1788200839.505086:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200839.505112:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715016192:0@lo:38:kworker.0 00000100:00100000:2.0:1788200839.505137:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200839.505154:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715016448:0@lo:38:kworker.0 00000100:00100000:2.0:1788200839.505179:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200839.505196:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715016832:0@lo:38:kworker.0 00000100:00100000:2.0:1788200839.505219:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200839.505247:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715016448 00000100:00100000:2.0:1788200839.505252:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715016448 00000100:00100000:2.0:1788200839.505283:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3797 00000100:00100000:2.0:1788200839.505289:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715016448:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788200839.505305:0:23728:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788200839.505340:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715016448:12345-0@lo:38:kworker.0 Request processed in 50us (160us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788200839.505346:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3797 00000100:00100000:1.0:1788200839.505541:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715016320:0@lo:400:kworker.0 00000100:00100000:1.0:1788200839.505574:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200839.505599:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788200839.505605:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715016064:0@lo:400:kworker.0 00000100:00100000:1.0:1788200839.505628:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200839.505656:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715016192 00000100:00100000:1.0:1788200839.505660:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715016192 00000100:00100000:1.0:1788200839.505681:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715016832 00000100:00100000:1.0:1788200839.505684:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715016832 00000100:00100000:1.0:1788200839.505693:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715016320 00000100:00100000:1.0:1788200839.505695:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715016320 00000100:00100000:1.0:1788200839.505730:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715016064 00000100:00100000:1.0:1788200839.505733:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715016064 00000100:00100000:1.0:1788200839.505748:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:1.0:1788200839.505754:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715016320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200839.505822:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715016320:12345-0@lo:400:kworker.0 Request processed in 67us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200839.505830:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:1.0:1788200839.505847:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:1.0:1788200839.505853:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715016064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200839.505881:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715016064:12345-0@lo:400:kworker.0 Request processed in 29us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200839.505887:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00100000:1.0:1788200839.505898:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:1.0:1788200839.505902:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715016192:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788200839.505913:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200839.505937:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715016192:12345-0@lo:38:kworker.0 Request processed in 34us (799us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788200839.505944:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00100000:1.0:1788200839.505955:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:1.0:1788200839.505959:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715016832:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788200839.505967:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200839.505991:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715016832:12345-0@lo:38:kworker.0 Request processed in 31us (771us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788200839.505996:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00100000:1.0:1788200839.506066:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715016064:0@lo:400:kworker.0 00000100:00100000:1.0:1788200839.506078:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715016320:0@lo:400:kworker.0 00000100:00100000:0.0:1788200839.506837:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715016576 00000100:00100000:0.0:1788200839.506846:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715016576 00000100:00100000:0.0:1788200839.506911:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715016704 00000100:00100000:0.0:1788200839.506915:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715016704 00000100:00100000:0.0:1788200839.506946:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560 00000100:00100000:0.0:1788200839.506955:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715016576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200839.507055:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715016576:12345-0@lo:400:kworker.0 Request processed in 103us (2049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200839.507062:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560 00000100:00100000:0.0:1788200839.507078:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561 00000100:00100000:0.0:1788200839.507085:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715016704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200839.507116:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715016704:12345-0@lo:400:kworker.0 Request processed in 32us (2029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200839.507122:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561 00000100:00080000:0.0:1788200839.507144:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788200839.507149:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788200839.507152:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788200839.507187:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715016704:0@lo:400:kworker.0 00000100:00100000:0.0:1788200839.507201:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715016576:0@lo:400:kworker.0 00000100:00080000:2.0:1788200839.509207:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788200839.509224:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788200839.509230:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715016192:0@lo:38:kworker.0 00000100:00080000:2.0:1788200839.509246:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788200839.509250:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788200839.509253:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715016448:0@lo:38:kworker.0 00000100:00080000:2.0:1788200839.509266:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788200839.509269:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788200839.509272:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715016832:0@lo:38:kworker.0 00000100:00100000:3.0:1788200839.642925:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200839.642967:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000400:00000100:3.0:1788200839.642996:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695326976 offset 0 length 224: 4 00000100:00100000:3.0:1788200839.643012:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200839.643071:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200839.643098:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695327488 00000100:00100000:3.0:1788200839.643107:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695327488 00000100:00100000:3.0:1788200839.643170:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695327360 00000100:00100000:3.0:1788200839.643173:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695327360 00000100:00100000:3.0:1788200839.643199:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2562 00000100:00100000:3.0:1788200839.643208:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:4292087e-fa00-4621-b681-837afc99ae35+5:2400:x1875060695327488:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200839.643272:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:4292087e-fa00-4621-b681-837afc99ae35+5:2400:x1875060695327488:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 64us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200839.643279:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2562 00000100:00100000:3.0:1788200839.643311:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2563 00000100:00100000:3.0:1788200839.643318:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:4292087e-fa00-4621-b681-837afc99ae35+5:2400:x1875060695327360:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200839.643341:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:4292087e-fa00-4621-b681-837afc99ae35+5:2400:x1875060695327360:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200839.643347:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2563 00000100:00100000:3.0:1788200839.643365:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695327232 00000100:00100000:3.0:1788200839.643382:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695327232 00000100:00100000:3.0:1788200839.643412:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695327104 00000100:00100000:3.0:1788200839.643415:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695327104 00000100:00100000:3.0:1788200839.643429:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1055 00000100:00100000:3.0:1788200839.643435:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695327232:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200839.643463:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695327232:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 28us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200839.643971:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1056 00000100:00100000:2.0:1788200839.643977:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695327104:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:2.0:1788200839.643998:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788200839.644053:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695327104:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 74us (981us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788200839.644060:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1056 00000100:00100000:3.0:1788200839.645592:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1055 00000100:00080000:0.0:1788200839.645635:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788200839.645646:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788200839.645651:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788200839.887236:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788200840.527283:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715016960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788200840.527608:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200840.529281:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715017088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788200840.529624:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715016960 00000100:00100000:0.0:1788200840.529635:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715016960 00000100:00100000:0.0:1788200840.529715:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2066 00000100:00100000:0.0:1788200840.529727:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715016960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788200840.529773:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200840.529864:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715016960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (2257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200840.529872:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2066 00000100:00100000:1.0:1788200840.530201:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200840.530446:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715017088 00000100:00100000:2.0:1788200840.530452:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715017088 00000100:00100000:2.0:1788200840.530500:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2067 00000100:00100000:2.0:1788200840.530509:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715017088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788200840.530532:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200840.530848:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715016960:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788200840.531188:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715017088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 680us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200840.531197:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2067 00000100:00100000:1.0:1788200840.532211:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715017088:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788200840.911231:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200841.935296:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200842.959297:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200843.983535:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788200844.623360:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120020380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715017216:0@lo:400:kworker.0 00000400:00000100:2.0:1788200844.623478:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715017216 offset 0 length 224: 4 00000100:00080000:0.0:1788200844.623568:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788200844.623574:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788200844.623579:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200844.623586:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3690 00000100:00080000:0.0:1788200844.623592:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788200844.623601:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788200844.623645:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc120022300 x1875060715017344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788200844.623735:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715017344:0@lo:38:kworker.0 00000100:00100000:1.0:1788200844.623786:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200844.623862:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715017344 00000100:00100000:1.0:1788200844.623872:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715017344 00000100:00100000:1.0:1788200844.623916:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:1.0:1788200844.623926:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715017344:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788200844.623952:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200844.624000:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715017344:12345-0@lo:38:kworker.0 Request processed in 74us (213us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788200844.624009:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00080000:1.0:1788200844.624087:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788200844.624092:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788200844.624095:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715017344:0@lo:38:kworker.0 00000100:00100000:3.0:1788200844.624347:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715017472:0@lo:400:kworker.0 00000100:00100000:3.0:1788200844.624387:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200844.624453:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715017472 00000100:00100000:3.0:1788200844.624457:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715017472 00000100:00100000:3.0:1788200844.624509:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:3.0:1788200844.624519:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715017472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200844.624567:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715017472:12345-0@lo:400:kworker.0 Request processed in 51us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200844.624589:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00100000:3.0:1788200844.624625:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715017472:0@lo:400:kworker.0 00000100:00080000:1.0:1788200844.625557:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788200844.632961:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788200844.632976:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788200844.632981:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200844.632992:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3690 00000100:00080000:0.0:1788200844.633000:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788200844.633008:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788200844.633097:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc120021c00 x1875060715017600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788200844.633160:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788200844.633164:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788200844.633166:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200844.633169:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3690 00000100:00080000:0.0:1788200844.633172:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788200844.633176:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788200844.633190:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc120021880 x1875060715017856/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788200844.633215:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788200844.633218:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788200844.633219:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200844.633223:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3690 00000100:00080000:0.0:1788200844.633225:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788200844.633228:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788200844.633236:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc120020e00 x1875060715018240/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788200844.633372:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715017984:0@lo:400:kworker.0 00000100:00100000:1.0:1788200844.633482:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200844.633545:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788200844.633552:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715017728:0@lo:400:kworker.0 00000100:00100000:1.0:1788200844.633582:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200844.633613:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120021c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715017600:0@lo:38:kworker.0 00000100:00100000:1.0:1788200844.633638:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200844.633655:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715017856:0@lo:38:kworker.0 00000100:00100000:1.0:1788200844.633690:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200844.633707:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120020e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715018240:0@lo:38:kworker.0 00000100:00100000:1.0:1788200844.633740:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200844.633777:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715017728 00000100:00100000:1.0:1788200844.633787:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715017728 00000100:00100000:1.0:1788200844.633854:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715017600 00000100:00100000:1.0:1788200844.633858:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715017600 00000100:00100000:1.0:1788200844.633873:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715018240 00000100:00100000:1.0:1788200844.633877:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715018240 00000100:00100000:1.0:1788200844.633890:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:1.0:1788200844.633901:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715017728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200844.633959:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715017728:12345-0@lo:400:kworker.0 Request processed in 60us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200844.633967:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00100000:1.0:1788200844.633988:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:1.0:1788200844.633994:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715017600:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788200844.634047:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200844.634079:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715017600:12345-0@lo:38:kworker.0 Request processed in 85us (441us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788200844.634085:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00100000:1.0:1788200844.634096:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:1.0:1788200844.634099:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715018240:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788200844.634107:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200844.634123:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715018240:12345-0@lo:38:kworker.0 Request processed in 24us (384us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788200844.634128:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00080000:1.0:1788200844.634150:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788200844.634189:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715017728:0@lo:400:kworker.0 00000100:00080000:1.0:1788200844.634216:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788200844.634221:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788200844.634223:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120021c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715017600:0@lo:38:kworker.0 00000100:00080000:1.0:1788200844.634229:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788200844.634232:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788200844.634234:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120020e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715018240:0@lo:38:kworker.0 00000100:00100000:2.0:1788200844.634471:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715018112:0@lo:400:kworker.0 00000100:00100000:2.0:1788200844.634511:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200844.634680:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715017984 00000100:00100000:0.0:1788200844.634686:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715017984 00000100:00100000:0.0:1788200844.634745:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715018112 00000100:00100000:0.0:1788200844.634749:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715018112 00000100:00100000:0.0:1788200844.634770:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2564 00000100:00100000:0.0:1788200844.634776:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715017984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200844.634820:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715017984:12345-0@lo:400:kworker.0 Request processed in 45us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200844.634834:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2564 00000100:00100000:0.0:1788200844.634848:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2565 00000100:00100000:0.0:1788200844.634855:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715018112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200844.634887:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715018112:12345-0@lo:400:kworker.0 Request processed in 33us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200844.634893:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2565 00000100:00100000:3.0:1788200844.635008:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715017856 00000100:00100000:3.0:1788200844.635048:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715017856 00000100:00100000:3.0:1788200844.635074:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3798 00000100:00100000:3.0:1788200844.635080:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715017856:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788200844.635092:0:8457:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788200844.635132:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715017856:12345-0@lo:38:kworker.0 Request processed in 51us (1440us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788200844.635138:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3798 00000100:00080000:3.0:1788200844.635178:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200844.635183:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200844.635186:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715017856:0@lo:38:kworker.0 00000100:00100000:1.0:1788200844.635306:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715017984:0@lo:400:kworker.0 00000100:00080000:2.0:1788200844.636569:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788200844.636578:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788200844.636619:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715018112:0@lo:400:kworker.0 00000400:00000100:2.0:1788200844.774222:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695327616 offset 0 length 224: 4 00000100:00100000:2.0:1788200844.774259:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200844.774284:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200844.774311:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200844.774376:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200844.774536:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695328000 00000100:00100000:0.0:1788200844.774546:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695328000 00000100:00100000:0.0:1788200844.774602:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695328128 00000100:00100000:0.0:1788200844.774605:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695328128 00000100:00100000:0.0:1788200844.774627:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5849 00000100:00100000:0.0:1788200844.774636:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:4292087e-fa00-4621-b681-837afc99ae35+5:2399:x1875060695328000:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:0.0:1788200844.774663:0:26211:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a362 00000100:00080000:0.0:1788200844.774670:0:26211:0:(import.c:65:import_set_state_nolock()) ffff8dc0078dd000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788200844.774709:0:26211:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969448 00000100:00100000:0.0:1788200844.774866:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:4292087e-fa00-4621-b681-837afc99ae35+2:2399:x1875060695328000:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 230us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200844.774874:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5849 00000100:00100000:0.0:1788200844.774889:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5850 00000100:00100000:0.0:1788200844.774897:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:4292087e-fa00-4621-b681-837afc99ae35+5:2399:x1875060695328128:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:0.0:1788200844.774907:0:26211:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a19ed8 00000100:00080000:0.0:1788200844.774912:0:26211:0:(import.c:65:import_set_state_nolock()) ffff8dc110730800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788200844.774931:0:26211:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969448 00000100:00100000:0.0:1788200844.775006:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:4292087e-fa00-4621-b681-837afc99ae35+2:2399:x1875060695328128:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 98us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200844.775048:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5850 00000100:00080000:0.0:1788200844.775064:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788200844.775067:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788200844.775082:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200844.775152:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788200844.775162:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695327872 00000100:00100000:0.0:1788200844.775166:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695327872 00000100:00100000:0.0:1788200844.775198:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695327744 00000100:00100000:0.0:1788200844.775201:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695327744 00000100:00100000:0.0:1788200844.775215:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1058 00000100:00100000:0.0:1788200844.775222:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695327872:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200844.775257:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695327872:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 35us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200844.775264:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1058 00000100:00100000:0.0:1788200844.775276:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1060 00000100:00100000:0.0:1788200844.775280:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875060695327744:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:0.0:1788200844.775299:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788200844.775321:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875060695327744:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 40us (1036us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788200844.775327:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1060 00000100:00080000:0.0:1788200844.775364:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788200845.007119:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200845.647271:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715018368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788200845.647343:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200845.647473:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715018368 00000100:00100000:2.0:1788200845.647489:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715018368 00000100:00100000:2.0:1788200845.647543:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2068 00000100:00100000:2.0:1788200845.647553:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715018368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788200845.647579:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788200845.647621:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715018368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200845.647628:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2068 00000100:00100000:1.0:1788200845.647816:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715018368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788200845.666414:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788200845.666446:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0073b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715018496:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788200845.666529:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200845.666726:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715018496 00000100:00100000:2.0:1788200845.666735:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715018496 00000100:00100000:2.0:1788200845.666784:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2069 00000100:00100000:2.0:1788200845.666794:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ac44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715018496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788200845.666822:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788200845.666870:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ac44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715018496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200845.666903:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2069 00000100:00100000:2.0:1788200845.667225:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0073b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715018496:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788200846.031217:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200847.056184:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200848.079155:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200849.109482:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788200849.745264:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788200849.745284:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788200849.745289:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200849.745299:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3696 00000100:00080000:0.0:1788200849.745306:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788200849.745315:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788200849.745343:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc120022680 x1875060715018752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788200849.745380:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788200849.745384:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788200849.745386:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200849.745390:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3696 00000100:00080000:0.0:1788200849.745393:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788200849.745398:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788200849.745411:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc120022300 x1875060715019008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788200849.745429:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788200849.745432:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788200849.745434:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200849.745438:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3696 00000100:00080000:0.0:1788200849.745441:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788200849.745445:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788200849.745459:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc120020e00 x1875060715019264/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788200849.745482:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788200849.745491:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788200849.745494:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200849.745498:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3696 00000100:00080000:0.0:1788200849.745502:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788200849.745506:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788200849.745519:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12ee2df80 x1875060715019648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788200849.745561:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120021c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715019392:0@lo:400:kworker.0 00000100:00100000:0.0:1788200849.745662:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200849.745717:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788200849.745723:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715018624:0@lo:400:kworker.0 00000400:00000100:0.0:1788200849.745745:0:3655:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715018624 offset 0 length 224: 4 00000100:00100000:3.0:1788200849.745857:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120022680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715018752:0@lo:38:kworker.0 00000100:00100000:3.0:1788200849.745896:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200849.745917:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715019008:0@lo:38:kworker.0 00000100:00100000:3.0:1788200849.745935:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200849.745951:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120020e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715019264:0@lo:38:kworker.0 00000100:00100000:0.0:1788200849.745976:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715019520:0@lo:400:kworker.0 00000100:00100000:3.0:1788200849.745985:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200849.746039:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715019648:0@lo:38:kworker.0 00000100:00100000:0.0:1788200849.746042:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200849.746075:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200849.746091:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715018880:0@lo:400:kworker.0 00000100:00100000:3.0:1788200849.746123:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715019392 00000100:00100000:0.0:1788200849.746129:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200849.746134:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715019392 00000100:00100000:0.0:1788200849.746159:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788200849.746166:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715019136:0@lo:400:kworker.0 00000100:00100000:0.0:1788200849.746196:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200849.746209:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715019520 00000100:00100000:3.0:1788200849.746222:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715019520 00000100:00100000:0.0:1788200849.746243:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566 00000100:00100000:0.0:1788200849.746258:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715019392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200849.746270:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567 00000100:00100000:3.0:1788200849.746280:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715019520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200849.746476:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715019392:12345-0@lo:400:kworker.0 Request processed in 221us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200849.746483:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566 00000100:00100000:0.0:1788200849.746521:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715018752 00000100:00100000:0.0:1788200849.746526:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715018752 00000100:00100000:0.0:1788200849.746544:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715019008 00000100:00100000:0.0:1788200849.746546:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715019008 00000100:00100000:0.0:1788200849.746553:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715019648 00000100:00100000:0.0:1788200849.746555:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715019648 00000100:00100000:0.0:1788200849.746562:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715018880 00000100:00100000:0.0:1788200849.746564:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715018880 00000100:00100000:0.0:1788200849.746582:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715019136 00000100:00100000:0.0:1788200849.746584:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715019136 00000100:00100000:0.0:1788200849.746599:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:0.0:1788200849.746605:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715018880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200849.746657:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715018880:12345-0@lo:400:kworker.0 Request processed in 52us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200849.746664:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:0.0:1788200849.746685:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:0.0:1788200849.746691:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715019136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200849.746724:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715019136:12345-0@lo:400:kworker.0 Request processed in 33us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200849.746730:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:0.0:1788200849.746743:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:0.0:1788200849.746747:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715018752:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788200849.746773:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788200849.747063:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715018752:12345-0@lo:38:kworker.0 Request processed in 312us (1163us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788200849.747071:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:0.0:1788200849.747087:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:0.0:1788200849.747090:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715019008:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788200849.747109:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788200849.747137:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715019008:12345-0@lo:38:kworker.0 Request processed in 44us (1200us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788200849.747143:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:0.0:1788200849.747155:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:0.0:1788200849.747160:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715019648:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788200849.747169:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788200849.747194:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715019648:12345-0@lo:38:kworker.0 Request processed in 33us (1120us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788200849.747199:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00100000:0.0:1788200849.747245:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715019136:0@lo:400:kworker.0 00000100:00100000:0.0:1788200849.747258:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715018880:0@lo:400:kworker.0 00000100:00100000:0.0:1788200849.747301:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120021c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715019392:0@lo:400:kworker.0 00000100:00100000:3.0:1788200849.748521:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715019520:12345-0@lo:400:kworker.0 Request processed in 2237us (2498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200849.748534:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567 00000100:00100000:3.0:1788200849.748599:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715019264 00000100:00100000:3.0:1788200849.748723:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715019264 00000100:00100000:3.0:1788200849.748761:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3799 00000100:00100000:3.0:1788200849.748767:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715019264:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788200849.748788:0:8458:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788200849.748834:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715019264:12345-0@lo:38:kworker.0 Request processed in 66us (2853us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788200849.748840:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3799 00000100:00080000:3.0:1788200849.748863:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788200849.748869:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788200849.748872:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788200849.748915:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200849.748920:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200849.748924:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120022680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715018752:0@lo:38:kworker.0 00000100:00080000:3.0:1788200849.749002:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200849.749007:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200849.749011:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715019008:0@lo:38:kworker.0 00000100:00080000:3.0:1788200849.749044:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200849.749048:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200849.749051:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120020e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715019264:0@lo:38:kworker.0 00000100:00080000:3.0:1788200849.749073:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200849.749077:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200849.749079:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715019648:0@lo:38:kworker.0 00000100:00100000:3.0:1788200849.749130:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715019520:0@lo:400:kworker.0 00000100:00100000:0.0:1788200849.885545:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000400:00000100:0.0:1788200849.885596:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695328256 offset 0 length 224: 4 00000100:00100000:0.0:1788200849.885694:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200849.885818:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695328384 00000100:00100000:2.0:1788200849.885832:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695328384 00000100:00100000:2.0:1788200849.885882:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695328512 00000100:00100000:2.0:1788200849.885884:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695328512 00000100:00100000:2.0:1788200849.885934:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1061 00000100:00100000:2.0:1788200849.885944:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695328512:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788200849.886057:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695328512:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 114us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200849.886064:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1061 00000100:00100000:2.0:1788200849.886085:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1064 00000100:00100000:2.0:1788200849.886089:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695328384:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:2.0:1788200849.886111:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788200849.886137:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695328384:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 47us (608us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788200849.886143:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1064 00000100:00080000:2.0:1788200849.886157:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788200850.127411:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788200850.266126:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4292087e-fa00-4621-b681-837afc99ae35 00000020:00000080:3.0:1788200850.266139:0:9526:0:(genops.c:885:class_export_put()) final put ffff8dc103482000/4292087e-fa00-4621-b681-837afc99ae35 00000001:00100000:2.0:1788200850.267716:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4292087e-fa00-4621-b681-837afc99ae35 00000020:00000080:2.0:1788200850.267729:0:8442:0:(genops.c:885:class_export_put()) final put ffff8dc0078dd800/4292087e-fa00-4621-b681-837afc99ae35 00000020:00000080:0.0:1788200850.268819:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc103482000/4292087e-fa00-4621-b681-837afc99ae35 for lustre-OST0001 00000020:00000080:0.0:1788200850.268914:0:41592:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc110730800 for lustre-OST0001 00000020:00000080:3.0:1788200850.271784:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0078dd800/4292087e-fa00-4621-b681-837afc99ae35 for lustre-OST0000 00000020:00000080:3.0:1788200850.271869:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc0078dd000 for lustre-OST0000 00000100:00100000:1.0:1788200850.767201:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788200850.767228:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0073b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715019776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788200850.767284:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200850.767445:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715019776 00000100:00100000:2.0:1788200850.767452:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715019776 00000100:00100000:2.0:1788200850.767506:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2070 00000100:00100000:2.0:1788200850.767517:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715019776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788200850.767555:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788200850.767600:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715019776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200850.767617:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2070 00000100:00100000:2.0:1788200850.767665:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0073b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715019776:0@lo:13:osp-pre-0-1.0 00000100:00000400:2.0:1788200850.772588:0:3655:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788200834/real 1788200834] req@ffff8dc003a70000 x1875060715013888/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788200850 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788200850.772626:0:3655:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8dc003a70000 x1875060715013888/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788200850 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788200850.772635:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788200850.772639:0:3655:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788200850.772643:0:3655:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.120@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788200850.772645:0:3655:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788200850.772649:0:3655:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc003a70000 x1875060715013888/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788200850 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788200850.772658:0:3655:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc12fb7b800 x1875060715015808/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788200855 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788200850.772679:0:3655:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc120020380 x1875060715017216/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788200860 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788200850.772688:0:3655:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc120023800 x1875060715018624/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788200865 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788200850.772696:0:3655:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788200850.772699:0:3655:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788200850.772700:0:3655:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788200850.772702:0:3655:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:2.0:1788200850.772719:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715018624:0@lo:400:kworker.0 00000100:00100000:2.0:1788200850.772739:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715013888:0@lo:400:kworker.0 00000100:00100000:3.0:1788200850.772817:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120020380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715017216:0@lo:400:kworker.0 00000100:00100000:3.0:1788200850.772825:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715015808:0@lo:400:kworker.0 00000100:00100000:2.0:1788200850.773481:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788200850.773493:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0073b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715019904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788200850.773555:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200850.773816:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715019904 00000100:00100000:1.0:1788200850.773825:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715019904 00000100:00100000:1.0:1788200850.774011:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2071 00000100:00100000:1.0:1788200850.774034:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715019904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788200850.774064:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200850.774120:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715019904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200850.774136:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2071 00000100:00100000:2.0:1788200850.774210:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0073b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715019904:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788200850.774760:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788200850.774765:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788200850.774767:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788200850.774771:0:76267:0:(import.c:510:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 3468 00000100:00080000:3.0:1788200850.774776:0:76267:0:(import.c:624:import_select_connection()) MGC192.168.201.120@tcp: import ffff8dc104280800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788200850.774794:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc140294e00 x1875060715020032/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788200850.774859:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715020032:0@lo:250:kworker.0 00000400:00000100:2.0:1788200850.774890:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715020032 offset 0 length 520: 4 00000100:00080000:3.0:1788200850.774936:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788200850.774940:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788200850.774942:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788200850.774945:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3701 00000100:00080000:3.0:1788200850.774948:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788200850.774952:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788200850.774976:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc140294a80 x1875060715020160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788200850.777954:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715020160:0@lo:38:kworker.0 00000100:00100000:2.0:1788200850.778043:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200850.778139:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715020160 00000100:00100000:0.0:1788200850.778147:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715020160 00000100:00100000:0.0:1788200850.778189:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:0.0:1788200850.778197:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715020160:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788200850.778228:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788200850.778288:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715020160:12345-0@lo:38:kworker.0 Request processed in 90us (244us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788200850.778295:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00080000:0.0:1788200850.778331:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788200850.778337:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788200850.778340:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715020160:0@lo:38:kworker.0 00000100:00080000:2.0:1788200850.781030:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788200850.781036:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788200850.781039:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788200850.781045:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3701 00000100:00080000:2.0:1788200850.781048:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788200850.781054:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788200850.781069:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc0073b8e00 x1875060715020416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788200850.781083:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788200850.781085:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788200850.781086:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788200850.781089:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3701 00000100:00080000:2.0:1788200850.781090:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788200850.781092:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788200850.781112:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc139ba1180 x1875060715020672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788200850.781119:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788200850.781121:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788200850.781122:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788200850.781124:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3701 00000100:00080000:2.0:1788200850.781126:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788200850.781128:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788200850.781133:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc139ba0700 x1875060715020800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788200850.781154:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0073bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715020544:0@lo:400:kworker.0 00000100:00100000:2.0:1788200850.781215:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200850.781252:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788200850.781258:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0073b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715020288:0@lo:400:kworker.0 00000100:00100000:2.0:1788200850.781278:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200850.781304:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715020544 00000100:00100000:2.0:1788200850.781309:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715020544 00000100:00100000:2.0:1788200850.781340:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715020288 00000100:00100000:2.0:1788200850.781342:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715020288 00000100:00100000:2.0:1788200850.781354:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:2.0:1788200850.781360:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715020544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200850.781666:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0073b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715020416:0@lo:38:kworker.0 00000100:00100000:0.0:1788200850.781691:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200850.781705:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc139ba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715020672:0@lo:38:kworker.0 00000100:00100000:0.0:1788200850.781721:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200850.781731:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc139ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715020800:0@lo:38:kworker.0 00000100:00100000:0.0:1788200850.781743:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200850.782134:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715020416 00000100:00100000:0.0:1788200850.782140:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715020416 00000100:00100000:0.0:1788200850.782158:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715020800 00000100:00100000:0.0:1788200850.782161:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715020800 00000100:00100000:0.0:1788200850.782170:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:0.0:1788200850.782176:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715020288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200850.782214:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715020288:12345-0@lo:400:kworker.0 Request processed in 40us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200850.782218:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00100000:0.0:1788200850.782231:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:0.0:1788200850.782233:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715020416:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788200850.782249:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788200850.782267:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715020416:12345-0@lo:38:kworker.0 Request processed in 33us (576us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788200850.782280:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:0.0:1788200850.782289:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:0.0:1788200850.782292:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120020380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715020800:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788200850.782298:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788200850.782313:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120020380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715020800:12345-0@lo:38:kworker.0 Request processed in 20us (569us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788200850.782316:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00080000:0.0:1788200850.782337:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788200850.782341:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788200850.782343:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0073b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715020416:0@lo:38:kworker.0 00000100:00080000:0.0:1788200850.782349:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788200850.782351:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788200850.782352:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc139ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715020800:0@lo:38:kworker.0 00000100:00100000:2.0:1788200850.782976:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715020544:12345-0@lo:400:kworker.0 Request processed in 1612us (1757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200850.782984:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:2.0:1788200850.783049:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0073b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715020288:0@lo:400:kworker.0 00000100:00100000:2.0:1788200850.783066:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0073bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715020544:0@lo:400:kworker.0 00000100:00100000:3.0:1788200850.783227:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715020672 00000100:00100000:3.0:1788200850.783232:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715020672 00000100:00100000:3.0:1788200850.783254:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3800 00000100:00100000:3.0:1788200850.783259:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715020672:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788200850.783271:0:8457:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788200850.783310:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715020672:12345-0@lo:38:kworker.0 Request processed in 50us (1586us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788200850.783316:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3800 00000100:00080000:3.0:1788200850.783347:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200850.783350:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200850.783353:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc139ba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715020672:0@lo:38:kworker.0 00000400:00000100:2.0:1788200850.926114:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695328640 offset 0 length 520: 4 00000100:00100000:2.0:1788200850.926154:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200850.926184:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200850.926216:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695328896 00000100:00100000:2.0:1788200850.926225:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695328896 00000100:00100000:2.0:1788200850.926273:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695328768 00000100:00100000:2.0:1788200850.926276:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695328768 00000100:00100000:2.0:1788200850.926295:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1064 00000100:00100000:2.0:1788200850.926305:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695328896:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788200850.926389:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695328896:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 84us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200850.926397:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1064 00000100:00100000:2.0:1788200850.926417:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1068 00000100:00100000:2.0:1788200850.926421:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695328768:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:2.0:1788200850.926442:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788200850.926467:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695328768:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 44us (283us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788200850.926473:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1068 00010000:00010000:0.0:1788200851.151135:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200852.175103:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200853.201362:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200854.224125:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200855.248012:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788200855.292254:0:85228:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788200855.292261:0:85228:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788200855.292263:0:85228:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788200855.292607:0:85228:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dc11d438000 00000020:01000004:1.0:1788200855.292622:0:85228:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788200855.292636:0:85228:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788200855.292651:0:85228:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8dc004040000) 00000020:00000080:1.0:1788200855.292669:0:85228:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788200855.411381:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788200855.417362:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788200855.418378:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788200855.418966:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788200855.419525:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788200855.419825:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788200855.420571:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788200855.420763:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788200855.420971:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788200855.421259:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788200855.421656:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788200855.421820:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788200855.422091:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788200855.422652:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788200855.426614:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788200855.428597:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788200855.428799:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788200855.429009:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788200855.429361:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788200855.429584:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788200855.429743:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788200855.429949:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788200855.430511:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788200855.430912:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788200855.431277:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788200855.431716:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788200855.431971:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788200855.432498:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788200855.432740:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788200855.432985:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788200855.433415:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788200855.433694:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788200855.433912:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788200855.434125:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788200855.434643:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788200855.434845:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788200855.435298:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788200855.435931:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788200855.436241:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788200855.436691:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788200855.436958:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788200855.437513:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788200855.437732:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788200855.437971:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788200855.438388:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788200855.438663:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788200855.438823:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788200855.440282:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788200855.440795:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788200855.441047:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788200855.442378:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788200855.442636:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788200855.442793:0:85228:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1788200855.443704:0:85228:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788200855.443984:0:85228:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788200855.443993:0:85228:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788200855.444005:0:85228:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1a47a 00000020:01000004:3.0:1788200855.444012:0:85228:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788200855.444101:0:85228:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788200855.444107:0:85228:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dc11d438000 from MGS 00000020:01000004:3.0:1788200855.444211:0:85228:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788200855.444222:0:85228:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8dc1401b0000) 00000020:00000080:3.0:1788200855.444236:0:85228:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:3.0:1788200855.444398:0:85228:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc11d438000 from MGS, refs=2 00080000:01000000:3.0:1788200855.444403:0:85228:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788200855.444408:0:85228:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1a488 00010000:00010000:3.0:1788200855.444592:0:85228:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1788200855.451058:0:85228:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788200855.456041:0:85232:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788200855.456103:0:85228:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788200855.456145:0:85228:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788200855.456830:0:85228:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788200855.457108:0:85228:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788200855.457261:0:85228:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788200855.457268:0:85228:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788200855.458753:0:85228:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788200855.458762:0:85228:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788200855.459152:0:85228:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788200855.459159:0:85228:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788200855.459866:0:85228:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788200855.459887:0:85228:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1788200855.459889:0:85228:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.120@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1788200855.459892:0:85228:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.120@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:3.0:1788200855.459898:0:85228:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8dc104280800 already not connected (conn 64, was 0): CONNECTING 00000100:00100000:3.0:1788200855.459903:0:85228:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:1.0:1788200855.887683:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc139ba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715020928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788200855.887755:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200855.887799:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715021056:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788200855.887823:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200855.887940:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715020928 00000100:00100000:0.0:1788200855.887948:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715020928 00000100:00100000:0.0:1788200855.888008:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715021056 00000100:00100000:0.0:1788200855.888011:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715021056 00000100:00100000:0.0:1788200855.888051:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2072 00000100:00100000:0.0:1788200855.888061:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715020928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788200855.888090:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200855.888138:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715020928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200855.888172:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2072 00000100:00100000:0.0:1788200855.888190:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2073 00000100:00100000:0.0:1788200855.888197:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715021056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788200855.888212:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200855.888241:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715021056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200855.888247:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2073 00000100:00100000:0.0:1788200855.888298:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc139ba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715020928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788200855.888312:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715021056:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788200855.888380:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788200855.888384:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788200855.888397:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788200855.888403:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788200855.888406:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788200855.888409:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788200855.888413:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788200855.888430:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3702 00000100:00080000:2.0:1788200855.888434:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788200855.888439:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788200855.888461:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc139ba0700 x1875060715021184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788200855.888500:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788200855.888504:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788200855.888506:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788200855.888509:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3702 00000100:00080000:2.0:1788200855.888512:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788200855.888532:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788200855.888546:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc003a70000 x1875060715021440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788200855.888569:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788200855.888572:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788200855.888574:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788200855.888578:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3702 00000100:00080000:2.0:1788200855.888580:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788200855.888583:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200855.888587:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc139ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715021184:0@lo:38:kworker.0 00000100:00100000:2.0:1788200855.888595:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc118140380 x1875060715021696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788200855.888604:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788200855.888607:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788200855.888608:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788200855.888611:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3702 00000100:00080000:2.0:1788200855.888614:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1788200855.888615:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788200855.888617:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788200855.888626:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc118142d80 x1875060715021824/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788200855.888633:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715021440:0@lo:38:kworker.0 00000100:00100000:1.0:1788200855.888653:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200855.888658:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788200855.888666:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715021568:0@lo:400:kworker.0 00000100:00100000:1.0:1788200855.888669:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715021696:0@lo:38:kworker.0 00000100:00100000:1.0:1788200855.888689:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200855.888689:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200855.888704:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715021824:0@lo:38:kworker.0 00000100:00100000:2.0:1788200855.888716:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715021184 00000100:00100000:2.0:1788200855.888720:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715021184 00000100:00100000:1.0:1788200855.888722:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200855.888738:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715021440 00000100:00100000:2.0:1788200855.888746:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715021440 00000100:00100000:1.0:1788200855.888755:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715021568 00000100:00100000:1.0:1788200855.888758:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715021568 00000100:00100000:2.0:1788200855.888760:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715021824 00000100:00100000:2.0:1788200855.888762:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715021824 00000100:00100000:2.0:1788200855.888771:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:2.0:1788200855.888776:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715021184:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788200855.888786:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:1.0:1788200855.888792:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715021568:12345-0@lo:400:kworker.0 00010000:00020000:2.0:1788200855.888792:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200855.888823:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715021568:12345-0@lo:400:kworker.0 Request processed in 31us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200855.888823:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715021184:12345-0@lo:38:kworker.0 Request processed in 46us (207us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788200855.888829:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:0.0:1788200855.889035:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc139ba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715021312:0@lo:400:kworker.0 00000100:00100000:3.0:1788200855.889045:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715021696 00000100:00100000:3.0:1788200855.889051:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715021696 00000100:00100000:0.0:1788200855.889065:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200855.889078:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3801 00000100:00100000:3.0:1788200855.889091:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715021696:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788200855.889112:0:8458:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200855.889117:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:1.0:1788200855.889136:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715021312 00000100:00100000:1.0:1788200855.889139:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715021312 00000100:00100000:3.0:1788200855.889145:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715021696:12345-0@lo:38:kworker.0 Request processed in 54us (454us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788200855.889153:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3801 00000100:00100000:1.0:1788200855.889172:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:1.0:1788200855.889181:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120023800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715021312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200855.889199:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:3.0:1788200855.889205:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715021440:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788200855.889214:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788200855.889242:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715021440:12345-0@lo:38:kworker.0 Request processed in 36us (589us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788200855.889248:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:3.0:1788200855.889259:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00080000:0.0:1788200855.889264:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788200855.889385:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788200855.889390:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788200855.889393:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715021696:0@lo:38:kworker.0 00000100:00080000:0.0:1788200855.889403:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788200855.889406:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788200855.889409:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc139ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715021184:0@lo:38:kworker.0 00000100:00080000:0.0:1788200855.889417:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788200855.889420:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788200855.889423:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715021440:0@lo:38:kworker.0 00000100:00100000:3.0:1788200855.889456:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715021568:0@lo:400:kworker.0 00000100:00100000:1.0:1788200855.889495:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120023800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715021312:12345-0@lo:400:kworker.0 Request processed in 314us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200855.889510:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715021824:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788200855.889532:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200855.889569:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:2.0:1788200855.889573:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715021824:12345-0@lo:38:kworker.0 Request processed in 317us (850us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788200855.889579:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:0.0:1788200855.889640:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc139ba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715021312:0@lo:400:kworker.0 00000100:00080000:3.0:1788200855.890500:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200855.890507:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200855.890510:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715021824:0@lo:38:kworker.0 00000100:00100000:2.0:1788200856.023138:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200856.023642:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695329152 00000100:00100000:0.0:1788200856.023652:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695329152 00000100:00100000:0.0:1788200856.023719:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1067 00000100:00100000:0.0:1788200856.023727:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695329152:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200856.023788:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695329152:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 62us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200856.023793:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1067 00000100:00080000:1.0:1788200856.023849:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788200856.024980:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200856.025074:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695329024 00000100:00100000:1.0:1788200856.025082:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695329024 00000100:00100000:1.0:1788200856.025121:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1072 00000100:00100000:1.0:1788200856.025128:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875060695329024:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:1.0:1788200856.025150:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200856.025194:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875060695329024:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 64us (217us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788200856.025200:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1072 00010000:00010000:0.0:1788200856.271700:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788200857.045583:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200857.048934:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695329280 00000100:00100000:2.0:1788200857.048948:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695329280 00000100:00100000:2.0:1788200857.049064:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1073 00000100:00100000:2.0:1788200857.049076:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695329280:12345-192.168.201.20@tcp:17:kworker.0 00000100:00100000:2.0:1788200857.049184:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695329280:12345-192.168.201.20@tcp:17:kworker.0 Request processed in 110us (3612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200857.049192:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1073 00010000:00010000:1.0:1788200857.295490:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200858.319186:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200859.343640:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788200860.116429:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200860.116482:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200860.116546:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200860.116706:0:85234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695329408 00000100:00100000:2.0:1788200860.116711:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695329664 00000100:00100000:0.0:1788200860.116716:0:85234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695329408 00000100:00100000:2.0:1788200860.116719:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695329664 00000100:00100000:0.0:1788200860.116773:0:85234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:0.0:1788200860.116782:0:85234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2399:x1875060695329408:12345-192.168.201.20@tcp:250:kworker.0 00000100:00100000:2.0:1788200860.116790:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695329536 00000100:00100000:2.0:1788200860.116808:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695329536 00010000:00080000:0.0:1788200860.116811:0:85234:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 0fa559bc-2180-4019-80c4-11831fedf9a9@192.168.201.20@tcp t0 exp 0000000000000000 cur 3711 last 0 00000100:00100000:2.0:1788200860.116834:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1068 00000020:00000080:0.0:1788200860.116842:0:85234:0:(genops.c:1385:class_connect()) connect: client 0fa559bc-2180-4019-80c4-11831fedf9a9, cookie 0x96d0c9b8c9a1a48f 00000100:00100000:2.0:1788200860.116846:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695329664:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788200860.116934:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695329664:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 91us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200860.116946:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1068 00000100:00100000:2.0:1788200860.116968:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1074 00000100:00100000:2.0:1788200860.116974:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695329536:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:2.0:1788200860.116989:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1788200860.116990:0:85234:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788200860.117050:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695329536:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 40us (469us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788200860.117057:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1074 00000100:00100000:0.0:1788200860.117082:0:85234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+5:2399:x1875060695329408:12345-192.168.201.20@tcp:250:kworker.0 Request processed in 299us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200860.117090:0:85234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00080000:3.0:1788200860.117519:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788200860.367221:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788200861.007159:0:3654:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788200850/real 1788200850] req@ffff8dc140294e00 x1875060715020032/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788200860 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788200861.007192:0:3654:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dc140294e00 x1875060715020032/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788200860 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788200861.007236:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200861.007244:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788200861.007266:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715020032:0@lo:250:kworker.0 10000000:01000000:1.0:1788200861.007318:0:85228:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1788200861.007336:0:85228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064edc00/0x96d0c9b8c9a1a140 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1a147 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788200861.007347:0:85228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064edc00/0x96d0c9b8c9a1a140 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1a147 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788200861.007361:0:85228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788200861.007425:0:85228:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788200861.007459:0:85228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064edc00/0x96d0c9b8c9a1a140 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1a147 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.007480:0:85228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc140758200/0x96d0c9b8c9a1a0a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1a0ad expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788200861.007486:0:85228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc140758200/0x96d0c9b8c9a1a0a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1a0ad expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788200861.007492:0:85228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:0.0:1788200861.007605:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788200861.007611:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788200861.007614:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200861.007619:0:76267:0:(import.c:510:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 3702 00000100:00080000:0.0:1788200861.007624:0:76267:0:(import.c:589:import_select_connection()) MGC192.168.201.120@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788200861.007630:0:76267:0:(import.c:624:import_select_connection()) MGC192.168.201.120@tcp: import ffff8dc104280800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788200861.007657:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc120021f80 x1875060715022080/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788200861.007669:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1788200861.007677:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788200861.007682:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788200861.007684:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1788200861.007686:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715021952:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788200861.007689:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3707 00000100:00080000:0.0:1788200861.007695:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788200861.007700:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788200861.007718:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc120020e00 x1875060715022208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788200861.007744:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788200861.007748:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788200861.007750:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200861.007754:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3707 00000100:00080000:0.0:1788200861.007756:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788200861.007759:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788200861.007769:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc120022680 x1875060715022464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788200861.007774:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788200861.007792:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788200861.007796:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788200861.007798:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200861.007802:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3707 00000100:00080000:0.0:1788200861.007804:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788200861.007807:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788200861.007824:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc120023100 x1875060715022720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788200861.007833:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120021c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715022592:0@lo:400:kworker.0 00000100:00080000:0.0:1788200861.007846:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788200861.007850:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788200861.007852:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200861.007855:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3707 00000100:00080000:0.0:1788200861.007858:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788200861.007862:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788200861.007873:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc003a73800 x1875060715022976/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788200861.007883:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200861.007908:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715021952 00000100:00100000:2.0:1788200861.007911:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788200861.007915:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715021952 00000100:00100000:2.0:1788200861.007919:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715022336:0@lo:400:kworker.0 00000100:00100000:2.0:1788200861.007947:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200861.007972:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2074 00000100:00100000:2.0:1788200861.007980:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715022848:0@lo:400:kworker.0 00000100:00100000:0.0:1788200861.007984:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118142d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715021952:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788200861.008012:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1788200861.008013:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200861.008077:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118142d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715021952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200861.008084:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2074 00000100:00100000:0.0:1788200861.008107:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715022592 00000100:00100000:0.0:1788200861.008111:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715022592 00000100:00100000:2.0:1788200861.008257:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715021952:0@lo:13:osp-pre-0-1.0 00000100:00020000:2.0:1788200861.008280:0:3654:0:(client.c:1404:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff8dc120021f80 x1875060715022080/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788200861.009253:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715022848 00000100:00100000:3.0:1788200861.009260:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715022848 00000100:00100000:3.0:1788200861.009300:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2568 00000100:00100000:3.0:1788200861.009307:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715022848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200861.009611:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715022848:12345-0@lo:400:kworker.0 Request processed in 303us (1598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200861.009619:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2568 00010000:00010000:1.0:1788200861.009651:0:85228:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788200861.009665:0:85228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc140758200/0x96d0c9b8c9a1a0a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1a0ad expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.009682:0:85228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee400/0x96d0c9b8c9a1a0c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1a0c9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200861.009684:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715023104:0@lo:13:osp-pre-1-1.0 10000000:00010000:1.0:1788200861.009698:0:85228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee400/0x96d0c9b8c9a1a0c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1a0c9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788200861.009704:0:85228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788200861.009722:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788200861.009731:0:85228:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788200861.009739:0:85228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee400/0x96d0c9b8c9a1a0c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1a0c9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.009749:0:85228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1a0ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1a0f3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200861.009762:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715023104 00000100:00100000:3.0:1788200861.009768:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715023104 10000000:00010000:1.0:1788200861.009787:0:85228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1a0ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1a0f3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788200861.009795:0:85228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788200861.009795:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2075 00000100:00100000:3.0:1788200861.009804:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140296d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715023104:12345-0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788200861.009818:0:85228:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00002000:00000024:3.0:1788200861.009825:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00010000:00010000:1.0:1788200861.009827:0:85228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1a0ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1a0f3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.009853:0:85228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2200/0x96d0c9b8c9a1a0fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1a101 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788200861.009861:0:85228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2200/0x96d0c9b8c9a1a0fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1a101 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200861.009867:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140296d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715023104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (144us total) trans 0 rc 0/0 10000000:01000000:1.0:1788200861.009872:0:85228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788200861.009878:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2075 00010000:00010000:1.0:1788200861.009893:0:85228:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788200861.009899:0:85228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2200/0x96d0c9b8c9a1a0fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1a101 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.009908:0:85228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3400/0x96d0c9b8c9a1a116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1a11d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788200861.009915:0:85228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3400/0x96d0c9b8c9a1a116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1a11d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200861.009920:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715023104:0@lo:13:osp-pre-1-1.0 10000000:01000000:1.0:1788200861.009924:0:85228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788200861.009945:0:85228:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788200861.009950:0:85228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3400/0x96d0c9b8c9a1a116 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1a11d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200861.009963:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715022848:0@lo:400:kworker.0 00010000:00010000:1.0:1788200861.009979:0:85228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3600/0x96d0c9b8c9a1a124 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1a12b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788200861.009988:0:85228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3600/0x96d0c9b8c9a1a124 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1a12b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788200861.009993:0:85228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788200861.010033:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715022336 00000100:00100000:3.0:1788200861.010038:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715022336 00010000:00010000:1.0:1788200861.010091:0:85228:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788200861.010098:0:85228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3600/0x96d0c9b8c9a1a124 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1a12b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.010108:0:85228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed200/0x96d0c9b8c9a1a14e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1a155 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788200861.010115:0:85228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed200/0x96d0c9b8c9a1a14e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1a155 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788200861.010120:0:85228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788200861.010135:0:85228:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788200861.010138:0:85228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed200/0x96d0c9b8c9a1a14e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1a155 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.010160:0:85228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2400/0x96d0c9b8c9a1a0b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1a0bb expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788200861.010167:0:85228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2400/0x96d0c9b8c9a1a0b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1a0bb expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788200861.010172:0:85228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788200861.010185:0:85228:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788200861.010189:0:85228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2400/0x96d0c9b8c9a1a0b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1a0bb expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.010208:0:85228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3000/0x96d0c9b8c9a1a0d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1a0d7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788200861.010216:0:85228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3000/0x96d0c9b8c9a1a0d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1a0d7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788200861.010221:0:85228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1788200861.010227:0:85228:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788200861.010231:0:85228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3000/0x96d0c9b8c9a1a0d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1a0d7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.010247:0:85228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1a0de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1a0e5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788200861.010253:0:85228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1a0de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1a0e5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788200861.010258:0:85228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788200861.010263:0:85228:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788200861.010267:0:85228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1a0de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1a0e5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.010275:0:85228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc140758400/0x96d0c9b8c9a1a108 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1a10f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788200861.010282:0:85228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc140758400/0x96d0c9b8c9a1a108 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1a10f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788200861.010296:0:85228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788200861.010309:0:85228:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788200861.010314:0:85228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc140758400/0x96d0c9b8c9a1a108 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1a10f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.010324:0:85228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3200/0x96d0c9b8c9a1a132 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1a139 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788200861.010331:0:85228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3200/0x96d0c9b8c9a1a132 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1a139 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788200861.010337:0:85228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788200861.010346:0:85228:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788200861.010350:0:85228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3200/0x96d0c9b8c9a1a132 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1a139 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200861.011178:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:3.0:1788200861.011191:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715022592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200861.014612:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715022592:12345-0@lo:400:kworker.0 Request processed in 3416us (6725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200861.014628:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:3.0:1788200861.014661:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:3.0:1788200861.014672:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715022336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200861.014704:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715022336:12345-0@lo:400:kworker.0 Request processed in 36us (6758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200861.014709:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00080000:3.0:1788200861.014735:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788200861.014741:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788200861.014744:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788200861.014803:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715022336:0@lo:400:kworker.0 00000100:00100000:3.0:1788200861.014815:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120021c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715022592:0@lo:400:kworker.0 00000100:00080000:1.0:1788200861.027179:0:85228:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8dc104280800 already not connected (conn 65, was 0): CONNECTING 00000100:00080000:1.0:1788200861.027190:0:85228:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:2.0:1788200861.027295:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788200861.027324:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00080000:1.0:1788200861.027407:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200861.027412:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788200861.027415:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200861.027420:0:76267:0:(import.c:510:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 3712 00000100:00080000:1.0:1788200861.027424:0:76267:0:(import.c:589:import_select_connection()) MGC192.168.201.120@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788200861.027440:0:76267:0:(import.c:624:import_select_connection()) MGC192.168.201.120@tcp: import ffff8dc104280800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200861.027479:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004be4380 x1875060715023232/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788200861.027531:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:0:1875060715022080:0@lo:250:kworker.0 00000100:00100000:2.0:1788200861.028670:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120020e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715022208:0@lo:38:kworker.0 00000100:00100000:2.0:1788200861.028745:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200861.028797:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120022680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715022464:0@lo:38:kworker.0 00000100:00100000:2.0:1788200861.028824:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200861.028981:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715022720:0@lo:38:kworker.0 00000100:00100000:2.0:1788200861.029008:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200861.029081:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715022720 00000100:00100000:2.0:1788200861.029089:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715022720 00000100:00100000:2.0:1788200861.029128:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3802 00000100:00100000:2.0:1788200861.029136:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715022720:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788200861.029158:0:8457:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788200861.029494:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715022720:12345-0@lo:38:kworker.0 Request processed in 355us (483us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788200861.029502:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3802 00000100:00080000:2.0:1788200861.029559:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788200861.029563:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788200861.029566:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715022720:0@lo:38:kworker.0 00000100:00100000:2.0:1788200861.029573:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715022976:0@lo:38:kworker.0 00000100:00100000:2.0:1788200861.029598:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200861.030388:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715023232:0@lo:250:kworker.0 00000100:00100000:2.0:1788200861.030451:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200861.031626:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715022208 00000100:00100000:0.0:1788200861.031636:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715022208 00000100:00100000:0.0:1788200861.031726:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715022464 00000100:00100000:0.0:1788200861.031730:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715022464 00000100:00100000:1.0:1788200861.031788:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715022976 00000100:00100000:1.0:1788200861.031802:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715022976 00000100:00100000:3.0:1788200861.031869:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:3.0:1788200861.031879:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715022208:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788200861.031901:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788200861.031966:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715022208:12345-0@lo:38:kworker.0 Request processed in 86us (3220us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788200861.031973:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:3.0:1788200861.031988:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:3.0:1788200861.031992:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715022464:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788200861.032002:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788200861.032067:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715022464:12345-0@lo:38:kworker.0 Request processed in 72us (3241us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788200861.032073:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:3.0:1788200861.032086:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:3.0:1788200861.032091:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715022976:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788200861.032101:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788200861.032126:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715022976:12345-0@lo:38:kworker.0 Request processed in 33us (2526us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788200861.032131:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00080000:2.0:1788200861.039315:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788200861.039329:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788200861.039334:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120020e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715022208:0@lo:38:kworker.0 00000100:00080000:2.0:1788200861.039345:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788200861.039349:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788200861.039352:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120022680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715022464:0@lo:38:kworker.0 00000100:00080000:2.0:1788200861.039361:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788200861.039365:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788200861.039368:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715022976:0@lo:38:kworker.0 00000100:00100000:0.0:1788200861.042259:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715023232 00000100:00100000:0.0:1788200861.042276:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715023232 00000100:00100000:0.0:1788200861.042320:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788200861.042329:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3654:x1875060715023232:12345-0@lo:250:kworker.0 00010000:00080000:0.0:1788200861.042371:0:85236:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c9b18af6-fecc-4172-82c2-66531890fe11@0@lo t0 exp 0000000000000000 cur 3712 last 0 00000020:00000080:0.0:1788200861.042414:0:85236:0:(genops.c:1385:class_connect()) connect: client c9b18af6-fecc-4172-82c2-66531890fe11, cookie 0x96d0c9b8c9a1a496 00000100:00080000:0.0:1788200861.042554:0:85236:0:(import.c:65:import_set_state_nolock()) ffff8dc13f868000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788200861.042641:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+5:3654:x1875060715023232:12345-0@lo:250:kworker.0 Request processed in 312us (12188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200861.042648:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788200861.043216:0:3654:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.120@tcp: committing for last_committed 0 gen 24 00000100:00080000:2.0:1788200861.043227:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.120@tcp: connect to target with instance 0 00000100:00080000:2.0:1788200861.043234:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788200861.043240:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788200861.043243:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788200861.043246:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788200861.043281:0:3654:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788200861.043292:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715023232:0@lo:250:kworker.0 00000100:00080000:2.0:1788200861.043335:0:85228:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1788200861.043347:0:85228:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788200861.043378:0:85228:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788200861.043383:0:85228:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788200861.043509:0:85228:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788200861.043544:0:85228:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.120@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788200861.043548:0:85228:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788200861.043550:0:85228:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788200861.043555:0:85228:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788200861.043556:0:85228:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788200861.043557:0:85228:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788200861.043558:0:85228:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788200861.043559:0:85228:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788200861.043560:0:85228:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788200861.043562:0:85228:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788200861.043563:0:85228:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788200861.043565:0:85228:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788200861.043567:0:85228:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788200861.043568:0:85228:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788200861.043569:0:85228:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788200861.043570:0:85228:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788200861.043571:0:85228:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788200861.043573:0:85228:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788200861.043574:0:85228:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788200861.043575:0:85228:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788200861.043576:0:85228:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788200861.043577:0:85228:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788200861.043597:0:85228:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788200861.043612:0:85228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715023360:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788200861.043656:0:85228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200861.043687:0:85228:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13ab40b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788200861.043715:0:85235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715023360 00000100:00100000:2.0:1788200861.043719:0:85235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715023360 00000100:00100000:2.0:1788200861.043749:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000020:01000000:1.0:1788200861.046460:0:76267:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.201.120@tcp 10000000:01000000:1.0:1788200861.046488:0:76267:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1788200861.046492:0:76267:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788200861.046493:0:76267:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788200861.046495:0:76267:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788200861.046496:0:76267:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788200861.046497:0:76267:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788200861.046499:0:76267:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788200861.046500:0:76267:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788200861.046502:0:76267:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788200861.046503:0:76267:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1788200861.046559:0:76267:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1788200861.046567:0:76267:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1788200861.046569:0:76267:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788200861.046570:0:76267:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788200861.046571:0:76267:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788200861.046573:0:76267:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788200861.046574:0:76267:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788200861.046575:0:76267:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788200861.046576:0:76267:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788200861.046577:0:76267:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788200861.046579:0:76267:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1788200861.046590:0:76267:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1788200861.046594:0:76267:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1788200861.046596:0:76267:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788200861.046597:0:76267:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788200861.046598:0:76267:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788200861.046599:0:76267:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788200861.046600:0:76267:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788200861.046601:0:76267:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788200861.046602:0:76267:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788200861.046603:0:76267:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788200861.046605:0:76267:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1788200861.046621:0:76267:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1788200861.047518:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+5:85228:x1875060715023360:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788200861.047566:0:85235:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788200861.047569:0:85235:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788200861.047572:0:85235:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000100:00100000:2.0:1788200861.047619:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715023488:0@lo:253:kworker.0 00000100:00100000:2.0:1788200861.047689:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200861.047731:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788200861.047737:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715023616:0@lo:253:kworker.0 00000100:00100000:2.0:1788200861.048155:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200861.048304:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715023744:0@lo:253:kworker.0 00000100:00100000:2.0:1788200861.048339:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200861.048517:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715023488 00000100:00100000:0.0:1788200861.048524:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715023488 00000100:00100000:0.0:1788200861.048556:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715023616 00000100:00100000:0.0:1788200861.048559:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715023616 00000100:00100000:0.0:1788200861.048570:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715023744 00000100:00100000:0.0:1788200861.048572:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715023744 00000100:00100000:0.0:1788200861.048585:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788200861.048594:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:3657:x1875060715023488:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788200861.048614:0:85236:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 10000000:01000000:0.0:1788200861.049977:0:85238:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788200861.051370:0:85235:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 103 20000000:01000000:2.0:1788200861.067876:0:85239:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788200861.067885:0:85239:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788200861.067888:0:85239:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788200861.067891:0:85239:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788200861.068248:0:85239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788200861.068459:0:85235:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788200861.068509:0:85236:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788200861.069341:0:85235:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788200861.073683:0:85236:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788200861.073708:0:85236:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788200861.074295:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:3657:x1875060715023488:12345-0@lo:253:kworker.0 Request processed in 25696us (26600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200861.074309:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:2.0:1788200861.074325:0:3657:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788200861.074329:0:3657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788200861.074331:0:3657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788200861.074332:0:3657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788200861.074333:0:3657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788200861.074335:0:3657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788200861.074337:0:3657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788200861.074339:0:3657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788200861.074341:0:3657:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788200861.074346:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715023488:0@lo:253:kworker.0 00000100:00100000:0.0:1788200861.074353:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788200861.074366:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+7:3657:x1875060715023616:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788200861.074405:0:85236:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788200861.074418:0:85236:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788200861.074774:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+7:85228:x1875060715023360:12345-0@lo:253:mount.lustre.0 Request processed in 31017us (31116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200861.074787:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788200861.074813:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788200861.074822:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+6:3655:x1875060715023744:12345-0@lo:253:kworker.0 00000100:00100000:2.0:1788200861.074837:0:85228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715023360:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788200861.074848:0:85228:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 20000000:01000000:3.0:1788200861.074850:0:85235:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000020:01000004:2.0:1788200861.074851:0:85228:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788200861.074855:0:85228:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788200861.074857:0:85228:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788200861.074858:0:85228:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788200861.074859:0:85228:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788200861.074861:0:85228:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788200861.074862:0:85228:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788200861.074863:0:85228:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788200861.074865:0:85228:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788200861.074866:0:85228:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788200861.074887:0:85228:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dc11d438000 from lustre-MDT0000 10000000:01000000:2.0:1788200861.074932:0:85228:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788200861.074935:0:85228:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788200861.074956:0:85228:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dc11d438000 10000000:01000000:2.0:1788200861.074960:0:85228:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788200861.074965:0:85228:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8dc11d438000 10000000:01000000:2.0:1788200861.074968:0:85228:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788200861.074971:0:85228:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dc11d438000 from 1 10000000:01000000:2.0:1788200861.074974:0:85228:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788200861.075005:0:85228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1a49d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200861.075046:0:85228:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1a49d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200861.075056:0:85228:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1a49d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200861.075075:0:85228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715023872:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788200861.075113:0:85228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200861.075153:0:85228:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f60f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788200861.075340:0:85234:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:3.0:1788200861.075348:0:85234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 20000000:01000000:1.0:1788200861.075495:0:85238:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788200861.075500:0:85238:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788200861.075517:0:85238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc00782d800/0x96d0c9b8c9a1a4a4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.075543:0:85238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782d800/0x96d0c9b8c9a1a4a4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788200861.075552:0:85238:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000051852s 00010000:00010000:1.0:1788200861.075557:0:85238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc00782d800/0x96d0c9b8c9a1a4a4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.075563:0:85238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc00782d800/0x96d0c9b8c9a1a4a4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.075571:0:85238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc00782d800/0x96d0c9b8c9a1a4a4 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.075577:0:85238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc00782d800/0x96d0c9b8c9a1a4a4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.075584:0:85238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200861.075588:0:85238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc00782d800/0x96d0c9b8c9a1a4a4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.075597:0:85238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc00782d800/0x96d0c9b8c9a1a4a4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.075610:0:85238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc00782d800/0x96d0c9b8c9a1a4a4 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.075618:0:85238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc00782d800/0x96d0c9b8c9a1a4a4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.075624:0:85238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782d800/0x96d0c9b8c9a1a4a4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788200861.079898:0:85236:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788200861.079911:0:85236:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788200861.080260:0:85235:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788200861.080368:0:85238:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788200861.080373:0:85238:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788200861.080396:0:85238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc00782da00/0x96d0c9b8c9a1a4ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.080412:0:85238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782da00/0x96d0c9b8c9a1a4ab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788200861.080421:0:85238:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000051852s 00010000:00010000:1.0:1788200861.080425:0:85238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc00782da00/0x96d0c9b8c9a1a4ab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.080445:0:85238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc00782da00/0x96d0c9b8c9a1a4ab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.080451:0:85238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc00782da00/0x96d0c9b8c9a1a4ab lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.080458:0:85238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc00782da00/0x96d0c9b8c9a1a4ab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.080463:0:85238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782da00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200861.080467:0:85238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc00782da00/0x96d0c9b8c9a1a4ab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.080475:0:85238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc00782da00/0x96d0c9b8c9a1a4ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.080487:0:85238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc00782da00/0x96d0c9b8c9a1a4ab lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.080512:0:85238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc00782da00/0x96d0c9b8c9a1a4ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.080518:0:85238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782da00/0x96d0c9b8c9a1a4ab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200861.080749:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+6:3657:x1875060715023616:12345-0@lo:253:kworker.0 Request processed in 6383us (32589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200861.080759:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788200861.080797:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715023872 00000100:00100000:3.0:1788200861.080805:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715023872 00000100:00100000:3.0:1788200861.080834:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788200861.080842:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+6:85228:x1875060715023872:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788200861.080862:0:85236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788200861.080876:0:85236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007a2c800/0x96d0c9b8c9a1a4b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1a49d expref: -99 pid: 85236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200861.080897:0:85236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007a2c800/0x96d0c9b8c9a1a4b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a49d expref: 7 pid: 85236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200861.080907:0:85236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007a2c800/0x96d0c9b8c9a1a4b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a49d expref: 7 pid: 85236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200861.080914:0:85236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2c800, rc 0) 00000020:01000004:2.0:1788200861.081111:0:3657:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788200861.081115:0:3657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788200861.081117:0:3657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788200861.081118:0:3657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788200861.081119:0:3657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788200861.081121:0:3657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788200861.081122:0:3657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788200861.081124:0:3657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788200861.081126:0:3657:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788200861.081130:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715023616:0@lo:253:kworker.0 00000100:00100000:3.0:1788200861.081184:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+7:85228:x1875060715023872:12345-0@lo:101:mount.lustre.0 Request processed in 342us (6070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200861.081255:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788200861.081356:0:85228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d71c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715023872:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788200861.081374:0:85228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1a49d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a4b2 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.081382:0:85228:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1a49d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a4b2 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788200861.081398:0:85228:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788200861.081419:0:85228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1a49d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a4b2 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.081438:0:85228:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1a49d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a4b2 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788200861.081446:0:85228:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788200861.081451:0:85228:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788200861.081457:0:85228:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8dc11d438000 10000000:01000000:1.0:1788200861.081462:0:85228:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788200861.081466:0:85228:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788200861.081468:0:85228:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788200861.081492:0:85228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1a4b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.081511:0:85228:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1a4b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.081520:0:85228:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1a4b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788200861.081540:0:85228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715024000:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788200861.081577:0:85228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200861.081610:0:85228:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1038926c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788200861.081780:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715024000 00000100:00100000:3.0:1788200861.081785:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715024000 00000100:00100000:3.0:1788200861.081808:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788200861.081814:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+7:85228:x1875060715024000:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788200861.081822:0:85236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788200861.081832:0:85236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007a2de00/0x96d0c9b8c9a1a4c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1a4b9 expref: -99 pid: 85236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200861.081846:0:85236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007a2de00/0x96d0c9b8c9a1a4c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a4b9 expref: 8 pid: 85236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200861.081855:0:85236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007a2de00/0x96d0c9b8c9a1a4c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a4b9 expref: 8 pid: 85236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200861.081861:0:85236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2de00, rc 0) 00000100:00100000:3.0:1788200861.081907:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:85228:x1875060715024000:12345-0@lo:101:mount.lustre.0 Request processed in 92us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200861.081913:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788200861.083058:0:85228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715024000:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788200861.083075:0:85228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1a4b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a4c0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.083085:0:85228:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1a4b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a4c0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788200861.083158:0:85228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715024128:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788200861.083205:0:85228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200861.083233:0:85228:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1038926c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788200861.083804:0:85234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715024128 00000100:00100000:0.0:1788200861.083810:0:85234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715024128 00000100:00100000:0.0:1788200861.083858:0:85234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788200861.083867:0:85234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+8:85228:x1875060715024128:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788200861.084101:0:85234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+9:85228:x1875060715024128:12345-0@lo:501:mount.lustre.0 Request processed in 235us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200861.084108:0:85234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788200861.084248:0:85228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715024128:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788200861.084280:0:85228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715024256:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788200861.084320:0:85228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200861.084336:0:85228:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1038926c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788200861.085011:0:85234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715024256 00000100:00100000:0.0:1788200861.085040:0:85234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715024256 00000100:00100000:0.0:1788200861.085061:0:85234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788200861.085068:0:85234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+9:85228:x1875060715024256:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788200861.088295:0:85234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+9:85228:x1875060715024256:12345-0@lo:503:mount.lustre.0 Request processed in 3218us (3966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200861.088309:0:85234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788200861.088504:0:85228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715024256:0@lo:503:mount.lustre.0 20000000:01000000:1.0:1788200861.090046:0:85235:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788200861.090073:0:85235:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1788200861.091481:0:85238:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788200861.091489:0:85238:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788200861.091518:0:85238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc007a2da00/0x96d0c9b8c9a1a4c7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200861.091534:0:85238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007a2da00/0x96d0c9b8c9a1a4c7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788200861.091543:0:85238:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000054654s 00010000:00010000:3.0:1788200861.091548:0:85238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc007a2da00/0x96d0c9b8c9a1a4c7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200861.091555:0:85238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc007a2da00/0x96d0c9b8c9a1a4c7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200861.091562:0:85238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc007a2da00/0x96d0c9b8c9a1a4c7 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200861.091569:0:85238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc007a2da00/0x96d0c9b8c9a1a4c7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200861.091574:0:85238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2da00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200861.091579:0:85238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc007a2da00/0x96d0c9b8c9a1a4c7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200861.091585:0:85238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc007a2da00/0x96d0c9b8c9a1a4c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200861.091597:0:85238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc007a2da00/0x96d0c9b8c9a1a4c7 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200861.091615:0:85238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc007a2da00/0x96d0c9b8c9a1a4c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200861.091621:0:85238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007a2da00/0x96d0c9b8c9a1a4c7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788200861.091851:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+8:3655:x1875060715023744:12345-0@lo:253:kworker.0 Request processed in 17026us (43507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200861.091869:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:3.0:1788200861.092107:0:3655:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788200861.092110:0:3655:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788200861.092111:0:3655:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788200861.092113:0:3655:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788200861.092126:0:3655:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788200861.092128:0:3655:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788200861.092130:0:3655:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788200861.092132:0:3655:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788200861.092133:0:3655:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788200861.092136:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715023744:0@lo:253:kworker.0 00000100:00100000:2.0:1788200861.096497:0:85241:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d70a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:85241:1875060715024384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788200861.096587:0:85241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200861.096673:0:85241:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f60f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788200861.102535:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715024384 00000100:00100000:3.0:1788200861.102555:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715024384 00000100:00100000:3.0:1788200861.103423:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788200861.103444:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:85241:x1875060715024384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788200861.109539:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:85241:x1875060715024384:12345-0@lo:502:llog_process_th.0 Request processed in 6088us (12942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200861.109553:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788200861.109690:0:85241:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d70a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:85241:1875060715024384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788200861.109749:0:85241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788200861.109760:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788200861.109763:0:85241:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788200861.109769:0:85241:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788200861.109772:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788200861.109788:0:85241:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8dc12f3099b8) 00000020:00000080:2.0:1788200861.109812:0:85241:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:2.0:1788200861.109819:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788200861.109917:0:85241:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788200861.110553:0:85241:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1a4d5 00000020:00000080:2.0:1788200861.111557:0:85241:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788200861.111567:0:85241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788200861.111572:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788200861.111574:0:85241:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788200861.111577:0:85241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788200861.111581:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788200861.111583:0:85241:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788200861.111587:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788200861.111598:0:85241:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8dc12f30cd28) 00000020:00000080:2.0:1788200861.111616:0:85241:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:2.0:1788200861.111620:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788200861.111622:0:85241:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788200861.111624:0:85241:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788200861.111632:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788200861.111693:0:85241:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc11d438000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788200861.112797:0:85241:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8dc12f308000) 00000020:00000080:2.0:1788200861.112815:0:85241:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:2.0:1788200861.112886:0:85241:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788200861.112894:0:85241:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1a4ea 00000020:00000080:2.0:1788200861.114056:0:85241:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788200861.114066:0:85241:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788200861.114074:0:85241:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x96d0c9b8c9a1a4f1 00080000:01000000:2.0:1788200861.114094:0:85241:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788200861.114099:0:85241:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1a4f8 00010000:00010000:3.0:1788200861.266069:0:85241:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1788200861.266212:0:85241:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 4292087e-fa00-4621-b681-837afc99ae35 idx: 0 lr: 0 srv lr: 98784247808 lx: 0 gen 23 00000001:00080000:3.0:1788200861.266251:0:85241:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 98784247808 lx: 0 gen 22 00000001:00000004:3.0:1788200861.266280:0:85241:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 98784247808 00000001:00080000:3.0:1788200861.266380:0:85241:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1788200861.266443:0:85241:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc1042650c0: xid 1875060695321088, transno 98784247809, client gen 23, slot idx 0 00000020:00000080:3.0:1788200861.266856:0:85241:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8dc1401b19b8) 00000020:00000080:3.0:1788200861.266875:0:85241:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:3.0:1788200861.266950:0:85241:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788200861.266956:0:85241:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1a514 00000020:00000080:0.0:1788200861.278484:0:85241:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788200861.288626:0:85241:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x96d0c9b8c9a1a51b 00000020:00000080:2.0:1788200861.289502:0:85241:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788200861.289516:0:85241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788200861.289523:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788200861.289525:0:85241:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788200861.289528:0:85241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788200861.289531:0:85241:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1788200861.289532:0:85241:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788200861.289534:0:85241:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788200861.289535:0:85241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788200861.289538:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788200861.289540:0:85241:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788200861.289542:0:85241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788200861.289547:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788200861.289548:0:85241:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788200861.289552:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788200861.289587:0:85241:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788200861.289598:0:85241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788200861.289600:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788200861.289601:0:85241:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788200861.289602:0:85241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788200861.289605:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788200861.289605:0:85241:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788200861.289607:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788200861.289611:0:85241:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:00000080:2.0:1788200861.289630:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788200861.289643:0:85241:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8dc13f870000) 00000020:00000080:2.0:1788200861.289655:0:85241:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1788200861.289658:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788200861.289706:0:85241:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788200861.289712:0:85241:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788200861.289724:0:85241:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1a529 00010000:00080000:2.0:1788200861.289753:0:85241:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc104280000@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:2.0:1788200861.291469:0:85241:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1788200861.292854:0:85241:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788200861.292864:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788200861.292891:0:85241:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788200861.292909:0:85241:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1a530 00000100:00080000:2.0:1788200861.293249:0:85241:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788200861.293255:0:85241:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8dc104280000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788200861.293291:0:85241:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004d70a80 x1875060715024512/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788200861.293315:0:85241:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788200861.293346:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715024512:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788200861.293423:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788200861.293479:0:85241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788200861.293482:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788200861.293484:0:85241:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788200861.293487:0:85241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000100:00100000:3.0:1788200861.293488:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715024512 00000020:01000000:2.0:1788200861.293490:0:85241:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1788200861.293491:0:85241:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788200861.293493:0:85241:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788200861.293494:0:85241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000100:00100000:3.0:1788200861.293494:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715024512 00000020:00000080:2.0:1788200861.293497:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788200861.293498:0:85241:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788200861.293500:0:85241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788200861.293504:0:85241:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788200861.293507:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788200861.293508:0:85241:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788200861.293511:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788200861.293514:0:85241:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000100:00100000:3.0:1788200861.293520:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3803 00000100:00100000:3.0:1788200861.293526:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715024512:12345-0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788200861.293531:0:85241:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788200861.293533:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788200861.293544:0:85241:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8dc13f874d28) 00010000:00080000:3.0:1788200861.293547:0:8458:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3712 last 0 00000020:00000080:2.0:1788200861.293563:0:85241:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1788200861.293568:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:00000080:3.0:1788200861.293573:0:8458:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1a537 00000004:00100000:3.0:1788200861.293586:0:8458:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000004:00080000:2.0:1788200861.293620:0:85241:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788200861.293625:0:85241:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788200861.293630:0:85241:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1a545 00010000:00080000:2.0:1788200861.293653:0:85241:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc005a4c800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.120@tcp at head 00000100:00080000:3.0:1788200861.293673:0:8458:0:(import.c:65:import_set_state_nolock()) ffff8dc106076000 : changing import state from RECOVER to FULL 00010000:00010000:2.0:1788200861.293819:0:85241:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:3.0:1788200861.293955:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715024512:12345-0@lo:38:llog_process_th.0 Request processed in 427us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200861.293963:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3803 00000100:00100000:3.0:1788200861.293999:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788200861.294007:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:3.0:1788200861.294013:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788200861.294068:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788200861.294071:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc104280000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788200861.294077:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715024512:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788200861.294129:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788200861.294137:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715024640:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788200861.294160:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200861.294631:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715024640 00000100:00100000:2.0:1788200861.294635:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715024640 00000100:00100000:2.0:1788200861.294659:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3804 00000100:00100000:2.0:1788200861.294666:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140295880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715024640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788200861.294688:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:2.0:1788200861.294736:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140295880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715024640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200861.294742:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3804 00000040:01000000:2.0:1788200861.295075:0:85241:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788200861.295093:0:85241:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788200861.295452:0:85241:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 22, last_idx 23 00000100:00100000:1.0:1788200861.295697:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715024640:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788200861.296228:0:85241:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788200861.296249:0:85241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].24, 64 off9728 00000040:00080000:2.0:1788200861.296440:0:85241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x60:0x0].1, 64 off8256 00000040:00080000:2.0:1788200861.296707:0:85247:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:2.0:1788200861.296712:0:85247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1788200861.296818:0:85247:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000040:00080000:2.0:1788200861.296832:0:85247:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1788200861.297415:0:85247:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:2.0:1788200861.297419:0:85247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788200861.297767:0:85241:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788200861.297776:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788200861.297808:0:85241:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788200861.297825:0:85241:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1a54c 00000100:00080000:1.0:1788200861.297832:0:85241:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788200861.297836:0:85241:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dc005a4c800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200861.297859:0:85241:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004be7b80 x1875060715024768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788200861.297904:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715024768:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788200861.297965:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200861.298010:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715024768 00000100:00080000:1.0:1788200861.298040:0:85241:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788200861.298095:0:85241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788200861.298099:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788200861.298101:0:85241:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788200861.298104:0:85241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788200861.298106:0:85241:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1788200861.298108:0:85241:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788200861.298109:0:85241:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788200861.298111:0:85241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788200861.298113:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788200861.298114:0:85241:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788200861.298117:0:85241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788200861.298121:0:85241:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788200861.298124:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788200861.298125:0:85241:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788200861.298128:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788200861.298131:0:85241:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:1.0:1788200861.298150:0:85241:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788200861.298160:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788200861.298170:0:85241:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8dc004044d28) 00000020:00000080:1.0:1788200861.298185:0:85241:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1788200861.298191:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788200861.298250:0:85241:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788200861.298319:0:85241:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788200861.298326:0:85241:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1a55a 00010000:00080000:1.0:1788200861.298354:0:85241:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc001e2f000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.120@tcp at head 00000100:00100000:0.0:1788200861.298410:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715024768 00000100:00100000:0.0:1788200861.298496:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5851 00000100:00100000:0.0:1788200861.298504:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140297b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:3654:x1875060715024768:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1788200861.298525:0:26214:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3712 last 0 00000020:00000080:0.0:1788200861.298545:0:26214:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1a561 00002000:00100000:0.0:1788200861.298558:0:26214:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8dc11cdda800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788200861.298562:0:26214:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788200861.298565:0:26214:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00010000:1.0:1788200861.298599:0:85241:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00002000:00080000:0.0:1788200861.298619:0:26214:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788200861.298638:0:26214:0:(import.c:65:import_set_state_nolock()) ffff8dc11cddc800 : changing import state from RECOVER to FULL 00000040:01000000:1.0:1788200861.298652:0:85241:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788200861.298665:0:85241:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788200861.302589:0:85241:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 22, last_idx 23 00000040:00080000:1.0:1788200861.303184:0:85241:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788200861.303211:0:85241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].24, 64 off9728 00000040:00080000:1.0:1788200861.303356:0:85241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x62:0x0].1, 64 off8256 00000040:00080000:1.0:1788200861.303681:0:85249:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:1.0:1788200861.303687:0:85249:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000100:00100000:3.0:1788200861.303829:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:0.0:1788200861.303831:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140297b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715024768:12345-0@lo:8:llog_process_th.0 Request processed in 5321us (5861us total) trans 0 rc 0/0 00000100:00080000:3.0:1788200861.303840:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788200861.303848:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:0.0:1788200861.303852:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5851 00000100:00080000:3.0:1788200861.303853:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788200861.303856:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc005a4c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788200861.303903:0:3654:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788200861.303910:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715024768:0@lo:8:llog_process_th.0 00000004:00080000:2.0:1788200861.303924:0:85247:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788200861.303967:0:85247:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3712775949679ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788200861.303973:0:85247:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788200861.304845:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715024896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788200861.304900:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200861.305105:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715024896 00000100:00100000:2.0:1788200861.305111:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715024896 00000100:00100000:2.0:1788200861.305292:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2076 00000100:00100000:2.0:1788200861.305300:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715024896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788200861.305319:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788200861.306707:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788200861.308750:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715024896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3443us (3841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200861.308763:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2076 00000100:00100000:3.0:1788200861.308819:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715024896:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1788200861.312288:0:85229:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000020:00000080:1.0:1788200861.314224:0:85241:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788200861.314239:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788200861.314287:0:85241:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788200861.314313:0:85241:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1a568 00000100:00080000:1.0:1788200861.314325:0:85241:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788200861.314341:0:85241:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dc001e2f000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200861.314377:0:85241:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004be4380 x1875060715025024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788200861.314403:0:85241:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1788200861.314443:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715025024:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1788200861.314466:0:85241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788200861.314470:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788200861.314472:0:85241:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788200861.314475:0:85241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788200861.314484:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788200861.314485:0:85241:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788200861.314488:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788200861.314490:0:85241:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788200861.314493:0:85241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788200861.314495:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788200861.314496:0:85241:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788200861.314498:0:85241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788200861.314500:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788200861.314501:0:85241:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788200861.314504:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788200861.314510:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200861.314531:0:85241:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:85241:1875060715025152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788200861.314572:0:85241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200861.314597:0:85241:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc003491240 going to sleep for 11 seconds 00000100:00100000:3.0:1788200861.314661:0:85234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715025152 00000100:00100000:3.0:1788200861.314668:0:85234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715025152 00000100:00100000:3.0:1788200861.314711:0:85234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788200861.314720:0:85234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+8:85241:x1875060715025152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788200861.314733:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715025024 00000100:00100000:2.0:1788200861.314737:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715025024 00000100:00100000:2.0:1788200861.314759:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5852 00000100:00100000:2.0:1788200861.314764:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3654:x1875060715025024:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1788200861.314786:0:26200:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3712 last 0 00000020:00000080:2.0:1788200861.314813:0:26200:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1a56f 00002000:00100000:2.0:1788200861.314827:0:26200:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8dc0078da000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788200861.314832:0:26200:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000100:00100000:3.0:1788200861.314834:0:85234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+8:85241:x1875060715025152:12345-0@lo:502:llog_process_th.0 Request processed in 114us (261us total) trans 0 rc 0/0 00002000:00100000:2.0:1788200861.314835:0:26200:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1788200861.314840:0:85234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00002000:00080000:2.0:1788200861.314902:0:26200:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788200861.314936:0:26200:0:(import.c:65:import_set_state_nolock()) ffff8dc0078de800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788200861.314985:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715025024:12345-0@lo:8:llog_process_th.0 Request processed in 219us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200861.314992:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5852 00000100:00100000:1.0:1788200861.315227:0:85241:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:85241:1875060715025152:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788200861.315252:0:85241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788200861.315257:0:85241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788200861.315259:0:85241:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788200861.315263:0:85241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788200861.315334:0:85228:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 00000100:00100000:3.0:1788200861.315350:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 10000000:01000000:1.0:1788200861.315355:0:85228:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00080000:3.0:1788200861.315356:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788200861.315362:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00010000:00010000:1.0:1788200861.315367:0:85228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1a4b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a4c0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788200861.315367:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788200861.315369:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001e2f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00010000:00010000:1.0:1788200861.315377:0:85228:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1a4b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a4c0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788200861.315377:0:3654:0:(osp_dev.c:1648:osp_import_event()) got connected 10000000:01000000:1.0:1788200861.315386:0:85228:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc11d438000 from 1 10000000:01000000:1.0:1788200861.315388:0:85228:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00100000:3.0:1788200861.315397:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715025024:0@lo:8:llog_process_th.0 00010000:00010000:1.0:1788200861.315413:0:85228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1a576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.315439:0:85228:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1a576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200861.315448:0:85228:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1a576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200861.315452:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715025408:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788200861.315460:0:85228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715025280:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788200861.315480:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200861.315481:0:85228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200861.315499:0:85228:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc003491240 going to sleep for 11 seconds 00000040:00080000:3.0:1788200861.315510:0:85249:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5e:0x0] index 3 count 2 00000040:00080000:3.0:1788200861.315530:0:85249:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:3.0:1788200861.315534:0:85249:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000004:00080000:3.0:1788200861.315551:0:85249:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788200861.315592:0:85249:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3712787575716ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788200861.315600:0:85249:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788200861.316772:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715025408 00000100:00100000:0.0:1788200861.316781:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715025408 00000100:00100000:0.0:1788200861.316844:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5853 00000100:00100000:0.0:1788200861.316853:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715025408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788200861.316877:0:26206:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:674 count 1 00000100:00080000:3.0:1788200861.317043:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788200861.317298:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715025408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 445us (1816us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788200861.317306:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5853 00000100:00100000:3.0:1788200861.317336:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715025536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788200861.317374:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200861.317408:0:85240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715025280 00000100:00100000:0.0:1788200861.317413:0:85240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715025280 00000100:00100000:3.0:1788200861.317423:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715025536 00000100:00100000:3.0:1788200861.317439:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715025536 00000100:00100000:3.0:1788200861.317463:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2077 00000100:00100000:0.0:1788200861.317470:0:85240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788200861.317470:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715025536:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788200861.317476:0:85240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+8:85228:x1875060715025280:12345-0@lo:101:mount.lustre.0 00002000:00000024:3.0:1788200861.317482:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00010000:00010000:0.0:1788200861.317484:0:85240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200861.317500:0:85240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007ce8600/0x96d0c9b8c9a1a57d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1a576 expref: -99 pid: 85240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200861.317512:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715025536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200861.317518:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2077 00010000:00010000:0.0:1788200861.317522:0:85240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007ce8600/0x96d0c9b8c9a1a57d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a576 expref: 9 pid: 85240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.317532:0:85240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007ce8600/0x96d0c9b8c9a1a57d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a576 expref: 9 pid: 85240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.317542:0:85240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ce8600, rc 0) 00000100:00100000:3.0:1788200861.317554:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715025536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788200861.317569:0:85240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+9:85228:x1875060715025280:12345-0@lo:101:mount.lustre.0 Request processed in 93us (2087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200861.317575:0:85240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788200861.317629:0:85228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715025280:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788200861.317643:0:85228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1a576 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a57d expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.317652:0:85228:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1a576 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a57d expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788200861.317787:0:3658:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dc140294000, transno 0 00000004:00080000:2.0:1788200861.317791:0:3658:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dc140294000/1, rc -2, transno 0 00000100:00100000:2.0:1788200861.317809:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715025408:0@lo:6:osp-syn-1-0.0 00000040:00080000:3.0:1788200861.318146:0:85249:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000040:00080000:3.0:1788200861.318167:0:85249:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000004:00080000:2.0:1788200861.319006:0:85229:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788200861.320676:0:85228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715025664:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788200861.320825:0:85228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200861.320879:0:85228:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f63180 going to sleep for 11 seconds 00000100:00100000:3.0:1788200861.321137:0:85234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715025664 00000100:00100000:3.0:1788200861.321144:0:85234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715025664 00000100:00100000:3.0:1788200861.321190:0:85234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788200861.321199:0:85234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+9:85228:x1875060715025664:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788200861.321228:0:85234:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788200861.321243:0:85234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788200861.321248:0:85234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788200861.321261:0:85234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788200861.321264:0:85234:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 106 00000100:00100000:3.0:1788200861.321343:0:85234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+9:85228:x1875060715025664:12345-0@lo:256:mount.lustre.0 Request processed in 145us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200861.321351:0:85234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788200861.321500:0:85228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715025664:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788200861.322275:0:85228:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788200861.322293:0:85228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1a576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a57d expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.322304:0:85228:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1a576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a57d expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788200861.322313:0:85228:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc11d438000 from 1 10000000:01000000:0.0:1788200861.322316:0:85228:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788200861.322355:0:85228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9400/0x96d0c9b8c9a1a584 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.322364:0:85228:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9400/0x96d0c9b8c9a1a584 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.322373:0:85228:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9400/0x96d0c9b8c9a1a584 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200861.322399:0:85228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715025792:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788200861.322447:0:85228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200861.322485:0:85228:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f63180 going to sleep for 11 seconds 00000100:00100000:3.0:1788200861.322499:0:85240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715025792 00000100:00100000:3.0:1788200861.322504:0:85240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715025792 00000100:00100000:3.0:1788200861.322538:0:85240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788200861.322545:0:85240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+9:85228:x1875060715025792:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788200861.322554:0:85240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788200861.322567:0:85240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007a2da00/0x96d0c9b8c9a1a58b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1a584 expref: -99 pid: 85240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200861.322587:0:85240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007a2da00/0x96d0c9b8c9a1a58b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a584 expref: 10 pid: 85240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200861.322597:0:85240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007a2da00/0x96d0c9b8c9a1a58b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a584 expref: 10 pid: 85240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200861.322605:0:85240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2da00, rc 0) 00000100:00100000:3.0:1788200861.322645:0:85240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+10:85228:x1875060715025792:12345-0@lo:101:mount.lustre.0 Request processed in 100us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200861.322651:0:85240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788200861.323070:0:85228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715025792:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788200861.323083:0:85228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9400/0x96d0c9b8c9a1a584 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a58b expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.323092:0:85228:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9400/0x96d0c9b8c9a1a584 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a58b expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200861.323161:0:85228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715025920:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788200861.323196:0:85228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200861.323214:0:85228:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f63180 going to sleep for 11 seconds 00000100:00100000:2.0:1788200861.323619:0:85235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715025920 00000100:00100000:2.0:1788200861.323637:0:85235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715025920 00000100:00100000:2.0:1788200861.323681:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788200861.323690:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:85228:x1875060715025920:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788200861.323826:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:85228:x1875060715025920:12345-0@lo:501:mount.lustre.0 Request processed in 137us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200861.323833:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788200861.323839:0:85228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715025920:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788200861.323867:0:85228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715026048:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788200861.323910:0:85228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200861.324050:0:85228:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f63180 going to sleep for 11 seconds 00000100:00100000:1.0:1788200861.328884:0:85240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715026048 00000100:00100000:1.0:1788200861.328901:0:85240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715026048 00000100:00100000:1.0:1788200861.328965:0:85240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788200861.328976:0:85240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+10:85228:x1875060715026048:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788200861.329161:0:85240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+10:85228:x1875060715026048:12345-0@lo:503:mount.lustre.0 Request processed in 187us (5250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200861.329170:0:85240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788200861.329202:0:85228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715026048:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788200861.331112:0:85251:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:85251:1875060715026176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788200861.331211:0:85251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200861.331254:0:85251:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f636c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788200861.331280:0:85235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715026176 00000100:00100000:2.0:1788200861.331286:0:85235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715026176 00000100:00100000:2.0:1788200861.331332:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788200861.331341:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:85251:x1875060715026176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788200861.332056:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:85251:x1875060715026176:12345-0@lo:502:llog_process_th.0 Request processed in 707us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200861.332066:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788200861.332201:0:85251:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:85251:1875060715026176:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788200861.332229:0:85251:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788200861.332238:0:85251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788200861.332240:0:85251:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788200861.332265:0:85251:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc11d438000 00000020:00000080:0.0:1788200861.332268:0:85251:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788200861.332277:0:85251:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788200861.332280:0:85251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788200861.332281:0:85251:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788200861.332284:0:85251:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788200861.332286:0:85251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788200861.332288:0:85251:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788200861.332291:0:85251:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc11d438000 00000020:00000080:0.0:1788200861.332293:0:85251:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788200861.332366:0:85251:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:85251:1875060715026304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788200861.332519:0:85251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200861.332555:0:85251:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc109023f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788200861.332965:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715026304 00000100:00100000:2.0:1788200861.332971:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715026304 00000100:00100000:2.0:1788200861.333010:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788200861.333044:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:85251:x1875060715026304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788200861.333289:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:85251:x1875060715026304:12345-0@lo:502:llog_process_th.0 Request processed in 270us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200861.333296:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788200861.337217:0:85251:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:85251:1875060715026304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788200861.337565:0:85251:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788200861.337575:0:85251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788200861.337577:0:85251:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788200861.337581:0:85251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788200861.338040:0:85228:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1788200861.338076:0:85228:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788200861.338209:0:85228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9400/0x96d0c9b8c9a1a584 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a58b expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200861.338227:0:85228:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9400/0x96d0c9b8c9a1a584 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a58b expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788200861.338297:0:85228:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788200861.338300:0:85228:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dc11d438000 10000000:01000000:2.0:1788200861.338303:0:85228:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dc11d438000 10000000:01000000:2.0:1788200861.338307:0:85228:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788200861.338313:0:85228:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc11d438000 from 1 10000000:01000000:2.0:1788200861.338315:0:85228:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788200861.338349:0:85228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1a592 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200861.338357:0:85228:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1a592 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200861.338366:0:85228:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1a592 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200861.338387:0:85228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715026432:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788200861.338469:0:85228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200861.338505:0:85228:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0072ff000 going to sleep for 11 seconds 00000100:00100000:0.0:1788200861.338793:0:85235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715026432 00000100:00100000:0.0:1788200861.338800:0:85235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715026432 00000100:00100000:0.0:1788200861.338848:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788200861.338858:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:85228:x1875060715026432:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788200861.338871:0:85235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200861.338883:0:85235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007ce9e00/0x96d0c9b8c9a1a599 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1a592 expref: -99 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.338904:0:85235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007ce9e00/0x96d0c9b8c9a1a599 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a592 expref: 11 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.338925:0:85235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007ce9e00/0x96d0c9b8c9a1a599 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a592 expref: 11 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.338940:0:85235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ce9e00, rc 0) 00000100:00100000:0.0:1788200861.338983:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:85228:x1875060715026432:12345-0@lo:101:mount.lustre.0 Request processed in 126us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200861.338990:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788200861.339043:0:85228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715026432:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788200861.339180:0:85228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1a592 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a599 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.339189:0:85228:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1a592 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a599 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200861.339241:0:85228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715026560:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788200861.339280:0:85228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200861.339296:0:85228:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1090239c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788200861.339310:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715026560 00000100:00100000:0.0:1788200861.339313:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715026560 00000100:00100000:0.0:1788200861.339340:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788200861.339346:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:85228:x1875060715026560:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788200861.339575:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:85228:x1875060715026560:12345-0@lo:501:mount.lustre.0 Request processed in 228us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200861.339581:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788200861.339614:0:85228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715026560:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788200861.339760:0:85228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715026688:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788200861.339796:0:85228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200861.339822:0:85228:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1090239c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788200861.339835:0:85235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715026688 00000100:00100000:0.0:1788200861.339838:0:85235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715026688 00000100:00100000:0.0:1788200861.339858:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788200861.339863:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:85228:x1875060715026688:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788200861.340190:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:85228:x1875060715026688:12345-0@lo:503:mount.lustre.0 Request processed in 326us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200861.340197:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788200861.340241:0:85228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715026688:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788200861.347205:0:85253:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:85253:1875060715026816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788200861.347301:0:85253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200861.347385:0:85253:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc109023180 going to sleep for 11 seconds 00000100:00100000:3.0:1788200861.347531:0:85234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715026816 00000100:00100000:3.0:1788200861.347539:0:85234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715026816 00000100:00100000:3.0:1788200861.347617:0:85234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788200861.347631:0:85234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:85253:x1875060715026816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788200861.347778:0:85234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:85253:x1875060715026816:12345-0@lo:502:llog_process_th.0 Request processed in 147us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200861.347785:0:85234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788200861.347873:0:85253:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:85253:1875060715026816:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788200861.347947:0:85253:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788200861.347962:0:85253:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8dc13f8719b8) 00000020:00000080:2.0:1788200861.347984:0:85253:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1788200861.348093:0:85253:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc11d438000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788200861.348098:0:85253:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc11d438000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788200861.348100:0:85253:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc11d438000 4 00010000:00080000:2.0:1788200861.348135:0:85253:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc0034f7000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:2.0:1788200861.349699:0:85253:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1788200861.371166:0:85253:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788200861.371644:0:85253:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788200861.371662:0:85253:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x96d0c9b8c9a1a5a7 00000100:00080000:3.0:1788200861.371674:0:85253:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788200861.371680:0:85253:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dc0034f7000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788200861.371716:0:85253:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc140294000 x1875060715026944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788200861.371736:0:85253:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788200861.372212:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715026944:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788200861.372283:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200861.372503:0:85253:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140295180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:85253:1875060715027072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788200861.372554:0:85253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200861.372578:0:85253:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0055c10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788200861.373690:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715027072 00000100:00100000:3.0:1788200861.373700:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715027072 00000100:00100000:3.0:1788200861.373750:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788200861.373759:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:85253:x1875060715027072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788200861.373904:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:85253:x1875060715027072:12345-0@lo:502:llog_process_th.0 Request processed in 145us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200861.373911:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788200861.373972:0:85253:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140295180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:85253:1875060715027072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788200861.374049:0:85253:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140295180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:85253:1875060715027200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788200861.374089:0:85253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200861.374112:0:85253:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0055c10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788200861.374120:0:85235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715027200 00000100:00100000:0.0:1788200861.374126:0:85235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715027200 00000100:00100000:0.0:1788200861.374164:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788200861.374173:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:85253:x1875060715027200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788200861.374250:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:85253:x1875060715027200:12345-0@lo:502:llog_process_th.0 Request processed in 77us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200861.374258:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788200861.374262:0:85253:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140295180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:85253:1875060715027200:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788200861.374289:0:85253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:1.0:1788200861.375832:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715026944 00000100:00100000:1.0:1788200861.375843:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715026944 00000100:00100000:1.0:1788200861.375886:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:1.0:1788200861.375893:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715026944:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788200861.375971:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715026944:12345-0@lo:38:llog_process_th.0 Request processed in 76us (3687us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788200861.375978:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:3.0:1788200861.375992:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788200861.376001:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200861.376006:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788200861.376011:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715026944:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788200861.376507:0:85228:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788200861.376533:0:85228:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788200861.376556:0:85228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1a592 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a599 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200861.376567:0:85228:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1a592 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a599 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788200861.376623:0:85228:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788200861.376625:0:85228:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788200861.376627:0:85228:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788200861.376628:0:85228:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788200861.376629:0:85228:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788200861.376630:0:85228:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788200861.376631:0:85228:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788200861.376633:0:85228:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788200861.376634:0:85228:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788200861.376635:0:85228:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788200861.376639:0:85228:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788200861.376641:0:85228:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788200861.376642:0:85228:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788200861.376644:0:85228:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788200861.376645:0:85228:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788200861.376646:0:85228:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788200861.376647:0:85228:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788200861.376648:0:85228:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788200861.376649:0:85228:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788200861.376650:0:85228:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788200861.376650:0:85228:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788200861.376668:0:85228:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788200861.376699:0:85228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d71180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715027328:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788200861.376744:0:85228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200861.376784:0:85228:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0072ff780 going to sleep for 11 seconds 00000100:00100000:1.0:1788200861.377136:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715027328 00000100:00100000:1.0:1788200861.377142:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715027328 00000100:00100000:1.0:1788200861.377177:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788200861.377186:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cce4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:85228:x1875060715027328:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788200861.377218:0:85236:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788200861.377232:0:85236:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788200861.379971:0:85236:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788200861.379992:0:85236:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788200861.380807:0:85238:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788200861.380814:0:85238:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788200861.380836:0:85238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc007ce9c00/0x96d0c9b8c9a1a5ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.380856:0:85238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc007ce8600/0x96d0c9b8c9a1a57d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a576 expref: 11 pid: 85240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.380865:0:85238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dc007ce9c00/0x96d0c9b8c9a1a5ae lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.380913:0:85238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc007ce8600/0x96d0c9b8c9a1a57d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1a576 expref: 11 pid: 85240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.380956:0:85238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc007ce8600/0x96d0c9b8c9a1a57d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1a576 expref: 11 pid: 85240 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200861.380974:0:85238:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85238:1875060715027456:0@lo:104: 00000100:00100000:0.0:1788200861.384062:0:85238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200861.384063:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cce4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:85228:x1875060715027328:12345-0@lo:253:mount.lustre.0 Request processed in 6868us (7309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200861.384079:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788200861.384124:0:85238:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f636c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788200861.384175:0:85228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d71180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:85228:1875060715027328:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788200861.384179:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715027456 00000100:00100000:0.0:1788200861.384188:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715027456 00000100:00100000:0.0:1788200861.384227:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788200861.384235:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9b18af6-fecc-4172-82c2-66531890fe11+3:85238:x1875060715027456:12345-0@lo:104: 00010000:00010000:0.0:1788200861.384250:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1a576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1a57d expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788200861.384259:0:85228:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788200861.384264:0:85228:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788200861.384266:0:85228:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788200861.384267:0:85228:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788200861.384269:0:85228:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788200861.384270:0:85228:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788200861.384271:0:85228:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788200861.384273:0:85228:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788200861.384274:0:85228:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788200861.384276:0:85228:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788200861.384278:0:85228:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788200861.384293:0:85228:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788200861.384309:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788200861.384315:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9b18af6-fecc-4172-82c2-66531890fe11+3:85238:x1875060715027456:12345-0@lo:104: Request processed in 81us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200861.384321:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788200861.384349:0:85238:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85238:1875060715027456:0@lo:104: 00010000:00010000:0.0:1788200861.384364:0:85238:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dc007ce9c00/0x96d0c9b8c9a1a5ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.384381:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788200861.384387:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1a576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1a57d expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.384436:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782da00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788200861.384440:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1a576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1a57d expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.384448:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1a576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1a57d expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788200861.384456:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1a576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1a57d expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788200861.384461:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788200861.384492:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1a576 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1a57d expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.384498:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788200861.384515:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1a576 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1a57d expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.384522:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1a576 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1a57d expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.384538:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200861.384539:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200861.384541:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788200861.384553:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715027584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788200861.384591:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200861.384635:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715027584 00000100:00100000:0.0:1788200861.384639:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715027584 00010000:00010000:0.0:1788200861.384653:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc007ce8600/0x96d0c9b8c9a1a57d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1a576 expref: 11 pid: 85240 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200861.384683:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2548 00000100:00100000:0.0:1788200861.384691:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+11:3656:x1875060715027584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788200861.384702:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788200861.384707:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc007ce8600/0x96d0c9b8c9a1a57d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1a576 expref: 11 pid: 85240 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.384719:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc007ce8600/0x96d0c9b8c9a1a57d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1a576 expref: 11 pid: 85240 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.384733:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007ce8600/0x96d0c9b8c9a1a57d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1a576 expref: 11 pid: 85240 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.384747:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dc007ce9c00/0x96d0c9b8c9a1a5ae lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.384755:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007ce9c00/0x96d0c9b8c9a1a5ae lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788200861.384768:0:6519:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003955137s 00010000:00010000:0.0:1788200861.384772:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc007ce9c00/0x96d0c9b8c9a1a5ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.384778:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc007ce9c00/0x96d0c9b8c9a1a5ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.384785:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc007ce9c00/0x96d0c9b8c9a1a5ae lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.384791:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc007ce9c00/0x96d0c9b8c9a1a5ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.384802:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce9c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200861.384807:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc007ce9c00/0x96d0c9b8c9a1a5ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.384814:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc007ce9c00/0x96d0c9b8c9a1a5ae lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.384827:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc007ce9c00/0x96d0c9b8c9a1a5ae lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.384838:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788200861.384872:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+10:3656:x1875060715027584:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200861.384879:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2548 00010000:00010000:0.0:1788200861.384898:0:85238:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dc007ce9c00/0x96d0c9b8c9a1a5ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.384904:0:85238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc007ce9c00/0x96d0c9b8c9a1a5ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200861.384910:0:85238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007ce9c00/0x96d0c9b8c9a1a5ae lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200861.384941:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715027584:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788200861.393208:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788200861.405290:0:85228:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411350 00000040:01000000:2.0:1788200861.406558:0:85228:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788200861.406849:0:85259:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411350 00000020:00080000:3.0:1788200861.406854:0:85259:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411350 00000040:01000000:0.0:1788200861.407549:0:85260:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1788200861.407613:0:85260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788200861.407846:0:85228:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1788200861.408669:0:85261:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d73800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85261:1875060715027712:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788200861.409173:0:85228:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788200861.409207:0:85228:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788200861.409656:0:85228:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788200861.409671:0:85228:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788200861.409721:0:85228:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788200861.411766:0:85228:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1788200861.415352:0:85261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200861.415395:0:85261:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1059713c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788200861.415468:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715027712 00000100:00100000:2.0:1788200861.415476:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715027712 00000100:00100000:2.0:1788200861.415526:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3805 00000100:00100000:2.0:1788200861.415534:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85261:x1875060715027712:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788200861.415638:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85261:x1875060715027712:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 104us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200861.415645:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3805 00000100:00100000:1.0:1788200861.415764:0:85261:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d73800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85261:1875060715027712:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788200861.415799:0:85261:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788200861.415834:0:85261:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85261:1875060715027840:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788200861.415861:0:85261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200861.415890:0:85261:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005a8f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788200861.416168:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715027840 00000100:00100000:2.0:1788200861.416172:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715027840 00000100:00100000:2.0:1788200861.416207:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3806 00000100:00100000:2.0:1788200861.416212:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85261:x1875060715027840:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788200861.416301:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85261:x1875060715027840:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 88us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200861.416307:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3806 00000100:00100000:1.0:1788200861.416419:0:85261:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85261:1875060715027840:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788200861.416518:0:85261:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85261:1875060715027968:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788200861.416540:0:85261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200861.416560:0:85261:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005a8f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788200861.416993:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715027968 00000100:00100000:2.0:1788200861.416998:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715027968 00000100:00100000:2.0:1788200861.417046:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3807 00000100:00100000:2.0:1788200861.417052:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85261:x1875060715027968:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788200861.417098:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85261:x1875060715027968:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 46us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200861.417118:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3807 00000100:00100000:1.0:1788200861.417323:0:85261:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85261:1875060715027968:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788200861.417361:0:85261:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788200861.419069:0:85260:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788200861.419135:0:85260:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1788200861.419225:0:85228:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788200861.419285:0:85228:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788200861.419382:0:85228:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788200861.423129:0:85228:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4b:0x0] (8/32) registered 00000040:00080000:1.0:1788200861.423131:0:85261:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788200861.423282:0:85261:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788200861.423288:0:85261:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:3.0:1788200861.435984:0:85228:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 98784247809 00010000:00080000:3.0:1788200861.438062:0:85262:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 85262 00010000:02000000:3.0:1788200861.438083:0:85262:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1788200861.438087:0:85262:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788200861.438090:0:85262:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1788200861.438333:0:85228:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788200861.438351:0:85228:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788200861.438368:0:85228:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788200861.438397:0:85228:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788200861.439519:0:85228:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788200861.440493:0:85228:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788200862.052893:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200862.065579:0:85235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695329792 00000100:00100000:2.0:1788200862.065603:0:85235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695329792 00000100:00100000:0.0:1788200862.074339:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:0.0:1788200862.074358:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+5:42467:x1875060695329792:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788200862.074382:0:85235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200862.074554:0:85235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007ce9200/0x96d0c9b8c9a1a5b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786546 expref: -99 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200862.074603:0:85235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007ce9200/0x96d0c9b8c9a1a5b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786546 expref: 6 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200862.074616:0:85235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007ce9200/0x96d0c9b8c9a1a5b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786546 expref: 6 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200862.074627:0:85235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ce9200, rc 0) 00000100:00100000:0.0:1788200862.074748:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+6:42467:x1875060695329792:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 392us (21868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200862.074755:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:2.0:1788200862.091833:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200862.091970:0:85234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695329920 00000100:00100000:3.0:1788200862.091982:0:85234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695329920 00000100:00100000:3.0:1788200862.092084:0:85234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:3.0:1788200862.092097:0:85234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+6:42467:x1875060695329920:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788200862.092133:0:85234:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1788200862.092155:0:85234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788200862.092160:0:85234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788200862.092164:0:85234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788200862.092167:0:85234:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788200862.092169:0:85234:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 107 00000100:00100000:2.0:1788200862.096491:0:85234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+6:42467:x1875060695329920:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 Request processed in 4380us (4658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200862.096512:0:85234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:2.0:1788200862.102500:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200862.106310:0:85240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695330176 00000100:00100000:3.0:1788200862.106332:0:85240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695330176 00000100:00100000:3.0:1788200862.106498:0:85240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:3.0:1788200862.106510:0:85240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cce6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+6:42467:x1875060695330176:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788200862.106532:0:85240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788200862.106557:0:85240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007a2c400/0x96d0c9b8c9a1a5bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78654d expref: -99 pid: 85240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.106607:0:85240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007a2c400/0x96d0c9b8c9a1a5bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78654d expref: 7 pid: 85240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.106620:0:85240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007a2c400/0x96d0c9b8c9a1a5bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78654d expref: 7 pid: 85240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.106631:0:85240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2c400, rc 0) 00000100:00100000:3.0:1788200862.106711:0:85240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cce6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+7:42467:x1875060695330176:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 203us (4222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200862.106719:0:85240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:3.0:1788200862.106893:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200862.107129:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695330048 00000100:00100000:1.0:1788200862.107135:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695330048 00000100:00100000:1.0:1788200862.107165:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1079 00000100:00100000:1.0:1788200862.107171:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695330048:12345-192.168.201.20@tcp:38:ll_cfg_requeue.0 00010000:00080000:1.0:1788200862.107201:0:66312:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '4292087e-fa00-4621-b681-837afc99ae35' at ffff8dc005d71000, cookie 0x96d0c9b8c9a1a4ff 00010000:00080000:1.0:1788200862.107208:0:66312:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp recovering/t98784247810 exp ffff8dc005d71000 cur 3713 last 1788200861 00010000:02000400:1.0:1788200862.107218:0:66312:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:1.0:1788200862.107231:0:66312:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1788200862.107254:0:66312:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788200862.107457:0:66312:0:(import.c:65:import_set_state_nolock()) ffff8dc0059d0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788200862.107508:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:2399:x1875060695330048:12345-192.168.201.20@tcp:38:ll_cfg_requeue.0 Request processed in 336us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200862.107516:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1079 00000100:00100000:0.0:1788200862.121086:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200862.121196:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200862.121280:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695330304 00000100:00100000:3.0:1788200862.121294:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695330304 00000100:00100000:3.0:1788200862.121369:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:3.0:1788200862.121431:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11073a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+7:42467:x1875060695330304:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788200862.121647:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11073a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+8:42467:x1875060695330304:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 267us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200862.121656:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:1.0:1788200862.121993:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695322880 00000100:00100000:1.0:1788200862.122000:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695322880 00000100:00100000:1.0:1788200862.122070:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1080 00000100:00100000:1.0:1788200862.122079:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2399:x1875060695322880:12345-192.168.201.20@tcp:36:mcreate.0 00010000:00080000:1.0:1788200862.122097:0:66313:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 98784247810, current: 98784247810, replaying 00000100:00100000:1.0:1788200862.122114:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2399:x1875060695322880:12345-192.168.201.20@tcp:36:mcreate.0 Request processed in 38us (918us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788200862.122122:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1080 00010000:00080000:0.0:1788200862.122195:0:85262:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1788200862.132739:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200862.132897:0:85240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695330432 00000100:00100000:2.0:1788200862.132910:0:85240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695330432 00000100:00100000:2.0:1788200862.132986:0:85240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:2.0:1788200862.133000:0:85240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+8:42467:x1875060695330432:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788200862.133357:0:85240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+8:42467:x1875060695330432:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 359us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200862.133367:0:85240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:1.0:1788200862.149463:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200862.150945:0:85234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695330560 00000100:00100000:0.0:1788200862.150966:0:85234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695330560 00000100:00100000:0.0:1788200862.151067:0:85234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:0.0:1788200862.151079:0:85234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11073ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+8:42467:x1875060695330560:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788200862.151103:0:85234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200862.151127:0:85234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007ce9800/0x96d0c9b8c9a1a5c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786554 expref: -99 pid: 85234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200862.151191:0:85234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007ce9800/0x96d0c9b8c9a1a5c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786554 expref: 9 pid: 85234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200862.151214:0:85234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007ce9800/0x96d0c9b8c9a1a5c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786554 expref: 9 pid: 85234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200862.151226:0:85234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ce9800, rc 0) 00000100:00100000:0.0:1788200862.151305:0:85234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11073ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+9:42467:x1875060695330560:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 227us (1856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200862.151313:0:85234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:1.0:1788200862.172829:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200862.172914:0:85240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695330688 00000100:00100000:2.0:1788200862.172928:0:85240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695330688 00000100:00100000:2.0:1788200862.173058:0:85240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:2.0:1788200862.173071:0:85240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+9:42467:x1875060695330688:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788200862.173274:0:85240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+9:42467:x1875060695330688:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 206us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200862.173305:0:85240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:1.0:1788200862.177406:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200862.177509:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695330816 00000100:00100000:3.0:1788200862.177524:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695330816 00000100:00100000:3.0:1788200862.177599:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:3.0:1788200862.177613:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+9:42467:x1875060695330816:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788200862.178046:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+9:42467:x1875060695330816:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 401us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200862.178058:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:1.0:1788200862.185457:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200862.185753:0:85235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695330944 00000100:00100000:2.0:1788200862.185768:0:85235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695330944 00000100:00100000:2.0:1788200862.185838:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00100000:2.0:1788200862.185849:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+9:42467:x1875060695330944:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788200862.185871:0:85235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788200862.185896:0:85235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064ed800/0x96d0c9b8c9a1a5ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78655b expref: -99 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.185931:0:85235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ed800/0x96d0c9b8c9a1a5ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78655b expref: 10 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.185942:0:85235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064ed800/0x96d0c9b8c9a1a5ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78655b expref: 10 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.185952:0:85235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ed800, rc 0) 00000100:00100000:2.0:1788200862.186048:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+10:42467:x1875060695330944:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 201us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200862.186053:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00100000:1.0:1788200862.189797:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200862.190012:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695331072 00000100:00100000:0.0:1788200862.190120:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695331072 00000100:00100000:1.0:1788200862.190509:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00100000:1.0:1788200862.190522:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:42467:x1875060695331072:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788200862.190760:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:42467:x1875060695331072:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 240us (977us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788200862.190771:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 35 00010000:00010000:0.0:1788200862.416181:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788200862.416360:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788200862.416366:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc11d438000 from 107 10000000:01000000:2.0:1788200862.416373:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788200862.416445:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1a5d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.416459:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1a5d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.416485:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1a5d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200862.416517:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715028096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788200862.417090:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200862.419092:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1059710c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788200862.426652:0:85240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715028096 00000100:00100000:3.0:1788200862.426678:0:85240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715028096 00000100:00100000:3.0:1788200862.426767:0:85240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788200862.426791:0:85240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+10:6529:x1875060715028096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788200862.426814:0:85240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788200862.426838:0:85240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007a2d800/0x96d0c9b8c9a1a5d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1a5d1 expref: -99 pid: 85240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.426872:0:85240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007a2d800/0x96d0c9b8c9a1a5d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a5d1 expref: 11 pid: 85240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.427218:0:85240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007a2d800/0x96d0c9b8c9a1a5d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a5d1 expref: 11 pid: 85240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.427231:0:85240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2d800, rc 0) 00000100:00100000:3.0:1788200862.427337:0:85240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715028096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 560us (10248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200862.427345:0:85240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788200862.427452:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715028096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788200862.427475:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1a5d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a5d8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.427486:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1a5d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a5d8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200862.427594:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140295180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715028224:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788200862.427830:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200862.427874:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006e9ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788200862.427914:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715028224 00000100:00100000:3.0:1788200862.427920:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715028224 00000100:00100000:3.0:1788200862.427958:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788200862.427966:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715028224:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788200862.427986:0:85236:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788200862.428007:0:85236:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788200862.428010:0:85236:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 107 00000100:00100000:3.0:1788200862.428119:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715028224:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 153us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200862.428127:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788200862.428166:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140295180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715028224:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788200862.428431:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788200862.428442:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1a5d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a5d8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.428452:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1a5d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a5d8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788200862.428463:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788200862.428466:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc0053a4000 from 52 10000000:01000000:3.0:1788200862.428469:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788200862.428497:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d200/0x96d0c9b8c9a1a5df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.428506:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d200/0x96d0c9b8c9a1a5df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.428516:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d200/0x96d0c9b8c9a1a5df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200862.428723:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140295180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715028352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788200862.428761:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200862.428781:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006e9ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788200862.428802:0:85240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715028352 00000100:00100000:3.0:1788200862.428807:0:85240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715028352 00000100:00100000:3.0:1788200862.428838:0:85240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788200862.428845:0:85240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715028352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788200862.428855:0:85240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788200862.428870:0:85240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007a2cc00/0x96d0c9b8c9a1a5e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1a5df expref: -99 pid: 85240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.429829:0:85240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007a2cc00/0x96d0c9b8c9a1a5e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a5df expref: 12 pid: 85240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.429849:0:85240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007a2cc00/0x96d0c9b8c9a1a5e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a5df expref: 12 pid: 85240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.429861:0:85240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2cc00, rc 0) 00000100:00100000:3.0:1788200862.430004:0:85240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715028352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1157us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200862.430012:0:85240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788200862.430120:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140295180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715028352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788200862.430141:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d200/0x96d0c9b8c9a1a5df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a5e6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.430152:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d200/0x96d0c9b8c9a1a5df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a5e6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200862.430440:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140295180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715028480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788200862.430480:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200862.430558:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006e9ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788200862.434062:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715028480 00000100:00100000:2.0:1788200862.434085:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715028480 00000100:00100000:3.0:1788200862.438331:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788200862.438356:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10bec5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715028480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788200862.438607:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10bec5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715028480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (8125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200862.438790:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788200862.439185:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140295180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715028480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788200862.439332:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140295180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715028608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788200862.439401:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200862.439494:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006e9ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788200862.439534:0:85240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715028608 00000100:00100000:2.0:1788200862.439542:0:85240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715028608 00000100:00100000:2.0:1788200862.439754:0:85240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788200862.439765:0:85240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10bec4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715028608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788200862.439970:0:85240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10bec4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715028608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200862.439979:0:85240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788200862.440098:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140295180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715028608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788200862.440849:0:85296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1788200862.440934:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1788200862.440965:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788200862.440979:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d200/0x96d0c9b8c9a1a5df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a5e6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200862.440991:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d200/0x96d0c9b8c9a1a5df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a5e6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788200862.441002:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788200862.441005:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc0053a4000 from 104 10000000:01000000:1.0:1788200862.441009:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788200862.441082:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782ca00/0x96d0c9b8c9a1a5ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200862.441091:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc00782ca00/0x96d0c9b8c9a1a5ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200862.441102:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc00782ca00/0x96d0c9b8c9a1a5ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788200862.441126:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715028736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788200862.441185:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200862.441770:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005a8fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788200862.441962:0:85235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715028736 00000100:00100000:3.0:1788200862.441972:0:85235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715028736 00000100:00100000:3.0:1788200862.442056:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788200862.442067:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10bec5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715028736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788200862.442083:0:85235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788200862.442103:0:85235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007a2ce00/0x96d0c9b8c9a1a5f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1a5ed expref: -99 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.442134:0:85235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007a2ce00/0x96d0c9b8c9a1a5f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a5ed expref: 13 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.442146:0:85235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007a2ce00/0x96d0c9b8c9a1a5f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a5ed expref: 13 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.442169:0:85235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2ce00, rc 0) 00000100:00100000:3.0:1788200862.442318:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10bec5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715028736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 251us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200862.442326:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788200862.442391:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715028736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788200862.442975:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc00782ca00/0x96d0c9b8c9a1a5ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a5f4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.442988:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc00782ca00/0x96d0c9b8c9a1a5ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a5f4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200862.443099:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140297800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715028864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788200862.443151:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200862.443175:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006e9ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788200862.443287:0:85235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715028864 00000100:00100000:3.0:1788200862.443294:0:85235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715028864 00000100:00100000:3.0:1788200862.443327:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788200862.443335:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10bec4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715028864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788200862.443355:0:85235:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788200862.443374:0:85235:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788200862.443379:0:85235:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788200862.443383:0:85235:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788200862.443386:0:85235:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788200862.443388:0:85235:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 107 00000100:00100000:3.0:1788200862.443495:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10bec4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715028864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 160us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200862.443510:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788200862.443553:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140297800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715028864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788200862.443831:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788200862.443841:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782ca00/0x96d0c9b8c9a1a5ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a5f4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.443850:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc00782ca00/0x96d0c9b8c9a1a5ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a5f4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788200862.443860:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788200862.443862:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1788200862.443865:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788200862.443978:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d400/0x96d0c9b8c9a1a5fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.443987:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d400/0x96d0c9b8c9a1a5fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.443998:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d400/0x96d0c9b8c9a1a5fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200862.444039:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140297800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715028992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788200862.444074:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200862.444093:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007365900 going to sleep for 11 seconds 00000100:00100000:3.0:1788200862.444108:0:85235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715028992 00000100:00100000:3.0:1788200862.444113:0:85235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715028992 00000100:00100000:3.0:1788200862.444135:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788200862.444142:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13aba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715028992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788200862.444157:0:85235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788200862.444172:0:85235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007a2ca00/0x96d0c9b8c9a1a602 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1a5fb expref: -99 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.444356:0:85235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007a2ca00/0x96d0c9b8c9a1a602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a5fb expref: 14 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.444369:0:85235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007a2ca00/0x96d0c9b8c9a1a602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a5fb expref: 14 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.444379:0:85235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2ca00, rc 0) 00000100:00100000:3.0:1788200862.444465:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13aba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715028992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 323us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200862.444471:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788200862.445962:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140297800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715028992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788200862.445996:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d400/0x96d0c9b8c9a1a5fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a602 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200862.446112:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d400/0x96d0c9b8c9a1a5fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a602 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788200862.446216:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715029120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788200862.446283:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200862.446381:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005a8f540 going to sleep for 11 seconds 00000100:00100000:3.0:1788200862.446454:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715029120 00000100:00100000:3.0:1788200862.446463:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715029120 00000100:00100000:3.0:1788200862.446524:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788200862.446535:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13aba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715029120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788200862.447290:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13aba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715029120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 754us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200862.447300:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788200862.447391:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715029120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788200862.447451:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715029248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788200862.447498:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200862.447579:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005a8f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788200862.447800:0:85240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715029248 00000100:00100000:2.0:1788200862.447808:0:85240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715029248 00000100:00100000:2.0:1788200862.447860:0:85240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788200862.447870:0:85240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13aba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715029248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788200862.449044:0:85240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13aba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715029248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1142us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200862.449058:0:85240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788200862.449187:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715029248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788200862.451132:0:85297:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1788200862.451487:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1788200862.451522:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788200862.451537:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d400/0x96d0c9b8c9a1a5fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a602 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200862.451760:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d400/0x96d0c9b8c9a1a5fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a602 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788200862.451773:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1788200862.451777:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dc0053a4000 from 1 10000000:01000000:1.0:1788200862.451780:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788200862.451831:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782d600/0x96d0c9b8c9a1a609 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200862.451839:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc00782d600/0x96d0c9b8c9a1a609 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200862.451860:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc00782d600/0x96d0c9b8c9a1a609 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788200862.451977:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715029376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788200862.452168:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200862.452259:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005a8f540 going to sleep for 11 seconds 00000100:00100000:3.0:1788200862.452309:0:85235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715029376 00000100:00100000:3.0:1788200862.452320:0:85235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715029376 00000100:00100000:3.0:1788200862.452424:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788200862.452437:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13aba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715029376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788200862.452453:0:85235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788200862.452474:0:85235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007a2c000/0x96d0c9b8c9a1a610 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1a609 expref: -99 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.452500:0:85235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007a2c000/0x96d0c9b8c9a1a610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a609 expref: 15 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.452512:0:85235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007a2c000/0x96d0c9b8c9a1a610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a609 expref: 15 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.452521:0:85235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2c000, rc 0) 00000100:00100000:3.0:1788200862.452578:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13aba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715029376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200862.452595:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788200862.452645:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715029376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788200862.452664:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc00782d600/0x96d0c9b8c9a1a609 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a610 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.452688:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc00782d600/0x96d0c9b8c9a1a609 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a610 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788200862.452709:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788200862.452728:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782d600/0x96d0c9b8c9a1a609 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a610 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.452735:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc00782d600/0x96d0c9b8c9a1a609 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a610 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788200862.452743:0:6529:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788200862.452745:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc0053a4000 from 7 10000000:01000000:2.0:1788200862.452748:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788200862.452769:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ece00/0x96d0c9b8c9a1a617 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.452777:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ece00/0x96d0c9b8c9a1a617 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.452785:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ece00/0x96d0c9b8c9a1a617 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200862.452801:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715029504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788200862.452837:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200862.452859:0:85235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715029504 00000100:00100000:2.0:1788200862.452860:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1059710c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788200862.452866:0:85235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715029504 00000100:00100000:3.0:1788200862.452975:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788200862.452983:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13aba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715029504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788200862.452991:0:85235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788200862.453001:0:85235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007a2d000/0x96d0c9b8c9a1a61e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1a617 expref: -99 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.453039:0:85235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007a2d000/0x96d0c9b8c9a1a61e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a617 expref: 16 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.453048:0:85235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007a2d000/0x96d0c9b8c9a1a61e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a617 expref: 16 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.453055:0:85235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2d000, rc 0) 00000100:00100000:3.0:1788200862.453087:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13aba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715029504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200862.453105:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788200862.453145:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715029504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788200862.453156:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ece00/0x96d0c9b8c9a1a617 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a61e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.453164:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ece00/0x96d0c9b8c9a1a617 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a61e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200862.453225:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140296680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715029632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788200862.453253:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200862.453267:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0073659c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788200862.453278:0:85235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715029632 00000100:00100000:3.0:1788200862.453281:0:85235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715029632 00000100:00100000:3.0:1788200862.453302:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788200862.453307:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13aba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715029632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788200862.453442:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13aba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715029632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200862.453450:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788200862.453485:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140296680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715029632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788200862.453515:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140296680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715029760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788200862.453572:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200862.453793:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0073659c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788200862.454386:0:85235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715029760 00000100:00100000:3.0:1788200862.454392:0:85235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715029760 00000100:00100000:3.0:1788200862.454435:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788200862.454453:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715029760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788200862.454730:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715029760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 278us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200862.454738:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788200862.454793:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140296680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715029760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788200862.455990:0:85298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788200862.457269:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788200862.457301:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788200862.457316:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ece00/0x96d0c9b8c9a1a617 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a61e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.457352:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ece00/0x96d0c9b8c9a1a617 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a61e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788200862.457364:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788200862.457366:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc001db6000 from 52 10000000:01000000:2.0:1788200862.457369:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788200862.457429:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1a625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.457517:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1a625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.457531:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1a625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200862.457575:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715029888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788200862.457665:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200862.457750:0:85235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715029888 00000100:00100000:3.0:1788200862.457760:0:85235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715029888 00000100:00100000:3.0:1788200862.457825:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788200862.457837:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715029888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788200862.457853:0:85235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1788200862.457863:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1059710c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788200862.457871:0:85235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007a2c200/0x96d0c9b8c9a1a62c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1a625 expref: -99 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.457918:0:85235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007a2c200/0x96d0c9b8c9a1a62c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a625 expref: 17 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.457930:0:85235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007a2c200/0x96d0c9b8c9a1a62c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a625 expref: 17 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.457940:0:85235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2c200, rc 0) 00000100:00100000:3.0:1788200862.457991:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715029888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200862.457997:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788200862.458072:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715029888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788200862.458088:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1a625 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a62c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.458099:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1a625 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a62c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200862.458475:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715030016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788200862.458502:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200862.458543:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1059710c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788200862.458730:0:85240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715030016 00000100:00100000:3.0:1788200862.458735:0:85240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715030016 00000100:00100000:3.0:1788200862.458830:0:85240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788200862.458840:0:85240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715030016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788200862.459004:0:85240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715030016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200862.459012:0:85240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788200862.459661:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715030016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788200862.459710:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715030144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788200862.459768:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200862.463347:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715030144 00000100:00100000:1.0:1788200862.463368:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715030144 00000100:00100000:2.0:1788200862.463397:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1059710c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788200862.463472:0:85234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788200862.463486:0:85234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715030144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788200862.464277:0:85234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715030144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 791us (4505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200862.464288:0:85234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788200862.464801:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715030144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788200862.481178:0:85300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1788200862.482641:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1788200862.482694:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788200862.482711:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1a625 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a62c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.482727:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1a625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a62c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788200862.482739:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788200862.482742:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1788200862.482746:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788200862.482799:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d600/0x96d0c9b8c9a1a633 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.482807:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d600/0x96d0c9b8c9a1a633 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.482821:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d600/0x96d0c9b8c9a1a633 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200862.482855:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140296680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715030272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788200862.482947:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200862.483070:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125706c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788200862.483136:0:85235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715030272 00000100:00100000:2.0:1788200862.483239:0:85235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715030272 00000100:00100000:2.0:1788200862.483309:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788200862.483322:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715030272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788200862.483339:0:85235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788200862.483356:0:85235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064ed200/0x96d0c9b8c9a1a63a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1a633 expref: -99 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.483384:0:85235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ed200/0x96d0c9b8c9a1a63a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a633 expref: 18 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.483397:0:85235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064ed200/0x96d0c9b8c9a1a63a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a633 expref: 18 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.483417:0:85235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ed200, rc 0) 00000100:00100000:2.0:1788200862.483478:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715030272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200862.483485:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788200862.484944:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140296680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715030272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788200862.484975:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d600/0x96d0c9b8c9a1a633 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a63a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200862.484987:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d600/0x96d0c9b8c9a1a633 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a63a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200862.485099:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715030400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788200862.485155:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200862.485192:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005dfd540 going to sleep for 11 seconds 00000100:00100000:1.0:1788200862.486524:0:85234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715030400 00000100:00100000:1.0:1788200862.486539:0:85234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715030400 00000100:00100000:1.0:1788200862.486610:0:85234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788200862.486623:0:85234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715030400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788200862.486874:0:85234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715030400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (1717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200862.486883:0:85234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788200862.488833:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715030400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788200862.488921:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715030528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788200862.489048:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200862.489107:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1059710c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788200862.489454:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715030528 00000100:00100000:3.0:1788200862.489465:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715030528 00000100:00100000:3.0:1788200862.489540:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788200862.489566:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715030528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788200862.497302:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715030528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788200862.497369:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715030528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 7808us (8318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200862.497385:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000040:00080000:2.0:1788200862.500260:0:85303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1788200862.503932:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1788200862.503994:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788200862.504010:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d600/0x96d0c9b8c9a1a633 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a63a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.504041:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d600/0x96d0c9b8c9a1a633 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a63a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788200862.504054:0:6529:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788200862.504058:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc001db6000 from 7 10000000:01000000:3.0:1788200862.504061:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788200862.504115:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007a2dc00/0x96d0c9b8c9a1a641 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.504124:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007a2dc00/0x96d0c9b8c9a1a641 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.504138:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007a2dc00/0x96d0c9b8c9a1a641 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200862.504172:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140297100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715030656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788200862.504277:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200862.504489:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125706300 going to sleep for 11 seconds 00000100:00100000:0.0:1788200862.504508:0:85234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715030656 00000100:00100000:0.0:1788200862.504520:0:85234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715030656 00000100:00100000:0.0:1788200862.504586:0:85234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788200862.504597:0:85234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715030656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788200862.504626:0:85234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200862.504642:0:85234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007ce9600/0x96d0c9b8c9a1a648 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1a641 expref: -99 pid: 85234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200862.504917:0:85234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007ce9600/0x96d0c9b8c9a1a648 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a641 expref: 19 pid: 85234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200862.504930:0:85234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007ce9600/0x96d0c9b8c9a1a648 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a641 expref: 19 pid: 85234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200862.504940:0:85234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ce9600, rc 0) 00000100:00100000:0.0:1788200862.505043:0:85234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715030656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 447us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200862.505050:0:85234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788200862.505083:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140297100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715030656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788200862.505104:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007a2dc00/0x96d0c9b8c9a1a641 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a648 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.505116:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007a2dc00/0x96d0c9b8c9a1a641 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a648 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200862.505209:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715030784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788200862.505245:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200862.505280:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1059710c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788200862.505473:0:85235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715030784 00000100:00100000:0.0:1788200862.505478:0:85235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715030784 00000100:00100000:0.0:1788200862.505513:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788200862.505519:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715030784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788200862.505629:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715030784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200862.505636:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788200862.505706:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715030784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788200862.505747:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715030912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788200862.505790:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200862.511971:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1059710c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788200862.514204:0:85234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715030912 00000100:00100000:0.0:1788200862.514218:0:85234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715030912 00000100:00100000:0.0:1788200862.514277:0:85234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788200862.514286:0:85234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715030912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788200862.514482:0:85234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715030912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (8688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200862.514501:0:85234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788200862.515267:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715030912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788200862.516106:0:85305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788200862.516483:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788200862.516500:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788200862.516509:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007a2dc00/0x96d0c9b8c9a1a641 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a648 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.516517:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007a2dc00/0x96d0c9b8c9a1a641 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a648 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788200862.516530:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788200862.516532:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc13aa9f000 from 52 10000000:01000000:3.0:1788200862.516533:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788200862.516564:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1a64f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.516572:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1a64f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.516581:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1a64f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200862.516602:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140297100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715031040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788200862.516650:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200862.516689:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1257063c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788200862.516721:0:85235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715031040 00000100:00100000:0.0:1788200862.516728:0:85235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715031040 00000100:00100000:0.0:1788200862.516771:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788200862.516779:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715031040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788200862.516790:0:85235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200862.516802:0:85235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007ce8400/0x96d0c9b8c9a1a656 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1a64f expref: -99 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200862.516824:0:85235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007ce8400/0x96d0c9b8c9a1a656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a64f expref: 20 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200862.516835:0:85235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007ce8400/0x96d0c9b8c9a1a656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a64f expref: 20 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200862.516844:0:85235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ce8400, rc 0) 00000100:00100000:0.0:1788200862.516884:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715031040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200862.516890:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788200862.516947:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140297100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715031040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788200862.516962:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1a64f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a656 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.516971:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1a64f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a656 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200862.517058:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140297100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715031168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788200862.517086:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200862.517103:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1257063c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788200862.517115:0:85234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715031168 00000100:00100000:0.0:1788200862.517120:0:85234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715031168 00000100:00100000:0.0:1788200862.517152:0:85234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788200862.517157:0:85234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715031168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788200862.517266:0:85234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715031168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200862.517275:0:85234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788200862.517367:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140297100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715031168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788200862.517398:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140297100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715031296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788200862.517452:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200862.517482:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1257063c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788200862.517530:0:85240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715031296 00000100:00100000:2.0:1788200862.517534:0:85240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715031296 00000100:00100000:2.0:1788200862.517576:0:85240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788200862.517583:0:85240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715031296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788200862.517721:0:85240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715031296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200862.517737:0:85240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788200862.522698:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140297100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715031296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788200862.526720:0:85307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788200862.527072:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788200862.527098:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788200862.527109:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1a64f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a656 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.527121:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1a64f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a656 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788200862.527152:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788200862.527155:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1788200862.527158:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788200862.527194:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064edc00/0x96d0c9b8c9a1a65d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.527583:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064edc00/0x96d0c9b8c9a1a65d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.527595:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064edc00/0x96d0c9b8c9a1a65d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200862.528073:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715031424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788200862.528138:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200862.528172:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005dfda80 going to sleep for 11 seconds 00000100:00100000:3.0:1788200862.528436:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715031424 00000100:00100000:3.0:1788200862.528444:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715031424 00000100:00100000:3.0:1788200862.528495:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788200862.528506:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715031424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788200862.528521:0:85236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788200862.528534:0:85236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fd600/0x96d0c9b8c9a1a664 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1a65d expref: -99 pid: 85236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.528558:0:85236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fd600/0x96d0c9b8c9a1a664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a65d expref: 21 pid: 85236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.528568:0:85236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fd600/0x96d0c9b8c9a1a664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a65d expref: 21 pid: 85236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200862.528579:0:85236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fd600, rc 0) 00000100:00100000:3.0:1788200862.528621:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715031424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200862.528628:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788200862.528896:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715031424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788200862.528910:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064edc00/0x96d0c9b8c9a1a65d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a664 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200862.528920:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064edc00/0x96d0c9b8c9a1a65d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a664 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200862.528981:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715031552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788200862.529007:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200862.529050:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005dfda80 going to sleep for 11 seconds 00000100:00100000:2.0:1788200862.529065:0:85240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715031552 00000100:00100000:2.0:1788200862.529070:0:85240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715031552 00000100:00100000:2.0:1788200862.529107:0:85240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788200862.529116:0:85240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715031552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788200862.529441:0:85240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715031552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200862.529459:0:85240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788200862.529576:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715031552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788200862.529684:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715031680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788200862.529723:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200862.529760:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005dfda80 going to sleep for 11 seconds 00000100:00100000:1.0:1788200862.529775:0:85234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715031680 00000100:00100000:1.0:1788200862.529782:0:85234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715031680 00000100:00100000:1.0:1788200862.529815:0:85234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788200862.529827:0:85234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715031680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788200862.530710:0:85234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715031680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 881us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200862.530718:0:85234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788200862.530753:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715031680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788200862.531781:0:85309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1788200862.531906:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1788200862.531928:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788200862.531937:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064edc00/0x96d0c9b8c9a1a65d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a664 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200862.531948:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064edc00/0x96d0c9b8c9a1a65d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a664 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788200862.531969:0:6529:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788200862.531971:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc13aa9f000 from 7 10000000:01000000:0.0:1788200862.531974:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788200862.532002:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8600/0x96d0c9b8c9a1a66b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200862.532010:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8600/0x96d0c9b8c9a1a66b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200862.532599:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8600/0x96d0c9b8c9a1a66b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200862.532624:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715031808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788200862.532672:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200862.532716:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005dfda80 going to sleep for 11 seconds 00000100:00100000:1.0:1788200862.532940:0:85235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715031808 00000100:00100000:1.0:1788200862.532947:0:85235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715031808 00000100:00100000:0.0:1788200862.533245:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788200862.533257:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715031808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788200862.533269:0:85235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200862.533283:0:85235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007ce9c00/0x96d0c9b8c9a1a672 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1a66b expref: -99 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200862.533306:0:85235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007ce9c00/0x96d0c9b8c9a1a672 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a66b expref: 22 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200862.533316:0:85235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007ce9c00/0x96d0c9b8c9a1a672 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a66b expref: 22 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200862.533325:0:85235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ce9c00, rc 0) 00000100:00100000:0.0:1788200862.533441:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715031808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200862.533449:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788200862.533468:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715031808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788200862.533487:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8600/0x96d0c9b8c9a1a66b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a672 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.533496:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8600/0x96d0c9b8c9a1a66b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a672 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200862.533553:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715031936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788200862.533656:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200862.533795:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102adce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788200862.533830:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715031936 00000100:00100000:3.0:1788200862.533835:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715031936 00000100:00100000:3.0:1788200862.533871:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788200862.533880:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715031936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788200862.534050:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715031936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200862.534067:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788200862.534445:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715031936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788200862.534495:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715032064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788200862.534540:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200862.535305:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102adce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788200862.535363:0:85240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715032064 00000100:00100000:3.0:1788200862.535429:0:85240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715032064 00000100:00100000:3.0:1788200862.535475:0:85240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788200862.535484:0:85240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715032064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788200862.535676:0:85240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715032064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200862.535682:0:85240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788200862.535806:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715032064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788200862.536849:0:85310:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788200862.536926:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788200862.536952:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788200862.536963:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8600/0x96d0c9b8c9a1a66b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a672 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.536973:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8600/0x96d0c9b8c9a1a66b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a672 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788200862.536982:0:6529:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788200862.536994:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8dc12563cd28 from 1 10000000:01000000:2.0:1788200862.536997:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788200862.537116:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec800/0x96d0c9b8c9a1a679 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.537126:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec800/0x96d0c9b8c9a1a679 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.537136:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec800/0x96d0c9b8c9a1a679 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200862.537167:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715032192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788200862.537215:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200862.537246:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102adce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788200862.537289:0:85234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715032192 00000100:00100000:1.0:1788200862.537295:0:85234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715032192 00000100:00100000:1.0:1788200862.537333:0:85234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788200862.537343:0:85234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715032192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788200862.537354:0:85234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788200862.537367:0:85234:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782c800/0x96d0c9b8c9a1a680 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1a679 expref: -99 pid: 85234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200862.537703:0:85234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782c800/0x96d0c9b8c9a1a680 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a679 expref: 23 pid: 85234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200862.537715:0:85234:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782c800/0x96d0c9b8c9a1a680 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a679 expref: 23 pid: 85234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200862.537724:0:85234:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782c800, rc 0) 00000100:00100000:1.0:1788200862.537766:0:85234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715032192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 425us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200862.537773:0:85234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788200862.537818:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715032192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788200862.537831:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec800/0x96d0c9b8c9a1a679 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a680 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.537839:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec800/0x96d0c9b8c9a1a679 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a680 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788200862.537856:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788200862.537860:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec800/0x96d0c9b8c9a1a679 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a680 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.537867:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec800/0x96d0c9b8c9a1a679 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a680 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788200862.537873:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788200862.537875:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dc12563cd28 from 1 10000000:01000000:2.0:1788200862.537884:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788200862.537899:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1a687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.537906:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1a687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.537912:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1a687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200862.537923:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715032320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788200862.537947:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200862.537974:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102adce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788200862.538444:0:85235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715032320 00000100:00100000:1.0:1788200862.538450:0:85235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715032320 00000100:00100000:1.0:1788200862.538483:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788200862.538499:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715032320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788200862.538508:0:85235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788200862.538517:0:85235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782c200/0x96d0c9b8c9a1a68e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1a687 expref: -99 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200862.538530:0:85235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782c200/0x96d0c9b8c9a1a68e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a687 expref: 24 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200862.538538:0:85235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782c200/0x96d0c9b8c9a1a68e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a687 expref: 24 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200862.538544:0:85235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782c200, rc 0) 00000100:00100000:1.0:1788200862.538578:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715032320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200862.538584:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788200862.538612:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715032320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788200862.538624:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1a687 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a68e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.538632:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1a687 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a68e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200862.538678:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715032448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788200862.538704:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200862.538739:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102adce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788200862.538857:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715032448 00000100:00100000:3.0:1788200862.538862:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715032448 00000100:00100000:3.0:1788200862.538899:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788200862.538906:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715032448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788200862.538983:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715032448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 78us (278us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788200862.538990:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788200862.539161:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715032448:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788200862.539184:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788200862.539190:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1a687 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a68e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200862.539208:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1a687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a68e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200863.467247:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200864.528674:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200865.237456:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200865.237502:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200865.237562:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695331328 00000100:00100000:1.0:1788200865.237572:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695331328 00000100:00100000:1.0:1788200865.237645:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1071 00000100:00100000:1.0:1788200865.237655:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695331328:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200865.237816:0:85240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695331200 00000100:00100000:3.0:1788200865.237821:0:85240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695331200 00000100:00100000:3.0:1788200865.237856:0:85240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 71 00000100:00100000:3.0:1788200865.237863:0:85240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695331200:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788200865.237918:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695331328:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 265us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200865.237926:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1071 00000100:00100000:3.0:1788200865.244578:0:85240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695331200:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 6704us (7121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200865.244593:0:85240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 71 00000100:00080000:3.0:1788200865.244652:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788200865.558457:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788200865.995978:0:85513:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788200866.127169:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788200866.127195:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715032576:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788200866.127268:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200866.127314:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715032576 00000100:00100000:3.0:1788200866.127321:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715032576 00000100:00100000:3.0:1788200866.127383:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2078 00000100:00100000:3.0:1788200866.127393:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715032576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788200866.127422:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200866.127539:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715032576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 147us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200866.127546:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2078 00000100:00080000:3.0:1788200866.127569:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788200866.127605:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715032576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788200866.136265:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788200866.136288:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715032704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788200866.136366:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200866.136513:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715032704 00000100:00100000:1.0:1788200866.136521:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715032704 00000100:00100000:1.0:1788200866.136577:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2079 00000100:00100000:1.0:1788200866.136587:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715032704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788200866.136615:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200866.136659:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715032704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200866.136666:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2079 00000100:00080000:1.0:1788200866.136689:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788200866.136729:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715032704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788200866.259956:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200866.260071:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200866.260146:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695331456 00000100:00100000:2.0:1788200866.260156:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695331456 00000100:00100000:2.0:1788200866.260207:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 72 00000100:00100000:2.0:1788200866.260218:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695331456:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788200866.260293:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695331456:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 77us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200866.260303:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 72 00000100:00100000:0.0:1788200866.260525:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695331584 00000100:00100000:0.0:1788200866.260530:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695331584 00000100:00100000:0.0:1788200866.260561:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1072 00000100:00100000:0.0:1788200866.260568:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695331584:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200866.260615:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695331584:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 47us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200866.260622:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1072 00010000:00010000:2.0:1788200866.576328:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788200866.641840:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788200866.641848:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788200866.641851:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200866.641859:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3712 00000100:00080000:0.0:1788200866.641863:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788200866.641870:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788200866.641892:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc0073bad80 x1875060715032960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788200866.641918:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788200866.641920:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788200866.641922:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200866.641925:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3712 00000100:00080000:0.0:1788200866.641928:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788200866.641944:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788200866.641955:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc0073b8e00 x1875060715033216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788200866.641982:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788200866.641985:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788200866.641987:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200866.641990:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3712 00000100:00080000:0.0:1788200866.641992:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788200866.641995:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788200866.642006:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13ab56d80 x1875060715033472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788200866.642051:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788200866.642054:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788200866.642055:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200866.642059:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3712 00000100:00080000:0.0:1788200866.642060:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788200866.642064:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788200866.642073:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13ab56680 x1875060715033856/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788200866.642107:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788200866.642110:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788200866.642113:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200866.642117:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dc0034f7000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788200866.642128:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13ab54000 x1875060715034368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788200866.642161:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0073b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715033088:0@lo:400:kworker.0 00000100:00100000:0.0:1788200866.642248:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200866.642283:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715033984:0@lo:400:kworker.0 00000100:00100000:0.0:1788200866.642356:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200866.642384:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788200866.642391:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715032832:0@lo:400:kworker.0 00000100:00100000:0.0:1788200866.642416:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200866.642444:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715033728:0@lo:400:kworker.0 00000100:00100000:0.0:1788200866.642466:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200866.642492:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0073bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715032960:0@lo:38:kworker.0 00000100:00100000:0.0:1788200866.642513:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200866.642530:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0073b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715033216:0@lo:38:kworker.0 00000100:00100000:0.0:1788200866.642565:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200866.642583:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715033472:0@lo:38:kworker.0 00000100:00100000:0.0:1788200866.642602:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200866.642619:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715033856:0@lo:38:kworker.0 00000100:00100000:0.0:1788200866.642637:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200866.642653:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715034368:0@lo:38:kworker.0 00000100:00100000:0.0:1788200866.642674:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200866.642700:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715033344:0@lo:400:kworker.0 00000100:00100000:0.0:1788200866.642723:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200866.642733:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715034112:0@lo:400:kworker.0 00000100:00100000:0.0:1788200866.642755:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200866.642784:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788200866.642789:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715033600:0@lo:400:kworker.0 00000100:00100000:0.0:1788200866.642811:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200866.642827:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715034240:0@lo:400:kworker.0 00000100:00100000:0.0:1788200866.642850:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200866.642881:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715033088 00000100:00100000:0.0:1788200866.642888:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715033088 00000100:00100000:0.0:1788200866.642931:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715032960 00000100:00100000:0.0:1788200866.642934:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715032960 00000100:00100000:0.0:1788200866.642944:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715033216 00000100:00100000:0.0:1788200866.642946:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715033216 00000100:00100000:0.0:1788200866.642952:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715033856 00000100:00100000:0.0:1788200866.642954:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715033856 00000100:00100000:0.0:1788200866.642961:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715034368 00000100:00100000:0.0:1788200866.642963:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715034368 00000100:00100000:0.0:1788200866.642970:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715033344 00000100:00100000:0.0:1788200866.642972:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715033344 00000100:00100000:0.0:1788200866.642989:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:0.0:1788200866.642997:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715033088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200866.643065:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715033088:12345-0@lo:400:kworker.0 Request processed in 67us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200866.643071:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00100000:0.0:1788200866.643087:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:0.0:1788200866.643093:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715033344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200866.643123:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715033344:12345-0@lo:400:kworker.0 Request processed in 31us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200866.643129:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00100000:0.0:1788200866.643141:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1788200866.643146:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715032960:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788200866.643177:0:66313:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3718 last 0 00000020:00000080:0.0:1788200866.643213:0:66313:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x96d0c9b8c9a1a695 00000004:00100000:0.0:1788200866.643229:0:66313:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788200866.643383:0:66313:0:(import.c:65:import_set_state_nolock()) ffff8dc120724000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788200866.643423:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875060715032960:12345-0@lo:38:kworker.0 Request processed in 275us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200866.643431:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1788200866.643443:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:0.0:1788200866.643447:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715033216:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788200866.643460:0:66313:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3718 last 0 00000020:00000080:0.0:1788200866.643481:0:66313:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x96d0c9b8c9a1a69c 00000004:00100000:0.0:1788200866.643487:0:66313:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788200866.643504:0:66313:0:(import.c:65:import_set_state_nolock()) ffff8dc120720800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788200866.643531:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875060715033216:12345-0@lo:38:kworker.0 Request processed in 82us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200866.643537:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:0.0:1788200866.643549:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:0.0:1788200866.643553:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715033856:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788200866.643566:0:66313:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3718 last 0 00000020:00000080:0.0:1788200866.643587:0:66313:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x96d0c9b8c9a1a6a3 00000004:00100000:0.0:1788200866.643593:0:66313:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788200866.643606:0:66313:0:(import.c:65:import_set_state_nolock()) ffff8dc120725000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788200866.643632:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875060715033856:12345-0@lo:38:kworker.0 Request processed in 77us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200866.643638:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:0.0:1788200866.643658:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:0.0:1788200866.643663:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715034368:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788200866.643676:0:66313:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3718 last 0 00000020:00000080:0.0:1788200866.643695:0:66313:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x96d0c9b8c9a1a6aa 00000004:00100000:0.0:1788200866.643701:0:66313:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788200866.643714:0:66313:0:(import.c:65:import_set_state_nolock()) ffff8dc1098d7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788200866.643741:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875060715034368:12345-0@lo:38:kworker.0 Request processed in 77us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200866.643747:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00100000:0.0:1788200866.643769:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715033984 00000100:00100000:0.0:1788200866.643773:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715033984 00000100:00100000:0.0:1788200866.643797:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715033472 00000100:00100000:0.0:1788200866.643800:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715033472 00000100:00100000:0.0:1788200866.643813:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3808 00000100:00100000:0.0:1788200866.643819:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715033984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200866.643853:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715033984:12345-0@lo:400:kworker.0 Request processed in 34us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200866.643859:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3808 00000100:00100000:0.0:1788200866.643870:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3809 00000100:00100000:0.0:1788200866.643874:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715033472:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788200866.643888:0:8458:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8dc11d43a000, cookie 0x96d0c9b8c9a1a506 00010000:00080000:0.0:1788200866.643892:0:8458:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t81604378640 exp ffff8dc11d43a000 cur 3718 last 1788200861 00000004:00100000:0.0:1788200866.643900:0:8458:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788200866.643914:0:8458:0:(import.c:65:import_set_state_nolock()) ffff8dc1098d1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788200866.643949:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715033472:12345-0@lo:38:kworker.0 Request processed in 72us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200866.643963:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3809 00000100:00100000:0.0:1788200866.643983:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715033728 00000100:00100000:0.0:1788200866.643987:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715033728 00000100:00100000:0.0:1788200866.644009:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715034112 00000100:00100000:0.0:1788200866.644012:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715034112 00000100:00100000:0.0:1788200866.644062:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715033600 00000100:00100000:0.0:1788200866.644065:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715033600 00000100:00100000:0.0:1788200866.644082:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715034240 00000100:00100000:0.0:1788200866.644085:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715034240 00000100:00100000:0.0:1788200866.644107:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2569 00000100:00100000:0.0:1788200866.644114:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715033728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200866.644144:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715033728:12345-0@lo:400:kworker.0 Request processed in 31us (1677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200866.644150:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2569 00000100:00100000:0.0:1788200866.644162:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2570 00000100:00100000:0.0:1788200866.644168:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715034112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200866.644194:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715034112:12345-0@lo:400:kworker.0 Request processed in 27us (1438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200866.644200:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2570 00000100:00100000:0.0:1788200866.644210:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2571 00000100:00100000:0.0:1788200866.644215:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715033600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200866.644240:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715033600:12345-0@lo:400:kworker.0 Request processed in 25us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200866.644246:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2571 00000100:00100000:0.0:1788200866.644257:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572 00000100:00100000:0.0:1788200866.644262:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715034240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200866.644299:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715034240:12345-0@lo:400:kworker.0 Request processed in 37us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200866.644305:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572 00000100:00080000:0.0:1788200866.644366:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788200866.644370:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788200866.644372:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788200866.644385:0:85262:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1788200866.644390:0:85262:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 98784247810 00000020:00080000:0.0:1788200866.644395:0:85262:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788200866.644398:0:85262:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 98784247810, next_transno: 98784247810 00010000:00080000:0.0:1788200866.644402:0:85262:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (98784247810) 00000020:00080000:0.0:1788200866.644404:0:85262:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788200866.644415:0:85262:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695322880 t98784247810 from 192.168.201.20@tcp req@ffff8dc139ba0700 x1875060695322880/t0(98784247810) o36->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:738/0 lens 528/0 e 0 to 0 dl 1788200873 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788200866.644506:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715033600:0@lo:400:kworker.0 00000100:00100000:0.0:1788200866.644519:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715034240:0@lo:400:kworker.0 00000100:00100000:0.0:1788200866.644528:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715033344:0@lo:400:kworker.0 00000100:00100000:0.0:1788200866.644537:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715034112:0@lo:400:kworker.0 00010000:00080000:0.0:1788200866.644576:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc0073bad80 x1875060715032960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788200891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788200866.644588:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 24 00000100:00100000:3.0:1788200866.646393:0:85240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715032832 00000100:00100000:3.0:1788200866.646405:0:85240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715032832 00000100:00100000:3.0:1788200866.646450:0:85240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788200866.646458:0:85240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715032832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200866.646522:0:85240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715032832:12345-0@lo:400:kworker.0 Request processed in 65us (4105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200866.646529:0:85240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788200866.646804:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715034496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788200866.646847:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200866.646891:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715034496 00000100:00100000:2.0:1788200866.646895:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715034496 00000100:00100000:2.0:1788200866.646921:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3810 00000100:00100000:2.0:1788200866.646928:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715034496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788200866.646952:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:2.0:1788200866.646986:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715034496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200866.646992:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3810 00000100:00100000:2.0:1788200866.647051:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715034496:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1788200866.648211:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8dc0073bad80 x1875060715032960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788200891 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788200866.648226:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1788200866.648360:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788200866.648366:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1788200866.648371:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0073bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715032960:0@lo:38:kworker.0 00010000:00080000:0.0:1788200866.648396:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc0073b8e00 x1875060715033216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788200891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788200866.648411:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 24 00000100:00080000:0.0:1788200866.651000:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8dc0073b8e00 x1875060715033216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788200891 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788200866.651044:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1788200866.651051:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788200866.651055:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1788200866.651060:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0073b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715033216:0@lo:38:kworker.0 00000100:00080000:0.0:1788200866.651110:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 24 00000100:00080000:0.0:1788200866.651121:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1788200866.651125:0:3654:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1788200866.651128:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 85899345923 gen 3 00000100:00080000:0.0:1788200866.651131:0:3654:0:(recover.c:53:ptlrpc_replay_next()) import ffff8dc109813800 from lustre-MDT0000_UUID committed 85899345923 last 0 00000100:00080000:0.0:1788200866.651134:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1788200866.651175:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715032832:0@lo:400:kworker.0 00000100:00100000:0.0:1788200866.651202:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715033728:0@lo:400:kworker.0 00000100:00100000:0.0:1788200866.651217:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0073b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715033088:0@lo:400:kworker.0 00000100:00100000:0.0:1788200866.651228:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715033984:0@lo:400:kworker.0 00000100:00100000:0.0:1788200866.651785:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715033472:0@lo:38:kworker.0 00010000:00080000:0.0:1788200866.651816:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc13ab56680 x1875060715033856/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788200891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788200866.651829:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 24 00010000:00080000:3.0:1788200866.652781:0:85541:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1788200866.652786:0:85541:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1788200866.652791:0:85541:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:3.0:1788200866.653304:0:85541:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:0.0:1788200866.667561:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8dc13ab56680 x1875060715033856/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788200891 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788200866.667575:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1788200866.667580:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788200866.667584:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1788200866.667590:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715033856:0@lo:38:kworker.0 00010000:00080000:0.0:1788200866.667628:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc13ab54000 x1875060715034368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788200876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788200866.667644:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 24 00000100:00080000:0.0:1788200866.667652:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788200866.667657:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788200866.667659:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788200866.667663:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715034368:0@lo:38:kworker.0 00000100:00100000:0.0:1788200866.667710:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715034624:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1788200866.667773:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788200866.668563:0:85262:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 24103us 00000100:00100000:3.0:1788200866.669456:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715034624 00000100:00100000:3.0:1788200866.669467:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715034624 00000100:00100000:3.0:1788200866.669539:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3811 00000100:00100000:3.0:1788200866.669550:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715034624:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1788200866.669569:0:23728:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc12014ce00 x1875060715034624/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:742/0 lens 224/0 e 0 to 0 dl 1788200877 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788200866.669581:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715034624:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 34us (1808us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788200866.669587:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3811 00010000:00010000:0.0:1788200866.723062:0:85262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a6b1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.723086:0:85262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a6b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.723113:0:85262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a6b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.723128:0:85262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a6b8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.723135:0:85262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a6b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.723141:0:85262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a6b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.723987:0:85262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a6b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.723998:0:85262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a6b1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.724005:0:85262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a6b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.724011:0:85262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788200866.724033:0:85262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a6b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.724042:0:85262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a6b1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.724054:0:85262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103b47c00) 00010000:00010000:0.0:1788200866.724058:0:85262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788200866.724062:0:85262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a6b1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.724076:0:85262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a6b1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788200866.724093:0:85262:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1f02ff2 reply state 00000000c8535d53 transno 98784247810 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a6b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.724104:0:85262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a6b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.724110:0:85262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc103b47800) 00010000:00010000:0.0:1788200866.724112:0:85262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788200866.724116:0:85262:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788200866.725063:0:85262:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788200866.725090:0:85262:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788200866.725094:0:85262:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247811 00000020:00080000:0.0:1788200866.725098:0:85262:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788200866.725100:0:85262:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247811 00000001:00080000:0.0:1788200866.729473:0:85229:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247810 is committed 00010000:00010000:2.0:1788200866.730281:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a6b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.730310:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a6b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.730317:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a6b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.730322:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788200866.730327:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a6b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.730346:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a6b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.730365:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc103b47800) 00010000:00010000:2.0:1788200866.730368:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788200866.730373:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a6b8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.730378:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a6b8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200866.734885:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200866.734976:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695323392 00000100:00100000:0.0:1788200866.734987:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695323392 00000100:00100000:0.0:1788200866.735084:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1085 00000100:00100000:0.0:1788200866.735105:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2399:x1875060695323392:12345-192.168.201.20@tcp:36:rm.0 00010000:00080000:0.0:1788200866.735124:0:66313:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 98784247811, current: 98784247811, replaying 00000100:00100000:0.0:1788200866.735137:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2399:x1875060695323392:12345-192.168.201.20@tcp:36:rm.0 Request processed in 45us (262us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788200866.735144:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1085 00000020:00080000:0.0:1788200866.735160:0:85262:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788200866.735171:0:85262:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247811, next_transno: 98784247811 00010000:00080000:0.0:1788200866.735175:0:85262:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (98784247811) 00000020:00080000:0.0:1788200866.735179:0:85262:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788200866.735187:0:85262:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695323392 t98784247811 from 192.168.201.20@tcp req@ffff8dc004d72a00 x1875060695323392/t0(98784247811) o36->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:742/0 lens 512/0 e 0 to 0 dl 1788200877 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788200866.735281:0:85262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a6bf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.735296:0:85262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a6bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.735307:0:85262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a6bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.735321:0:85262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a6c6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.735328:0:85262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a6c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.735349:0:85262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a6c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.735427:0:85262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a6cd lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.735434:0:85262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a6cd lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.735440:0:85262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a6cd lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.735686:0:85262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a6cd lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.735695:0:85262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a6cd lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.735702:0:85262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a6cd lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.735708:0:85262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788200866.735712:0:85262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a6cd lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.735719:0:85262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a6cd lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.735732:0:85262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x1:0x0].0x0 (ffff8dc11248cb00) 00010000:00010000:0.0:1788200866.735735:0:85262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788200866.735739:0:85262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a6cd lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.735746:0:85262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a6cd lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.735764:0:85262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a6bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.735770:0:85262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a6bf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.735776:0:85262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a6bf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.735787:0:85262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788200866.735790:0:85262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a6bf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.735797:0:85262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a6bf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.735805:0:85262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc11248c000) 00010000:00010000:0.0:1788200866.735807:0:85262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788200866.735810:0:85262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a6bf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.735816:0:85262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a6bf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788200866.735828:0:85262:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002371936d reply state 000000003d54b09c transno 98784247811 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a6c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.735839:0:85262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a6c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.735845:0:85262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc11248ce00) 00010000:00010000:0.0:1788200866.735847:0:85262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788200866.735850:0:85262:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788200866.735911:0:85262:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788200866.735926:0:85262:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788200866.735929:0:85262:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247812 00000020:00080000:0.0:1788200866.735932:0:85262:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788200866.735934:0:85262:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247812 00000100:00100000:1.0:1788200866.741428:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200866.741514:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695325184 00000100:00100000:0.0:1788200866.741537:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695325184 00000100:00100000:0.0:1788200866.741617:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1086 00000100:00100000:0.0:1788200866.741628:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+8:2399:x1875060695325184:12345-192.168.201.20@tcp:101:lfs.0 00010000:00080000:0.0:1788200866.741658:0:66312:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 98784247812, current: 98784247812, replaying 00000100:00100000:0.0:1788200866.741678:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+8:2399:x1875060695325184:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 53us (258us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788200866.741686:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1086 00000020:00080000:2.0:1788200866.741786:0:85262:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788200866.741791:0:85262:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247812, next_transno: 98784247812 00010000:00080000:2.0:1788200866.741795:0:85262:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (98784247812) 00000020:00080000:2.0:1788200866.741797:0:85262:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788200866.741806:0:85262:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695325184 t98784247812 from 192.168.201.20@tcp req@ffff8dc120091500 x1875060695325184/t0(98784247812) o101->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:742/0 lens 536/0 e 0 to 0 dl 1788200877 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1788200866.741826:0:85262:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788200866.741854:0:85262:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1a6d4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786538 expref: -99 pid: 85262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.742044:0:85262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1a6db lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.742057:0:85262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1a6db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.742068:0:85262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1a6db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.742081:0:85262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a6e2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.742088:0:85262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a6e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.742107:0:85262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a6e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788200866.742498:0:85262:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00000004:00080000:2.0:1788200866.742517:0:85262:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000afe1:0x2:0x0], cookie = 0x96d0c9b8c9a1a457 00000004:00080000:2.0:1788200866.742520:0:85262:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x96d0c9b8c9a1a457 in new mfd 00010000:00010000:2.0:1788200866.742529:0:85262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1a6db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.742537:0:85262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1a6db lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.742543:0:85262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1a6db lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.742560:0:85262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788200866.742564:0:85262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1a6db lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.742571:0:85262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1a6db lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.742584:0:85262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661800) 00010000:00010000:2.0:1788200866.742586:0:85262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788200866.742591:0:85262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1a6db lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.742596:0:85262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1a6db lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788200866.742607:0:85262:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074e99067 reply state 00000000ab002bd3 transno 98784247812 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a6e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.742616:0:85262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a6e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.742622:0:85262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff8dc12b661900) 00010000:00010000:2.0:1788200866.742624:0:85262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788200866.742627:0:85262:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788200866.742660:0:85262:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1a6d4 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786538 expref: 10 pid: 85262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.742669:0:85262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661800) 00010000:00010000:2.0:1788200866.742671:0:85262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788200866.742680:0:85262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1a6d4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786538 expref: 10 pid: 85262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.742694:0:85262:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064eda00, rc 0) 00010000:00080000:2.0:1788200866.742757:0:85262:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788200866.742772:0:85262:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788200866.742774:0:85262:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247813 00000020:00080000:2.0:1788200866.742778:0:85262:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788200866.742780:0:85262:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247813 00000100:00100000:2.0:1788200866.773840:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200866.778208:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695325440 00000100:00100000:3.0:1788200866.778223:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695325440 00000100:00100000:3.0:1788200866.778341:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1087 00000100:00100000:3.0:1788200866.778353:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+10:2399:x1875060695325440:12345-192.168.201.20@tcp:101:lfs.0 00010000:00080000:3.0:1788200866.778372:0:66314:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 98784247813, current: 98784247813, replaying 00000100:00100000:3.0:1788200866.778390:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+10:2399:x1875060695325440:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 40us (4560us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788200866.778396:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1087 00000020:00080000:2.0:1788200866.778434:0:85262:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788200866.778439:0:85262:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247813, next_transno: 98784247813 00010000:00080000:2.0:1788200866.778443:0:85262:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (98784247813) 00000020:00080000:2.0:1788200866.778446:0:85262:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788200866.778456:0:85262:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695325440 t98784247813 from 192.168.201.20@tcp req@ffff8dc004d70700 x1875060695325440/t0(98784247813) o101->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:742/0 lens 736/0 e 0 to 0 dl 1788200877 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1788200866.778477:0:85262:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788200866.778500:0:85262:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1a6f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78653f expref: -99 pid: 85262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788200866.778589:0:85262:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x2:0x0]: returning size 0 00000004:00080000:2.0:1788200866.778776:0:85262:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000afe1:0x2:0x0], cookie = 0x96d0c9b8c9a1a46c 00000004:00080000:2.0:1788200866.778780:0:85262:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x96d0c9b8c9a1a46c in new mfd 00010000:00010000:2.0:1788200866.778811:0:85262:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1a6f0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78653f expref: 12 pid: 85262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.778825:0:85262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661800) 00010000:00010000:2.0:1788200866.778835:0:85262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788200866.778841:0:85262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1a6f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78653f expref: 12 pid: 85262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.778857:0:85262:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064eda00, rc 0) 00010000:00080000:2.0:1788200866.778920:0:85262:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788200866.778936:0:85262:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788200866.778939:0:85262:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000020:00080000:2.0:1788200866.778942:0:85262:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788200866.778944:0:85262:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000100:00100000:0.0:1788200866.791431:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200866.791524:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695325824 00000100:00100000:1.0:1788200866.791534:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695325824 00000100:00100000:1.0:1788200866.791647:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 215 00000100:00100000:1.0:1788200866.791660:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4292087e-fa00-4621-b681-837afc99ae35+11:2399:x1875060695325824:12345-192.168.201.20@tcp:35:lfs.0 00010000:00080000:1.0:1788200866.791680:0:79137:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 98784247814, current: 98784247814, replaying 00000100:00100000:1.0:1788200866.791700:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4292087e-fa00-4621-b681-837afc99ae35+11:2399:x1875060695325824:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 44us (279us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788200866.791707:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 215 00000020:00080000:2.0:1788200866.791942:0:85262:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788200866.791946:0:85262:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247814, next_transno: 98784247814 00010000:00080000:2.0:1788200866.791950:0:85262:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (98784247814) 00000020:00080000:2.0:1788200866.791953:0:85262:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788200866.791962:0:85262:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695325824 t98784247814 from 192.168.201.20@tcp req@ffff8dc12014e300 x1875060695325824/t0(98784247814) o35->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:742/0 lens 392/0 e 0 to 0 dl 1788200877 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788200866.792234:0:85262:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788200866.792249:0:85262:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788200866.792251:0:85262:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000020:00080000:2.0:1788200866.792254:0:85262:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788200866.792256:0:85262:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000100:00100000:2.0:1788200866.794524:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200866.794849:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695326080 00000100:00100000:0.0:1788200866.794858:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695326080 00000100:00100000:0.0:1788200866.794892:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 216 00000100:00100000:0.0:1788200866.794901:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4292087e-fa00-4621-b681-837afc99ae35+12:2399:x1875060695326080:12345-192.168.201.20@tcp:35:lfs.0 00010000:00080000:0.0:1788200866.794917:0:66316:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 98784247815, current: 98784247815, replaying 00000100:00100000:0.0:1788200866.794934:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4292087e-fa00-4621-b681-837afc99ae35+12:2399:x1875060695326080:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 34us (419us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788200866.794941:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 216 00000020:00080000:2.0:1788200866.794989:0:85262:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788200866.794992:0:85262:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247815, next_transno: 98784247815 00010000:00080000:2.0:1788200866.794996:0:85262:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (98784247815) 00000020:00080000:2.0:1788200866.794999:0:85262:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788200866.795007:0:85262:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695326080 t98784247815 from 192.168.201.20@tcp req@ffff8dc137c5dc50 x1875060695326080/t0(98784247815) o35->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:742/0 lens 392/0 e 0 to 0 dl 1788200877 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788200866.795233:0:85262:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788200866.795266:0:85262:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788200866.795268:0:85262:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000020:00080000:2.0:1788200866.795271:0:85262:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788200866.795273:0:85262:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000100:00100000:2.0:1788200866.800720:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200866.800822:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695331712 00000100:00100000:0.0:1788200866.800832:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695331712 00000100:00100000:1.0:1788200866.802053:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1075 00000100:00100000:1.0:1788200866.802069:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+13:2399:x1875060695331712:12345-192.168.201.20@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1788200866.802094:0:66312:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc004d72680 x1875060695331712/t0(0) o400->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:742/0 lens 224/0 e 0 to 0 dl 1788200877 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788200866.802114:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+13:2399:x1875060695331712:12345-192.168.201.20@tcp:400:ldlm_lock_repla.0 Request processed in 53us (1404us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788200866.802132:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1075 00000020:00080000:3.0:1788200866.804470:0:85262:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788200866.804478:0:85262:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 98784247816 00010000:00080000:3.0:1788200866.804482:0:85262:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1788200866.804485:0:85262:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788200866.804493:0:85262:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788200866.804495:0:85262:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1788200866.804602:0:85262:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 103079215104 00000001:00100000:3.0:1788200866.806865:0:85229:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4292087e-fa00-4621-b681-837afc99ae35 00000001:00100000:3.0:1788200866.806875:0:85229:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1788200866.806891:0:85229:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247815 is committed 00010000:00010000:3.0:1788200866.806931:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a6c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.806953:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a6c6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.806960:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a6c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.806966:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce9000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788200866.806970:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a6c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.806977:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a6c6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.806996:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a6c6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.807002:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a6c6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.807050:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a6e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.807057:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a6e2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.807062:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a6e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.807067:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ede00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788200866.807069:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a6e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.807080:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a6e2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.807101:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a6e2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.807108:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1a6e2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85262 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788200866.807151:0:85262:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1788200866.807184:0:85262:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1788200866.809628:0:85262:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8dc12014ce00 x1875060715034624/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:742/0 lens 224/0 e 0 to 0 dl 1788200877 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788200866.809824:0:85262:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.201.20@tcp: req@ffff8dc004d72680 x1875060695331712/t0(0) o400->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:742/0 lens 224/0 e 0 to 0 dl 1788200877 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788200866.809878:0:85262:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:0.0:1788200866.812492:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1788200866.812507:0:3654:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8dc140295180 x1875060715034624/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788200882 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788200866.812518:0:3654:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8dc140295180 x1875060715034624/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788200882 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788200866.812525:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788200866.812546:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1788200866.812551:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715034624:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1788200866.812623:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715034752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788200866.812682:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200866.812735:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715034752 00000100:00100000:1.0:1788200866.812742:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715034752 00000100:00100000:1.0:1788200866.812791:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3812 00000100:00100000:1.0:1788200866.812801:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715034752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788200866.812838:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444974592 avail 1298735104 00000100:00100000:1.0:1788200866.812882:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715034752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200866.812888:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3812 00000100:00100000:1.0:1788200866.812924:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715034752:0@lo:41:osp-pre-0-1.0 00000004:00000080:2.0:1788200866.830365:0:85262:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa0dd486f7e10 00100000:10000000:2.0:1788200866.830379:0:85262:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1788200866.831364:0:85250:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x2a2:0x0] 00000100:00100000:3.0:1788200866.831412:0:85250:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140296a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85250:1875060715034880:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788200866.831483:0:85250:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200866.831571:0:85250:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005dfd900 going to sleep for 11 seconds 00000004:00080000:1.0:1788200866.831872:0:85248:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0xb0:0x0] 00000100:00100000:1.0:1788200866.831891:0:85248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85248:1875060715035008:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788200866.831918:0:85248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200866.833932:0:85248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102adce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788200866.837604:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715034880 00000100:00100000:1.0:1788200866.837620:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715034880 00000100:00100000:1.0:1788200866.837714:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5854 00000100:00100000:1.0:1788200866.837726:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:85250:x1875060715034880:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788200866.837762:0:26208:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 737 -> diff = -63 00002000:02000040:1.0:1788200866.837767:0:26208:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:675 to 0x2c0000401:737) 00000100:00100000:2.0:1788200866.841563:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715035008 00000100:00100000:2.0:1788200866.841578:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715035008 00000100:00100000:2.0:1788200866.841633:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5855 00000100:00100000:2.0:1788200866.841644:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:85248:x1875060715035008:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788200866.841677:0:8449:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 737 -> diff = -561 00002000:02000040:2.0:1788200866.841681:0:8449:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:177 to 0x280000401:737) 00002000:00010000:1.0:1788200866.843259:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.843272:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1a6fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.843301:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e1:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.843305:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.843311:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1a6fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.843337:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1a6fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.843348:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1a6fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.843354:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1a6fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.843410:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788200866.843566:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.843571:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1a705 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.843579:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e0:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.843581:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.843585:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1a705 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.843594:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1a705 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.843614:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1a705 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.843621:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1a705 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.843652:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788200866.843660:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1a6fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.843667:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200866.843671:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1a6fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.843687:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1a6fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.843703:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1a6fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.843711:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1a6fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.843730:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200866.843733:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1a705 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.843739:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782da00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200866.843742:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1a705 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.843750:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1a705 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.843759:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1a705 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.843767:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200866.843769:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200866.843776:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.846923:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788200866.846949:0:26208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1a705 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788200866.847801:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.847810:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1a70c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.847824:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2df:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.847829:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.847834:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1a70c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.847848:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1a70c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.847858:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1a70c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.847877:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1a70c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.848169:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200866.848177:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1a70c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.848186:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200866.848190:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1a70c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.848199:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1a70c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.848216:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1a70c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.848225:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200866.848227:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200866.848229:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788200866.849555:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1788200866.852474:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.852488:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1a713 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.852507:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e1:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.852511:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.852516:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1a713 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.852533:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1a713 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.852561:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1a713 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.852569:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1a713 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.852600:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788200866.852751:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.852757:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028ebed8b/0x96d0c9b8c9a1a71a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.852765:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e0:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.852768:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.852772:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028ebed8b/0x96d0c9b8c9a1a71a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.852781:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028ebed8b/0x96d0c9b8c9a1a71a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.852788:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028ebed8b/0x96d0c9b8c9a1a71a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.852795:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028ebed8b/0x96d0c9b8c9a1a71a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.852822:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788200866.852834:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788200866.852840:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1a713 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.852848:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ede00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200866.852853:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1a713 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.852863:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1a713 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.852881:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1a713 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.852889:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1a713 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.852912:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200866.852916:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028ebed8b/0x96d0c9b8c9a1a71a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.852923:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200866.852926:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028ebed8b/0x96d0c9b8c9a1a71a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.852946:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028ebed8b/0x96d0c9b8c9a1a71a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.852956:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028ebed8b/0x96d0c9b8c9a1a71a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.852964:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028ebed8b/0x96d0c9b8c9a1a71a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.852976:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.852978:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.852980:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200866.853055:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.853129:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788200866.853136:0:26208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1a70c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788200866.853210:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.853215:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1a721 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853223:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2de:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.853225:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.853229:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1a721 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853238:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1a721 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853245:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1a721 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853251:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1a721 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853277:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788200866.853318:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.853323:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1a728 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853343:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2dd:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.853346:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.853350:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1a728 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853359:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1a728 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853367:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1a728 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853373:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1a728 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853388:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788200866.853396:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788200866.853399:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1a721 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853406:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.853414:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1a721 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853422:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1a721 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853433:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1a721 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853440:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1a721 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853455:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200866.853458:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1a728 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853464:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782cc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.853467:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1a728 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853474:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1a728 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853483:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1a728 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853490:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1a728 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853510:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.853511:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.853514:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788200866.853555:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.853561:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1a72f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853568:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2dc:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.853571:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.853575:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1a72f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853583:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1a72f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853590:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1a72f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853596:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1a72f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853609:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788200866.853615:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200866.853618:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1a72f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853634:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.853636:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1a72f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853643:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1a72f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853652:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1a72f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853658:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1a72f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853670:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.853672:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.853673:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788200866.853711:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.853716:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1a736 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853723:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2db:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.853726:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.853729:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1a736 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853738:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1a736 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853751:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1a736 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853757:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1a736 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853768:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788200866.853776:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200866.853779:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1a736 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853785:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.853787:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1a736 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853794:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1a736 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853804:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1a736 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853812:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1a736 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853824:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.853830:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.853832:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788200866.853870:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.853875:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1a73d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853883:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2da:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.853886:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.853890:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1a73d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853898:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1a73d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853904:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1a73d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853911:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1a73d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853923:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788200866.853929:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200866.853932:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1a73d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853937:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.853940:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1a73d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853956:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1a73d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853965:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1a73d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853972:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1a73d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.853984:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.853986:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.853988:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788200866.854053:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.854058:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1a744 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854066:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d9:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.854068:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.854072:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1a744 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854079:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1a744 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854086:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1a744 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854098:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1a744 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854109:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788200866.854116:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200866.854119:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1a744 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854126:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782de00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.854129:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1a744 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854137:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1a744 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854148:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1a744 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854154:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1a744 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854167:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.854168:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.854170:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788200866.854209:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.854219:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1a74b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854225:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d8:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.854228:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.854231:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1a74b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854239:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1a74b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854246:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1a74b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854252:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1a74b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854264:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788200866.854271:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200866.854274:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1a74b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854280:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.854284:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1a74b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854291:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1a74b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854308:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1a74b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854315:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1a74b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854343:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.854346:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.854347:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788200866.854386:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.854391:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1a752 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854398:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d7:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.854401:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.854405:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1a752 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854413:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1a752 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854419:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1a752 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854425:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1a752 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854446:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788200866.854453:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200866.854456:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1a752 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854462:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782dc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.854465:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1a752 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854472:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1a752 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854481:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1a752 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854486:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1a752 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854499:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.854500:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.854502:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788200866.854539:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.854544:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bef357a/0x96d0c9b8c9a1a759 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854550:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d6:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.854558:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.854562:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bef357a/0x96d0c9b8c9a1a759 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854571:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bef357a/0x96d0c9b8c9a1a759 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854578:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bef357a/0x96d0c9b8c9a1a759 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854585:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bef357a/0x96d0c9b8c9a1a759 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854597:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788200866.854604:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200866.854607:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bef357a/0x96d0c9b8c9a1a759 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854613:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0054e3a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.854617:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bef357a/0x96d0c9b8c9a1a759 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854624:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bef357a/0x96d0c9b8c9a1a759 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854633:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bef357a/0x96d0c9b8c9a1a759 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854650:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bef357a/0x96d0c9b8c9a1a759 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854663:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.854665:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.854667:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788200866.854708:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.854713:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e2a85b7/0x96d0c9b8c9a1a760 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854721:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d5:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.854723:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.854727:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e2a85b7/0x96d0c9b8c9a1a760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854735:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e2a85b7/0x96d0c9b8c9a1a760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854743:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e2a85b7/0x96d0c9b8c9a1a760 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854749:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e2a85b7/0x96d0c9b8c9a1a760 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854761:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788200866.854772:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200866.854775:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e2a85b7/0x96d0c9b8c9a1a760 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854781:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0054e3200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.854784:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e2a85b7/0x96d0c9b8c9a1a760 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854791:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e2a85b7/0x96d0c9b8c9a1a760 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854801:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e2a85b7/0x96d0c9b8c9a1a760 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854808:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e2a85b7/0x96d0c9b8c9a1a760 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854821:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.854822:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.854824:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788200866.854860:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.854866:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee5d68b2/0x96d0c9b8c9a1a767 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854873:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d4:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.854876:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.854880:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee5d68b2/0x96d0c9b8c9a1a767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854900:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee5d68b2/0x96d0c9b8c9a1a767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854908:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee5d68b2/0x96d0c9b8c9a1a767 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854916:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee5d68b2/0x96d0c9b8c9a1a767 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854928:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788200866.854935:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200866.854938:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee5d68b2/0x96d0c9b8c9a1a767 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854945:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0054e3e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.854948:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee5d68b2/0x96d0c9b8c9a1a767 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854955:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee5d68b2/0x96d0c9b8c9a1a767 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854965:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee5d68b2/0x96d0c9b8c9a1a767 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854973:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee5d68b2/0x96d0c9b8c9a1a767 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.854992:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.854994:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.854996:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788200866.855058:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.855063:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e7bb6e0/0x96d0c9b8c9a1a76e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855070:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d3:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.855073:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.855078:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e7bb6e0/0x96d0c9b8c9a1a76e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855085:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e7bb6e0/0x96d0c9b8c9a1a76e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855092:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e7bb6e0/0x96d0c9b8c9a1a76e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855098:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e7bb6e0/0x96d0c9b8c9a1a76e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855110:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788200866.855115:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200866.855119:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e7bb6e0/0x96d0c9b8c9a1a76e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855135:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0054e3800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.855138:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e7bb6e0/0x96d0c9b8c9a1a76e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855146:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e7bb6e0/0x96d0c9b8c9a1a76e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855155:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e7bb6e0/0x96d0c9b8c9a1a76e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855162:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e7bb6e0/0x96d0c9b8c9a1a76e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855174:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.855175:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.855177:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788200866.855232:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.855236:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9cb5006/0x96d0c9b8c9a1a775 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855244:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d2:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.855246:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.855250:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9cb5006/0x96d0c9b8c9a1a775 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855259:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9cb5006/0x96d0c9b8c9a1a775 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855272:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9cb5006/0x96d0c9b8c9a1a775 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855278:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9cb5006/0x96d0c9b8c9a1a775 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855289:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788200866.855295:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200866.855298:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9cb5006/0x96d0c9b8c9a1a775 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855305:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0054e3600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.855308:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9cb5006/0x96d0c9b8c9a1a775 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855316:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9cb5006/0x96d0c9b8c9a1a775 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855326:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9cb5006/0x96d0c9b8c9a1a775 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855341:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9cb5006/0x96d0c9b8c9a1a775 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855353:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.855359:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.855360:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788200866.855398:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.855403:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e04e8e33/0x96d0c9b8c9a1a77c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855409:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d1:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.855412:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.855417:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e04e8e33/0x96d0c9b8c9a1a77c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855425:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e04e8e33/0x96d0c9b8c9a1a77c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855433:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e04e8e33/0x96d0c9b8c9a1a77c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855439:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e04e8e33/0x96d0c9b8c9a1a77c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855449:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788200866.855455:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200866.855460:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e04e8e33/0x96d0c9b8c9a1a77c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855468:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0054e2c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.855471:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e04e8e33/0x96d0c9b8c9a1a77c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855489:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e04e8e33/0x96d0c9b8c9a1a77c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855499:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e04e8e33/0x96d0c9b8c9a1a77c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855506:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e04e8e33/0x96d0c9b8c9a1a77c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855518:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.855520:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.855521:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788200866.855558:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.855564:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4170119/0x96d0c9b8c9a1a783 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855572:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d0:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.855575:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.855579:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4170119/0x96d0c9b8c9a1a783 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855587:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4170119/0x96d0c9b8c9a1a783 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855593:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4170119/0x96d0c9b8c9a1a783 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855606:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4170119/0x96d0c9b8c9a1a783 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855618:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788200866.855625:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200866.855628:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4170119/0x96d0c9b8c9a1a783 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855636:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0054e3000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.855639:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4170119/0x96d0c9b8c9a1a783 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855647:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4170119/0x96d0c9b8c9a1a783 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855657:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4170119/0x96d0c9b8c9a1a783 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855664:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4170119/0x96d0c9b8c9a1a783 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855676:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.855677:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.855679:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788200866.855716:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.855726:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048853572/0x96d0c9b8c9a1a78a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855734:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cf:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.855736:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.855740:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048853572/0x96d0c9b8c9a1a78a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855748:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048853572/0x96d0c9b8c9a1a78a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855755:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048853572/0x96d0c9b8c9a1a78a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855761:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048853572/0x96d0c9b8c9a1a78a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855772:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788200866.855778:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200866.855781:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048853572/0x96d0c9b8c9a1a78a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855787:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0054e2e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.855791:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048853572/0x96d0c9b8c9a1a78a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855798:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048853572/0x96d0c9b8c9a1a78a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855814:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048853572/0x96d0c9b8c9a1a78a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855821:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048853572/0x96d0c9b8c9a1a78a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855833:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.855835:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.855837:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788200866.855876:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.855882:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ee4d9ae/0x96d0c9b8c9a1a791 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855889:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ce:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.855892:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.855896:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ee4d9ae/0x96d0c9b8c9a1a791 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855904:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ee4d9ae/0x96d0c9b8c9a1a791 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855912:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ee4d9ae/0x96d0c9b8c9a1a791 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855919:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ee4d9ae/0x96d0c9b8c9a1a791 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855940:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788200866.855946:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200866.855950:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ee4d9ae/0x96d0c9b8c9a1a791 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855956:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0054e2200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.855959:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ee4d9ae/0x96d0c9b8c9a1a791 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855967:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ee4d9ae/0x96d0c9b8c9a1a791 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855977:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ee4d9ae/0x96d0c9b8c9a1a791 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855985:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ee4d9ae/0x96d0c9b8c9a1a791 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.855997:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.855998:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.856000:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788200866.856062:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.856067:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040dff313/0x96d0c9b8c9a1a798 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.856074:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cd:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.856082:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.856086:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040dff313/0x96d0c9b8c9a1a798 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.856095:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040dff313/0x96d0c9b8c9a1a798 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.856101:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040dff313/0x96d0c9b8c9a1a798 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.856107:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040dff313/0x96d0c9b8c9a1a798 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.856119:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788200866.856125:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200866.856129:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040dff313/0x96d0c9b8c9a1a798 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.856136:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0054e2000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.856139:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040dff313/0x96d0c9b8c9a1a798 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.856146:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040dff313/0x96d0c9b8c9a1a798 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.856156:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040dff313/0x96d0c9b8c9a1a798 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.856173:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040dff313/0x96d0c9b8c9a1a798 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.856186:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.856187:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.856188:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788200866.856226:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.856232:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083d500c3/0x96d0c9b8c9a1a79f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.856239:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cc:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.856242:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.856246:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083d500c3/0x96d0c9b8c9a1a79f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.856255:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083d500c3/0x96d0c9b8c9a1a79f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.856262:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083d500c3/0x96d0c9b8c9a1a79f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.856269:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083d500c3/0x96d0c9b8c9a1a79f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.856282:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788200866.856294:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200866.856297:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083d500c3/0x96d0c9b8c9a1a79f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.856304:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0054e2800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.856307:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083d500c3/0x96d0c9b8c9a1a79f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.856315:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083d500c3/0x96d0c9b8c9a1a79f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.856325:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083d500c3/0x96d0c9b8c9a1a79f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.856399:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200866.857247:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788200866.857806:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.857813:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f25da42e/0x96d0c9b8c9a1a7a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.857827:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2df:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.857832:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.857837:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f25da42e/0x96d0c9b8c9a1a7a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.857848:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f25da42e/0x96d0c9b8c9a1a7a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.857856:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f25da42e/0x96d0c9b8c9a1a7a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.857869:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f25da42e/0x96d0c9b8c9a1a7a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.857888:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788200866.857934:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.857938:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000847d8716/0x96d0c9b8c9a1a7ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.857945:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2de:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.857948:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.857952:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000847d8716/0x96d0c9b8c9a1a7ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.857959:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000847d8716/0x96d0c9b8c9a1a7ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.857966:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000847d8716/0x96d0c9b8c9a1a7ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.857972:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000847d8716/0x96d0c9b8c9a1a7ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.857987:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788200866.857994:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788200866.857999:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f25da42e/0x96d0c9b8c9a1a7a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858011:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200866.858082:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f25da42e/0x96d0c9b8c9a1a7a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858093:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f25da42e/0x96d0c9b8c9a1a7a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858107:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f25da42e/0x96d0c9b8c9a1a7a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858115:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f25da42e/0x96d0c9b8c9a1a7a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858128:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200866.858132:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000847d8716/0x96d0c9b8c9a1a7ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858138:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200866.858140:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000847d8716/0x96d0c9b8c9a1a7ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858147:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000847d8716/0x96d0c9b8c9a1a7ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858157:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000847d8716/0x96d0c9b8c9a1a7ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858171:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000847d8716/0x96d0c9b8c9a1a7ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858184:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.858188:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.858190:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788200866.858230:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.858235:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1a7b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858243:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2dd:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.858245:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.858249:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1a7b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858257:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1a7b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858265:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1a7b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858272:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1a7b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858284:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788200866.858319:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.858342:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1a7bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858350:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2dc:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.858353:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.858356:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1a7bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858365:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1a7bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858371:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1a7bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858378:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1a7bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858390:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788200866.858397:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788200866.858400:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1a7b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858406:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064eda00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200866.858409:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1a7b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858416:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1a7b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858436:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1a7b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858442:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1a7b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858454:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200866.858457:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1a7bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858463:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200866.858467:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1a7bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858474:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1a7bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858484:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1a7bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858491:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1a7bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858501:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.858503:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.858509:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788200866.858548:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.858553:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1a7c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858560:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2db:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.858563:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.858566:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1a7c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858574:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1a7c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858580:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1a7c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858587:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1a7c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858599:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788200866.858605:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200866.858609:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1a7c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858615:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200866.858618:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1a7c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858636:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1a7c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858646:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1a7c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858652:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1a7c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858665:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.858667:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.858668:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788200866.858704:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.858709:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1a7c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858717:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2da:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.858720:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.858724:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1a7c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858733:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1a7c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858741:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1a7c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858753:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1a7c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858764:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788200866.858770:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200866.858773:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1a7c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858780:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200866.858783:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1a7c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858791:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1a7c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858801:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1a7c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858808:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1a7c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858819:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.858821:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.858822:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788200866.858856:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.858866:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1a7d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858874:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d9:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.858877:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.858881:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1a7d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858890:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1a7d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858898:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1a7d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858905:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1a7d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858916:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788200866.858921:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200866.858924:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1a7d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858931:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100031400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200866.858934:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1a7d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858942:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1a7d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858956:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1a7d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858964:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1a7d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.858976:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.858978:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.858979:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788200866.859009:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.859036:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1a7d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859044:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d8:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.859047:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.859052:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1a7d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859060:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1a7d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859069:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1a7d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859076:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1a7d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859096:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788200866.859102:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200866.859105:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1a7d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859112:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100031200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200866.859115:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1a7d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859122:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1a7d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859133:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1a7d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859141:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1a7d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859152:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.859154:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.859155:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788200866.859187:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.859192:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1a7de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859200:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d7:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.859207:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.859212:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1a7de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859221:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1a7de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859229:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1a7de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859237:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1a7de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859247:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788200866.859252:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200866.859255:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1a7de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859261:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100031e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200866.859264:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1a7de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859271:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1a7de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859279:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1a7de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859295:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1a7de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859308:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.859310:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.859312:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788200866.859366:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.859370:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1a7e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859378:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d6:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.859381:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.859385:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1a7e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859393:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1a7e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859401:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1a7e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859407:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1a7e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859418:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788200866.859425:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200866.859433:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1a7e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859439:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200866.859443:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1a7e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859449:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1a7e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859457:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1a7e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859463:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1a7e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859474:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.859477:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.859478:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788200866.859515:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.859519:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1a7ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859527:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d5:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.859529:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.859532:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1a7ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859551:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1a7ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859558:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1a7ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859563:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1a7ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859576:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788200866.859581:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200866.859585:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1a7ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859591:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200866.859594:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1a7ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859601:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1a7ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859611:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1a7ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859617:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1a7ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859636:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.859638:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.859639:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788200866.859678:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.859682:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1a7f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859689:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d4:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.859691:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.859695:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1a7f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859703:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1a7f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859710:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1a7f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859716:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1a7f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859728:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788200866.859735:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200866.859738:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1a7f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859753:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200866.859757:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1a7f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859763:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1a7f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859774:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1a7f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859780:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1a7f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859794:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.859796:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.859797:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788200866.859836:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.859841:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032bc5d6a/0x96d0c9b8c9a1a7fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859848:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d3:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.859851:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.859854:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032bc5d6a/0x96d0c9b8c9a1a7fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859862:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032bc5d6a/0x96d0c9b8c9a1a7fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859873:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032bc5d6a/0x96d0c9b8c9a1a7fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859878:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032bc5d6a/0x96d0c9b8c9a1a7fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859889:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788200866.859895:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200866.859899:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032bc5d6a/0x96d0c9b8c9a1a7fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859904:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6c600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200866.859908:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032bc5d6a/0x96d0c9b8c9a1a7fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859913:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032bc5d6a/0x96d0c9b8c9a1a7fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859923:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032bc5d6a/0x96d0c9b8c9a1a7fa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859930:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032bc5d6a/0x96d0c9b8c9a1a7fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859943:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.859948:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.859950:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788200866.859985:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.859991:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005258d08c/0x96d0c9b8c9a1a801 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.859997:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d2:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.860000:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.860003:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005258d08c/0x96d0c9b8c9a1a801 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860011:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005258d08c/0x96d0c9b8c9a1a801 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860039:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005258d08c/0x96d0c9b8c9a1a801 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860046:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005258d08c/0x96d0c9b8c9a1a801 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860058:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788200866.860063:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200866.860067:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005258d08c/0x96d0c9b8c9a1a801 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860073:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6d000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200866.860077:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005258d08c/0x96d0c9b8c9a1a801 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860094:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005258d08c/0x96d0c9b8c9a1a801 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860105:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005258d08c/0x96d0c9b8c9a1a801 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860112:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005258d08c/0x96d0c9b8c9a1a801 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860123:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.860125:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.860126:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788200866.860159:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.860164:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5c7c962/0x96d0c9b8c9a1a808 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860171:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d1:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.860174:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.860178:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5c7c962/0x96d0c9b8c9a1a808 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860187:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5c7c962/0x96d0c9b8c9a1a808 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860194:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5c7c962/0x96d0c9b8c9a1a808 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860207:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5c7c962/0x96d0c9b8c9a1a808 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860218:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788200866.860224:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200866.860227:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5c7c962/0x96d0c9b8c9a1a808 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860234:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6d600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200866.860237:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5c7c962/0x96d0c9b8c9a1a808 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860245:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5c7c962/0x96d0c9b8c9a1a808 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860254:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5c7c962/0x96d0c9b8c9a1a808 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860261:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5c7c962/0x96d0c9b8c9a1a808 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860273:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.860274:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.860276:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788200866.860312:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.860323:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a316510/0x96d0c9b8c9a1a80f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860342:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d0:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.860345:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.860349:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a316510/0x96d0c9b8c9a1a80f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860358:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a316510/0x96d0c9b8c9a1a80f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860365:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a316510/0x96d0c9b8c9a1a80f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860370:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a316510/0x96d0c9b8c9a1a80f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860382:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788200866.860387:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200866.860391:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a316510/0x96d0c9b8c9a1a80f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860397:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6da00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200866.860400:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a316510/0x96d0c9b8c9a1a80f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860408:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a316510/0x96d0c9b8c9a1a80f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860424:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a316510/0x96d0c9b8c9a1a80f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860430:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a316510/0x96d0c9b8c9a1a80f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860443:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.860445:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.860447:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788200866.860487:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.860492:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbdd92a8/0x96d0c9b8c9a1a816 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860500:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cf:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.860502:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.860507:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbdd92a8/0x96d0c9b8c9a1a816 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860515:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbdd92a8/0x96d0c9b8c9a1a816 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860524:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbdd92a8/0x96d0c9b8c9a1a816 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860530:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbdd92a8/0x96d0c9b8c9a1a816 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860555:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788200866.860561:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200866.860564:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbdd92a8/0x96d0c9b8c9a1a816 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860571:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6ca00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200866.860574:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbdd92a8/0x96d0c9b8c9a1a816 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860582:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbdd92a8/0x96d0c9b8c9a1a816 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860591:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbdd92a8/0x96d0c9b8c9a1a816 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860598:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbdd92a8/0x96d0c9b8c9a1a816 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860610:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.860612:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.860614:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788200866.860649:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.860655:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000757562ee/0x96d0c9b8c9a1a81d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.860662:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ce:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.860671:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200866.860854:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200866.861059:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.861564:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083d500c3/0x96d0c9b8c9a1a79f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.861585:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.861587:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.861589:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788200866.861656:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.861662:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043e97e1d/0x96d0c9b8c9a1a824 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.861671:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cb:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.861674:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.861679:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043e97e1d/0x96d0c9b8c9a1a824 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.861702:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043e97e1d/0x96d0c9b8c9a1a824 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.861711:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043e97e1d/0x96d0c9b8c9a1a824 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.861718:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043e97e1d/0x96d0c9b8c9a1a824 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.861734:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788200866.861770:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.861775:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f756d36a/0x96d0c9b8c9a1a82b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.861782:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ca:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.861785:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.861788:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f756d36a/0x96d0c9b8c9a1a82b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.861796:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f756d36a/0x96d0c9b8c9a1a82b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.861802:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f756d36a/0x96d0c9b8c9a1a82b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.861819:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f756d36a/0x96d0c9b8c9a1a82b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.861831:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788200866.861867:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.861872:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fce99f5c/0x96d0c9b8c9a1a832 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.861879:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c9:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.861881:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.861885:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fce99f5c/0x96d0c9b8c9a1a832 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.861893:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fce99f5c/0x96d0c9b8c9a1a832 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.861900:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fce99f5c/0x96d0c9b8c9a1a832 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.861907:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fce99f5c/0x96d0c9b8c9a1a832 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.861918:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788200866.861950:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.861955:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042b68f3c/0x96d0c9b8c9a1a839 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.861968:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c8:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.861971:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.861975:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042b68f3c/0x96d0c9b8c9a1a839 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.861984:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042b68f3c/0x96d0c9b8c9a1a839 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.861991:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042b68f3c/0x96d0c9b8c9a1a839 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.861998:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042b68f3c/0x96d0c9b8c9a1a839 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862013:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1788200866.862049:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788200866.862053:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043e97e1d/0x96d0c9b8c9a1a824 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862061:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0054e2a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.862065:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043e97e1d/0x96d0c9b8c9a1a824 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862072:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043e97e1d/0x96d0c9b8c9a1a824 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862096:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043e97e1d/0x96d0c9b8c9a1a824 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862103:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043e97e1d/0x96d0c9b8c9a1a824 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862117:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788200866.862120:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f756d36a/0x96d0c9b8c9a1a82b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862127:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0054e2400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.862130:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f756d36a/0x96d0c9b8c9a1a82b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862137:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f756d36a/0x96d0c9b8c9a1a82b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862146:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f756d36a/0x96d0c9b8c9a1a82b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862152:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f756d36a/0x96d0c9b8c9a1a82b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862163:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788200866.862166:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fce99f5c/0x96d0c9b8c9a1a832 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862178:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0054e2600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.862181:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fce99f5c/0x96d0c9b8c9a1a832 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862189:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fce99f5c/0x96d0c9b8c9a1a832 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862199:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fce99f5c/0x96d0c9b8c9a1a832 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862206:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fce99f5c/0x96d0c9b8c9a1a832 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862220:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200866.862223:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042b68f3c/0x96d0c9b8c9a1a839 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862228:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0054e3400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.862232:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042b68f3c/0x96d0c9b8c9a1a839 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862238:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042b68f3c/0x96d0c9b8c9a1a839 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862246:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042b68f3c/0x96d0c9b8c9a1a839 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862258:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042b68f3c/0x96d0c9b8c9a1a839 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862272:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.862274:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.862275:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788200866.862315:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.862319:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021983fdf/0x96d0c9b8c9a1a840 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862337:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c7:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.862341:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.862344:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021983fdf/0x96d0c9b8c9a1a840 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862353:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021983fdf/0x96d0c9b8c9a1a840 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862361:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021983fdf/0x96d0c9b8c9a1a840 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862368:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021983fdf/0x96d0c9b8c9a1a840 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862379:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788200866.862391:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200866.862395:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021983fdf/0x96d0c9b8c9a1a840 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862401:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0054e3c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.862404:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021983fdf/0x96d0c9b8c9a1a840 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862412:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021983fdf/0x96d0c9b8c9a1a840 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862422:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021983fdf/0x96d0c9b8c9a1a840 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862429:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021983fdf/0x96d0c9b8c9a1a840 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862440:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.862442:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.862443:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788200866.862482:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.862486:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa16e4c0/0x96d0c9b8c9a1a847 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862493:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c6:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.862496:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.862499:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa16e4c0/0x96d0c9b8c9a1a847 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862518:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa16e4c0/0x96d0c9b8c9a1a847 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862527:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa16e4c0/0x96d0c9b8c9a1a847 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862534:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa16e4c0/0x96d0c9b8c9a1a847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862545:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788200866.862552:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200866.862555:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa16e4c0/0x96d0c9b8c9a1a847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862561:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0079ada00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.862564:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa16e4c0/0x96d0c9b8c9a1a847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862570:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa16e4c0/0x96d0c9b8c9a1a847 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862579:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa16e4c0/0x96d0c9b8c9a1a847 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862586:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa16e4c0/0x96d0c9b8c9a1a847 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862603:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.862605:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.862607:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788200866.862646:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.862650:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050e1005d/0x96d0c9b8c9a1a84e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862657:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c5:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.862659:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.862663:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050e1005d/0x96d0c9b8c9a1a84e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862671:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050e1005d/0x96d0c9b8c9a1a84e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862678:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050e1005d/0x96d0c9b8c9a1a84e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862684:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050e1005d/0x96d0c9b8c9a1a84e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862694:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788200866.862700:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200866.862703:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050e1005d/0x96d0c9b8c9a1a84e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862720:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0079ad400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.862723:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050e1005d/0x96d0c9b8c9a1a84e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862730:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050e1005d/0x96d0c9b8c9a1a84e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862741:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050e1005d/0x96d0c9b8c9a1a84e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862748:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050e1005d/0x96d0c9b8c9a1a84e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862760:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.862761:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.862763:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788200866.862802:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.862807:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1a855 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862814:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c4:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.862817:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.862820:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1a855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862829:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1a855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862842:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1a855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862848:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1a855 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862860:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788200866.862866:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200866.862869:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1a855 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862875:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0079ac600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.862878:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1a855 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862884:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1a855 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862894:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1a855 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862901:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1a855 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862914:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.862921:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.862923:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788200866.862962:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.862967:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0362657/0x96d0c9b8c9a1a85c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862974:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c3:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.862977:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.862981:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0362657/0x96d0c9b8c9a1a85c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862991:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0362657/0x96d0c9b8c9a1a85c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.862999:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0362657/0x96d0c9b8c9a1a85c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.863007:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0362657/0x96d0c9b8c9a1a85c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.863041:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788200866.863047:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200866.863051:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0362657/0x96d0c9b8c9a1a85c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.863058:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0079acc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.863062:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0362657/0x96d0c9b8c9a1a85c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.863080:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0362657/0x96d0c9b8c9a1a85c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.863090:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0362657/0x96d0c9b8c9a1a85c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.863098:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0362657/0x96d0c9b8c9a1a85c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.863113:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.863115:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.863116:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788200866.863156:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788200866.863161:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c001ff0/0x96d0c9b8c9a1a863 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.863168:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c2:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:1.0:1788200866.863171:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788200866.863175:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c001ff0/0x96d0c9b8c9a1a863 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.863184:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c001ff0/0x96d0c9b8c9a1a863 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.863192:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c001ff0/0x96d0c9b8c9a1a863 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.863205:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c001ff0/0x96d0c9b8c9a1a863 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.863216:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788200866.863222:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200866.863226:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c001ff0/0x96d0c9b8c9a1a863 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.863232:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0079ac200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200866.863234:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c001ff0/0x96d0c9b8c9a1a863 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.863241:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c001ff0/0x96d0c9b8c9a1a863 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.863251:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c001ff0/0x96d0c9b8c9a1a863 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.863257:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c001ff0/0x96d0c9b8c9a1a863 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.863268:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.863270:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.863271:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788200866.863510:0:26208:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:674 00000100:00100000:1.0:1788200866.863603:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:85250:x1875060715034880:12345-0@lo:5:osp-pre-1-0.0 Request processed in 25876us (32118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200866.863613:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5854 00010000:00010000:3.0:1788200866.863804:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788200866.863874:0:85250:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140296a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85250:1875060715034880:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788200866.863889:0:85250:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x2e1:0x0] from OST, last_created [0x2c0000401:0x2e1:0x0]last_used is [0x2c0000401:0x2a2:0x0] 00000100:00100000:3.0:1788200866.863958:0:85250:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140295180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85250:1875060715035264:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788200866.863988:0:85250:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200866.864035:0:85250:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005dfd900 going to sleep for 11 seconds 00000100:00100000:3.0:1788200866.864052:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715035264 00000100:00100000:3.0:1788200866.864058:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715035264 00000100:00100000:3.0:1788200866.864091:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5856 00000100:00100000:3.0:1788200866.864099:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140297800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:85250:x1875060715035264:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788200866.864131:0:26203:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 738 00000100:00100000:3.0:1788200866.865357:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140297800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:85250:x1875060715035264:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1255us (1364us total) trans 4294969449 rc 0/0 00000100:00100000:3.0:1788200866.865367:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5856 00000100:00100000:3.0:1788200866.865439:0:85250:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140295180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85250:1875060715035264:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788200866.865451:0:85250:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x2e1:0x0]-[0x2c0000401:0x301:0x0] 00010000:00010000:3.0:1788200866.865467:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200866.865476:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788200866.865744:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715035136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788200866.865781:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788200866.866474:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000757562ee/0x96d0c9b8c9a1a81d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.866493:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000757562ee/0x96d0c9b8c9a1a81d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.866505:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000757562ee/0x96d0c9b8c9a1a81d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.866513:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000757562ee/0x96d0c9b8c9a1a81d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200866.866847:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715035136 00000100:00100000:3.0:1788200866.866854:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715035136 00000100:00100000:3.0:1788200866.866895:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2080 00000100:00100000:3.0:1788200866.866903:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715035136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788200866.866921:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200866.866969:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715035136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200866.866975:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2080 00000100:00100000:3.0:1788200866.867033:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715035136:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788200866.867083:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788200866.867191:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.867197:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000801c7151/0x96d0c9b8c9a1a86a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.867208:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cd:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.867212:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.867217:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000801c7151/0x96d0c9b8c9a1a86a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.867226:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000801c7151/0x96d0c9b8c9a1a86a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.867234:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000801c7151/0x96d0c9b8c9a1a86a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.867252:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000801c7151/0x96d0c9b8c9a1a86a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1788200866.867366:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788200866.867514:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788200866.867521:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000757562ee/0x96d0c9b8c9a1a81d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.867529:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6dc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200866.867534:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000757562ee/0x96d0c9b8c9a1a81d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.867543:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000757562ee/0x96d0c9b8c9a1a81d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.867560:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000757562ee/0x96d0c9b8c9a1a81d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.867567:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000757562ee/0x96d0c9b8c9a1a81d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.867585:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788200866.867588:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000801c7151/0x96d0c9b8c9a1a86a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.867594:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6c000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200866.867602:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000801c7151/0x96d0c9b8c9a1a86a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.867610:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000801c7151/0x96d0c9b8c9a1a86a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.867619:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000801c7151/0x96d0c9b8c9a1a86a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.867628:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200866.867630:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200866.867632:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.867686:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788200866.867691:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000801c7151/0x96d0c9b8c9a1a86a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788200866.867745:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.867750:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000135e105d/0x96d0c9b8c9a1a871 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.867758:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cc:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.867762:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.867767:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000135e105d/0x96d0c9b8c9a1a871 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.867775:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000135e105d/0x96d0c9b8c9a1a871 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.867783:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000135e105d/0x96d0c9b8c9a1a871 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.867791:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000135e105d/0x96d0c9b8c9a1a871 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.867831:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200866.867836:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000135e105d/0x96d0c9b8c9a1a871 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.867842:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6ce00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200866.867850:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000135e105d/0x96d0c9b8c9a1a871 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.867857:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000135e105d/0x96d0c9b8c9a1a871 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.867867:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000135e105d/0x96d0c9b8c9a1a871 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.867875:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200866.867876:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200866.867878:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.867931:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788200866.867936:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000135e105d/0x96d0c9b8c9a1a871 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788200866.867980:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.867986:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e9780d2/0x96d0c9b8c9a1a878 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.867993:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cb:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.867995:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.867999:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e9780d2/0x96d0c9b8c9a1a878 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.868007:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e9780d2/0x96d0c9b8c9a1a878 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.868068:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e9780d2/0x96d0c9b8c9a1a878 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.868076:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e9780d2/0x96d0c9b8c9a1a878 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.868260:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200866.868266:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e9780d2/0x96d0c9b8c9a1a878 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.868274:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6d800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200866.868278:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e9780d2/0x96d0c9b8c9a1a878 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.868285:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e9780d2/0x96d0c9b8c9a1a878 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.868295:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e9780d2/0x96d0c9b8c9a1a878 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.868303:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200866.868310:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200866.868313:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.868766:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788200866.868771:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e9780d2/0x96d0c9b8c9a1a878 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788200866.868846:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.868852:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a24fb372/0x96d0c9b8c9a1a87f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.868860:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ca:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.868864:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.868868:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a24fb372/0x96d0c9b8c9a1a87f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.868877:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a24fb372/0x96d0c9b8c9a1a87f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.868885:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a24fb372/0x96d0c9b8c9a1a87f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.868891:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a24fb372/0x96d0c9b8c9a1a87f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.868922:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200866.868927:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a24fb372/0x96d0c9b8c9a1a87f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.868934:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6c800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200866.868937:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a24fb372/0x96d0c9b8c9a1a87f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.868944:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a24fb372/0x96d0c9b8c9a1a87f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.868955:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a24fb372/0x96d0c9b8c9a1a87f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.868963:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200866.868965:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200866.868967:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.872810:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788200866.872826:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a24fb372/0x96d0c9b8c9a1a87f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788200866.872959:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.872967:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c41fc41/0x96d0c9b8c9a1a886 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.872992:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c9:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.872996:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.873003:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c41fc41/0x96d0c9b8c9a1a886 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.873067:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c41fc41/0x96d0c9b8c9a1a886 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.873078:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c41fc41/0x96d0c9b8c9a1a886 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.873087:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c41fc41/0x96d0c9b8c9a1a886 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.874035:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788200866.874043:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c41fc41/0x96d0c9b8c9a1a886 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.874052:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6d200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200866.874056:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c41fc41/0x96d0c9b8c9a1a886 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.874064:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c41fc41/0x96d0c9b8c9a1a886 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200866.874081:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c41fc41/0x96d0c9b8c9a1a886 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200866.874230:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.874232:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.874234:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.878656:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788200866.878671:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c41fc41/0x96d0c9b8c9a1a886 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788200866.878815:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.878823:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047fe6d29/0x96d0c9b8c9a1a88d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.878838:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c8:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.878843:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.878849:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047fe6d29/0x96d0c9b8c9a1a88d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.878873:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047fe6d29/0x96d0c9b8c9a1a88d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.878883:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047fe6d29/0x96d0c9b8c9a1a88d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.878891:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047fe6d29/0x96d0c9b8c9a1a88d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.879269:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200866.879277:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047fe6d29/0x96d0c9b8c9a1a88d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.879285:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6de00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200866.879290:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047fe6d29/0x96d0c9b8c9a1a88d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.879299:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047fe6d29/0x96d0c9b8c9a1a88d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.879324:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047fe6d29/0x96d0c9b8c9a1a88d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200866.879344:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200866.879346:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200866.879348:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.879596:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788200866.879602:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047fe6d29/0x96d0c9b8c9a1a88d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788200866.879668:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.879674:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038bce239/0x96d0c9b8c9a1a894 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.879682:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c7:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.879686:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.879690:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038bce239/0x96d0c9b8c9a1a894 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.879699:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038bce239/0x96d0c9b8c9a1a894 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.879717:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038bce239/0x96d0c9b8c9a1a894 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.879724:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038bce239/0x96d0c9b8c9a1a894 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.879736:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788200866.879774:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.879780:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2964ff0/0x96d0c9b8c9a1a89b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.879787:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c6:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.879791:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.879795:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2964ff0/0x96d0c9b8c9a1a89b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.879803:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2964ff0/0x96d0c9b8c9a1a89b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.879810:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2964ff0/0x96d0c9b8c9a1a89b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.879817:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2964ff0/0x96d0c9b8c9a1a89b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.879841:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788200866.879874:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.879878:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a4f610d/0x96d0c9b8c9a1a8a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.879886:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c5:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.879888:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.879892:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a4f610d/0x96d0c9b8c9a1a8a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.879901:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a4f610d/0x96d0c9b8c9a1a8a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.879908:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a4f610d/0x96d0c9b8c9a1a8a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.879915:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a4f610d/0x96d0c9b8c9a1a8a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.879928:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788200866.879934:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788200866.879938:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038bce239/0x96d0c9b8c9a1a894 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.879944:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6cc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200866.879952:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038bce239/0x96d0c9b8c9a1a894 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.879960:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038bce239/0x96d0c9b8c9a1a894 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.879971:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038bce239/0x96d0c9b8c9a1a894 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.879978:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038bce239/0x96d0c9b8c9a1a894 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.879992:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788200866.879995:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2964ff0/0x96d0c9b8c9a1a89b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880002:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6d400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200866.880005:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2964ff0/0x96d0c9b8c9a1a89b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880012:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2964ff0/0x96d0c9b8c9a1a89b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880050:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2964ff0/0x96d0c9b8c9a1a89b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880057:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2964ff0/0x96d0c9b8c9a1a89b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880075:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200866.880079:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a4f610d/0x96d0c9b8c9a1a8a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880085:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6c400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200866.880088:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a4f610d/0x96d0c9b8c9a1a8a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880165:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a4f610d/0x96d0c9b8c9a1a8a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880176:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a4f610d/0x96d0c9b8c9a1a8a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880183:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a4f610d/0x96d0c9b8c9a1a8a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880196:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.880198:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.880199:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788200866.880260:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.880265:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d36937de/0x96d0c9b8c9a1a8a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880272:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c4:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.880280:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.880285:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d36937de/0x96d0c9b8c9a1a8a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880293:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d36937de/0x96d0c9b8c9a1a8a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880300:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d36937de/0x96d0c9b8c9a1a8a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880306:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d36937de/0x96d0c9b8c9a1a8a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880317:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788200866.880324:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200866.880337:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d36937de/0x96d0c9b8c9a1a8a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880344:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6c200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200866.880346:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d36937de/0x96d0c9b8c9a1a8a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880353:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d36937de/0x96d0c9b8c9a1a8a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880362:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d36937de/0x96d0c9b8c9a1a8a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880380:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d36937de/0x96d0c9b8c9a1a8a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880393:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.880395:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.880397:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788200866.880437:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.880441:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1a8b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880448:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c3:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.880451:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.880454:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1a8b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880462:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1a8b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880469:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1a8b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880475:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1a8b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880486:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788200866.880491:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200866.880499:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1a8b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880506:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100031400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200866.880509:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1a8b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880516:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1a8b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880526:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1a8b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880532:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1a8b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880545:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.880547:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.880548:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788200866.880585:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200866.880590:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1a8b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880597:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c2:0x0].0x0 since=3718s v=(0 0) 00010000:00010000:2.0:1788200866.880600:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200866.880604:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1a8b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880623:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1a8b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880631:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1a8b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880638:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1a8b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880650:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788200866.880656:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200866.880659:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1a8b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880665:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200866.880668:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1a8b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880675:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1a8b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880684:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1a8b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880691:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1a8b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200866.880711:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.880712:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200866.880714:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200866.881192:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200866.881199:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200866.883338:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788200866.884477:0:8449:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:176 00000100:00100000:2.0:1788200866.884623:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:85248:x1875060715035008:12345-0@lo:5:osp-pre-0-0.0 Request processed in 42977us (52700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200866.884634:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5855 00000100:00100000:1.0:1788200866.894289:0:85248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85248:1875060715035008:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788200866.894312:0:85248:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x2e1:0x0] from OST, last_created [0x280000401:0x2e1:0x0]last_used is [0x280000401:0xb0:0x0] 00000100:00100000:1.0:1788200866.894411:0:85248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125642d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85248:1875060715035520:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788200866.894468:0:85248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200866.894497:0:85248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10bd326c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788200866.894516:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788200866.894527:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715035392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788200866.894550:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200866.894578:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715035520 00000100:00100000:1.0:1788200866.894583:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715035520 00000100:00100000:1.0:1788200866.894629:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5857 00000100:00100000:1.0:1788200866.894639:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125640380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:85248:x1875060715035520:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788200866.894678:0:26214:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 738 00000100:00100000:0.0:1788200866.896087:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715035392 00000100:00100000:0.0:1788200866.896113:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715035392 00000100:00100000:0.0:1788200866.896157:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2081 00000100:00100000:0.0:1788200866.896165:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715035392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788200866.896184:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 896 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200866.896245:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715035392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (1694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200866.896252:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2081 00000100:00100000:1.0:1788200866.901920:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125640380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:85248:x1875060715035520:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7275us (7445us total) trans 4294969449 rc 0/0 00000100:00100000:1.0:1788200866.901931:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5857 00000100:00100000:1.0:1788200866.902002:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715035392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788200866.903622:0:85248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125642d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85248:1875060715035520:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788200866.903645:0:85248:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x2e1:0x0]-[0x280000401:0x301:0x0] 00000020:00000004:3.0:1788200867.035702:0:85568:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788200867.035990:0:85568:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788200867.599499:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788200867.669912:0:75739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000004:2.0:1788200868.119979:0:85618:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788200868.120574:0:85618:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788200868.627259:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200869.647343:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200870.671291:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788200870.707003:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200870.707353:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695331840 00000100:00100000:1.0:1788200870.707364:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695331840 00000100:00100000:1.0:1788200870.707607:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1088 00000100:00100000:1.0:1788200870.707618:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:65300:x1875060695331840:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1788200870.707640:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788200870.707667:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079acc00/0x96d0c9b8c9a1a8be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786562 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200870.707751:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ac600/0x96d0c9b8c9a1a8c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200870.707766:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ac600/0x96d0c9b8c9a1a8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200870.707781:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ac600/0x96d0c9b8c9a1a8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788200870.707831:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788200870.707835:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788200870.707872:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ac600/0x96d0c9b8c9a1a8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200870.707899:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079acc00/0x96d0c9b8c9a1a8be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786562 expref: 8 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200870.707918:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ac600/0x96d0c9b8c9a1a8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786562 expref: 7 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200870.707940:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12f34f300) 00010000:00010000:1.0:1788200870.707943:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788200870.707947:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0079ac600, rc 0) 00000100:00100000:1.0:1788200870.708009:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+7:65300:x1875060695331840:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 392us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200870.708061:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1088 00000100:00080000:0.0:1788200870.708574:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788200870.721103:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200870.721227:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695331968 00000100:00100000:3.0:1788200870.721248:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695331968 00000100:00100000:3.0:1788200870.721326:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1089 00000100:00100000:3.0:1788200870.721337:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+7:65300:x1875060695331968:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:3.0:1788200870.721377:0:66314:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444974592 avail 1298735104 00000100:00100000:3.0:1788200870.721457:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+7:65300:x1875060695331968:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 121us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200870.721464:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1089 00000100:00100000:3.0:1788200870.726109:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200870.726908:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695332096 00000100:00100000:0.0:1788200870.726921:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695332096 00000100:00100000:2.0:1788200870.727117:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1090 00000100:00100000:2.0:1788200870.727129:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:65300:x1875060695332096:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:2.0:1788200870.727165:0:66757:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:2.0:1788200870.727271:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:65300:x1875060695332096:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 136us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200870.727287:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1090 00000100:00080000:1.0:1788200870.729712:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788200870.732503:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200870.733146:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695332224 00000100:00100000:2.0:1788200870.733157:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695332224 00000100:00100000:2.0:1788200870.733202:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5858 00000100:00100000:2.0:1788200870.733211:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2399:x1875060695332224:12345-192.168.201.20@tcp:8:lfs.0 00010000:00080000:2.0:1788200870.733259:0:26201:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp t0 exp 0000000000000000 cur 3722 last 0 00000020:00000080:2.0:1788200870.733642:0:26201:0:(genops.c:1385:class_connect()) connect: client 4292087e-fa00-4621-b681-837afc99ae35, cookie 0x96d0c9b8c9a1a8cc 00002000:00100000:2.0:1788200870.733658:0:26201:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4292087e-fa00-4621-b681-837afc99ae35/ffff8dc13339f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788200870.733676:0:26201:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788200870.733757:0:26201:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788200870.733792:0:26201:0:(import.c:65:import_set_state_nolock()) ffff8dc109815800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788200870.733907:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4292087e-fa00-4621-b681-837afc99ae35+6:2399:x1875060695332224:12345-192.168.201.20@tcp:8:lfs.0 Request processed in 694us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200870.733916:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5858 00000100:00100000:3.0:1788200870.746325:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200870.746555:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695332352 00000100:00100000:1.0:1788200870.746567:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695332352 00000100:00100000:1.0:1788200870.746646:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2082 00000100:00100000:1.0:1788200870.746657:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120022680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+6:65300:x1875060695332352:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:1.0:1788200870.746682:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200870.746752:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120022680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+6:65300:x1875060695332352:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 97us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200870.746759:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2082 00000100:00080000:0.0:1788200870.746832:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788200870.751598:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200870.751740:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695332480 00000100:00100000:1.0:1788200870.751749:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695332480 00000100:00100000:1.0:1788200870.751839:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5859 00000100:00100000:1.0:1788200870.751848:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120020e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2399:x1875060695332480:12345-192.168.201.20@tcp:8:lfs.0 00010000:00080000:1.0:1788200870.751884:0:26209:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp t0 exp 0000000000000000 cur 3722 last 0 00000020:00000080:1.0:1788200870.751916:0:26209:0:(genops.c:1385:class_connect()) connect: client 4292087e-fa00-4621-b681-837afc99ae35, cookie 0x96d0c9b8c9a1a8d3 00002000:00100000:1.0:1788200870.751927:0:26209:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4292087e-fa00-4621-b681-837afc99ae35/ffff8dc137d33800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788200870.751945:0:26209:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788200870.752010:0:26209:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788200870.752090:0:26209:0:(import.c:65:import_set_state_nolock()) ffff8dc137d31800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788200870.752155:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120020e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:4292087e-fa00-4621-b681-837afc99ae35+6:2399:x1875060695332480:12345-192.168.201.20@tcp:8:lfs.0 Request processed in 306us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200870.752162:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5859 00000100:00100000:3.0:1788200870.768624:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200870.768734:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695332608 00000100:00100000:0.0:1788200870.768745:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695332608 00000100:00100000:0.0:1788200870.768821:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2083 00000100:00100000:0.0:1788200870.768832:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+6:65300:x1875060695332608:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:0.0:1788200870.768858:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200870.768929:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+6:65300:x1875060695332608:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 98us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200870.768937:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2083 00000100:00080000:1.0:1788200870.769209:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788200871.247659:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788200871.247692:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715035648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788200871.247798:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200871.249406:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715035648 00000100:00100000:0.0:1788200871.249426:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715035648 00000100:00080000:2.0:1788200871.249517:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788200871.249542:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2084 00000100:00100000:0.0:1788200871.249569:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715035648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788200871.249605:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200871.249630:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788200871.249653:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715035776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788200871.249700:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715035648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 145us (1901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200871.249727:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200871.249733:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2084 00000100:00100000:2.0:1788200871.249819:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715035648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788200871.275455:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715035776 00000100:00100000:0.0:1788200871.275484:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715035776 00000100:00100000:0.0:1788200871.276010:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2085 00000100:00100000:0.0:1788200871.276052:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715035776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788200871.276093:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200871.276525:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715035776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 475us (26790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200871.276539:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2085 00000100:00100000:1.0:1788200871.276683:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715035776:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788200871.285139:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788200871.381451:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200871.381519:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200871.381561:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200871.381605:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200871.381640:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695333120 00000100:00100000:2.0:1788200871.381641:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200871.381652:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695333120 00000100:00100000:2.0:1788200871.381667:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695332864 00000100:00100000:2.0:1788200871.381672:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695332864 00000100:00100000:1.0:1788200871.381697:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695333248 00000100:00100000:1.0:1788200871.381702:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695333248 00000100:00100000:2.0:1788200871.381707:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695332992 00000100:00100000:2.0:1788200871.381712:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695332992 00000100:00100000:1.0:1788200871.381734:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2573 00000100:00100000:2.0:1788200871.381739:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1076 00000100:00100000:1.0:1788200871.381747:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695333120:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788200871.381752:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+7:2400:x1875060695332864:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200871.381843:0:85234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695332736 00000100:00100000:3.0:1788200871.381848:0:85234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695332736 00000100:00100000:0.0:1788200871.381878:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2574 00000100:00100000:0.0:1788200871.381890:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695333248:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200871.381894:0:85234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 74 00000100:00100000:2.0:1788200871.382066:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+7:2400:x1875060695332864:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 318us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200871.382073:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1076 00000100:00100000:2.0:1788200871.382090:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1077 00000100:00100000:2.0:1788200871.382095:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695332992:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200871.382148:0:85234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2400:x1875060695332736:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788200871.386142:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695333120:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 4388us (4611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200871.386156:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2573 00000100:00100000:0.0:1788200871.388088:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695333248:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 6195us (6440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200871.388098:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2574 00000100:00100000:2.0:1788200871.389241:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695332992:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 7141us (7632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200871.389260:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1077 00000100:00100000:3.0:1788200871.399193:0:85234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2400:x1875060695332736:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 17265us (17618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200871.399209:0:85234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 74 00010000:00010000:2.0:1788200871.703765:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788200871.760642:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715036288:0@lo:400:kworker.0 00000100:00100000:2.0:1788200871.760709:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200871.760759:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715036800:0@lo:400:kworker.0 00000100:00100000:2.0:1788200871.760799:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200871.760817:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715037312:0@lo:400:kworker.0 00000100:00100000:2.0:1788200871.760839:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200871.760860:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788200871.760867:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715036160:0@lo:400:kworker.0 00000100:00100000:2.0:1788200871.760887:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200871.760902:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715036672:0@lo:400:kworker.0 00000100:00100000:2.0:1788200871.760937:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200871.760954:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715037184:0@lo:400:kworker.0 00000100:00100000:2.0:1788200871.760973:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200871.761002:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715036288 00000100:00100000:2.0:1788200871.761008:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715036288 00000100:00100000:2.0:1788200871.761072:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715036160 00000100:00100000:2.0:1788200871.761075:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715036160 00000100:00100000:2.0:1788200871.761096:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:2.0:1788200871.761106:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715036288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200871.761166:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715036288:12345-0@lo:400:kworker.0 Request processed in 61us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200871.761189:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:2.0:1788200871.761206:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:2.0:1788200871.761212:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715036160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.761388:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715036032:0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.761418:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200871.761450:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715036544:0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.761487:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200871.761503:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715037056:0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.761524:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200871.761542:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1788200871.761547:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715035904:0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.761572:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200871.761596:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715036416:0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.761623:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200871.761634:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715036928:0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.761650:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200871.761659:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715037440:0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.761677:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200871.761699:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715036800 00000100:00100000:0.0:1788200871.761703:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715036800 00000100:00100000:0.0:1788200871.761731:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715037312 00000100:00100000:0.0:1788200871.761734:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715037312 00000100:00100000:0.0:1788200871.761750:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715036672 00000100:00100000:0.0:1788200871.761753:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715036672 00000100:00100000:0.0:1788200871.761764:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715037184 00000100:00100000:0.0:1788200871.761767:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715037184 00000100:00100000:0.0:1788200871.761783:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2575 00000100:00100000:0.0:1788200871.761789:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715036800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.761821:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715036800:12345-0@lo:400:kworker.0 Request processed in 32us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200871.761827:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2575 00000100:00100000:0.0:1788200871.761837:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2576 00000100:00100000:0.0:1788200871.761843:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715037312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.761867:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715037312:12345-0@lo:400:kworker.0 Request processed in 24us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200871.761872:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2576 00000100:00100000:0.0:1788200871.761882:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2577 00000100:00100000:0.0:1788200871.761887:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715036672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.761912:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715036672:12345-0@lo:400:kworker.0 Request processed in 25us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200871.761927:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2577 00000100:00100000:0.0:1788200871.761938:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578 00000100:00100000:0.0:1788200871.761944:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715037184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.761970:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715037184:12345-0@lo:400:kworker.0 Request processed in 27us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200871.761976:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578 00000100:00080000:0.0:1788200871.762038:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788200871.762042:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788200871.762045:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788200871.762047:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788200871.762073:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715036672:0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.762085:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715037184:0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.762094:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715036288:0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.762103:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715036800:0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.762130:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715037312:0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.762166:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715036032 00000100:00100000:0.0:1788200871.762170:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715036032 00000100:00080000:0.0:1788200871.762185:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788200871.762199:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715036416 00000100:00100000:0.0:1788200871.762202:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715036416 00000100:00080000:0.0:1788200871.762213:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788200871.762345:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715036928 00000100:00100000:0.0:1788200871.762349:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715036928 00000100:00100000:0.0:1788200871.762360:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715037440 00000100:00100000:0.0:1788200871.762362:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715037440 00000100:00100000:0.0:1788200871.762373:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:0.0:1788200871.762384:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715036032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.762473:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715036032:12345-0@lo:400:kworker.0 Request processed in 37us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200871.762480:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00100000:0.0:1788200871.762505:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715036032:0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.762522:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1788200871.762527:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715036416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.762559:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715036416:12345-0@lo:400:kworker.0 Request processed in 31us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200871.762564:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1788200871.762586:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715036416:0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.762603:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:0.0:1788200871.762609:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715036928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.762639:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715036928:12345-0@lo:400:kworker.0 Request processed in 29us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200871.762644:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:0.0:1788200871.762663:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715036928:0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.762685:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:0.0:1788200871.762691:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715037440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.762720:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715037440:12345-0@lo:400:kworker.0 Request processed in 29us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200871.762725:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:0.0:1788200871.762747:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715037440:0@lo:400:kworker.0 00000100:00100000:3.0:1788200871.762897:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715036544 00000100:00100000:3.0:1788200871.762901:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715036544 00000100:00100000:3.0:1788200871.762924:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715037056 00000100:00100000:3.0:1788200871.762927:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715037056 00000100:00100000:3.0:1788200871.762956:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3813 00000100:00100000:3.0:1788200871.762964:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715036544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200871.762999:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715036544:12345-0@lo:400:kworker.0 Request processed in 37us (1511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200871.763005:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3813 00000100:00100000:3.0:1788200871.763040:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3814 00000100:00100000:3.0:1788200871.763047:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715037056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200871.763076:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715037056:12345-0@lo:400:kworker.0 Request processed in 29us (1551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200871.763081:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3814 00000100:00100000:3.0:1788200871.763103:0:85240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715035904 00000100:00100000:3.0:1788200871.763106:0:85240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715035904 00000100:00100000:3.0:1788200871.763130:0:85240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788200871.763137:0:85240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715035904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200871.763164:0:85240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715035904:12345-0@lo:400:kworker.0 Request processed in 28us (1591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200871.763170:0:85240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788200871.763312:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120021c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715037568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788200871.763340:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200871.763370:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715035904:0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.763380:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715036544:0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.763388:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715037056:0@lo:400:kworker.0 00000100:00100000:1.0:1788200871.763618:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715037568 00000100:00100000:1.0:1788200871.763623:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715037568 00000100:00100000:1.0:1788200871.763658:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3815 00000100:00100000:1.0:1788200871.763665:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715037568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788200871.763687:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:1.0:1788200871.763722:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715037568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200871.763728:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3815 00000100:00100000:3.0:1788200871.763849:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715036160:12345-0@lo:400:kworker.0 Request processed in 2636us (2960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200871.763861:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00100000:1.0:1788200871.763929:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715036160:0@lo:400:kworker.0 00000100:00100000:0.0:1788200871.764000:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120021c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715037568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788200872.271320:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715037696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788200872.271386:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200872.271435:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715037696 00000100:00100000:3.0:1788200872.271443:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715037696 00000100:00100000:3.0:1788200872.271483:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2086 00000100:00100000:3.0:1788200872.271491:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120021880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715037696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788200872.271512:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200872.271563:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120021880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715037696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200872.271570:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2086 00000100:00100000:3.0:1788200872.271629:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715037696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788200872.272410:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788200872.272419:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715037824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788200872.272447:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200872.272472:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715037824 00000100:00100000:3.0:1788200872.272476:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715037824 00000100:00100000:3.0:1788200872.272497:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2087 00000100:00100000:3.0:1788200872.272504:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120021c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715037824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788200872.272516:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200872.272548:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120021c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715037824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200872.272554:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2087 00000100:00100000:3.0:1788200872.272584:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715037824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788200872.277413:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715037952:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788200872.277501:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200872.277558:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715037952 00000100:00100000:3.0:1788200872.277565:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715037952 00000100:00100000:3.0:1788200872.277611:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3816 00000100:00100000:3.0:1788200872.277619:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120021f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715037952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788200872.277776:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444974592 avail 1298735104 00000100:00100000:3.0:1788200872.278917:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120021f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715037952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1297us (1414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200872.278925:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3816 00000100:00100000:2.0:1788200872.280075:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715037952:0@lo:41:osp-pre-0-1.0 00000001:00100000:2.0:1788200872.287116:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4292087e-fa00-4621-b681-837afc99ae35 00000001:00080000:2.0:1788200872.287129:0:9526:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969449 is committed 00000001:00100000:3.0:1788200872.288693:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4292087e-fa00-4621-b681-837afc99ae35 00000001:00080000:3.0:1788200872.288704:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969449 is committed 00010000:00010000:2.0:1788200872.719963:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200873.744355:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200874.767841:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200875.792697:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788200876.368210:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715038080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788200876.368291:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200876.368461:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715038080 00000100:00100000:3.0:1788200876.368470:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715038080 00000100:00100000:3.0:1788200876.368593:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2088 00000100:00100000:3.0:1788200876.368604:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715038080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788200876.368634:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200876.368678:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715038080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200876.368684:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2088 00000100:00080000:0.0:1788200876.371403:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788200876.371478:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715038080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788200876.379947:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715038208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788200876.380092:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200876.382699:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715038208 00000100:00100000:2.0:1788200876.382713:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715038208 00000100:00100000:2.0:1788200876.382793:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2089 00000100:00100000:2.0:1788200876.382805:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715038208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788200876.382849:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788200876.382941:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715038208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 139us (2848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200876.382948:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2089 00000100:00080000:0.0:1788200876.383039:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788200876.384659:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715038208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788200876.501005:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200876.501096:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200876.501116:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200876.501141:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200876.501197:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200876.501248:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695333888 00000100:00100000:3.0:1788200876.501385:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695333888 00000100:00100000:3.0:1788200876.501456:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695333760 00000100:00100000:3.0:1788200876.501460:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695333760 00000100:00100000:3.0:1788200876.501485:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2579 00000100:00100000:3.0:1788200876.501496:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4292087e-fa00-4621-b681-837afc99ae35+5:2400:x1875060695333888:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200876.501567:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4292087e-fa00-4621-b681-837afc99ae35+5:2400:x1875060695333888:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 72us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200876.501589:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2579 00000100:00100000:3.0:1788200876.501612:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2580 00000100:00100000:3.0:1788200876.501619:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4292087e-fa00-4621-b681-837afc99ae35+5:2400:x1875060695333760:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200876.501646:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4292087e-fa00-4621-b681-837afc99ae35+5:2400:x1875060695333760:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 28us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200876.501652:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2580 00000100:00100000:1.0:1788200876.503064:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695333376 00000100:00100000:1.0:1788200876.503075:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695333376 00000100:00100000:1.0:1788200876.503143:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 76 00000100:00100000:1.0:1788200876.503152:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2400:x1875060695333376:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788200876.503212:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2400:x1875060695333376:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 61us (2215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200876.503219:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 76 00000100:00100000:1.0:1788200876.503259:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695333632 00000100:00100000:1.0:1788200876.503263:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695333632 00000100:00100000:1.0:1788200876.503297:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695333504 00000100:00100000:1.0:1788200876.503300:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695333504 00000100:00100000:1.0:1788200876.503320:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1084 00000100:00100000:1.0:1788200876.503326:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695333632:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788200876.503355:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695333632:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 29us (2260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200876.503361:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1084 00000100:00100000:1.0:1788200876.503372:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1085 00000100:00100000:1.0:1788200876.503377:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+7:2400:x1875060695333504:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788200876.503396:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+7:2400:x1875060695333504:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 19us (2255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200876.503400:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1085 00000100:00080000:0.0:1788200876.503510:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788200876.503514:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788200876.503517:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788200876.503519:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788200876.819617:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788200876.879560:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715038464:0@lo:400:kworker.0 00000100:00100000:3.0:1788200876.879645:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200876.879713:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788200876.879727:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715038336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788200876.879770:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200876.879812:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715038336 00000100:00100000:0.0:1788200876.879818:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715038336 00000100:00100000:0.0:1788200876.879860:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3817 00000100:00100000:0.0:1788200876.879868:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715038336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788200876.879913:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:0.0:1788200876.880227:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715038336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 357us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200876.880234:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3817 00000100:00100000:0.0:1788200876.880258:0:85240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715038464 00000100:00100000:0.0:1788200876.880262:0:85240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715038464 00000100:00100000:0.0:1788200876.880286:0:85240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788200876.880292:0:85240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715038464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200876.880385:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715038592:0@lo:400:kworker.0 00000100:00100000:1.0:1788200876.880426:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200876.880476:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715038592 00000100:00100000:1.0:1788200876.880480:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715038592 00000100:00100000:1.0:1788200876.880522:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:1.0:1788200876.880529:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715038592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200876.880564:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715038592:12345-0@lo:400:kworker.0 Request processed in 35us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200876.880579:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00080000:1.0:1788200876.880598:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788200876.880630:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715038592:0@lo:400:kworker.0 00000100:00100000:1.0:1788200876.880667:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715038336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788200876.896866:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715038848:0@lo:400:kworker.0 00000100:00100000:2.0:1788200876.896954:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200876.896990:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715039360:0@lo:400:kworker.0 00000100:00100000:2.0:1788200876.897050:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200876.897071:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715039872:0@lo:400:kworker.0 00000100:00100000:2.0:1788200876.897092:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200876.897116:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788200876.897121:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715038720:0@lo:400:kworker.0 00000100:00100000:2.0:1788200876.897143:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200876.897172:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715039232:0@lo:400:kworker.0 00000100:00100000:2.0:1788200876.897191:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200876.897208:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715039744:0@lo:400:kworker.0 00000100:00100000:2.0:1788200876.897227:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200876.897258:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715039360 00000100:00100000:2.0:1788200876.897265:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715039360 00000100:00100000:2.0:1788200876.897307:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715039232 00000100:00100000:2.0:1788200876.897310:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715039232 00000100:00100000:2.0:1788200876.897326:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715039744 00000100:00100000:2.0:1788200876.897329:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715039744 00000100:00100000:2.0:1788200876.897363:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2581 00000100:00100000:2.0:1788200876.897372:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715039360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200876.897420:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715039360:12345-0@lo:400:kworker.0 Request processed in 49us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200876.897427:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2581 00000100:00100000:2.0:1788200876.897443:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582 00000100:00100000:2.0:1788200876.897450:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715039232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200876.897781:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583 00000100:00100000:3.0:1788200876.897792:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715039744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200876.897831:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715039744:12345-0@lo:400:kworker.0 Request processed in 42us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200876.897837:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583 00000100:00100000:3.0:1788200876.897858:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715038848 00000100:00100000:3.0:1788200876.897862:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715038848 00000100:00100000:3.0:1788200876.897894:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715039872 00000100:00100000:3.0:1788200876.897897:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715039872 00000100:00100000:3.0:1788200876.897927:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715038720 00000100:00100000:3.0:1788200876.897930:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715038720 00000100:00100000:3.0:1788200876.897947:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:3.0:1788200876.897953:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715038848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200876.897984:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715038848:12345-0@lo:400:kworker.0 Request processed in 31us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200876.897990:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:3.0:1788200876.898006:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:3.0:1788200876.898043:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715039872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200876.898075:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715039872:12345-0@lo:400:kworker.0 Request processed in 33us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200876.898081:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:3.0:1788200876.898094:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:3.0:1788200876.898100:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715038720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200876.898127:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715038720:12345-0@lo:400:kworker.0 Request processed in 27us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200876.898133:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00100000:3.0:1788200876.898179:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715039104:0@lo:400:kworker.0 00000100:00100000:3.0:1788200876.898210:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200876.898232:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715039616:0@lo:400:kworker.0 00000100:00100000:3.0:1788200876.898253:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200876.898280:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788200876.898286:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715038976:0@lo:400:kworker.0 00000100:00100000:3.0:1788200876.898305:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200876.898320:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715039488:0@lo:400:kworker.0 00000100:00100000:3.0:1788200876.898339:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200876.898364:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715039104 00000100:00100000:3.0:1788200876.898367:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715039104 00000100:00100000:3.0:1788200876.898395:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3818 00000100:00100000:3.0:1788200876.898401:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120022300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715039104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200876.898434:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120022300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715039104:12345-0@lo:400:kworker.0 Request processed in 33us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200876.898439:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3818 00000100:00100000:3.0:1788200876.898485:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715038976 00000100:00100000:3.0:1788200876.898490:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715038976 00000100:00100000:3.0:1788200876.898513:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715039488 00000100:00100000:3.0:1788200876.898516:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715039488 00000100:00100000:3.0:1788200876.898530:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:3.0:1788200876.898535:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715038976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200876.898565:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715038976:12345-0@lo:400:kworker.0 Request processed in 30us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200876.898581:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:3.0:1788200876.898593:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:3.0:1788200876.898599:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715039488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200876.898624:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715039488:12345-0@lo:400:kworker.0 Request processed in 26us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200876.898630:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:3.0:1788200876.898667:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715038976:0@lo:400:kworker.0 00000100:00100000:3.0:1788200876.898677:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715039488:0@lo:400:kworker.0 00000100:00100000:3.0:1788200876.898685:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715039104:0@lo:400:kworker.0 00000100:00100000:3.0:1788200876.898727:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715039616 00000100:00100000:3.0:1788200876.898730:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715039616 00000100:00100000:3.0:1788200876.898757:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2584 00000100:00100000:3.0:1788200876.898763:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715039616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200876.898796:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715039616:12345-0@lo:400:kworker.0 Request processed in 33us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200876.898802:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2584 00000100:00100000:3.0:1788200876.898833:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969449 gen 2 00000100:00100000:3.0:1788200876.898845:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715039616:0@lo:400:kworker.0 00000100:00080000:3.0:1788200876.898874:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788200876.898878:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788200876.898880:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788200876.898883:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788200876.898909:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715038720:0@lo:400:kworker.0 00000100:00100000:3.0:1788200876.898919:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969449 gen 2 00000100:00100000:3.0:1788200876.898927:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715039744:0@lo:400:kworker.0 00000100:00100000:3.0:1788200876.898936:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715038848:0@lo:400:kworker.0 00000100:00100000:3.0:1788200876.898982:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715039360:0@lo:400:kworker.0 00000100:00100000:3.0:1788200876.898994:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715039872:0@lo:400:kworker.0 00000100:00100000:2.0:1788200876.899400:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715039232:12345-0@lo:400:kworker.0 Request processed in 1950us (2206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200876.899408:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582 00000100:00100000:0.0:1788200876.899510:0:85240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715038464:12345-0@lo:400:kworker.0 Request processed in 19216us (19864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200876.899518:0:85240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788200876.911962:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715039232:0@lo:400:kworker.0 00000100:00100000:1.0:1788200876.916843:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715038464:0@lo:400:kworker.0 00000100:00100000:3.0:1788200877.391284:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788200877.391307:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715040000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788200877.391400:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200877.395619:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788200877.395646:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715040256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788200877.395725:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200877.395787:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715040128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788200877.395810:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200877.395845:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715040000 00000100:00100000:3.0:1788200877.395853:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715040000 00000100:00100000:3.0:1788200877.395894:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715040128 00000100:00100000:3.0:1788200877.395897:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715040128 00000100:00100000:3.0:1788200877.395917:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2090 00000100:00100000:3.0:1788200877.395924:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715040000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788200877.395960:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200877.396003:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715040000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (4611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200877.396010:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2090 00000100:00100000:3.0:1788200877.396058:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2091 00000100:00100000:3.0:1788200877.396065:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715040128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788200877.396074:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200877.396096:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715040128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200877.396102:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2091 00000100:00100000:3.0:1788200877.396140:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715040128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788200877.396169:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715040000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788200877.396325:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715040256 00000100:00100000:0.0:1788200877.396330:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715040256 00000100:00100000:0.0:1788200877.396378:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3819 00000100:00100000:0.0:1788200877.396385:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715040256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788200877.396837:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444974592 avail 1298735104 00000100:00100000:0.0:1788200877.396886:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715040256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 501us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200877.396892:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3819 00000100:00100000:3.0:1788200877.397317:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715040256:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788200877.840369:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788200878.558696:0:85811:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:1.0:1788200878.863290:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200879.888319:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200880.912542:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788200881.021569:0:85860:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:1.0:1788200881.501928:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715040512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788200881.502000:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200881.502634:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715040512 00000100:00100000:2.0:1788200881.502645:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715040512 00000100:00100000:2.0:1788200881.502710:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2092 00000100:00100000:2.0:1788200881.502720:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125641c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715040512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788200881.502748:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200881.505532:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715040384:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788200881.505606:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788200881.505670:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788200881.505689:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715040384 00000100:00100000:3.0:1788200881.505696:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715040384 00000100:00100000:3.0:1788200881.505741:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2093 00000100:00100000:3.0:1788200881.505752:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715040384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788200881.505781:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200881.505827:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715040384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200881.505847:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2093 00000100:00080000:3.0:1788200881.505869:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788200881.505902:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715040384:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788200881.523670:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125641c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715040512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 20940us (21658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200881.523688:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2092 00000100:00100000:1.0:1788200881.529649:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715040512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788200881.624912:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200881.624954:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200881.624980:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200881.625010:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200881.625114:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200881.625145:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695334272 00000100:00100000:0.0:1788200881.625163:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695334272 00000100:00100000:0.0:1788200881.625230:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695334144 00000100:00100000:0.0:1788200881.625233:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695334144 00000100:00100000:0.0:1788200881.625255:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1092 00000100:00100000:0.0:1788200881.625265:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695334272:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200881.625339:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695334272:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 75us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200881.625346:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1092 00000100:00100000:0.0:1788200881.625361:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1093 00000100:00100000:0.0:1788200881.625367:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+7:2401:x1875060695334144:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200881.625386:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+7:2401:x1875060695334144:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 20us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200881.625403:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1093 00000100:00100000:0.0:1788200881.625570:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695334528 00000100:00100000:0.0:1788200881.625574:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695334528 00000100:00100000:0.0:1788200881.625600:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695334400 00000100:00100000:0.0:1788200881.625602:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695334400 00000100:00100000:0.0:1788200881.625622:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2585 00000100:00100000:0.0:1788200881.625628:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4292087e-fa00-4621-b681-837afc99ae35+5:2401:x1875060695334528:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200881.625652:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4292087e-fa00-4621-b681-837afc99ae35+5:2401:x1875060695334528:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 24us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200881.625658:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2585 00000100:00100000:0.0:1788200881.625669:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2586 00000100:00100000:0.0:1788200881.625674:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4292087e-fa00-4621-b681-837afc99ae35+5:2401:x1875060695334400:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200881.625691:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4292087e-fa00-4621-b681-837afc99ae35+5:2401:x1875060695334400:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 17us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200881.625703:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2586 00000100:00080000:0.0:1788200881.625719:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788200881.625724:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788200881.625726:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788200881.625728:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788200881.626180:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695334016 00000100:00100000:1.0:1788200881.626186:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695334016 00000100:00100000:1.0:1788200881.626229:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 78 00000100:00100000:1.0:1788200881.626237:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695334016:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788200881.626277:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695334016:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 41us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200881.626283:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 78 00010000:00010000:3.0:1788200881.935275:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788200881.999326:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715040640:0@lo:400:kworker.0 00000100:00100000:0.0:1788200881.999405:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200881.999493:0:85235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715040640 00000100:00100000:1.0:1788200881.999515:0:85235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715040640 00000100:00100000:1.0:1788200881.999568:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788200881.999578:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715040640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200881.999753:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715041152:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788200881.999787:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200881.999850:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715040640:12345-0@lo:400:kworker.0 Request processed in 273us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200881.999857:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788200881.999893:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715041024:0@lo:400:kworker.0 00000100:00100000:1.0:1788200881.999920:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200881.999974:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715041152 00000100:00100000:1.0:1788200881.999978:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715041152 00000100:00100000:1.0:1788200882.000007:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3820 00000100:00100000:1.0:1788200882.000035:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715041152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788200882.000063:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:1.0:1788200882.000107:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715041152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200882.000113:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3820 00000100:00100000:1.0:1788200882.000132:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715040896:0@lo:400:kworker.0 00000100:00100000:1.0:1788200882.000154:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200882.000176:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788200882.000182:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715040768:0@lo:400:kworker.0 00000100:00100000:1.0:1788200882.000203:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200882.000234:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715041024 00000100:00100000:1.0:1788200882.000238:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715041024 00000100:00100000:1.0:1788200882.000273:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715040896 00000100:00100000:1.0:1788200882.000276:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715040896 00000100:00100000:1.0:1788200882.000292:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715040768 00000100:00100000:1.0:1788200882.000294:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715040768 00000100:00100000:1.0:1788200882.000319:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:1.0:1788200882.000325:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715041024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200882.000362:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715041024:12345-0@lo:400:kworker.0 Request processed in 37us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200882.000368:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:1.0:1788200882.000380:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:1.0:1788200882.000386:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715040896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200882.000416:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715040896:12345-0@lo:400:kworker.0 Request processed in 30us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200882.000422:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:1.0:1788200882.000434:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:1.0:1788200882.000440:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715040768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200882.000468:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715040768:12345-0@lo:400:kworker.0 Request processed in 28us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200882.000473:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00100000:1.0:1788200882.000507:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715041024:0@lo:400:kworker.0 00000100:00080000:1.0:1788200882.000532:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788200882.000536:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788200882.000551:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715040768:0@lo:400:kworker.0 00000100:00100000:1.0:1788200882.000559:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715040896:0@lo:400:kworker.0 00000100:00100000:1.0:1788200882.000793:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715041280:0@lo:400:kworker.0 00000100:00100000:1.0:1788200882.000819:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200882.000909:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715041792:0@lo:400:kworker.0 00000100:00100000:1.0:1788200882.000931:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200882.001002:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788200882.001009:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715041408:0@lo:400:kworker.0 00000100:00100000:1.0:1788200882.001053:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200882.001084:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715041920:0@lo:400:kworker.0 00000100:00100000:1.0:1788200882.001107:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200882.001132:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715041536:0@lo:400:kworker.0 00000100:00100000:1.0:1788200882.001154:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200882.001172:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715042048:0@lo:400:kworker.0 00000100:00100000:1.0:1788200882.001200:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200882.001218:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788200882.001223:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715041664:0@lo:400:kworker.0 00000100:00100000:1.0:1788200882.001245:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200882.001263:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715042176:0@lo:400:kworker.0 00000100:00100000:1.0:1788200882.001286:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200882.001443:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715040640:0@lo:400:kworker.0 00000100:00100000:0.0:1788200882.001469:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715041152:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788200882.001489:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715041408 00000100:00100000:0.0:1788200882.001493:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715041408 00000100:00100000:0.0:1788200882.001521:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3821 00000100:00100000:0.0:1788200882.001527:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715041408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200882.001562:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715041408:12345-0@lo:400:kworker.0 Request processed in 35us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200882.001568:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3821 00000100:00100000:0.0:1788200882.001592:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715041408:0@lo:400:kworker.0 00000100:00100000:0.0:1788200882.001621:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715041920 00000100:00100000:0.0:1788200882.001625:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715041920 00000100:00100000:0.0:1788200882.001655:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715041536 00000100:00100000:0.0:1788200882.001658:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715041536 00000100:00100000:0.0:1788200882.001673:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715042048 00000100:00100000:0.0:1788200882.001676:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715042048 00000100:00100000:0.0:1788200882.001690:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715041664 00000100:00100000:0.0:1788200882.001700:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715041664 00000100:00100000:0.0:1788200882.001720:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2587 00000100:00100000:0.0:1788200882.001726:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715041920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200882.001759:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715041920:12345-0@lo:400:kworker.0 Request processed in 33us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200882.001765:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2587 00000100:00100000:0.0:1788200882.001776:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2588 00000100:00100000:0.0:1788200882.001782:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13336ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715041536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200882.001810:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13336ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715041536:12345-0@lo:400:kworker.0 Request processed in 28us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200882.001816:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2588 00000100:00100000:0.0:1788200882.001948:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589 00000100:00100000:0.0:1788200882.001955:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140fa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715042048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200882.001987:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140fa1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715042048:12345-0@lo:400:kworker.0 Request processed in 33us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200882.001993:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589 00000100:00100000:0.0:1788200882.002166:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590 00000100:00100000:0.0:1788200882.002173:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13336bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715041664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200882.002202:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13336bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715041664:12345-0@lo:400:kworker.0 Request processed in 30us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200882.002207:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590 00000100:00080000:0.0:1788200882.002223:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788200882.002226:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788200882.002242:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715041920:0@lo:400:kworker.0 00000100:00100000:1.0:1788200882.002420:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715041536:0@lo:400:kworker.0 00000100:00100000:1.0:1788200882.002430:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715042048:0@lo:400:kworker.0 00000100:00100000:1.0:1788200882.002445:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715041664:0@lo:400:kworker.0 00000100:00100000:3.0:1788200882.002493:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715041280 00000100:00100000:3.0:1788200882.002498:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715041280 00000100:00100000:3.0:1788200882.002547:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715041792 00000100:00100000:3.0:1788200882.002551:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715041792 00000100:00100000:3.0:1788200882.002568:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715042176 00000100:00100000:3.0:1788200882.002572:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715042176 00000100:00100000:3.0:1788200882.002584:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:3.0:1788200882.002590:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13336aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715041280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200882.002628:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13336aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715041280:12345-0@lo:400:kworker.0 Request processed in 38us (1808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200882.002633:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:3.0:1788200882.002648:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:3.0:1788200882.002654:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715041792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200882.002679:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715041792:12345-0@lo:400:kworker.0 Request processed in 25us (1747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200882.002684:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:3.0:1788200882.002695:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:3.0:1788200882.002701:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715042176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200882.002727:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715042176:12345-0@lo:400:kworker.0 Request processed in 26us (1440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200882.002732:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:3.0:1788200882.002762:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715041280:0@lo:400:kworker.0 00000100:00100000:3.0:1788200882.002781:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715041792:0@lo:400:kworker.0 00000100:00080000:1.0:1788200882.002905:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788200882.002923:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715042176:0@lo:400:kworker.0 00000100:00100000:3.0:1788200882.519209:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715042304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788200882.519280:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200882.519355:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715042304 00000100:00100000:3.0:1788200882.519368:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715042304 00000100:00100000:3.0:1788200882.519412:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2094 00000100:00100000:3.0:1788200882.519420:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715042304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788200882.519440:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200882.519482:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715042304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200882.519490:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2094 00000100:00100000:3.0:1788200882.519538:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715042304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788200882.521928:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715042432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788200882.522003:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200882.522201:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715042560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788200882.522244:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200882.522957:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715042560 00000100:00100000:0.0:1788200882.522965:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715042560 00000100:00100000:0.0:1788200882.523045:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3822 00000100:00100000:0.0:1788200882.523064:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13336ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715042560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788200882.523100:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444974592 avail 1298735104 00000100:00100000:0.0:1788200882.523151:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13336ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715042560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200882.523157:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3822 00000100:00100000:3.0:1788200882.523253:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715042560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788200882.524330:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715042432 00000100:00100000:2.0:1788200882.524337:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715042432 00000100:00100000:2.0:1788200882.524391:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2095 00000100:00100000:2.0:1788200882.524399:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715042432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788200882.524416:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788200882.524476:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715042432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (2472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200882.524482:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2095 00000100:00100000:0.0:1788200882.524665:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715042432:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788200882.959469:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200883.983738:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788200884.360177:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200884.360290:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695334656 00000100:00100000:1.0:1788200884.360301:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695334656 00000100:00100000:1.0:1788200884.360391:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1091 00000100:00100000:1.0:1788200884.360402:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+7:65768:x1875060695334656:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:1.0:1788200884.360438:0:69485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444974592 avail 1298735104 00000100:00100000:1.0:1788200884.360509:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+7:65768:x1875060695334656:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 108us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200884.360517:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1091 00000100:00080000:2.0:1788200884.360680:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788200884.363100:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200884.363182:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695334784 00000100:00100000:3.0:1788200884.363191:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695334784 00000100:00100000:3.0:1788200884.363258:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1092 00000100:00100000:3.0:1788200884.363267:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:65768:x1875060695334784:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:3.0:1788200884.363302:0:66313:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:3.0:1788200884.363367:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:65768:x1875060695334784:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 100us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200884.363374:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1092 00000100:00080000:2.0:1788200884.363445:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788200884.366112:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200884.366181:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695334912 00000100:00100000:3.0:1788200884.366188:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695334912 00000100:00100000:3.0:1788200884.366254:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2096 00000100:00100000:3.0:1788200884.366262:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:65768:x1875060695334912:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:3.0:1788200884.366288:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200884.366351:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:65768:x1875060695334912:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 89us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200884.366359:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2096 00000100:00080000:2.0:1788200884.366415:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788200884.367728:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200884.367869:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695335040 00000100:00100000:3.0:1788200884.367875:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695335040 00000100:00100000:3.0:1788200884.367918:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2097 00000100:00100000:3.0:1788200884.367925:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:65768:x1875060695335040:12345-192.168.201.20@tcp:13:lfs.0 00000100:00080000:2.0:1788200884.367968:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1788200884.368061:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200884.368116:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:65768:x1875060695335040:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 191us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200884.368123:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2097 00000100:00100000:1.0:1788200884.405114:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200884.405209:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695335296 00000100:00100000:0.0:1788200884.405219:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695335296 00000100:00100000:0.0:1788200884.405272:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1093 00000100:00100000:0.0:1788200884.405282:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+7:65784:x1875060695335296:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788200884.405300:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200884.405320:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a8da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786569 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200884.405398:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8e00/0x96d0c9b8c9a1a8e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200884.405412:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8e00/0x96d0c9b8c9a1a8e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200884.405423:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8e00/0x96d0c9b8c9a1a8e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200884.405457:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8800/0x96d0c9b8c9a1a8e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200884.405465:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8800/0x96d0c9b8c9a1a8e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200884.405472:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8800/0x96d0c9b8c9a1a8e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200884.405542:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8e00/0x96d0c9b8c9a1a8e1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200884.405550:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8e00/0x96d0c9b8c9a1a8e1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200884.405556:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8e00/0x96d0c9b8c9a1a8e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200884.405563:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8e00/0x96d0c9b8c9a1a8e1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200884.405569:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8e00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788200884.405573:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8e00/0x96d0c9b8c9a1a8e1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200884.405580:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8e00/0x96d0c9b8c9a1a8e1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200884.405592:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12f34f300) 00010000:00010000:0.0:1788200884.405595:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788200884.405599:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8e00/0x96d0c9b8c9a1a8e1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200884.405613:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8e00/0x96d0c9b8c9a1a8e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200884.405627:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8800/0x96d0c9b8c9a1a8e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200884.405633:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8800/0x96d0c9b8c9a1a8e8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200884.405638:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8800/0x96d0c9b8c9a1a8e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200884.405644:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788200884.405647:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8800/0x96d0c9b8c9a1a8e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200884.405654:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8800/0x96d0c9b8c9a1a8e8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200884.405662:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff8dc137d07500) 00010000:00010000:0.0:1788200884.405665:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788200884.405668:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8800/0x96d0c9b8c9a1a8e8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200884.405674:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8800/0x96d0c9b8c9a1a8e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200884.405708:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a8da lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786569 expref: 8 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200884.405746:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12f34f300) 00010000:00010000:0.0:1788200884.405749:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788200884.405754:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a8da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786569 expref: 8 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200884.405764:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ce8000, rc 0) 00000100:00100000:0.0:1788200884.406224:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+7:65784:x1875060695335296:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 941us (1118us total) trans 0 rc 301/301 00000100:00100000:0.0:1788200884.406233:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1093 00000100:00100000:1.0:1788200884.408674:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200884.408750:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695335424 00000100:00100000:3.0:1788200884.408758:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695335424 00000100:00100000:3.0:1788200884.408817:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1094 00000100:00100000:3.0:1788200884.408826:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+7:65784:x1875060695335424:12345-192.168.201.20@tcp:34:lfs.0 00010000:00010000:3.0:1788200884.408890:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1a8ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.408906:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1a8ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.408918:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1a8ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.408932:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1a8f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.408953:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1a8f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.408961:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1a8f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.409077:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1a8fd lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.409087:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1a8fd lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.409094:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1a8fd lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788200884.409136:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788200884.409148:0:66312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1a8fd lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.409163:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1a8ef lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.409171:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1a8ef lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.409178:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1a8ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.409186:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1a8ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.409192:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fca00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788200884.409209:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1a8ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.409218:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1a8ef lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.409231:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12f34f300) 00010000:00010000:3.0:1788200884.409234:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788200884.409238:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1a8ef lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.409246:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1a8ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.409259:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1a8f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.409265:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1a8f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.409272:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1a8f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.409277:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fdc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788200884.409280:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1a8f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.409287:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1a8f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.409294:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff8dc107112d00) 00010000:00010000:3.0:1788200884.409296:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788200884.409304:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1a8f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.409311:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1a8f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.409327:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1a8fd lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.409332:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1a8fd lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.409348:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1a8fd lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.409353:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fc400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788200884.409356:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1a8fd lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.409363:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1a8fd lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.409371:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x2:0x0].0x0 (ffff8dc107112a00) 00010000:00010000:3.0:1788200884.409373:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788200884.409375:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1a8fd lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200884.409380:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1a8fd lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200884.409440:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+7:65784:x1875060695335424:12345-192.168.201.20@tcp:34:lfs.0 Request processed in 614us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200884.409448:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1094 00010000:00010000:3.0:1788200885.007373:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200886.031168:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788200886.609134:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788200886.609155:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715042688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788200886.609225:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200886.609290:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715042688 00000100:00100000:2.0:1788200886.609304:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715042688 00000100:00100000:2.0:1788200886.609362:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2098 00000100:00100000:2.0:1788200886.609371:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715042688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788200886.609396:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788200886.609435:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715042688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200886.609442:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2098 00000100:00080000:2.0:1788200886.609461:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788200886.609488:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715042688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788200886.620117:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715042816:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788200886.620193:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200886.622080:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715042816 00000100:00100000:2.0:1788200886.622093:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715042816 00000100:00100000:2.0:1788200886.622173:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2099 00000100:00100000:2.0:1788200886.622184:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715042816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788200886.622216:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788200886.622284:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715042816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (2091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200886.622305:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2099 00000100:00080000:3.0:1788200886.622699:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788200886.622740:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715042816:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788200886.749421:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200886.749466:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200886.749505:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200886.749522:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200886.749604:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200886.749632:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695335936 00000100:00100000:2.0:1788200886.749640:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695335936 00000100:00100000:2.0:1788200886.749698:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695336064 00000100:00100000:2.0:1788200886.749701:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695336064 00000100:00100000:2.0:1788200886.749726:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2591 00000100:00100000:2.0:1788200886.749736:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695335936:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788200886.749827:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695335680 00000100:00100000:1.0:1788200886.749832:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695335680 00000100:00100000:1.0:1788200886.749864:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695335808 00000100:00100000:1.0:1788200886.749867:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695335808 00000100:00100000:1.0:1788200886.749899:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1100 00000100:00100000:1.0:1788200886.749907:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+7:2403:x1875060695335680:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788200886.749994:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+7:2403:x1875060695335680:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 76us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200886.750002:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1100 00000100:00100000:1.0:1788200886.750043:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1101 00000100:00100000:1.0:1788200886.750051:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695335808:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788200886.750077:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695335808:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200886.750083:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1101 00000100:00100000:1.0:1788200886.750104:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695335552 00000100:00100000:1.0:1788200886.750108:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695335552 00000100:00100000:1.0:1788200886.750134:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:1.0:1788200886.750150:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2403:x1875060695335552:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788200886.750189:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2403:x1875060695335552:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 40us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200886.750195:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:2.0:1788200886.750717:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695335936:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 983us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200886.750725:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2591 00000100:00100000:2.0:1788200886.750809:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2592 00000100:00100000:2.0:1788200886.750820:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695336064:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788200886.750847:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695336064:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 30us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200886.750853:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2592 00000100:00080000:2.0:1788200886.750872:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788200886.750876:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788200886.750878:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788200886.750880:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788200887.075057:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200887.130335:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715043328:0@lo:400:kworker.0 00000100:00100000:1.0:1788200887.130406:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200887.130452:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715043840:0@lo:400:kworker.0 00000100:00100000:1.0:1788200887.130477:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200887.130501:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715044352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788200887.130520:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200887.130534:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788200887.130539:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715042944:0@lo:400:kworker.0 00000100:00100000:1.0:1788200887.130574:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200887.130600:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715043456:0@lo:400:kworker.0 00000100:00100000:1.0:1788200887.130623:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200887.130624:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715043328 00000100:00100000:2.0:1788200887.130631:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715043328 00000100:00100000:1.0:1788200887.130637:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715043968:0@lo:400:kworker.0 00000100:00100000:1.0:1788200887.130656:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200887.130680:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715043456 00000100:00100000:2.0:1788200887.130683:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715043456 00000100:00100000:1.0:1788200887.130694:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715043072:0@lo:400:kworker.0 00000100:00100000:2.0:1788200887.130708:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:1.0:1788200887.130716:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200887.130717:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715043328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200887.130729:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715043584:0@lo:400:kworker.0 00000100:00100000:1.0:1788200887.130747:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200887.130761:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715044096:0@lo:400:kworker.0 00000100:00100000:1.0:1788200887.130778:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200887.130778:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715043328:12345-0@lo:400:kworker.0 Request processed in 62us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200887.130785:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:1.0:1788200887.130801:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788200887.130802:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715043072 00000100:00100000:2.0:1788200887.130805:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715043072 00000100:00100000:1.0:1788200887.130807:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715043200:0@lo:400:kworker.0 00000100:00100000:2.0:1788200887.130821:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:1.0:1788200887.130827:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200887.130837:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715043712:0@lo:400:kworker.0 00000100:00100000:2.0:1788200887.130842:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715043456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200887.130855:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200887.130865:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cb50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715044224:0@lo:400:kworker.0 00000100:00100000:2.0:1788200887.130868:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715043456:12345-0@lo:400:kworker.0 Request processed in 41us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200887.130880:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00100000:1.0:1788200887.130892:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200887.130892:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715043200 00000100:00100000:2.0:1788200887.130895:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715043200 00000100:00100000:2.0:1788200887.130908:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715043712 00000100:00100000:2.0:1788200887.130910:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715043712 00000100:00100000:1.0:1788200887.130916:0:85235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715042944 00000100:00100000:1.0:1788200887.130919:0:85235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715042944 00000100:00100000:2.0:1788200887.130921:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715044224 00000100:00100000:2.0:1788200887.130922:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715044224 00000100:00100000:2.0:1788200887.130933:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:2.0:1788200887.130938:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715043072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200887.130943:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788200887.130948:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715042944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200887.130969:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715042944:12345-0@lo:400:kworker.0 Request processed in 22us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200887.130969:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715043072:12345-0@lo:400:kworker.0 Request processed in 31us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200887.130987:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00000100:00100000:1.0:1788200887.130992:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788200887.131000:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:2.0:1788200887.131005:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715043200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200887.131038:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:1.0:1788200887.131045:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715043712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200887.131049:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715043200:12345-0@lo:400:kworker.0 Request processed in 46us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200887.131055:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00100000:2.0:1788200887.131066:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:1.0:1788200887.131069:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715043712:12345-0@lo:400:kworker.0 Request processed in 25us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200887.131072:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715044224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200887.131074:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00100000:1.0:1788200887.131092:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715043968 00000100:00100000:2.0:1788200887.131094:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715044224:12345-0@lo:400:kworker.0 Request processed in 23us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200887.131096:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715043968 00000100:00100000:2.0:1788200887.131099:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00080000:2.0:1788200887.131114:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788200887.131118:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788200887.131120:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715044096 00000100:00080000:2.0:1788200887.131120:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788200887.131123:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715044096 00000100:00080000:2.0:1788200887.131142:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788200887.131147:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593 00000100:00100000:1.0:1788200887.131154:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715043968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200887.131182:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715043968:12345-0@lo:400:kworker.0 Request processed in 30us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200887.131194:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593 00000100:00100000:1.0:1788200887.131206:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594 00000100:00100000:1.0:1788200887.131212:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715044096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200887.131238:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715044096:12345-0@lo:400:kworker.0 Request processed in 26us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200887.131243:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594 00000100:00100000:1.0:1788200887.131293:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715043200:0@lo:400:kworker.0 00000100:00100000:1.0:1788200887.131304:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715043712:0@lo:400:kworker.0 00000100:00100000:1.0:1788200887.131312:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cb50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715044224:0@lo:400:kworker.0 00000100:00100000:1.0:1788200887.131320:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715043072:0@lo:400:kworker.0 00000100:00100000:1.0:1788200887.131327:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715044096:0@lo:400:kworker.0 00000100:00100000:1.0:1788200887.131358:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715042944:0@lo:400:kworker.0 00000100:00100000:1.0:1788200887.131366:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715043456:0@lo:400:kworker.0 00000100:00100000:1.0:1788200887.131373:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715043968:0@lo:400:kworker.0 00000100:00100000:1.0:1788200887.131380:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715043328:0@lo:400:kworker.0 00000100:00100000:0.0:1788200887.131758:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715043840 00000100:00100000:0.0:1788200887.131764:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715043840 00000100:00100000:0.0:1788200887.131796:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715044352 00000100:00100000:0.0:1788200887.131800:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715044352 00000100:00100000:0.0:1788200887.131809:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715043584 00000100:00100000:0.0:1788200887.131811:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715043584 00000100:00100000:0.0:1788200887.131822:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3823 00000100:00100000:0.0:1788200887.131828:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715043840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200887.131889:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715043840:12345-0@lo:400:kworker.0 Request processed in 53us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200887.131896:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3823 00000100:00100000:0.0:1788200887.131910:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3824 00000100:00100000:2.0:1788200887.131915:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715043840:0@lo:400:kworker.0 00000100:00100000:0.0:1788200887.131916:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715044352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788200887.131939:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:0.0:1788200887.131988:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715044352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (1467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200887.131994:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3824 00000100:00100000:2.0:1788200887.132014:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715044352:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788200887.132031:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3825 00000100:00100000:0.0:1788200887.132038:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715043584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200887.132080:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715043584:12345-0@lo:400:kworker.0 Request processed in 43us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200887.132086:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3825 00000100:00100000:2.0:1788200887.132100:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715043584:0@lo:400:kworker.0 00000100:00100000:3.0:1788200887.631225:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715044480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788200887.631461:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715044608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788200887.631515:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200887.631683:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cb50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715044736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788200887.631715:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200887.631762:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715044736 00000100:00100000:1.0:1788200887.631768:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715044736 00000100:00100000:1.0:1788200887.631814:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2100 00000100:00100000:1.0:1788200887.631822:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715044736:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788200887.631849:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715044608 00000100:00100000:0.0:1788200887.631856:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715044608 00002000:00000024:1.0:1788200887.631860:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200887.631911:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3826 00000100:00100000:1.0:1788200887.631913:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715044736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200887.631923:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715044608:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788200887.631925:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2100 00000004:00000024:0.0:1788200887.631954:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444974592 avail 1298735104 00000100:00100000:1.0:1788200887.632002:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cb50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715044736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788200887.632055:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715044608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200887.632063:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3826 00000100:00100000:2.0:1788200887.632229:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715044608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788200887.632469:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200887.632549:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715044480 00000100:00100000:2.0:1788200887.632554:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715044480 00000100:00100000:2.0:1788200887.632587:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2101 00000100:00100000:2.0:1788200887.632593:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715044480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788200887.632605:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788200887.632647:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715044480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200887.632653:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2101 00000100:00100000:3.0:1788200887.633479:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715044480:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788200888.080433:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200889.103371:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200890.127205:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200891.156137:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788200891.729476:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788200891.729499:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715044864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788200891.729567:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200891.729746:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cb50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715044992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788200891.729773:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200891.729907:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715044864 00000100:00100000:0.0:1788200891.729917:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715044864 00000100:00100000:0.0:1788200891.729977:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715044992 00000100:00100000:0.0:1788200891.729981:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715044992 00000100:00100000:0.0:1788200891.729999:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2102 00000100:00100000:0.0:1788200891.730011:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140297b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715044864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788200891.730075:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200891.730128:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140297b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715044864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200891.730135:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2102 00000100:00100000:0.0:1788200891.730153:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2103 00000100:00100000:0.0:1788200891.730160:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715044992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788200891.730174:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788200891.730370:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788200891.730375:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788200891.730423:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715044992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 264us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200891.730430:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2103 00000100:00100000:0.0:1788200891.730472:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cb50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715044992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788200891.730487:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715044864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788200891.865097:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200891.865155:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200891.865182:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200891.865206:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200891.865233:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200891.865264:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695336192 00000100:00100000:1.0:1788200891.865275:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695336192 00000100:00100000:1.0:1788200891.865329:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 82 00000100:00100000:1.0:1788200891.865340:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2402:x1875060695336192:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788200891.865409:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2402:x1875060695336192:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 69us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200891.865416:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 82 00000100:00100000:2.0:1788200891.865594:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695336320 00000100:00100000:2.0:1788200891.865599:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695336320 00000100:00100000:2.0:1788200891.865665:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695336448 00000100:00100000:2.0:1788200891.865669:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695336448 00000100:00100000:2.0:1788200891.865694:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1108 00000100:00100000:2.0:1788200891.865701:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+7:2402:x1875060695336320:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788200891.865737:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+7:2402:x1875060695336320:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 37us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200891.865745:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1108 00000100:00100000:2.0:1788200891.865759:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1109 00000100:00100000:2.0:1788200891.865783:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695336448:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788200891.865810:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695336448:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 29us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200891.865817:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1109 00000100:00100000:0.0:1788200891.866196:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695336576 00000100:00100000:0.0:1788200891.866201:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695336576 00000100:00100000:0.0:1788200891.866244:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695336704 00000100:00100000:0.0:1788200891.866247:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695336704 00000100:00100000:0.0:1788200891.866272:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2595 00000100:00100000:0.0:1788200891.866280:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4292087e-fa00-4621-b681-837afc99ae35+5:2402:x1875060695336576:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200891.866319:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4292087e-fa00-4621-b681-837afc99ae35+5:2402:x1875060695336576:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 41us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200891.866325:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2595 00000100:00100000:0.0:1788200891.866338:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2596 00000100:00100000:0.0:1788200891.866345:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4292087e-fa00-4621-b681-837afc99ae35+5:2402:x1875060695336704:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200891.866370:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4292087e-fa00-4621-b681-837afc99ae35+5:2402:x1875060695336704:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200891.866376:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2596 00000100:00080000:1.0:1788200891.866915:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788200891.866922:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788200891.866924:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788200891.866926:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788200892.175765:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200892.239374:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715045120:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788200892.239456:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200892.240062:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715045120 00000100:00100000:2.0:1788200892.240071:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715045120 00000100:00100000:2.0:1788200892.240133:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3827 00000100:00100000:2.0:1788200892.240143:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715045120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788200892.240179:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:2.0:1788200892.240248:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715045120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200892.240256:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3827 00000100:00100000:3.0:1788200892.240290:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715045120:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788200892.241430:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715045248:0@lo:400:kworker.0 00000100:00100000:3.0:1788200892.241480:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200892.241481:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715045504:0@lo:400:kworker.0 00000100:00100000:0.0:1788200892.241509:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200892.241519:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715045760:0@lo:400:kworker.0 00000100:00100000:0.0:1788200892.241529:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715046016:0@lo:400:kworker.0 00000100:00100000:3.0:1788200892.241540:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200892.241553:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715045504 00000100:00100000:0.0:1788200892.241558:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715045504 00000100:00100000:3.0:1788200892.241558:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc139ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715046272:0@lo:400:kworker.0 00000100:00100000:3.0:1788200892.241578:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200892.241605:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788200892.241610:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715045632:0@lo:400:kworker.0 00000100:00100000:3.0:1788200892.241632:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200892.241844:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715045376:0@lo:400:kworker.0 00000100:00080000:1.0:1788200892.246591:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788200892.247471:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715045760 00000100:00100000:0.0:1788200892.247486:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715045760 00000100:00100000:0.0:1788200892.247539:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715045632 00000100:00100000:0.0:1788200892.247542:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715045632 00000100:00100000:0.0:1788200892.247616:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:0.0:1788200892.247751:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715045504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200892.249874:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200892.249932:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715045888:0@lo:400:kworker.0 00000100:00100000:1.0:1788200892.250012:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200892.250829:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc139ba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715046400:0@lo:400:kworker.0 00000100:00100000:1.0:1788200892.250863:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200892.250945:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715045888 00000100:00100000:1.0:1788200892.250954:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715045888 00000100:00100000:1.0:1788200892.250997:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3828 00000100:00100000:1.0:1788200892.251006:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715045888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200892.252154:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715045888:12345-0@lo:400:kworker.0 Request processed in 1144us (2137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200892.252164:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3828 00000100:00080000:1.0:1788200892.252205:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788200892.252400:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715045888:0@lo:400:kworker.0 00000100:00100000:2.0:1788200892.252623:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715045376 00000100:00100000:2.0:1788200892.252631:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715045376 00000100:00100000:2.0:1788200892.252692:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715046400 00000100:00100000:2.0:1788200892.252695:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715046400 00000100:00100000:2.0:1788200892.252711:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:2.0:1788200892.252719:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715045632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200892.252767:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715045632:12345-0@lo:400:kworker.0 Request processed in 49us (11134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200892.252774:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:2.0:1788200892.252788:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:2.0:1788200892.252794:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715045376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200892.252827:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715045376:12345-0@lo:400:kworker.0 Request processed in 34us (2959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200892.252845:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00100000:2.0:1788200892.252859:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:2.0:1788200892.252864:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715046400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200892.252907:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715046400:12345-0@lo:400:kworker.0 Request processed in 43us (2043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200892.252913:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00100000:2.0:1788200892.252946:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715045376:0@lo:400:kworker.0 00000100:00100000:2.0:1788200892.252956:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc139ba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715046400:0@lo:400:kworker.0 00000100:00100000:3.0:1788200892.253193:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715045632:0@lo:400:kworker.0 00000100:00100000:3.0:1788200892.253203:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715046144:0@lo:400:kworker.0 00000100:00100000:3.0:1788200892.253250:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200892.253302:0:85235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715045248 00000100:00100000:3.0:1788200892.253306:0:85235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715045248 00000100:00100000:3.0:1788200892.253339:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788200892.253346:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715045248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200892.253382:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715045248:12345-0@lo:400:kworker.0 Request processed in 36us (11901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200892.253387:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788200892.253423:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715046272 00000100:00100000:3.0:1788200892.253427:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715046272 00000100:00100000:3.0:1788200892.253455:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715046144 00000100:00100000:3.0:1788200892.253458:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715046144 00000100:00100000:3.0:1788200892.253478:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2597 00000100:00100000:3.0:1788200892.253484:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140297800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715046272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200892.253517:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140297800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715046272:12345-0@lo:400:kworker.0 Request processed in 33us (11937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200892.253523:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2597 00000100:00100000:3.0:1788200892.253534:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598 00000100:00100000:3.0:1788200892.253540:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715046144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200892.253568:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715046144:12345-0@lo:400:kworker.0 Request processed in 29us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200892.253584:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598 00000100:00100000:3.0:1788200892.253615:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200892.253666:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715046016 00000100:00100000:3.0:1788200892.253669:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715046016 00000100:00100000:3.0:1788200892.253692:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:3.0:1788200892.253698:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715046016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200892.253732:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715046016:12345-0@lo:400:kworker.0 Request processed in 35us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200892.253739:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00100000:3.0:1788200892.253769:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715046016:0@lo:400:kworker.0 00000100:00100000:3.0:1788200892.253786:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715045504:0@lo:400:kworker.0 00000100:00100000:0.0:1788200892.253788:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715045504:12345-0@lo:400:kworker.0 Request processed in 6045us (12277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200892.253795:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:3.0:1788200892.253804:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715046144:0@lo:400:kworker.0 00000100:00100000:3.0:1788200892.253814:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc139ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715046272:0@lo:400:kworker.0 00000100:00100000:3.0:1788200892.253822:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715045248:0@lo:400:kworker.0 00000100:00100000:0.0:1788200892.253839:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:0.0:1788200892.253845:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715045760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200892.253878:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715045760:12345-0@lo:400:kworker.0 Request processed in 33us (12337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200892.253884:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:3.0:1788200892.253920:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715045760:0@lo:400:kworker.0 00000100:00080000:1.0:1788200892.254197:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788200892.254202:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788200892.254204:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788200892.254206:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788200892.751517:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715046528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788200892.751599:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200892.752044:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715046528 00000100:00100000:1.0:1788200892.752053:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715046528 00000100:00100000:1.0:1788200892.752100:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2104 00000100:00100000:1.0:1788200892.752109:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715046528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788200892.752130:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200892.752175:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715046528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200892.752196:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2104 00000100:00100000:3.0:1788200892.753892:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc139ba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715046784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788200892.753953:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200892.753993:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788200892.754000:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715046656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788200892.754061:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200892.754096:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715046656 00000100:00100000:3.0:1788200892.754101:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715046656 00000100:00100000:3.0:1788200892.754140:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2105 00000100:00100000:3.0:1788200892.754163:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715046656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788200892.754181:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200892.754238:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715046656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200892.754245:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2105 00000100:00100000:3.0:1788200892.754272:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715046784 00000100:00100000:3.0:1788200892.754276:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715046784 00000100:00100000:3.0:1788200892.754305:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3829 00000100:00100000:3.0:1788200892.754311:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715046784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788200892.754335:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444974592 avail 1298735104 00000100:00100000:3.0:1788200892.754367:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715046784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200892.754372:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3829 00000100:00100000:3.0:1788200892.754418:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715046656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788200892.754431:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc139ba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715046784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788200892.754491:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715046528:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788200893.207124:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788200894.158254:0:86056:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130b: DoM file create (inherited) replay ========================================================== 14:28:12 (1788200892) 00010000:00010000:1.0:1788200894.228458:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788200894.338919:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200894.339053:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695336832 00000100:00100000:0.0:1788200894.339067:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695336832 00000100:00100000:0.0:1788200894.339156:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1095 00000100:00100000:0.0:1788200894.339169:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+7:66371:x1875060695336832:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788200894.339197:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200894.339225:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a904 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786570 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.339314:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a90b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.339330:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a90b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.339363:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a90b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.339383:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a912 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.339391:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a912 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.339398:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a912 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.339471:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a90b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.339480:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a90b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.339486:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a90b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.339493:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a90b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.339500:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce9000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788200894.339506:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a90b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.339514:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a90b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.339531:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12f34f300) 00010000:00010000:0.0:1788200894.339551:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788200894.339559:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a90b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.339566:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a90b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.339588:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a912 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.339595:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a912 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.339602:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a912 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.339607:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788200894.339610:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a912 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.339617:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a912 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.339625:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff8dc137d07f00) 00010000:00010000:0.0:1788200894.339628:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788200894.339631:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a912 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.339637:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a912 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.339677:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a904 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786570 expref: 8 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.339697:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12f34f300) 00010000:00010000:0.0:1788200894.339699:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788200894.339703:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a904 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786570 expref: 8 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.339713:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ce8c00, rc 0) 00000100:00100000:0.0:1788200894.339796:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+7:66371:x1875060695336832:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 629us (893us total) trans 0 rc 301/301 00000100:00100000:0.0:1788200894.339805:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1095 00000100:00080000:3.0:1788200894.340550:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788200894.357398:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200894.357593:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695337088 00000100:00100000:2.0:1788200894.357615:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695337088 00000100:00100000:2.0:1788200894.357706:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1096 00000100:00100000:2.0:1788200894.357719:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+7:66371:x1875060695337088:12345-192.168.201.20@tcp:36:lfs.0 00010000:00010000:2.0:1788200894.357806:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788200894.357862:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ac600/0x96d0c9b8c9a1a8c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786562 expref: 7 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200894.357893:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12f34f300) 00010000:00010000:2.0:1788200894.357907:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788200894.358004:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1a919 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200894.358052:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1a919 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200894.358078:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1a919 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200894.358110:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031e00/0x96d0c9b8c9a1a920 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200894.358119:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031e00/0x96d0c9b8c9a1a920 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200894.358127:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031e00/0x96d0c9b8c9a1a920 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200894.364262:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1a927 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200894.364292:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1a927 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200894.364305:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1a927 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788200894.364326:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eff8d44b reply state 000000006a1afb7b transno 103079215105 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1a927 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200894.364339:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1a927 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200894.364348:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8dc1207c9100) 00010000:00010000:2.0:1788200894.364351:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788200894.364356:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788200894.364364:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788200894.364375:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1a919 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200894.364382:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1a919 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200894.364395:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1a919 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200894.364403:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1a919 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200894.364410:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100031200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788200894.364592:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1a919 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200894.364604:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1a919 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200894.364618:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc1207c9600) 00010000:00010000:2.0:1788200894.364621:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788200894.364625:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1a919 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200894.364632:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1a919 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788200894.364793:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eff8d44b reply state 000000006a1afb7b transno 103079215105 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031e00/0x96d0c9b8c9a1a920 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200894.364804:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031e00/0x96d0c9b8c9a1a920 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200894.364810:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff8dc1207c9400) 00010000:00010000:2.0:1788200894.364813:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788200894.364815:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788200894.365064:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+8:66371:x1875060695337088:12345-192.168.201.20@tcp:36:lfs.0 Request processed in 7342us (7677us total) trans 103079215105 rc 0/0 00000100:00100000:2.0:1788200894.365082:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1096 00000100:00100000:0.0:1788200894.415202:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200894.415673:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695337216 00000100:00100000:1.0:1788200894.415702:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695337216 00000100:00100000:1.0:1788200894.415784:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1097 00000100:00100000:1.0:1788200894.415797:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+8:66375:x1875060695337216:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1788200894.415833:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788200894.415884:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad400/0x96d0c9b8c9a1a92e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786577 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200894.415978:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079acc00/0x96d0c9b8c9a1a935 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200894.415996:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079acc00/0x96d0c9b8c9a1a935 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200894.416011:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079acc00/0x96d0c9b8c9a1a935 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788200894.416098:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788200894.416102:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788200894.416129:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079acc00/0x96d0c9b8c9a1a935 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200894.416158:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad400/0x96d0c9b8c9a1a92e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786577 expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200894.416179:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079acc00/0x96d0c9b8c9a1a935 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786577 expref: 9 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200894.416189:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12066f700) 00010000:00010000:1.0:1788200894.416192:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788200894.416196:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0079acc00, rc 0) 00000100:00100000:1.0:1788200894.416284:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+9:66375:x1875060695337216:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 488us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200894.416292:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1097 00000100:00100000:3.0:1788200894.435173:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200894.435282:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695337344 00000100:00100000:0.0:1788200894.435296:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695337344 00000100:00100000:0.0:1788200894.435376:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1098 00000100:00100000:0.0:1788200894.435390:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+9:66375:x1875060695337344:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788200894.435420:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200894.435447:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a93c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78657e expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.435552:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a943 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.435575:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a943 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.435590:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a943 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.435633:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a94a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.435642:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a94a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.435649:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a94a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.435743:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a951 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.435752:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a951 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.435759:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a951 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788200894.435813:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788200894.435817:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788200894.435868:0:66312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a951 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.435883:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a943 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.435889:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a943 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.435897:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a943 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.435912:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a943 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.435919:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788200894.435924:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a943 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.435933:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a943 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.435950:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12066f700) 00010000:00010000:0.0:1788200894.435953:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788200894.435958:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a943 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.435965:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a943 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.435978:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a94a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.435985:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a94a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.435991:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a94a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.435996:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce9000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788200894.435999:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a94a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.436043:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a94a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.436053:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff8dc1207c9400) 00010000:00010000:0.0:1788200894.436055:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788200894.436059:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a94a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.436065:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a94a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.436096:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a93c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78657e expref: 11 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.436111:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a951 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78657e expref: 10 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.436118:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8dc1207c9100) 00010000:00010000:0.0:1788200894.436121:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788200894.436123:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ce8000, rc 0) 00000100:00100000:0.0:1788200894.436200:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+10:66375:x1875060695337344:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 814us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200894.436209:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1098 00000100:00100000:3.0:1788200894.440650:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200894.440885:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695337600 00000100:00100000:0.0:1788200894.440899:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695337600 00000100:00100000:0.0:1788200894.440982:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1099 00000100:00100000:0.0:1788200894.440995:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+10:66375:x1875060695337600:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788200894.441072:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200894.441100:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8e00/0x96d0c9b8c9a1a958 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786585 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788200894.441238:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788200894.441369:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8e00/0x96d0c9b8c9a1a958 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786585 expref: 12 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.441389:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12066f700) 00010000:00010000:0.0:1788200894.441392:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788200894.441398:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8e00/0x96d0c9b8c9a1a958 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786585 expref: 12 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200894.441426:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ce8e00, rc 0) 00000100:00100000:0.0:1788200894.441504:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+11:66375:x1875060695337600:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 511us (868us total) trans 103079215106 rc 301/301 00000100:00100000:0.0:1788200894.441512:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1099 00000100:00100000:0.0:1788200894.448216:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200894.448305:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695337856 00000100:00100000:3.0:1788200894.448319:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695337856 00000100:00100000:3.0:1788200894.448390:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1100 00000100:00100000:3.0:1788200894.448401:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+11:66375:x1875060695337856:12345-192.168.201.20@tcp:36:lfs.0 00010000:00010000:3.0:1788200894.448505:0:69485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788200894.448541:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a951 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78657e expref: 11 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200894.448567:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8dc1207c9100) 00010000:00010000:3.0:1788200894.448574:0:69485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788200894.448937:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1a966 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200894.448955:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1a966 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200894.448968:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1a966 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788200894.449210:0:69485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006638f3d3 reply state 00000000d671357c transno 103079215107 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1a966 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200894.449226:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1a966 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200894.449233:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8dc1207c9100) 00010000:00010000:3.0:1788200894.449236:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1788200894.449239:0:69485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788200894.449248:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000100:00100000:3.0:1788200894.449346:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+12:66375:x1875060695337856:12345-192.168.201.20@tcp:36:lfs.0 Request processed in 946us (1144us total) trans 103079215107 rc 0/0 00000100:00100000:3.0:1788200894.449355:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1100 00000100:00100000:1.0:1788200894.458459:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200894.458685:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695338112 00000100:00100000:0.0:1788200894.458702:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695338112 00000100:00100000:0.0:1788200894.458777:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 217 00000100:00100000:0.0:1788200894.458792:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4292087e-fa00-4621-b681-837afc99ae35+12:66375:x1875060695338112:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:0.0:1788200894.459154:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4292087e-fa00-4621-b681-837afc99ae35+13:66375:x1875060695338112:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 365us (703us total) trans 103079215108 rc 0/0 00000100:00100000:0.0:1788200894.459165:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 217 00010000:00010000:0.0:1788200895.247245:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788200895.406957:0:85229:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215108 is committed 00010000:00010000:2.0:1788200895.407321:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031e00/0x96d0c9b8c9a1a920 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.407335:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031e00/0x96d0c9b8c9a1a920 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.407345:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031e00/0x96d0c9b8c9a1a920 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.407353:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100031e00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788200895.407358:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031e00/0x96d0c9b8c9a1a920 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.407366:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031e00/0x96d0c9b8c9a1a920 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.407384:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff8dc1207c9400) 00010000:00010000:2.0:1788200895.407387:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788200895.407392:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031e00/0x96d0c9b8c9a1a920 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.407397:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031e00/0x96d0c9b8c9a1a920 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.407415:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1a927 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.407422:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1a927 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.407440:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1a927 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.407444:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788200895.407447:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1a927 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.407453:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1a927 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.407462:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8dc1207c9100) 00010000:00010000:2.0:1788200895.407464:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788200895.407467:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1a927 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.407473:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1a927 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.407488:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1a966 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.407495:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1a966 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.407501:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1a966 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.407505:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fc400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788200895.407508:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1a966 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.407524:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1a966 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.407545:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8dc1207c9100) 00010000:00010000:2.0:1788200895.407548:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788200895.407551:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1a966 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.407556:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1a966 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200895.509908:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200895.514970:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695338240 00000100:00100000:0.0:1788200895.514987:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695338240 00000100:00100000:0.0:1788200895.515076:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1101 00000100:00100000:0.0:1788200895.515087:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+7:66385:x1875060695338240:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:0.0:1788200895.515125:0:66314:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444970496 avail 1298731008 00000100:00100000:0.0:1788200895.515199:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+7:66385:x1875060695338240:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 113us (5298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200895.515206:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1101 00000100:00100000:1.0:1788200895.518009:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200895.518867:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695338368 00000100:00100000:2.0:1788200895.518879:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695338368 00000100:00100000:2.0:1788200895.518958:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1102 00000100:00100000:2.0:1788200895.518970:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:66385:x1875060695338368:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:2.0:1788200895.519009:0:66757:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:2.0:1788200895.519099:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:66385:x1875060695338368:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 131us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200895.519107:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1102 00000100:00080000:1.0:1788200895.519288:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788200895.523094:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200895.523182:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695338496 00000100:00100000:1.0:1788200895.523192:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695338496 00000100:00080000:3.0:1788200895.523233:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788200895.523317:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2106 00000100:00100000:1.0:1788200895.523330:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:66385:x1875060695338496:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:1.0:1788200895.523363:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200895.523445:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:66385:x1875060695338496:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 118us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200895.523452:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2106 00000100:00100000:2.0:1788200895.526492:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200895.526575:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695338624 00000100:00100000:3.0:1788200895.526583:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695338624 00000100:00100000:3.0:1788200895.526690:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2107 00000100:00100000:3.0:1788200895.526702:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:66385:x1875060695338624:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:3.0:1788200895.526733:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200895.526792:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:66385:x1875060695338624:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 93us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200895.526799:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2107 00000100:00080000:0.0:1788200895.527350:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788200895.619120:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200895.619192:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695338880 00000100:00100000:0.0:1788200895.619201:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695338880 00000100:00100000:0.0:1788200895.619254:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1103 00000100:00100000:0.0:1788200895.619264:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+7:66392:x1875060695338880:12345-192.168.201.20@tcp:36:mcreate.0 00010000:00010000:0.0:1788200895.619322:0:66312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788200895.619349:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079acc00/0x96d0c9b8c9a1a935 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786577 expref: 7 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.619367:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12066f700) 00010000:00010000:0.0:1788200895.619376:0:66312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788200895.619424:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a96d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.619434:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a96d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.619441:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a96d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.619459:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a974 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.619464:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a974 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.619468:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a974 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.619772:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a96d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.619780:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a96d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.619785:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a96d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.619789:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a96d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.619793:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce9000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788200895.619797:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a96d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.619801:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a96d lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.619808:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc137d07c00) 00010000:00010000:0.0:1788200895.619810:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788200895.619812:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a96d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.619821:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a96d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788200895.619844:0:66312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ec8d70b reply state 000000007afb908f transno 103079215109 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a974 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.619857:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a974 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.619867:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc137d07200) 00010000:00010000:0.0:1788200895.619870:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788200895.619873:0:66312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788200895.620063:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+8:66392:x1875060695338880:12345-192.168.201.20@tcp:36:mcreate.0 Request processed in 800us (949us total) trans 103079215109 rc 0/0 00000100:00100000:0.0:1788200895.620071:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1103 00000100:00100000:3.0:1788200895.645793:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200895.646566:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695339008 00000100:00100000:2.0:1788200895.646579:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695339008 00000100:00100000:3.0:1788200895.646815:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1104 00000100:00100000:3.0:1788200895.646835:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+8:66395:x1875060695339008:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:3.0:1788200895.646858:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788200895.646882:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1a97b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78658c expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.646951:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1a982 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.646965:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1a982 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.646975:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1a982 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788200895.647040:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788200895.647044:0:66313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788200895.647065:0:66313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1a982 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.647106:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1a97b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78658c expref: 10 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.647123:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1a982 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78658c expref: 9 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.647131:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc107112a00) 00010000:00010000:3.0:1788200895.647133:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788200895.647150:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fca00, rc 0) 00000100:00100000:3.0:1788200895.647526:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+9:66395:x1875060695339008:12345-192.168.201.20@tcp:101:rm.0 Request processed in 700us (1743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200895.647533:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1104 00000100:00100000:0.0:1788200895.651528:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200895.651747:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695339136 00000100:00100000:3.0:1788200895.651757:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695339136 00000100:00100000:3.0:1788200895.651817:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1105 00000100:00100000:3.0:1788200895.651837:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+9:66395:x1875060695339136:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:3.0:1788200895.651857:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788200895.651876:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fda00/0x96d0c9b8c9a1a989 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786593 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.651943:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1a990 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.651956:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1a990 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.651967:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1a990 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.651989:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1a997 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.651997:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1a997 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.652004:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1a997 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.652175:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1a99e lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.652193:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1a99e lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.652200:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1a99e lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788200895.652324:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788200895.652327:0:69485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788200895.652343:0:69485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1a99e lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.652355:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1a99e lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.652363:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1a990 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.652369:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1a990 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.652385:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1a990 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.652401:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1a990 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.652407:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788200895.652411:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1a990 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.652418:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1a990 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.652846:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc107112a00) 00010000:00010000:3.0:1788200895.652849:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788200895.652854:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1a990 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.652861:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1a990 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.652875:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1a997 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.652881:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1a997 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.652887:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1a997 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.652892:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788200895.652901:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1a997 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.652908:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1a997 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.652915:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc137d07200) 00010000:00010000:3.0:1788200895.652917:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788200895.652920:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1a997 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.652926:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1a997 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.652951:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fda00/0x96d0c9b8c9a1a989 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786593 expref: 11 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.652964:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1a99e lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786593 expref: 10 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200895.652971:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff8dc107112700) 00010000:00010000:3.0:1788200895.652973:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788200895.652975:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fc600, rc 0) 00000100:00100000:3.0:1788200895.653104:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+10:66395:x1875060695339136:12345-192.168.201.20@tcp:101:rm.0 Request processed in 1278us (1586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200895.653111:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1105 00000100:00100000:1.0:1788200895.662698:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200895.662774:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695339392 00000100:00100000:0.0:1788200895.662785:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695339392 00000100:00100000:0.0:1788200895.662857:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1106 00000100:00100000:0.0:1788200895.662868:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+10:66395:x1875060695339392:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:0.0:1788200895.662921:0:66312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788200895.662949:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1a99e lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786593 expref: 10 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.662968:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff8dc107112700) 00010000:00010000:0.0:1788200895.662986:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1a982 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78658c expref: 9 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663064:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc107112a00) 00010000:00010000:0.0:1788200895.663073:0:66312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788200895.663099:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a9a5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663112:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a9a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663122:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a9a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663132:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a9ac lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663141:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a9ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663148:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a9ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663240:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8e00/0x96d0c9b8c9a1a9b3 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663248:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8e00/0x96d0c9b8c9a1a9b3 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663255:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8e00/0x96d0c9b8c9a1a9b3 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663456:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a9ba lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663475:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a9ba lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663482:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a9ba lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663489:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a9ba lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663495:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a9ba lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663500:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a9ba lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663525:0:66312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788200895.663544:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8e00/0x96d0c9b8c9a1a9b3 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663550:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8e00/0x96d0c9b8c9a1a9b3 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663556:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8e00/0x96d0c9b8c9a1a9b3 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663561:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8e00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788200895.663565:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8e00/0x96d0c9b8c9a1a9b3 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663573:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8e00/0x96d0c9b8c9a1a9b3 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663592:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff8dc137d07400) 00010000:00010000:0.0:1788200895.663594:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788200895.663598:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8e00/0x96d0c9b8c9a1a9b3 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663604:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8e00/0x96d0c9b8c9a1a9b3 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663619:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a9a5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663626:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a9a5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663631:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a9a5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663637:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a9a5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663642:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce9000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788200895.663646:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a9a5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663651:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a9a5 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663658:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc137d07c00) 00010000:00010000:0.0:1788200895.663661:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788200895.663664:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a9a5 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.663675:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788200895.663688:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1a9a5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.663690:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a9ba lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.663696:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8000 already unused, calling callback (ffffffffc0c83230) 00000004:00010000:0.0:1788200895.663702:0:66312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009bbc5ad8 reply state 000000000e9814c8 transno 103079215110 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a9ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.663706:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a9ba lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.663712:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a9ba lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663713:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a9ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200895.663720:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc137d07200) 00010000:00010000:2.0:1788200895.663721:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff8dc137d07400) 00010000:00010000:0.0:1788200895.663722:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788200895.663725:0:66312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788200895.663732:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788200895.663735:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a9ba lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.663740:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1a9ba lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200895.663752:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200895.663753:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200895.663755:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788200895.663797:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+10:66395:x1875060695339392:12345-192.168.201.20@tcp:36:rm.0 Request processed in 931us (1119us total) trans 103079215110 rc 0/0 00000100:00100000:0.0:1788200895.663805:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1106 00010000:00010000:2.0:1788200896.276906:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788200896.848145:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788200896.848163:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715046912:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788200896.848218:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200896.848262:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715046912 00000100:00100000:0.0:1788200896.848271:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715046912 00000100:00100000:0.0:1788200896.848359:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2108 00000100:00100000:0.0:1788200896.848370:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715046912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788200896.848399:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200896.848443:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715046912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200896.848450:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2108 00000100:00080000:0.0:1788200896.848470:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788200896.848508:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715046912:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788200896.848739:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715047040:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788200896.848766:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200896.848851:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715047040 00000100:00100000:1.0:1788200896.848856:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715047040 00000100:00100000:1.0:1788200896.848894:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2109 00000100:00100000:1.0:1788200896.848902:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715047040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788200896.848919:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200896.848954:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715047040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200896.848962:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2109 00000100:00080000:0.0:1788200896.849039:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788200896.849065:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715047040:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788200896.984254:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200896.984302:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200896.984334:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200896.984357:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200896.984398:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200896.984426:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695339648 00000100:00100000:3.0:1788200896.984435:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695339648 00000100:00100000:3.0:1788200896.984491:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695339776 00000100:00100000:3.0:1788200896.984495:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695339776 00000100:00100000:3.0:1788200896.984516:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1116 00000100:00100000:3.0:1788200896.984526:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+10:2403:x1875060695339648:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000080:3.0:1788200896.984560:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc1331b4700 x1875060695339648/t0(0) o400->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:17/0 lens 224/224 e 0 to 0 dl 1788200907 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788200896.984618:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+10:2403:x1875060695339648:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 93us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200896.984625:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1116 00000100:00100000:3.0:1788200896.984645:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1117 00000100:00100000:3.0:1788200896.984651:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695339776:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200896.984673:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695339776:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200896.984679:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1117 00000100:00100000:3.0:1788200896.984696:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695339904 00000100:00100000:3.0:1788200896.984699:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695339904 00000100:00100000:3.0:1788200896.984718:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695340032 00000100:00100000:3.0:1788200896.984720:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695340032 00000100:00100000:3.0:1788200896.984733:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2599 00000100:00100000:3.0:1788200896.984738:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695339904:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200896.984757:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695339904:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 19us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200896.984763:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2599 00000100:00100000:3.0:1788200896.984779:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2600 00000100:00100000:3.0:1788200896.984784:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695340032:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200896.984801:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695340032:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 17us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200896.984835:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2600 00000100:00080000:3.0:1788200896.984849:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788200896.985330:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695339520 00000100:00100000:1.0:1788200896.985336:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695339520 00000100:00100000:1.0:1788200896.985371:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 84 00000100:00100000:1.0:1788200896.985378:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2403:x1875060695339520:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788200896.985424:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2403:x1875060695339520:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 47us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200896.985431:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 84 00010000:00010000:1.0:1788200897.296525:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200897.359212:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715047168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788200897.359292:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200897.359395:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715047168 00000100:00100000:3.0:1788200897.359402:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715047168 00000100:00100000:3.0:1788200897.359454:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3830 00000100:00100000:3.0:1788200897.359464:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715047168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788200897.359496:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:3.0:1788200897.359541:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715047168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200897.359548:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3830 00000100:00100000:1.0:1788200897.359632:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715047168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788200897.363382:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715047296:0@lo:400:kworker.0 00000100:00100000:0.0:1788200897.363452:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200897.363602:0:85235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715047296 00000100:00100000:3.0:1788200897.363611:0:85235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715047296 00000100:00100000:3.0:1788200897.363660:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788200897.363670:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715047296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200897.367222:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715047424:0@lo:400:kworker.0 00000100:00100000:1.0:1788200897.367293:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200897.367337:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715047936:0@lo:400:kworker.0 00000100:00100000:1.0:1788200897.367361:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200897.367379:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715048448:0@lo:400:kworker.0 00000100:00100000:1.0:1788200897.367396:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200897.367418:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788200897.367424:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715047552:0@lo:400:kworker.0 00000100:00100000:1.0:1788200897.367444:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200897.367461:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715048064:0@lo:400:kworker.0 00000100:00100000:1.0:1788200897.367480:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200897.367514:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715047424 00000100:00100000:1.0:1788200897.367520:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715047424 00000100:00100000:1.0:1788200897.367566:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715048448 00000100:00100000:1.0:1788200897.367569:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715048448 00000100:00100000:1.0:1788200897.367579:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715047552 00000100:00100000:1.0:1788200897.367581:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715047552 00000100:00100000:1.0:1788200897.367591:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715048064 00000100:00100000:1.0:1788200897.367601:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715048064 00000100:00100000:1.0:1788200897.367616:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1788200897.367623:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715047424:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788200897.367644:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc005d5bb80 x1875060715047424/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:18/0 lens 224/224 e 0 to 0 dl 1788200908 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788200897.367682:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715047424:12345-0@lo:400:kworker.0 Request processed in 59us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200897.367689:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1788200897.367708:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:1.0:1788200897.367714:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715048448:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788200897.367726:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc005d5aa00 x1875060715048448/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:18/0 lens 224/224 e 0 to 0 dl 1788200908 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788200897.367751:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715048448:12345-0@lo:400:kworker.0 Request processed in 37us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200897.367757:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:1.0:1788200897.367769:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:1.0:1788200897.367775:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715047552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200897.367814:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715047552:12345-0@lo:400:kworker.0 Request processed in 39us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200897.367819:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00100000:1.0:1788200897.367830:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1788200897.367836:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715048064:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788200897.367846:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc005d5ad80 x1875060715048064/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:18/0 lens 224/224 e 0 to 0 dl 1788200908 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788200897.367870:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715048064:12345-0@lo:400:kworker.0 Request processed in 35us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200897.367882:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1788200897.367902:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715047936 00000100:00100000:1.0:1788200897.367905:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715047936 00000100:00100000:1.0:1788200897.367931:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3831 00000100:00100000:1.0:1788200897.367937:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715047936:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788200897.367950:0:8457:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc005d5b800 x1875060715047936/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:18/0 lens 224/224 e 0 to 0 dl 1788200908 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788200897.367976:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715047936:12345-0@lo:400:kworker.0 Request processed in 39us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200897.367982:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3831 00000100:00080000:1.0:1788200897.368007:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788200897.368011:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788200897.368069:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715047680:0@lo:400:kworker.0 00000100:00100000:1.0:1788200897.368094:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200897.368110:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715048192:0@lo:400:kworker.0 00000100:00100000:1.0:1788200897.368132:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200897.368152:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788200897.368158:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715047808:0@lo:400:kworker.0 00000100:00100000:1.0:1788200897.368178:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200897.368193:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715048320:0@lo:400:kworker.0 00000100:00100000:1.0:1788200897.368214:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200897.368238:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715048192 00000100:00100000:1.0:1788200897.368241:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715048192 00000100:00100000:1.0:1788200897.368271:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715048320 00000100:00100000:1.0:1788200897.368274:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715048320 00000100:00100000:1.0:1788200897.368294:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:1.0:1788200897.368306:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715048192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200897.368340:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715048192:12345-0@lo:400:kworker.0 Request processed in 35us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200897.368346:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00000100:00100000:1.0:1788200897.368357:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602 00000100:00100000:1.0:1788200897.368363:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715048320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200897.368388:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715048320:12345-0@lo:400:kworker.0 Request processed in 26us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200897.368393:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602 00000100:00100000:1.0:1788200897.368416:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715047680 00000100:00100000:1.0:1788200897.368419:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715047680 00000100:00100000:1.0:1788200897.368441:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715047808 00000100:00100000:1.0:1788200897.368444:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715047808 00000100:00100000:1.0:1788200897.368460:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:1.0:1788200897.368465:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715047680:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788200897.368477:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc005d59880 x1875060715047680/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:18/0 lens 224/224 e 0 to 0 dl 1788200908 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788200897.368504:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715047680:12345-0@lo:400:kworker.0 Request processed in 39us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200897.368510:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:1.0:1788200897.368521:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:1.0:1788200897.368527:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715047808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200897.368553:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715047808:12345-0@lo:400:kworker.0 Request processed in 27us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200897.368559:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00080000:1.0:1788200897.368577:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788200897.368585:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788200897.368588:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788200897.368589:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788200897.368616:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715047552:0@lo:400:kworker.0 00000100:00100000:1.0:1788200897.368629:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715048064:0@lo:400:kworker.0 00000100:00100000:1.0:1788200897.368639:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715047424:0@lo:400:kworker.0 00000100:00100000:1.0:1788200897.368648:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715047936:0@lo:400:kworker.0 00000100:00100000:1.0:1788200897.368656:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715048448:0@lo:400:kworker.0 00000100:00100000:1.0:1788200897.368685:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715047808:0@lo:400:kworker.0 00000100:00100000:1.0:1788200897.368693:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715048320:0@lo:400:kworker.0 00000100:00100000:1.0:1788200897.368700:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715047680:0@lo:400:kworker.0 00000100:00100000:1.0:1788200897.368707:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715048192:0@lo:400:kworker.0 00000100:00100000:3.0:1788200897.368906:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715047296:12345-0@lo:400:kworker.0 Request processed in 5236us (5451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200897.368914:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788200897.369080:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715047296:0@lo:400:kworker.0 00000100:00100000:3.0:1788200897.871301:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788200897.871324:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715048576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788200897.871373:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715048704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788200897.871395:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200897.871424:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200897.872994:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715048832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788200897.873002:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715048704 00000100:00100000:2.0:1788200897.873011:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715048704 00000100:00100000:3.0:1788200897.873052:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200897.873122:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3832 00000100:00100000:1.0:1788200897.873134:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715048704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788200897.873167:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444970496 avail 1298731008 00010000:00000080:1.0:1788200897.873182:0:23728:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11cd18a80 x1875060715048704/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:18/0 lens 224/368 e 0 to 0 dl 1788200908 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788200897.873225:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715048704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (1801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200897.873231:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3832 00000100:00100000:1.0:1788200897.873283:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715048704:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788200897.881157:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715048576 00000100:00100000:0.0:1788200897.881172:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715048576 00000100:00100000:1.0:1788200897.883727:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715048832 00000100:00100000:1.0:1788200897.883741:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715048832 00000100:00100000:3.0:1788200897.887579:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2110 00000100:00100000:3.0:1788200897.887593:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715048576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788200897.887621:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200897.887712:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715048576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (16318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200897.887718:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2110 00000100:00100000:2.0:1788200897.888215:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715048576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788200897.890352:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2111 00000100:00100000:3.0:1788200897.890366:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715048832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788200897.890402:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200897.890480:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715048832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (17428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200897.890487:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2111 00000100:00100000:2.0:1788200897.890669:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715048832:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788200898.319140:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200899.350131:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200900.367385:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200901.392822:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788200901.458243:0:85229:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215110 is committed 00010000:00010000:0.0:1788200901.458272:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a974 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200901.458284:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a974 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200901.458292:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a974 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200901.458298:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788200901.458304:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a974 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200901.458311:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a974 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200901.458329:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc137d07200) 00010000:00010000:0.0:1788200901.458339:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788200901.458345:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a974 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200901.458351:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8200/0x96d0c9b8c9a1a974 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200901.458368:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a9ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200901.458372:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a9ac lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200901.458378:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a9ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200901.458383:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788200901.458386:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a9ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200901.458391:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a9ac lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200901.458399:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc137d07200) 00010000:00010000:0.0:1788200901.458401:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788200901.458404:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a9ac lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200901.458409:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8c00/0x96d0c9b8c9a1a9ac lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788200901.969198:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715048960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788200901.969281:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200901.969346:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715048960 00000100:00100000:1.0:1788200901.969354:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715048960 00000100:00100000:1.0:1788200901.969411:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2112 00000100:00100000:1.0:1788200901.969420:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715048960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788200901.969453:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200901.969499:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715048960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200901.969506:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2112 00000100:00080000:1.0:1788200901.969528:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788200901.969566:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715048960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788200901.969832:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715049088:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788200901.969858:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200901.969930:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715049088 00000100:00100000:2.0:1788200901.969934:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715049088 00000100:00100000:2.0:1788200901.969969:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2113 00000100:00100000:2.0:1788200901.969975:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715049088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788200901.969991:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788200901.970048:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715049088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200901.970066:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2113 00000100:00080000:1.0:1788200901.970169:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788200901.970190:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715049088:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788200902.100387:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200902.100425:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200902.100459:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200902.100474:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200902.100496:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200902.100546:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695340544 00000100:00100000:0.0:1788200902.100562:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695340544 00000100:00100000:0.0:1788200902.100622:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695340672 00000100:00100000:0.0:1788200902.100625:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695340672 00000100:00100000:0.0:1788200902.100645:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2603 00000100:00100000:0.0:1788200902.100654:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:4292087e-fa00-4621-b681-837afc99ae35+5:2402:x1875060695340544:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200902.100738:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:4292087e-fa00-4621-b681-837afc99ae35+5:2402:x1875060695340544:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 85us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200902.100745:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2603 00000100:00100000:0.0:1788200902.100760:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2604 00000100:00100000:0.0:1788200902.100766:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:4292087e-fa00-4621-b681-837afc99ae35+5:2402:x1875060695340672:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200902.100786:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:4292087e-fa00-4621-b681-837afc99ae35+5:2402:x1875060695340672:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 20us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200902.100791:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2604 00000100:00100000:1.0:1788200902.100978:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695340288 00000100:00100000:1.0:1788200902.100982:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695340288 00000100:00100000:1.0:1788200902.101041:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695340416 00000100:00100000:1.0:1788200902.101044:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695340416 00000100:00100000:1.0:1788200902.101064:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1124 00000100:00100000:1.0:1788200902.101071:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695340288:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000080:1.0:1788200902.101085:0:66757:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11cc40a80 x1875060695340288/t0(0) o400->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:23/0 lens 224/224 e 0 to 0 dl 1788200913 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788200902.101121:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695340288:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 51us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200902.101127:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1124 00000100:00100000:1.0:1788200902.101141:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1125 00000100:00100000:1.0:1788200902.101147:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695340416:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788200902.101166:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695340416:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 20us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200902.101172:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1125 00000100:00100000:1.0:1788200902.101188:0:85236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695340160 00000100:00100000:1.0:1788200902.101191:0:85236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695340160 00000100:00100000:1.0:1788200902.101212:0:85236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00100000:1.0:1788200902.101218:0:85236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2402:x1875060695340160:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788200902.101238:0:85236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2402:x1875060695340160:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 20us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200902.101243:0:85236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00080000:3.0:1788200902.101428:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788200902.101433:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788200902.101435:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788200902.101437:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788200902.429164:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200902.479378:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715049216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788200902.479458:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200902.479491:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715049216 00000100:00100000:3.0:1788200902.479500:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715049216 00000100:00100000:1.0:1788200902.479520:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715049728:0@lo:400:kworker.0 00000100:00100000:3.0:1788200902.479545:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3833 00000100:00100000:1.0:1788200902.479546:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200902.479555:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715049216:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788200902.479561:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715050240:0@lo:400:kworker.0 00000100:00100000:1.0:1788200902.479579:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:3.0:1788200902.479587:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:1.0:1788200902.479593:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788200902.479598:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715049344:0@lo:400:kworker.0 00000100:00100000:3.0:1788200902.479626:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715049216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200902.479631:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200902.479638:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3833 00000100:00100000:1.0:1788200902.479655:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715049856:0@lo:400:kworker.0 00000100:00100000:3.0:1788200902.479655:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715050240 00000100:00100000:3.0:1788200902.479658:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715050240 00000100:00100000:1.0:1788200902.479675:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200902.479676:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3834 00000100:00100000:1.0:1788200902.479690:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715050368:0@lo:400:kworker.0 00000100:00100000:1.0:1788200902.479724:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200902.479762:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715049216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788200902.479794:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715049472:0@lo:400:kworker.0 00000100:00100000:1.0:1788200902.479820:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200902.479836:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715049984:0@lo:400:kworker.0 00000100:00100000:1.0:1788200902.479853:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200902.479864:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715050496:0@lo:400:kworker.0 00000100:00100000:1.0:1788200902.479881:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200902.479898:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788200902.479904:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715049600:0@lo:400:kworker.0 00000100:00100000:1.0:1788200902.479925:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200902.479940:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715050112:0@lo:400:kworker.0 00000100:00100000:1.0:1788200902.479956:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200902.479970:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715050624:0@lo:400:kworker.0 00000100:00100000:1.0:1788200902.479988:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200902.480012:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715049984 00000100:00100000:1.0:1788200902.480033:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715049984 00000100:00100000:1.0:1788200902.480056:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3835 00000100:00100000:1.0:1788200902.480062:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715049984:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788200902.480077:0:8458:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004fa2300 x1875060715049984/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:23/0 lens 224/224 e 0 to 0 dl 1788200913 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788200902.480117:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715049984:12345-0@lo:400:kworker.0 Request processed in 55us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200902.480124:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3835 00000100:00100000:1.0:1788200902.480145:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715049728 00000100:00100000:1.0:1788200902.480148:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715049728 00000100:00100000:3.0:1788200902.480150:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715050240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200902.480176:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715049856 00000100:00100000:1.0:1788200902.480179:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715049856 00000100:00100000:3.0:1788200902.480185:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715050240:12345-0@lo:400:kworker.0 Request processed in 503us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200902.480191:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3834 00000100:00100000:1.0:1788200902.480206:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715049472 00000100:00100000:1.0:1788200902.480209:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715049472 00000100:00100000:1.0:1788200902.480221:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715049600 00000100:00100000:1.0:1788200902.480224:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715049600 00000100:00100000:1.0:1788200902.480234:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715050112 00000100:00100000:1.0:1788200902.480236:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715050112 00000100:00100000:1.0:1788200902.480244:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:1.0:1788200902.480250:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715049728:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788200902.480261:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc005d58e00 x1875060715049728/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:23/0 lens 224/224 e 0 to 0 dl 1788200913 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788200902.480289:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715049728:12345-0@lo:400:kworker.0 Request processed in 40us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200902.480295:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00100000:1.0:1788200902.480304:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715050624 00000100:00100000:1.0:1788200902.480307:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715050624 00000100:00100000:1.0:1788200902.480321:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:1.0:1788200902.480327:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715049856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200902.480351:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715049856:12345-0@lo:400:kworker.0 Request processed in 25us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200902.480357:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:1.0:1788200902.480375:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:1.0:1788200902.480381:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715049472:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788200902.480391:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11cd18700 x1875060715049472/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:23/0 lens 224/224 e 0 to 0 dl 1788200913 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788200902.480417:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715049472:12345-0@lo:400:kworker.0 Request processed in 36us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200902.480422:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:1.0:1788200902.480433:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:1.0:1788200902.480439:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715049600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200902.480461:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715049600:12345-0@lo:400:kworker.0 Request processed in 23us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200902.480466:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00100000:1.0:1788200902.480478:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:1.0:1788200902.480483:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715050112:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788200902.480491:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004fa2a00 x1875060715050112/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:23/0 lens 224/224 e 0 to 0 dl 1788200913 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788200902.480513:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715050112:12345-0@lo:400:kworker.0 Request processed in 30us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200902.480518:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00100000:1.0:1788200902.480528:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:1.0:1788200902.480533:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715050624:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788200902.480542:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc13a443b80 x1875060715050624/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:23/0 lens 224/224 e 0 to 0 dl 1788200913 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788200902.480563:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715050624:12345-0@lo:400:kworker.0 Request processed in 30us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200902.480572:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:1.0:1788200902.480594:0:85235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715049344 00000100:00100000:1.0:1788200902.480597:0:85235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715049344 00000100:00100000:1.0:1788200902.480631:0:85235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788200902.480638:0:85235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715049344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200902.480670:0:85235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715049344:12345-0@lo:400:kworker.0 Request processed in 33us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200902.480676:0:85235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788200902.480706:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715050368 00000100:00100000:1.0:1788200902.480719:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715050368 00000100:00100000:1.0:1788200902.480748:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715050496 00000100:00100000:1.0:1788200902.480751:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715050496 00000100:00100000:1.0:1788200902.480770:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2605 00000100:00100000:1.0:1788200902.480775:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715050368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200902.480802:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715050368:12345-0@lo:400:kworker.0 Request processed in 27us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200902.480813:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2605 00000100:00100000:1.0:1788200902.480823:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2606 00000100:00100000:1.0:1788200902.480828:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715050496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200902.480852:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715050496:12345-0@lo:400:kworker.0 Request processed in 24us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200902.480857:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2606 00000100:00080000:1.0:1788200902.480883:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788200902.480886:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788200902.480888:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788200902.480890:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788200902.480916:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715049600:0@lo:400:kworker.0 00000100:00100000:1.0:1788200902.480933:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715050112:0@lo:400:kworker.0 00000100:00100000:1.0:1788200902.480942:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715050624:0@lo:400:kworker.0 00000100:00100000:1.0:1788200902.480951:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715049472:0@lo:400:kworker.0 00000100:00100000:1.0:1788200902.480959:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715049984:0@lo:400:kworker.0 00000100:00100000:1.0:1788200902.480966:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715050496:0@lo:400:kworker.0 00000100:00100000:1.0:1788200902.480998:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715049344:0@lo:400:kworker.0 00000100:00100000:1.0:1788200902.481007:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715049856:0@lo:400:kworker.0 00000100:00100000:1.0:1788200902.481031:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715050368:0@lo:400:kworker.0 00000100:00100000:1.0:1788200902.481042:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715049728:0@lo:400:kworker.0 00000100:00100000:1.0:1788200902.481051:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715050240:0@lo:400:kworker.0 00000001:02000400:1.0:1788200902.522626:0:86453:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:3.0:1788200902.674299:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200902.674473:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695340800 00000100:00100000:1.0:1788200902.674484:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695340800 00000100:00100000:1.0:1788200902.674546:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1107 00000100:00100000:1.0:1788200902.674556:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:66462:x1875060695340800:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:1.0:1788200902.674575:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788200902.674597:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ac600/0x96d0c9b8c9a1a9c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78659a expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200902.674670:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1a9c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200902.674693:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1a9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200902.674715:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1a9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788200902.674757:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788200902.674760:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788200902.674808:0:66312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1a9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200902.674834:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ac600/0x96d0c9b8c9a1a9c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78659a expref: 8 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200902.674850:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1a9c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78659a expref: 7 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200902.674857:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12066fc00) 00010000:00010000:1.0:1788200902.674860:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788200902.674863:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0079ada00, rc 0) 00010000:00000080:1.0:1788200902.674870:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc1060cd880 x1875060695340800/t0(0) o101->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:23/0 lens 576/688 e 0 to 0 dl 1788200913 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788200902.674934:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+7:66462:x1875060695340800:12345-192.168.201.20@tcp:101:touch.0 Request processed in 380us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200902.674940:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1107 00000100:00100000:1.0:1788200902.685529:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200902.686138:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695340928 00000100:00100000:3.0:1788200902.686153:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695340928 00000100:00100000:3.0:1788200902.687587:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1108 00000100:00100000:3.0:1788200902.687617:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+7:66462:x1875060695340928:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:3.0:1788200902.687640:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788200902.687661:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fda00/0x96d0c9b8c9a1a9cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7865a1 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.687740:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1a9d6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.687754:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1a9d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.687766:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1a9d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.687793:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1a9dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.687811:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1a9dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.687818:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1a9dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.687904:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1a9e4 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.687912:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1a9e4 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.687919:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1a9e4 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788200902.687956:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788200902.687960:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788200902.687986:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1a9e4 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.687999:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1a9d6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.688006:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1a9d6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.688013:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1a9d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.688052:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1a9d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.688068:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788200902.688072:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1a9d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.688080:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1a9d6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.688093:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12066fc00) 00010000:00010000:3.0:1788200902.688097:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788200902.688102:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1a9d6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.688110:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1a9d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.688126:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1a9dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.688132:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1a9dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.688138:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1a9dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.688143:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788200902.688145:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1a9dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.688151:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1a9dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.688172:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff8dc107112f00) 00010000:00010000:3.0:1788200902.688175:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788200902.688178:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1a9dd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.688184:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1a9dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.688217:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fda00/0x96d0c9b8c9a1a9cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865a1 expref: 9 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.688231:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1a9e4 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865a1 expref: 8 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200902.688239:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8dc107112400) 00010000:00010000:3.0:1788200902.688241:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788200902.688244:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fdc00, rc 0) 00010000:00000080:3.0:1788200902.688253:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc13a442d80 x1875060695340928/t0(0) o101->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:23/0 lens 592/688 e 0 to 0 dl 1788200913 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788200902.689574:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+8:66462:x1875060695340928:12345-192.168.201.20@tcp:101:touch.0 Request processed in 1967us (4047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200902.689585:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1108 00000100:00100000:2.0:1788200902.696970:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200902.701410:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695341184 00000100:00100000:1.0:1788200902.701427:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695341184 00000100:00100000:1.0:1788200902.701580:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1109 00000100:00100000:1.0:1788200902.701591:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+8:66462:x1875060695341184:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:1.0:1788200902.701725:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788200902.701749:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ac600/0x96d0c9b8c9a1a9eb lrc: 2/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7865a8 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200902.701861:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079adc00/0x96d0c9b8c9a1a9f2 lrc: 3/0,1 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200902.701874:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079adc00/0x96d0c9b8c9a1a9f2 lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200902.701886:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079adc00/0x96d0c9b8c9a1a9f2 lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200902.701898:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1a9f9 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200902.701904:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1a9f9 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200902.701910:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1a9f9 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200902.702456:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad200/0x96d0c9b8c9a1aa00 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200902.702466:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad200/0x96d0c9b8c9a1aa00 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200902.702543:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad200/0x96d0c9b8c9a1aa00 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788200902.702594:0:66313:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:1.0:1788200902.702597:0:66313:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb mtime from disk: 0 -> 1788200902 00000004:00010000:1.0:1788200902.702600:0:66313:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb atime from disk: 0 -> 1788200902 00000004:00010000:1.0:1788200902.702602:0:66313:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb ctime from disk: 0 -> 1788200902 00000004:00010000:1.0:1788200902.702604:0:66313:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:1.0:1788200902.702671:0:66313:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:1.0:1788200902.702678:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079adc00/0x96d0c9b8c9a1a9f2 lrc: 4/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200902.702684:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079adc00/0x96d0c9b8c9a1a9f2 lrc: 4/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200902.702691:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079adc00/0x96d0c9b8c9a1a9f2 lrc: 3/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200902.702697:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079adc00/0x96d0c9b8c9a1a9f2 lrc: 4/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200902.702702:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0079adc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788200902.702715:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079adc00/0x96d0c9b8c9a1a9f2 lrc: 4/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200902.702723:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079adc00/0x96d0c9b8c9a1a9f2 lrc: 5/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200902.702734:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8dc107112400) 00010000:00010000:1.0:1788200902.702738:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788200902.702741:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079adc00/0x96d0c9b8c9a1a9f2 lrc: 3/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200902.702757:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079adc00/0x96d0c9b8c9a1a9f2 lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788200902.702770:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d8565bd reply state 0000000018002bbc transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1a9f9 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200902.702922:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1a9f9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200902.702930:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff8dc12066f900) 00010000:00010000:1.0:1788200902.702933:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788200902.702936:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788200902.702966:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ac600/0x96d0c9b8c9a1a9eb lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865a8 expref: 11 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200902.702981:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad200/0x96d0c9b8c9a1aa00 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865a8 expref: 10 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200902.702987:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff8dc12066fe00) 00010000:00010000:1.0:1788200902.702989:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:1.0:1788200902.702992:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0079ad200, rc 0) 00010000:00000080:1.0:1788200902.702999:0:66313:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc0058a8a80 x1875060695341184/t103079215111(0) o101->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:23/0 lens 752/824 e 0 to 0 dl 1788200913 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788200902.703290:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+11:66462:x1875060695341184:12345-192.168.201.20@tcp:101:touch.0 Request processed in 1699us (6325us total) trans 103079215111 rc 0/0 00000100:00100000:1.0:1788200902.703297:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1109 00000100:00100000:0.0:1788200902.720855:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200902.720893:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695341440 00000100:00100000:0.0:1788200902.720902:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695341440 00000100:00100000:0.0:1788200902.720954:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1110 00000100:00100000:0.0:1788200902.720964:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+11:66462:x1875060695341440:12345-192.168.201.20@tcp:36:touch.0 00010000:00010000:0.0:1788200902.722286:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1aa0e lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200902.722309:0:66757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad200/0x96d0c9b8c9a1aa00 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865a8 expref: 11 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200902.722318:0:66757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1aa0e lrc: 4/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200902.722370:0:66757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad200/0x96d0c9b8c9a1aa00 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865a8 expref: 11 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200902.722384:0:66757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad200/0x96d0c9b8c9a1aa00 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865a8 expref: 11 pid: 66313 timeout: 3854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200902.722399:0:66757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:66757:1875060715050752:192.168.201.20@tcp:104: 00000100:00100000:0.0:1788200902.722495:0:66757:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10647eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788200902.727693:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200902.727761:0:66757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:66757:1875060715050752:192.168.201.20@tcp:104: 00010000:00010000:0.0:1788200902.727792:0:66757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1aa0e lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200902.727828:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695341568 00000100:00100000:0.0:1788200902.727834:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695341568 00010000:00010000:0.0:1788200902.727865:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad200/0x96d0c9b8c9a1aa00 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865a8 expref: 12 pid: 66313 timeout: 3854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200902.727895:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2549 00000100:00100000:0.0:1788200902.727906:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4292087e-fa00-4621-b681-837afc99ae35+12:2400:x1875060695341568:12345-192.168.201.20@tcp:102:ldlm_bl.0 00010000:00010000:0.0:1788200902.727923:0:26215:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad200/0x96d0c9b8c9a1aa00 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865a8 expref: 12 pid: 66313 timeout: 3854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200902.727935:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad200/0x96d0c9b8c9a1aa00 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865a8 expref: 12 pid: 66313 timeout: 3854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200902.727960:0:26215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad200/0x96d0c9b8c9a1aa00 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865a8 expref: 12 pid: 66313 timeout: 3854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200902.727971:0:26215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff8dc12066fe00) 00010000:00010000:0.0:1788200902.727974:0:26215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:0.0:1788200902.727978:0:26215:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1aa0e lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200902.727987:0:26215:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1aa0e lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200902.727994:0:26215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1aa0e lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200902.728053:0:26215:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad200/0x96d0c9b8c9a1aa00 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865a8 expref: 12 pid: 66313 timeout: 3854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200902.728111:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:4292087e-fa00-4621-b681-837afc99ae35+12:2400:x1875060695341568:12345-192.168.201.20@tcp:102:ldlm_bl.0 Request processed in 206us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200902.728119:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2549 00010000:00010000:0.0:1788200902.728146:0:66757:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1aa0e lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200902.728153:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1aa0e lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788200902.728283:0:66757:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1788200902.728287:0:66757:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb mtime from disk: 1788200902 -> 1788200902 00000004:00010000:0.0:1788200902.728290:0:66757:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb atime from disk: 1788200902 -> 1788200902 00000004:00010000:0.0:1788200902.728301:0:66757:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb ctime from disk: 1788200902 -> 1788200902 00000004:00010000:0.0:1788200902.728304:0:66757:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:0.0:1788200902.728312:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002496178d reply state 00000000e27c9791 transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1aa0e lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200902.728324:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1aa0e lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200902.728331:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff8dc12066fe00) 00010000:00010000:0.0:1788200902.728333:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788200902.728335:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:0.0:1788200902.728382:0:66757:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12ee2f100 x1875060695341440/t103079215112(0) o36->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:23/0 lens 488/456 e 0 to 0 dl 1788200913 ref 1 fl Interpret:/200/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788200902.728410:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+13:66462:x1875060695341440:12345-192.168.201.20@tcp:36:touch.0 Request processed in 7448us (7566us total) trans 103079215112 rc 0/0 00000100:00100000:0.0:1788200902.728417:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1110 00000100:00100000:0.0:1788200902.731721:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200902.733147:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695341824 00000100:00100000:1.0:1788200902.733172:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695341824 00000100:00100000:1.0:1788200902.733233:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 218 00000100:00100000:1.0:1788200902.733243:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4292087e-fa00-4621-b681-837afc99ae35+13:66462:x1875060695341824:12345-192.168.201.20@tcp:35:touch.0 00010000:00000080:1.0:1788200902.733425:0:66315:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12ee2ce00 x1875060695341824/t103079215113(0) o35->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:23/0 lens 392/456 e 0 to 0 dl 1788200913 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788200902.733907:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4292087e-fa00-4621-b681-837afc99ae35+14:66462:x1875060695341824:12345-192.168.201.20@tcp:35:touch.0 Request processed in 663us (2205us total) trans 103079215113 rc 0/0 00000100:00100000:1.0:1788200902.733916:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 218 00000100:00100000:1.0:1788200902.991901:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715050880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788200902.991964:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200902.992002:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788200902.992008:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715051008:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788200902.992047:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200902.992079:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715050880 00000100:00100000:1.0:1788200902.992086:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715050880 00000100:00100000:1.0:1788200902.992124:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2114 00000100:00100000:1.0:1788200902.992133:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715050880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788200902.992152:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200902.992186:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715050880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200902.992193:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2114 00000100:00100000:1.0:1788200902.992215:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715051008 00000100:00100000:1.0:1788200902.992218:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715051008 00000100:00100000:1.0:1788200902.992239:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3836 00000100:00100000:1.0:1788200902.992244:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715051008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788200902.992265:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444970496 avail 1298731008 00010000:00000080:1.0:1788200902.992283:0:8458:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc13a440a80 x1875060715051008/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:23/0 lens 224/368 e 0 to 0 dl 1788200913 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788200902.992311:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715051008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200902.992317:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3836 00000100:00100000:1.0:1788200902.992357:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715051008:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788200902.992371:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715050880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788200902.992692:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715051136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788200902.992733:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200902.992868:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715051136 00000100:00100000:3.0:1788200902.992873:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715051136 00000100:00100000:3.0:1788200902.992907:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2115 00000100:00100000:3.0:1788200902.992915:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715051136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788200902.992927:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200902.992971:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715051136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200902.992977:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2115 00000100:00100000:3.0:1788200902.993011:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715051136:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788200903.442456:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200904.492719:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788200904.692141:0:86550:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788200904.692189:0:86550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1a592 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a599 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.692203:0:86550:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1a592 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a599 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.692211:0:86550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1a592 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1a599 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.692219:0:86550:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1a592 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1a599 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.692237:0:86550:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788200904.692242:0:86550:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1788200904.692267:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200904.692272:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1a592 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1a599 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.692280:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ecc00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788200904.692284:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1a592 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1a599 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.692293:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1a592 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1a599 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788200904.692301:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1a592 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1a599 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788200904.692314:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788200904.692317:0:6521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788200904.692319:0:6521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788200904.692354:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1a592 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1a599 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.692360:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788200904.692382:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1a592 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1a599 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.692388:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1a592 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1a599 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.692399:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200904.692401:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200904.692403:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788200904.692416:0:86550:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788200904.692420:0:86550:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788200904.692426:0:86550:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788200904.692451:0:86550:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f7000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788200904.692475:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715051392:0@lo:39:umount.0 00000100:00100000:3.0:1788200904.692477:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788200904.692488:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715051264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788200904.697664:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200904.701776:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715051264 00000100:00100000:0.0:1788200904.701794:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715051264 00000100:00100000:0.0:1788200904.701859:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:0.0:1788200904.701869:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715051264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788200904.701885:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788200904.701906:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007ce9e00/0x96d0c9b8c9a1a599 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a592 expref: 24 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.701940:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788200904.702032:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+23:3655:x1875060715051264:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (4359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200904.702039:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:2.0:1788200904.703073:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200904.703160:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715051264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788200904.706142:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715051392 00000100:00100000:0.0:1788200904.706157:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715051392 00000100:00100000:0.0:1788200904.706278:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:0.0:1788200904.706288:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875060715051392:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788200904.706316:0:66314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a6aa 00000100:00080000:0.0:1788200904.706333:0:66314:0:(import.c:65:import_set_state_nolock()) ffff8dc1098d7800 : changing import state from FULL to CLOSED 00010000:00000080:1.0:1788200904.708550:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc0058aad80 x1875060715051392/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:25/0 lens 224/224 e 0 to 0 dl 1788200915 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788200904.708652:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3654:x1875060715051392:12345-0@lo:39:umount.0 Request processed in 2364us (5582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200904.708662:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000020:00000080:1.0:1788200904.708687:0:66314:0:(genops.c:885:class_export_put()) final put ffff8dc1098d5000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788200904.708796:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1098d5000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788200904.708859:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1098d7800 for lustre-MDT0000 00000100:00080000:0.0:1788200904.708997:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f7000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788200904.709008:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715051392:0@lo:39:umount.0 00000100:00080000:3.0:1788200904.709400:0:86550:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788200904.709404:0:86550:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788200904.709409:0:86550:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788200904.710558:0:86550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1a4b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a4c0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200904.710574:0:86550:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1a4b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a4c0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200904.710581:0:86550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1a4b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1a4c0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200904.710587:0:86550:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1a4b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1a4c0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.712044:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200904.712055:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1a4b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1a4c0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.712066:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782ce00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788200904.712070:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1a4b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1a4c0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.712097:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1a4b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1a4c0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788200904.712106:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1a4b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1a4c0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788200904.712113:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788200904.712115:0:13349:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788200904.713507:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1a4b9 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1a4c0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.713519:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788200904.713588:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715051520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788200904.713651:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788200904.713738:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1a4b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1a4c0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.713756:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200904.713758:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200904.713760:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788200904.713803:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715051520 00000100:00100000:0.0:1788200904.713810:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715051520 00000100:00100000:0.0:1788200904.713871:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:0.0:1788200904.713881:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a442680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+23:3657:x1875060715051520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788200904.713894:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788200904.713911:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007a2de00/0x96d0c9b8c9a1a4c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a4b9 expref: 23 pid: 85236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.713927:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788200904.716877:0:86550:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788200904.716893:0:86550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1a4b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1a4c0 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200904.716946:0:86550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1a5d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a5d8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200904.716955:0:86550:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1a5d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a5d8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200904.716963:0:86550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1a5d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1a5d8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200904.716970:0:86550:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1a5d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1a5d8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200904.716999:0:86550:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200904.717006:0:86550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9400/0x96d0c9b8c9a1a584 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a58b expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200904.717013:0:86550:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9400/0x96d0c9b8c9a1a584 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a58b expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200904.717055:0:86550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9400/0x96d0c9b8c9a1a584 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1a58b expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200904.717061:0:86550:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9400/0x96d0c9b8c9a1a584 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1a58b expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200904.717072:0:86550:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788200904.717078:0:86550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1a49d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1a4b2 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200904.717097:0:86550:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1a49d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1a4b2 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200904.717103:0:86550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1a49d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1a4b2 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200904.717109:0:86550:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1a49d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1a4b2 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200904.717120:0:86550:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1788200904.717124:0:86550:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788200904.717132:0:86550:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788200904.717171:0:86550:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788200904.717175:0:86550:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1788200904.717180:0:86550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1788200904.717187:0:86550:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:2.0:1788200904.718487:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788200904.718496:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1a5d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1a5d8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.718505:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed000 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788200904.718509:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1a5d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1a5d8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.718519:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1a5d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1a5d8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788200904.718526:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1a5d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1a5d8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788200904.718543:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788200904.718546:0:6520:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788200904.718549:0:6520:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788200904.718589:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1a5d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1a5d8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.718595:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788200904.718790:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a442680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+22:3657:x1875060715051520:12345-0@lo:103:ldlm_bl.0 Request processed in 4906us (5133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200904.718802:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00010000:00010000:0.0:1788200904.718827:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788200904.718832:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9400/0x96d0c9b8c9a1a584 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1a58b expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.718845:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce9400 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788200904.718848:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9400/0x96d0c9b8c9a1a584 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1a58b expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.718856:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9400/0x96d0c9b8c9a1a584 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1a58b expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788200904.718862:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9400/0x96d0c9b8c9a1a584 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1a58b expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788200904.718868:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788200904.718870:0:24979:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788200904.718872:0:24979:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788200904.718889:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9400/0x96d0c9b8c9a1a584 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1a58b expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.718895:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788200904.718921:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9400/0x96d0c9b8c9a1a584 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1a58b expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.718928:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9400/0x96d0c9b8c9a1a584 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1a58b expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.718939:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788200904.718943:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1a49d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1a4b2 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.718949:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec400 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788200904.718952:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1a49d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1a4b2 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.718966:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1a49d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1a4b2 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788200904.718973:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1a49d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1a4b2 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788200904.718978:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788200904.718980:0:24979:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788200904.718981:0:24979:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788200904.718996:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1a49d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1a4b2 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.719002:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788200904.719008:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1a49d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1a4b2 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.719031:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1a49d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1a4b2 expref: -99 pid: 85228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.719041:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200904.719043:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200904.719045:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:3.0:1788200904.719798:0:86550:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000100:00100000:3.0:1788200904.719823:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715051776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788200904.719885:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200904.719934:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788200904.719940:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715051904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788200904.719961:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200904.719988:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715051776 00000100:00100000:3.0:1788200904.719994:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715051776 00000100:00100000:3.0:1788200904.720060:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715051904 00000100:00100000:3.0:1788200904.720063:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715051904 00000100:00100000:3.0:1788200904.720084:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:3.0:1788200904.720093:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10a10c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+23:3655:x1875060715051776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788200904.720114:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788200904.720131:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007a2da00/0x96d0c9b8c9a1a58b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a584 expref: 23 pid: 85240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200904.720144:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788200904.720175:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10a10c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+22:3655:x1875060715051776:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200904.720181:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00100000:3.0:1788200904.720219:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:3.0:1788200904.720225:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+21:3655:x1875060715051904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788200904.720232:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788200904.720240:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007a2c800/0x96d0c9b8c9a1a4b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a49d expref: 21 pid: 85236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200904.720249:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788200904.720268:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+20:3655:x1875060715051904:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200904.720274:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:3.0:1788200904.720311:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715051904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788200904.720320:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715051776:0@lo:103:ldlm_bl.0 00000001:00080000:3.0:1788200904.720652:0:85229:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215113 is committed 00010000:00010000:2.0:1788200904.722154:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1a5d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1a5d8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.722168:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1a5d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1a5d8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.722184:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200904.722186:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200904.722189:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788200904.722206:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715051648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788200904.722261:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788200904.722329:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1a9f9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.722338:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1a9f9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.722346:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1a9f9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.722351:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0079ace00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788200904.722357:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1a9f9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.722375:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1a9f9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.722403:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff8dc12066f900) 00010000:00010000:2.0:1788200904.722406:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788200904.722410:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1a9f9 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.722416:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1a9f9 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200904.722520:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715051648 00000100:00100000:0.0:1788200904.722529:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715051648 00000100:00100000:0.0:1788200904.722578:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:0.0:1788200904.722588:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+20:3658:x1875060715051648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788200904.722600:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788200904.722614:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007a2d800/0x96d0c9b8c9a1a5d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a5d1 expref: 20 pid: 85240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.722728:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1aa0e lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.722736:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1aa0e lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.722742:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1aa0e lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.722747:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788200904.722751:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1aa0e lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.722757:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1aa0e lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.722767:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff8dc12066fe00) 00010000:00010000:2.0:1788200904.722770:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788200904.722773:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1aa0e lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200904.722785:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce8000/0x96d0c9b8c9a1aa0e lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.722875:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788200904.722916:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+19:3658:x1875060715051648:12345-0@lo:103:ldlm_bl.0 Request processed in 330us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200904.722924:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:1.0:1788200904.724777:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715051520:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1788200904.725627:0:86550:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1788200904.725636:0:86550:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc120725800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788200904.725642:0:86550:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc120727800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788200904.725646:0:86550:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc120726800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788200904.725679:0:86550:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc11d43a000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788200904.725687:0:86550:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc005d71000 4292087e-fa00-4621-b681-837afc99ae35 192.168.201.20@tcp 9 (0 0 3) 0 0 0 0: 0000000000000000 103079215113 stale:0 00000020:00080000:3.0:1788200904.725692:0:86550:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff8dc12f30cd28) has exports, disconnecting them 00000020:00080000:3.0:1788200904.725697:0:86550:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc120725800), last request at 1788200866 00000020:00000080:3.0:1788200904.725704:0:86550:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a6a3 00000100:00080000:3.0:1788200904.725712:0:86550:0:(import.c:65:import_set_state_nolock()) ffff8dc120725000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788200904.725741:0:86550:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc120725800): rc 0 00000020:00000080:3.0:1788200904.725744:0:86550:0:(genops.c:885:class_export_put()) final put ffff8dc120725800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788200904.725758:0:86550:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc120727800), last request at 1788200902 00000020:00000080:3.0:1788200904.725761:0:86550:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a69c 00000100:00080000:3.0:1788200904.725765:0:86550:0:(import.c:65:import_set_state_nolock()) ffff8dc120720800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788200904.725777:0:86550:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc120727800): rc 0 00000020:00000080:3.0:1788200904.725779:0:86550:0:(genops.c:885:class_export_put()) final put ffff8dc120727800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788200904.725783:0:86550:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc120726800), last request at 1788200902 00000020:00000080:3.0:1788200904.725785:0:86550:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a695 00000100:00080000:3.0:1788200904.725787:0:86550:0:(import.c:65:import_set_state_nolock()) ffff8dc120724000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788200904.725791:0:86550:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc120726800): rc 0 00000020:00000080:3.0:1788200904.725793:0:86550:0:(genops.c:885:class_export_put()) final put ffff8dc120726800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788200904.725796:0:86550:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc11d43a000), last request at 1788200861 00000020:00000080:3.0:1788200904.725805:0:86550:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a506 00000100:00080000:3.0:1788200904.725815:0:86550:0:(import.c:65:import_set_state_nolock()) ffff8dc1098d1000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788200904.725856:0:86550:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc11d43a000): rc 0 00000020:00000080:3.0:1788200904.725859:0:86550:0:(genops.c:885:class_export_put()) final put ffff8dc11d43a000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:3.0:1788200904.725864:0:86550:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.201.20@tcp (ffff8dc005d71000), last request at 1788200902 00000020:00000080:3.0:1788200904.725867:0:86550:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a4ff 00000020:00010000:3.0:1788200904.725873:0:86550:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc005d71000: total 4 00000100:00080000:3.0:1788200904.725877:0:86550:0:(import.c:65:import_set_state_nolock()) ffff8dc0059d0000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788200904.725889:0:86550:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.201.20@tcp (ffff8dc005d71000): rc 0 00000004:00000080:3.0:1788200904.725894:0:86550:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa0dd41d3bae0 00000100:00080000:3.0:1788200904.725914:0:86550:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788200904.725917:0:86550:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788200904.726720:0:86550:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788200904.726747:0:86550:0:(import.c:65:import_set_state_nolock()) ffff8dc104280000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788200904.726876:0:86550:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788200904.726879:0:86550:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969449 gen 3 00000004:00080000:3.0:1788200904.726889:0:86550:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788200904.726956:0:86550:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788200904.726965:0:86550:0:(import.c:65:import_set_state_nolock()) ffff8dc005a4c800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788200904.726971:0:86550:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788200904.726973:0:86550:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969449 gen 3 00000004:00080000:3.0:1788200904.726980:0:86550:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788200904.727058:0:86550:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788200904.727065:0:86550:0:(import.c:65:import_set_state_nolock()) ffff8dc001e2f000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788200904.727105:0:86550:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8dc12f30cd28) has no exports 00000020:00010000:3.0:1788200904.727253:0:6521:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc005d71000: total 4 00010000:00010000:3.0:1788200904.727291:0:6521:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc005d71000, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1788200904.727328:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1a9e4 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865a1 expref: 5 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200904.727358:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1a9c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78659a expref: 4 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200904.727377:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad200/0x96d0c9b8c9a1aa00 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865a8 expref: 3 pid: 66313 timeout: 3854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200904.727404:0:6521:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc005d71000, canceled 3 locks, left on hash table 0. 00000020:00000080:1.0:1788200904.728903:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc120725800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788200904.728950:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc120727800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788200904.728963:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc120726800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788200904.728979:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d43a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788200904.729002:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc120725000 for lustre-MDT0000 00000020:00000080:1.0:1788200904.729005:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc120720800 for lustre-MDT0000 00000020:00000080:1.0:1788200904.729008:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc120724000 for lustre-MDT0000 00000020:00000080:1.0:1788200904.729011:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1098d1000 for lustre-MDT0000 00010000:00010000:0.0:1788200904.729377:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788200904.729398:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715052032:0@lo:39:umount.0 00000100:00100000:0.0:1788200904.729481:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200904.729527:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715052160:0@lo:9:umount.0 00000100:00100000:0.0:1788200904.729551:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200904.729570:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715052288:0@lo:9:umount.0 00000100:00100000:0.0:1788200904.729590:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200904.729709:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715052032 00000100:00100000:1.0:1788200904.729730:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715052032 00000100:00100000:1.0:1788200904.729783:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3837 00000100:00100000:1.0:1788200904.729793:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715052032:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788200904.729823:0:83817:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a537 00000100:00080000:1.0:1788200904.729832:0:83817:0:(import.c:65:import_set_state_nolock()) ffff8dc106076000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788200904.729850:0:83817:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411436 00000100:00100000:1.0:1788200904.729995:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3654:x1875060715052032:12345-0@lo:39:umount.0 Request processed in 202us (512us total) trans 77309411437 rc 0/0 00000100:00100000:1.0:1788200904.730003:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3837 00010000:00010000:1.0:1788200904.730051:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788200904.730078:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc104280000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788200904.730085:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715052032:0@lo:39:umount.0 00000100:00100000:2.0:1788200904.730686:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715051648:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788200904.730710:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200904.731073:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788200904.731143:0:86550:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8dc12f30cd28) has no exports 00000100:00100000:2.0:1788200904.733450:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715052160 00000100:00100000:2.0:1788200904.733463:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715052160 00000100:00100000:2.0:1788200904.733524:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715052288 00000100:00100000:2.0:1788200904.733527:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715052288 00000100:00100000:2.0:1788200904.733547:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5860 00000100:00100000:2.0:1788200904.733557:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715052160:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788200904.733582:0:26203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a561 00000100:00080000:2.0:1788200904.733590:0:26203:0:(import.c:65:import_set_state_nolock()) ffff8dc11cddc800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788200904.733630:0:26203:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969449 00000100:00100000:2.0:1788200904.733814:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2:3654:x1875060715052160:12345-0@lo:9:umount.0 Request processed in 258us (4260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200904.733821:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5860 00000100:00100000:2.0:1788200904.733836:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5861 00000100:00100000:2.0:1788200904.733841:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715052288:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788200904.733852:0:26203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a56f 00000100:00080000:2.0:1788200904.733857:0:26203:0:(import.c:65:import_set_state_nolock()) ffff8dc0078de800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788200904.733874:0:26203:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969449 00000100:00100000:2.0:1788200904.733944:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2:3654:x1875060715052288:12345-0@lo:9:umount.0 Request processed in 102us (4352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200904.733950:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5861 00000100:00080000:2.0:1788200904.733969:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788200904.733972:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788200904.734005:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788200904.734059:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc005a4c800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788200904.734070:0:3654:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788200904.734073:0:3654:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788200904.734077:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715052160:0@lo:9:umount.0 00000100:00080000:2.0:1788200904.734089:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001e2f000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788200904.734096:0:3654:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788200904.734098:0:3654:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788200904.734099:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715052288:0@lo:9:umount.0 00010000:00010000:2.0:1788200904.734125:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788200904.771827:0:6521:0:(genops.c:885:class_export_put()) final put ffff8dc005d71000/4292087e-fa00-4621-b681-837afc99ae35 00010000:00010000:2.0:1788200904.772537:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200904.772541:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200904.772544:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788200904.779963:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005d71000/4292087e-fa00-4621-b681-837afc99ae35 for lustre-MDT0000 00000020:00000080:0.0:1788200904.780079:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc0059d0000 for lustre-MDT0000 00000020:00000080:1.0:1788200904.792860:0:86550:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a51b 00000020:00000080:1.0:1788200904.792876:0:86550:0:(genops.c:885:class_export_put()) final put ffff8dc002a57800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788200904.792899:0:86550:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788200904.792996:0:86550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788200904.793009:0:86550:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788200904.793042:0:86550:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8dc1401b19b8) has no exports 00000020:00000080:3.0:1788200904.793635:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc002a57800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788200904.793708:0:86550:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a514 00000020:00000080:1.0:1788200904.793715:0:86550:0:(genops.c:885:class_export_put()) final put ffff8dc11d639800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788200904.793777:0:86550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788200904.793786:0:86550:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788200904.793789:0:86550:0:(genops.c:885:class_export_put()) final put ffff8dc11d63b000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788200904.793792:0:86550:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d63b000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788200904.793799:0:86550:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1788200904.793954:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d639800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788200904.794190:0:86550:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc007476300 - data ffff8dc11d9c5798/ffff8dc11811b400 00000020:01000000:1.0:1788200904.794326:0:86550:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc007fd0e40 - data ffff8dc11dbf5948/ffff8dc1333a4c00 00000100:00080000:0.0:1788200904.838483:0:86550:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788200904.838492:0:86550:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788200904.838506:0:86550:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8dc1060cc380 x1875060715052032/t77309411437(77309411437) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788200914 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788200904.838532:0:86550:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788200904.840291:0:86550:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788200904.840297:0:86550:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969449 gen 4 00000004:00080000:0.0:1788200904.840317:0:86550:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788200904.840319:0:86550:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788200904.841086:0:85247:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788200904.841092:0:85247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x60:0x0] index 1 count 1 00000040:00080000:3.0:1788200904.841103:0:85247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 24 count 2 00000100:00080000:1.0:1788200904.841644:0:86550:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788200904.841649:0:86550:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969449 gen 4 00000004:00080000:1.0:1788200904.841676:0:86550:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788200904.841688:0:86550:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788200904.841900:0:85249:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788200904.841904:0:85249:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x62:0x0] index 1 count 1 00000040:00080000:3.0:1788200904.841912:0:85249:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 24 count 2 00000020:00000080:1.0:1788200904.847213:0:86550:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a4d5 00000020:00000080:1.0:1788200904.847225:0:86550:0:(genops.c:885:class_export_put()) final put ffff8dc104284000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788200904.848105:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc104284000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788200904.848840:0:86550:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a4ea 00000020:00000080:1.0:1788200904.848849:0:86550:0:(genops.c:885:class_export_put()) final put ffff8dc110734000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788200904.848901:0:86550:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788200904.848907:0:86550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788200904.848918:0:86550:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788200904.848921:0:86550:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8dc12f3099b8) has no exports 00000004:01000000:1.0:1788200904.849108:0:86550:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788200904.849117:0:86550:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a568 00000020:00000080:1.0:1788200904.849122:0:86550:0:(genops.c:885:class_export_put()) final put ffff8dc005a4e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788200904.852576:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110734000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788200904.854680:0:86550:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788200904.854697:0:86550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788200904.854714:0:86550:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788200904.854720:0:86550:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8dc004044d28) has no exports 00000020:00000080:1.0:1788200904.854731:0:86550:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a55a 00000020:00000080:1.0:1788200904.854740:0:86550:0:(genops.c:885:class_export_put()) final put ffff8dc001e2e000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788200904.858112:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005a4e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788200904.858584:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc001e2e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788200904.859071:0:86550:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788200904.859076:0:86550:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788200904.859080:0:86550:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969449 gen 5 00000004:00080000:1.0:1788200904.859086:0:86550:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788200904.859089:0:86550:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788200904.859142:0:86550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788200904.859155:0:86550:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788200904.859164:0:86550:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a54c 00000020:00000080:1.0:1788200904.859173:0:86550:0:(genops.c:885:class_export_put()) final put ffff8dc110732000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788200904.859178:0:86550:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788200904.859185:0:86550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788200904.859190:0:86550:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788200904.859194:0:86550:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8dc13f874d28) has no exports 00000020:00000080:1.0:1788200904.859201:0:86550:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a545 00000020:00000080:1.0:1788200904.859204:0:86550:0:(genops.c:885:class_export_put()) final put ffff8dc005a4f800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788200904.859829:0:86550:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788200904.859832:0:86550:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788200904.859834:0:86550:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969449 gen 5 00000004:00080000:1.0:1788200904.859838:0:86550:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788200904.859840:0:86550:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788200904.859872:0:86550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788200904.859878:0:86550:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788200904.859890:0:86550:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788200904.859896:0:86550:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a530 00000020:00000080:3.0:1788200904.859899:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc001e2f000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788200904.859900:0:86550:0:(genops.c:885:class_export_put()) final put ffff8dc110730000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788200904.859905:0:86550:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788200904.859905:0:86307:0:(genops.c:885:class_export_put()) final put ffff8dc110733800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788200904.859907:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110733800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788200904.859909:0:86550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788200904.859913:0:86550:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:01000000:3.0:1788200904.859913:0:86307:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00080000:1.0:1788200904.859916:0:86550:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8dc13f870000) has no exports 00000020:00000080:1.0:1788200904.859920:0:86550:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a529 00000020:00000080:1.0:1788200904.859922:0:86550:0:(genops.c:885:class_export_put()) final put ffff8dc110732800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788200904.859993:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110732000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788200904.859997:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005a4f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788200904.860000:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc005a4c800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788200904.860005:0:86307:0:(genops.c:885:class_export_put()) final put ffff8dc110730800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788200904.860006:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110730800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788200904.860009:0:86307:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788200904.860052:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110730000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788200904.860062:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110732800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788200904.862548:0:86550:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788200904.862567:0:86550:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788200904.862571:0:86550:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788200904.862579:0:86550:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788200904.862631:0:86550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788200904.862654:0:86550:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788200904.862690:0:86550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788200904.862694:0:86550:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788200904.862699:0:86550:0:(genops.c:885:class_export_put()) final put ffff8dc104283800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788200904.862704:0:86550:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc104283800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788200904.862715:0:86550:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788200904.862813:0:86550:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a4f1 00000020:00000080:0.0:1788200904.862819:0:86550:0:(genops.c:885:class_export_put()) final put ffff8dc110736800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788200904.862824:0:86550:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788200904.862827:0:86550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788200904.862832:0:86550:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788200904.862835:0:86550:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8dc12f308000) has no exports 00000020:00000080:0.0:1788200904.862850:0:86550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788200904.862854:0:86550:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788200904.862857:0:86550:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a4f8 00000020:00000080:0.0:1788200904.862860:0:86550:0:(genops.c:885:class_export_put()) final put ffff8dc110737000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788200904.862866:0:86550:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc11d438000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788200904.862869:0:86550:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc11d438000 3 00000020:01000004:0.0:1788200904.862872:0:86550:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dc11d438000 from lustre-MDT0000 00000020:00000080:0.0:1788200904.862889:0:86550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788200904.862892:0:86550:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788200904.862895:0:86550:0:(genops.c:885:class_export_put()) final put ffff8dc104281000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788200904.862897:0:86550:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc104281000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788200904.862904:0:86550:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788200904.862932:0:86550:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788200904.862935:0:86550:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788200904.862938:0:86550:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788200904.862940:0:86550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788200904.862948:0:86550:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788200904.862955:0:86550:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8dc13f86b800 c9b18af6-fecc-4172-82c2-66531890fe11 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788200904.862963:0:86550:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8dc13f86b000 0fa559bc-2180-4019-80c4-11831fedf9a9 192.168.201.20@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788200904.862968:0:86550:0:(genops.c:1553:class_disconnect_exports()) OBD device 3 (ffff8dc1401b0000) has exports, disconnecting them 00000020:00080000:0.0:1788200904.862972:0:86550:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8dc13f86b800), last request at 1788200861 00000020:00000080:0.0:1788200904.862993:0:86550:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a496 00000020:00010000:0.0:1788200904.862998:0:86550:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc13f86b800: total 2 00000100:00080000:0.0:1788200904.863001:0:86550:0:(import.c:65:import_set_state_nolock()) ffff8dc13f868000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788200904.863012:0:86550:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc13f86b800): rc 0 00000020:00080000:0.0:1788200904.863030:0:86550:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.201.20@tcp (ffff8dc13f86b000), last request at 1788200860 00000020:00000080:0.0:1788200904.863071:0:86550:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a48f 00000020:00010000:0.0:1788200904.863074:0:86550:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc13f86b000: total 2 00000100:00080000:0.0:1788200904.863078:0:86550:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86a800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788200904.863091:0:86550:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.201.20@tcp (ffff8dc13f86b000): rc 0 00000020:00080000:0.0:1788200904.863095:0:86550:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8dc1401b0000) has no exports 00000100:00100000:3.0:1788200904.864635:0:85240:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff8dc11cf02c00:85240] 3 exiting: rc = 0 00000020:00000080:3.0:1788200904.864752:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc104280000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788200904.864760:0:57134:0:(genops.c:885:class_export_put()) final put ffff8dc110735800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788200904.864763:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110735800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788200904.864768:0:57134:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788200904.864829:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110736800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788200904.864833:0:57134:0:(genops.c:885:class_export_put()) final put ffff8dc110733000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788200904.864835:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110733000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788200904.864838:0:57134:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788200904.864858:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110737000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1788200904.866165:0:24979:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc13f86b800: total 0 00010000:00010000:0.0:1788200904.866173:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200904.866221:0:24979:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc13f86b800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788200904.866257:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007a2cc00/0x96d0c9b8c9a1a5e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a5df expref: 14 pid: 85240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.866274:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007ce9600/0x96d0c9b8c9a1a648 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a641 expref: 13 pid: 85234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.866284:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007ce8400/0x96d0c9b8c9a1a656 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a64f expref: 12 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.866292:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fd600/0x96d0c9b8c9a1a664 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a65d expref: 11 pid: 85236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.866316:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007a2ce00/0x96d0c9b8c9a1a5f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a5ed expref: 10 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.866325:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007ce9c00/0x96d0c9b8c9a1a672 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a66b expref: 9 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.866333:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007a2ca00/0x96d0c9b8c9a1a602 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a5fb expref: 8 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.866341:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007a2c000/0x96d0c9b8c9a1a610 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a609 expref: 7 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.866353:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782c200/0x96d0c9b8c9a1a68e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a687 expref: 6 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.866361:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007a2d000/0x96d0c9b8c9a1a61e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a617 expref: 5 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.866370:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782c800/0x96d0c9b8c9a1a680 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a679 expref: 4 pid: 85234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.866381:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ed200/0x96d0c9b8c9a1a63a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a633 expref: 3 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.866407:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007a2c200/0x96d0c9b8c9a1a62c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1a625 expref: 2 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.866415:0:24979:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc13f86b800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788200904.866438:0:24979:0:(genops.c:885:class_export_put()) final put ffff8dc13f86b800/c9b18af6-fecc-4172-82c2-66531890fe11 00000020:00010000:0.0:1788200904.866454:0:24979:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc13f86b000: total 1 00010000:00010000:0.0:1788200904.866478:0:24979:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc13f86b000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1788200904.866496:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007ce9200/0x96d0c9b8c9a1a5b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786546 expref: 5 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.866510:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007ce9800/0x96d0c9b8c9a1a5c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786554 expref: 4 pid: 85234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788200904.866521:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13f86b800/c9b18af6-fecc-4172-82c2-66531890fe11 for MGS 00010000:00010000:0.0:1788200904.866522:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ed800/0x96d0c9b8c9a1a5ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78655b expref: 3 pid: 85235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.866532:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007a2c400/0x96d0c9b8c9a1a5bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78654d expref: 2 pid: 85240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200904.866543:0:24979:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc13f86b000, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1788200904.866552:0:24979:0:(genops.c:885:class_export_put()) final put ffff8dc13f86b000/0fa559bc-2180-4019-80c4-11831fedf9a9 00010000:00010000:0.0:1788200904.866556:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200904.866558:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788200904.866558:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc13f868000 for MGS 00010000:00010000:0.0:1788200904.866559:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788200904.866562:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13f86b000/0fa559bc-2180-4019-80c4-11831fedf9a9 for MGS 00000020:00000080:3.0:1788200904.866573:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc13f86a800 for MGS 00000100:00100000:3.0:1788200904.874641:0:85236:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8dc11cf02000:85236] 2 exiting: rc = 0 00010000:00010000:3.0:1788200904.874760:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788200904.877229:0:85234:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8dc103d2fe00:85234] 0 exiting: rc = 1 00000100:00100000:0.0:1788200904.879126:0:85235:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8dc103d2e800:85235] 1 exiting: rc = 0 00000100:00100000:3.0:1788200904.879288:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879296:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879302:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879309:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879315:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879321:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879326:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879332:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879338:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879345:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879350:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879356:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879361:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879383:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879405:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879411:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879416:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879421:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879426:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879440:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879446:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879451:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879457:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879463:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879469:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879474:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879479:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879484:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879489:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879493:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879498:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879503:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879509:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879514:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879519:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879524:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879530:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879535:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879540:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879545:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879550:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879556:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879561:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879566:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879571:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879577:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879582:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879587:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879600:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879605:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879610:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879615:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879620:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879625:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879631:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879636:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879651:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879657:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879663:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879678:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879684:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879690:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879697:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788200904.879704:0:86550:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1788200904.881145:0:86550:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc007476ae0 - data ffff8dc002143510/ffff8dc002ae5c00 00000020:01000000:3.0:1788200904.881262:0:86550:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc007476780 - data ffff8dc0023db870/ffff8dc002ae5000 00000020:00000080:3.0:1788200904.881718:0:86550:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a488 00000020:00000080:3.0:1788200904.881728:0:86550:0:(genops.c:885:class_export_put()) final put ffff8dc005d74800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788200904.881956:0:86550:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc11d438000 from MGS, refs=2 00000020:01000004:3.0:1788200904.881961:0:86550:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc11d438000 2 00000020:01000004:3.0:1788200904.881964:0:86550:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dc11d438000 from MGS 00000020:00000080:3.0:1788200904.881983:0:86550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788200904.881990:0:86550:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788200904.881993:0:86550:0:(genops.c:885:class_export_put()) final put ffff8dc12f19b800/MGS 00000020:00000080:3.0:1788200904.881995:0:86550:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12f19b800/MGS for MGS 00000020:01000000:3.0:1788200904.882001:0:86550:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788200904.882080:0:86550:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788200904.882083:0:86550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788200904.882096:0:86550:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788200904.882106:0:86550:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8dc11ccfc000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788200904.882113:0:86550:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8dc13f8719b8) has exports, disconnecting them 00000020:00080000:3.0:1788200904.882126:0:86550:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8dc11ccfc000), last request at 1788200861 00000020:00000080:3.0:1788200904.882130:0:86550:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a5a7 00000020:00080000:3.0:1788200904.882140:0:86550:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc11ccfc000): rc 0 00000020:00000080:3.0:1788200904.882145:0:86550:0:(genops.c:885:class_export_put()) final put ffff8dc11ccfc000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788200904.882285:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005d74800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788200904.883613:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11ccfc000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788200904.889089:0:86550:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788200904.889103:0:86550:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788200904.889113:0:86550:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788200904.889125:0:86550:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788200904.889178:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc0034f7000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788200904.889450:0:86550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788200904.889464:0:86550:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788200904.889470:0:86550:0:(genops.c:885:class_export_put()) final put ffff8dc0078db800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788200904.889485:0:86550:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0078db800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788200904.889501:0:86550:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788200904.889634:0:86550:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc11d438000 1 00000020:00000080:0.0:1788200904.889643:0:86550:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a47a 00000020:00000080:0.0:1788200904.889650:0:86550:0:(genops.c:885:class_export_put()) final put ffff8dc12f19d000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788200904.889659:0:86550:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788200904.889677:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12f19d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788200904.889687:0:86550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788200904.889691:0:86550:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788200904.889695:0:86550:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8dc004040000) has no exports 00000020:00000080:0.0:1788200905.047468:0:86550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788200905.047482:0:86550:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788200905.047488:0:86550:0:(genops.c:885:class_export_put()) final put ffff8dc11d439800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788200905.047493:0:86550:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d439800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788200905.047502:0:86550:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788200905.047615:0:86550:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dc11d43f800 00000020:02000400:0.0:1788200905.047683:0:86550:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788200905.487172:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200906.512669:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788200907.088198:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715052544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788200907.088290:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200907.088345:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788200907.088352:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715052416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788200907.088377:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200907.088477:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715052544 00000100:00100000:2.0:1788200907.088486:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715052544 00000100:00100000:2.0:1788200907.088574:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715052416 00000100:00100000:2.0:1788200907.088577:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715052416 00000100:00100000:2.0:1788200907.088598:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2116 00000100:00100000:2.0:1788200907.088608:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715052544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788200907.088650:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788200907.088705:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715052544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200907.088712:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2116 00000100:00100000:2.0:1788200907.088730:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2117 00000100:00100000:2.0:1788200907.088736:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715052416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788200907.088753:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788200907.088778:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715052416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200907.088804:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2117 00000100:00100000:2.0:1788200907.088855:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715052416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788200907.088870:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715052544:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788200907.089110:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788200907.089114:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000400:00000100:0.0:1788200907.223343:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695341952 offset 0 length 224: 4 00000100:00100000:0.0:1788200907.223392:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200907.223537:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695342208 00000100:00100000:1.0:1788200907.223549:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695342208 00000100:00100000:1.0:1788200907.223641:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1132 00000100:00100000:1.0:1788200907.223652:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695342208:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788200907.223737:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695342208:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 87us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200907.223745:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1132 00000100:00080000:0.0:1788200907.223811:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788200907.232390:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200907.232436:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200907.232494:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200907.232623:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695342464 00000100:00100000:3.0:1788200907.232644:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695342464 00000100:00100000:3.0:1788200907.232717:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695342336 00000100:00100000:3.0:1788200907.232720:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695342336 00000100:00100000:3.0:1788200907.232745:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2607 00000100:00100000:3.0:1788200907.232756:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4292087e-fa00-4621-b681-837afc99ae35+5:2401:x1875060695342464:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200907.232825:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4292087e-fa00-4621-b681-837afc99ae35+5:2401:x1875060695342464:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 71us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200907.232833:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2607 00000100:00100000:3.0:1788200907.232854:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2608 00000100:00100000:3.0:1788200907.232862:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4292087e-fa00-4621-b681-837afc99ae35+5:2401:x1875060695342336:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200907.232885:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4292087e-fa00-4621-b681-837afc99ae35+5:2401:x1875060695342336:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200907.232891:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2608 00000100:00080000:0.0:1788200907.233358:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788200907.233362:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788200907.233429:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695342080 00000100:00100000:1.0:1788200907.233434:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695342080 00000100:00100000:1.0:1788200907.233471:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1112 00000100:00100000:1.0:1788200907.233476:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1875060695342080:12345-192.168.201.20@tcp:400:kworker.0 00000020:00080000:1.0:1788200907.233483:0:66757:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.20@tcp 00000100:00100000:1.0:1788200907.233526:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1875060695342080:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 49us (1089us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788200907.233539:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1112 00000100:00100000:0.0:1788200907.249943:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200907.250088:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695342592 00000100:00100000:1.0:1788200907.250097:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695342592 00000100:00100000:1.0:1788200907.250144:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1113 00000100:00100000:1.0:1788200907.250152:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875060695342592:12345-192.168.201.20@tcp:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1788200907.250175:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200907.250239:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875060695342592:12345-192.168.201.20@tcp:38:ptlrpcd_00_01.0 Request processed in 86us (315us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788200907.250245:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1113 00010000:00010000:0.0:1788200907.535449:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788200907.599544:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715052928:0@lo:400:kworker.0 00000100:00100000:2.0:1788200907.599632:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200907.599678:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120020e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715053440:0@lo:400:kworker.0 00000100:00100000:2.0:1788200907.599715:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200907.599744:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788200907.599750:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715053056:0@lo:400:kworker.0 00000100:00100000:2.0:1788200907.599768:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200907.599781:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0073b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715053568:0@lo:400:kworker.0 00000100:00100000:2.0:1788200907.599798:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200907.599824:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715053440 00000100:00100000:2.0:1788200907.599831:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715053440 00000100:00100000:2.0:1788200907.599869:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715053568 00000100:00100000:2.0:1788200907.599871:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715053568 00000100:00100000:2.0:1788200907.599888:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2609 00000100:00100000:2.0:1788200907.599896:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715053440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200907.599939:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715053440:12345-0@lo:400:kworker.0 Request processed in 43us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200907.599945:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2609 00000100:00100000:2.0:1788200907.599962:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2610 00000100:00100000:2.0:1788200907.599968:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715053568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200907.599995:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715053568:12345-0@lo:400:kworker.0 Request processed in 26us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200907.600050:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2610 00000100:00100000:2.0:1788200907.600077:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715052928 00000100:00100000:2.0:1788200907.600080:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715052928 00000100:00100000:2.0:1788200907.600109:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715053056 00000100:00100000:2.0:1788200907.600111:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715053056 00000100:00100000:2.0:1788200907.600123:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:2.0:1788200907.600129:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715052928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200907.600156:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715052928:12345-0@lo:400:kworker.0 Request processed in 28us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200907.600162:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00100000:2.0:1788200907.600185:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:2.0:1788200907.600189:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1875060715053056:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788200907.600194:0:66757:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788200907.600214:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1875060715053056:12345-0@lo:400:kworker.0 Request processed in 24us (445us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788200907.600219:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00080000:2.0:1788200907.600234:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788200907.600380:0:3657:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788200907.600385:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788200907.600389:0:3657:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788200907.600394:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788200907.600398:0:3657:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3718 00000100:00080000:2.0:1788200907.600404:0:3657:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788200907.600426:0:3657:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005abce00 x1875060715053824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788200907.600460:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715053056:0@lo:400:kworker.0 00000100:00100000:2.0:1788200907.600476:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0073b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715053568:0@lo:400:kworker.0 00000100:00100000:2.0:1788200907.600486:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715052928:0@lo:400:kworker.0 00000100:00100000:2.0:1788200907.600494:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120020e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715053440:0@lo:400:kworker.0 00000100:00100000:2.0:1788200907.600527:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715053824:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788200907.600553:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200907.600801:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715052672:0@lo:400:kworker.0 00000400:00000100:3.0:1788200907.600829:0:3655:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715052672 offset 0 length 224: 4 00000100:00100000:3.0:1788200907.600855:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120023480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715053184:0@lo:400:kworker.0 00000100:00100000:3.0:1788200907.600878:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200907.600903:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0073bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715053696:0@lo:400:kworker.0 00000100:00100000:3.0:1788200907.600923:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200907.600954:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788200907.600961:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715052800:0@lo:400:kworker.0 00000100:00100000:3.0:1788200907.600983:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200907.601001:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120020700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715053312:0@lo:400:kworker.0 00000100:00100000:3.0:1788200907.601044:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200907.601069:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715053824 00000100:00100000:3.0:1788200907.601073:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715053824 00000100:00100000:3.0:1788200907.601091:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715053184 00000100:00100000:3.0:1788200907.601093:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715053184 00000100:00100000:3.0:1788200907.601113:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715053696 00000100:00100000:3.0:1788200907.601115:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715053696 00000100:00100000:3.0:1788200907.601122:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715052800 00000100:00100000:3.0:1788200907.601123:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715052800 00000100:00100000:3.0:1788200907.601132:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:3.0:1788200907.601138:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715053184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200907.601185:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715053184:12345-0@lo:400:kworker.0 Request processed in 47us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200907.601190:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00100000:3.0:1788200907.601206:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:3.0:1788200907.601210:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715053824:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788200907.601228:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788200907.601255:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715053824:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 44us (702us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788200907.601261:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:3.0:1788200907.601269:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:3.0:1788200907.601273:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3655:x1875060715053696:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788200907.601277:0:66312:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788200907.601302:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3655:x1875060715053696:12345-0@lo:400:kworker.0 Request processed in 27us (378us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788200907.601307:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:3.0:1788200907.601317:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:3.0:1788200907.601320:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3655:x1875060715052800:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788200907.601324:0:66312:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788200907.601339:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3655:x1875060715052800:12345-0@lo:400:kworker.0 Request processed in 18us (355us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788200907.601344:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00080000:3.0:1788200907.601364:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200907.601369:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200907.601372:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715053824:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1788200907.601387:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788200907.601403:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788200907.601406:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788200907.601409:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788200907.601413:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788200907.601416:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3718 00000100:00080000:3.0:1788200907.601421:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788200907.601439:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc1060cc000 x1875060715053952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788200907.601456:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715052800:0@lo:400:kworker.0 00000100:00100000:3.0:1788200907.601469:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120023480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715053184:0@lo:400:kworker.0 00000100:00080000:3.0:1788200907.601476:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788200907.601483:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788200907.601486:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788200907.601489:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788200907.601492:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3718 00000100:00080000:3.0:1788200907.601496:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788200907.601506:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc1060cca80 x1875060715054080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788200907.601516:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0073bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715053696:0@lo:400:kworker.0 00000100:00100000:3.0:1788200907.601540:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715053952:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788200907.601565:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200907.601580:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715054080:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788200907.601600:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200907.601850:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715053952 00000100:00100000:2.0:1788200907.601855:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715053952 00000100:00100000:2.0:1788200907.601871:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715054080 00000100:00100000:2.0:1788200907.601873:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715054080 00000100:00100000:2.0:1788200907.601881:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:2.0:1788200907.601886:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715053952:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788200907.601898:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200907.601984:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715053312 00000100:00100000:1.0:1788200907.601989:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715053312 00000100:00100000:1.0:1788200907.602041:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3838 00000100:00100000:1.0:1788200907.602046:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3655:x1875060715053312:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788200907.602052:0:8458:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788200907.602091:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3655:x1875060715053312:12345-0@lo:400:kworker.0 Request processed in 44us (1045us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788200907.602096:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3838 00000100:00080000:1.0:1788200907.602128:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788200907.602131:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788200907.602134:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788200907.602138:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200907.602141:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3718 00000100:00080000:1.0:1788200907.602146:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200907.602160:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13a441880 x1875060715054208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788200907.602235:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:3.0:1788200907.602242:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715054080:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1788200907.602252:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788200907.602413:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715053952:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 525us (847us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788200907.602419:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:0.0:1788200907.602864:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715054208:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788200907.602904:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200907.602981:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715054208 00000100:00100000:2.0:1788200907.602986:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715054208 00000100:00100000:2.0:1788200907.603010:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3839 00000100:00100000:2.0:1788200907.603033:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715054208:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788200907.603045:0:83817:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200907.608756:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120020700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715053312:0@lo:400:kworker.0 00000100:00100000:3.0:1788200907.611140:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715054080:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 8883us (9525us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788200907.611159:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00080000:0.0:1788200907.612584:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788200907.612596:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788200907.612601:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715053952:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1788200907.612763:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788200907.612767:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788200907.612770:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715054080:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788200907.613858:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715054208:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 10835us (10946us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788200907.613895:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3839 00000100:00080000:0.0:1788200907.618600:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788200907.618617:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788200907.618634:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715054208:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:3.0:1788200908.559729:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200909.583812:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200910.607503:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788200910.672440:0:75739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788200910.672456:0:75739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411437 is committed 00000020:00000080:1.0:1788200910.672462:0:75739:0:(genops.c:885:class_export_put()) final put ffff8dc106072800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788200910.672538:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc106072800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788200910.672816:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc106076000 for lustre-MDT0001 00000001:00100000:3.0:1788200910.673318:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788200910.673322:0:9526:0:(genops.c:885:class_export_put()) final put ffff8dc0078da000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788200910.673463:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0078da000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788200910.673507:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc0078de800 for lustre-OST0001 00000001:00100000:0.0:1788200910.673712:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788200910.673716:0:8442:0:(genops.c:885:class_export_put()) final put ffff8dc11cdda800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788200910.673799:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11cdda800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788200910.673970:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc11cddc800 for lustre-OST0000 00010000:00010000:0.0:1788200911.632876:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788200912.208097:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788200912.208120:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715054336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788200912.208186:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200912.208531:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715054464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788200912.208591:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200912.208725:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715054336 00000100:00100000:0.0:1788200912.208733:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715054336 00000100:00100000:0.0:1788200912.208795:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715054464 00000100:00100000:0.0:1788200912.208798:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715054464 00000100:00100000:0.0:1788200912.208815:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2118 00000100:00100000:0.0:1788200912.208825:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715054336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788200912.208853:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200912.208914:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715054336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200912.208922:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2118 00000100:00100000:0.0:1788200912.208939:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2119 00000100:00100000:0.0:1788200912.208945:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715054464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788200912.208959:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200912.208988:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715054464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200912.208994:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2119 00000100:00080000:3.0:1788200912.209134:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788200912.209138:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788200912.209170:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715054464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788200912.209202:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715054336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788200912.343619:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200912.343668:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000400:00000100:3.0:1788200912.343701:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695342720 offset 0 length 224: 4 00000100:00100000:3.0:1788200912.343723:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200912.343763:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200912.343792:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695342976 00000100:00100000:3.0:1788200912.343802:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695342976 00000100:00100000:3.0:1788200912.343852:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695342848 00000100:00100000:3.0:1788200912.343856:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695342848 00000100:00100000:3.0:1788200912.343873:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1135 00000100:00100000:3.0:1788200912.343895:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695342976:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200912.343960:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695342976:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 68us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200912.343968:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1135 00000100:00100000:3.0:1788200912.343988:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1120 00000100:00100000:3.0:1788200912.344007:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695342848:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:3.0:1788200912.344074:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788200912.344102:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695342848:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 93us (338us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788200912.344109:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1120 00000100:00080000:3.0:1788200912.344125:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788200912.344601:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695343232 00000100:00100000:2.0:1788200912.344607:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695343232 00000100:00100000:2.0:1788200912.344652:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695343104 00000100:00100000:2.0:1788200912.344655:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695343104 00000100:00100000:2.0:1788200912.344677:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2611 00000100:00100000:2.0:1788200912.344684:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4292087e-fa00-4621-b681-837afc99ae35+5:2401:x1875060695343232:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788200912.344721:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4292087e-fa00-4621-b681-837afc99ae35+5:2401:x1875060695343232:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 38us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200912.344728:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2611 00000100:00100000:2.0:1788200912.344741:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2612 00000100:00100000:2.0:1788200912.344748:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4292087e-fa00-4621-b681-837afc99ae35+5:2401:x1875060695343104:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788200912.344771:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4292087e-fa00-4621-b681-837afc99ae35+5:2401:x1875060695343104:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 24us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200912.344776:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2612 00000100:00080000:3.0:1788200912.346118:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788200912.346131:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788200912.655393:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788200912.731197:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788200912.731204:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788200912.731208:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788200912.731217:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3759 00000100:00080000:3.0:1788200912.731222:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788200912.731227:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788200912.731250:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12fb0d180 x1875060715054720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788200912.731306:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788200912.731310:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788200912.731311:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788200912.731315:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3759 00000100:00080000:3.0:1788200912.731317:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788200912.731320:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788200912.731333:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12fb0ed80 x1875060715054976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788200912.731373:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788200912.731377:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788200912.731379:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788200912.731383:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3759 00000100:00080000:3.0:1788200912.731385:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788200912.731389:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788200912.731403:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc133f4ce00 x1875060715055232/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788200912.731423:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788200912.731426:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788200912.731428:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788200912.731431:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3759 00000100:00080000:3.0:1788200912.731434:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788200912.731444:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788200912.731455:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc133f4c000 x1875060715055616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788200912.731487:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715055104:0@lo:400:kworker.0 00000100:00100000:3.0:1788200912.731566:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200912.731605:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788200912.731616:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715054848:0@lo:400:kworker.0 00000100:00100000:3.0:1788200912.731637:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200912.731669:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715055104 00000100:00100000:3.0:1788200912.731675:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715055104 00000100:00100000:3.0:1788200912.731724:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715054848 00000100:00100000:3.0:1788200912.731734:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715054848 00000100:00100000:3.0:1788200912.731760:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:3.0:1788200912.731767:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715055104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200912.731813:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715055104:12345-0@lo:400:kworker.0 Request processed in 46us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200912.731820:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:3.0:1788200912.731838:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:3.0:1788200912.731845:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715054848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200912.731872:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715054848:12345-0@lo:400:kworker.0 Request processed in 28us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200912.731877:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00080000:3.0:1788200912.731891:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788200912.731918:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715054848:0@lo:400:kworker.0 00000100:00100000:3.0:1788200912.731929:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715055104:0@lo:400:kworker.0 00000100:00100000:1.0:1788200912.732094:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715054720:0@lo:38:kworker.0 00000100:00100000:1.0:1788200912.732124:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200912.732155:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715054976:0@lo:38:kworker.0 00000100:00100000:1.0:1788200912.732175:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200912.732192:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715055232:0@lo:38:kworker.0 00000100:00100000:1.0:1788200912.732217:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200912.732233:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715055616:0@lo:38:kworker.0 00000100:00100000:1.0:1788200912.732255:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200912.732282:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715055232 00000100:00100000:1.0:1788200912.732286:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715055232 00000100:00100000:1.0:1788200912.732319:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3840 00000100:00100000:1.0:1788200912.732324:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715055232:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788200912.732341:0:8458:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200912.732373:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715055232:12345-0@lo:38:kworker.0 Request processed in 47us (155us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788200912.732378:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3840 00000100:00080000:1.0:1788200912.732408:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788200912.732412:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788200912.732415:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715055232:0@lo:38:kworker.0 00000100:00100000:1.0:1788200912.732432:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715054720 00000100:00100000:1.0:1788200912.732443:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715054720 00000100:00100000:1.0:1788200912.732456:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1788200912.732460:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715054720:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788200912.732470:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200912.732499:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715054720:12345-0@lo:38:kworker.0 Request processed in 37us (374us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788200912.732505:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1788200912.732514:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715054976 00000100:00100000:1.0:1788200912.732517:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715054976 00000100:00100000:1.0:1788200912.732525:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715055616 00000100:00100000:1.0:1788200912.732527:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715055616 00000100:00100000:1.0:1788200912.732547:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:1.0:1788200912.732551:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715054976:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788200912.732560:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200912.732583:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715054976:12345-0@lo:38:kworker.0 Request processed in 30us (407us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788200912.732588:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:1.0:1788200912.732598:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:1.0:1788200912.732601:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715055616:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788200912.732610:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200912.732630:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715055616:12345-0@lo:38:kworker.0 Request processed in 27us (375us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788200912.732636:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00080000:1.0:1788200912.732657:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788200912.732661:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788200912.732664:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715054720:0@lo:38:kworker.0 00000100:00080000:1.0:1788200912.732683:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788200912.732687:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788200912.732690:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715054976:0@lo:38:kworker.0 00000100:00080000:1.0:1788200912.732697:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788200912.732700:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788200912.732703:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715055616:0@lo:38:kworker.0 00000100:00100000:0.0:1788200912.733392:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715055360:0@lo:400:kworker.0 00000100:00100000:0.0:1788200912.733431:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200912.733463:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788200912.733470:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715054592:0@lo:400:kworker.0 00000400:00000100:0.0:1788200912.733488:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715054592 offset 0 length 224: 4 00000100:00100000:0.0:1788200912.733509:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715055488:0@lo:400:kworker.0 00000100:00100000:0.0:1788200912.733540:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200912.733569:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715055360 00000100:00100000:0.0:1788200912.733573:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715055360 00000100:00100000:0.0:1788200912.733602:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715055488 00000100:00100000:0.0:1788200912.733605:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715055488 00000100:00100000:0.0:1788200912.733621:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2613 00000100:00100000:0.0:1788200912.733628:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715055360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200912.733669:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715055360:12345-0@lo:400:kworker.0 Request processed in 40us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200912.733675:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2613 00000100:00100000:0.0:1788200912.733689:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2614 00000100:00100000:0.0:1788200912.733703:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715055488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200912.733731:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715055488:12345-0@lo:400:kworker.0 Request processed in 30us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200912.733736:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2614 00000100:00100000:0.0:1788200912.733766:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715055488:0@lo:400:kworker.0 00000100:00100000:0.0:1788200912.733776:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715055360:0@lo:400:kworker.0 00010000:00010000:2.0:1788200913.679214:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200914.703736:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200915.727233:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200916.754912:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788200917.327324:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788200917.327348:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715055744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788200917.327432:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200917.327514:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715055744 00000100:00100000:1.0:1788200917.327523:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715055744 00000100:00100000:3.0:1788200917.327551:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715055872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788200917.327580:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200917.327586:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2120 00000100:00100000:1.0:1788200917.327600:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715055744:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788200917.327612:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788200917.327626:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715055872 00002000:00000024:1.0:1788200917.327632:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200917.327640:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715055872 00000100:00100000:1.0:1788200917.327682:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715055744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200917.327685:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2121 00000100:00100000:1.0:1788200917.327695:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2120 00000100:00100000:3.0:1788200917.327700:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715055872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788200917.327734:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200917.327765:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715055872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200917.327771:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2121 00000100:00080000:3.0:1788200917.327787:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788200917.327816:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715055872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788200917.327828:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715055744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788200917.468365:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000400:00000100:0.0:1788200917.468401:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695343360 offset 0 length 224: 4 00000100:00100000:0.0:1788200917.468431:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200917.468475:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200917.468540:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200917.468569:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695343744 00000100:00100000:0.0:1788200917.468578:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695343744 00000100:00100000:0.0:1788200917.468633:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695343872 00000100:00100000:0.0:1788200917.468636:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695343872 00000100:00100000:0.0:1788200917.468658:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5862 00000100:00100000:0.0:1788200917.468666:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4292087e-fa00-4621-b681-837afc99ae35+5:2399:x1875060695343744:12345-192.168.201.20@tcp:9:kworker.0 00000100:00100000:2.0:1788200917.468765:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695343616 00000100:00100000:2.0:1788200917.468771:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695343616 00000100:00100000:2.0:1788200917.468801:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695343488 00000100:00100000:2.0:1788200917.468805:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695343488 00000100:00100000:2.0:1788200917.468822:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1138 00000100:00100000:2.0:1788200917.468830:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695343616:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788200917.469033:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1124 00000100:00100000:1.0:1788200917.469041:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875060695343488:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:1.0:1788200917.469060:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:00000080:0.0:1788200917.469112:0:26204:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a8cc 00000100:00080000:0.0:1788200917.469120:0:26204:0:(import.c:65:import_set_state_nolock()) ffff8dc109815800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788200917.469176:0:26204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969449 00000100:00100000:2.0:1788200917.469823:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695343616:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 992us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200917.469845:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1138 00000100:00100000:1.0:1788200917.470813:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875060695343488:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 1766us (2386us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788200917.470825:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1124 00000100:00100000:0.0:1788200917.471706:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4292087e-fa00-4621-b681-837afc99ae35+2:2399:x1875060695343744:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 3036us (3227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200917.471717:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5862 00000100:00100000:0.0:1788200917.471741:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5863 00000100:00100000:0.0:1788200917.471753:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4292087e-fa00-4621-b681-837afc99ae35+5:2399:x1875060695343872:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:0.0:1788200917.471789:0:26204:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1a8d3 00000100:00080000:0.0:1788200917.471797:0:26204:0:(import.c:65:import_set_state_nolock()) ffff8dc137d31800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788200917.471858:0:26204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969449 00000100:00100000:0.0:1788200917.472093:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4292087e-fa00-4621-b681-837afc99ae35+2:2399:x1875060695343872:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 343us (3552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200917.472100:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5863 00000100:00080000:0.0:1788200917.472122:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788200917.472127:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788200917.472129:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788200917.472160:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200917.472166:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200917.777155:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788200917.840377:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715056000:0@lo:400:kworker.0 00000400:00000100:0.0:1788200917.840438:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715056000 offset 0 length 224: 4 00000100:00080000:1.0:1788200917.840559:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200917.840564:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788200917.840568:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200917.840583:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3764 00000100:00080000:1.0:1788200917.840588:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788200917.840595:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200917.840624:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13a440000 x1875060715056128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788200917.840711:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715056128:0@lo:38:kworker.0 00000100:00100000:2.0:1788200917.840716:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715056256:0@lo:400:kworker.0 00000100:00100000:3.0:1788200917.840762:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200917.840796:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715056128 00000100:00100000:2.0:1788200917.840805:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715056128 00000100:00100000:3.0:1788200917.840827:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200917.840840:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715056256 00000100:00100000:2.0:1788200917.840844:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715056256 00000100:00100000:3.0:1788200917.840879:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:3.0:1788200917.840888:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715056128:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788200917.840900:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1139 00000100:00100000:2.0:1788200917.840910:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715056256:12345-0@lo:400:kworker.0 00010000:00020000:3.0:1788200917.840911:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788200917.840964:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715056128:12345-0@lo:38:kworker.0 Request processed in 75us (201us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788200917.840974:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:2.0:1788200917.840975:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715056256:12345-0@lo:400:kworker.0 Request processed in 65us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200917.840986:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1139 00000100:00080000:3.0:1788200917.841039:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788200917.841043:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788200917.841046:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200917.841052:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715056128:0@lo:38:kworker.0 00000100:00100000:2.0:1788200917.841076:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715056256:0@lo:400:kworker.0 00000100:00080000:1.0:1788200917.841363:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200917.841368:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788200917.841371:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200917.841375:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3764 00000100:00080000:1.0:1788200917.841378:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788200917.841383:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200917.841399:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc0058a9500 x1875060715056384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788200917.841476:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715056512:0@lo:400:kworker.0 00000100:00100000:0.0:1788200917.841505:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788200917.841557:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200917.841561:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788200917.841563:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200917.841566:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3764 00000100:00080000:1.0:1788200917.841569:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788200917.841573:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200917.841587:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12b637100 x1875060715056640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788200917.841610:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200917.841613:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788200917.841626:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200917.841636:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3764 00000100:00080000:1.0:1788200917.841639:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788200917.841643:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200917.841655:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12b637480 x1875060715057024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788200917.845690:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788200917.845708:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715056768:0@lo:400:kworker.0 00000100:00100000:0.0:1788200917.845767:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200917.845821:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715056896:0@lo:400:kworker.0 00000100:00100000:0.0:1788200917.845850:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200917.845886:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715056768 00000100:00100000:0.0:1788200917.845894:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715056768 00000100:00100000:0.0:1788200917.845939:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715056896 00000100:00100000:0.0:1788200917.845943:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715056896 00000100:00100000:0.0:1788200917.845965:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2615 00000100:00100000:0.0:1788200917.845974:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715056768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200917.847230:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715056768:12345-0@lo:400:kworker.0 Request processed in 1253us (1458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200917.847254:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2615 00000100:00100000:0.0:1788200917.847282:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2616 00000100:00100000:0.0:1788200917.847291:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715056896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200917.847355:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715056896:12345-0@lo:400:kworker.0 Request processed in 60us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200917.847362:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2616 00000100:00100000:0.0:1788200917.847418:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715056896:0@lo:400:kworker.0 00000100:00100000:0.0:1788200917.847462:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715056768:0@lo:400:kworker.0 00000100:00100000:3.0:1788200917.847861:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715056384:0@lo:38:kworker.0 00000100:00100000:3.0:1788200917.847906:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200917.852054:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715056640:0@lo:38:kworker.0 00000100:00100000:3.0:1788200917.852120:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200917.852159:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715057024:0@lo:38:kworker.0 00000100:00100000:3.0:1788200917.852185:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200917.853602:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715056512 00000100:00100000:2.0:1788200917.853614:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715056512 00000100:00080000:2.0:1788200917.853921:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788200917.853975:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715056384 00000100:00100000:2.0:1788200917.853980:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715056384 00000100:00100000:2.0:1788200917.854005:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:2.0:1788200917.854045:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715056512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200917.854139:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715056512:12345-0@lo:400:kworker.0 Request processed in 125us (12632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200917.854147:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:2.0:1788200917.854165:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:2.0:1788200917.854257:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715056384:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788200917.854278:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788200917.854587:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715056384:12345-0@lo:38:kworker.0 Request processed in 256us (6607us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788200917.854596:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00100000:2.0:1788200917.854646:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715056512:0@lo:400:kworker.0 00000100:00100000:2.0:1788200917.854700:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715056640 00000100:00100000:2.0:1788200917.854704:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715056640 00000100:00100000:2.0:1788200917.854726:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3841 00000100:00100000:2.0:1788200917.854731:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715056640:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788200917.854742:0:83817:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788200917.854774:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715056640:12345-0@lo:38:kworker.0 Request processed in 41us (2654us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788200917.854780:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3841 00000100:00080000:3.0:1788200917.855057:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200917.855064:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200917.855068:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715056384:0@lo:38:kworker.0 00000100:00080000:3.0:1788200917.855078:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200917.855082:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200917.855085:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715056640:0@lo:38:kworker.0 00000100:00100000:2.0:1788200917.855123:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715057024 00000100:00100000:2.0:1788200917.855128:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715057024 00000100:00100000:2.0:1788200917.855154:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:2.0:1788200917.855159:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715057024:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788200917.855171:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788200917.855211:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715057024:12345-0@lo:38:kworker.0 Request processed in 50us (3024us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788200917.855218:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00080000:3.0:1788200917.855242:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200917.855248:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200917.855252:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715057024:0@lo:38:kworker.0 00010000:00010000:3.0:1788200918.799222:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200919.824131:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200920.847177:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200921.874693:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788200922.448193:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788200922.448216:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715057152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788200922.448285:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200922.448332:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715057152 00000100:00100000:3.0:1788200922.448340:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715057152 00000100:00100000:3.0:1788200922.448407:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2122 00000100:00100000:3.0:1788200922.448416:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715057152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788200922.448445:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200922.448557:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715057152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 142us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200922.448564:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2122 00000100:00100000:3.0:1788200922.448750:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715057152:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788200922.453836:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788200922.454345:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715057280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788200922.454477:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200922.455863:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715057280 00000100:00100000:1.0:1788200922.455877:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715057280 00000100:00100000:1.0:1788200922.455958:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2123 00000100:00100000:1.0:1788200922.455972:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715057280:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788200922.455977:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788200922.456006:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200922.456119:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715057280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 152us (1642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200922.456127:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2123 00000100:00100000:3.0:1788200922.456281:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715057280:0@lo:13:osp-pre-0-1.0 00000400:00000100:0.0:1788200922.582281:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695344000 offset 0 length 224: 4 00000100:00100000:0.0:1788200922.583578:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200922.583655:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200922.583685:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695344256 00000100:00100000:0.0:1788200922.583695:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695344256 00000100:00100000:0.0:1788200922.583752:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695344128 00000100:00100000:0.0:1788200922.583755:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695344128 00000100:00100000:0.0:1788200922.583776:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1141 00000100:00100000:0.0:1788200922.583788:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695344256:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200922.583858:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695344256:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 73us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200922.583865:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1141 00000100:00100000:0.0:1788200922.583881:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1128 00000100:00100000:0.0:1788200922.583885:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695344128:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:0.0:1788200922.583904:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788200922.583936:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695344128:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 48us (280us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788200922.583943:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1128 00000100:00080000:0.0:1788200922.583963:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788200922.899820:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788200922.963323:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715057408:0@lo:400:kworker.0 00000400:00000100:3.0:1788200922.963391:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715057408 offset 0 length 224: 4 00000100:00080000:0.0:1788200922.963470:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788200922.963475:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788200922.963479:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200922.963485:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3769 00000100:00080000:0.0:1788200922.963490:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788200922.963496:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788200922.963520:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13ab57800 x1875060715057536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788200922.963554:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788200922.963557:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788200922.963559:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200922.963562:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3769 00000100:00080000:0.0:1788200922.963565:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788200922.963568:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788200922.963579:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13ab57480 x1875060715057792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788200922.963593:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788200922.963596:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788200922.963598:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200922.963601:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3769 00000100:00080000:0.0:1788200922.963604:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788200922.963615:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788200922.963628:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13ab54a80 x1875060715058048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788200922.963686:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715058176:0@lo:400:kworker.0 00000100:00100000:1.0:1788200922.963724:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200922.963770:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715058176 00000100:00100000:1.0:1788200922.963777:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715058176 00000100:00100000:1.0:1788200922.963825:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2617 00000100:00100000:1.0:1788200922.963835:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715058176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200922.963884:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715058176:12345-0@lo:400:kworker.0 Request processed in 50us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200922.963890:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2617 00000100:00100000:1.0:1788200922.963931:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715058176:0@lo:400:kworker.0 00000100:00080000:0.0:1788200922.968841:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788200922.968848:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788200922.968853:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200922.968861:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3769 00000100:00080000:0.0:1788200922.968867:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788200922.968873:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788200922.968894:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efc8000 x1875060715058432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788200922.968933:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715057536:0@lo:38:kworker.0 00000100:00100000:0.0:1788200922.969007:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200922.969063:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715057792:0@lo:38:kworker.0 00000100:00100000:0.0:1788200922.969086:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200922.969104:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715058048:0@lo:38:kworker.0 00000100:00100000:0.0:1788200922.969761:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200922.969788:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715058432:0@lo:38:kworker.0 00000100:00100000:0.0:1788200922.969812:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200922.969852:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715057664:0@lo:400:kworker.0 00000100:00100000:0.0:1788200922.969878:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200922.969899:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788200922.969905:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715057920:0@lo:400:kworker.0 00000100:00100000:0.0:1788200922.969926:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200922.969972:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715057536 00000100:00100000:0.0:1788200922.969979:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715057536 00000100:00100000:0.0:1788200922.970006:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715057792 00000100:00100000:0.0:1788200922.970008:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715057792 00000100:00100000:0.0:1788200922.970039:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715058432 00000100:00100000:0.0:1788200922.970042:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715058432 00000100:00100000:0.0:1788200922.970051:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715057664 00000100:00100000:0.0:1788200922.970053:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715057664 00000100:00100000:0.0:1788200922.970085:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715057920 00000100:00100000:0.0:1788200922.970088:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715057920 00000100:00100000:0.0:1788200922.970105:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:0.0:1788200922.970181:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715057664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200922.970237:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715057664:12345-0@lo:400:kworker.0 Request processed in 124us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200922.970244:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00000100:00100000:0.0:1788200922.970260:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:0.0:1788200922.970267:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715057920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200922.970295:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715057920:12345-0@lo:400:kworker.0 Request processed in 29us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200922.970300:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00100000:0.0:1788200922.970312:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:0.0:1788200922.970316:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715057536:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788200922.970335:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788200922.970376:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715057536:12345-0@lo:38:kworker.0 Request processed in 57us (1368us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788200922.970381:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00100000:0.0:1788200922.970392:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:0.0:1788200922.970395:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715057792:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788200922.970412:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788200922.970435:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715057792:12345-0@lo:38:kworker.0 Request processed in 38us (1348us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788200922.970441:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00100000:0.0:1788200922.970453:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:0.0:1788200922.970456:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715058432:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788200922.970465:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788200922.970487:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715058432:12345-0@lo:38:kworker.0 Request processed in 28us (674us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788200922.970493:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:0.0:1788200922.970513:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715058048 00000100:00100000:0.0:1788200922.970517:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715058048 00000100:00100000:0.0:1788200922.970536:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3842 00000100:00100000:0.0:1788200922.970541:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715058048:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788200922.970549:0:8457:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788200922.970572:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715058048:12345-0@lo:38:kworker.0 Request processed in 30us (813us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788200922.970578:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3842 00000100:00080000:0.0:1788200922.970602:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788200922.970630:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715057920:0@lo:400:kworker.0 00000100:00100000:0.0:1788200922.970640:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715057664:0@lo:400:kworker.0 00000100:00080000:0.0:1788200922.970682:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788200922.970687:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788200922.970690:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715057536:0@lo:38:kworker.0 00000100:00080000:0.0:1788200922.970706:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788200922.970710:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788200922.970713:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715057792:0@lo:38:kworker.0 00000100:00080000:0.0:1788200922.970719:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788200922.970723:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788200922.970725:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715058048:0@lo:38:kworker.0 00000100:00080000:0.0:1788200922.970732:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788200922.970736:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788200922.970738:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715058432:0@lo:38:kworker.0 00000100:00100000:3.0:1788200922.970908:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788200922.970923:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715058304:0@lo:400:kworker.0 00000100:00100000:3.0:1788200922.970961:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200922.971850:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715058304 00000100:00100000:0.0:1788200922.971857:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715058304 00000100:00100000:0.0:1788200922.971941:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2618 00000100:00100000:0.0:1788200922.971950:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715058304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200922.972007:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715058304:12345-0@lo:400:kworker.0 Request processed in 59us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200922.972029:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2618 00000100:00100000:0.0:1788200922.976547:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715058304:0@lo:400:kworker.0 00000001:00100000:3.0:1788200923.473217:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4292087e-fa00-4621-b681-837afc99ae35 00000020:00000080:3.0:1788200923.473228:0:9526:0:(genops.c:885:class_export_put()) final put ffff8dc137d33800/4292087e-fa00-4621-b681-837afc99ae35 00000020:00000080:0.0:1788200923.473323:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d33800/4292087e-fa00-4621-b681-837afc99ae35 for lustre-OST0001 00000020:00000080:0.0:1788200923.473397:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc137d31800 for lustre-OST0001 00000001:00100000:3.0:1788200923.474863:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4292087e-fa00-4621-b681-837afc99ae35 00000020:00000080:3.0:1788200923.474871:0:8442:0:(genops.c:885:class_export_put()) final put ffff8dc13339f800/4292087e-fa00-4621-b681-837afc99ae35 00000020:00000080:0.0:1788200923.475806:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13339f800/4292087e-fa00-4621-b681-837afc99ae35 for lustre-OST0000 00000020:00000080:0.0:1788200923.475849:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc109815800 for lustre-OST0000 00000400:00000100:1.0:1788200923.620141:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695344384 offset 0 length 520: 4 00000100:00100000:1.0:1788200923.620184:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200923.620231:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200923.620260:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695344512 00000100:00100000:1.0:1788200923.620269:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695344512 00000100:00100000:1.0:1788200923.620302:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695344640 00000100:00100000:1.0:1788200923.620315:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695344640 00000100:00100000:1.0:1788200923.620359:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1144 00000100:00100000:1.0:1788200923.620375:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695344640:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788200923.620441:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695344640:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 68us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200923.620447:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1144 00000100:00100000:1.0:1788200923.620464:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1132 00000100:00100000:1.0:1788200923.620468:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695344512:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:1.0:1788200923.620486:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200923.620506:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695344512:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 37us (323us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788200923.620511:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1132 00010000:00010000:1.0:1788200923.924784:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1788200923.995601:0:3655:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788200907/real 1788200907] req@ffff8dc12014ea00 x1875060715052672/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788200923 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788200924.059458:0:3655:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8dc12014ea00 x1875060715052672/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788200923 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788200924.059473:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788200924.059476:0:3655:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788200924.059480:0:3655:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.120@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788200924.059482:0:3655:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788200924.059486:0:3655:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc12014ea00 x1875060715052672/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788200923 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788200924.059494:0:3655:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc12fb0ca80 x1875060715054592/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788200928 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788200924.059520:0:3655:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc13a442680 x1875060715056000/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788200933 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788200924.059549:0:3655:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc13ab54e00 x1875060715057408/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788200938 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788200924.059561:0:3655:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788200924.059564:0:3655:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788200924.059565:0:3655:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788200924.059567:0:3655:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:2.0:1788200924.060159:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715056000:0@lo:400:kworker.0 00000100:00100000:2.0:1788200924.060169:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715054592:0@lo:400:kworker.0 00000100:00100000:2.0:1788200924.060218:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715057408:0@lo:400:kworker.0 00000100:00080000:2.0:1788200924.060250:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788200924.060254:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788200924.060257:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788200924.060263:0:41592:0:(import.c:510:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 3712 00000100:00080000:2.0:1788200924.060270:0:41592:0:(import.c:624:import_select_connection()) MGC192.168.201.120@tcp: import ffff8dc104280800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788200924.060298:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005abca80 x1875060715058560/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788200924.060323:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788200924.060327:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788200924.060329:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788200924.060341:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3774 00000100:00080000:2.0:1788200924.060344:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788200924.060347:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788200924.060362:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005abdc00 x1875060715058688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788200924.060391:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788200924.060394:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788200924.060396:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788200924.060399:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3774 00000100:00080000:2.0:1788200924.060402:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788200924.060405:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788200924.060415:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005abf800 x1875060715058944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788200924.060441:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788200924.060451:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788200924.060452:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788200924.060456:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3774 00000100:00080000:2.0:1788200924.060459:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788200924.060464:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788200924.060476:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005abd880 x1875060715059200/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788200924.060500:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788200924.060503:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788200924.060505:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788200924.060508:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3774 00000100:00080000:2.0:1788200924.060510:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788200924.060514:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788200924.060523:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005abea00 x1875060715059584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788200924.060551:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715058816:0@lo:400:kworker.0 00000100:00100000:2.0:1788200924.060614:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200924.060779:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788200924.060786:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715059072:0@lo:400:kworker.0 00000100:00100000:2.0:1788200924.060813:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200924.060851:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715059456:0@lo:400:kworker.0 00000100:00100000:2.0:1788200924.060878:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200924.060898:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788200924.060904:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715059328:0@lo:400:kworker.0 00000100:00100000:2.0:1788200924.061280:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200924.061326:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715052672:0@lo:400:kworker.0 00000100:00100000:1.0:1788200924.062877:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715058816 00000100:00100000:1.0:1788200924.062889:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715058816 00000100:00100000:1.0:1788200924.062974:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715059072 00000100:00100000:1.0:1788200924.062977:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715059072 00000100:00100000:1.0:1788200924.063005:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:1.0:1788200924.063035:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715058816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200924.063128:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715058816:12345-0@lo:400:kworker.0 Request processed in 115us (2514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200924.063135:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:1.0:1788200924.063154:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:1.0:1788200924.063173:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715059072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200924.063203:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715059072:12345-0@lo:400:kworker.0 Request processed in 32us (2389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200924.063209:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:1.0:1788200924.063229:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715059456 00000100:00100000:1.0:1788200924.063233:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715059456 00000100:00100000:1.0:1788200924.063260:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715059328 00000100:00100000:1.0:1788200924.063262:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715059328 00000100:00100000:1.0:1788200924.063281:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2619 00000100:00100000:1.0:1788200924.063287:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715059456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200924.063328:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715059456:12345-0@lo:400:kworker.0 Request processed in 41us (2449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200924.063345:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2619 00000100:00100000:1.0:1788200924.063358:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2620 00000100:00100000:1.0:1788200924.063364:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715059328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200924.063393:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715059328:12345-0@lo:400:kworker.0 Request processed in 29us (2114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200924.063398:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2620 00000100:00100000:1.0:1788200924.063451:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715059328:0@lo:400:kworker.0 00000100:00100000:1.0:1788200924.063463:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715059456:0@lo:400:kworker.0 00000100:00100000:1.0:1788200924.063495:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715059072:0@lo:400:kworker.0 00000100:00100000:1.0:1788200924.063506:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715058816:0@lo:400:kworker.0 00000100:00080000:2.0:1788200924.066620:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788200924.066632:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788200924.066635:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788200924.070832:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715058560:0@lo:250:kworker.0 00000400:00000100:3.0:1788200924.070904:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715058560 offset 0 length 520: 4 00000100:00100000:3.0:1788200924.070956:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715058688:0@lo:38:kworker.0 00000100:00100000:3.0:1788200924.070996:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200924.071091:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715058944:0@lo:38:kworker.0 00000100:00100000:3.0:1788200924.071260:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200924.076567:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715059200:0@lo:38:kworker.0 00000100:00100000:3.0:1788200924.076635:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200924.076670:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715059584:0@lo:38:kworker.0 00000100:00100000:3.0:1788200924.076699:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200924.079797:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715058688 00000100:00100000:2.0:1788200924.079812:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715058688 00000100:00100000:0.0:1788200924.079851:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715058944 00000100:00100000:0.0:1788200924.079857:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715058944 00000100:00100000:2.0:1788200924.079874:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:0.0:1788200924.079878:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:2.0:1788200924.079881:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715058688:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788200924.079893:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715058944:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788200924.080186:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788200924.080265:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715058688:12345-0@lo:38:kworker.0 Request processed in 382us (9268us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788200924.080272:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00010000:00020000:0.0:1788200924.081377:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788200924.081431:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715058944:12345-0@lo:38:kworker.0 Request processed in 1546us (10170us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788200924.081439:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00080000:3.0:1788200924.089175:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200924.089187:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200924.089192:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715058688:0@lo:38:kworker.0 00000100:00080000:3.0:1788200924.089205:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200924.089208:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200924.089212:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715058944:0@lo:38:kworker.0 00000100:00100000:3.0:1788200924.089249:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715059200 00000100:00100000:3.0:1788200924.089256:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715059200 00000100:00100000:3.0:1788200924.089298:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3843 00000100:00100000:3.0:1788200924.089319:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715059200:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788200924.089353:0:83817:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788200924.089417:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715059200:12345-0@lo:38:kworker.0 Request processed in 97us (12782us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788200924.089425:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3843 00000100:00080000:3.0:1788200924.089462:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200924.089467:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200924.089470:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715059200:0@lo:38:kworker.0 00000100:00100000:0.0:1788200924.089846:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715059584 00000100:00100000:0.0:1788200924.089852:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715059584 00000100:00100000:0.0:1788200924.089878:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:0.0:1788200924.089957:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715059584:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788200924.089971:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788200924.090010:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715059584:12345-0@lo:38:kworker.0 Request processed in 125us (13314us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788200924.090034:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00080000:3.0:1788200924.091576:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200924.091585:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200924.091590:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715059584:0@lo:38:kworker.0 00010000:00010000:0.0:1788200924.943770:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200925.967284:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200926.998757:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788200927.333789:0:87170:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788200927.333795:0:87170:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788200927.333797:0:87170:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788200927.333910:0:87170:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dc13f809800 00000020:01000004:3.0:1788200927.333923:0:87170:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788200927.333936:0:87170:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788200927.333949:0:87170:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8dc1401b0000) 00000020:00000080:3.0:1788200927.333966:0:87170:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788200927.403820:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788200927.407446:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788200927.408254:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788200927.408631:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1788200927.408832:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788200927.409129:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788200927.409335:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1788200927.409514:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788200927.409688:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788200927.409912:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1788200927.410115:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788200927.410299:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1788200927.410485:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788200927.410713:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1788200927.413685:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1788200927.414556:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1788200927.414851:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788200927.415011:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788200927.415297:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788200927.415454:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788200927.415670:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1788200927.415852:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1788200927.416099:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1788200927.416290:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1788200927.416483:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788200927.416669:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1788200927.416832:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788200927.417067:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788200927.417684:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1788200927.417874:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788200927.418093:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788200927.418322:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1788200927.418540:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788200927.418801:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788200927.419161:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1788200927.419404:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788200927.419615:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788200927.419816:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788200927.419971:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788200927.420259:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788200927.420425:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788200927.420590:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1788200927.420788:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788200927.420947:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788200927.421212:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1788200927.421400:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788200927.421581:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788200927.422509:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788200927.422836:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1788200927.423169:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788200927.423582:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1788200927.423796:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788200927.424013:0:87170:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:1.0:1788200927.424542:0:87170:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788200927.424761:0:87170:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788200927.424769:0:87170:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788200927.424779:0:87170:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1aa1c 00000020:01000004:1.0:1788200927.424785:0:87170:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788200927.424798:0:87170:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788200927.424802:0:87170:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dc13f809800 from MGS 00000020:01000004:1.0:1788200927.424805:0:87170:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788200927.424814:0:87170:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8dc0040419b8) 00000020:00000080:1.0:1788200927.424823:0:87170:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:1.0:1788200927.424881:0:87170:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc13f809800 from MGS, refs=2 00080000:01000000:1.0:1788200927.424885:0:87170:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788200927.424890:0:87170:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1aa2a 00010000:00010000:1.0:1788200927.425008:0:87170:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1788200927.428347:0:87170:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788200927.430754:0:87174:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788200927.432707:0:87170:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788200927.432752:0:87170:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788200927.433437:0:87170:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788200927.433693:0:87170:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788200927.433872:0:87170:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788200927.433878:0:87170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788200927.434772:0:87170:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788200927.434779:0:87170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788200927.437177:0:87170:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788200927.437187:0:87170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788200927.437637:0:87170:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788200927.437661:0:87170:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1788200927.437663:0:87170:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.120@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1788200927.437667:0:87170:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.120@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:3.0:1788200927.437673:0:87170:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8dc104280800 already not connected (conn 67, was 0): CONNECTING 00000100:00100000:3.0:1788200927.437683:0:87170:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:0.0:1788200927.567384:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788200927.567408:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715059712:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788200927.567485:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200927.567593:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715059712 00000100:00100000:3.0:1788200927.567601:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715059712 00000100:00100000:3.0:1788200927.567665:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2124 00000100:00100000:3.0:1788200927.567676:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715059712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788200927.567705:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200927.567751:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715059712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200927.567757:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2124 00000100:00100000:3.0:1788200927.567808:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715059712:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788200927.567882:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788200927.568869:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715059840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788200927.568914:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200927.569039:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715059840 00000100:00100000:1.0:1788200927.569046:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715059840 00000100:00100000:1.0:1788200927.569094:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2125 00000100:00100000:1.0:1788200927.569113:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715059840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788200927.569135:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200927.569177:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715059840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200927.569183:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2125 00000100:00100000:3.0:1788200927.569347:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715059840:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788200927.569408:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788200928.015308:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788200928.724672:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200928.724750:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200928.725701:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695344896 00000100:00100000:1.0:1788200928.725713:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695344896 00000100:00100000:1.0:1788200928.725790:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695344768 00000100:00100000:1.0:1788200928.725807:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695344768 00000100:00100000:1.0:1788200928.725843:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1147 00000100:00100000:1.0:1788200928.725855:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695344896:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200928.725926:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1136 00000100:00100000:1.0:1788200928.725935:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695344896:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 81us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200928.725936:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695344768:12345-192.168.201.20@tcp:38:kworker.0 00000100:00100000:1.0:1788200928.725951:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1147 00010000:00020000:3.0:1788200928.725974:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788200928.726008:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695344768:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 72us (1255us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788200928.726032:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1136 00000100:00080000:0.0:1788200928.726157:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788200929.039655:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788200929.105192:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788200929.105203:0:41592:0:(pinger.c:247:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788200929.105206:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788200929.105229:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788200929.105232:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200929.105241:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3775 00000100:00080000:0.0:1788200929.105255:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788200929.105263:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788200929.105301:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efca300 x1875060715059968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788200929.105358:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788200929.105361:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788200929.105363:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200929.105366:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3775 00000100:00080000:0.0:1788200929.105368:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788200929.105371:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788200929.105383:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efc8380 x1875060715060224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788200929.105399:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788200929.105403:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788200929.105405:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200929.105409:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3775 00000100:00080000:0.0:1788200929.105411:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788200929.105414:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788200929.105428:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efc9880 x1875060715060480/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788200929.105470:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788200929.105479:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788200929.105481:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788200929.105486:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3775 00000100:00080000:0.0:1788200929.105489:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788200929.105493:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788200929.105507:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715060608:0@lo:400:kworker.0 00000100:00100000:0.0:1788200929.105510:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efc8700 x1875060715060864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788200929.105540:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715060736:0@lo:400:kworker.0 00000100:00100000:1.0:1788200929.105625:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715059968:0@lo:38:kworker.0 00000100:00100000:2.0:1788200929.105716:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715060096:0@lo:400:kworker.0 00000100:00100000:3.0:1788200929.108578:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200929.108673:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715060608 00000100:00100000:3.0:1788200929.108683:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715060608 00000100:00100000:3.0:1788200929.108898:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2621 00000100:00100000:3.0:1788200929.108910:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715060608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200929.108989:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715060608:12345-0@lo:400:kworker.0 Request processed in 83us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200929.108997:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2621 00000100:00100000:3.0:1788200929.109144:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715060608:0@lo:400:kworker.0 00000100:00080000:3.0:1788200929.109184:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788200929.109208:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715060352:0@lo:400:kworker.0 00000100:00100000:3.0:1788200929.109256:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200929.109292:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715060352 00000100:00100000:3.0:1788200929.109296:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715060352 00000100:00100000:3.0:1788200929.109336:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:3.0:1788200929.109343:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715060352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200929.109381:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715060352:12345-0@lo:400:kworker.0 Request processed in 38us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200929.109386:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00080000:3.0:1788200929.109402:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788200929.109417:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715060352:0@lo:400:kworker.0 00000100:00100000:1.0:1788200929.114184:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200929.114237:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715060224:0@lo:38:kworker.0 00000100:00100000:1.0:1788200929.114291:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200929.114329:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715059968 00000100:00100000:1.0:1788200929.114337:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715059968 00000100:00100000:1.0:1788200929.114376:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715060224 00000100:00100000:1.0:1788200929.114379:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715060224 00000100:00100000:1.0:1788200929.114397:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:1.0:1788200929.114404:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715059968:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788200929.114427:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200929.114465:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715059968:12345-0@lo:38:kworker.0 Request processed in 60us (289us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788200929.114473:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00100000:1.0:1788200929.114491:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:1.0:1788200929.114495:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715060224:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788200929.114504:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200929.114531:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715060224:12345-0@lo:38:kworker.0 Request processed in 35us (240us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788200929.114536:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00080000:1.0:1788200929.114587:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788200929.114592:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788200929.114596:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715060224:0@lo:38:kworker.0 00000100:00100000:1.0:1788200929.114603:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715060480:0@lo:38:kworker.0 00000100:00100000:1.0:1788200929.114631:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200929.114657:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715060480 00000100:00100000:1.0:1788200929.114661:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715060480 00000100:00100000:1.0:1788200929.114680:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3844 00000100:00100000:1.0:1788200929.114685:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715060480:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788200929.114714:0:8457:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200929.114739:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715060480:12345-0@lo:38:kworker.0 Request processed in 54us (108us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788200929.114745:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3844 00000100:00080000:1.0:1788200929.114768:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788200929.114772:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788200929.114775:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715060480:0@lo:38:kworker.0 00000100:00100000:1.0:1788200929.114781:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715060864:0@lo:38:kworker.0 00000100:00100000:1.0:1788200929.114805:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200929.114826:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715060864 00000100:00100000:1.0:1788200929.114845:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715060864 00000100:00100000:1.0:1788200929.114864:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1139 00000100:00100000:1.0:1788200929.114869:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715060864:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788200929.114878:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200929.114906:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715060864:12345-0@lo:38:kworker.0 Request processed in 36us (100us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788200929.114921:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1139 00000100:00080000:1.0:1788200929.114947:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788200929.114951:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788200929.114954:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715060864:0@lo:38:kworker.0 00000100:00080000:1.0:1788200929.114988:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788200929.114992:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788200929.114995:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715059968:0@lo:38:kworker.0 00000100:00100000:0.0:1788200929.115532:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200929.116316:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715060736 00000100:00100000:1.0:1788200929.116324:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715060736 00000100:00100000:1.0:1788200929.116394:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2622 00000100:00100000:1.0:1788200929.116403:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715060736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200929.116467:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715060736:12345-0@lo:400:kworker.0 Request processed in 66us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200929.116474:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2622 00000100:00100000:0.0:1788200929.116564:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715060736:0@lo:400:kworker.0 00000100:00080000:3.0:1788200929.116572:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788200929.121885:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200929.122230:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715060096 00000100:00100000:1.0:1788200929.122241:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715060096 00000100:00100000:1.0:1788200929.122331:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:1.0:1788200929.122341:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715060096:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788200929.122360:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788200929.122475:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715060096:12345-0@lo:400:kworker.0 Request processed in 136us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200929.122482:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00100000:0.0:1788200929.132489:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715060096:0@lo:400:kworker.0 00010000:00010000:3.0:1788200930.064655:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200931.087279:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200932.117482:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788200932.687603:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788200932.687649:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715061120:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788200932.687743:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200932.687811:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00388ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715060992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788200932.687837:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200932.687904:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715061120 00000100:00100000:1.0:1788200932.687920:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715061120 00000100:00100000:3.0:1788200932.688118:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715060992 00000100:00100000:3.0:1788200932.688124:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715060992 00000100:00100000:1.0:1788200932.688255:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2126 00000100:00100000:1.0:1788200932.688287:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715061120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788200932.688329:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200932.688436:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715061120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 152us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200932.688444:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2126 00000100:00100000:1.0:1788200932.688529:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715061120:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788200932.691857:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788200932.691874:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788200932.692127:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2127 00000100:00100000:3.0:1788200932.692149:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715060992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788200932.692215:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200932.692351:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715060992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 212us (4512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200932.692380:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2127 00000100:00100000:0.0:1788200932.693317:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00388ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715060992:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788200933.135366:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200933.872619:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200933.872695:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200933.872736:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200933.872869:0:87176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695345024 00000100:00100000:0.0:1788200933.872883:0:87176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695345024 00000100:00100000:0.0:1788200933.872947:0:87176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:0.0:1788200933.872958:0:87176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1258bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2399:x1875060695345024:12345-192.168.201.20@tcp:250:kworker.0 00010000:00080000:0.0:1788200933.872996:0:87176:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 0fa559bc-2180-4019-80c4-11831fedf9a9@192.168.201.20@tcp t0 exp 0000000000000000 cur 3785 last 0 00000020:00000080:0.0:1788200933.873083:0:87176:0:(genops.c:1385:class_connect()) connect: client 0fa559bc-2180-4019-80c4-11831fedf9a9, cookie 0x96d0c9b8c9a1aa31 00000100:00080000:0.0:1788200933.873301:0:87176:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788200933.873405:0:87176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1258bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+5:2399:x1875060695345024:12345-192.168.201.20@tcp:250:kworker.0 Request processed in 436us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200933.873415:0:87176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:3.0:1788200933.874078:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695345280 00000100:00100000:3.0:1788200933.874087:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695345280 00000100:00100000:3.0:1788200933.874170:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695345152 00000100:00100000:3.0:1788200933.874174:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695345152 00000100:00100000:3.0:1788200933.874193:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1150 00000100:00100000:3.0:1788200933.874203:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695345280:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200933.874275:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695345280:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 74us (1675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200933.874282:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1150 00000100:00100000:3.0:1788200933.874303:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1140 00000100:00100000:3.0:1788200933.874308:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695345152:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:3.0:1788200933.874331:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788200933.874355:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695345152:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 46us (1618us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788200933.874360:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1140 00000100:00080000:0.0:1788200933.875380:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788200934.159837:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788200934.223362:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200934.223376:0:86307:0:(pinger.c:247:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788200934.223380:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200934.223384:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788200934.223389:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200934.223400:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3780 00000100:00080000:1.0:1788200934.223406:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788200934.223416:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200934.223471:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11d29d880 x1875060715061248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788200934.223537:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200934.223541:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788200934.223543:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200934.223547:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3780 00000100:00080000:1.0:1788200934.223549:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788200934.223574:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200934.223602:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11d29f100 x1875060715061504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788200934.223620:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200934.223624:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788200934.223634:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200934.223637:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3780 00000100:00080000:1.0:1788200934.223640:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788200934.223644:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200934.223659:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11d29ce00 x1875060715061760/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788200934.223691:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200934.223695:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788200934.223697:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200934.223700:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3780 00000100:00080000:1.0:1788200934.223703:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788200934.223707:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200934.223717:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11d29e680 x1875060715062144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788200934.223834:0:3654:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788200924/real 1788200924] req@ffff8dc005abca80 x1875060715058560/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788200934 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788200934.223866:0:3654:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dc005abca80 x1875060715058560/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788200934 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788200934.223894:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715061248:0@lo:38:kworker.0 00000100:00100000:3.0:1788200934.223981:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200934.224050:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715061504:0@lo:38:kworker.0 00000100:00100000:3.0:1788200934.224082:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200934.224099:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715061760:0@lo:38:kworker.0 00000100:00100000:3.0:1788200934.224124:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200934.224139:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715062144:0@lo:38:kworker.0 00000100:00100000:3.0:1788200934.224172:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788200934.224188:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200934.224199:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788200934.224208:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715058560:0@lo:250:kworker.0 00000100:00100000:3.0:1788200934.224254:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715061760 00000100:00100000:3.0:1788200934.224263:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715061760 00000100:00100000:3.0:1788200934.224303:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3845 00000100:00100000:3.0:1788200934.224311:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715061760:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788200934.224340:0:83817:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788200934.224387:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715061760:12345-0@lo:38:kworker.0 Request processed in 75us (261us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788200934.224395:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3845 10000000:01000000:3.0:1788200934.224435:0:87170:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:3.0:1788200934.224457:0:87170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec800/0x96d0c9b8c9a1a679 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1a680 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788200934.224468:0:87170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec800/0x96d0c9b8c9a1a679 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1a680 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788200934.224476:0:87170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788200934.224492:0:87170:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788200934.224505:0:87170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec800/0x96d0c9b8c9a1a679 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1a680 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200934.224539:0:87170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d200/0x96d0c9b8c9a1a5df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1a5e6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788200934.224546:0:87170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d200/0x96d0c9b8c9a1a5df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1a5e6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788200934.224551:0:87170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788200934.224554:0:87170:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788200934.224558:0:87170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d200/0x96d0c9b8c9a1a5df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1a5e6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200934.224567:0:87170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d400/0x96d0c9b8c9a1a5fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1a602 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788200934.224573:0:87170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d400/0x96d0c9b8c9a1a5fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1a602 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788200934.224578:0:87170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788200934.224581:0:87170:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788200934.224583:0:87170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d400/0x96d0c9b8c9a1a5fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1a602 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200934.224592:0:87170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1a625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1a62c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788200934.224599:0:87170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1a625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1a62c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788200934.224604:0:87170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788200934.224615:0:87170:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788200934.224620:0:87170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1a625 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1a62c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200934.224629:0:87170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d600/0x96d0c9b8c9a1a633 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1a63a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788200934.224636:0:87170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d600/0x96d0c9b8c9a1a633 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1a63a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788200934.224641:0:87170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788200934.224644:0:87170:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788200934.224648:0:87170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d600/0x96d0c9b8c9a1a633 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1a63a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200934.224656:0:87170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1a64f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1a656 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788200934.224663:0:87170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1a64f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1a656 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788200934.224668:0:87170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788200934.224671:0:87170:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788200934.224675:0:87170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1a64f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1a656 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200934.224683:0:87170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064edc00/0x96d0c9b8c9a1a65d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1a664 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788200934.224689:0:87170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064edc00/0x96d0c9b8c9a1a65d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1a664 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788200934.224705:0:87170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788200934.224709:0:87170:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788200934.224712:0:87170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064edc00/0x96d0c9b8c9a1a65d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1a664 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200934.224721:0:87170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1a687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1a68e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788200934.224728:0:87170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1a687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1a68e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788200934.224734:0:87170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788200934.224737:0:87170:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788200934.224741:0:87170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1a687 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1a68e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200934.224754:0:87170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc00782ca00/0x96d0c9b8c9a1a5ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1a5f4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788200934.224761:0:87170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782ca00/0x96d0c9b8c9a1a5ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1a5f4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788200934.224767:0:87170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788200934.224770:0:87170:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788200934.224774:0:87170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc00782ca00/0x96d0c9b8c9a1a5ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1a5f4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200934.224784:0:87170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc00782d600/0x96d0c9b8c9a1a609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1a610 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788200934.224800:0:87170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782d600/0x96d0c9b8c9a1a609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1a610 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788200934.224806:0:87170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:3.0:1788200934.224810:0:87170:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788200934.224814:0:87170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc00782d600/0x96d0c9b8c9a1a609 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1a610 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200934.224828:0:87170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064ece00/0x96d0c9b8c9a1a617 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1a61e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788200934.224835:0:87170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ece00/0x96d0c9b8c9a1a617 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1a61e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788200934.224840:0:87170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788200934.224843:0:87170:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788200934.224847:0:87170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064ece00/0x96d0c9b8c9a1a617 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1a61e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200934.224856:0:87170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007a2dc00/0x96d0c9b8c9a1a641 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1a648 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788200934.224862:0:87170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007a2dc00/0x96d0c9b8c9a1a641 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1a648 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788200934.224867:0:87170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788200934.224870:0:87170:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788200934.224873:0:87170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007a2dc00/0x96d0c9b8c9a1a641 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1a648 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200934.224893:0:87170:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8600/0x96d0c9b8c9a1a66b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1a672 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788200934.224899:0:87170:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8600/0x96d0c9b8c9a1a66b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1a672 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788200934.224905:0:87170:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788200934.224908:0:87170:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788200934.224912:0:87170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8600/0x96d0c9b8c9a1a66b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1a672 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788200934.224928:0:87170:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8dc104280800 already not connected (conn 67, was 0): DISCONN 00000100:00080000:3.0:1788200934.224934:0:87170:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788200934.224939:0:87170:0:(import.c:510:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 3775 00000100:00080000:3.0:1788200934.224944:0:87170:0:(import.c:589:import_select_connection()) MGC192.168.201.120@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788200934.224949:0:87170:0:(import.c:624:import_select_connection()) MGC192.168.201.120@tcp: import ffff8dc104280800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788200934.224967:0:87170:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11cc2aa00 x1875060715062272/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788200934.224980:0:87170:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:3.0:1788200934.225058:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715061248 00000100:00100000:3.0:1788200934.225063:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715061248 00000100:00100000:3.0:1788200934.225085:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715061504 00000100:00100000:3.0:1788200934.225087:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715061504 00000100:00100000:3.0:1788200934.225097:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715062144 00000100:00100000:3.0:1788200934.225099:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715062144 00000100:00100000:3.0:1788200934.225109:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:3.0:1788200934.225114:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715061248:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788200934.225128:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788200934.225185:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715061248:12345-0@lo:38:kworker.0 Request processed in 70us (1204us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788200934.225191:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:3.0:1788200934.225203:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:3.0:1788200934.225207:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715061504:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788200934.225215:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788200934.225236:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715061504:12345-0@lo:38:kworker.0 Request processed in 28us (1153us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788200934.225241:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00000100:00100000:3.0:1788200934.225250:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:3.0:1788200934.225254:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715062144:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788200934.225262:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788200934.225283:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715062144:12345-0@lo:38:kworker.0 Request processed in 28us (1111us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788200934.225288:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00100000:3.0:1788200934.225308:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715062272:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788200934.225344:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788200934.225390:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200934.225395:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200934.225398:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715061248:0@lo:38:kworker.0 00000100:00080000:3.0:1788200934.225408:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200934.225411:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200934.225414:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715061504:0@lo:38:kworker.0 00000100:00080000:3.0:1788200934.225423:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200934.225433:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200934.225435:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715061760:0@lo:38:kworker.0 00000100:00080000:3.0:1788200934.225445:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200934.225448:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200934.225451:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715062144:0@lo:38:kworker.0 00000100:00100000:0.0:1788200934.225575:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715061376:0@lo:400:kworker.0 00000100:00100000:0.0:1788200934.225612:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200934.225645:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788200934.225651:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715061632:0@lo:400:kworker.0 00000100:00100000:0.0:1788200934.225675:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200934.225710:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715062016:0@lo:400:kworker.0 00000100:00100000:0.0:1788200934.225739:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200934.225760:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788200934.225766:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715061888:0@lo:400:kworker.0 00000100:00100000:0.0:1788200934.225787:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200934.225818:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715062016 00000100:00100000:0.0:1788200934.225824:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715062016 00000100:00100000:0.0:1788200934.225869:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715061888 00000100:00100000:0.0:1788200934.225872:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715061888 00000100:00100000:0.0:1788200934.225895:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2623 00000100:00100000:0.0:1788200934.225903:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715062016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200934.225949:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715062016:12345-0@lo:400:kworker.0 Request processed in 47us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200934.225956:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2623 00000100:00100000:0.0:1788200934.225969:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2624 00000100:00100000:0.0:1788200934.225975:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715061888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200934.226001:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715061888:12345-0@lo:400:kworker.0 Request processed in 26us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200934.226006:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2624 00000100:00080000:0.0:1788200934.226066:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788200934.226070:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788200934.226092:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715061888:0@lo:400:kworker.0 00000100:00100000:0.0:1788200934.226111:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715062016:0@lo:400:kworker.0 00000100:00100000:1.0:1788200934.226309:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715061376 00000100:00100000:1.0:1788200934.226316:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715061376 00000100:00100000:1.0:1788200934.226355:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715061632 00000100:00100000:1.0:1788200934.226359:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715061632 00000100:00100000:1.0:1788200934.226374:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:1.0:1788200934.226381:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715061376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200934.226438:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715061376:12345-0@lo:400:kworker.0 Request processed in 57us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200934.226445:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:1.0:1788200934.226461:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:1.0:1788200934.226468:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715061632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200934.226494:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715061632:12345-0@lo:400:kworker.0 Request processed in 27us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200934.226499:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:1.0:1788200934.226537:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715061632:0@lo:400:kworker.0 00000100:00100000:1.0:1788200934.226547:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715061376:0@lo:400:kworker.0 00000100:00080000:1.0:1788200934.226573:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200934.226578:0:86307:0:(pinger.c:247:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788200934.226610:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715062272 00000100:00100000:1.0:1788200934.226614:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715062272 00000100:00100000:1.0:1788200934.227343:0:87178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788200934.227353:0:87178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1258bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3654:x1875060715062272:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788200934.227387:0:87178:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c9b18af6-fecc-4172-82c2-66531890fe11@0@lo t0 exp 0000000000000000 cur 3785 last 0 00000020:00000080:1.0:1788200934.227423:0:87178:0:(genops.c:1385:class_connect()) connect: client c9b18af6-fecc-4172-82c2-66531890fe11, cookie 0x96d0c9b8c9a1aa38 00000100:00080000:1.0:1788200934.227620:0:87178:0:(import.c:65:import_set_state_nolock()) ffff8dc137d37800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788200934.227712:0:87178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1258bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+5:3654:x1875060715062272:12345-0@lo:250:mount.lustre.0 Request processed in 359us (2368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200934.227722:0:87178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788200934.227791:0:3654:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.120@tcp: committing for last_committed 0 gen 25 00000100:00080000:1.0:1788200934.227802:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.120@tcp: connect to target with instance 0 00000100:00080000:1.0:1788200934.227824:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788200934.227829:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788200934.227833:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788200934.227836:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788200934.227857:0:3654:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788200934.227866:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715062272:0@lo:250:mount.lustre.0 00000100:00080000:0.0:1788200934.228573:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788200934.228670:0:87170:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:3.0:1788200934.228687:0:87170:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788200934.228742:0:87170:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788200934.228749:0:87170:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788200934.228898:0:87170:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788200934.228955:0:87170:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.120@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788200934.228961:0:87170:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788200934.228963:0:87170:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788200934.228964:0:87170:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788200934.228966:0:87170:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788200934.228967:0:87170:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788200934.228969:0:87170:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788200934.228971:0:87170:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788200934.228973:0:87170:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788200934.228975:0:87170:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788200934.228977:0:87170:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788200934.228980:0:87170:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788200934.228982:0:87170:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788200934.228983:0:87170:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000000:1.0:1788200934.229219:0:86307:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.201.120@tcp 10000000:01000000:1.0:1788200934.229240:0:86307:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1788200934.229243:0:86307:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788200934.229245:0:86307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788200934.229246:0:86307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788200934.229247:0:86307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788200934.229248:0:86307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788200934.229249:0:86307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788200934.229250:0:86307:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788200934.229252:0:86307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788200934.229253:0:86307:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1788200934.229322:0:86307:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1788200934.229331:0:86307:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1788200934.229333:0:86307:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788200934.229334:0:86307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788200934.229335:0:86307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788200934.229337:0:86307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788200934.229338:0:86307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788200934.229339:0:86307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788200934.229340:0:86307:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788200934.229342:0:86307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788200934.229343:0:86307:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1788200934.229356:0:86307:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1788200934.229361:0:86307:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1788200934.229363:0:86307:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788200934.229365:0:86307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788200934.229366:0:86307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788200934.229367:0:86307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788200934.229368:0:86307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788200934.229369:0:86307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788200934.229371:0:86307:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788200934.229379:0:86307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788200934.229381:0:86307:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1788200934.229403:0:86307:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1788200934.229619:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715062528:0@lo:253:kworker.0 00000100:00100000:2.0:1788200934.229731:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200934.229791:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788200934.229796:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715062400:0@lo:253:kworker.0 00000100:00100000:2.0:1788200934.229823:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200934.229869:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715062528 00000100:00100000:2.0:1788200934.229877:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715062528 00000100:00100000:2.0:1788200934.229935:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715062400 00000100:00100000:2.0:1788200934.229939:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715062400 00000100:00100000:2.0:1788200934.229955:0:87178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788200934.229964:0:87178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1258b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+6:3658:x1875060715062528:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788200934.230006:0:87178:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:2.0:1788200934.230188:0:87176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788200934.230197:0:87176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1258ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+6:3658:x1875060715062400:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788200934.230214:0:87176:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 10000000:01000000:2.0:1788200934.230257:0:87180:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788200934.230390:0:87178:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 107 00000020:01000004:3.0:1788200934.231042:0:87170:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788200934.231044:0:87170:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788200934.231045:0:87170:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788200934.231047:0:87170:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788200934.231049:0:87170:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788200934.231051:0:87170:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788200934.231053:0:87170:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788200934.231054:0:87170:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788200934.231082:0:87170:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788200934.231101:0:87170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc2b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715062784:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788200934.231187:0:87170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200934.231216:0:87170:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0010ebd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788200934.231660:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788200934.231678:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715062656:0@lo:253:kworker.0 00000100:00100000:0.0:1788200934.231721:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200934.231984:0:87177:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1788200934.231994:0:87177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:1.0:1788200934.232544:0:87177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715062784 00000100:00100000:1.0:1788200934.232554:0:87177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715062784 00000100:00100000:1.0:1788200934.232703:0:87177:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1788200934.232712:0:87177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715062656 00000100:00100000:1.0:1788200934.232715:0:87177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715062656 00000100:00100000:3.0:1788200934.232861:0:87181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788200934.232873:0:87181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+8:87170:x1875060715062784:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788200934.237602:0:87182:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788200934.237614:0:87182:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788200934.237618:0:87182:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788200934.237621:0:87182:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788200934.237834:0:87182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788200934.238347:0:87178:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788200934.238383:0:87178:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788200934.238829:0:87181:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788200934.238834:0:87181:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788200934.238840:0:87181:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:3.0:1788200934.238849:0:87181:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788200934.246912:0:87178:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788200934.246956:0:87178:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788200934.247248:0:87176:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788200934.247776:0:87180:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788200934.247783:0:87180:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788200934.247818:0:87180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc0078fd000/0x96d0c9b8c9a1aa3f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200934.247839:0:87180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fd000/0x96d0c9b8c9a1aa3f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788200934.247851:0:87180:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000068563s 00010000:00010000:3.0:1788200934.247857:0:87180:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc0078fd000/0x96d0c9b8c9a1aa3f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200934.247864:0:87180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc0078fd000/0x96d0c9b8c9a1aa3f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200934.247872:0:87180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc0078fd000/0x96d0c9b8c9a1aa3f lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200934.247880:0:87180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc0078fd000/0x96d0c9b8c9a1aa3f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200934.247886:0:87180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200934.247891:0:87180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc0078fd000/0x96d0c9b8c9a1aa3f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200934.247929:0:87180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc0078fd000/0x96d0c9b8c9a1aa3f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200934.247947:0:87180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc0078fd000/0x96d0c9b8c9a1aa3f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200934.247957:0:87180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc0078fd000/0x96d0c9b8c9a1aa3f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200934.247965:0:87180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fd000/0x96d0c9b8c9a1aa3f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200934.248119:0:87181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+8:87170:x1875060715062784:12345-0@lo:253:mount.lustre.0 Request processed in 15243us (16925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200934.248131:0:87181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788200934.248204:0:87181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788200934.248219:0:87181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+7:3656:x1875060715062656:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1788200934.248260:0:87181:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:3.0:1788200934.248544:0:87178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1258b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+7:3658:x1875060715062528:12345-0@lo:253:kworker.0 Request processed in 18580us (18812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200934.248552:0:87178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788200934.248760:0:87170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc2b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715062784:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788200934.248779:0:87170:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788200934.248783:0:87170:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788200934.248785:0:87170:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788200934.248786:0:87170:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788200934.248787:0:87170:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788200934.248788:0:87170:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788200934.248790:0:87170:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788200934.248791:0:87170:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788200934.248793:0:87170:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788200934.248795:0:87170:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788200934.248796:0:87170:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788200934.248826:0:87170:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dc13f809800 from lustre-MDT0000 10000000:01000000:2.0:1788200934.248868:0:87170:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788200934.248872:0:87170:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788200934.248895:0:87170:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dc13f809800 10000000:01000000:2.0:1788200934.248901:0:87170:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788200934.248907:0:87170:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8dc13f809800 10000000:01000000:2.0:1788200934.248910:0:87170:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788200934.248914:0:87170:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dc13f809800 from 1 10000000:01000000:2.0:1788200934.248918:0:87170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788200934.248962:0:87170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100031400/0x96d0c9b8c9a1aa46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200934.248974:0:87170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc100031400/0x96d0c9b8c9a1aa46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200934.248994:0:87170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc100031400/0x96d0c9b8c9a1aa46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200934.249046:0:87170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715062912:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788200934.249093:0:87170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200934.249135:0:87170:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccf480 going to sleep for 11 seconds 00000100:00100000:3.0:1788200934.249339:0:87177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715062912 00000100:00100000:3.0:1788200934.249348:0:87177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715062912 00000100:00100000:3.0:1788200934.249398:0:87177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788200934.249407:0:87177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+7:87170:x1875060715062912:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788200934.249418:0:87177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788200934.249435:0:87177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1aa4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1aa46 expref: -99 pid: 87177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200934.249474:0:87177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1aa4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1aa46 expref: 8 pid: 87177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200934.249485:0:87177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1aa4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1aa46 expref: 8 pid: 87177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200934.249495:0:87177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fda00, rc 0) 00000100:00100000:3.0:1788200934.249532:0:87177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+8:87170:x1875060715062912:12345-0@lo:101:mount.lustre.0 Request processed in 126us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200934.249538:0:87177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788200934.249615:0:87170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715062912:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788200934.249631:0:87170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc100031400/0x96d0c9b8c9a1aa46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1aa4d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200934.249641:0:87170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc100031400/0x96d0c9b8c9a1aa46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1aa4d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788200934.249656:0:87170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788200934.249675:0:87170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100031400/0x96d0c9b8c9a1aa46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1aa4d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200934.249683:0:87170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc100031400/0x96d0c9b8c9a1aa46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1aa4d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788200934.249698:0:87170:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788200934.249702:0:87170:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788200934.249707:0:87170:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8dc13f809800 10000000:01000000:2.0:1788200934.249709:0:87170:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788200934.249731:0:87170:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788200934.249733:0:87170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788200934.249751:0:87170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1aa54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200934.249759:0:87170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1aa54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200934.249767:0:87170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1aa54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200934.249780:0:87170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715063040:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788200934.249808:0:87170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200934.249821:0:87170:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccf480 going to sleep for 11 seconds 00000100:00100000:2.0:1788200934.250052:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715063040 00000100:00100000:2.0:1788200934.250058:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715063040 00000100:00100000:2.0:1788200934.250081:0:87178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788200934.250087:0:87178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11802ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:87170:x1875060715063040:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788200934.250096:0:87178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788200934.250108:0:87178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc100030000/0x96d0c9b8c9a1aa5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1aa54 expref: -99 pid: 87178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200934.250124:0:87178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc100030000/0x96d0c9b8c9a1aa5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1aa54 expref: 9 pid: 87178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200934.250145:0:87178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc100030000/0x96d0c9b8c9a1aa5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1aa54 expref: 9 pid: 87178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200934.250153:0:87178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc100030000, rc 0) 00000100:00100000:2.0:1788200934.250200:0:87178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11802ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+9:87170:x1875060715063040:12345-0@lo:101:mount.lustre.0 Request processed in 112us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200934.250206:0:87178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788200934.250239:0:87170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715063040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788200934.250248:0:87170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1aa54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1aa5b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200934.250255:0:87170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1aa54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1aa5b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200934.250312:0:87170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715063168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788200934.250337:0:87170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200934.250358:0:87170:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccf480 going to sleep for 11 seconds 00000100:00100000:2.0:1788200934.250369:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715063168 00000100:00100000:2.0:1788200934.250373:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715063168 00000100:00100000:2.0:1788200934.250391:0:87178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788200934.250396:0:87178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11802f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+9:87170:x1875060715063168:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788200934.250538:0:87178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11802f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:87170:x1875060715063168:12345-0@lo:501:mount.lustre.0 Request processed in 140us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200934.250544:0:87178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788200934.250574:0:87170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715063168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788200934.250614:0:87170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715063296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788200934.250660:0:87170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200934.250672:0:87170:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccf480 going to sleep for 11 seconds 00000100:00100000:2.0:1788200934.250684:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715063296 00000100:00100000:2.0:1788200934.250688:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715063296 00000100:00100000:2.0:1788200934.250703:0:87178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788200934.250708:0:87178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11802d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:87170:x1875060715063296:12345-0@lo:503:mount.lustre.0 00000020:01000004:0.0:1788200934.250909:0:3658:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788200934.250912:0:3658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788200934.250914:0:3658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788200934.250915:0:3658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788200934.250916:0:3658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788200934.250918:0:3658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788200934.250919:0:3658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788200934.250921:0:3658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788200934.250922:0:3658:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788200934.250926:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715062528:0@lo:253:kworker.0 00000100:00100000:3.0:1788200934.259066:0:87178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11802d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:87170:x1875060715063296:12345-0@lo:503:mount.lustre.0 Request processed in 8341us (8389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200934.259087:0:87178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788200934.259405:0:87170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715063296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788200934.260423:0:87183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:87183:1875060715063424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788200934.260513:0:87183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200934.260566:0:87183:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc139bfe000 going to sleep for 11 seconds 00000100:00100000:3.0:1788200934.260665:0:87177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715063424 00000100:00100000:3.0:1788200934.260673:0:87177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715063424 00000100:00100000:3.0:1788200934.260729:0:87177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788200934.260742:0:87177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11802c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:87183:x1875060715063424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788200934.261726:0:87177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11802c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:87183:x1875060715063424:12345-0@lo:502:llog_process_th.0 Request processed in 983us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200934.261738:0:87177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 20000000:01000000:2.0:1788200934.266900:0:87176:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788200934.266936:0:87176:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788200934.267152:0:87181:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788200934.267489:0:87180:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788200934.267496:0:87180:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788200934.267530:0:87180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc007ce9600/0x96d0c9b8c9a1aa62 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.267551:0:87180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007ce9600/0x96d0c9b8c9a1aa62 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788200934.267562:0:87180:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000068563s 00010000:00010000:0.0:1788200934.267568:0:87180:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc007ce9600/0x96d0c9b8c9a1aa62 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.267575:0:87180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc007ce9600/0x96d0c9b8c9a1aa62 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.267604:0:87180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc007ce9600/0x96d0c9b8c9a1aa62 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.267613:0:87180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc007ce9600/0x96d0c9b8c9a1aa62 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.267620:0:87180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce9600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200934.267625:0:87180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc007ce9600/0x96d0c9b8c9a1aa62 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.267635:0:87180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc007ce9600/0x96d0c9b8c9a1aa62 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.267651:0:87180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc007ce9600/0x96d0c9b8c9a1aa62 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.267659:0:87180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc007ce9600/0x96d0c9b8c9a1aa62 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.267666:0:87180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007ce9600/0x96d0c9b8c9a1aa62 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200934.267926:0:87176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1258ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+9:3658:x1875060715062400:12345-0@lo:253:kworker.0 Request processed in 37715us (38085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200934.267940:0:87176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:0.0:1788200934.268501:0:3658:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788200934.268505:0:3658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788200934.268507:0:3658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788200934.268509:0:3658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788200934.268510:0:3658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788200934.268511:0:3658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788200934.268513:0:3658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788200934.268516:0:3658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788200934.268517:0:3658:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788200934.268521:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715062400:0@lo:253:kworker.0 00000100:00100000:1.0:1788200934.268770:0:87183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:87183:1875060715063424:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788200934.268818:0:87183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788200934.268832:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788200934.268835:0:87183:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788200934.268843:0:87183:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788200934.268847:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788200934.268867:0:87183:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8dc004040000) 00000020:00000080:1.0:1788200934.268897:0:87183:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:1.0:1788200934.268905:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788200934.270271:0:87183:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788200934.270290:0:87183:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1aa70 00000020:00000080:1.0:1788200934.270603:0:87183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788200934.270617:0:87183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788200934.270623:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788200934.270625:0:87183:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788200934.270629:0:87183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788200934.270636:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788200934.270637:0:87183:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788200934.270642:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788200934.270656:0:87183:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8dc004044d28) 00000020:00000080:1.0:1788200934.270678:0:87183:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:1.0:1788200934.270683:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788200934.270686:0:87183:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788200934.270696:0:87183:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788200934.270704:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788200934.270760:0:87183:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc13f809800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788200934.270776:0:87183:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8dc002640000) 00000020:00000080:1.0:1788200934.270789:0:87183:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:1.0:1788200934.270857:0:87183:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788200934.270865:0:87183:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1aa85 00000020:00000080:1.0:1788200934.270967:0:87183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788200934.270975:0:87183:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788200934.270981:0:87183:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x96d0c9b8c9a1aa8c 00080000:01000000:1.0:1788200934.270987:0:87183:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788200934.270991:0:87183:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1aa93 20000000:01000000:3.0:1788200934.291227:0:87181:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788200934.291300:0:87181:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788200934.292044:0:87181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+8:3656:x1875060715062656:12345-0@lo:253:kworker.0 Request processed in 43793us (60283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200934.292069:0:87181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 20000000:01000000:0.0:1788200934.294057:0:87180:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788200934.294071:0:87180:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788200934.294109:0:87180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc007ce9400/0x96d0c9b8c9a1aa9a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.294128:0:87180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007ce9400/0x96d0c9b8c9a1aa9a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788200934.294139:0:87180:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000070959s 00010000:00010000:0.0:1788200934.294145:0:87180:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc007ce9400/0x96d0c9b8c9a1aa9a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.294152:0:87180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc007ce9400/0x96d0c9b8c9a1aa9a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.294172:0:87180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc007ce9400/0x96d0c9b8c9a1aa9a lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.294179:0:87180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc007ce9400/0x96d0c9b8c9a1aa9a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.294185:0:87180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce9400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200934.294190:0:87180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc007ce9400/0x96d0c9b8c9a1aa9a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.294199:0:87180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc007ce9400/0x96d0c9b8c9a1aa9a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.294216:0:87180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc007ce9400/0x96d0c9b8c9a1aa9a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.294224:0:87180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc007ce9400/0x96d0c9b8c9a1aa9a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.294246:0:87180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007ce9400/0x96d0c9b8c9a1aa9a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788200934.294542:0:3656:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1788200934.294546:0:3656:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788200934.294548:0:3656:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788200934.294550:0:3656:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788200934.294552:0:3656:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788200934.294554:0:3656:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788200934.294555:0:3656:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788200934.294558:0:3656:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788200934.294560:0:3656:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788200934.294567:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715062656:0@lo:253:kworker.0 00010000:00010000:0.0:1788200934.431786:0:87183:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:0.0:1788200934.431997:0:87183:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 4292087e-fa00-4621-b681-837afc99ae35 idx: 0 lr: 98784247815 srv lr: 103079215104 lx: 0 gen 23 00000001:00080000:0.0:1788200934.432082:0:87183:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 103079215104 lx: 0 gen 22 00000001:00000004:0.0:1788200934.432112:0:87183:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 103079215104 00000001:00080000:0.0:1788200934.432251:0:87183:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:0.0:1788200934.432330:0:87183:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc005dfd780: xid 1875060695338112, transno 103079215108, client gen 23, slot idx 0 00000001:00080000:0.0:1788200934.432340:0:87183:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc005dfd3c0: xid 1875060695337856, transno 103079215107, client gen 23, slot idx 1 00000020:00000080:0.0:1788200934.433504:0:87183:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8dc004fd4d28) 00000020:00000080:0.0:1788200934.433535:0:87183:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:0.0:1788200934.433669:0:87183:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788200934.433678:0:87183:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1aab6 00000020:00000080:1.0:1788200934.435054:0:87183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788200934.457699:0:87183:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x96d0c9b8c9a1aabd 00000020:00000080:1.0:1788200934.459991:0:87183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788200934.460011:0:87183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788200934.460034:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788200934.460037:0:87183:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788200934.460041:0:87183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788200934.460044:0:87183:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1788200934.460046:0:87183:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788200934.460048:0:87183:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788200934.460050:0:87183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788200934.460052:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788200934.460054:0:87183:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788200934.460077:0:87183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788200934.460083:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788200934.460084:0:87183:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788200934.460090:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788200934.460171:0:87183:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788200934.460203:0:87183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788200934.460207:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788200934.460208:0:87183:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788200934.460211:0:87183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788200934.460214:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788200934.460215:0:87183:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788200934.460218:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788200934.460225:0:87183:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:00000080:1.0:1788200934.460257:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788200934.460279:0:87183:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8dc139bbb370) 00000020:00000080:1.0:1788200934.460305:0:87183:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1788200934.460311:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788200934.460383:0:87183:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788200934.460390:0:87183:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788200934.460398:0:87183:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1aacb 00010000:00080000:1.0:1788200934.460439:0:87183:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc12e647000@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:1.0:1788200934.469556:0:87183:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1788200934.487370:0:87183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788200934.487393:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788200934.487461:0:87183:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788200934.487506:0:87183:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1aad2 00000100:00080000:1.0:1788200934.487521:0:87183:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788200934.487529:0:87183:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8dc12e647000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200934.487581:0:87183:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11d29f480 x1875060715063552/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788200934.488431:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715063552:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788200934.488539:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200934.488657:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715063552 00000100:00100000:0.0:1788200934.488667:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715063552 00000100:00100000:0.0:1788200934.488720:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3846 00000100:00100000:0.0:1788200934.488728:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715063552:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788200934.488759:0:8457:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3785 last 0 00000020:00000080:0.0:1788200934.488801:0:8457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1aad9 00000004:00100000:0.0:1788200934.488821:0:8457:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788200934.489345:0:87183:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788200934.489457:0:87183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788200934.489570:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788200934.489573:0:87183:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788200934.489578:0:87183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788200934.489582:0:87183:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1788200934.489591:0:87183:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788200934.489593:0:87183:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788200934.489595:0:87183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788200934.489597:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788200934.489599:0:87183:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788200934.489601:0:87183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788200934.489608:0:87183:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788200934.489611:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788200934.489612:0:87183:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788200934.489615:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788200934.489619:0:87183:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:1.0:1788200934.489693:0:87183:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788200934.489696:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788200934.489714:0:87183:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8dc139bb8000) 00000020:00000080:1.0:1788200934.489737:0:87183:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1788200934.489742:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788200934.489832:0:87183:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788200934.489839:0:87183:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788200934.489993:0:87183:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1aae7 00010000:00080000:1.0:1788200934.490099:0:87183:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc1257f5800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:1.0:1788200934.490399:0:87183:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00080000:2.0:1788200934.490694:0:8457:0:(import.c:65:import_set_state_nolock()) ffff8dc1031fa800 : changing import state from RECOVER to FULL 00000040:01000000:1.0:1788200934.492305:0:87183:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788200934.492340:0:87183:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788200934.492437:0:87183:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000040:00080000:1.0:1788200934.494330:0:87183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788200934.494369:0:87183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].25, 64 off9792 00000040:00080000:1.0:1788200934.495535:0:87183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x64:0x0].1, 64 off8256 00000100:00100000:2.0:1788200934.496136:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715063552:12345-0@lo:38:llog_process_th.0 Request processed in 7398us (7588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200934.496170:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3846 00000040:00080000:2.0:1788200934.496480:0:87189:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:2.0:1788200934.496485:0:87189:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1788200934.496822:0:87189:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000040:00080000:2.0:1788200934.496976:0:87189:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1788200934.497242:0:87189:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:2.0:1788200934.497246:0:87189:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788200934.502140:0:87183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788200934.502172:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788200934.502235:0:87183:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788200934.502288:0:87183:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1aaee 00000100:00080000:2.0:1788200934.502301:0:87183:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788200934.502309:0:87183:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dc1257f5800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788200934.502354:0:87183:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005abdc00 x1875060715063680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788200934.502374:0:87183:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788200934.502443:0:87183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788200934.502447:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788200934.502449:0:87183:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788200934.502453:0:87183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788200934.502456:0:87183:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788200934.502458:0:87183:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788200934.502460:0:87183:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788200934.502461:0:87183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788200934.502573:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788200934.502575:0:87183:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788200934.502579:0:87183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788200934.502594:0:87183:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788200934.502600:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788200934.502601:0:87183:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788200934.502605:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788200934.502609:0:87183:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:2.0:1788200934.502647:0:87183:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788200934.502650:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788200934.502664:0:87183:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8dc13f8719b8) 00000020:00000080:2.0:1788200934.502685:0:87183:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1788200934.502690:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788200934.502770:0:87183:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788200934.502779:0:87183:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788200934.502786:0:87183:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1aafc 00010000:00080000:2.0:1788200934.502826:0:87183:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc12b6ba000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:2.0:1788200934.503326:0:87183:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1788200934.503418:0:87183:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788200934.503438:0:87183:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1788200934.504131:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788200934.504147:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:3.0:1788200934.504168:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788200934.504175:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788200934.504180:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc12e647000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788200934.504198:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715063552:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788200934.504519:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715063680:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788200934.504608:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200934.504695:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715063680 00000100:00100000:3.0:1788200934.504704:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715063680 00000100:00100000:3.0:1788200934.504742:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5864 00000100:00100000:3.0:1788200934.504751:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3654:x1875060715063680:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1788200934.504784:0:26201:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3785 last 0 00000020:00000080:3.0:1788200934.504989:0:26201:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1ab03 00002000:00100000:3.0:1788200934.505011:0:26201:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8dc12f1af000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788200934.505063:0:26201:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788200934.505066:0:26201:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788200934.505183:0:26201:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788200934.505216:0:26201:0:(import.c:65:import_set_state_nolock()) ffff8dc13aa9b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788200934.505285:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715063680:12345-0@lo:8:llog_process_th.0 Request processed in 532us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200934.505309:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5864 00000100:00100000:3.0:1788200934.505362:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788200934.505371:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788200934.505377:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788200934.505382:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788200934.505385:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f5800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788200934.505401:0:3654:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788200934.505407:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715063680:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1788200934.505445:0:87189:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788200934.505506:0:87189:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3785977488865ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788200934.505513:0:87189:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788200934.505717:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715063808:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788200934.505763:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788200934.506112:0:87183:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000100:00100000:3.0:1788200934.506553:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715063808 00000100:00100000:3.0:1788200934.506563:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715063808 00000100:00100000:3.0:1788200934.506612:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3847 00000100:00100000:0.0:1788200934.506980:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715063936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788200934.507058:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200934.508776:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715063808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788200934.508829:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000004:00080000:0.0:1788200934.509116:0:87171:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788200934.509253:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715063936 00000100:00100000:1.0:1788200934.509263:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715063936 00000100:00100000:1.0:1788200934.509336:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2128 00000100:00100000:1.0:1788200934.509346:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715063936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788200934.509364:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200934.509452:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715063936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (2392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200934.509460:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2128 00000100:00100000:3.0:1788200934.509566:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715063808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2944us (3801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200934.509575:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3847 00000100:00080000:0.0:1788200934.510001:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788200934.510095:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715063936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788200934.510244:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715063808:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788200934.511306:0:87183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788200934.511349:0:87183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].25, 64 off9792 00000040:00080000:2.0:1788200934.511491:0:87183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x66:0x0].1, 64 off8256 00000040:00080000:0.0:1788200934.514519:0:87191:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:0.0:1788200934.514534:0:87191:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1788200934.514791:0:87191:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000040:00080000:0.0:1788200934.514817:0:87191:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1788200934.515213:0:87191:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:0.0:1788200934.515217:0:87191:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788200934.517764:0:87183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788200934.517786:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788200934.517971:0:87183:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788200934.518011:0:87183:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1ab0a 00000100:00080000:1.0:1788200934.518128:0:87183:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788200934.518135:0:87183:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dc12b6ba000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788200934.518448:0:87183:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005abfb80 x1875060715064064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788200934.518524:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715064064:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788200934.518646:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200934.518754:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715064064 00000100:00100000:1.0:1788200934.518763:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715064064 00000100:00100000:1.0:1788200934.518813:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5865 00000100:00100000:1.0:1788200934.518822:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3654:x1875060715064064:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1788200934.518867:0:26212:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3785 last 0 00000020:00000080:1.0:1788200934.518901:0:26212:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1ab11 00002000:00100000:1.0:1788200934.518928:0:26212:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8dc003956800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788200934.518933:0:26212:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788200934.518936:0:26212:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788200934.519079:0:26212:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788200934.519111:0:26212:0:(import.c:65:import_set_state_nolock()) ffff8dc005a4f800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788200934.519492:0:87183:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788200934.519617:0:87183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788200934.519625:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788200934.519627:0:87183:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788200934.519631:0:87183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788200934.519637:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788200934.519638:0:87183:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788200934.519642:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788200934.519644:0:87183:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788200934.519647:0:87183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788200934.519649:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788200934.519651:0:87183:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788200934.519653:0:87183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788200934.519655:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788200934.519657:0:87183:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788200934.519661:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788200934.519704:0:87183:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:87183:1875060715064192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788200934.519769:0:87183:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200934.519805:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715064192 00000100:00100000:2.0:1788200934.519811:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715064192 00000100:00100000:2.0:1788200934.519867:0:87178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788200934.519876:0:87178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11802fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:87183:x1875060715064192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788200934.520045:0:87178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11802fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:87183:x1875060715064192:12345-0@lo:502:llog_process_th.0 Request processed in 170us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200934.520053:0:87178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788200934.520107:0:87183:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1098dd780 going to sleep for 11 seconds 00000100:00100000:2.0:1788200934.520130:0:87183:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:87183:1875060715064192:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788200934.520167:0:87183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788200934.520172:0:87183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788200934.520173:0:87183:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788200934.520177:0:87183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788200934.523389:0:87170:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788200934.523443:0:87170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788200934.523476:0:87170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1aa54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1aa5b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200934.523491:0:87170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1aa54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1aa5b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788200934.523502:0:87170:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc13f809800 from 1 10000000:01000000:2.0:1788200934.523505:0:87170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788200934.523564:0:87170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100030e00/0x96d0c9b8c9a1ab18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200934.523573:0:87170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc100030e00/0x96d0c9b8c9a1ab18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200934.523599:0:87170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc100030e00/0x96d0c9b8c9a1ab18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200934.523639:0:87170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715064320:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788200934.523752:0:87170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200934.523815:0:87170:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1098dd780 going to sleep for 11 seconds 00000100:00100000:0.0:1788200934.523909:0:87176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715064320 00000100:00100000:0.0:1788200934.523929:0:87176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715064320 00000100:00100000:0.0:1788200934.523989:0:87176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788200934.524001:0:87176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11802d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+8:87170:x1875060715064320:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788200934.524047:0:87176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200934.524065:0:87176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007ce9400/0x96d0c9b8c9a1ab1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ab18 expref: -99 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.524093:0:87176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007ce9400/0x96d0c9b8c9a1ab1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ab18 expref: 9 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.524104:0:87176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007ce9400/0x96d0c9b8c9a1ab1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ab18 expref: 9 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.524114:0:87176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ce9400, rc 0) 00000100:00100000:0.0:1788200934.524171:0:87176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11802d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+9:87170:x1875060715064320:12345-0@lo:101:mount.lustre.0 Request processed in 171us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200934.524178:0:87176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788200934.524449:0:87170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715064320:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788200934.524466:0:87170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc100030e00/0x96d0c9b8c9a1ab18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ab1f expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200934.524476:0:87170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc100030e00/0x96d0c9b8c9a1ab18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ab1f expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200934.525227:0:87170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715064448:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788200934.525291:0:87170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200934.525334:0:87170:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1098dd780 going to sleep for 11 seconds 00000100:00100000:2.0:1788200934.525360:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715064448 00000100:00100000:2.0:1788200934.525366:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715064448 00000100:00100000:2.0:1788200934.525409:0:87178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788200934.525418:0:87178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11802cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+9:87170:x1875060715064448:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788200934.525440:0:87178:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788200934.525462:0:87178:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788200934.525467:0:87178:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788200934.525470:0:87178:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788200934.525473:0:87178:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 110 00000100:00100000:2.0:1788200934.525559:0:87178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11802cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+9:87170:x1875060715064448:12345-0@lo:256:mount.lustre.0 Request processed in 142us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200934.525566:0:87178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788200934.525610:0:87170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715064448:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788200934.527117:0:87170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788200934.527148:0:87170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100030e00/0x96d0c9b8c9a1ab18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ab1f expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200934.527181:0:87170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc100030e00/0x96d0c9b8c9a1ab18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ab1f expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788200934.527192:0:87170:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc13f809800 from 1 10000000:01000000:2.0:1788200934.527195:0:87170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788200934.527239:0:87170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100030800/0x96d0c9b8c9a1ab26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200934.527247:0:87170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc100030800/0x96d0c9b8c9a1ab26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200934.527258:0:87170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc100030800/0x96d0c9b8c9a1ab26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200934.527283:0:87170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715064576:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788200934.527372:0:87170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200934.527420:0:87170:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1098dd780 going to sleep for 11 seconds 00000100:00100000:0.0:1788200934.527827:0:87176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715064576 00000100:00100000:0.0:1788200934.527838:0:87176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715064576 00000100:00100000:0.0:1788200934.527891:0:87176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788200934.527902:0:87176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11802f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+9:87170:x1875060715064576:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788200934.527939:0:87176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200934.527957:0:87176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007ce9600/0x96d0c9b8c9a1ab2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ab26 expref: -99 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.527986:0:87176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007ce9600/0x96d0c9b8c9a1ab2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ab26 expref: 10 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.527998:0:87176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007ce9600/0x96d0c9b8c9a1ab2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ab26 expref: 10 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.528009:0:87176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ce9600, rc 0) 00000100:00100000:0.0:1788200934.528089:0:87176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11802f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+10:87170:x1875060715064576:12345-0@lo:101:mount.lustre.0 Request processed in 189us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200934.528096:0:87176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788200934.528329:0:87170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715064576:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788200934.528347:0:87170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc100030800/0x96d0c9b8c9a1ab26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ab2d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200934.528357:0:87170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc100030800/0x96d0c9b8c9a1ab26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ab2d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200934.528440:0:87170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715064704:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788200934.528474:0:87170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200934.528501:0:87170:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1098dd780 going to sleep for 11 seconds 00000100:00100000:2.0:1788200934.528524:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715064704 00000100:00100000:2.0:1788200934.528530:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715064704 00000100:00100000:2.0:1788200934.528558:0:87178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788200934.528565:0:87178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:87170:x1875060715064704:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788200934.528738:0:87178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:87170:x1875060715064704:12345-0@lo:501:mount.lustre.0 Request processed in 173us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200934.528746:0:87178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788200934.528795:0:87170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715064704:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788200934.528826:0:87170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715064832:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788200934.530704:0:87170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200934.530823:0:87170:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1098dd780 going to sleep for 11 seconds 00000100:00100000:1.0:1788200934.531207:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715064064:12345-0@lo:8:llog_process_th.0 Request processed in 12379us (12556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200934.531225:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5865 00000100:00100000:3.0:1788200934.531408:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788200934.531423:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788200934.531434:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788200934.531441:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788200934.531445:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc12b6ba000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788200934.531554:0:3654:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788200934.531563:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715064064:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788200934.531801:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715064960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788200934.533751:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200934.533872:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715064960 00000100:00100000:2.0:1788200934.533883:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715064960 00000100:00100000:2.0:1788200934.533962:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2129 00000100:00100000:2.0:1788200934.533972:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715064960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788200934.534012:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788200934.534090:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715064960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200934.534098:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2129 00000100:00080000:2.0:1788200934.534121:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788200934.534194:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715064960:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1788200934.535929:0:87191:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788200934.536084:0:87191:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3786008066656ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788200934.536094:0:87191:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788200934.540700:0:87176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715064832 00000100:00100000:0.0:1788200934.540720:0:87176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715064832 00000100:00100000:2.0:1788200934.541286:0:87176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788200934.541300:0:87176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+10:87170:x1875060715064832:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788200934.541536:0:87176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+10:87170:x1875060715064832:12345-0@lo:503:mount.lustre.0 Request processed in 238us (10839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200934.541543:0:87176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788200934.542325:0:87170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715064832:0@lo:503:mount.lustre.0 00000004:00080000:1.0:1788200934.547343:0:87171:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788200934.548329:0:87193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:87193:1875060715065088:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788200934.548452:0:87193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200934.548522:0:87193:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1064703c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788200934.549674:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715065088 00000100:00100000:0.0:1788200934.549690:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715065088 00000100:00100000:0.0:1788200934.549764:0:87178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788200934.549776:0:87178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:87193:x1875060715065088:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788200934.551582:0:87178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:87193:x1875060715065088:12345-0@lo:502:llog_process_th.0 Request processed in 1798us (3121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200934.551608:0:87178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788200934.552541:0:87193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:87193:1875060715065088:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788200934.552611:0:87193:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788200934.552636:0:87193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788200934.552639:0:87193:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788200934.552648:0:87193:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc13f809800 00000020:00000080:3.0:1788200934.552651:0:87193:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788200934.552664:0:87193:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788200934.552667:0:87193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788200934.552668:0:87193:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788200934.552671:0:87193:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788200934.552673:0:87193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788200934.552674:0:87193:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788200934.552678:0:87193:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc13f809800 00000020:00000080:3.0:1788200934.552680:0:87193:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788200934.552805:0:87193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc2a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:87193:1875060715065216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788200934.555529:0:87193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200934.555602:0:87193:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f17b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788200934.562089:0:87181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715065216 00000100:00100000:0.0:1788200934.562114:0:87181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715065216 00000100:00100000:0.0:1788200934.562232:0:87181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788200934.562246:0:87181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+10:87193:x1875060715065216:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788200934.563924:0:87181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+10:87193:x1875060715065216:12345-0@lo:502:llog_process_th.0 Request processed in 1663us (8386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200934.563947:0:87181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788200934.570255:0:87193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc2a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:87193:1875060715065216:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788200934.571324:0:87193:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788200934.571340:0:87193:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788200934.571343:0:87193:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788200934.571352:0:87193:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788200934.571576:0:87170:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1788200934.571630:0:87170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788200934.571655:0:87170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100030800/0x96d0c9b8c9a1ab26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ab2d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.571669:0:87170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc100030800/0x96d0c9b8c9a1ab26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ab2d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788200934.571745:0:87170:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788200934.571749:0:87170:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dc13f809800 10000000:01000000:0.0:1788200934.571752:0:87170:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dc13f809800 10000000:01000000:0.0:1788200934.571757:0:87170:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788200934.571764:0:87170:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc13f809800 from 1 10000000:01000000:0.0:1788200934.571767:0:87170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788200934.571811:0:87170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9e00/0x96d0c9b8c9a1ab34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.571821:0:87170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9e00/0x96d0c9b8c9a1ab34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.571833:0:87170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9e00/0x96d0c9b8c9a1ab34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200934.572571:0:87170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715065344:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788200934.572770:0:87170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200934.572832:0:87170:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc00745d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788200934.572947:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715065344 00000100:00100000:2.0:1788200934.572956:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715065344 00000100:00100000:2.0:1788200934.573040:0:87178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788200934.573052:0:87178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:87170:x1875060715065344:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788200934.573070:0:87178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788200934.573090:0:87178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc100031200/0x96d0c9b8c9a1ab3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ab34 expref: -99 pid: 87178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200934.573122:0:87178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc100031200/0x96d0c9b8c9a1ab3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ab34 expref: 11 pid: 87178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200934.573133:0:87178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc100031200/0x96d0c9b8c9a1ab3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ab34 expref: 11 pid: 87178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200934.573143:0:87178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc100031200, rc 0) 00000100:00100000:2.0:1788200934.573203:0:87178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:87170:x1875060715065344:12345-0@lo:101:mount.lustre.0 Request processed in 154us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200934.573221:0:87178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788200934.573795:0:87170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715065344:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788200934.573816:0:87170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9e00/0x96d0c9b8c9a1ab34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ab3b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.573835:0:87170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9e00/0x96d0c9b8c9a1ab34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ab3b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200934.574070:0:87170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715065472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788200934.574116:0:87170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200934.574164:0:87170:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc00745d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788200934.574185:0:87181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715065472 00000100:00100000:0.0:1788200934.574191:0:87181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715065472 00000100:00100000:0.0:1788200934.574234:0:87181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788200934.574244:0:87181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+11:87170:x1875060715065472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788200934.574404:0:87181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+11:87170:x1875060715065472:12345-0@lo:501:mount.lustre.0 Request processed in 161us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200934.574412:0:87181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788200934.574450:0:87170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715065472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788200934.574481:0:87170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715065600:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788200934.574525:0:87170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200934.574539:0:87170:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc00745d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788200934.575297:0:87176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715065600 00000100:00100000:1.0:1788200934.575307:0:87176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715065600 00000100:00100000:1.0:1788200934.575352:0:87176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788200934.575362:0:87176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:87170:x1875060715065600:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788200934.575495:0:87176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:87170:x1875060715065600:12345-0@lo:503:mount.lustre.0 Request processed in 134us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200934.575502:0:87176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788200934.575573:0:87170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715065600:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788200934.578237:0:87196:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:87196:1875060715065728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788200934.578350:0:87196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200934.578402:0:87196:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc109062e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788200934.578455:0:87176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715065728 00000100:00100000:1.0:1788200934.578464:0:87176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715065728 00000100:00100000:1.0:1788200934.578519:0:87176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788200934.578530:0:87176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b83a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:87196:x1875060715065728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788200934.578695:0:87176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b83a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:87196:x1875060715065728:12345-0@lo:502:llog_process_th.0 Request processed in 166us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200934.578704:0:87176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788200934.578791:0:87196:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:87196:1875060715065728:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788200934.578872:0:87196:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788200934.578892:0:87196:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8dc13f870000) 00000020:00000080:2.0:1788200934.578931:0:87196:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1788200934.579060:0:87196:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc13f809800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788200934.579066:0:87196:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc13f809800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788200934.579069:0:87196:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc13f809800 4 00010000:00080000:2.0:1788200934.579105:0:87196:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc12b6be800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:2.0:1788200934.580934:0:87196:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1788200934.581220:0:87196:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788200934.581281:0:87196:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788200934.581310:0:87196:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x96d0c9b8c9a1ab49 00000100:00080000:2.0:1788200934.581323:0:87196:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788200934.581329:0:87196:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dc12b6be800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788200934.581373:0:87196:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005abe300 x1875060715065856/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788200934.588474:0:87196:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788200934.588682:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200934.588690:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788200934.588696:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200934.588715:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3785 00000100:00080000:1.0:1788200934.588721:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788200934.588731:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200934.588779:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11d29d180 x1875060715065984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788200934.590749:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200934.590760:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788200934.590766:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200934.590777:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3785 00000100:00080000:1.0:1788200934.590784:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788200934.590795:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200934.590837:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11d29d880 x1875060715066240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788200934.591203:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200934.591207:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788200934.591209:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200934.591214:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3785 00000100:00080000:1.0:1788200934.591217:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788200934.591222:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200934.591238:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11d29f480 x1875060715066496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788200934.591281:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200934.591285:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788200934.591287:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200934.591299:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3785 00000100:00080000:1.0:1788200934.591302:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788200934.591306:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200934.591320:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d57100 x1875060715066880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788200934.591537:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715066368:0@lo:400:kworker.0 00000100:00100000:2.0:1788200934.593926:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715066112:0@lo:400:kworker.0 00000100:00100000:2.0:1788200934.594039:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200934.594095:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715067008:0@lo:400:kworker.0 00000100:00100000:2.0:1788200934.594132:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200934.594383:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715067008 00000100:00100000:2.0:1788200934.594394:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715067008 00000100:00100000:2.0:1788200934.594454:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3848 00000100:00100000:2.0:1788200934.594466:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715067008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200934.594536:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715067008:12345-0@lo:400:kworker.0 Request processed in 72us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200934.594562:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3848 00000100:00100000:2.0:1788200934.594622:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715067008:0@lo:400:kworker.0 00000100:00100000:2.0:1788200934.595049:0:87196:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:87196:1875060715067264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788200934.595107:0:87196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200934.595137:0:87177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715067264 00000100:00100000:2.0:1788200934.595142:0:87177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715067264 00000100:00100000:2.0:1788200934.595183:0:87177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788200934.595190:0:87177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b839c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:87196:x1875060715067264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788200934.595307:0:87177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b839c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:87196:x1875060715067264:12345-0@lo:502:llog_process_th.0 Request processed in 117us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200934.595313:0:87177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788200934.595361:0:87196:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1064703c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788200934.595374:0:87196:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:87196:1875060715067264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788200934.595409:0:87196:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:87196:1875060715067392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788200934.595438:0:87196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200934.595462:0:87196:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1064703c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788200934.596279:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200934.596326:0:87176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715067392 00000100:00100000:1.0:1788200934.596332:0:87176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715067392 00000100:00100000:1.0:1788200934.596373:0:87176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788200934.596382:0:87176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:87196:x1875060715067392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788200934.596492:0:87176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:87196:x1875060715067392:12345-0@lo:502:llog_process_th.0 Request processed in 112us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200934.596500:0:87176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788200934.596546:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715066624:0@lo:400:kworker.0 00000100:00100000:1.0:1788200934.596582:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200934.596627:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788200934.596635:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715066752:0@lo:400:kworker.0 00000100:00100000:1.0:1788200934.596660:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200934.596704:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715066112 00000100:00100000:1.0:1788200934.596708:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715066112 00000100:00100000:1.0:1788200934.596741:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715066368 00000100:00100000:1.0:1788200934.596744:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715066368 00000100:00100000:1.0:1788200934.596768:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:1.0:1788200934.596774:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715066112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200934.596819:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715066112:12345-0@lo:400:kworker.0 Request processed in 45us (2780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200934.596832:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:1.0:1788200934.597713:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:1.0:1788200934.597729:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715066368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200934.600343:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715065856:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788200934.605478:0:87196:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:87196:1875060715067392:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788200934.605548:0:87196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:3.0:1788200934.611179:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200934.611254:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715065984:0@lo:38:kworker.0 00000100:00100000:3.0:1788200934.611295:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200934.611319:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715066240:0@lo:38:kworker.0 00000100:00100000:3.0:1788200934.611369:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200934.611381:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715066496:0@lo:38:kworker.0 00000100:00100000:3.0:1788200934.611409:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200934.611426:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715066880:0@lo:38:kworker.0 00000100:00100000:3.0:1788200934.611449:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200934.611499:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715066624 00000100:00100000:3.0:1788200934.611509:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715066624 00000100:00100000:3.0:1788200934.611566:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715066752 00000100:00100000:3.0:1788200934.611569:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715066752 00000100:00100000:3.0:1788200934.611612:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2625 00000100:00100000:3.0:1788200934.611632:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715066624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200934.611703:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715066624:12345-0@lo:400:kworker.0 Request processed in 81us (15120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200934.611712:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2625 00000100:00100000:3.0:1788200934.611735:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2626 00000100:00100000:3.0:1788200934.611741:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715066752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200934.611771:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715066752:12345-0@lo:400:kworker.0 Request processed in 31us (15110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200934.611776:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2626 00000100:00100000:3.0:1788200934.611795:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715066496 00000100:00100000:3.0:1788200934.611798:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715066496 00000100:00100000:3.0:1788200934.611819:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3849 00000100:00100000:3.0:1788200934.611824:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715066496:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788200934.611887:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715066496:12345-0@lo:38:kworker.0 Request processed in 62us (477us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788200934.611894:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3849 00000100:00100000:3.0:1788200934.612177:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715066752:0@lo:400:kworker.0 00000100:00100000:3.0:1788200934.612194:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715066624:0@lo:400:kworker.0 00000100:00080000:3.0:1788200934.612240:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200934.612246:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788200934.612249:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715066496:0@lo:38:kworker.0 00000100:00100000:3.0:1788200934.612273:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715065856 00000100:00100000:3.0:1788200934.612277:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715065856 00000100:00100000:3.0:1788200934.612293:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715065984 00000100:00100000:3.0:1788200934.612296:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715065984 00000100:00100000:3.0:1788200934.612305:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715066240 00000100:00100000:3.0:1788200934.612307:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715066240 00000100:00100000:3.0:1788200934.612314:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715066880 00000100:00100000:3.0:1788200934.612316:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715066880 00000100:00100000:3.0:1788200934.612327:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:3.0:1788200934.612331:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715065856:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788200934.612376:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715065856:12345-0@lo:38:llog_process_th.0 Request processed in 43us (1209us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788200934.612383:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:3.0:1788200934.612395:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:3.0:1788200934.612399:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715065984:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788200934.612425:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715065984:12345-0@lo:38:kworker.0 Request processed in 24us (1129us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788200934.612430:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:3.0:1788200934.612440:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:3.0:1788200934.612444:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715066240:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788200934.612470:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715066240:12345-0@lo:38:kworker.0 Request processed in 24us (1101us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788200934.612485:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:3.0:1788200934.612497:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:3.0:1788200934.612501:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715066880:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788200934.612529:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715066880:12345-0@lo:38:kworker.0 Request processed in 26us (1078us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788200934.612534:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00100000:3.0:1788200934.612556:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788200934.612562:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc12b6be800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200934.612566:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788200934.612570:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715065856:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788200934.612581:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200934.612584:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788200934.612587:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715065984:0@lo:38:kworker.0 00000100:00080000:3.0:1788200934.612596:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200934.612599:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788200934.612602:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715066240:0@lo:38:kworker.0 00000100:00080000:3.0:1788200934.612612:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200934.612615:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788200934.612737:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715066880:0@lo:38:kworker.0 00000100:00100000:0.0:1788200934.620374:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715066112:0@lo:400:kworker.0 00000100:00100000:0.0:1788200934.620529:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715067136:0@lo:400:kworker.0 00000100:00100000:0.0:1788200934.621435:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788200934.622725:0:87170:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788200934.622776:0:87170:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788200934.622801:0:87170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9e00/0x96d0c9b8c9a1ab34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ab3b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.622817:0:87170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9e00/0x96d0c9b8c9a1ab34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ab3b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788200934.624578:0:87170:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788200934.624584:0:87170:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788200934.624585:0:87170:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788200934.624587:0:87170:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788200934.624588:0:87170:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788200934.624593:0:87170:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788200934.624595:0:87170:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788200934.624596:0:87170:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788200934.624599:0:87170:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788200934.624600:0:87170:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788200934.624605:0:87170:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788200934.624609:0:87170:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788200934.624611:0:87170:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788200934.624612:0:87170:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788200934.624614:0:87170:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788200934.624625:0:87170:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788200934.624626:0:87170:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788200934.624628:0:87170:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788200934.624629:0:87170:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788200934.624630:0:87170:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788200934.624631:0:87170:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788200934.624673:0:87170:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788200934.624702:0:87170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715067520:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788200934.624796:0:87170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200934.624874:0:87170:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1090620c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788200934.628085:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715067136 00000100:00100000:0.0:1788200934.628106:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715067136 00000100:00100000:0.0:1788200934.628194:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2627 00000100:00100000:0.0:1788200934.628228:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715067136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200934.628361:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715067136:12345-0@lo:400:kworker.0 Request processed in 148us (6929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200934.628368:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2627 00000100:00100000:0.0:1788200934.628437:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715067136:0@lo:400:kworker.0 00000100:00100000:1.0:1788200934.628744:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715066368:12345-0@lo:400:kworker.0 Request processed in 31010us (32455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200934.628763:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:1.0:1788200934.629542:0:87177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715067520 00000100:00100000:1.0:1788200934.629556:0:87177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715067520 00000100:00100000:1.0:1788200934.629609:0:87177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788200934.629619:0:87177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b838050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:87170:x1875060715067520:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788200934.629651:0:87177:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788200934.629668:0:87177:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788200934.630737:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715066368:0@lo:400:kworker.0 20000000:01000000:1.0:1788200934.642509:0:87177:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788200934.642538:0:87177:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788200934.642694:0:87180:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788200934.642699:0:87180:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788200934.642721:0:87180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc007ce8800/0x96d0c9b8c9a1ab50 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.642739:0:87180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc007ce9400/0x96d0c9b8c9a1ab1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ab18 expref: 11 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.642748:0:87180:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dc007ce8800/0x96d0c9b8c9a1ab50 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.642787:0:87180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc007ce9400/0x96d0c9b8c9a1ab1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1ab18 expref: 11 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200934.642801:0:87180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc007ce9400/0x96d0c9b8c9a1ab1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ab18 expref: 11 pid: 87176 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200934.642816:0:87180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab54e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87180:1875060715067648:0@lo:104: 00000100:00100000:0.0:1788200934.642882:0:87180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200934.642935:0:87180:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc109062e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788200934.642992:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715067648 00000100:00100000:1.0:1788200934.643000:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715067648 00000100:00100000:1.0:1788200934.643074:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788200934.643087:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9b18af6-fecc-4172-82c2-66531890fe11+3:87180:x1875060715067648:12345-0@lo:104: 00010000:00010000:1.0:1788200934.643101:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc100030e00/0x96d0c9b8c9a1ab18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1ab1f expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200934.643171:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788200934.643177:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9b18af6-fecc-4172-82c2-66531890fe11+3:87180:x1875060715067648:12345-0@lo:104: Request processed in 95us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200934.643185:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00010000:00010000:1.0:1788200934.643208:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200934.643213:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc100030e00/0x96d0c9b8c9a1ab18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1ab1f expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200934.643243:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030e00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788200934.643248:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc100030e00/0x96d0c9b8c9a1ab18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1ab1f expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200934.643257:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc100030e00/0x96d0c9b8c9a1ab18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1ab1f expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788200934.643265:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc100030e00/0x96d0c9b8c9a1ab18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1ab1f expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788200934.643272:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1788200934.643299:0:87180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab54e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87180:1875060715067648:0@lo:104: 00010000:00010000:1.0:1788200934.643306:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc100030e00/0x96d0c9b8c9a1ab18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1ab1f expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200934.643314:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788200934.643334:0:87180:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dc007ce8800/0x96d0c9b8c9a1ab50 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200934.643338:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc100030e00/0x96d0c9b8c9a1ab18 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1ab1f expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200934.643368:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc100030e00/0x96d0c9b8c9a1ab18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1ab1f expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200934.643386:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200934.643388:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200934.643390:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788200934.643392:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715067776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788200934.643481:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200934.643784:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715067776 00000100:00100000:1.0:1788200934.643833:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715067776 00000100:00100000:0.0:1788200934.643917:0:87177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b838050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+12:87170:x1875060715067520:12345-0@lo:253:mount.lustre.0 Request processed in 14288us (19110us total) trans 0 rc 0/0 00010000:00010000:1.0:1788200934.643932:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc007ce9400/0x96d0c9b8c9a1ab1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ab18 expref: 12 pid: 87176 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200934.643956:0:87177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788200934.643988:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550 00000100:00100000:1.0:1788200934.644007:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+11:3657:x1875060715067776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788200934.644052:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788200934.644056:0:87170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:87170:1875060715067520:0@lo:253:mount.lustre.0 00010000:00010000:1.0:1788200934.644062:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc007ce9400/0x96d0c9b8c9a1ab1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ab18 expref: 11 pid: 87176 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788200934.644072:0:87170:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788200934.644077:0:87170:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00010000:00010000:1.0:1788200934.644079:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc007ce9400/0x96d0c9b8c9a1ab1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ab18 expref: 11 pid: 87176 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788200934.644081:0:87170:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788200934.644085:0:87170:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788200934.644090:0:87170:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788200934.644096:0:87170:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788200934.644101:0:87170:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788200934.644103:0:87170:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788200934.644105:0:87170:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788200934.644107:0:87170:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788200934.644109:0:87170:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:1.0:1788200934.644115:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007ce9400/0x96d0c9b8c9a1ab1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ab18 expref: 11 pid: 87176 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:0.0:1788200934.644124:0:87170:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788200934.644137:0:26215:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dc007ce8800/0x96d0c9b8c9a1ab50 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200934.644158:0:26215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007ce8800/0x96d0c9b8c9a1ab50 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788200934.644176:0:26215:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001476328s 00010000:00010000:1.0:1788200934.644181:0:26215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc007ce8800/0x96d0c9b8c9a1ab50 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200934.644188:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc007ce8800/0x96d0c9b8c9a1ab50 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200934.644196:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc007ce8800/0x96d0c9b8c9a1ab50 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200934.644202:0:26215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc007ce8800/0x96d0c9b8c9a1ab50 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200934.644208:0:26215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200934.644222:0:26215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc007ce8800/0x96d0c9b8c9a1ab50 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200934.644231:0:26215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc007ce8800/0x96d0c9b8c9a1ab50 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200934.644244:0:26215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc007ce8800/0x96d0c9b8c9a1ab50 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200934.644257:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788200934.644300:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+10:3657:x1875060715067776:12345-0@lo:103:ldlm_bl.0 Request processed in 295us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200934.644307:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550 00000100:00100000:3.0:1788200934.644408:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715067776:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788200934.644432:0:87180:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dc007ce8800/0x96d0c9b8c9a1ab50 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200934.644440:0:87180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc007ce8800/0x96d0c9b8c9a1ab50 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200934.644446:0:87180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007ce8800/0x96d0c9b8c9a1ab50 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788200934.683103:0:87170:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411350 00000040:01000000:3.0:1788200934.683748:0:87170:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788200934.683860:0:87201:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411350 00000020:00080000:0.0:1788200934.683865:0:87201:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411350 00000040:01000000:3.0:1788200934.694350:0:87202:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788200934.694558:0:87170:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1788200934.699470:0:87202:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788200934.701584:0:87202:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788200934.701683:0:87202:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1788200934.703342:0:87203:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc47480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87203:1875060715067904:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788200934.703415:0:87203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200934.703456:0:87203:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc11199e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788200934.706197:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715067904 00000100:00100000:1.0:1788200934.706213:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715067904 00000100:00100000:1.0:1788200934.706282:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3850 00000100:00100000:1.0:1788200934.706293:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87203:x1875060715067904:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788200934.706433:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87203:x1875060715067904:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 141us (3018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200934.706441:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3850 00000040:01000000:2.0:1788200934.715577:0:87170:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788200934.715627:0:87170:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788200934.717984:0:87170:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788200934.718160:0:87170:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788200934.718288:0:87170:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788200934.719405:0:87170:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1788200934.720466:0:87203:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc47480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87203:1875060715067904:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788200934.720516:0:87203:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788200934.720566:0:87203:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab57480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87203:1875060715068032:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788200934.720637:0:87203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200934.720685:0:87203:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fae1e40 going to sleep for 11 seconds 00000040:00080000:3.0:1788200934.721451:0:87170:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788200934.721515:0:87170:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788200934.721636:0:87170:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788200934.722929:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715068032 00000100:00100000:2.0:1788200934.722942:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715068032 00000100:00100000:2.0:1788200934.723010:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3851 00000100:00100000:2.0:1788200934.723041:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87203:x1875060715068032:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788200934.723243:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87203:x1875060715068032:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 206us (2606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200934.723251:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3851 00000100:00100000:2.0:1788200934.723299:0:87203:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab57480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87203:1875060715068032:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788200934.723396:0:87203:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87203:1875060715068160:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788200934.723433:0:87203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200934.723454:0:87203:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1208bf9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788200934.723529:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715068160 00000100:00100000:1.0:1788200934.723534:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715068160 00000100:00100000:1.0:1788200934.723567:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3852 00000100:00100000:1.0:1788200934.723574:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87203:x1875060715068160:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788200934.723627:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87203:x1875060715068160:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 54us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200934.723644:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3852 00000100:00100000:2.0:1788200934.723791:0:87203:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87203:1875060715068160:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788200934.723835:0:87203:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788200934.724602:0:87170:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4c:0x0] (8/32) registered 00000040:00080000:2.0:1788200934.733520:0:87203:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00010000:00080000:3.0:1788200934.733520:0:87170:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 103079215108 00000004:00080000:2.0:1788200934.733597:0:87203:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788200934.733601:0:87203:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:1.0:1788200934.735733:0:87204:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 87204 00010000:02000000:1.0:1788200934.735756:0:87204:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1788200934.735760:0:87204:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788200934.735763:0:87204:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1788200934.736197:0:87170:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788200934.736213:0:87170:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788200934.736250:0:87170:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788200934.736276:0:87170:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788200934.737305:0:87170:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788200934.737562:0:87170:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788200935.061788:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200935.061871:0:87176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695345408 00000100:00100000:2.0:1788200935.061882:0:87176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695345408 00000100:00100000:2.0:1788200935.062005:0:87176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:2.0:1788200935.062043:0:87176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b839850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+5:42467:x1875060695345408:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788200935.062062:0:87176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788200935.062081:0:87176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc100031e00/0x96d0c9b8c9a1ab57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7865af expref: -99 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200935.062109:0:87176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc100031e00/0x96d0c9b8c9a1ab57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865af expref: 6 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200935.062121:0:87176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc100031e00/0x96d0c9b8c9a1ab57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865af expref: 6 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200935.062151:0:87176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc100031e00, rc 0) 00000100:00100000:2.0:1788200935.062211:0:87176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b839850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+6:42467:x1875060695345408:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 197us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200935.062218:0:87176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:0.0:1788200935.069938:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200935.070192:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695345536 00000100:00100000:1.0:1788200935.070202:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695345536 00000100:00100000:1.0:1788200935.070255:0:87178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:1.0:1788200935.070265:0:87178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12eddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+6:42467:x1875060695345536:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788200935.070289:0:87178:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1788200935.070308:0:87178:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788200935.070312:0:87178:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1788200935.070316:0:87178:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1788200935.070318:0:87178:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1788200935.070320:0:87178:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 111 00000100:00100000:2.0:1788200935.079670:0:87178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12eddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+6:42467:x1875060695345536:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 Request processed in 9393us (9729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200935.079684:0:87178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:1.0:1788200935.110523:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200935.110580:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200935.110615:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695345664 00000100:00100000:1.0:1788200935.110624:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695345664 00000100:00100000:1.0:1788200935.110669:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1148 00000100:00100000:1.0:1788200935.110677:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875060695345664:12345-192.168.201.20@tcp:38:ll_cfg_requeue.0 00010000:00080000:1.0:1788200935.110709:0:66314:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '4292087e-fa00-4621-b681-837afc99ae35' at ffff8dc1401c1800, cookie 0x96d0c9b8c9a1aaa1 00010000:00080000:1.0:1788200935.110715:0:66314:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp recovering/t103079215109 exp ffff8dc1401c1800 cur 3786 last 1788200934 00010000:02000400:1.0:1788200935.110724:0:66314:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00000100:00100000:3.0:1788200935.111111:0:87176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695345792 00000100:00100000:3.0:1788200935.111118:0:87176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695345792 00000100:00100000:3.0:1788200935.111176:0:87176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:3.0:1788200935.111184:0:87176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12eddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+6:42467:x1875060695345792:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788200935.111197:0:87176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788200935.111215:0:87176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fd000/0x96d0c9b8c9a1ab5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7865b6 expref: -99 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200935.111249:0:87176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fd000/0x96d0c9b8c9a1ab5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865b6 expref: 7 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200935.111261:0:87176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fd000/0x96d0c9b8c9a1ab5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865b6 expref: 7 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200935.111271:0:87176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fd000, rc 0) 00000100:00100000:3.0:1788200935.111327:0:87176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12eddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+7:42467:x1875060695345792:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 144us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200935.111334:0:87176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:3.0:1788200935.123812:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200935.123852:0:87177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695345920 00000100:00100000:3.0:1788200935.123861:0:87177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695345920 00010000:00080000:1.0:1788200935.123870:0:66314:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1788200935.123904:0:66314:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788200935.123927:0:87177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:3.0:1788200935.123936:0:87177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12eddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+7:42467:x1875060695345920:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00080000:1.0:1788200935.124060:0:66314:0:(import.c:65:import_set_state_nolock()) ffff8dc001e2e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788200935.124103:0:87177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12eddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+8:42467:x1875060695345920:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 162us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200935.124110:0:87177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:1.0:1788200935.124388:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2399:x1875060695345664:12345-192.168.201.20@tcp:38:ll_cfg_requeue.0 Request processed in 13709us (13806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200935.124397:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1148 00000100:00100000:0.0:1788200935.126831:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200935.127062:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695338880 00000100:00100000:3.0:1788200935.127084:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695338880 00000100:00100000:3.0:1788200935.127135:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1149 00000100:00100000:3.0:1788200935.127174:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:2399:x1875060695338880:12345-192.168.201.20@tcp:36:mcreate.0 00010000:00080000:3.0:1788200935.127193:0:66312:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 103079215109, current: 103079215109, replaying 00000100:00100000:3.0:1788200935.127209:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:2399:x1875060695338880:12345-192.168.201.20@tcp:36:mcreate.0 Request processed in 66us (387us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788200935.127215:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1149 00000100:00100000:3.0:1788200935.127640:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200935.127662:0:87176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695346048 00000100:00100000:3.0:1788200935.127666:0:87176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695346048 00000100:00100000:3.0:1788200935.127691:0:87176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:3.0:1788200935.127697:0:87176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12eddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+8:42467:x1875060695346048:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788200935.127831:0:87176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12eddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+8:42467:x1875060695346048:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 133us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200935.127839:0:87176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 30 00010000:00080000:2.0:1788200935.129644:0:87204:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:0.0:1788200935.140887:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200935.144828:0:87177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695346176 00000100:00100000:3.0:1788200935.144847:0:87177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695346176 00000100:00100000:2.0:1788200935.145394:0:87177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:2.0:1788200935.145405:0:87177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+8:42467:x1875060695346176:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788200935.145420:0:87177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788200935.145437:0:87177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc100030c00/0x96d0c9b8c9a1ab65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7865bd expref: -99 pid: 87177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200935.145479:0:87177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc100030c00/0x96d0c9b8c9a1ab65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865bd expref: 9 pid: 87177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200935.145489:0:87177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc100030c00/0x96d0c9b8c9a1ab65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865bd expref: 9 pid: 87177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200935.145498:0:87177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc100030c00, rc 0) 00000100:00100000:2.0:1788200935.145564:0:87177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+9:42467:x1875060695346176:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 160us (4687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200935.145571:0:87177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:2.0:1788200935.150818:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200935.150955:0:87176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695346304 00000100:00100000:3.0:1788200935.150966:0:87176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695346304 00000100:00100000:0.0:1788200935.153870:0:87181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:0.0:1788200935.153890:0:87181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+9:42467:x1875060695346304:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788200935.154177:0:87181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+9:42467:x1875060695346304:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 295us (3366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200935.154196:0:87181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:2.0:1788200935.165939:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200935.166080:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695346432 00000100:00100000:3.0:1788200935.166093:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695346432 00000100:00100000:3.0:1788200935.166138:0:87178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:3.0:1788200935.166157:0:87178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+9:42467:x1875060695346432:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788200935.166322:0:87178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+9:42467:x1875060695346432:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 164us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200935.166330:0:87178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:1.0:1788200935.178181:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200935.178271:0:87181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695346560 00000100:00100000:0.0:1788200935.178283:0:87181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695346560 00000100:00100000:0.0:1788200935.178395:0:87181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00100000:0.0:1788200935.178407:0:87181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+9:42467:x1875060695346560:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788200935.178425:0:87181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200935.178444:0:87181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007ce9400/0x96d0c9b8c9a1ab6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7865c4 expref: -99 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200935.178486:0:87181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007ce9400/0x96d0c9b8c9a1ab6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865c4 expref: 10 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200935.178498:0:87181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007ce9400/0x96d0c9b8c9a1ab6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865c4 expref: 10 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200935.178507:0:87181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ce9400, rc 0) 00000100:00100000:0.0:1788200935.178564:0:87181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+10:42467:x1875060695346560:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 159us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200935.178571:0:87181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00100000:2.0:1788200935.190923:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00010000:00010000:1.0:1788200935.191047:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788200935.191158:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695346688 00000100:00100000:3.0:1788200935.191168:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695346688 00000100:00100000:3.0:1788200935.191218:0:87178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00100000:3.0:1788200935.191229:0:87178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:42467:x1875060695346688:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788200935.191345:0:87178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:42467:x1875060695346688:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 118us (434us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788200935.191354:0:87178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 35 10000000:01000000:2.0:1788200936.146807:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788200936.146815:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc13f809800 from 111 10000000:01000000:2.0:1788200936.146821:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788200936.146863:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100030400/0x96d0c9b8c9a1ab73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200936.146876:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc100030400/0x96d0c9b8c9a1ab73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200936.146888:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc100030400/0x96d0c9b8c9a1ab73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200936.146915:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715068288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788200936.146989:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200936.147077:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0072ff780 going to sleep for 11 seconds 00000100:00100000:3.0:1788200936.152347:0:87176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715068288 00000100:00100000:3.0:1788200936.152364:0:87176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715068288 00000100:00100000:3.0:1788200936.152460:0:87176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788200936.152471:0:87176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+10:6529:x1875060715068288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788200936.152488:0:87176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788200936.152505:0:87176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fd200/0x96d0c9b8c9a1ab7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ab73 expref: -99 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200936.152532:0:87176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fd200/0x96d0c9b8c9a1ab7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ab73 expref: 11 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200936.152543:0:87176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fd200/0x96d0c9b8c9a1ab7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ab73 expref: 11 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200936.152552:0:87176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fd200, rc 0) 00000100:00100000:3.0:1788200936.152637:0:87176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715068288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (5648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200936.152644:0:87176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788200936.152818:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715068288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788200936.152835:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc100030400/0x96d0c9b8c9a1ab73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ab7a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200936.152845:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc100030400/0x96d0c9b8c9a1ab73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ab7a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200936.152921:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715068416:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788200936.152962:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200936.164682:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0072ff780 going to sleep for 11 seconds 00000100:00100000:2.0:1788200936.164735:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715068416 00000100:00100000:2.0:1788200936.164745:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715068416 00000100:00100000:2.0:1788200936.164822:0:87178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788200936.164832:0:87178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715068416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788200936.164857:0:87178:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788200936.164877:0:87178:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788200936.164880:0:87178:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 111 00000100:00100000:2.0:1788200936.165035:0:87178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715068416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 185us (12052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200936.165044:0:87178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788200936.165099:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715068416:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788200936.165169:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788200936.165180:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100030400/0x96d0c9b8c9a1ab73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ab7a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200936.165190:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc100030400/0x96d0c9b8c9a1ab73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ab7a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788200936.165201:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788200936.165203:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc0053a4000 from 52 10000000:01000000:2.0:1788200936.165207:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788200936.165238:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100030e00/0x96d0c9b8c9a1ab81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200936.165245:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc100030e00/0x96d0c9b8c9a1ab81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200936.165254:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc100030e00/0x96d0c9b8c9a1ab81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200936.165273:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715068544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788200936.165315:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200936.165343:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0072ff780 going to sleep for 11 seconds 00000100:00100000:2.0:1788200936.165357:0:87181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715068544 00000100:00100000:2.0:1788200936.165360:0:87181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715068544 00000100:00100000:2.0:1788200936.165384:0:87181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788200936.165391:0:87181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715068544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788200936.165400:0:87181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788200936.165413:0:87181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006c6c200/0x96d0c9b8c9a1ab88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ab81 expref: -99 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200936.165435:0:87181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006c6c200/0x96d0c9b8c9a1ab88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ab81 expref: 12 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200936.165445:0:87181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006c6c200/0x96d0c9b8c9a1ab88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ab81 expref: 12 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200936.165465:0:87181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006c6c200, rc 0) 00000100:00100000:2.0:1788200936.165494:0:87181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715068544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200936.165501:0:87181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788200936.165530:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715068544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788200936.165542:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc100030e00/0x96d0c9b8c9a1ab81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ab88 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200936.165551:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc100030e00/0x96d0c9b8c9a1ab81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ab88 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200936.165603:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715068672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788200936.165633:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200936.165646:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0072ff780 going to sleep for 11 seconds 00000100:00100000:2.0:1788200936.165657:0:87181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715068672 00000100:00100000:2.0:1788200936.165660:0:87181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715068672 00000100:00100000:2.0:1788200936.165683:0:87181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788200936.165689:0:87181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715068672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788200936.165809:0:87181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715068672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200936.165816:0:87181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788200936.165845:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715068672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788200936.165872:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715068800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788200936.165909:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200936.165922:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0072ff780 going to sleep for 11 seconds 00000100:00100000:2.0:1788200936.165933:0:87181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715068800 00000100:00100000:2.0:1788200936.165936:0:87181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715068800 00000100:00100000:2.0:1788200936.165956:0:87181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788200936.165962:0:87181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715068800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788200936.166061:0:87181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715068800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200936.166067:0:87181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788200936.166105:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715068800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788200936.171918:0:87267:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1788200936.172922:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1788200936.172975:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788200936.172989:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100030e00/0x96d0c9b8c9a1ab81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ab88 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200936.173012:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc100030e00/0x96d0c9b8c9a1ab81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ab88 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788200936.173053:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788200936.173056:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc0053a4000 from 108 10000000:01000000:3.0:1788200936.173059:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788200936.173099:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fdc00/0x96d0c9b8c9a1ab8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200936.173107:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0078fdc00/0x96d0c9b8c9a1ab8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200936.173119:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0078fdc00/0x96d0c9b8c9a1ab8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200936.173156:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc47b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715068928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788200936.173230:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200936.173276:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006e9ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788200936.173747:0:87181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715068928 00000100:00100000:0.0:1788200936.173757:0:87181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715068928 00000100:00100000:0.0:1788200936.173801:0:87181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788200936.173811:0:87181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715068928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788200936.173824:0:87181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200936.173836:0:87181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007ce9200/0x96d0c9b8c9a1ab96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ab8f expref: -99 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.173877:0:87181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007ce9200/0x96d0c9b8c9a1ab96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ab8f expref: 13 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.173887:0:87181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007ce9200/0x96d0c9b8c9a1ab96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ab8f expref: 13 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.173896:0:87181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ce9200, rc 0) 00000100:00100000:0.0:1788200936.173946:0:87181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715068928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200936.173952:0:87181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788200936.174001:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc47b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715068928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788200936.174032:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0078fdc00/0x96d0c9b8c9a1ab8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ab96 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.174042:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fdc00/0x96d0c9b8c9a1ab8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ab96 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200936.174094:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715069056:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788200936.174140:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200936.174164:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fae1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788200936.174178:0:87177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715069056 00000100:00100000:0.0:1788200936.174182:0:87177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715069056 00000100:00100000:0.0:1788200936.174204:0:87177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788200936.174210:0:87177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715069056:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788200936.174224:0:87177:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788200936.174242:0:87177:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788200936.174250:0:87177:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1788200936.174252:0:87177:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1788200936.174254:0:87177:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1788200936.174256:0:87177:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 111 00000100:00100000:0.0:1788200936.174330:0:87177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715069056:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200936.174336:0:87177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788200936.174363:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715069056:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788200936.174430:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788200936.174436:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fdc00/0x96d0c9b8c9a1ab8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ab96 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.174443:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0078fdc00/0x96d0c9b8c9a1ab8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ab96 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788200936.174451:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788200936.174453:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1788200936.174455:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788200936.174470:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9800/0x96d0c9b8c9a1ab9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.174477:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9800/0x96d0c9b8c9a1ab9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.174485:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9800/0x96d0c9b8c9a1ab9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200936.174498:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715069184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788200936.174524:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200936.174546:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fae1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788200936.174557:0:87181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715069184 00000100:00100000:0.0:1788200936.174561:0:87181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715069184 00000100:00100000:0.0:1788200936.174581:0:87181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788200936.174587:0:87181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715069184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788200936.174594:0:87181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200936.174603:0:87181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007ce9a00/0x96d0c9b8c9a1aba4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ab9d expref: -99 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.174617:0:87181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007ce9a00/0x96d0c9b8c9a1aba4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ab9d expref: 14 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.174624:0:87181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007ce9a00/0x96d0c9b8c9a1aba4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ab9d expref: 14 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.174631:0:87181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ce9a00, rc 0) 00000100:00100000:0.0:1788200936.174659:0:87181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715069184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 71us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200936.174664:0:87181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788200936.176927:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715069184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788200936.176957:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9800/0x96d0c9b8c9a1ab9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1aba4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.176969:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9800/0x96d0c9b8c9a1ab9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1aba4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200936.177305:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715069312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788200936.177369:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200936.177440:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc003a3a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788200936.177571:0:87181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715069312 00000100:00100000:2.0:1788200936.177578:0:87181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715069312 00000100:00100000:2.0:1788200936.177628:0:87181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788200936.177636:0:87181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715069312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788200936.177812:0:87181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715069312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 176us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200936.177821:0:87181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788200936.177974:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715069312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788200936.178006:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715069440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788200936.178076:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200936.178096:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006e9ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788200936.178257:0:87177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715069440 00000100:00100000:0.0:1788200936.178262:0:87177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715069440 00000100:00100000:0.0:1788200936.178339:0:87177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788200936.178347:0:87177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715069440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788200936.186252:0:87177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715069440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 7894us (8164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200936.186267:0:87177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788200936.186383:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715069440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788200936.191860:0:87269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:0.0:1788200936.192806:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:0.0:1788200936.192833:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788200936.192845:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9800/0x96d0c9b8c9a1ab9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1aba4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.192857:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9800/0x96d0c9b8c9a1ab9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1aba4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788200936.192867:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1788200936.192870:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dc0053a4000 from 1 10000000:01000000:0.0:1788200936.192873:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788200936.192925:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8000/0x96d0c9b8c9a1abab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.192932:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8000/0x96d0c9b8c9a1abab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.192942:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8000/0x96d0c9b8c9a1abab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200936.192966:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715069568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788200936.193063:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200936.193110:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc003a3a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788200936.193365:0:87181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715069568 00000100:00100000:3.0:1788200936.193373:0:87181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715069568 00000100:00100000:3.0:1788200936.193441:0:87181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788200936.193451:0:87181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715069568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788200936.193464:0:87181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788200936.193477:0:87181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fd800/0x96d0c9b8c9a1abb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1abab expref: -99 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200936.193498:0:87181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fd800/0x96d0c9b8c9a1abb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1abab expref: 15 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200936.193507:0:87181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fd800/0x96d0c9b8c9a1abb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1abab expref: 15 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200936.193515:0:87181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fd800, rc 0) 00000100:00100000:3.0:1788200936.193553:0:87181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715069568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200936.193559:0:87181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788200936.193663:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715069568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788200936.193695:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8000/0x96d0c9b8c9a1abab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1abb2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.193703:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8000/0x96d0c9b8c9a1abab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1abb2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788200936.193718:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788200936.193723:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8000/0x96d0c9b8c9a1abab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1abb2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.193728:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8000/0x96d0c9b8c9a1abab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1abb2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788200936.193734:0:6529:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788200936.193736:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc0053a4000 from 7 10000000:01000000:0.0:1788200936.193738:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788200936.193751:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8200/0x96d0c9b8c9a1abb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.193757:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8200/0x96d0c9b8c9a1abb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.193763:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8200/0x96d0c9b8c9a1abb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200936.193776:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715069696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788200936.193802:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200936.193828:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc003a3a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788200936.193842:0:87176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715069696 00000100:00100000:0.0:1788200936.193846:0:87176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715069696 00000100:00100000:0.0:1788200936.193872:0:87176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788200936.193878:0:87176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715069696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788200936.193896:0:87176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200936.193904:0:87176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007ce8c00/0x96d0c9b8c9a1abc0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1abb9 expref: -99 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.193916:0:87176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007ce8c00/0x96d0c9b8c9a1abc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1abb9 expref: 16 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.193924:0:87176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007ce8c00/0x96d0c9b8c9a1abc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1abb9 expref: 16 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.193930:0:87176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ce8c00, rc 0) 00000100:00100000:0.0:1788200936.193959:0:87176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715069696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200936.193965:0:87176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788200936.193992:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715069696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788200936.194001:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8200/0x96d0c9b8c9a1abb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1abc0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.194008:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8200/0x96d0c9b8c9a1abb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1abc0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200936.194086:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715069824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788200936.194109:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200936.194141:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc003a3a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788200936.194152:0:87176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715069824 00000100:00100000:0.0:1788200936.194155:0:87176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715069824 00000100:00100000:0.0:1788200936.194176:0:87176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788200936.194181:0:87176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715069824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788200936.194279:0:87176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715069824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200936.194285:0:87176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788200936.194310:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715069824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788200936.194349:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715069952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788200936.194390:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200936.194402:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc003a3a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788200936.194414:0:87176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715069952 00000100:00100000:0.0:1788200936.194417:0:87176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715069952 00000100:00100000:0.0:1788200936.194434:0:87176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788200936.194440:0:87176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715069952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788200936.194526:0:87176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715069952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200936.194533:0:87176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788200936.194575:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715069952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788200936.197442:0:87270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788200936.200550:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788200936.200599:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788200936.200612:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8200/0x96d0c9b8c9a1abb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1abc0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.200626:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8200/0x96d0c9b8c9a1abb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1abc0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788200936.200638:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788200936.200656:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc001db6000 from 52 10000000:01000000:0.0:1788200936.200660:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788200936.200715:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8a00/0x96d0c9b8c9a1abc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.200723:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8a00/0x96d0c9b8c9a1abc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.200734:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8a00/0x96d0c9b8c9a1abc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200936.200764:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715070080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788200936.200839:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200936.201142:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc003a3a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788200936.203209:0:87176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715070080 00000100:00100000:2.0:1788200936.203224:0:87176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715070080 00000100:00100000:2.0:1788200936.203286:0:87176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788200936.203297:0:87176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715070080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788200936.203314:0:87176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788200936.203334:0:87176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006c6c400/0x96d0c9b8c9a1abce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1abc7 expref: -99 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200936.203361:0:87176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006c6c400/0x96d0c9b8c9a1abce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1abc7 expref: 17 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200936.203373:0:87176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006c6c400/0x96d0c9b8c9a1abce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1abc7 expref: 17 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200936.203385:0:87176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006c6c400, rc 0) 00000100:00100000:2.0:1788200936.203473:0:87176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715070080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (2633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200936.203480:0:87176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788200936.207853:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715070080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788200936.208006:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200936.208069:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8a00/0x96d0c9b8c9a1abc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1abce expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.208083:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8a00/0x96d0c9b8c9a1abc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1abce expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200936.208185:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715070208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788200936.208254:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200936.208300:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc003a3a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788200936.208357:0:87181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715070208 00000100:00100000:3.0:1788200936.208364:0:87181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715070208 00000100:00100000:3.0:1788200936.208411:0:87181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788200936.208421:0:87181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715070208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788200936.208569:0:87181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715070208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200936.208577:0:87181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788200936.208822:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715070208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788200936.208854:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715070336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788200936.208914:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200936.208937:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc003a3a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788200936.208964:0:87176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715070336 00000100:00100000:2.0:1788200936.208969:0:87176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715070336 00000100:00100000:2.0:1788200936.209006:0:87176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788200936.209029:0:87176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715070336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788200936.209131:0:87176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715070336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200936.209147:0:87176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788200936.209242:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715070336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788200936.210107:0:87271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1788200936.210394:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1788200936.210419:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788200936.210430:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8a00/0x96d0c9b8c9a1abc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1abce expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.210440:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8a00/0x96d0c9b8c9a1abc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1abce expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788200936.210450:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788200936.210452:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1788200936.210455:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788200936.210487:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8400/0x96d0c9b8c9a1abd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.210495:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8400/0x96d0c9b8c9a1abd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.210504:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8400/0x96d0c9b8c9a1abd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200936.210524:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715070464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788200936.210570:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200936.210610:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140024b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788200936.214291:0:87181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715070464 00000100:00100000:3.0:1788200936.214309:0:87181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715070464 00000100:00100000:3.0:1788200936.214379:0:87181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788200936.214402:0:87181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715070464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788200936.214420:0:87181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788200936.214438:0:87181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1abdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1abd5 expref: -99 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200936.214465:0:87181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1abdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1abd5 expref: 18 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200936.214476:0:87181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1abdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1abd5 expref: 18 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200936.214485:0:87181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fc800, rc 0) 00000100:00100000:3.0:1788200936.214583:0:87181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715070464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (4012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200936.214589:0:87181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788200936.217011:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715070464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788200936.217199:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8400/0x96d0c9b8c9a1abd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1abdc expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200936.217213:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8400/0x96d0c9b8c9a1abd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1abdc expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788200936.217309:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715070592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788200936.217366:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200936.217402:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1059710c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788200936.217547:0:87177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715070592 00000100:00100000:3.0:1788200936.217554:0:87177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715070592 00000100:00100000:3.0:1788200936.217593:0:87177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788200936.217602:0:87177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0059c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715070592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788200936.217785:0:87177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0059c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715070592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 183us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200936.217793:0:87177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788200936.219835:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715070592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788200936.220626:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715070720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788200936.221700:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200936.221739:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1059710c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788200936.221810:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715070720 00000100:00100000:2.0:1788200936.221818:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715070720 00000100:00100000:2.0:1788200936.221867:0:87178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788200936.221877:0:87178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0059cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715070720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788200936.225574:0:87178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0059cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715070720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3689us (3868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200936.225587:0:87178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788200936.225823:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715070720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788200936.230382:0:87273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1788200936.231914:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1788200936.231951:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788200936.231972:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8400/0x96d0c9b8c9a1abd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1abdc expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200936.231985:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8400/0x96d0c9b8c9a1abd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1abdc expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788200936.231994:0:6529:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788200936.231997:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc001db6000 from 7 10000000:01000000:1.0:1788200936.232000:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788200936.232063:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad000/0x96d0c9b8c9a1abe3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200936.232072:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad000/0x96d0c9b8c9a1abe3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200936.232084:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad000/0x96d0c9b8c9a1abe3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788200936.232111:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715070848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788200936.232191:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200936.232236:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1059710c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788200936.237865:0:87177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715070848 00000100:00100000:2.0:1788200936.237881:0:87177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715070848 00000100:00100000:2.0:1788200936.238159:0:87177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788200936.238169:0:87177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0059cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715070848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788200936.238185:0:87177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788200936.238202:0:87177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006c6d400/0x96d0c9b8c9a1abea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1abe3 expref: -99 pid: 87177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200936.238231:0:87177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006c6d400/0x96d0c9b8c9a1abea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1abe3 expref: 19 pid: 87177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200936.238243:0:87177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006c6d400/0x96d0c9b8c9a1abea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1abe3 expref: 19 pid: 87177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200936.238252:0:87177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006c6d400, rc 0) 00000100:00100000:2.0:1788200936.238586:0:87177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0059cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715070848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 417us (6393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200936.238594:0:87177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788200936.239093:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715070848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788200936.239114:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad000/0x96d0c9b8c9a1abe3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1abea expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.239152:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad000/0x96d0c9b8c9a1abe3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1abea expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200936.239229:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715070976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788200936.239271:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200936.239308:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140024780 going to sleep for 11 seconds 00000100:00100000:3.0:1788200936.239486:0:87181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715070976 00000100:00100000:3.0:1788200936.239492:0:87181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715070976 00000100:00100000:3.0:1788200936.239532:0:87181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788200936.239549:0:87181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0059ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715070976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788200936.239674:0:87181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0059ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715070976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200936.239681:0:87181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788200936.239719:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715070976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788200936.239751:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715071104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788200936.239793:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200936.239806:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a86e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788200936.239851:0:87176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715071104 00000100:00100000:0.0:1788200936.239856:0:87176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715071104 00000100:00100000:0.0:1788200936.239899:0:87176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788200936.239906:0:87176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0059c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715071104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788200936.239984:0:87176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0059c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715071104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200936.239990:0:87176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788200936.240316:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715071104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788200936.241725:0:87274:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788200936.242409:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788200936.242436:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788200936.242447:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad000/0x96d0c9b8c9a1abe3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1abea expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200936.242477:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad000/0x96d0c9b8c9a1abe3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1abea expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788200936.242486:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788200936.242488:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc13aa9f000 from 52 10000000:01000000:2.0:1788200936.242491:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788200936.242525:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1abf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200936.242533:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1abf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200936.242542:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1abf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200936.242565:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715071232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788200936.242625:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200936.242670:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0072ff000 going to sleep for 11 seconds 00000100:00100000:3.0:1788200936.242769:0:87181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715071232 00000100:00100000:3.0:1788200936.242776:0:87181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715071232 00000100:00100000:3.0:1788200936.242824:0:87181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788200936.242834:0:87181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715071232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788200936.242845:0:87181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788200936.242857:0:87181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fce00/0x96d0c9b8c9a1abf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1abf1 expref: -99 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200936.242878:0:87181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fce00/0x96d0c9b8c9a1abf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1abf1 expref: 20 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200936.242900:0:87181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fce00/0x96d0c9b8c9a1abf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1abf1 expref: 20 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200936.242908:0:87181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fce00, rc 0) 00000100:00100000:3.0:1788200936.242952:0:87181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715071232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200936.242966:0:87181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788200936.243284:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715071232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788200936.243299:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1abf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1abf8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200936.243308:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1abf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1abf8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200936.243372:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715071360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788200936.243399:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200936.243467:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0072ff000 going to sleep for 11 seconds 00000100:00100000:3.0:1788200936.244006:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715071360 00000100:00100000:3.0:1788200936.244041:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715071360 00000100:00100000:3.0:1788200936.244079:0:87178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788200936.244087:0:87178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715071360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788200936.244225:0:87178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715071360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200936.244232:0:87178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788200936.244483:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715071360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788200936.244524:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715071488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788200936.244571:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200936.244607:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140024600 going to sleep for 11 seconds 00000100:00100000:3.0:1788200936.244685:0:87181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715071488 00000100:00100000:3.0:1788200936.244690:0:87181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715071488 00000100:00100000:3.0:1788200936.244726:0:87181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788200936.244732:0:87181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715071488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788200936.244825:0:87181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715071488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200936.244832:0:87181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788200936.244914:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715071488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788200936.246433:0:87275:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1788200936.246717:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1788200936.246744:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788200936.246755:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1abf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1abf8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200936.246766:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1abf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1abf8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788200936.246775:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788200936.246777:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1788200936.246780:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788200936.246814:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1abff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200936.246834:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1abff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200936.246844:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1abff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200936.246865:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715071616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788200936.246932:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200936.246963:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12585ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788200936.247142:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715071616 00000100:00100000:2.0:1788200936.247149:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715071616 00000100:00100000:2.0:1788200936.247191:0:87178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788200936.247198:0:87178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715071616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788200936.247209:0:87178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788200936.247221:0:87178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006c6de00/0x96d0c9b8c9a1ac06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1abff expref: -99 pid: 87178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200936.247242:0:87178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006c6de00/0x96d0c9b8c9a1ac06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1abff expref: 21 pid: 87178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200936.247252:0:87178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006c6de00/0x96d0c9b8c9a1ac06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1abff expref: 21 pid: 87178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200936.247259:0:87178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006c6de00, rc 0) 00000100:00100000:2.0:1788200936.247297:0:87178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715071616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200936.247303:0:87178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788200936.247419:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715071616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788200936.247433:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1abff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ac06 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200936.247441:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1abff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ac06 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200936.247498:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715071744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788200936.247524:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200936.247538:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12585ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788200936.247551:0:87181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715071744 00000100:00100000:3.0:1788200936.247555:0:87181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715071744 00000100:00100000:3.0:1788200936.247582:0:87181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788200936.247589:0:87181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715071744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788200936.247725:0:87181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715071744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200936.247732:0:87181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788200936.247772:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715071744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788200936.247798:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715071872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788200936.247833:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200936.247847:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0010eba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788200936.247858:0:87177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715071872 00000100:00100000:3.0:1788200936.247861:0:87177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715071872 00000100:00100000:3.0:1788200936.247882:0:87177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788200936.248037:0:87177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1258bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715071872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788200936.248787:0:87177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1258bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715071872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 772us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200936.248796:0:87177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788200936.248851:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715071872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788200936.251331:0:87276:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1788200936.251551:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1788200936.251581:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788200936.251594:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1abff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ac06 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.251606:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1abff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ac06 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788200936.251636:0:6529:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788200936.251638:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc13aa9f000 from 7 10000000:01000000:0.0:1788200936.251641:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788200936.251691:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8600/0x96d0c9b8c9a1ac0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.251699:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8600/0x96d0c9b8c9a1ac0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.251710:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8600/0x96d0c9b8c9a1ac0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200936.251734:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715072000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788200936.251803:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200936.251852:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140024240 going to sleep for 11 seconds 00000100:00100000:3.0:1788200936.252058:0:87177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715072000 00000100:00100000:3.0:1788200936.252066:0:87177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715072000 00000100:00100000:3.0:1788200936.252115:0:87177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788200936.252134:0:87177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1258bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715072000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788200936.252148:0:87177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788200936.252161:0:87177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fd400/0x96d0c9b8c9a1ac14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ac0d expref: -99 pid: 87177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200936.252185:0:87177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fd400/0x96d0c9b8c9a1ac14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ac0d expref: 22 pid: 87177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200936.252194:0:87177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fd400/0x96d0c9b8c9a1ac14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ac0d expref: 22 pid: 87177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200936.252213:0:87177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fd400, rc 0) 00000100:00100000:3.0:1788200936.252254:0:87177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1258bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715072000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200936.252259:0:87177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788200936.252632:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715072000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788200936.252649:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8600/0x96d0c9b8c9a1ac0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ac14 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.252658:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8600/0x96d0c9b8c9a1ac0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ac14 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200936.252732:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715072128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788200936.252761:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200936.252794:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140024240 going to sleep for 11 seconds 00000100:00100000:3.0:1788200936.253243:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715072128 00000100:00100000:3.0:1788200936.253249:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715072128 00000100:00100000:3.0:1788200936.253285:0:87178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788200936.253293:0:87178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715072128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788200936.253409:0:87178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110006850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715072128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200936.253416:0:87178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788200936.253519:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715072128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788200936.253552:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715072256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788200936.253610:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200936.253636:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1059713c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788200936.254234:0:87177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715072256 00000100:00100000:3.0:1788200936.254241:0:87177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715072256 00000100:00100000:3.0:1788200936.254281:0:87177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788200936.254289:0:87177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1258b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715072256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788200936.254386:0:87177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1258b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715072256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200936.254393:0:87177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788200936.254512:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715072256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788200936.255458:0:87277:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788200936.255618:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788200936.255653:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788200936.255670:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8600/0x96d0c9b8c9a1ac0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ac14 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.255685:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8600/0x96d0c9b8c9a1ac0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ac14 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788200936.255693:0:6529:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788200936.255695:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8dc12563cd28 from 1 10000000:01000000:0.0:1788200936.255698:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788200936.255727:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8800/0x96d0c9b8c9a1ac1b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.255734:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8800/0x96d0c9b8c9a1ac1b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.255743:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8800/0x96d0c9b8c9a1ac1b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200936.255761:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715072384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788200936.255809:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200936.255847:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140024b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788200936.257907:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715072384 00000100:00100000:1.0:1788200936.257950:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715072384 00000100:00100000:1.0:1788200936.258162:0:87178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788200936.258172:0:87178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715072384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788200936.258187:0:87178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788200936.258206:0:87178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0079aca00/0x96d0c9b8c9a1ac22 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ac1b expref: -99 pid: 87178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200936.258232:0:87178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0079aca00/0x96d0c9b8c9a1ac22 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ac1b expref: 23 pid: 87178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200936.258243:0:87178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0079aca00/0x96d0c9b8c9a1ac22 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ac1b expref: 23 pid: 87178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200936.258252:0:87178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0079aca00, rc 0) 00000100:00100000:1.0:1788200936.258333:0:87178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110007c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715072384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (2522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200936.258340:0:87178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788200936.258498:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715072384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788200936.258521:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8800/0x96d0c9b8c9a1ac1b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ac22 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200936.258530:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8800/0x96d0c9b8c9a1ac1b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ac22 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788200936.258566:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788200936.258572:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8800/0x96d0c9b8c9a1ac1b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ac22 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200936.258579:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8800/0x96d0c9b8c9a1ac1b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ac22 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788200936.258587:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788200936.258590:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dc12563cd28 from 1 10000000:01000000:3.0:1788200936.258593:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788200936.258616:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1ac29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200936.258624:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1ac29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200936.258632:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1ac29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200936.258652:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715072512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788200936.258701:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200936.261977:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0010eb000 going to sleep for 11 seconds 00000100:00100000:0.0:1788200936.263584:0:87176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715072512 00000100:00100000:0.0:1788200936.263596:0:87176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715072512 00000100:00100000:0.0:1788200936.263661:0:87176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788200936.264248:0:87176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11802ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715072512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788200936.264270:0:87176:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200936.264289:0:87176:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007ce8e00/0x96d0c9b8c9a1ac30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ac29 expref: -99 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.264319:0:87176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007ce8e00/0x96d0c9b8c9a1ac30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ac29 expref: 24 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.264341:0:87176:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007ce8e00/0x96d0c9b8c9a1ac30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ac29 expref: 24 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200936.264351:0:87176:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ce8e00, rc 0) 00000100:00100000:0.0:1788200936.264424:0:87176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11802ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715072512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 755us (5722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200936.264431:0:87176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788200936.265078:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715072512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788200936.265099:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1ac29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ac30 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200936.265109:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1ac29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ac30 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200936.265216:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715072640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788200936.265256:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200936.265290:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140c450c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788200936.265379:0:87181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715072640 00000100:00100000:0.0:1788200936.265385:0:87181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715072640 00000100:00100000:0.0:1788200936.265412:0:87181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788200936.265420:0:87181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11802f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715072640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788200936.265653:0:87181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11802f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715072640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (395us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788200936.265661:0:87181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788200936.265982:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715072640:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788200936.266045:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788200936.266053:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1ac29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ac30 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200936.266062:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1ac29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ac30 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200937.234739:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788200937.810508:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788200937.810539:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715072768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788200937.811333:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200937.811758:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715072768 00000100:00100000:1.0:1788200937.811770:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715072768 00000100:00100000:1.0:1788200937.811843:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2130 00000100:00080000:0.0:1788200937.812214:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788200937.812274:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715072768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788200937.812324:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200937.812572:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715072768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788200937.813269:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715072768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1415us (1938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200937.813281:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2130 00000100:00100000:0.0:1788200937.815707:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715072896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788200937.815792:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200937.825149:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715072896 00000100:00100000:1.0:1788200937.825173:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715072896 00000100:00100000:1.0:1788200937.825269:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2131 00000100:00100000:1.0:1788200937.825285:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715072896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788200937.825329:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200937.828699:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715072896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3405us (12891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200937.828717:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2131 00000100:00100000:1.0:1788200937.828835:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715072896:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788200937.830551:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788200938.263952:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788200938.970825:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200938.971521:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695346944 00000100:00100000:1.0:1788200938.971537:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695346944 00000100:00100000:1.0:1788200938.971650:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1155 00000100:00100000:1.0:1788200938.971665:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695346944:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788200938.971788:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695346944:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 126us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200938.971797:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1155 00000100:00080000:3.0:1788200938.971946:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788200938.973891:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200938.974518:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695346816 00000100:00100000:3.0:1788200938.974533:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695346816 00000100:00100000:3.0:1788200938.974616:0:87178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 71 00000100:00100000:3.0:1788200938.974629:0:87178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11802d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2400:x1875060695346816:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200938.974754:0:87178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11802d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2400:x1875060695346816:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 127us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200938.974764:0:87178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 71 00010000:00010000:2.0:1788200939.279355:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788200939.857233:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788200939.857243:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788200939.857248:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788200939.857264:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788200939.857294:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11cc45f80 x1875060715073152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788200939.857331:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788200939.857335:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788200939.857337:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788200939.857343:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788200939.857354:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11cc47b80 x1875060715073408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788200939.857371:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788200939.857375:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788200939.857377:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788200939.857383:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788200939.857396:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11d29ce00 x1875060715073664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788200939.857418:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788200939.857421:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788200939.857433:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788200939.857439:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788200939.857453:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11d29d180 x1875060715074048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788200939.857483:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788200939.857486:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788200939.857487:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc12b6be800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788200939.857492:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dc12b6be800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788200939.857509:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc133701180 x1875060715074560/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788200939.857767:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715073024:0@lo:400:kworker.0 00000100:00100000:1.0:1788200939.857869:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200939.857921:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715073920:0@lo:400:kworker.0 00000100:00100000:1.0:1788200939.857961:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200939.857993:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788200939.858000:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715073792:0@lo:400:kworker.0 00000100:00100000:1.0:1788200939.858049:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200939.858084:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715074432:0@lo:400:kworker.0 00000100:00100000:1.0:1788200939.858112:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200939.858154:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715073920 00000100:00100000:1.0:1788200939.858164:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715073920 00000100:00100000:1.0:1788200939.858229:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715073792 00000100:00100000:1.0:1788200939.858232:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715073792 00000100:00100000:1.0:1788200939.858257:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715074432 00000100:00100000:1.0:1788200939.858259:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715074432 00000100:00100000:1.0:1788200939.858288:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2628 00000100:00100000:1.0:1788200939.858297:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715073920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200939.858357:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715073920:12345-0@lo:400:kworker.0 Request processed in 61us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200939.858363:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2628 00000100:00100000:1.0:1788200939.858385:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2629 00000100:00100000:1.0:1788200939.858391:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715073792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200939.858418:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715073792:12345-0@lo:400:kworker.0 Request processed in 28us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200939.858423:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2629 00000100:00100000:1.0:1788200939.858433:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2630 00000100:00100000:1.0:1788200939.858439:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715074432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200939.858464:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715074432:12345-0@lo:400:kworker.0 Request processed in 25us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200939.858469:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2630 00000100:00100000:1.0:1788200939.858526:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715073792:0@lo:400:kworker.0 00000100:00100000:3.0:1788200939.858752:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715073152:0@lo:38:kworker.0 00000100:00100000:3.0:1788200939.858794:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200939.858816:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715073408:0@lo:38:kworker.0 00000100:00100000:3.0:1788200939.858841:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200939.858859:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715073664:0@lo:38:kworker.0 00000100:00100000:3.0:1788200939.858888:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200939.858910:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715074048:0@lo:38:kworker.0 00000100:00100000:3.0:1788200939.858934:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200939.858953:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715074560:0@lo:38:kworker.0 00000100:00100000:3.0:1788200939.858976:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200939.859010:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715073280:0@lo:400:kworker.0 00000100:00100000:3.0:1788200939.859054:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200939.859088:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715074176:0@lo:400:kworker.0 00000100:00100000:3.0:1788200939.859111:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200939.859142:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788200939.859148:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715073536:0@lo:400:kworker.0 00000100:00100000:3.0:1788200939.859170:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200939.859179:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715074304:0@lo:400:kworker.0 00000100:00100000:3.0:1788200939.859200:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200939.859235:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715074304 00000100:00100000:3.0:1788200939.859240:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715074304 00000100:00100000:3.0:1788200939.859274:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631 00000100:00100000:3.0:1788200939.859282:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715074304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200939.859322:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715074304:12345-0@lo:400:kworker.0 Request processed in 42us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200939.859328:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631 00000100:00080000:3.0:1788200939.859354:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788200939.859359:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788200939.859370:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715073152 00000100:00100000:3.0:1788200939.859374:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715073152 00000100:00100000:3.0:1788200939.859388:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715073408 00000100:00100000:3.0:1788200939.859391:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715073408 00000100:00100000:3.0:1788200939.859399:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715074048 00000100:00100000:3.0:1788200939.859401:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715074048 00000100:00100000:3.0:1788200939.859409:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715074560 00000100:00100000:3.0:1788200939.859410:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715074560 00000100:00100000:3.0:1788200939.859419:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715073280 00000100:00100000:3.0:1788200939.859421:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715073280 00000100:00100000:3.0:1788200939.859444:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715073536 00000100:00100000:3.0:1788200939.859447:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715073536 00000100:00100000:3.0:1788200939.859465:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:3.0:1788200939.859470:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715073280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200939.859502:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715073280:12345-0@lo:400:kworker.0 Request processed in 31us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200939.859519:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:1.0:1788200939.864891:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715074432:0@lo:400:kworker.0 00000100:00100000:1.0:1788200939.864912:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715073920:0@lo:400:kworker.0 00000100:00100000:0.0:1788200939.865290:0:87176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715073024 00000100:00100000:0.0:1788200939.865301:0:87176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715073024 00000100:00100000:0.0:1788200939.865391:0:87176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788200939.865403:0:87176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11802c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715073024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200939.865550:0:87176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11802c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715073024:12345-0@lo:400:kworker.0 Request processed in 148us (7680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200939.865558:0:87176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788200939.865856:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788200939.865875:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715074688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788200939.865927:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200939.866083:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715073024:0@lo:400:kworker.0 00000100:00100000:0.0:1788200939.866181:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715073664 00000100:00100000:0.0:1788200939.866187:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715073664 00000100:00100000:0.0:1788200939.866218:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715074176 00000100:00100000:0.0:1788200939.866221:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715074176 00000100:00100000:0.0:1788200939.866240:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715074688 00000100:00100000:0.0:1788200939.866242:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715074688 00000100:00100000:0.0:1788200939.866254:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3853 00000100:00100000:0.0:1788200939.866261:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715073664:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788200939.866293:0:23728:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8dc1401c6800, cookie 0x96d0c9b8c9a1aaa8 00010000:00080000:0.0:1788200939.866299:0:23728:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t81604378640 exp ffff8dc1401c6800 cur 3791 last 1788200934 00000004:00100000:0.0:1788200939.866322:0:23728:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788200939.866494:0:23728:0:(import.c:65:import_set_state_nolock()) ffff8dc106074000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788200939.867688:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:3.0:1788200939.867713:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715073536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200939.867804:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715073536:12345-0@lo:400:kworker.0 Request processed in 103us (8631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200939.867810:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00100000:3.0:1788200939.867841:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:3.0:1788200939.867846:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715073152:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788200939.867870:0:66312:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3791 last 0 00000020:00000080:3.0:1788200939.867919:0:66312:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x96d0c9b8c9a1ac37 00000004:00100000:3.0:1788200939.867934:0:66312:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788200939.867969:0:66312:0:(import.c:65:import_set_state_nolock()) ffff8dc11cdda800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788200939.868038:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875060715073152:12345-0@lo:38:kworker.0 Request processed in 189us (9243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200939.868046:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:3.0:1788200939.868077:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:3.0:1788200939.868083:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715073408:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788200939.868102:0:66312:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3791 last 0 00000020:00000080:3.0:1788200939.868127:0:66312:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x96d0c9b8c9a1ac3e 00000004:00100000:3.0:1788200939.868133:0:66312:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788200939.868150:0:66312:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788200939.868193:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875060715073408:12345-0@lo:38:kworker.0 Request processed in 110us (9352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200939.868200:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:3.0:1788200939.868216:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:3.0:1788200939.868220:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715074048:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788200939.868233:0:66312:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3791 last 0 00000020:00000080:3.0:1788200939.868258:0:66312:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x96d0c9b8c9a1ac45 00000004:00100000:3.0:1788200939.868265:0:66312:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788200939.868280:0:66312:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788200939.868310:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875060715074048:12345-0@lo:38:kworker.0 Request processed in 87us (9374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200939.868316:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:3.0:1788200939.868330:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:3.0:1788200939.868334:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715074560:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788200939.868348:0:66312:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3791 last 0 00000020:00000080:3.0:1788200939.868370:0:66312:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x96d0c9b8c9a1ac4c 00000004:00100000:3.0:1788200939.868375:0:66312:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788200939.868387:0:66312:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788200939.868416:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875060715074560:12345-0@lo:38:kworker.0 Request processed in 80us (9438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200939.868422:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:3.0:1788200939.868450:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3854 00000100:00100000:3.0:1788200939.868458:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3657:x1875060715074176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200939.868495:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3657:x1875060715074176:12345-0@lo:400:kworker.0 Request processed in 38us (9383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200939.868510:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3854 00000100:00100000:3.0:1788200939.868528:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3855 00000100:00100000:3.0:1788200939.868534:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715074688:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788200939.869290:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715073664:12345-0@lo:38:kworker.0 Request processed in 3025us (10397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200939.869300:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3853 00010000:00080000:0.0:1788200939.869332:0:87204:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1788200939.869339:0:87204:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 103079215109 00000020:00080000:0.0:1788200939.869344:0:87204:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788200939.869348:0:87204:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 103079215109, next_transno: 103079215109 00010000:00080000:0.0:1788200939.869352:0:87204:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (103079215109) 00000020:00080000:0.0:1788200939.869355:0:87204:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788200939.869366:0:87204:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695338880 t103079215109 from 192.168.201.20@tcp req@ffff8dc13ab54700 x1875060695338880/t0(103079215109) o36->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:56/0 lens 528/0 e 0 to 0 dl 1788200946 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000004:00000024:3.0:1788200939.871152:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:3.0:1788200939.871255:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715074688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2717us (5324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200939.871266:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3855 00000100:00100000:3.0:1788200939.871377:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715073536:0@lo:400:kworker.0 00000100:00100000:3.0:1788200939.871396:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715074304:0@lo:400:kworker.0 00000100:00100000:3.0:1788200939.871411:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715073280:0@lo:400:kworker.0 00000100:00100000:3.0:1788200939.871423:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715074176:0@lo:400:kworker.0 00000100:00080000:3.0:1788200939.871462:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788200939.871489:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc11cc45f80 x1875060715073152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788200964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788200939.871506:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 25 00000004:00080000:0.0:1788200939.872729:0:87204:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3279us 00000100:00080000:3.0:1788200939.875503:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8dc11cc45f80 x1875060715073152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788200964 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788200939.875522:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788200939.876640:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788200939.876653:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788200939.876662:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715073152:0@lo:38:kworker.0 00010000:00080000:3.0:1788200939.876711:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc11cc47b80 x1875060715073408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788200964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788200939.876746:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 25 00000100:00080000:3.0:1788200939.883477:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8dc11cc47b80 x1875060715073408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788200964 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788200939.883496:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788200939.883503:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788200939.883509:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788200939.883517:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715073408:0@lo:38:kworker.0 00000100:00080000:3.0:1788200939.884708:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 25 00000100:00080000:3.0:1788200939.884731:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1788200939.884737:0:3654:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1788200939.884740:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 85899345923 gen 3 00000100:00080000:3.0:1788200939.884746:0:3654:0:(recover.c:53:ptlrpc_replay_next()) import ffff8dc109813800 from lustre-MDT0000_UUID committed 85899345923 last 0 00000100:00080000:3.0:1788200939.884750:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1788200939.884832:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715074688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788200939.908469:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715073664:0@lo:38:kworker.0 00010000:00080000:2.0:1788200939.908543:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc11d29d180 x1875060715074048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788200964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788200939.908568:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 25 00000100:00080000:2.0:1788200939.909444:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8dc11d29d180 x1875060715074048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788200964 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788200939.909456:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788200939.909464:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788200939.909468:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788200939.909474:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715074048:0@lo:38:kworker.0 00010000:00080000:2.0:1788200939.909514:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc133701180 x1875060715074560/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788200949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788200939.909529:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 25 00000100:00080000:2.0:1788200939.909537:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788200939.909542:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788200939.909544:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc12b6be800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788200939.909549:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715074560:0@lo:38:kworker.0 00010000:00080000:2.0:1788200939.909627:0:87399:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1788200939.909650:0:87399:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1788200939.909657:0:87399:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:2.0:1788200939.910148:0:87399:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1788200939.910218:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715074816:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788200939.910302:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200939.913786:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715074816 00000100:00100000:2.0:1788200939.913809:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715074816 00000100:00100000:2.0:1788200939.913901:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3856 00000100:00100000:2.0:1788200939.913913:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715074816:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1788200939.913939:0:23728:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc005abdc00 x1875060715074816/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:60/0 lens 224/0 e 0 to 0 dl 1788200950 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788200939.913952:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715074816:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 43us (3651us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788200939.913959:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3856 00010000:00010000:2.0:1788200939.926392:0:87204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ca00/0x96d0c9b8c9a1ac53 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200939.926422:0:87204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ca00/0x96d0c9b8c9a1ac53 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200939.926440:0:87204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ca00/0x96d0c9b8c9a1ac53 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200939.926456:0:87204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6da00/0x96d0c9b8c9a1ac5a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200939.926463:0:87204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6da00/0x96d0c9b8c9a1ac5a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200939.926483:0:87204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6da00/0x96d0c9b8c9a1ac5a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200939.927045:0:87204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ca00/0x96d0c9b8c9a1ac53 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200939.927055:0:87204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ca00/0x96d0c9b8c9a1ac53 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200939.927075:0:87204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ca00/0x96d0c9b8c9a1ac53 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200939.927081:0:87204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6ca00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788200939.927086:0:87204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ca00/0x96d0c9b8c9a1ac53 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200939.927095:0:87204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ca00/0x96d0c9b8c9a1ac53 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200939.927110:0:87204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048beb00) 00010000:00010000:2.0:1788200939.927113:0:87204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788200939.927118:0:87204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ca00/0x96d0c9b8c9a1ac53 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200939.927124:0:87204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ca00/0x96d0c9b8c9a1ac53 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788200939.927142:0:87204:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000409943cd reply state 00000000232fdfa5 transno 103079215109 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6da00/0x96d0c9b8c9a1ac5a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200939.927152:0:87204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6da00/0x96d0c9b8c9a1ac5a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200939.927165:0:87204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc0048be100) 00010000:00010000:2.0:1788200939.927167:0:87204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788200939.927170:0:87204:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788200939.927320:0:87204:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788200939.927355:0:87204:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788200939.927359:0:87204:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215110 00000020:00080000:2.0:1788200939.927364:0:87204:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788200939.927366:0:87204:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215110 00000100:00100000:1.0:1788200939.937677:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200939.937742:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695339392 00000100:00100000:1.0:1788200939.937756:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695339392 00000100:00100000:1.0:1788200939.937825:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1154 00000100:00100000:1.0:1788200939.937840:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+8:2399:x1875060695339392:12345-192.168.201.20@tcp:36:rm.0 00010000:00080000:1.0:1788200939.937864:0:66312:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 103079215110, current: 103079215110, replaying 00000100:00100000:1.0:1788200939.937881:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+8:2399:x1875060695339392:12345-192.168.201.20@tcp:36:rm.0 Request processed in 47us (221us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788200939.937889:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1154 00000020:00080000:1.0:1788200939.937914:0:87204:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788200939.937919:0:87204:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215110, next_transno: 103079215110 00010000:00080000:1.0:1788200939.937924:0:87204:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (103079215110) 00000020:00080000:1.0:1788200939.937928:0:87204:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788200939.937939:0:87204:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695339392 t103079215110 from 192.168.201.20@tcp req@ffff8dc005d56a00 x1875060695339392/t0(103079215110) o36->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:60/0 lens 512/0 e 0 to 0 dl 1788200950 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788200939.938080:0:87204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ac61 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.938101:0:87204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ac61 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.938116:0:87204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ac61 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.938137:0:87204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1ac68 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.938146:0:87204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1ac68 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.938153:0:87204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1ac68 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.938265:0:87204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad200/0x96d0c9b8c9a1ac6f lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.938274:0:87204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad200/0x96d0c9b8c9a1ac6f lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.938281:0:87204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad200/0x96d0c9b8c9a1ac6f lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.938576:0:87204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad200/0x96d0c9b8c9a1ac6f lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.938585:0:87204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad200/0x96d0c9b8c9a1ac6f lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.938593:0:87204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad200/0x96d0c9b8c9a1ac6f lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.938600:0:87204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0079ad200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788200939.938606:0:87204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad200/0x96d0c9b8c9a1ac6f lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.938614:0:87204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad200/0x96d0c9b8c9a1ac6f lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.938636:0:87204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x4:0x0].0x0 (ffff8dc12f142200) 00010000:00010000:1.0:1788200939.938639:0:87204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788200939.938645:0:87204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad200/0x96d0c9b8c9a1ac6f lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.938651:0:87204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad200/0x96d0c9b8c9a1ac6f lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.938683:0:87204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ac61 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.938689:0:87204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ac61 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.938694:0:87204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ac61 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.938699:0:87204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0079ace00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788200939.938702:0:87204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ac61 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.938708:0:87204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ac61 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.938716:0:87204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12f142000) 00010000:00010000:1.0:1788200939.938719:0:87204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788200939.938721:0:87204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ac61 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.938727:0:87204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ac61 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788200939.938768:0:87204:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005188ba1 reply state 000000001bd303c0 transno 103079215110 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1ac68 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.938782:0:87204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1ac68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.938789:0:87204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc0048be100) 00010000:00010000:1.0:1788200939.938792:0:87204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788200939.938795:0:87204:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788200939.938889:0:87204:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788200939.938913:0:87204:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788200939.938916:0:87204:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215111 00000020:00080000:1.0:1788200939.938920:0:87204:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788200939.938922:0:87204:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215111 00000001:00080000:0.0:1788200939.939803:0:87171:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215109 is committed 00010000:00010000:1.0:1788200939.941334:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6da00/0x96d0c9b8c9a1ac5a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.941353:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6da00/0x96d0c9b8c9a1ac5a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.941361:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6da00/0x96d0c9b8c9a1ac5a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.941368:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6da00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788200939.941373:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6da00/0x96d0c9b8c9a1ac5a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.941380:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6da00/0x96d0c9b8c9a1ac5a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.941536:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc0048be100) 00010000:00010000:1.0:1788200939.941539:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788200939.941545:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6da00/0x96d0c9b8c9a1ac5a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200939.941553:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6da00/0x96d0c9b8c9a1ac5a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200939.955747:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200939.955808:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695341184 00000100:00100000:0.0:1788200939.955833:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695341184 00000100:00100000:0.0:1788200939.955910:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1155 00000100:00100000:0.0:1788200939.955923:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+8:2399:x1875060695341184:12345-192.168.201.20@tcp:101:touch.0 00010000:00080000:0.0:1788200939.955951:0:66313:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 103079215111, current: 103079215111, replaying 00000100:00100000:0.0:1788200939.955968:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+8:2399:x1875060695341184:12345-192.168.201.20@tcp:101:touch.0 Request processed in 48us (236us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788200939.955976:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1155 00000020:00080000:0.0:1788200939.956002:0:87204:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788200939.956007:0:87204:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215111, next_transno: 103079215111 00010000:00080000:0.0:1788200939.956012:0:87204:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (103079215111) 00000020:00080000:0.0:1788200939.956034:0:87204:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788200939.956045:0:87204:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695341184 t103079215111 from 192.168.201.20@tcp req@ffff8dc13ab54e00 x1875060695341184/t0(103079215111) o101->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:60/0 lens 752/0 e 0 to 0 dl 1788200950 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1788200939.956084:0:87204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200939.956120:0:87204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1ac76 lrc: 2/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7865a8 expref: -99 pid: 87204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200939.956425:0:87204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2dc00/0x96d0c9b8c9a1ac7d lrc: 3/0,1 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200939.956443:0:87204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2dc00/0x96d0c9b8c9a1ac7d lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200939.956466:0:87204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2dc00/0x96d0c9b8c9a1ac7d lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200939.956483:0:87204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d600/0x96d0c9b8c9a1ac84 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200939.956490:0:87204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d600/0x96d0c9b8c9a1ac84 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200939.956496:0:87204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d600/0x96d0c9b8c9a1ac84 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788200939.957255:0:87204:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000afe1:0x5:0x0], cookie = 0x96d0c9b8c9a1aa07 00000004:00080000:0.0:1788200939.957260:0:87204:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x96d0c9b8c9a1aa07 in new mfd 00010000:00010000:0.0:1788200939.957273:0:87204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2dc00/0x96d0c9b8c9a1ac7d lrc: 3/0,1 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200939.957282:0:87204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2dc00/0x96d0c9b8c9a1ac7d lrc: 2/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200939.957289:0:87204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2dc00/0x96d0c9b8c9a1ac7d lrc: 3/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200939.957294:0:87204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2dc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788200939.957300:0:87204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2dc00/0x96d0c9b8c9a1ac7d lrc: 3/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200939.957307:0:87204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2dc00/0x96d0c9b8c9a1ac7d lrc: 4/0,0 mode: CW/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200939.957323:0:87204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8dc137d07f00) 00010000:00010000:0.0:1788200939.957336:0:87204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788200939.957341:0:87204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2dc00/0x96d0c9b8c9a1ac7d lrc: 2/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200939.957348:0:87204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2dc00/0x96d0c9b8c9a1ac7d lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788200939.957363:0:87204:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000097596685 reply state 00000000363e28a7 transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d600/0x96d0c9b8c9a1ac84 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200939.957376:0:87204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d600/0x96d0c9b8c9a1ac84 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200939.957382:0:87204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff8dc137d07500) 00010000:00010000:0.0:1788200939.957384:0:87204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788200939.957388:0:87204:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788200939.957426:0:87204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1ac76 lrc: 1/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865a8 expref: 10 pid: 87204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200939.957439:0:87204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8dc137d07f00) 00010000:00010000:0.0:1788200939.957441:0:87204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788200939.957445:0:87204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ce9000/0x96d0c9b8c9a1ac76 lrc: 0/0,0 mode: --/CW res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865a8 expref: 10 pid: 87204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200939.957461:0:87204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ce9000, rc 0) 00010000:00080000:0.0:1788200939.958747:0:87204:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788200939.958785:0:87204:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788200939.958789:0:87204:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000020:00080000:0.0:1788200939.958794:0:87204:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788200939.958796:0:87204:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000100:00100000:3.0:1788200939.993189:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200939.993237:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200939.993273:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695347072 00000100:00100000:3.0:1788200939.993284:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695347072 00000100:00100000:3.0:1788200939.993352:0:87178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 73 00000100:00100000:3.0:1788200939.993364:0:87178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1258ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695347072:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200939.993467:0:87178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1258ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695347072:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 105us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200939.993475:0:87178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 73 00000100:00100000:3.0:1788200939.993526:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695347200 00000100:00100000:3.0:1788200939.993562:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695347200 00000100:00100000:3.0:1788200939.993599:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1158 00000100:00100000:3.0:1788200939.993606:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695347200:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200939.993644:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695347200:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 40us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200939.993651:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1158 00000100:00100000:1.0:1788200940.022328:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200940.022435:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695341440 00000100:00100000:3.0:1788200940.022448:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695341440 00000100:00100000:3.0:1788200940.022525:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1156 00000100:00100000:3.0:1788200940.022729:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+10:2399:x1875060695341440:12345-192.168.201.20@tcp:36:touch.0 00010000:00080000:3.0:1788200940.022757:0:69485:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 103079215112, current: 103079215112, replaying 00000100:00100000:3.0:1788200940.022779:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+10:2399:x1875060695341440:12345-192.168.201.20@tcp:36:touch.0 Request processed in 58us (468us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788200940.022788:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1156 00000020:00080000:1.0:1788200940.022923:0:87204:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788200940.022929:0:87204:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215112, next_transno: 103079215112 00010000:00080000:1.0:1788200940.022934:0:87204:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (103079215112) 00000020:00080000:1.0:1788200940.022939:0:87204:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788200940.022951:0:87204:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695341440 t103079215112 from 192.168.201.20@tcp req@ffff8dc005d55f80 x1875060695341440/t0(103079215112) o36->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:61/0 lens 488/0 e 0 to 0 dl 1788200951 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788200940.023161:0:87204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ac92 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.023181:0:87204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ac92 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.023196:0:87204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ac92 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788200940.023340:0:87204:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b52722f reply state 00000000057704a5 transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ac92 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.023356:0:87204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ac92 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.023385:0:87204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff8dc12f142000) 00010000:00010000:1.0:1788200940.023389:0:87204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788200940.023394:0:87204:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788200940.023508:0:87204:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788200940.023732:0:87204:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788200940.023736:0:87204:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000020:00080000:1.0:1788200940.023740:0:87204:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788200940.023742:0:87204:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000100:00100000:2.0:1788200940.045740:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200940.050675:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695341824 00000100:00100000:0.0:1788200940.050698:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695341824 00000100:00100000:0.0:1788200940.051659:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 219 00000100:00100000:0.0:1788200940.051677:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4292087e-fa00-4621-b681-837afc99ae35+12:2399:x1875060695341824:12345-192.168.201.20@tcp:35:touch.0 00010000:00080000:0.0:1788200940.051704:0:79137:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 103079215113, current: 103079215113, replaying 00000100:00100000:0.0:1788200940.051725:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4292087e-fa00-4621-b681-837afc99ae35+12:2399:x1875060695341824:12345-192.168.201.20@tcp:35:touch.0 Request processed in 54us (6000us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788200940.051733:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 219 00000020:00080000:3.0:1788200940.055116:0:87204:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788200940.055129:0:87204:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215113, next_transno: 103079215113 00010000:00080000:3.0:1788200940.055136:0:87204:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (103079215113) 00000020:00080000:3.0:1788200940.055140:0:87204:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788200940.055159:0:87204:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695341824 t103079215113 from 192.168.201.20@tcp req@ffff8dc005abe300 x1875060695341824/t0(103079215113) o35->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:61/0 lens 392/0 e 0 to 0 dl 1788200951 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788200940.055990:0:87204:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:3.0:1788200940.056040:0:87204:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788200940.056043:0:87204:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215114 00000020:00080000:3.0:1788200940.056048:0:87204:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788200940.056051:0:87204:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215114 00000100:00100000:3.0:1788200940.066512:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200940.066649:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695347328 00000100:00100000:0.0:1788200940.066662:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695347328 00000100:00100000:0.0:1788200940.066735:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1159 00000100:00100000:0.0:1788200940.066749:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+13:2399:x1875060695347328:12345-192.168.201.20@tcp:400:ldlm_lock_repla.0 00010000:00080000:0.0:1788200940.066782:0:66757:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc13f8d8700 x1875060695347328/t0(0) o400->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:61/0 lens 224/0 e 0 to 0 dl 1788200951 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788200940.066811:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+13:2399:x1875060695347328:12345-192.168.201.20@tcp:400:ldlm_lock_repla.0 Request processed in 66us (315us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788200940.066828:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1159 00000020:00080000:1.0:1788200940.066980:0:87204:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788200940.066986:0:87204:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 103079215114 00010000:00080000:1.0:1788200940.066990:0:87204:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1788200940.066994:0:87204:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788200940.067003:0:87204:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1788200940.067006:0:87204:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1788200940.067177:0:87204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 107374182400 00000001:00100000:1.0:1788200940.069222:0:87171:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4292087e-fa00-4621-b681-837afc99ae35 00000001:00100000:1.0:1788200940.069236:0:87171:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1788200940.069267:0:87171:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215113 is committed 00000001:00080000:1.0:1788200940.069324:0:87204:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1788200940.069384:0:87204:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00010000:0.0:1788200940.069593:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1ac68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.069608:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1ac68 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.069618:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1ac68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.069625:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0079ada00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788200940.069647:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1ac68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.069658:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1ac68 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.069680:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc0048be100) 00010000:00010000:0.0:1788200940.069684:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788200940.069690:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1ac68 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.069696:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1ac68 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.069730:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d600/0x96d0c9b8c9a1ac84 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.069737:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d600/0x96d0c9b8c9a1ac84 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.069744:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d600/0x96d0c9b8c9a1ac84 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.069749:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2d600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788200940.069752:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d600/0x96d0c9b8c9a1ac84 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.069759:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d600/0x96d0c9b8c9a1ac84 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.069767:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff8dc137d07500) 00010000:00010000:0.0:1788200940.069770:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788200940.069780:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d600/0x96d0c9b8c9a1ac84 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.069786:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d600/0x96d0c9b8c9a1ac84 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.069804:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ac92 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.069811:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ac92 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.069818:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ac92 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.069824:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0079ace00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788200940.069827:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ac92 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.069833:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ac92 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.070388:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff8dc12f142000) 00010000:00010000:0.0:1788200940.070392:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788200940.070396:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ac92 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.070404:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ac92 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788200940.070647:0:87204:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8dc005abdc00 x1875060715074816/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:60/0 lens 224/0 e 0 to 0 dl 1788200950 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788200940.070808:0:87204:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.201.20@tcp: req@ffff8dc13f8d8700 x1875060695347328/t0(0) o400->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:61/0 lens 224/0 e 0 to 0 dl 1788200951 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788200940.072673:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1788200940.072692:0:3654:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8dc005abca80 x1875060715074816/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788200955 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788200940.072724:0:3654:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8dc005abca80 x1875060715074816/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788200955 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788200940.072732:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788200940.072753:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1788200940.072759:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715074816:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1788200940.073316:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715074944:0@lo:41:osp-pre-0-1.0 00010000:02000000:1.0:1788200940.073482:0:87204:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00100000:0.0:1788200940.081044:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200940.081152:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715074944 00000100:00100000:0.0:1788200940.081164:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715074944 00000100:00100000:0.0:1788200940.081228:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3857 00000100:00100000:0.0:1788200940.081240:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715074944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788200940.081290:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444970496 avail 1298731008 00000100:00100000:0.0:1788200940.081360:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715074944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200940.082731:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3857 00000100:00100000:0.0:1788200940.082821:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715074944:0@lo:41:osp-pre-0-1.0 00000004:00000080:1.0:1788200940.129193:0:87204:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa0dd486d7e10 00100000:10000000:1.0:1788200940.129224:0:87204:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1788200940.134483:0:87190:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0xb0:0x0] 00000100:00100000:0.0:1788200940.134565:0:87190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87190:1875060715075072:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788200940.134657:0:87190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200940.134698:0:87190:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ce6000 going to sleep for 11 seconds 00000100:00100000:0.0:1788200940.134734:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715075072 00000100:00100000:0.0:1788200940.134742:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715075072 00000100:00100000:0.0:1788200940.134806:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5866 00000100:00100000:0.0:1788200940.134817:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:87190:x1875060715075072:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788200940.134864:0:26209:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 769 -> diff = -593 00002000:02000040:0.0:1788200940.134870:0:26209:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:177 to 0x280000401:769) 00000004:00080000:2.0:1788200940.136290:0:87192:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x2a2:0x0] 00000100:00100000:2.0:1788200940.136342:0:87192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87192:1875060715075200:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788200940.136414:0:87192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200940.136453:0:87192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038e0180 going to sleep for 11 seconds 00000100:00100000:2.0:1788200940.136482:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715075200 00000100:00100000:2.0:1788200940.136488:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715075200 00000100:00100000:2.0:1788200940.136547:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5867 00000100:00100000:2.0:1788200940.136558:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:87192:x1875060715075200:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788200940.136595:0:23974:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 769 -> diff = -95 00002000:02000040:2.0:1788200940.136599:0:23974:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:675 to 0x2c0000401:769) 00002000:00010000:0.0:1788200940.141246:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x301:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.141267:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1ac99 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.141291:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x301:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.141296:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x301:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.141305:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1ac99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.141326:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1ac99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.141339:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1ac99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.141347:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1ac99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.141383:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788200940.141405:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788200940.141412:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1ac99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.141421:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2d600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200940.141447:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1ac99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.141458:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1ac99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.141478:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1ac99 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.141486:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1ac99 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.141512:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200940.141514:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200940.141516:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788200940.142010:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x300:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.142065:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1aca0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.142076:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x300:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.142080:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x300:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.142084:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1aca0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.142094:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1aca0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.142116:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1aca0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.142124:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1aca0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.142140:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788200940.142150:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788200940.142154:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1aca0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.142162:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2dc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200940.142166:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1aca0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.142174:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1aca0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.142186:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1aca0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.142194:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1aca0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.142210:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200940.142217:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200940.142219:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788200940.142813:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.142821:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012988d5d/0x96d0c9b8c9a1aca7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.142832:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ff:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.142837:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.142842:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012988d5d/0x96d0c9b8c9a1aca7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.142853:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012988d5d/0x96d0c9b8c9a1aca7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.142861:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012988d5d/0x96d0c9b8c9a1aca7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.142870:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012988d5d/0x96d0c9b8c9a1aca7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.142889:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788200940.142938:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.142943:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094e5585b/0x96d0c9b8c9a1acae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.142951:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fe:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.142954:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.142959:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094e5585b/0x96d0c9b8c9a1acae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.142976:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094e5585b/0x96d0c9b8c9a1acae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.142984:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094e5585b/0x96d0c9b8c9a1acae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.142992:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094e5585b/0x96d0c9b8c9a1acae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.143044:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788200940.144883:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.144896:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a534e104/0x96d0c9b8c9a1acb5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.144913:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fd:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.144918:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.144925:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a534e104/0x96d0c9b8c9a1acb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.144939:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a534e104/0x96d0c9b8c9a1acb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.144949:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a534e104/0x96d0c9b8c9a1acb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.144973:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a534e104/0x96d0c9b8c9a1acb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.145097:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788200940.145169:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.145174:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004194fab/0x96d0c9b8c9a1acbc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.145204:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fc:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.145209:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.145213:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004194fab/0x96d0c9b8c9a1acbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.145224:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004194fab/0x96d0c9b8c9a1acbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.145232:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004194fab/0x96d0c9b8c9a1acbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.145239:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004194fab/0x96d0c9b8c9a1acbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1788200940.145313:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788200940.151934:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788200940.151958:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012988d5d/0x96d0c9b8c9a1aca7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.151977:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2d400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200940.151983:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012988d5d/0x96d0c9b8c9a1aca7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.151998:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012988d5d/0x96d0c9b8c9a1aca7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.152044:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012988d5d/0x96d0c9b8c9a1aca7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.152064:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012988d5d/0x96d0c9b8c9a1aca7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.152107:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788200940.152112:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094e5585b/0x96d0c9b8c9a1acae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.152119:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2d200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200940.152123:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094e5585b/0x96d0c9b8c9a1acae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.152131:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094e5585b/0x96d0c9b8c9a1acae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.152169:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094e5585b/0x96d0c9b8c9a1acae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.152178:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094e5585b/0x96d0c9b8c9a1acae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.152194:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788200940.152198:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a534e104/0x96d0c9b8c9a1acb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.152207:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2c600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200940.152210:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a534e104/0x96d0c9b8c9a1acb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.152219:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a534e104/0x96d0c9b8c9a1acb5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.152229:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a534e104/0x96d0c9b8c9a1acb5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.152236:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a534e104/0x96d0c9b8c9a1acb5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.152249:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200940.152253:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004194fab/0x96d0c9b8c9a1acbc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.152266:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2c400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200940.152269:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004194fab/0x96d0c9b8c9a1acbc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.152278:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004194fab/0x96d0c9b8c9a1acbc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.152290:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004194fab/0x96d0c9b8c9a1acbc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.152299:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200940.152301:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200940.152303:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200940.153061:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788200940.153074:0:26209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004194fab/0x96d0c9b8c9a1acbc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788200940.153253:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.153260:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027372f9b/0x96d0c9b8c9a1acc3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153274:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fb:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.153280:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.153288:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027372f9b/0x96d0c9b8c9a1acc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153303:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027372f9b/0x96d0c9b8c9a1acc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153311:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027372f9b/0x96d0c9b8c9a1acc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153319:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027372f9b/0x96d0c9b8c9a1acc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153337:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788200940.153379:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.153385:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9ea44f/0x96d0c9b8c9a1acca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153393:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fa:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.153395:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.153406:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9ea44f/0x96d0c9b8c9a1acca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153416:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9ea44f/0x96d0c9b8c9a1acca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153425:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9ea44f/0x96d0c9b8c9a1acca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153432:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9ea44f/0x96d0c9b8c9a1acca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153441:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788200940.153486:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.153491:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc441ab6/0x96d0c9b8c9a1acd1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153499:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f9:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.153502:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.153505:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc441ab6/0x96d0c9b8c9a1acd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153513:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc441ab6/0x96d0c9b8c9a1acd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153521:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc441ab6/0x96d0c9b8c9a1acd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153604:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc441ab6/0x96d0c9b8c9a1acd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153615:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788200940.153658:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.153664:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fb5dba6/0x96d0c9b8c9a1acd8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153672:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f8:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.153675:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.153680:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fb5dba6/0x96d0c9b8c9a1acd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153689:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fb5dba6/0x96d0c9b8c9a1acd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153698:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fb5dba6/0x96d0c9b8c9a1acd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153705:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fb5dba6/0x96d0c9b8c9a1acd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153713:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788200940.153748:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.153753:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1acdf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153767:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f7:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.153769:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.153773:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1acdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153783:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1acdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153792:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1acdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153800:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1acdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153809:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788200940.153853:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.153859:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1ace6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153868:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f6:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.153871:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.153875:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1ace6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153884:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1ace6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153902:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1ace6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153910:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1ace6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153919:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1788200940.153960:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.153965:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f5d0ebe/0x96d0c9b8c9a1aced lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153974:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f5:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.153977:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.153980:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f5d0ebe/0x96d0c9b8c9a1aced lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153990:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f5d0ebe/0x96d0c9b8c9a1aced lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.153998:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f5d0ebe/0x96d0c9b8c9a1aced lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.154006:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f5d0ebe/0x96d0c9b8c9a1aced lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.154066:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1788200940.154107:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.154113:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000154502bb/0x96d0c9b8c9a1acf4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.154122:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f4:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.154125:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.154129:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000154502bb/0x96d0c9b8c9a1acf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.154138:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000154502bb/0x96d0c9b8c9a1acf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.154146:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000154502bb/0x96d0c9b8c9a1acf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.154153:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000154502bb/0x96d0c9b8c9a1acf4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.154162:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1788200940.154200:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.154205:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1acfb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.154213:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f3:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.154222:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.154227:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1acfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.154236:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1acfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.154244:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1acfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.154251:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1acfb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.154260:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:0.0:1788200940.154300:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.154305:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cb75e62/0x96d0c9b8c9a1ad02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.154312:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f2:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.154315:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.154320:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009cb75e62/0x96d0c9b8c9a1ad02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.154328:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009cb75e62/0x96d0c9b8c9a1ad02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.154337:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cb75e62/0x96d0c9b8c9a1ad02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.154352:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009cb75e62/0x96d0c9b8c9a1ad02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.154366:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:0.0:1788200940.154408:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.154414:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fca8c909/0x96d0c9b8c9a1ad09 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.154422:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f1:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.154426:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.154430:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fca8c909/0x96d0c9b8c9a1ad09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.154438:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fca8c909/0x96d0c9b8c9a1ad09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.154447:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fca8c909/0x96d0c9b8c9a1ad09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.154454:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fca8c909/0x96d0c9b8c9a1ad09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.154463:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:0.0:1788200940.154506:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.154511:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4699a99/0x96d0c9b8c9a1ad10 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.154524:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f0:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.154527:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.154532:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4699a99/0x96d0c9b8c9a1ad10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.154673:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:1.0:1788200940.154682:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027372f9b/0x96d0c9b8c9a1acc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.154692:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2c200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200940.154698:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027372f9b/0x96d0c9b8c9a1acc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.154708:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027372f9b/0x96d0c9b8c9a1acc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.154728:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027372f9b/0x96d0c9b8c9a1acc3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.154744:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027372f9b/0x96d0c9b8c9a1acc3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.154767:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:1.0:1788200940.154772:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9ea44f/0x96d0c9b8c9a1acca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.154779:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2d000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200940.154783:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9ea44f/0x96d0c9b8c9a1acca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.154791:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9ea44f/0x96d0c9b8c9a1acca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.154802:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9ea44f/0x96d0c9b8c9a1acca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.154810:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9ea44f/0x96d0c9b8c9a1acca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.154823:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1788200940.154827:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc441ab6/0x96d0c9b8c9a1acd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.154833:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2c000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200940.154842:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc441ab6/0x96d0c9b8c9a1acd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.154850:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc441ab6/0x96d0c9b8c9a1acd1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.154860:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc441ab6/0x96d0c9b8c9a1acd1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.154867:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc441ab6/0x96d0c9b8c9a1acd1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.154881:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788200940.154884:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fb5dba6/0x96d0c9b8c9a1acd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.154891:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2ca00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200940.154894:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fb5dba6/0x96d0c9b8c9a1acd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.154900:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fb5dba6/0x96d0c9b8c9a1acd8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.154910:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fb5dba6/0x96d0c9b8c9a1acd8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.154918:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fb5dba6/0x96d0c9b8c9a1acd8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.154939:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788200940.154944:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1acdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.154951:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2ce00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200940.154955:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1acdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.154963:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1acdf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.154973:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1acdf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.154981:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1acdf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.154992:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788200940.154996:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1ace6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155002:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2cc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200940.155006:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1ace6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155045:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1ace6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155065:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1ace6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155073:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1ace6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155088:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788200940.155091:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f5d0ebe/0x96d0c9b8c9a1aced lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155097:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2c800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200940.155100:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f5d0ebe/0x96d0c9b8c9a1aced lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155108:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f5d0ebe/0x96d0c9b8c9a1aced lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155119:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f5d0ebe/0x96d0c9b8c9a1aced lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155126:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f5d0ebe/0x96d0c9b8c9a1aced lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155151:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788200940.155155:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000154502bb/0x96d0c9b8c9a1acf4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155163:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2da00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200940.155166:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000154502bb/0x96d0c9b8c9a1acf4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155176:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000154502bb/0x96d0c9b8c9a1acf4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155186:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000154502bb/0x96d0c9b8c9a1acf4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155194:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000154502bb/0x96d0c9b8c9a1acf4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155204:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788200940.155208:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1acfb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155216:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2d800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200940.155220:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1acfb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155238:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1acfb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155248:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1acfb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155255:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1acfb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155268:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788200940.155271:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009cb75e62/0x96d0c9b8c9a1ad02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155278:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2de00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200940.155281:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009cb75e62/0x96d0c9b8c9a1ad02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155289:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009cb75e62/0x96d0c9b8c9a1ad02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155299:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009cb75e62/0x96d0c9b8c9a1ad02 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155307:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009cb75e62/0x96d0c9b8c9a1ad02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155334:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200940.155338:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fca8c909/0x96d0c9b8c9a1ad09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155346:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce9000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200940.155349:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fca8c909/0x96d0c9b8c9a1ad09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155358:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fca8c909/0x96d0c9b8c9a1ad09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155369:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fca8c909/0x96d0c9b8c9a1ad09 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155376:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fca8c909/0x96d0c9b8c9a1ad09 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.155388:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200940.155390:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200940.155392:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200940.155403:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200940.157177:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200940.157188:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788200940.157251:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x301:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200940.157261:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005258d08c/0x96d0c9b8c9a1ad17 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.157281:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x301:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788200940.157295:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x301:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200940.157303:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005258d08c/0x96d0c9b8c9a1ad17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.157322:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005258d08c/0x96d0c9b8c9a1ad17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.157334:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005258d08c/0x96d0c9b8c9a1ad17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.157343:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005258d08c/0x96d0c9b8c9a1ad17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.157365:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788200940.157899:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4699a99/0x96d0c9b8c9a1ad10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.157909:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4699a99/0x96d0c9b8c9a1ad10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.157917:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4699a99/0x96d0c9b8c9a1ad10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.157932:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788200940.158008:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.158030:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c3c003a/0x96d0c9b8c9a1ad1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.158040:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ef:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.158044:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.158048:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c3c003a/0x96d0c9b8c9a1ad1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.158076:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c3c003a/0x96d0c9b8c9a1ad1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.158097:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c3c003a/0x96d0c9b8c9a1ad1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.158104:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c3c003a/0x96d0c9b8c9a1ad1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.158120:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788200940.158167:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.158173:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d0f7a8f/0x96d0c9b8c9a1ad25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.158182:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ee:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.158185:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.158190:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d0f7a8f/0x96d0c9b8c9a1ad25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.158199:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d0f7a8f/0x96d0c9b8c9a1ad25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.158208:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d0f7a8f/0x96d0c9b8c9a1ad25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.158217:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d0f7a8f/0x96d0c9b8c9a1ad25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.158242:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788200940.158288:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.158293:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028224086/0x96d0c9b8c9a1ad2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.158302:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ed:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.158305:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.158309:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028224086/0x96d0c9b8c9a1ad2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.158319:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028224086/0x96d0c9b8c9a1ad2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.158327:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028224086/0x96d0c9b8c9a1ad2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.158336:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028224086/0x96d0c9b8c9a1ad2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.158345:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788200940.158384:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.158389:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000669d6cf6/0x96d0c9b8c9a1ad33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.158397:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ec:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.158405:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.158409:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000669d6cf6/0x96d0c9b8c9a1ad33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.158418:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000669d6cf6/0x96d0c9b8c9a1ad33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.158427:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000669d6cf6/0x96d0c9b8c9a1ad33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.158434:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000669d6cf6/0x96d0c9b8c9a1ad33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.158442:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1788200940.158485:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.158491:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bb224c1/0x96d0c9b8c9a1ad3a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.158500:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2eb:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.158503:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.158508:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bb224c1/0x96d0c9b8c9a1ad3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.158517:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bb224c1/0x96d0c9b8c9a1ad3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.158525:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bb224c1/0x96d0c9b8c9a1ad3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.159439:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788200940.159451:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005258d08c/0x96d0c9b8c9a1ad17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.159466:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6d000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200940.159471:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005258d08c/0x96d0c9b8c9a1ad17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.159481:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005258d08c/0x96d0c9b8c9a1ad17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.159505:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005258d08c/0x96d0c9b8c9a1ad17 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.159526:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005258d08c/0x96d0c9b8c9a1ad17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.159651:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788200940.159659:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4699a99/0x96d0c9b8c9a1ad10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.159666:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140758400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200940.159677:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4699a99/0x96d0c9b8c9a1ad10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.159685:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4699a99/0x96d0c9b8c9a1ad10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.159699:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4699a99/0x96d0c9b8c9a1ad10 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.159706:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4699a99/0x96d0c9b8c9a1ad10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.159729:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788200940.159733:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c3c003a/0x96d0c9b8c9a1ad1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.159740:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140758200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200940.159743:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c3c003a/0x96d0c9b8c9a1ad1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.159750:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c3c003a/0x96d0c9b8c9a1ad1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.159760:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c3c003a/0x96d0c9b8c9a1ad1e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.159766:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c3c003a/0x96d0c9b8c9a1ad1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.159786:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788200940.159790:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d0f7a8f/0x96d0c9b8c9a1ad25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.159797:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140758600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200940.159800:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d0f7a8f/0x96d0c9b8c9a1ad25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.159810:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d0f7a8f/0x96d0c9b8c9a1ad25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.159821:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d0f7a8f/0x96d0c9b8c9a1ad25 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.159829:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d0f7a8f/0x96d0c9b8c9a1ad25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.159840:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788200940.159844:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028224086/0x96d0c9b8c9a1ad2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.159850:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140759e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200940.159854:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028224086/0x96d0c9b8c9a1ad2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.159874:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028224086/0x96d0c9b8c9a1ad2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.159884:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028224086/0x96d0c9b8c9a1ad2c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.159891:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028224086/0x96d0c9b8c9a1ad2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.159906:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200940.159910:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000669d6cf6/0x96d0c9b8c9a1ad33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.159917:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140758800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788200940.159920:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000669d6cf6/0x96d0c9b8c9a1ad33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.159928:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000669d6cf6/0x96d0c9b8c9a1ad33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.159938:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000669d6cf6/0x96d0c9b8c9a1ad33 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.159947:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000669d6cf6/0x96d0c9b8c9a1ad33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200940.159972:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200940.159974:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200940.159976:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200940.159985:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200940.160717:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200940.160721:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200940.160723:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200940.160734:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788200940.160911:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x300:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200940.160921:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032bc5d6a/0x96d0c9b8c9a1ad41 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.160937:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x300:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788200940.160942:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x300:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200940.160950:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032bc5d6a/0x96d0c9b8c9a1ad41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.160964:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032bc5d6a/0x96d0c9b8c9a1ad41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.160974:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032bc5d6a/0x96d0c9b8c9a1ad41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.160982:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032bc5d6a/0x96d0c9b8c9a1ad41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.161004:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788200940.161048:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200940.161066:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032bc5d6a/0x96d0c9b8c9a1ad41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.161075:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6c600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200940.161079:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032bc5d6a/0x96d0c9b8c9a1ad41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.161088:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032bc5d6a/0x96d0c9b8c9a1ad41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.161103:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032bc5d6a/0x96d0c9b8c9a1ad41 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.161111:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032bc5d6a/0x96d0c9b8c9a1ad41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.161123:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200940.161125:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200940.161127:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788200940.161254:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200940.161259:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbdd92a8/0x96d0c9b8c9a1ad48 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.161268:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ff:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788200940.161271:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200940.161276:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbdd92a8/0x96d0c9b8c9a1ad48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.161298:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbdd92a8/0x96d0c9b8c9a1ad48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.161307:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbdd92a8/0x96d0c9b8c9a1ad48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.161315:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbdd92a8/0x96d0c9b8c9a1ad48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.161343:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788200940.161352:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200940.161357:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbdd92a8/0x96d0c9b8c9a1ad48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.161365:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6ca00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200940.161369:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbdd92a8/0x96d0c9b8c9a1ad48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.161376:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbdd92a8/0x96d0c9b8c9a1ad48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.161388:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbdd92a8/0x96d0c9b8c9a1ad48 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.161395:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbdd92a8/0x96d0c9b8c9a1ad48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.161415:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200940.161417:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200940.161419:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200940.161730:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009bb224c1/0x96d0c9b8c9a1ad3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.161766:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788200940.161844:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.161850:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026b216d1/0x96d0c9b8c9a1ad4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.161859:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ea:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.161863:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.161868:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026b216d1/0x96d0c9b8c9a1ad4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.161878:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026b216d1/0x96d0c9b8c9a1ad4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.161886:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026b216d1/0x96d0c9b8c9a1ad4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.161894:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026b216d1/0x96d0c9b8c9a1ad4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.161909:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788200940.161952:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.161957:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b75f5ab/0x96d0c9b8c9a1ad56 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.161972:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e9:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.161974:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.161978:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b75f5ab/0x96d0c9b8c9a1ad56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.161987:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b75f5ab/0x96d0c9b8c9a1ad56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.161993:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b75f5ab/0x96d0c9b8c9a1ad56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.162000:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b75f5ab/0x96d0c9b8c9a1ad56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.162013:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788200940.165225:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788200940.165246:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009bb224c1/0x96d0c9b8c9a1ad3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.165264:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140759200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200940.165270:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009bb224c1/0x96d0c9b8c9a1ad3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.165284:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009bb224c1/0x96d0c9b8c9a1ad3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.165314:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009bb224c1/0x96d0c9b8c9a1ad3a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.165323:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bb224c1/0x96d0c9b8c9a1ad3a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.165358:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788200940.165363:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026b216d1/0x96d0c9b8c9a1ad4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.165370:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140758000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200940.165386:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026b216d1/0x96d0c9b8c9a1ad4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.165394:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026b216d1/0x96d0c9b8c9a1ad4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.165405:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026b216d1/0x96d0c9b8c9a1ad4f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.165412:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026b216d1/0x96d0c9b8c9a1ad4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.165428:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200940.165433:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b75f5ab/0x96d0c9b8c9a1ad56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.165439:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140759400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200940.165442:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b75f5ab/0x96d0c9b8c9a1ad56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.165450:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b75f5ab/0x96d0c9b8c9a1ad56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.165461:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b75f5ab/0x96d0c9b8c9a1ad56 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.165468:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b75f5ab/0x96d0c9b8c9a1ad56 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.165491:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200940.165493:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200940.165495:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200940.165601:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200940.165608:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788200940.165788:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788200940.165796:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a316510/0x96d0c9b8c9a1ad5d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.165810:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fe:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:2.0:1788200940.165815:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788200940.165823:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a316510/0x96d0c9b8c9a1ad5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.165838:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a316510/0x96d0c9b8c9a1ad5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.165848:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a316510/0x96d0c9b8c9a1ad5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.165857:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a316510/0x96d0c9b8c9a1ad5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.165883:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788200940.165893:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200940.165898:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a316510/0x96d0c9b8c9a1ad5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.165911:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6da00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200940.165914:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a316510/0x96d0c9b8c9a1ad5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.165921:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a316510/0x96d0c9b8c9a1ad5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.165932:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a316510/0x96d0c9b8c9a1ad5d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.165940:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a316510/0x96d0c9b8c9a1ad5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.165957:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200940.165958:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200940.165960:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788200940.170308:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.170325:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025c036ed/0x96d0c9b8c9a1ad64 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170347:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e8:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.170352:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.170360:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025c036ed/0x96d0c9b8c9a1ad64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170376:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025c036ed/0x96d0c9b8c9a1ad64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170414:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025c036ed/0x96d0c9b8c9a1ad64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170423:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025c036ed/0x96d0c9b8c9a1ad64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170462:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788200940.170525:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.170530:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006849ec2c/0x96d0c9b8c9a1ad6b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170539:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e7:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.170542:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.170546:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006849ec2c/0x96d0c9b8c9a1ad6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170556:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006849ec2c/0x96d0c9b8c9a1ad6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170564:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006849ec2c/0x96d0c9b8c9a1ad6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170572:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006849ec2c/0x96d0c9b8c9a1ad6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170609:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788200940.170648:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.170653:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054dc1ce6/0x96d0c9b8c9a1ad72 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170661:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e6:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.170664:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.170668:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054dc1ce6/0x96d0c9b8c9a1ad72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170677:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054dc1ce6/0x96d0c9b8c9a1ad72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170685:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054dc1ce6/0x96d0c9b8c9a1ad72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170693:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054dc1ce6/0x96d0c9b8c9a1ad72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170707:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788200940.170740:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.170744:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f20bb7b1/0x96d0c9b8c9a1ad79 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170751:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e5:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.170759:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.170764:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f20bb7b1/0x96d0c9b8c9a1ad79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170773:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f20bb7b1/0x96d0c9b8c9a1ad79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170782:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f20bb7b1/0x96d0c9b8c9a1ad79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170789:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f20bb7b1/0x96d0c9b8c9a1ad79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170802:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788200940.170837:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.170842:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2f6aaa8/0x96d0c9b8c9a1ad80 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170848:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e4:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.170850:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.170854:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2f6aaa8/0x96d0c9b8c9a1ad80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170862:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2f6aaa8/0x96d0c9b8c9a1ad80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170870:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2f6aaa8/0x96d0c9b8c9a1ad80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170884:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2f6aaa8/0x96d0c9b8c9a1ad80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170893:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788200940.170933:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.170938:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd87944c/0x96d0c9b8c9a1ad87 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170945:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e3:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.170948:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.170952:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd87944c/0x96d0c9b8c9a1ad87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170960:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd87944c/0x96d0c9b8c9a1ad87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170968:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd87944c/0x96d0c9b8c9a1ad87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170976:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd87944c/0x96d0c9b8c9a1ad87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.170985:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1788200940.171049:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788200940.171065:0:26209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088df804f/0x96d0c9b8c9a1ad8e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.171078:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e2:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1788200940.171082:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788200940.171086:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088df804f/0x96d0c9b8c9a1ad8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.171094:0:26209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088df804f/0x96d0c9b8c9a1ad8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.171102:0:26209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088df804f/0x96d0c9b8c9a1ad8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.171109:0:26209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088df804f/0x96d0c9b8c9a1ad8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200940.171118:0:26209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:2.0:1788200940.173433:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788200940.173449:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025c036ed/0x96d0c9b8c9a1ad64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173464:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140759000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200940.173470:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025c036ed/0x96d0c9b8c9a1ad64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173481:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025c036ed/0x96d0c9b8c9a1ad64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173514:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025c036ed/0x96d0c9b8c9a1ad64 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173522:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025c036ed/0x96d0c9b8c9a1ad64 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173549:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788200940.173553:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006849ec2c/0x96d0c9b8c9a1ad6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173560:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140758e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200940.173563:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006849ec2c/0x96d0c9b8c9a1ad6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173571:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006849ec2c/0x96d0c9b8c9a1ad6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173581:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006849ec2c/0x96d0c9b8c9a1ad6b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173589:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006849ec2c/0x96d0c9b8c9a1ad6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173603:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788200940.173607:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054dc1ce6/0x96d0c9b8c9a1ad72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173620:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140759800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200940.173623:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054dc1ce6/0x96d0c9b8c9a1ad72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173631:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054dc1ce6/0x96d0c9b8c9a1ad72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173642:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054dc1ce6/0x96d0c9b8c9a1ad72 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173648:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054dc1ce6/0x96d0c9b8c9a1ad72 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173661:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788200940.173664:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f20bb7b1/0x96d0c9b8c9a1ad79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173670:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140758c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200940.173673:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f20bb7b1/0x96d0c9b8c9a1ad79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173679:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f20bb7b1/0x96d0c9b8c9a1ad79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173688:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f20bb7b1/0x96d0c9b8c9a1ad79 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173700:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f20bb7b1/0x96d0c9b8c9a1ad79 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173713:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788200940.173717:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2f6aaa8/0x96d0c9b8c9a1ad80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173724:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140758a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200940.173727:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2f6aaa8/0x96d0c9b8c9a1ad80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173735:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2f6aaa8/0x96d0c9b8c9a1ad80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173745:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2f6aaa8/0x96d0c9b8c9a1ad80 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173752:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2f6aaa8/0x96d0c9b8c9a1ad80 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173764:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788200940.173769:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd87944c/0x96d0c9b8c9a1ad87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173775:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140759600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200940.173784:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd87944c/0x96d0c9b8c9a1ad87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173792:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd87944c/0x96d0c9b8c9a1ad87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173802:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd87944c/0x96d0c9b8c9a1ad87 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173809:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd87944c/0x96d0c9b8c9a1ad87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173823:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200940.173826:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088df804f/0x96d0c9b8c9a1ad8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173832:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140759a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788200940.173835:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088df804f/0x96d0c9b8c9a1ad8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173843:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088df804f/0x96d0c9b8c9a1ad8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173852:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088df804f/0x96d0c9b8c9a1ad8e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173859:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088df804f/0x96d0c9b8c9a1ad8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200940.173879:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200940.173881:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200940.173883:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200940.173894:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200940.173902:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788200940.173962:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788200940.174157:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788200940.178921:0:26209:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:176 00000100:00100000:0.0:1788200940.179108:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:87190:x1875060715075072:12345-0@lo:5:osp-pre-0-0.0 Request processed in 44285us (44444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200940.179122:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5866 00000100:00100000:0.0:1788200940.179208:0:87190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87190:1875060715075072:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788200940.179228:0:87190:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x301:0x0] from OST, last_created [0x280000401:0x301:0x0]last_used is [0x280000401:0xb0:0x0] 00000100:00100000:0.0:1788200940.179311:0:87190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87190:1875060715075456:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788200940.179353:0:87190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200940.179388:0:87190:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007486780 going to sleep for 11 seconds 00000100:00100000:0.0:1788200940.179419:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715075328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788200940.179448:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200940.179495:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715075456 00000100:00100000:0.0:1788200940.179503:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715075456 00000100:00100000:0.0:1788200940.179550:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5868 00000100:00100000:0.0:1788200940.179561:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:87190:x1875060715075456:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788200940.179610:0:26212:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 770 00002000:00010000:3.0:1788200940.181998:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.182037:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090d8cd0e/0x96d0c9b8c9a1ad95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182071:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fd:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.182078:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.182086:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090d8cd0e/0x96d0c9b8c9a1ad95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182106:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090d8cd0e/0x96d0c9b8c9a1ad95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182119:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090d8cd0e/0x96d0c9b8c9a1ad95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182129:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090d8cd0e/0x96d0c9b8c9a1ad95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182166:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200940.182182:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.182190:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090d8cd0e/0x96d0c9b8c9a1ad95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182198:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fde00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.182204:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090d8cd0e/0x96d0c9b8c9a1ad95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182231:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090d8cd0e/0x96d0c9b8c9a1ad95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182253:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090d8cd0e/0x96d0c9b8c9a1ad95 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182261:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090d8cd0e/0x96d0c9b8c9a1ad95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182282:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.182284:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.182285:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200940.182353:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.182360:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5135343/0x96d0c9b8c9a1ad9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182369:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fc:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.182372:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.182377:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5135343/0x96d0c9b8c9a1ad9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182386:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5135343/0x96d0c9b8c9a1ad9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182394:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5135343/0x96d0c9b8c9a1ad9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182408:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5135343/0x96d0c9b8c9a1ad9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182424:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200940.182433:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.182438:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5135343/0x96d0c9b8c9a1ad9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182446:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fc200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.182449:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5135343/0x96d0c9b8c9a1ad9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182458:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5135343/0x96d0c9b8c9a1ad9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182469:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5135343/0x96d0c9b8c9a1ad9c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182476:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5135343/0x96d0c9b8c9a1ad9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182489:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.182490:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.182492:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200940.182540:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.182551:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032c6723a/0x96d0c9b8c9a1ada3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182558:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fb:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.182562:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.182565:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032c6723a/0x96d0c9b8c9a1ada3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182574:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032c6723a/0x96d0c9b8c9a1ada3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182582:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032c6723a/0x96d0c9b8c9a1ada3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182588:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032c6723a/0x96d0c9b8c9a1ada3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182601:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200940.182608:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.182612:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032c6723a/0x96d0c9b8c9a1ada3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182620:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.182624:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032c6723a/0x96d0c9b8c9a1ada3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182631:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032c6723a/0x96d0c9b8c9a1ada3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182649:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032c6723a/0x96d0c9b8c9a1ada3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182656:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032c6723a/0x96d0c9b8c9a1ada3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182669:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.182670:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.182672:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200940.182715:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.182720:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2d043ef/0x96d0c9b8c9a1adaa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182727:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fa:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.182730:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.182734:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2d043ef/0x96d0c9b8c9a1adaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182742:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2d043ef/0x96d0c9b8c9a1adaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182750:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2d043ef/0x96d0c9b8c9a1adaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182758:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2d043ef/0x96d0c9b8c9a1adaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182785:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200940.182793:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.182798:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2d043ef/0x96d0c9b8c9a1adaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182806:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fca00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.182809:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2d043ef/0x96d0c9b8c9a1adaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182817:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2d043ef/0x96d0c9b8c9a1adaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182829:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2d043ef/0x96d0c9b8c9a1adaa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182836:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2d043ef/0x96d0c9b8c9a1adaa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182849:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.182851:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.182853:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200940.182897:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.182903:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1adb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182911:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f9:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.182919:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.182924:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1adb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182933:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1adb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182941:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1adb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182948:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1adb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182961:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200940.182968:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.182972:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1adb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182978:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fc600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.182982:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1adb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.182990:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1adb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183001:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1adb1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183070:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1adb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183085:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.183086:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.183088:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200940.183154:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.183160:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000911ffc6c/0x96d0c9b8c9a1adb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183169:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f8:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.183173:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.183176:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000911ffc6c/0x96d0c9b8c9a1adb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183187:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000911ffc6c/0x96d0c9b8c9a1adb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183194:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000911ffc6c/0x96d0c9b8c9a1adb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183201:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000911ffc6c/0x96d0c9b8c9a1adb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183214:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200940.183228:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.183232:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000911ffc6c/0x96d0c9b8c9a1adb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183239:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fc400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.183242:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000911ffc6c/0x96d0c9b8c9a1adb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183250:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000911ffc6c/0x96d0c9b8c9a1adb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183260:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000911ffc6c/0x96d0c9b8c9a1adb8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183267:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000911ffc6c/0x96d0c9b8c9a1adb8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183280:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.183281:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.183283:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200940.183329:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.183334:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f3a753/0x96d0c9b8c9a1adbf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183342:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f7:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.183344:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.183348:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087f3a753/0x96d0c9b8c9a1adbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183368:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087f3a753/0x96d0c9b8c9a1adbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183375:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f3a753/0x96d0c9b8c9a1adbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183384:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087f3a753/0x96d0c9b8c9a1adbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183397:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200940.183404:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.183407:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087f3a753/0x96d0c9b8c9a1adbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183413:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.183417:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f3a753/0x96d0c9b8c9a1adbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183425:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f3a753/0x96d0c9b8c9a1adbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183435:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087f3a753/0x96d0c9b8c9a1adbf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183443:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087f3a753/0x96d0c9b8c9a1adbf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183463:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.183465:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.183467:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200940.183510:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.183516:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f7ba23f/0x96d0c9b8c9a1adc6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183524:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f6:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.183528:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.183532:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f7ba23f/0x96d0c9b8c9a1adc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183541:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f7ba23f/0x96d0c9b8c9a1adc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183549:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f7ba23f/0x96d0c9b8c9a1adc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183556:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f7ba23f/0x96d0c9b8c9a1adc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183569:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200940.183576:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.183580:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f7ba23f/0x96d0c9b8c9a1adc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183599:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782ca00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.183603:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f7ba23f/0x96d0c9b8c9a1adc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183611:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f7ba23f/0x96d0c9b8c9a1adc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183623:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f7ba23f/0x96d0c9b8c9a1adc6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183631:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f7ba23f/0x96d0c9b8c9a1adc6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183644:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.183645:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.183647:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200940.183693:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.183699:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007f42006/0x96d0c9b8c9a1adcd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183707:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f5:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.183710:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.183715:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007f42006/0x96d0c9b8c9a1adcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183725:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007f42006/0x96d0c9b8c9a1adcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183740:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007f42006/0x96d0c9b8c9a1adcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183747:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007f42006/0x96d0c9b8c9a1adcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183760:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200940.183767:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.183771:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007f42006/0x96d0c9b8c9a1adcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183778:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.183781:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007f42006/0x96d0c9b8c9a1adcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183789:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007f42006/0x96d0c9b8c9a1adcd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183800:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007f42006/0x96d0c9b8c9a1adcd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183808:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007f42006/0x96d0c9b8c9a1adcd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183821:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.183828:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.183830:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200940.183876:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.183882:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034a08521/0x96d0c9b8c9a1add4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183890:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f4:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.183893:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.183897:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034a08521/0x96d0c9b8c9a1add4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183906:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034a08521/0x96d0c9b8c9a1add4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183914:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034a08521/0x96d0c9b8c9a1add4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183921:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034a08521/0x96d0c9b8c9a1add4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183935:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200940.183941:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.183945:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034a08521/0x96d0c9b8c9a1add4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183951:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.183955:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034a08521/0x96d0c9b8c9a1add4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183973:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034a08521/0x96d0c9b8c9a1add4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183984:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034a08521/0x96d0c9b8c9a1add4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.183992:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034a08521/0x96d0c9b8c9a1add4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184006:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.184007:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.184009:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200940.184090:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.184096:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008581f318/0x96d0c9b8c9a1addb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184104:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f3:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.184107:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.184112:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008581f318/0x96d0c9b8c9a1addb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184121:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008581f318/0x96d0c9b8c9a1addb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184129:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008581f318/0x96d0c9b8c9a1addb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184143:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008581f318/0x96d0c9b8c9a1addb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184156:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200940.184163:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.184166:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008581f318/0x96d0c9b8c9a1addb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184173:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782ce00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.184176:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008581f318/0x96d0c9b8c9a1addb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184184:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008581f318/0x96d0c9b8c9a1addb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184194:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008581f318/0x96d0c9b8c9a1addb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184200:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008581f318/0x96d0c9b8c9a1addb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184213:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.184214:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.184216:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200940.184261:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.184272:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1ade2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184281:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f2:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.184284:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.184288:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1ade2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184297:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1ade2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184305:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1ade2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184312:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1ade2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184326:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200940.184334:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.184338:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1ade2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184345:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782dc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.184348:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1ade2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184356:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1ade2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184374:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1ade2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184383:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1ade2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184397:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.184399:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.184401:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200940.184443:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.184448:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1ade9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184456:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f1:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.184460:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.184465:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1ade9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184474:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1ade9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184482:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1ade9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184489:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1ade9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184513:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200940.184520:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.184523:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1ade9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184530:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.184534:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1ade9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184542:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1ade9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184554:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1ade9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184561:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1ade9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184573:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.184575:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.184577:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200940.184619:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.184624:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1adf0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184632:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f0:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.184641:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.184645:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1adf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184655:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1adf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184662:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1adf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184669:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1adf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184682:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200940.184689:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.184693:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1adf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184700:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782de00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.184703:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1adf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184710:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1adf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184721:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1adf0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184741:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1adf0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184755:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.184757:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.184759:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200940.184804:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.184810:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1adf7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184819:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ef:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.184822:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.184826:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1adf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184835:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1adf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184843:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1adf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184850:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1adf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184862:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200940.184874:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.184878:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1adf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184886:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.184890:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1adf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184898:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1adf7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184908:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1adf7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184916:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1adf7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184930:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.184932:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.184934:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200940.184979:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.184984:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1adfe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.184991:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ee:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.184994:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.184998:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1adfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.185043:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1adfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200940.189777:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:87190:x1875060715075456:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10205us (10412us total) trans 4294969450 rc 0/0 00000100:00100000:0.0:1788200940.189793:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5868 00000100:00100000:0.0:1788200940.189858:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715075328 00000100:00100000:0.0:1788200940.189870:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715075328 00000100:00100000:0.0:1788200940.189922:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2132 00000100:00100000:0.0:1788200940.189931:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715075328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788200940.189963:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200940.190005:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715075328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (10555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200940.190012:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2132 00000100:00100000:0.0:1788200940.190149:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715075328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788200940.190197:0:87190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87190:1875060715075456:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788200940.190213:0:87190:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x301:0x0]-[0x280000401:0x321:0x0] 00010000:00010000:3.0:1788200940.190524:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1adfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.190547:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1adfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.190580:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788200940.190706:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.190713:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1ae05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.190727:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ed:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.190732:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.190739:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1ae05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.190754:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1ae05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.190763:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1ae05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.190793:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1ae05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.190810:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788200940.190823:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788200940.190829:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1adfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.190838:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.190843:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1adfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.190854:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1adfe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.190874:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1adfe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.190882:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1adfe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.190905:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.190908:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1ae05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.190927:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.190930:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1ae05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.190938:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1ae05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.190948:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1ae05 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.190955:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1ae05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.190968:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.190970:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.190971:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200940.191046:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.191062:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1ae0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191071:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ec:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.191074:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.191078:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1ae0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191088:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1ae0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191104:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1ae0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191111:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1ae0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191126:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200940.191134:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.191138:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1ae0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191145:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782cc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.191148:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1ae0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191156:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1ae0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191167:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1ae0c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191174:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1ae0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191190:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.191198:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.191200:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200940.191245:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.191251:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1ae13 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191259:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2eb:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.191263:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.191267:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1ae13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191276:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1ae13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191284:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1ae13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191292:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1ae13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191307:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200940.191314:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.191318:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1ae13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191325:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.191328:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1ae13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191347:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1ae13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191357:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1ae13 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191365:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1ae13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191378:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.191380:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.191382:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200940.191427:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.191432:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1ae1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191439:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ea:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.191443:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.191446:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1ae1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191454:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1ae1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191461:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1ae1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191475:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1ae1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191487:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200940.191493:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.191496:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1ae1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191503:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.191506:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1ae1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191514:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1ae1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191525:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1ae1a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191532:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1ae1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191545:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.191547:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.191549:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200940.191589:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.191600:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1ae21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191609:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e9:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.191612:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.191616:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1ae21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191626:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1ae21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191633:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1ae21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191640:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1ae21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191653:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200940.191659:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.191663:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1ae21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191670:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782da00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.191674:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1ae21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191681:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1ae21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191699:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1ae21 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191705:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1ae21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191718:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.191720:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.191722:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200940.191765:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.191770:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1ae28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191778:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e8:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.191780:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.191784:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1ae28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191794:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1ae28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191802:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1ae28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191809:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1ae28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191832:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200940.191839:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.191843:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1ae28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191850:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.191854:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1ae28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191862:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1ae28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191873:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1ae28 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191881:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1ae28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191894:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.191896:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.191898:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200940.191943:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.191949:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1ae2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191956:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e7:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.191964:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.191969:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1ae2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191979:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1ae2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191987:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1ae2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.191995:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1ae2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192008:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200940.192037:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.192041:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1ae2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192048:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ece00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.192062:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1ae2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192070:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1ae2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192082:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1ae2f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192099:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1ae2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192114:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.192116:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.192118:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200940.192163:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.192168:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1ae36 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192177:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e6:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.192180:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.192184:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1ae36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192193:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1ae36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192201:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1ae36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192208:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1ae36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192222:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200940.192235:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.192239:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1ae36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192246:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064eca00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.192249:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1ae36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192258:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1ae36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192268:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1ae36 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192276:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1ae36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192289:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.192291:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.192293:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200940.192334:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.192339:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1ae3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192347:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e5:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.192351:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.192355:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1ae3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192375:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1ae3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192384:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1ae3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192392:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1ae3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192405:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200940.192413:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.192417:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1ae3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192424:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064edc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.192427:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1ae3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192437:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1ae3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192447:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1ae3d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192454:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1ae3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192474:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.192476:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.192478:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200940.192523:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.192528:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1ae44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192536:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e4:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.192539:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.192543:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1ae44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192552:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1ae44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192559:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1ae44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192566:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1ae44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192579:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200940.192585:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.192589:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1ae44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192606:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.192609:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1ae44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192617:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1ae44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192628:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1ae44 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192636:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1ae44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192649:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.192651:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.192652:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200940.192698:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.192704:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae91ee5a/0x96d0c9b8c9a1ae4b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192712:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e3:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.192715:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.192719:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae91ee5a/0x96d0c9b8c9a1ae4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192728:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae91ee5a/0x96d0c9b8c9a1ae4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192741:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae91ee5a/0x96d0c9b8c9a1ae4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192748:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae91ee5a/0x96d0c9b8c9a1ae4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192761:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200940.192768:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.192771:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae91ee5a/0x96d0c9b8c9a1ae4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192778:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.192781:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae91ee5a/0x96d0c9b8c9a1ae4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192788:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae91ee5a/0x96d0c9b8c9a1ae4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192799:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae91ee5a/0x96d0c9b8c9a1ae4b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192806:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae91ee5a/0x96d0c9b8c9a1ae4b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192820:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.192827:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.192829:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788200940.192874:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788200940.192879:0:23974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1ae52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192887:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e2:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:3.0:1788200940.192890:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788200940.192895:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1ae52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192904:0:23974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1ae52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192911:0:23974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1ae52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192918:0:23974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1ae52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192931:0:23974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200940.192938:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788200940.192941:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1ae52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192948:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788200940.192951:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1ae52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192969:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1ae52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192980:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1ae52 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.192988:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1ae52 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200940.193003:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.193005:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200940.193006:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788200940.193511:0:23974:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:674 00000100:00100000:3.0:1788200940.193641:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:87192:x1875060715075200:12345-0@lo:5:osp-pre-1-0.0 Request processed in 57080us (57222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200940.193652:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5867 00000100:00100000:3.0:1788200940.193720:0:87192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87192:1875060715075200:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788200940.193739:0:87192:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x301:0x0] from OST, last_created [0x2c0000401:0x301:0x0]last_used is [0x2c0000401:0x2a2:0x0] 00000100:00100000:3.0:1788200940.193825:0:87192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8d9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87192:1875060715075712:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788200940.193867:0:87192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200940.193894:0:87192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10304fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788200940.193915:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715075584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788200940.193944:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200940.193993:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715075712 00000100:00100000:3.0:1788200940.194009:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715075712 00010000:00010000:0.0:1788200940.197177:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788200940.198281:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5869 00000100:00100000:3.0:1788200940.198309:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:87192:x1875060715075712:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788200940.198375:0:26210:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 770 00000100:00100000:3.0:1788200940.200287:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:87192:x1875060715075712:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1985us (6411us total) trans 4294969450 rc 0/0 00000100:00100000:3.0:1788200940.200302:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5869 00000100:00100000:3.0:1788200940.203859:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715075584 00000100:00100000:3.0:1788200940.203881:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715075584 00000100:00100000:3.0:1788200940.203965:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2133 00000100:00100000:3.0:1788200940.203979:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715075584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788200940.204033:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200940.204162:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715075584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 185us (10214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200940.204170:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2133 00000100:00100000:3.0:1788200940.204273:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715075584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788200940.204340:0:87192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8d9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87192:1875060715075712:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788200940.204354:0:87192:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x301:0x0]-[0x2c0000401:0x321:0x0] 00010000:00010000:2.0:1788200940.308183:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788200940.368488:0:75739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788200941.330077:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788200941.432740:0:87458:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788200942.351700:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788200942.688530:0:87510:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788200942.688849:0:87510:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788200942.928531:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715075840:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788200942.928607:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200942.934429:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715075840 00000100:00100000:1.0:1788200942.934445:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715075840 00000100:00100000:1.0:1788200942.934530:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2134 00000100:00100000:1.0:1788200942.934547:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715075840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788200942.934581:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200942.934671:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715075840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (6063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200942.934678:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2134 00000100:00100000:1.0:1788200942.934739:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715075840:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788200942.934811:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788200942.937280:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788200942.937303:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715075968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788200942.937374:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200942.938333:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715075968 00000100:00100000:1.0:1788200942.938345:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715075968 00000100:00100000:1.0:1788200942.938416:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2135 00000100:00100000:1.0:1788200942.938427:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715075968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788200942.938458:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200942.938516:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715075968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200942.938523:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2135 00000100:00080000:2.0:1788200942.938585:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788200942.938622:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715075968:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788200943.376195:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788200943.700159:0:87560:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788200943.700594:0:87560:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788200944.400637:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200944.977375:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715076224:0@lo:400:kworker.0 00000100:00100000:1.0:1788200944.977462:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200944.977498:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715076736:0@lo:400:kworker.0 00000100:00100000:1.0:1788200944.977524:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200944.977541:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715077248:0@lo:400:kworker.0 00000100:00100000:1.0:1788200944.977562:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200944.977587:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788200944.977593:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715076352:0@lo:400:kworker.0 00000100:00100000:1.0:1788200944.977614:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200944.977631:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715076864:0@lo:400:kworker.0 00000100:00100000:1.0:1788200944.977651:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200944.977784:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715076096:0@lo:400:kworker.0 00000100:00100000:2.0:1788200944.977820:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200944.977872:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715076608:0@lo:400:kworker.0 00000100:00100000:2.0:1788200944.977897:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200944.977913:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715077120:0@lo:400:kworker.0 00000100:00100000:2.0:1788200944.977932:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200944.977946:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715077632:0@lo:400:kworker.0 00000100:00100000:2.0:1788200944.977966:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200944.977996:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788200944.978001:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715076480:0@lo:400:kworker.0 00000100:00100000:2.0:1788200944.978072:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200944.978084:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715076992:0@lo:400:kworker.0 00000100:00100000:2.0:1788200944.978102:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200944.978115:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715077504:0@lo:400:kworker.0 00000100:00100000:2.0:1788200944.978132:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200944.978181:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715076736 00000100:00100000:2.0:1788200944.978191:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715076736 00000100:00100000:2.0:1788200944.978241:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715077248 00000100:00100000:2.0:1788200944.978248:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715077248 00000100:00100000:2.0:1788200944.978288:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3858 00000100:00100000:0.0:1788200944.978297:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715076864 00000100:00100000:2.0:1788200944.978302:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715076736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200944.978311:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715076864 00000100:00100000:2.0:1788200944.978373:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715076736:12345-0@lo:400:kworker.0 Request processed in 69us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200944.978385:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3858 00000100:00100000:0.0:1788200944.978403:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715076992 00000100:00100000:2.0:1788200944.978417:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3859 00000100:00100000:0.0:1788200944.978429:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715076992 00000100:00100000:2.0:1788200944.978436:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715077248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200944.978483:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715077504 00000100:00100000:0.0:1788200944.978488:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715077504 00000100:00100000:2.0:1788200944.978495:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715077248:12345-0@lo:400:kworker.0 Request processed in 60us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200944.978506:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3859 00000100:00100000:0.0:1788200944.978529:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632 00000100:00100000:0.0:1788200944.978541:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715076864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200944.978596:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2633 00000100:00100000:2.0:1788200944.978617:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120020e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715076992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200944.978651:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715076864:12345-0@lo:400:kworker.0 Request processed in 111us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200944.978662:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632 00000100:00100000:2.0:1788200944.978692:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120020e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715076992:12345-0@lo:400:kworker.0 Request processed in 84us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200944.978700:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2633 00000100:00100000:2.0:1788200944.978719:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2634 00000100:00100000:2.0:1788200944.978727:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715077504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200944.978769:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715077504:12345-0@lo:400:kworker.0 Request processed in 43us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200944.978775:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2634 00000100:00080000:2.0:1788200944.978793:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788200944.978799:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788200944.978819:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715076224 00000100:00100000:2.0:1788200944.978823:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715076224 00000100:00100000:2.0:1788200944.978852:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715076352 00000100:00100000:2.0:1788200944.978855:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715076352 00000100:00100000:2.0:1788200944.978867:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715076608 00000100:00100000:2.0:1788200944.978869:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715076608 00000100:00100000:2.0:1788200944.978882:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715077120 00000100:00100000:2.0:1788200944.978885:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715077120 00000100:00100000:2.0:1788200944.978894:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715077632 00000100:00100000:2.0:1788200944.978896:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715077632 00000100:00100000:2.0:1788200944.978905:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715076480 00000100:00100000:2.0:1788200944.978907:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715076480 00000100:00100000:2.0:1788200944.978922:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:2.0:1788200944.978931:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715076224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200944.978990:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715076224:12345-0@lo:400:kworker.0 Request processed in 57us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200944.978993:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:2.0:1788200944.979004:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:0.0:1788200944.979010:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715076352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200944.979066:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00100000:2.0:1788200944.979078:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715076608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200944.979091:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715076352:12345-0@lo:400:kworker.0 Request processed in 86us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200944.979096:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00100000:0.0:1788200944.979120:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:0.0:1788200944.979129:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715077120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200944.979140:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715076608:12345-0@lo:400:kworker.0 Request processed in 62us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200944.979149:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00000100:00100000:0.0:1788200944.979166:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715077120:12345-0@lo:400:kworker.0 Request processed in 39us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200944.979171:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00100000:2.0:1788200944.979183:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:0.0:1788200944.979190:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:2.0:1788200944.979198:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715077632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200944.979199:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715076480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200944.979222:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715076480:12345-0@lo:400:kworker.0 Request processed in 26us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200944.979228:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00100000:0.0:1788200944.979246:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788200944.979261:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715077632:12345-0@lo:400:kworker.0 Request processed in 68us (1291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200944.979264:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715077760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788200944.979280:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:2.0:1788200944.979312:0:87176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715076096 00000100:00100000:2.0:1788200944.979317:0:87176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715076096 00000100:00100000:0.0:1788200944.979321:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200944.979361:0:87176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788200944.979379:0:87176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715076096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200944.979423:0:87176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715076096:12345-0@lo:400:kworker.0 Request processed in 54us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200944.979433:0:87176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788200944.979469:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715076480:0@lo:400:kworker.0 00000100:00080000:2.0:1788200944.979472:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788200944.979480:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788200944.979497:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715077760 00000100:00100000:0.0:1788200944.979498:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715076992:0@lo:400:kworker.0 00000100:00100000:2.0:1788200944.979505:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715077760 00000100:00100000:0.0:1788200944.979529:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715077504:0@lo:400:kworker.0 00000100:00100000:2.0:1788200944.979540:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3860 00000100:00100000:0.0:1788200944.979544:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715076096:0@lo:400:kworker.0 00000100:00100000:2.0:1788200944.979556:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715077760:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788200944.979561:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715076608:0@lo:400:kworker.0 00000100:00100000:0.0:1788200944.979570:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715077120:0@lo:400:kworker.0 00000100:00100000:0.0:1788200944.979587:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715077632:0@lo:400:kworker.0 00000004:00000024:2.0:1788200944.979587:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:2.0:1788200944.979658:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715077760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200944.979666:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3860 00000100:00100000:2.0:1788200944.979713:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715077760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788200944.980816:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715076864:0@lo:400:kworker.0 00000100:00100000:1.0:1788200944.980953:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715077376:0@lo:400:kworker.0 00000100:00100000:1.0:1788200944.981042:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200944.981092:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715076224:0@lo:400:kworker.0 00000100:00100000:1.0:1788200944.981105:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715076736:0@lo:400:kworker.0 00000100:00100000:1.0:1788200944.981115:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715077248:0@lo:400:kworker.0 00000100:00100000:1.0:1788200944.981148:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715076352:0@lo:400:kworker.0 00000100:00100000:3.0:1788200944.981292:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715077376 00000100:00100000:3.0:1788200944.981299:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715077376 00000100:00100000:3.0:1788200944.981380:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2635 00000100:00100000:3.0:1788200944.981389:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715077376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200944.981445:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715077376:12345-0@lo:400:kworker.0 Request processed in 58us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200944.981451:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2635 00000100:00100000:1.0:1788200944.981768:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715077376:0@lo:400:kworker.0 00000100:00080000:2.0:1788200944.985815:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788200945.124063:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200945.124112:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200945.124141:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200945.124227:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695347584 00000100:00100000:0.0:1788200945.124239:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695347584 00000100:00100000:0.0:1788200945.124303:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695347712 00000100:00100000:0.0:1788200945.124306:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695347712 00000100:00100000:0.0:1788200945.124329:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1166 00000100:00100000:0.0:1788200945.124338:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695347584:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200945.124403:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695347584:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 66us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200945.124410:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1166 00000100:00100000:0.0:1788200945.124424:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1167 00000100:00100000:0.0:1788200945.124431:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695347712:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200945.124450:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695347712:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 20us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200945.124455:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1167 00000100:00100000:3.0:1788200945.124581:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695347456 00000100:00100000:3.0:1788200945.124586:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695347456 00000100:00100000:3.0:1788200945.124621:0:87178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 75 00000100:00100000:3.0:1788200945.124628:0:87178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11802fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695347456:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200945.124653:0:87178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11802fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695347456:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200945.124659:0:87178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 75 00000100:00080000:1.0:1788200945.125044:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788200945.125048:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788200945.423809:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788200945.488169:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715077888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788200945.488252:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200945.488314:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715077888 00000100:00100000:2.0:1788200945.488321:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715077888 00000100:00100000:2.0:1788200945.488383:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2136 00000100:00100000:2.0:1788200945.488393:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715077888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788200945.488422:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788200945.488478:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715077888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200945.488486:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2136 00000100:00100000:2.0:1788200945.488535:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715077888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788200945.489206:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788200945.489230:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715078016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788200945.490067:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788200945.490083:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715078144:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788200945.492994:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969450 is committed 00000100:00100000:3.0:1788200945.496388:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200945.496499:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715078144 00000100:00100000:2.0:1788200945.496510:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715078144 00000100:00100000:2.0:1788200945.496568:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2137 00000100:00100000:2.0:1788200945.496578:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715078144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788200945.496610:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788200945.496669:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715078144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200945.496677:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2137 00000100:00100000:0.0:1788200945.496713:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969450 gen 2 00000100:00100000:0.0:1788200945.496744:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715078144:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788200945.498316:0:9526:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969450 is committed 00000100:00100000:1.0:1788200945.499915:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200945.500086:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715078016 00000100:00100000:2.0:1788200945.500101:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715078016 00000100:00100000:2.0:1788200945.500167:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3861 00000100:00100000:2.0:1788200945.500177:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715078016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788200945.500215:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444970496 avail 1298731008 00000100:00100000:2.0:1788200945.500318:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715078016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200945.500326:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3861 00000100:00100000:1.0:1788200945.500483:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715078016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788200945.971441:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200945.971608:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695347840 00000100:00100000:0.0:1788200945.971619:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695347840 00000100:00100000:0.0:1788200945.971703:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1157 00000100:00100000:0.0:1788200945.971723:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:66786:x1875060695347840:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788200945.971745:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200945.971768:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759000/0x96d0c9b8c9a1ae59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7865cb expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200945.972239:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759400/0x96d0c9b8c9a1ae60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200945.972255:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759400/0x96d0c9b8c9a1ae60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200945.972269:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759400/0x96d0c9b8c9a1ae60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788200945.972323:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788200945.972327:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788200945.972369:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759400/0x96d0c9b8c9a1ae60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200945.972394:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759000/0x96d0c9b8c9a1ae59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865cb expref: 8 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200945.972413:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759400/0x96d0c9b8c9a1ae60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865cb expref: 7 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200945.972422:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a1e700) 00010000:00010000:0.0:1788200945.972438:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788200945.972442:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140759400, rc 0) 00000100:00100000:0.0:1788200945.972507:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+7:66786:x1875060695347840:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 793us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200945.972514:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1157 00000100:00100000:3.0:1788200945.980799:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200945.980933:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695347968 00000100:00100000:0.0:1788200945.980965:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695347968 00000100:00100000:0.0:1788200945.981077:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1158 00000100:00100000:0.0:1788200945.981089:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+7:66786:x1875060695347968:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:0.0:1788200945.981150:0:66312:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444970496 avail 1298731008 00000100:00100000:0.0:1788200945.981256:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+7:66786:x1875060695347968:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 169us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200945.981271:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1158 00000100:00100000:1.0:1788200945.987844:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200945.988082:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695348096 00000100:00100000:2.0:1788200945.988103:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695348096 00000100:00100000:2.0:1788200945.988197:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1159 00000100:00100000:2.0:1788200945.988209:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:66786:x1875060695348096:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:2.0:1788200945.988269:0:66757:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:2.0:1788200945.988372:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:66786:x1875060695348096:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 164us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200945.988380:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1159 00000100:00100000:2.0:1788200946.001895:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200946.002258:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695348224 00000100:00100000:0.0:1788200946.002268:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695348224 00000100:00100000:0.0:1788200946.002319:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5870 00000100:00100000:0.0:1788200946.002327:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:2399:x1875060695348224:12345-192.168.201.20@tcp:8:lfs.0 00010000:00080000:0.0:1788200946.002359:0:26204:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp t0 exp 0000000000000000 cur 3797 last 0 00000020:00000080:0.0:1788200946.002389:0:26204:0:(genops.c:1385:class_connect()) connect: client 4292087e-fa00-4621-b681-837afc99ae35, cookie 0x96d0c9b8c9a1ae67 00002000:00100000:0.0:1788200946.002404:0:26204:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4292087e-fa00-4621-b681-837afc99ae35/ffff8dc0078db800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788200946.002416:0:26204:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788200946.002499:0:26204:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788200946.002526:0:26204:0:(import.c:65:import_set_state_nolock()) ffff8dc0078dc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788200946.002605:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4292087e-fa00-4621-b681-837afc99ae35+6:2399:x1875060695348224:12345-192.168.201.20@tcp:8:lfs.0 Request processed in 277us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200946.002613:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5870 00000100:00100000:0.0:1788200946.011126:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200946.011337:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695348352 00000100:00100000:2.0:1788200946.011347:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695348352 00000100:00100000:2.0:1788200946.011429:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2138 00000100:00100000:2.0:1788200946.011441:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ac46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+6:66786:x1875060695348352:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:2.0:1788200946.011468:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788200946.011595:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ac46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+6:66786:x1875060695348352:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 156us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200946.011604:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2138 00000100:00080000:1.0:1788200946.012074:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788200946.022888:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200946.023059:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695348480 00000100:00100000:3.0:1788200946.023071:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695348480 00000100:00100000:3.0:1788200946.023119:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5871 00000100:00100000:3.0:1788200946.023128:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:2399:x1875060695348480:12345-192.168.201.20@tcp:8:lfs.0 00010000:00080000:3.0:1788200946.023166:0:26202:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp t0 exp 0000000000000000 cur 3797 last 0 00000020:00000080:3.0:1788200946.023209:0:26202:0:(genops.c:1385:class_connect()) connect: client 4292087e-fa00-4621-b681-837afc99ae35, cookie 0x96d0c9b8c9a1ae6e 00002000:00100000:3.0:1788200946.023222:0:26202:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4292087e-fa00-4621-b681-837afc99ae35/ffff8dc11d63d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788200946.023247:0:26202:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788200946.023326:0:26202:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788200946.023357:0:26202:0:(import.c:65:import_set_state_nolock()) ffff8dc11d639800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788200946.023433:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4292087e-fa00-4621-b681-837afc99ae35+6:2399:x1875060695348480:12345-192.168.201.20@tcp:8:lfs.0 Request processed in 304us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200946.023441:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5871 00000100:00100000:3.0:1788200946.027006:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200946.027964:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695348608 00000100:00100000:2.0:1788200946.027978:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695348608 00000100:00100000:2.0:1788200946.028079:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2139 00000100:00100000:2.0:1788200946.028091:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+6:66786:x1875060695348608:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:2.0:1788200946.028119:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788200946.028209:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+6:66786:x1875060695348608:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 120us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200946.028216:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2139 00000100:00080000:1.0:1788200946.029089:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788200946.449086:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200947.471380:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200948.055883:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715078272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788200948.055971:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200948.056071:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715078272 00000100:00100000:1.0:1788200948.056079:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715078272 00000100:00100000:1.0:1788200948.056135:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2140 00000100:00100000:1.0:1788200948.056145:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715078272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788200948.056548:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200948.056616:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715078272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 473us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200948.056624:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2140 00000100:00080000:1.0:1788200948.056653:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788200948.056874:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715078272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788200948.059995:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788200948.060040:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715078400:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788200948.060109:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200948.060159:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715078400 00000100:00100000:1.0:1788200948.060166:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715078400 00000100:00100000:1.0:1788200948.060241:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2141 00000100:00100000:1.0:1788200948.060251:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715078400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788200948.060278:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200948.060332:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715078400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200948.060339:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2141 00000100:00080000:1.0:1788200948.060360:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788200948.060391:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715078400:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788200948.506783:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200949.522906:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788200950.095933:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715078528:0@lo:400:kworker.0 00000100:00100000:3.0:1788200950.096005:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200950.096068:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715079040:0@lo:400:kworker.0 00000100:00100000:3.0:1788200950.096095:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200950.096116:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715079552:0@lo:400:kworker.0 00000100:00100000:3.0:1788200950.096136:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200950.096410:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715080064:0@lo:400:kworker.0 00000100:00100000:3.0:1788200950.096614:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200950.096643:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788200950.096651:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715078656:0@lo:400:kworker.0 00000100:00100000:3.0:1788200950.096674:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200950.096692:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715079168:0@lo:400:kworker.0 00000100:00100000:3.0:1788200950.096717:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200950.096736:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715079680:0@lo:400:kworker.0 00000100:00100000:3.0:1788200950.096755:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200950.097094:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788200950.097103:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715080192:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788200950.097124:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200950.097321:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715079168 00000100:00100000:2.0:1788200950.097330:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715079168 00000100:00100000:2.0:1788200950.097375:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715079680 00000100:00100000:2.0:1788200950.097378:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715079680 00000100:00100000:2.0:1788200950.097390:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715080192 00000100:00100000:2.0:1788200950.097399:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715080192 00000100:00100000:2.0:1788200950.097418:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3862 00000100:00100000:2.0:1788200950.097440:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715079168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200950.097502:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715079168:12345-0@lo:400:kworker.0 Request processed in 76us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200950.097509:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3862 00000100:00100000:2.0:1788200950.097525:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3863 00000100:00100000:2.0:1788200950.097531:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715079680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200950.097556:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715079680:12345-0@lo:400:kworker.0 Request processed in 26us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200950.097561:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3863 00000100:00100000:2.0:1788200950.097572:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3864 00000100:00100000:2.0:1788200950.097578:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715080192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788200950.097601:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:2.0:1788200950.097631:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715080192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200950.097637:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3864 00000100:00100000:0.0:1788200950.098061:0:87177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715078528 00000100:00100000:0.0:1788200950.098067:0:87177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715078528 00000100:00100000:0.0:1788200950.098098:0:87177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788200950.098104:0:87177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11802d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715078528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200950.098153:0:87177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11802d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715078528:12345-0@lo:400:kworker.0 Request processed in 37us (2136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200950.098160:0:87177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788200950.098301:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715080192:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788200950.098313:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715079168:0@lo:400:kworker.0 00000100:00100000:3.0:1788200950.098321:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715079680:0@lo:400:kworker.0 00000100:00100000:3.0:1788200950.098329:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715078528:0@lo:400:kworker.0 00000100:00100000:3.0:1788200950.098366:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715078784:0@lo:400:kworker.0 00000100:00100000:3.0:1788200950.098393:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200950.098415:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715079296:0@lo:400:kworker.0 00000100:00100000:3.0:1788200950.099087:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200950.099110:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715079808:0@lo:400:kworker.0 00000100:00100000:3.0:1788200950.099137:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200950.099173:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788200950.099180:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715078912:0@lo:400:kworker.0 00000100:00100000:1.0:1788200950.099601:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715079296 00000100:00100000:1.0:1788200950.099607:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715079296 00000100:00100000:1.0:1788200950.099651:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715079808 00000100:00100000:1.0:1788200950.099654:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715079808 00000100:00100000:1.0:1788200950.099681:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2636 00000100:00100000:1.0:1788200950.099690:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715079296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200950.099780:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2637 00000100:00100000:0.0:1788200950.099808:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140e9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715079808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200950.100693:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715079040 00000100:00100000:2.0:1788200950.100700:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715079040 00000100:00100000:2.0:1788200950.100739:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715079552 00000100:00100000:2.0:1788200950.100743:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715079552 00000100:00100000:2.0:1788200950.100756:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715080064 00000100:00100000:2.0:1788200950.100758:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715080064 00000100:00100000:2.0:1788200950.100769:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715078656 00000100:00100000:2.0:1788200950.100772:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715078656 00000100:00100000:2.0:1788200950.100783:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715078784 00000100:00100000:2.0:1788200950.100785:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715078784 00000100:00100000:2.0:1788200950.101005:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:2.0:1788200950.101036:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cf33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715079040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200950.101164:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715079296:12345-0@lo:400:kworker.0 Request processed in 1474us (2077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200950.101173:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2636 00000100:00080000:1.0:1788200950.101207:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788200950.101212:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788200950.101214:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788200950.101452:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140e9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715079808:12345-0@lo:400:kworker.0 Request processed in 1651us (2311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200950.101460:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2637 00000100:00100000:1.0:1788200950.103817:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:1.0:1788200950.103836:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cf31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715079552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200950.103946:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cf31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715079552:12345-0@lo:400:kworker.0 Request processed in 116us (7808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200950.103953:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00100000:1.0:1788200950.103981:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:1.0:1788200950.103988:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715080064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200950.104041:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715080064:12345-0@lo:400:kworker.0 Request processed in 52us (7425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200950.104047:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:1.0:1788200950.104068:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:1.0:1788200950.104075:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715078656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200950.104103:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715078656:12345-0@lo:400:kworker.0 Request processed in 30us (7428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200950.104108:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00100000:1.0:1788200950.104118:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:1.0:1788200950.104123:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715078784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200950.104146:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715078784:12345-0@lo:400:kworker.0 Request processed in 24us (5753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200950.104151:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00100000:3.0:1788200950.106612:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200950.106694:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715078656:0@lo:400:kworker.0 00000100:00100000:1.0:1788200950.106821:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715078912 00000100:00100000:1.0:1788200950.106829:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715078912 00000100:00100000:1.0:1788200950.106893:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:1.0:1788200950.106903:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715078912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200950.106957:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715078912:12345-0@lo:400:kworker.0 Request processed in 55us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200950.106964:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00080000:1.0:1788200950.106992:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788200950.107299:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715079552:0@lo:400:kworker.0 00000100:00100000:3.0:1788200950.107318:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715080064:0@lo:400:kworker.0 00000100:00100000:3.0:1788200950.107374:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715078912:0@lo:400:kworker.0 00000100:00100000:3.0:1788200950.107384:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715079424:0@lo:400:kworker.0 00000100:00100000:3.0:1788200950.107918:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200950.107952:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715079936:0@lo:400:kworker.0 00000100:00100000:3.0:1788200950.107979:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200950.108006:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715079424 00000100:00100000:3.0:1788200950.108012:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715079424 00000100:00100000:3.0:1788200950.108071:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715079936 00000100:00100000:3.0:1788200950.108074:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715079936 00000100:00100000:3.0:1788200950.108107:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2638 00000100:00100000:3.0:1788200950.108116:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715079424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200950.108319:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2639 00000100:00100000:1.0:1788200950.108328:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715079936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200950.108366:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715079936:12345-0@lo:400:kworker.0 Request processed in 40us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200950.108372:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2639 00000100:00100000:2.0:1788200950.108990:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cf33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715079040:12345-0@lo:400:kworker.0 Request processed in 7953us (12891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200950.109000:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00100000:3.0:1788200950.109119:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715079424:12345-0@lo:400:kworker.0 Request processed in 1004us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200950.109126:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2638 00000100:00100000:1.0:1788200950.109328:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715079040:0@lo:400:kworker.0 00000100:00080000:3.0:1788200950.109383:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788200950.109403:0:3655:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969450 gen 2 00000100:00100000:3.0:1788200950.109596:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715079936:0@lo:400:kworker.0 00000100:00100000:3.0:1788200950.109613:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715078784:0@lo:400:kworker.0 00000100:00100000:3.0:1788200950.109625:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715079296:0@lo:400:kworker.0 00000100:00100000:3.0:1788200950.109636:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715079808:0@lo:400:kworker.0 00000100:00100000:3.0:1788200950.109661:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715079424:0@lo:400:kworker.0 00000100:00100000:1.0:1788200950.227801:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200950.227854:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200950.227923:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200950.227955:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200950.227984:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200950.228012:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695348992 00000100:00100000:1.0:1788200950.228056:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695348992 00000100:00100000:1.0:1788200950.228111:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695348864 00000100:00100000:1.0:1788200950.228115:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695348864 00000100:00100000:1.0:1788200950.228154:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1174 00000100:00100000:1.0:1788200950.228164:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695348992:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788200950.228235:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695348992:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 73us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200950.228242:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1174 00000100:00100000:1.0:1788200950.228262:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1175 00000100:00100000:1.0:1788200950.228270:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+7:2403:x1875060695348864:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788200950.228295:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+7:2403:x1875060695348864:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200950.228302:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1175 00000100:00100000:1.0:1788200950.228321:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695349248 00000100:00100000:1.0:1788200950.228324:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695349248 00000100:00100000:1.0:1788200950.228352:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695349120 00000100:00100000:1.0:1788200950.228355:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695349120 00000100:00100000:1.0:1788200950.228377:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2640 00000100:00100000:1.0:1788200950.228383:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695349248:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788200950.228420:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695349248:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 36us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200950.228427:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2640 00000100:00100000:1.0:1788200950.228448:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2641 00000100:00100000:1.0:1788200950.228455:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695349120:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788200950.228712:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695349120:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 256us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200950.228720:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2641 00000100:00100000:3.0:1788200950.228862:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695348736 00000100:00100000:3.0:1788200950.228867:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695348736 00000100:00100000:3.0:1788200950.228917:0:87178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 77 00000100:00100000:3.0:1788200950.228925:0:87178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11802cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2403:x1875060695348736:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200950.228952:0:87178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11802cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2403:x1875060695348736:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 29us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200950.228959:0:87178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 77 00000100:00080000:3.0:1788200950.228998:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788200950.229003:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788200950.229005:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788200950.229007:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788200950.543498:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788200950.612250:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715080320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788200950.612360:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200950.614047:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788200950.614074:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715080448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788200950.614625:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715080576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788200950.614704:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200950.614772:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715080576 00000100:00100000:1.0:1788200950.614782:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715080576 00000100:00100000:1.0:1788200950.614845:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3865 00000100:00100000:1.0:1788200950.614856:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715080576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788200950.614914:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444970496 avail 1298731008 00000100:00100000:1.0:1788200950.614971:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715080576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200950.614979:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3865 00000100:00100000:1.0:1788200950.615065:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715080576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788200950.616197:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200950.616714:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715080320 00000100:00100000:0.0:1788200950.616724:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715080320 00000100:00100000:0.0:1788200950.616781:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715080448 00000100:00100000:0.0:1788200950.616785:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715080448 00000100:00100000:0.0:1788200950.616803:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2142 00000100:00100000:0.0:1788200950.616812:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715080320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788200950.616846:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200950.616924:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715080320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (4565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200950.616932:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2142 00000100:00100000:0.0:1788200950.616950:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2143 00000100:00100000:0.0:1788200950.616956:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715080448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788200950.616993:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200950.617052:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715080448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200950.617059:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2143 00000100:00100000:0.0:1788200950.617104:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715080448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788200950.617122:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715080320:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788200951.567181:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788200951.633059:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4292087e-fa00-4621-b681-837afc99ae35 00000001:00100000:0.0:1788200951.633587:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4292087e-fa00-4621-b681-837afc99ae35 00010000:00010000:3.0:1788200952.593816:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788200953.167420:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715080704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788200953.167498:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200953.167575:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715080704 00000100:00100000:0.0:1788200953.167583:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715080704 00000100:00100000:0.0:1788200953.167649:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2144 00000100:00100000:0.0:1788200953.167660:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715080704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788200953.167690:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200953.167741:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715080704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200953.167748:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2144 00000100:00080000:3.0:1788200953.167776:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788200953.167795:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715080704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788200953.170960:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788200953.174886:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715080832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788200953.174964:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200953.175132:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715080832 00000100:00100000:2.0:1788200953.175141:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715080832 00000100:00100000:2.0:1788200953.175245:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2145 00000100:00100000:2.0:1788200953.175256:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715080832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788200953.175287:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788200953.175342:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715080832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200953.175350:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2145 00000100:00080000:3.0:1788200953.175408:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788200953.176255:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715080832:0@lo:13:osp-pre-1-1.0 00000001:02000400:3.0:1788200953.465409:0:87754:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:3.0:1788200953.615184:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200954.641139:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200955.215390:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715081088:0@lo:400:kworker.0 00000100:00100000:1.0:1788200955.215473:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200955.215512:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715081600:0@lo:400:kworker.0 00000100:00100000:1.0:1788200955.215541:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200955.215572:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715082112:0@lo:400:kworker.0 00000100:00100000:1.0:1788200955.215595:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200955.215618:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788200955.215624:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715081216:0@lo:400:kworker.0 00000100:00100000:1.0:1788200955.215645:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200955.215660:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715081728:0@lo:400:kworker.0 00000100:00100000:1.0:1788200955.215683:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200955.215701:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715082240:0@lo:400:kworker.0 00000100:00100000:1.0:1788200955.215737:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200955.215775:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715081088 00000100:00100000:1.0:1788200955.215783:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715081088 00000100:00100000:1.0:1788200955.215865:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715081216 00000100:00100000:1.0:1788200955.215869:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715081216 00000100:00100000:1.0:1788200955.215892:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:1.0:1788200955.215903:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715081088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200955.215955:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715081088:12345-0@lo:400:kworker.0 Request processed in 54us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200955.215963:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00100000:1.0:1788200955.215984:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:1.0:1788200955.215991:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715081216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200955.216047:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715081216:12345-0@lo:400:kworker.0 Request processed in 57us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200955.216053:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00100000:1.0:1788200955.216076:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715081728 00000100:00100000:1.0:1788200955.216080:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715081728 00000100:00100000:1.0:1788200955.216107:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715082240 00000100:00100000:1.0:1788200955.216110:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715082240 00000100:00100000:1.0:1788200955.216142:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2642 00000100:00100000:1.0:1788200955.216149:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00586d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715081728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200955.216180:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00586d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715081728:12345-0@lo:400:kworker.0 Request processed in 32us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200955.216186:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2642 00000100:00100000:1.0:1788200955.216197:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2643 00000100:00100000:1.0:1788200955.216203:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00586c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715082240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200955.216229:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00586c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715082240:12345-0@lo:400:kworker.0 Request processed in 27us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200955.216234:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2643 00000100:00080000:1.0:1788200955.216252:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788200955.216257:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788200955.216259:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788200955.216301:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715081216:0@lo:400:kworker.0 00000100:00100000:1.0:1788200955.216311:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715081728:0@lo:400:kworker.0 00000100:00100000:1.0:1788200955.216319:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715082240:0@lo:400:kworker.0 00000100:00100000:1.0:1788200955.216328:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715081088:0@lo:400:kworker.0 00000100:00100000:0.0:1788200955.216496:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715080960:0@lo:400:kworker.0 00000100:00100000:0.0:1788200955.216532:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200955.216567:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715081472:0@lo:400:kworker.0 00000100:00100000:0.0:1788200955.216591:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200955.216606:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715081984:0@lo:400:kworker.0 00000100:00100000:0.0:1788200955.216625:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200955.216639:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715082496:0@lo:400:kworker.0 00000100:00100000:0.0:1788200955.216671:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200955.216689:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788200955.216695:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715081344:0@lo:400:kworker.0 00000100:00100000:0.0:1788200955.216727:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200955.216743:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715081856:0@lo:400:kworker.0 00000100:00100000:0.0:1788200955.216763:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200955.216777:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715082368:0@lo:400:kworker.0 00000100:00100000:0.0:1788200955.216808:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200955.216943:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715081600 00000100:00100000:3.0:1788200955.216948:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715081600 00000100:00100000:3.0:1788200955.216985:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715082112 00000100:00100000:3.0:1788200955.216988:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715082112 00000100:00100000:3.0:1788200955.217007:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3866 00000100:00100000:3.0:1788200955.217032:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715081600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200955.217078:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715081600:12345-0@lo:400:kworker.0 Request processed in 64us (1535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200955.217084:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3866 00000100:00100000:3.0:1788200955.217098:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3867 00000100:00100000:3.0:1788200955.217105:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715082112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200955.217129:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715082112:12345-0@lo:400:kworker.0 Request processed in 25us (1533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200955.217144:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3867 00000100:00100000:3.0:1788200955.217163:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715081472 00000100:00100000:3.0:1788200955.217166:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715081472 00000100:00100000:3.0:1788200955.217191:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715081984 00000100:00100000:3.0:1788200955.217193:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715081984 00000100:00100000:3.0:1788200955.217201:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715082496 00000100:00100000:3.0:1788200955.217203:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715082496 00000100:00100000:3.0:1788200955.217210:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715081344 00000100:00100000:3.0:1788200955.217212:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715081344 00000100:00100000:3.0:1788200955.217225:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:3.0:1788200955.217229:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715081472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200955.217264:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715081472:12345-0@lo:400:kworker.0 Request processed in 34us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200955.217270:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00100000:3.0:1788200955.217282:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:3.0:1788200955.217288:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715081984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200955.217313:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715081984:12345-0@lo:400:kworker.0 Request processed in 26us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200955.217319:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:3.0:1788200955.217330:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:3.0:1788200955.217336:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715082496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200955.217362:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715082496:12345-0@lo:400:kworker.0 Request processed in 27us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200955.217368:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:3.0:1788200955.217380:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:3.0:1788200955.217385:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715081344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200955.217422:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715081344:12345-0@lo:400:kworker.0 Request processed in 37us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200955.217427:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:3.0:1788200955.217447:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715081856 00000100:00100000:3.0:1788200955.217450:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715081856 00000100:00100000:3.0:1788200955.217474:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715082368 00000100:00100000:3.0:1788200955.217477:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715082368 00000100:00100000:3.0:1788200955.217498:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2644 00000100:00100000:3.0:1788200955.217504:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715081856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200955.217535:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715081856:12345-0@lo:400:kworker.0 Request processed in 32us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200955.217541:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2644 00000100:00100000:3.0:1788200955.217552:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2645 00000100:00100000:3.0:1788200955.217559:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715082368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200955.217583:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715082368:12345-0@lo:400:kworker.0 Request processed in 26us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200955.217589:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2645 00000100:00080000:3.0:1788200955.217620:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788200955.217623:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788200955.217624:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788200955.217647:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715081344:0@lo:400:kworker.0 00000100:00100000:3.0:1788200955.217658:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715081856:0@lo:400:kworker.0 00000100:00100000:3.0:1788200955.217667:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715082368:0@lo:400:kworker.0 00000100:00100000:3.0:1788200955.217676:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715081472:0@lo:400:kworker.0 00000100:00100000:3.0:1788200955.217685:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715081984:0@lo:400:kworker.0 00000100:00100000:3.0:1788200955.217702:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715082496:0@lo:400:kworker.0 00000100:00100000:3.0:1788200955.217831:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715081600:0@lo:400:kworker.0 00000100:00100000:3.0:1788200955.217842:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715082112:0@lo:400:kworker.0 00000100:00100000:1.0:1788200955.217976:0:87177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715080960 00000100:00100000:1.0:1788200955.217981:0:87177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715080960 00000100:00100000:1.0:1788200955.218183:0:87177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788200955.218191:0:87177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11802f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715080960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200955.218235:0:87177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11802f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715080960:12345-0@lo:400:kworker.0 Request processed in 45us (1702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200955.218241:0:87177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788200955.218308:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715080960:0@lo:400:kworker.0 00000100:00100000:3.0:1788200955.219616:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715082624:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788200955.219676:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200955.219870:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715082624 00000100:00100000:2.0:1788200955.219879:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715082624 00000100:00100000:2.0:1788200955.219927:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3868 00000100:00100000:2.0:1788200955.219935:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715082624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788200955.219972:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:2.0:1788200955.220045:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715082624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200955.220051:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3868 00000100:00100000:3.0:1788200955.220142:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715082624:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788200955.347945:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200955.347990:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200955.348065:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200955.348099:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200955.348125:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200955.348154:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695349760 00000100:00100000:0.0:1788200955.348165:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695349760 00000100:00100000:0.0:1788200955.348223:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695349888 00000100:00100000:0.0:1788200955.348227:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695349888 00000100:00100000:0.0:1788200955.348255:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2646 00000100:00100000:0.0:1788200955.348265:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695349760:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200955.348338:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695349760:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 75us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200955.348346:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2646 00000100:00100000:0.0:1788200955.348363:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2647 00000100:00100000:0.0:1788200955.348370:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695349888:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200955.348395:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695349888:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200955.348410:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2647 00000100:00100000:3.0:1788200955.348664:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695349376 00000100:00100000:3.0:1788200955.348669:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695349376 00000100:00100000:3.0:1788200955.348707:0:87178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 79 00000100:00100000:3.0:1788200955.348715:0:87178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2403:x1875060695349376:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200955.348743:0:87178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2403:x1875060695349376:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 29us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200955.348750:0:87178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 79 00000100:00100000:3.0:1788200955.348811:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695349504 00000100:00100000:3.0:1788200955.348815:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695349504 00000100:00100000:3.0:1788200955.348853:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695349632 00000100:00100000:3.0:1788200955.348857:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695349632 00000100:00100000:3.0:1788200955.348882:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1182 00000100:00100000:3.0:1788200955.348889:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+7:2403:x1875060695349504:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200955.348917:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+7:2403:x1875060695349504:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 29us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200955.348923:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1182 00000100:00100000:3.0:1788200955.348935:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1183 00000100:00100000:3.0:1788200955.348940:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695349632:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200955.348968:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695349632:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200955.348975:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1183 00000100:00080000:3.0:1788200955.348992:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788200955.348995:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788200955.348997:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788200955.348999:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788200955.664922:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788200955.727493:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788200955.727526:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00586f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715082752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788200955.727594:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200955.727816:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715082880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788200955.727850:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200955.727896:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715082880 00000100:00100000:0.0:1788200955.727904:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715082880 00000100:00100000:0.0:1788200955.727951:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2146 00000100:00100000:0.0:1788200955.727962:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715082880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788200955.727991:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200955.728072:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715082880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200955.728080:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2146 00000100:00100000:0.0:1788200955.728127:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715082880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788200955.728326:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715082752 00000100:00100000:1.0:1788200955.728338:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715082752 00000100:00100000:1.0:1788200955.728376:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3869 00000100:00100000:1.0:1788200955.728393:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715082752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788200955.728417:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444970496 avail 1298731008 00000100:00100000:1.0:1788200955.728462:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715082752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200955.728468:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3869 00000100:00100000:1.0:1788200955.728500:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00586f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715082752:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788200955.728617:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715083008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788200955.728648:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200955.728716:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715083008 00000100:00100000:2.0:1788200955.728721:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715083008 00000100:00100000:2.0:1788200955.728752:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2147 00000100:00100000:2.0:1788200955.728759:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715083008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788200955.728775:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788200955.728827:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715083008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200955.728833:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2147 00000100:00100000:1.0:1788200955.728899:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715083008:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788200955.820748:0:87802:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:3.0:1788200956.687505:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200957.711534:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788200958.084628:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200958.084791:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695350016 00000100:00100000:0.0:1788200958.084802:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695350016 00000100:00100000:0.0:1788200958.084888:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1160 00000100:00100000:0.0:1788200958.084899:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+7:67254:x1875060695350016:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:0.0:1788200958.084936:0:66312:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444970496 avail 1298731008 00000100:00100000:0.0:1788200958.085046:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+7:67254:x1875060695350016:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 148us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200958.085054:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1160 00000100:00080000:3.0:1788200958.085183:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788200958.096204:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200958.096320:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695350144 00000100:00100000:3.0:1788200958.096339:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695350144 00000100:00100000:3.0:1788200958.096429:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1161 00000100:00100000:3.0:1788200958.096442:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:67254:x1875060695350144:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:3.0:1788200958.096490:0:66757:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:3.0:1788200958.096581:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:67254:x1875060695350144:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 142us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200958.096589:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1161 00000100:00080000:0.0:1788200958.096674:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788200958.108387:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200958.108538:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695350272 00000100:00100000:0.0:1788200958.108559:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695350272 00000100:00100000:0.0:1788200958.108634:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2148 00000100:00100000:0.0:1788200958.108654:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:67254:x1875060695350272:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:0.0:1788200958.108686:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200958.108778:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:67254:x1875060695350272:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 134us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200958.108786:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2148 00000100:00080000:3.0:1788200958.109005:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788200958.114245:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200958.114539:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695350400 00000100:00100000:0.0:1788200958.114552:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695350400 00000100:00100000:0.0:1788200958.114635:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2149 00000100:00100000:0.0:1788200958.114656:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:67254:x1875060695350400:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:0.0:1788200958.114690:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200958.114768:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:67254:x1875060695350400:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 114us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200958.114775:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2149 00000100:00080000:3.0:1788200958.115550:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788200958.239282:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200958.250945:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695350528 00000100:00100000:2.0:1788200958.253287:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695350528 00000100:00100000:3.0:1788200958.270912:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1162 00000100:00100000:3.0:1788200958.270929:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00586f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+7:67270:x1875060695350528:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1788200958.270951:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788200958.270989:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1ae75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7865d2 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.273611:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1ae7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.273633:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1ae7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.273908:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1ae7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.273925:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1ae83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.273934:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1ae83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.273941:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1ae83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.275471:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1ae8a lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.275490:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1ae8a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.275499:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1ae8a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788200958.277984:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788200958.277989:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788200958.278035:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1ae8a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.278074:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1ae7c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.278082:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1ae7c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.278088:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1ae7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.278095:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1ae7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.278100:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788200958.278104:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1ae7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.278110:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1ae7c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.278126:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a1e700) 00010000:00010000:3.0:1788200958.278128:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788200958.278134:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1ae7c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.278139:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1ae7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.278155:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1ae83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.278161:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1ae83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.278173:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1ae83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.278178:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788200958.278180:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1ae83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.278186:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1ae83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.278194:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff8dc005cc6a00) 00010000:00010000:3.0:1788200958.278196:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788200958.278198:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1ae83 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.278204:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1ae83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.278248:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1ae75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865d2 expref: 9 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.278263:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1ae8a lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865d2 expref: 8 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.278269:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8dc005cc6100) 00010000:00010000:3.0:1788200958.278271:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788200958.278273:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064edc00, rc 0) 00000100:00100000:3.0:1788200958.281085:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00586f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+8:67270:x1875060695350528:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 10148us (41802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200958.281118:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1162 00000100:00100000:3.0:1788200958.291359:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00586c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715083136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788200958.291434:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200958.291658:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715083136 00000100:00100000:1.0:1788200958.291666:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715083136 00000100:00100000:1.0:1788200958.291728:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2150 00000100:00100000:1.0:1788200958.291749:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715083136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788200958.291773:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200958.291824:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715083136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200958.291831:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2150 00000100:00100000:1.0:1788200958.291878:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00586c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715083136:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788200958.292657:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788200958.293340:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0073bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715083264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788200958.293397:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200958.293875:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715083264 00000100:00100000:2.0:1788200958.293885:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715083264 00000100:00100000:2.0:1788200958.293954:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2151 00000100:00100000:2.0:1788200958.293963:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715083264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788200958.293996:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788200958.294091:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715083264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200958.294099:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2151 00000100:00100000:2.0:1788200958.294144:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0073bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715083264:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788200958.295232:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788200958.301773:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200958.301876:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695350784 00000100:00100000:1.0:1788200958.301887:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695350784 00000100:00100000:1.0:1788200958.301954:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1163 00000100:00100000:1.0:1788200958.301964:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+8:67270:x1875060695350784:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1788200958.301986:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788200958.302006:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad800/0x96d0c9b8c9a1ae91 lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7865d9 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200958.302141:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1ae98 lrc: 3/1,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200958.302155:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1ae98 lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200958.302167:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1ae98 lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200958.302182:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ae9f lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200958.302189:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ae9f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200958.302195:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ae9f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200958.302280:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1ae98 lrc: 4/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200958.302288:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1ae98 lrc: 4/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200958.302293:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1ae98 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200958.302300:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1ae98 lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200958.302318:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0079ada00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788200958.302336:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1ae98 lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200958.302344:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1ae98 lrc: 5/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200958.302357:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8dc005cc6100) 00010000:00010000:1.0:1788200958.302360:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788200958.302364:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1ae98 lrc: 3/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200958.302370:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1ae98 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200958.302384:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ae9f lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200958.302391:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ae9f lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200958.302396:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ae9f lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200958.302401:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0079ace00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788200958.302404:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ae9f lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200958.302409:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ae9f lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200958.302416:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff8dc12066ff00) 00010000:00010000:1.0:1788200958.302418:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788200958.302426:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ae9f lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200958.302432:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ace00/0x96d0c9b8c9a1ae9f lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200958.302466:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad800/0x96d0c9b8c9a1ae91 lrc: 1/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865d9 expref: 9 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200958.302476:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8dc005cc6100) 00010000:00010000:1.0:1788200958.302478:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788200958.302481:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad800/0x96d0c9b8c9a1ae91 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865d9 expref: 9 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200958.302490:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0079ad800, rc 0) 00000100:00100000:1.0:1788200958.302791:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+8:67270:x1875060695350784:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 827us (1029us total) trans 0 rc 301/301 00000100:00100000:1.0:1788200958.302799:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1163 00000100:00100000:0.0:1788200958.316613:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200958.317002:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695351040 00000100:00100000:3.0:1788200958.317037:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695351040 00000100:00100000:3.0:1788200958.317316:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1164 00000100:00100000:3.0:1788200958.317852:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+8:67270:x1875060695351040:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1788200958.317874:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788200958.317893:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1aea6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7865e0 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788200958.318007:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788200958.318167:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1aea6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865e0 expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.318182:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a1e700) 00010000:00010000:3.0:1788200958.318185:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788200958.318190:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1aea6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865e0 expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200958.318215:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ec800, rc 0) 00000100:00100000:3.0:1788200958.318282:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+9:67270:x1875060695351040:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 436us (1985us total) trans 107374182401 rc 301/301 00000100:00100000:3.0:1788200958.338867:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1164 00000100:00100000:1.0:1788200958.350596:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200958.356212:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695351168 00000100:00100000:3.0:1788200958.356229:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695351168 00000100:00100000:2.0:1788200958.356871:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1165 00000100:00100000:2.0:1788200958.356884:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00586c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+9:67270:x1875060695351168:12345-192.168.201.20@tcp:34:lfs.0 00010000:00010000:2.0:1788200958.356999:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6d800/0x96d0c9b8c9a1aeb4 lrc: 3/1,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.357722:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6d800/0x96d0c9b8c9a1aeb4 lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.357747:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6d800/0x96d0c9b8c9a1aeb4 lrc: 3/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.357769:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ce00/0x96d0c9b8c9a1aebb lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.357777:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ce00/0x96d0c9b8c9a1aebb lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.357783:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ce00/0x96d0c9b8c9a1aebb lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.357866:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1aec2 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.357874:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1aec2 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.357881:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1aec2 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788200958.357929:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788200958.357945:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1aec2 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.357974:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6d800/0x96d0c9b8c9a1aeb4 lrc: 4/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.357991:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6d800/0x96d0c9b8c9a1aeb4 lrc: 4/1,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.357997:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6d800/0x96d0c9b8c9a1aeb4 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.358004:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6d800/0x96d0c9b8c9a1aeb4 lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.358009:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6d800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788200958.358013:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6d800/0x96d0c9b8c9a1aeb4 lrc: 4/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.359225:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6d800/0x96d0c9b8c9a1aeb4 lrc: 5/0,0 mode: CR/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.359244:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0x0 (ffff8dc005cc6100) 00010000:00010000:2.0:1788200958.359247:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788200958.359253:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6d800/0x96d0c9b8c9a1aeb4 lrc: 3/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.359260:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6d800/0x96d0c9b8c9a1aeb4 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.359277:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ce00/0x96d0c9b8c9a1aebb lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.359284:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ce00/0x96d0c9b8c9a1aebb lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.359291:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ce00/0x96d0c9b8c9a1aebb lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.359711:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6ce00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788200958.359716:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ce00/0x96d0c9b8c9a1aebb lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.359723:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ce00/0x96d0c9b8c9a1aebb lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.359732:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x3:0x0].0xfa0fa5c1 (ffff8dc11248c600) 00010000:00010000:2.0:1788200958.359735:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788200958.359883:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ce00/0x96d0c9b8c9a1aebb lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.359890:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ce00/0x96d0c9b8c9a1aebb lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.359912:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1aec2 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.359919:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1aec2 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.359926:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1aec2 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.359930:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6c000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788200958.359933:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1aec2 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.359951:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1aec2 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.359985:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x5:0x0].0x0 (ffff8dc11248c900) 00010000:00010000:2.0:1788200958.359987:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788200958.359990:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1aec2 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200958.359996:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1aec2 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200958.361959:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00586c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+9:67270:x1875060695351168:12345-192.168.201.20@tcp:34:lfs.0 Request processed in 5067us (11364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200958.361985:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1165 00000100:00100000:2.0:1788200958.376571:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200958.381292:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695351424 00000100:00100000:1.0:1788200958.381703:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695351424 00000100:00100000:1.0:1788200958.381787:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 220 00000100:00100000:1.0:1788200958.381798:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4292087e-fa00-4621-b681-837afc99ae35+9:67270:x1875060695351424:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:1.0:1788200958.382940:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4292087e-fa00-4621-b681-837afc99ae35+10:67270:x1875060695351424:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 1137us (6637us total) trans 107374182402 rc 0/0 00000100:00100000:1.0:1788200958.382953:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 220 00010000:00010000:3.0:1788200958.743399:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200959.760233:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200960.335510:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0073b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715083392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788200960.335581:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200960.335749:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715083392 00000100:00100000:2.0:1788200960.335758:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715083392 00000100:00100000:2.0:1788200960.335809:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3870 00000100:00100000:2.0:1788200960.335818:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715083392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788200960.335849:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:2.0:1788200960.335903:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715083392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200960.335910:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3870 00000100:00100000:1.0:1788200960.335981:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0073b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715083392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788200960.336207:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715083648:0@lo:400:kworker.0 00000100:00100000:1.0:1788200960.336242:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200960.336262:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715084160:0@lo:400:kworker.0 00000100:00100000:1.0:1788200960.336284:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200960.336300:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715084672:0@lo:400:kworker.0 00000100:00100000:1.0:1788200960.336320:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200960.336339:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788200960.336344:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715083776:0@lo:400:kworker.0 00000100:00100000:1.0:1788200960.336364:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200960.336378:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715084288:0@lo:400:kworker.0 00000100:00100000:1.0:1788200960.336396:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200960.336411:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715084800:0@lo:400:kworker.0 00000100:00100000:1.0:1788200960.336429:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200960.336454:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715083648 00000100:00100000:1.0:1788200960.336458:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715083648 00000100:00100000:1.0:1788200960.336506:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715083776 00000100:00100000:1.0:1788200960.336510:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715083776 00000100:00100000:1.0:1788200960.336530:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:1.0:1788200960.336537:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715083648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200960.336572:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715083648:12345-0@lo:400:kworker.0 Request processed in 36us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200960.336578:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:1.0:1788200960.336593:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:1.0:1788200960.336599:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715083776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200960.336635:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715083776:12345-0@lo:400:kworker.0 Request processed in 36us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200960.336642:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:1.0:1788200960.336659:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715084160 00000100:00100000:1.0:1788200960.336663:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715084160 00000100:00100000:1.0:1788200960.336684:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3871 00000100:00100000:1.0:1788200960.336690:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715084160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200960.336730:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715084160:12345-0@lo:400:kworker.0 Request processed in 40us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200960.336736:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3871 00000100:00100000:1.0:1788200960.336755:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715084672 00000100:00100000:1.0:1788200960.336758:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715084672 00000100:00100000:1.0:1788200960.336783:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715084288 00000100:00100000:1.0:1788200960.336786:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715084288 00000100:00100000:1.0:1788200960.336801:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715084800 00000100:00100000:1.0:1788200960.336804:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715084800 00000100:00100000:1.0:1788200960.336822:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2648 00000100:00100000:1.0:1788200960.336828:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715084672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200960.336856:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715084672:12345-0@lo:400:kworker.0 Request processed in 28us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200960.336862:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2648 00000100:00100000:1.0:1788200960.336873:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2649 00000100:00100000:1.0:1788200960.336878:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715084288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200960.336899:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715084288:12345-0@lo:400:kworker.0 Request processed in 21us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200960.336905:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2649 00000100:00100000:1.0:1788200960.336914:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2650 00000100:00100000:1.0:1788200960.336927:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715084800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200960.336952:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715084800:12345-0@lo:400:kworker.0 Request processed in 27us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200960.336958:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2650 00000100:00080000:1.0:1788200960.336980:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788200960.336984:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788200960.336986:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788200960.336988:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788200960.337052:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715083776:0@lo:400:kworker.0 00000100:00100000:1.0:1788200960.337063:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715084288:0@lo:400:kworker.0 00000100:00100000:1.0:1788200960.337071:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715084800:0@lo:400:kworker.0 00000100:00100000:1.0:1788200960.337080:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715083648:0@lo:400:kworker.0 00000100:00100000:1.0:1788200960.337089:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715084160:0@lo:400:kworker.0 00000100:00100000:1.0:1788200960.337096:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715084672:0@lo:400:kworker.0 00000100:00100000:3.0:1788200960.337375:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715083520:0@lo:400:kworker.0 00000100:00100000:3.0:1788200960.337413:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200960.337450:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715084032:0@lo:400:kworker.0 00000100:00100000:3.0:1788200960.337482:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200960.337501:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715084544:0@lo:400:kworker.0 00000100:00100000:3.0:1788200960.337522:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200960.337537:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788200960.337543:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715083904:0@lo:400:kworker.0 00000100:00100000:3.0:1788200960.337562:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200960.337574:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715084416:0@lo:400:kworker.0 00000100:00100000:3.0:1788200960.337593:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200960.337605:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715084928:0@lo:400:kworker.0 00000100:00100000:3.0:1788200960.337623:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200960.337644:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715084416 00000100:00100000:3.0:1788200960.337647:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715084416 00000100:00100000:3.0:1788200960.337675:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2651 00000100:00100000:3.0:1788200960.337681:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715084416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200960.337727:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715084416:12345-0@lo:400:kworker.0 Request processed in 46us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200960.337733:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2651 00000100:00100000:3.0:1788200960.337753:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715084032 00000100:00100000:3.0:1788200960.337756:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715084032 00000100:00100000:3.0:1788200960.337776:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715084544 00000100:00100000:3.0:1788200960.337778:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715084544 00000100:00100000:3.0:1788200960.337799:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715083904 00000100:00100000:3.0:1788200960.337801:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715083904 00000100:00100000:3.0:1788200960.337812:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715084928 00000100:00100000:3.0:1788200960.337814:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715084928 00000100:00100000:3.0:1788200960.337826:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:3.0:1788200960.337831:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715084032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200960.337859:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715084032:12345-0@lo:400:kworker.0 Request processed in 28us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200960.337866:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:3.0:1788200960.337877:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:3.0:1788200960.337882:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715084544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200960.337905:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715084544:12345-0@lo:400:kworker.0 Request processed in 22us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200960.337911:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:3.0:1788200960.337921:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:3.0:1788200960.337927:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715083904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200960.337948:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715083904:12345-0@lo:400:kworker.0 Request processed in 22us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200960.337954:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:3.0:1788200960.337963:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1788200960.337969:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715084928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200960.337991:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715084928:12345-0@lo:400:kworker.0 Request processed in 22us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200960.337997:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1788200960.338046:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715083904:0@lo:400:kworker.0 00000100:00100000:3.0:1788200960.338056:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715084416:0@lo:400:kworker.0 00000100:00100000:3.0:1788200960.338073:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715084928:0@lo:400:kworker.0 00000100:00100000:3.0:1788200960.338081:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715084032:0@lo:400:kworker.0 00000100:00100000:3.0:1788200960.338090:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715084544:0@lo:400:kworker.0 00000100:00100000:1.0:1788200960.338763:0:87176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715083520 00000100:00100000:1.0:1788200960.338770:0:87176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715083520 00000100:00100000:1.0:1788200960.338812:0:87176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788200960.338820:0:87176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715083520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200960.338872:0:87176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715083520:12345-0@lo:400:kworker.0 Request processed in 53us (1459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200960.338879:0:87176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1788200960.338921:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788200960.338925:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788200960.338927:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788200960.339003:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715083520:0@lo:400:kworker.0 00000100:00100000:2.0:1788200960.477057:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200960.477097:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200960.477124:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200960.477148:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200960.477172:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200960.477199:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695352064 00000100:00100000:2.0:1788200960.477215:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695352064 00000100:00100000:2.0:1788200960.477293:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695351936 00000100:00100000:2.0:1788200960.477297:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695351936 00000100:00100000:2.0:1788200960.477323:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2652 00000100:00100000:2.0:1788200960.477335:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695352064:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788200960.477412:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695352064:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 80us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200960.477420:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2652 00000100:00100000:2.0:1788200960.477437:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2653 00000100:00100000:2.0:1788200960.477445:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695351936:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788200960.477485:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695351936:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 40us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200960.477492:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2653 00000100:00100000:2.0:1788200960.477511:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695351808 00000100:00100000:2.0:1788200960.477516:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695351808 00000100:00100000:2.0:1788200960.477543:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695351680 00000100:00100000:2.0:1788200960.477545:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695351680 00000100:00100000:2.0:1788200960.477564:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1190 00000100:00100000:2.0:1788200960.477570:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695351808:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788200960.477595:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695351808:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200960.477601:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1190 00000100:00100000:2.0:1788200960.477612:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1191 00000100:00100000:2.0:1788200960.477618:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+10:2403:x1875060695351680:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788200960.477643:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+10:2403:x1875060695351680:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200960.477659:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1191 00000100:00080000:2.0:1788200960.477678:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788200960.477681:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788200960.477684:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788200960.477686:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788200960.478065:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695351552 00000100:00100000:3.0:1788200960.478071:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695351552 00000100:00100000:3.0:1788200960.478106:0:87178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 81 00000100:00100000:3.0:1788200960.478113:0:87178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2403:x1875060695351552:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200960.478149:0:87178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2403:x1875060695351552:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 37us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200960.478157:0:87178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 81 00010000:00010000:3.0:1788200960.783419:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200960.847588:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715085184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788200960.847704:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200960.847888:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715085184 00000100:00100000:2.0:1788200960.847897:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715085184 00000100:00100000:2.0:1788200960.847954:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2152 00000100:00100000:2.0:1788200960.847963:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715085184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788200960.847993:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788200960.848086:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715085184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200960.848093:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2152 00000100:00100000:0.0:1788200960.848268:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788200960.848280:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715085056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788200960.848316:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200960.848344:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715085056 00000100:00100000:0.0:1788200960.848347:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715085056 00000100:00100000:0.0:1788200960.848373:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3872 00000100:00100000:0.0:1788200960.848379:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13c271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715085056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788200960.848408:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444970496 avail 1298731008 00000100:00100000:0.0:1788200960.848440:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13c271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715085056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200960.848446:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3872 00000100:00100000:0.0:1788200960.849136:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715085056:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788200960.852133:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715085184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788200960.852645:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788200960.852666:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715085312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788200960.852757:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200960.854292:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715085312 00000100:00100000:0.0:1788200960.854305:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715085312 00000100:00100000:0.0:1788200960.854368:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2153 00000100:00100000:0.0:1788200960.854377:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715085312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788200960.854408:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200960.854493:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715085312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (1736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200960.854500:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2153 00000100:00100000:3.0:1788200960.854792:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715085312:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788200961.815389:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200962.833000:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788200963.407395:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715085568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788200963.407478:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200963.407531:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788200963.407538:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715085440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788200963.407564:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200963.407659:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715085568 00000100:00100000:1.0:1788200963.407667:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715085568 00000100:00100000:1.0:1788200963.407727:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715085440 00000100:00100000:1.0:1788200963.407731:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715085440 00000100:00100000:1.0:1788200963.407748:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2154 00000100:00100000:1.0:1788200963.407759:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715085568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788200963.407789:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200963.407842:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715085568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200963.407850:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2154 00000100:00100000:1.0:1788200963.407871:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2155 00000100:00100000:1.0:1788200963.407878:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715085440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788200963.407893:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200963.407920:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715085440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200963.407926:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2155 00000100:00100000:1.0:1788200963.407966:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715085440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788200963.407979:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715085568:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788200963.408277:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788200963.408299:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788200963.855587:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788200964.432926:0:87171:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182402 is committed 00010000:00010000:3.0:1788200964.879901:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200965.455583:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788200965.455606:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715085696:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788200965.455696:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200965.455750:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715085696 00000100:00100000:1.0:1788200965.455758:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715085696 00000100:00100000:1.0:1788200965.455798:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3873 00000100:00100000:1.0:1788200965.455806:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715085696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788200965.455839:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:1.0:1788200965.455885:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715085696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200965.455893:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3873 00000100:00100000:1.0:1788200965.455956:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715085696:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788200965.456424:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715086208:0@lo:400:kworker.0 00000100:00100000:2.0:1788200965.456437:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715085952:0@lo:400:kworker.0 00000100:00100000:3.0:1788200965.456472:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200965.456503:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200965.456506:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715086720:0@lo:400:kworker.0 00000100:00100000:2.0:1788200965.456532:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715086464:0@lo:400:kworker.0 00000100:00100000:3.0:1788200965.456541:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200965.456563:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200965.456566:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715087232:0@lo:400:kworker.0 00000100:00100000:2.0:1788200965.456587:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715086976:0@lo:400:kworker.0 00000100:00100000:3.0:1788200965.456598:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200965.456633:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200965.456633:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788200965.456642:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715085824:0@lo:400:kworker.0 00000100:00100000:2.0:1788200965.456660:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788200965.456670:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715086080:0@lo:400:kworker.0 00000100:00100000:3.0:1788200965.456676:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200965.456702:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200965.456710:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715086336:0@lo:400:kworker.0 00000100:00100000:2.0:1788200965.456724:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715086592:0@lo:400:kworker.0 00000100:00100000:3.0:1788200965.456739:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200965.456756:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200965.456778:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715087104:0@lo:400:kworker.0 00000100:00100000:2.0:1788200965.456807:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200965.456834:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715086208 00000100:00100000:2.0:1788200965.456838:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715086208 00000100:00100000:2.0:1788200965.456873:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715085952 00000100:00100000:2.0:1788200965.456876:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715085952 00000100:00100000:2.0:1788200965.456887:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715087232 00000100:00100000:2.0:1788200965.456890:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715087232 00000100:00100000:2.0:1788200965.456899:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715086080 00000100:00100000:2.0:1788200965.456902:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715086080 00000100:00100000:2.0:1788200965.456912:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715086336 00000100:00100000:2.0:1788200965.456915:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715086336 00000100:00100000:2.0:1788200965.456927:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:2.0:1788200965.456934:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715086208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200965.456971:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715086208:12345-0@lo:400:kworker.0 Request processed in 37us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200965.456977:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00100000:2.0:1788200965.456991:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:2.0:1788200965.456998:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715085952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200965.457086:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715086848:0@lo:400:kworker.0 00000100:00100000:1.0:1788200965.457249:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:1.0:1788200965.457259:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715087232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200965.457392:0:87176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715085824 00000100:00100000:0.0:1788200965.457396:0:87176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715085824 00000100:00100000:0.0:1788200965.457425:0:87176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788200965.457432:0:87176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715085824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200965.463621:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200965.463639:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715087232:12345-0@lo:400:kworker.0 Request processed in 6377us (7037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200965.463654:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00100000:3.0:1788200965.463683:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715086208:0@lo:400:kworker.0 00000100:00100000:1.0:1788200965.463696:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715086848 00000100:00100000:3.0:1788200965.463702:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715087232:0@lo:400:kworker.0 00000100:00100000:1.0:1788200965.463705:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715086848 00000100:00100000:1.0:1788200965.463742:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:3.0:1788200965.463751:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715086720 00000100:00100000:1.0:1788200965.463752:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120023100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715086080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200965.463758:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715086720 00000100:00100000:3.0:1788200965.463809:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715086976 00000100:00100000:3.0:1788200965.463814:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715086976 00000100:00100000:1.0:1788200965.463820:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120023100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715086080:12345-0@lo:400:kworker.0 Request processed in 69us (7119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200965.463828:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:3.0:1788200965.463838:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715086592 00000100:00100000:3.0:1788200965.463843:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715086592 00000100:00100000:1.0:1788200965.463846:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:1.0:1788200965.463856:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715086336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200965.463874:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715087104 00000100:00100000:3.0:1788200965.463879:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715087104 00000100:00100000:3.0:1788200965.463905:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2654 00000100:00100000:1.0:1788200965.463911:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715086336:12345-0@lo:400:kworker.0 Request processed in 45us (7160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200965.463913:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715086720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200965.463919:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00100000:1.0:1788200965.463945:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:1.0:1788200965.463951:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715086848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200965.463979:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715086848:12345-0@lo:400:kworker.0 Request processed in 29us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200965.463985:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:1.0:1788200965.464012:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2655 00000100:00100000:1.0:1788200965.464284:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120022680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715086976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200965.464320:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120022680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715086976:12345-0@lo:400:kworker.0 Request processed in 41us (7689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200965.464327:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2655 00000100:00100000:1.0:1788200965.464345:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2656 00000100:00100000:1.0:1788200965.464351:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120021880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715086592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200965.464377:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120021880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715086592:12345-0@lo:400:kworker.0 Request processed in 27us (7622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200965.464382:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2656 00000100:00100000:1.0:1788200965.464393:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2657 00000100:00100000:1.0:1788200965.464399:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120021c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715087104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200965.464426:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120021c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715087104:12345-0@lo:400:kworker.0 Request processed in 28us (7618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200965.464431:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2657 00000100:00100000:1.0:1788200965.464464:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715086080:0@lo:400:kworker.0 00000100:00100000:1.0:1788200965.464476:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715086592:0@lo:400:kworker.0 00000100:00100000:1.0:1788200965.464487:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715087104:0@lo:400:kworker.0 00000100:00100000:1.0:1788200965.464498:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715086976:0@lo:400:kworker.0 00000100:00100000:1.0:1788200965.464543:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715086336:0@lo:400:kworker.0 00000100:00100000:1.0:1788200965.464554:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715086848:0@lo:400:kworker.0 00000100:00100000:2.0:1788200965.464782:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715085952:12345-0@lo:400:kworker.0 Request processed in 7782us (8278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200965.464790:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:2.0:1788200965.464814:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715086464 00000100:00100000:2.0:1788200965.464819:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715086464 00000100:00100000:2.0:1788200965.464846:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3874 00000100:00100000:2.0:1788200965.464852:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120020e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715086464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200965.464883:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120020e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715086464:12345-0@lo:400:kworker.0 Request processed in 32us (8322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200965.464889:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3874 00000100:00100000:1.0:1788200965.464994:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715085952:0@lo:400:kworker.0 00000100:00100000:1.0:1788200965.465004:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715086464:0@lo:400:kworker.0 00000100:00080000:2.0:1788200965.465276:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788200965.465281:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788200965.465284:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788200965.465286:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788200965.465520:0:87176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715085824:12345-0@lo:400:kworker.0 Request processed in 8086us (8841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200965.465531:0:87176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788200965.465542:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715086720:12345-0@lo:400:kworker.0 Request processed in 1629us (9000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200965.465551:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2654 00000100:00100000:1.0:1788200965.465647:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715085824:0@lo:400:kworker.0 00000100:00100000:1.0:1788200965.465661:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715086720:0@lo:400:kworker.0 00000100:00100000:2.0:1788200965.594310:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200965.594361:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200965.594406:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200965.594438:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200965.594461:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200965.594540:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695352576 00000100:00100000:3.0:1788200965.594552:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695352576 00000100:00100000:3.0:1788200965.594629:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695352704 00000100:00100000:3.0:1788200965.594632:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695352704 00000100:00100000:3.0:1788200965.594659:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2658 00000100:00100000:3.0:1788200965.594669:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:4292087e-fa00-4621-b681-837afc99ae35+5:2400:x1875060695352576:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200965.594740:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:4292087e-fa00-4621-b681-837afc99ae35+5:2400:x1875060695352576:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 72us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200965.594748:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2658 00000100:00100000:3.0:1788200965.594768:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2659 00000100:00100000:3.0:1788200965.594775:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:4292087e-fa00-4621-b681-837afc99ae35+5:2400:x1875060695352704:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200965.594800:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:4292087e-fa00-4621-b681-837afc99ae35+5:2400:x1875060695352704:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200965.594807:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2659 00000100:00100000:0.0:1788200965.595494:0:87178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695352192 00000100:00100000:0.0:1788200965.595500:0:87178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695352192 00000100:00100000:0.0:1788200965.595545:0:87178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 83 00000100:00100000:0.0:1788200965.595553:0:87178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2400:x1875060695352192:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200965.595592:0:87178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2400:x1875060695352192:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 39us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200965.595625:0:87178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 83 00000100:00080000:2.0:1788200965.595717:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788200965.595723:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788200965.595936:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695352320 00000100:00100000:1.0:1788200965.595941:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695352320 00000100:00100000:1.0:1788200965.595991:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695352448 00000100:00100000:1.0:1788200965.595995:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695352448 00000100:00100000:3.0:1788200965.596115:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1198 00000100:00100000:3.0:1788200965.596126:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120021f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+8:2400:x1875060695352320:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200965.596166:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120021f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+8:2400:x1875060695352320:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 43us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200965.596174:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1198 00000100:00100000:3.0:1788200965.596191:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1199 00000100:00100000:3.0:1788200965.596197:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695352448:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200965.596249:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695352448:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 51us (1810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200965.596257:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1199 00000100:00080000:2.0:1788200965.596302:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788200965.596307:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788200965.906879:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788200965.967301:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788200965.967323:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715087360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788200965.967393:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200965.967482:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715087360 00000100:00100000:2.0:1788200965.967490:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715087360 00000100:00100000:2.0:1788200965.967537:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2156 00000100:00100000:2.0:1788200965.967546:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715087360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788200965.967575:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788200965.967657:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715087360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200965.967664:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2156 00000100:00100000:3.0:1788200965.967742:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715087360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788200965.968944:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715087488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788200965.969000:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200965.969051:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715087488 00000100:00100000:0.0:1788200965.969059:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715087488 00000100:00100000:0.0:1788200965.969100:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2157 00000100:00100000:0.0:1788200965.969110:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715087488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788200965.969133:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788200965.969201:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715087616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788200965.969238:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200965.969282:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715087616 00000100:00100000:2.0:1788200965.969286:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715087616 00000100:00100000:2.0:1788200965.969314:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3875 00000100:00100000:2.0:1788200965.969321:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715087616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788200965.969346:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444970496 avail 1298731008 00000100:00100000:2.0:1788200965.969385:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715087616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200965.969404:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3875 00000100:00100000:2.0:1788200965.969443:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715087616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788200965.978196:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715087488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9078us (9186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200965.978210:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2157 00000100:00100000:1.0:1788200965.981362:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715087488:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788200966.928256:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788200967.478734:0:87998:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 131a: DoM file write lock replay === 14:29:25 (1788200965) 00000100:00100000:3.0:1788200967.940913:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200967.943711:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695352832 00000100:00100000:2.0:1788200967.943728:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695352832 00000100:00100000:2.0:1788200967.943834:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1166 00000100:00100000:2.0:1788200967.943848:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+8:67852:x1875060695352832:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1788200967.943870:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788200967.943892:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6da00/0x96d0c9b8c9a1aec9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7865e7 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.943958:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ca00/0x96d0c9b8c9a1aed0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.943970:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ca00/0x96d0c9b8c9a1aed0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.943983:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ca00/0x96d0c9b8c9a1aed0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.943997:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c600/0x96d0c9b8c9a1aed7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.944004:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c600/0x96d0c9b8c9a1aed7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.944010:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c600/0x96d0c9b8c9a1aed7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.944116:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ca00/0x96d0c9b8c9a1aed0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.944123:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ca00/0x96d0c9b8c9a1aed0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.944129:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ca00/0x96d0c9b8c9a1aed0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.944135:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ca00/0x96d0c9b8c9a1aed0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.944152:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6ca00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788200967.944156:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ca00/0x96d0c9b8c9a1aed0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.944164:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ca00/0x96d0c9b8c9a1aed0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.944175:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a1e700) 00010000:00010000:2.0:1788200967.944177:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788200967.944181:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ca00/0x96d0c9b8c9a1aed0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.944187:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6ca00/0x96d0c9b8c9a1aed0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.944201:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c600/0x96d0c9b8c9a1aed7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.944217:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c600/0x96d0c9b8c9a1aed7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.944229:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c600/0x96d0c9b8c9a1aed7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.944234:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6c600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788200967.944238:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c600/0x96d0c9b8c9a1aed7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.944244:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c600/0x96d0c9b8c9a1aed7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.944251:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff8dc11248c600) 00010000:00010000:2.0:1788200967.944253:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788200967.944256:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c600/0x96d0c9b8c9a1aed7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.944261:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c600/0x96d0c9b8c9a1aed7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.944292:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6da00/0x96d0c9b8c9a1aec9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865e7 expref: 9 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.944302:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a1e700) 00010000:00010000:2.0:1788200967.944304:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788200967.944307:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6da00/0x96d0c9b8c9a1aec9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865e7 expref: 9 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.944315:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006c6da00, rc 0) 00000100:00100000:2.0:1788200967.944378:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+8:67852:x1875060695352832:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 534us (3474us total) trans 0 rc 301/301 00000100:00100000:2.0:1788200967.944393:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1166 00000100:00080000:3.0:1788200967.944886:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788200967.951113:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200967.951362:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695353088 00000100:00100000:0.0:1788200967.951373:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695353088 00000100:00100000:0.0:1788200967.951441:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1167 00000100:00100000:0.0:1788200967.951453:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+8:67852:x1875060695353088:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788200967.951476:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200967.951480:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788200967.951507:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759400/0x96d0c9b8c9a1ae60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865cb expref: 8 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200967.951527:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a1e700) 00010000:00010000:0.0:1788200967.951539:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788200967.951568:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758400/0x96d0c9b8c9a1aede lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7865ee expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200967.951686:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1aee5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200967.951699:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1aee5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200967.951721:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1aee5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200967.951734:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758600/0x96d0c9b8c9a1aeec lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200967.951741:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758600/0x96d0c9b8c9a1aeec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200967.951747:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758600/0x96d0c9b8c9a1aeec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200967.952511:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759e00/0x96d0c9b8c9a1aef3 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200967.952525:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759e00/0x96d0c9b8c9a1aef3 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200967.952533:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759e00/0x96d0c9b8c9a1aef3 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788200967.952966:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x6:0x0]: returning size 0 00010000:00010000:1.0:1788200967.953124:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1aee5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200967.953134:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1aee5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200967.953154:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1aee5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200967.953160:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1aee5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200967.953180:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140758200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788200967.953185:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1aee5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200967.953193:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1aee5 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200967.953205:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a1e200) 00010000:00010000:1.0:1788200967.953208:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788200967.953212:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1aee5 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200967.953218:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1aee5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788200967.953232:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6705f02 reply state 00000000206176eb transno 107374182403 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758600/0x96d0c9b8c9a1aeec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200967.953244:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758600/0x96d0c9b8c9a1aeec lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200967.953251:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff8dc103a1e100) 00010000:00010000:1.0:1788200967.953254:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788200967.953257:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788200967.953289:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758400/0x96d0c9b8c9a1aede lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865ee expref: 10 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200967.953309:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759e00/0x96d0c9b8c9a1aef3 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865ee expref: 9 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200967.953328:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8dc103a1eb00) 00010000:00010000:1.0:1788200967.953331:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788200967.953347:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140759e00, rc 0) 00000100:00100000:1.0:1788200967.953422:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+10:67852:x1875060695353088:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 1971us (2319us total) trans 107374182403 rc 0/0 00000100:00100000:1.0:1788200967.953431:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1167 00010000:00010000:0.0:1788200967.953955:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200967.977433:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200967.982804:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695353344 00000100:00100000:2.0:1788200967.982820:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695353344 00000100:00100000:2.0:1788200967.982952:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1168 00000100:00100000:2.0:1788200967.982965:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+10:67852:x1875060695353344:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1788200967.982989:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788200967.983013:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6da00/0x96d0c9b8c9a1af01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7865f5 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.983140:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c600/0x96d0c9b8c9a1af08 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.983157:0:66314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759e00/0x96d0c9b8c9a1aef3 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865ee expref: 11 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.983166:0:66314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c600/0x96d0c9b8c9a1af08 lrc: 4/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.983200:0:66314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759e00/0x96d0c9b8c9a1aef3 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865ee expref: 11 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200967.983230:0:66314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759e00/0x96d0c9b8c9a1aef3 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865ee expref: 11 pid: 66313 timeout: 3919 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200967.983244:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125641f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66314:1875060715087744:192.168.201.20@tcp:104: 00000100:00100000:2.0:1788200967.983336:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004bdecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788200967.986661:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125641f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66314:1875060715087744:192.168.201.20@tcp:104: 00010000:00010000:2.0:1788200967.986703:0:66314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c600/0x96d0c9b8c9a1af08 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788200968.002328:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200968.002621:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695353472 00000100:00100000:0.0:1788200968.002632:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695353472 00010000:00010000:0.0:1788200968.002671:0:26213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759e00/0x96d0c9b8c9a1aef3 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865ee expref: 12 pid: 66313 timeout: 3919 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200968.002714:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2551 00000100:00100000:0.0:1788200968.002724:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4292087e-fa00-4621-b681-837afc99ae35+12:2400:x1875060695353472:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788200968.002754:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788200968.002761:0:26213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759e00/0x96d0c9b8c9a1aef3 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865ee expref: 12 pid: 66313 timeout: 3919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200968.002775:0:26213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759e00/0x96d0c9b8c9a1aef3 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865ee expref: 12 pid: 66313 timeout: 3919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200968.002798:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759e00/0x96d0c9b8c9a1aef3 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865ee expref: 12 pid: 66313 timeout: 3919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200968.002813:0:26213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8dc103a1eb00) 00010000:00010000:0.0:1788200968.002818:0:26213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c600/0x96d0c9b8c9a1af08 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200968.002827:0:26213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c600/0x96d0c9b8c9a1af08 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200968.002833:0:26213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c600/0x96d0c9b8c9a1af08 lrc: 4/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200968.002871:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788200968.002931:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4292087e-fa00-4621-b681-837afc99ae35+11:2400:x1875060695353472:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 208us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200968.002939:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2551 00010000:00010000:2.0:1788200968.004176:0:66314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c600/0x96d0c9b8c9a1af08 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200968.004191:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c600/0x96d0c9b8c9a1af08 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788200968.004222:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x6:0x0]: returning size 0 00010000:00010000:2.0:1788200968.004489:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c600/0x96d0c9b8c9a1af08 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200968.004498:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c600/0x96d0c9b8c9a1af08 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200968.004504:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c600/0x96d0c9b8c9a1af08 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200968.004510:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6c600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788200968.004514:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c600/0x96d0c9b8c9a1af08 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200968.004521:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c600/0x96d0c9b8c9a1af08 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200968.004535:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8dc103a1eb00) 00010000:00010000:2.0:1788200968.004653:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788200968.004659:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c600/0x96d0c9b8c9a1af08 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200968.004667:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c600/0x96d0c9b8c9a1af08 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200968.004747:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6da00/0x96d0c9b8c9a1af01 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865f5 expref: 11 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200968.004758:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc11248c600) 00010000:00010000:2.0:1788200968.004760:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788200968.004764:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6da00/0x96d0c9b8c9a1af01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865f5 expref: 11 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200968.004776:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006c6da00, rc 0) 00000100:00100000:2.0:1788200968.005105:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+10:67852:x1875060695353344:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 22141us (27680us total) trans 107374182404 rc 301/301 00000100:00100000:2.0:1788200968.005114:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1168 00000100:00100000:1.0:1788200968.031176:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200968.033983:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695353728 00000100:00100000:0.0:1788200968.034000:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695353728 00000100:00100000:0.0:1788200968.034143:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 221 00000100:00100000:0.0:1788200968.034155:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4292087e-fa00-4621-b681-837afc99ae35+10:67852:x1875060695353728:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:0.0:1788200968.037781:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4292087e-fa00-4621-b681-837afc99ae35+11:67852:x1875060695353728:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 3613us (6600us total) trans 107374182405 rc 0/0 00000100:00100000:0.0:1788200968.037798:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 221 00000100:00100000:3.0:1788200968.044307:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200968.044679:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695353984 00000100:00100000:2.0:1788200968.044691:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695353984 00000100:00100000:2.0:1788200968.044759:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 222 00000100:00100000:2.0:1788200968.044770:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c5c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4292087e-fa00-4621-b681-837afc99ae35+11:67852:x1875060695353984:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:2.0:1788200968.045011:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c5c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4292087e-fa00-4621-b681-837afc99ae35+12:67852:x1875060695353984:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 242us (712us total) trans 107374182406 rc 0/0 00000100:00100000:2.0:1788200968.045059:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 222 00000100:00100000:1.0:1788200968.527269:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004c1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715087872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788200968.527349:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200968.527413:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715087872 00000100:00100000:1.0:1788200968.527422:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715087872 00000100:00100000:1.0:1788200968.527480:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2158 00000100:00100000:1.0:1788200968.527491:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715087872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788200968.527521:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200968.527580:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715087872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200968.527588:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2158 00000100:00080000:1.0:1788200968.527611:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788200968.527650:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004c1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715087872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788200968.531750:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715088000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788200968.531834:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200968.534176:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715088000 00000100:00100000:0.0:1788200968.534189:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715088000 00000100:00100000:0.0:1788200968.534285:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2159 00000100:00100000:0.0:1788200968.534296:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715088000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788200968.534336:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200968.534419:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715088000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (2585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200968.534425:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2159 00000100:00080000:1.0:1788200968.534670:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788200968.534723:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715088000:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788200968.979067:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788200969.209635:0:87171:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182406 is committed 00010000:00010000:1.0:1788200969.209715:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758600/0x96d0c9b8c9a1aeec lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200969.209728:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758600/0x96d0c9b8c9a1aeec lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200969.209736:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758600/0x96d0c9b8c9a1aeec lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200969.209742:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140758600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788200969.209748:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758600/0x96d0c9b8c9a1aeec lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200969.209755:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758600/0x96d0c9b8c9a1aeec lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200969.209772:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff8dc103a1e100) 00010000:00010000:1.0:1788200969.209775:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788200969.209780:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758600/0x96d0c9b8c9a1aeec lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200969.209787:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758600/0x96d0c9b8c9a1aeec lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788200969.301925:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200969.302081:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695354112 00000100:00100000:0.0:1788200969.302092:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695354112 00000100:00100000:0.0:1788200969.302161:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1169 00000100:00100000:0.0:1788200969.302171:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+7:67869:x1875060695354112:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788200969.302195:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200969.302218:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759000/0x96d0c9b8c9a1af16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7865fc expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.302283:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758e00/0x96d0c9b8c9a1af1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.302297:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758e00/0x96d0c9b8c9a1af1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.302307:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758e00/0x96d0c9b8c9a1af1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788200969.302384:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788200969.302388:0:69485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788200969.302408:0:69485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758e00/0x96d0c9b8c9a1af1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.302432:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759000/0x96d0c9b8c9a1af16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865fc expref: 9 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.302449:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758e00/0x96d0c9b8c9a1af1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865fc expref: 8 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.302457:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a1e700) 00010000:00010000:0.0:1788200969.302460:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788200969.302463:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140758e00, rc 0) 00000100:00100000:0.0:1788200969.302515:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+8:67869:x1875060695354112:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 345us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200969.302522:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1169 00000100:00080000:1.0:1788200969.302901:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788200969.318746:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200969.323440:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695354240 00000100:00100000:1.0:1788200969.323454:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695354240 00000100:00100000:1.0:1788200969.323522:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1170 00000100:00100000:1.0:1788200969.323532:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+8:67869:x1875060695354240:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:1.0:1788200969.323586:0:66313:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444970496 avail 1298731008 00000100:00100000:1.0:1788200969.323676:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+8:67869:x1875060695354240:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 145us (4939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200969.323684:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1170 00000100:00100000:0.0:1788200969.328193:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200969.331281:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695354368 00000100:00100000:2.0:1788200969.331295:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695354368 00000100:00080000:1.0:1788200969.331769:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788200969.331779:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1171 00000100:00100000:2.0:1788200969.331791:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:67869:x1875060695354368:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:2.0:1788200969.331835:0:66314:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:2.0:1788200969.331936:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:67869:x1875060695354368:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 148us (3753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200969.331943:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1171 00000100:00100000:2.0:1788200969.340604:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200969.340740:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695354496 00000100:00100000:1.0:1788200969.340751:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695354496 00000100:00080000:3.0:1788200969.340801:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788200969.340831:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2160 00000100:00100000:1.0:1788200969.340843:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:67869:x1875060695354496:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:1.0:1788200969.340875:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200969.340950:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:67869:x1875060695354496:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 111us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200969.340958:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2160 00000100:00100000:2.0:1788200969.344604:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200969.344700:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695354624 00000100:00100000:3.0:1788200969.344710:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695354624 00000100:00100000:3.0:1788200969.344811:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2161 00000100:00100000:3.0:1788200969.344822:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125641c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:67869:x1875060695354624:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:3.0:1788200969.344847:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200969.345119:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125641c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:67869:x1875060695354624:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 298us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200969.345128:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2161 00000100:00080000:2.0:1788200969.348765:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788200969.480301:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200969.480599:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695354880 00000100:00100000:2.0:1788200969.480611:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695354880 00000100:00100000:2.0:1788200969.480674:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1172 00000100:00100000:2.0:1788200969.480684:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+8:67876:x1875060695354880:12345-192.168.201.20@tcp:36:mcreate.0 00010000:00010000:2.0:1788200969.480741:0:66757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788200969.480771:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758e00/0x96d0c9b8c9a1af1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865fc expref: 8 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200969.480791:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a1e700) 00010000:00010000:2.0:1788200969.480806:0:66757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788200969.480887:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6dc00/0x96d0c9b8c9a1af24 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200969.480901:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6dc00/0x96d0c9b8c9a1af24 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200969.480910:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6dc00/0x96d0c9b8c9a1af24 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200969.480922:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6d800/0x96d0c9b8c9a1af2b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200969.480929:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6d800/0x96d0c9b8c9a1af2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200969.480954:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6d800/0x96d0c9b8c9a1af2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200969.481729:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6dc00/0x96d0c9b8c9a1af24 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200969.481742:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6dc00/0x96d0c9b8c9a1af24 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200969.481748:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6dc00/0x96d0c9b8c9a1af24 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200969.481755:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6dc00/0x96d0c9b8c9a1af24 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200969.481762:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6dc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788200969.481766:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6dc00/0x96d0c9b8c9a1af24 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200969.481774:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6dc00/0x96d0c9b8c9a1af24 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200969.481785:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc11248c900) 00010000:00010000:2.0:1788200969.481789:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788200969.481792:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6dc00/0x96d0c9b8c9a1af24 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200969.481799:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6dc00/0x96d0c9b8c9a1af24 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788200969.481816:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044856c34 reply state 00000000c12fd82b transno 107374182407 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6d800/0x96d0c9b8c9a1af2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200969.481836:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6d800/0x96d0c9b8c9a1af2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200969.481843:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc11248c300) 00010000:00010000:2.0:1788200969.482187:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788200969.482192:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788200969.482499:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+9:67876:x1875060695354880:12345-192.168.201.20@tcp:36:mcreate.0 Request processed in 1811us (2204us total) trans 107374182407 rc 0/0 00000100:00100000:3.0:1788200969.482519:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1172 00000100:00100000:2.0:1788200969.526763:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200969.527170:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695355008 00000100:00100000:2.0:1788200969.527180:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695355008 00000100:00100000:2.0:1788200969.527573:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1173 00000100:00100000:2.0:1788200969.527585:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+9:67879:x1875060695355008:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:2.0:1788200969.527607:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788200969.527630:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6dc00/0x96d0c9b8c9a1af32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786603 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200969.527692:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1af39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200969.527706:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1af39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200969.527718:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1af39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788200969.527759:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788200969.527764:0:66313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788200969.527786:0:66313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1af39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200969.527809:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6dc00/0x96d0c9b8c9a1af32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786603 expref: 11 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200969.527836:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1af39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786603 expref: 10 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200969.527845:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc11248c900) 00010000:00010000:2.0:1788200969.527849:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788200969.527852:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006c6c000, rc 0) 00000100:00100000:2.0:1788200969.527906:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+10:67879:x1875060695355008:12345-192.168.201.20@tcp:101:rm.0 Request processed in 324us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200969.527914:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1173 00000100:00100000:2.0:1788200969.548005:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200969.548113:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695355136 00000100:00100000:0.0:1788200969.548124:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695355136 00000100:00100000:0.0:1788200969.548189:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1174 00000100:00100000:0.0:1788200969.548199:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13336ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+10:67879:x1875060695355136:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1788200969.548221:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788200969.548241:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758c00/0x96d0c9b8c9a1af40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78660a expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548325:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758a00/0x96d0c9b8c9a1af47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548358:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758a00/0x96d0c9b8c9a1af47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548373:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758a00/0x96d0c9b8c9a1af47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548386:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759600/0x96d0c9b8c9a1af4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548393:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759600/0x96d0c9b8c9a1af4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548399:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759600/0x96d0c9b8c9a1af4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548480:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759a00/0x96d0c9b8c9a1af55 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548489:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759a00/0x96d0c9b8c9a1af55 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548496:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759a00/0x96d0c9b8c9a1af55 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788200969.548552:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788200969.548556:0:69485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788200969.548578:0:69485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759a00/0x96d0c9b8c9a1af55 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548590:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759a00/0x96d0c9b8c9a1af55 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548609:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758a00/0x96d0c9b8c9a1af47 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548616:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758a00/0x96d0c9b8c9a1af47 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548622:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758a00/0x96d0c9b8c9a1af47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548629:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758a00/0x96d0c9b8c9a1af47 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548636:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140758a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788200969.548641:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758a00/0x96d0c9b8c9a1af47 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548649:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758a00/0x96d0c9b8c9a1af47 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548661:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc11248c900) 00010000:00010000:0.0:1788200969.548664:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788200969.548668:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758a00/0x96d0c9b8c9a1af47 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548675:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758a00/0x96d0c9b8c9a1af47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548688:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759600/0x96d0c9b8c9a1af4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548694:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759600/0x96d0c9b8c9a1af4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548706:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759600/0x96d0c9b8c9a1af4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548711:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140759600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788200969.548714:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759600/0x96d0c9b8c9a1af4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548720:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759600/0x96d0c9b8c9a1af4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548728:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc11248c300) 00010000:00010000:0.0:1788200969.548730:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788200969.548733:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759600/0x96d0c9b8c9a1af4e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548739:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759600/0x96d0c9b8c9a1af4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548766:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758c00/0x96d0c9b8c9a1af40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78660a expref: 12 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548781:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759a00/0x96d0c9b8c9a1af55 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78660a expref: 11 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.548788:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff8dc103a1e300) 00010000:00010000:0.0:1788200969.548790:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788200969.548793:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140759a00, rc 0) 00000100:00100000:0.0:1788200969.549092:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13336ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+11:67879:x1875060695355136:12345-192.168.201.20@tcp:101:rm.0 Request processed in 893us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200969.549110:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1174 00000100:00100000:2.0:1788200969.556510:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200969.556608:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695355392 00000100:00100000:3.0:1788200969.556619:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695355392 00000100:00100000:3.0:1788200969.556704:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1175 00000100:00100000:3.0:1788200969.556716:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13336bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+11:67879:x1875060695355392:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:3.0:1788200969.556768:0:66757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788200969.556795:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140759a00/0x96d0c9b8c9a1af55 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78660a expref: 11 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.556813:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff8dc103a1e300) 00010000:00010000:3.0:1788200969.556830:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1af39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786603 expref: 10 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.556839:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc11248c900) 00010000:00010000:3.0:1788200969.556845:0:66757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788200969.556948:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1af5c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.556962:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1af5c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.556971:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1af5c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.556981:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1af63 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.556989:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1af63 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.557011:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1af63 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.557504:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1af6a lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.557514:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1af6a lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.557521:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1af6a lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.557725:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1af71 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.557735:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1af71 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.557742:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1af71 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.557749:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1af71 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.557755:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1af71 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.557761:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1af71 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.557783:0:66757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200969.557805:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1af6a lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.557818:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1af6a lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.557825:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1af6a lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.557832:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788200969.557837:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1af6a lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.557845:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1af6a lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.557855:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff8dc005cc6500) 00010000:00010000:0.0:1788200969.557972:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788200969.557979:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1af71 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.558003:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788200969.558007:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1af6a lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.558038:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1af6a lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.558057:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1af5c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.558064:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1af5c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.558071:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1af5c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.558077:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1af5c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.558089:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788200969.558092:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1af5c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.558099:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1af5c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.558108:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc005cc6a00) 00010000:00010000:3.0:1788200969.558110:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788200969.558113:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1af5c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.558120:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1af5c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788200969.558136:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016ee6dc3 reply state 00000000b4d62962 transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1af63 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.558148:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1af63 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200969.558155:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc11248c300) 00010000:00010000:3.0:1788200969.558157:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788200969.558160:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788200969.558389:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13336bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+11:67879:x1875060695355392:12345-192.168.201.20@tcp:36:rm.0 Request processed in 1672us (1886us total) trans 107374182408 rc 0/0 00000100:00100000:3.0:1788200969.558398:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1175 00010000:00010000:0.0:1788200969.565228:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064eca00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788200969.565240:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1af71 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.565255:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1af71 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.565275:0:13349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff8dc005cc6500) 00010000:00010000:0.0:1788200969.565278:0:13349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788200969.565283:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1af71 lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200969.565289:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1af71 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200969.565425:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200969.565428:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200969.565431:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788200969.999583:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200970.576347:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788200970.576375:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715088128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788200970.576454:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200970.576505:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715088128 00000100:00100000:1.0:1788200970.576512:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715088128 00000100:00100000:1.0:1788200970.576569:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3876 00000100:00100000:1.0:1788200970.576579:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715088128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788200970.576615:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:1.0:1788200970.576675:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715088128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200970.576693:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3876 00000100:00100000:1.0:1788200970.576746:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715088128:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788200970.577142:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715088640:0@lo:400:kworker.0 00000100:00100000:0.0:1788200970.577189:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200970.577211:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0073b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715089152:0@lo:400:kworker.0 00000100:00100000:0.0:1788200970.577236:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200970.577254:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715089664:0@lo:400:kworker.0 00000100:00100000:0.0:1788200970.577274:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200970.577291:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788200970.577296:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715088256:0@lo:400:kworker.0 00000100:00100000:0.0:1788200970.577332:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200970.577355:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715088768:0@lo:400:kworker.0 00000100:00100000:0.0:1788200970.577375:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200970.577391:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715089280:0@lo:400:kworker.0 00000100:00100000:0.0:1788200970.577411:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200970.577436:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715088640 00000100:00100000:0.0:1788200970.577440:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715088640 00000100:00100000:0.0:1788200970.577473:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715089664 00000100:00100000:0.0:1788200970.577476:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715089664 00000100:00100000:0.0:1788200970.577488:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715088768 00000100:00100000:0.0:1788200970.577490:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715088768 00000100:00100000:0.0:1788200970.577501:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715089280 00000100:00100000:0.0:1788200970.577503:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715089280 00000100:00100000:0.0:1788200970.577515:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:0.0:1788200970.577521:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715088640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200970.577570:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715088640:12345-0@lo:400:kworker.0 Request processed in 49us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200970.577577:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:0.0:1788200970.577590:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:0.0:1788200970.577596:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715089664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200970.577619:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715089664:12345-0@lo:400:kworker.0 Request processed in 23us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200970.577625:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:0.0:1788200970.577634:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:0.0:1788200970.577640:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715088768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200970.578548:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715088768:12345-0@lo:400:kworker.0 Request processed in 904us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200970.578568:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:0.0:1788200970.578588:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:0.0:1788200970.578596:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715089280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200970.578629:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715089280:12345-0@lo:400:kworker.0 Request processed in 35us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200970.578633:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:1.0:1788200970.578870:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715088384:0@lo:400:kworker.0 00000100:00100000:1.0:1788200970.578910:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200970.578950:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715088896:0@lo:400:kworker.0 00000100:00100000:1.0:1788200970.578975:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200970.578995:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715089408:0@lo:400:kworker.0 00000100:00100000:1.0:1788200970.579041:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200970.579064:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788200970.579070:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715088512:0@lo:400:kworker.0 00000100:00100000:1.0:1788200970.579093:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200970.579105:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0073bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715089024:0@lo:400:kworker.0 00000100:00100000:1.0:1788200970.579126:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200970.579143:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715089536:0@lo:400:kworker.0 00000100:00100000:1.0:1788200970.579164:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200970.579196:0:87177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715088256 00000100:00100000:1.0:1788200970.579203:0:87177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715088256 00000100:00100000:1.0:1788200970.579241:0:87177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788200970.579248:0:87177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715088256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200970.579282:0:87177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715088256:12345-0@lo:400:kworker.0 Request processed in 34us (1950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200970.579289:0:87177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788200970.579324:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715088896 00000100:00100000:1.0:1788200970.579328:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715088896 00000100:00100000:1.0:1788200970.579363:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3877 00000100:00100000:1.0:1788200970.579369:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715088896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200970.579403:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715088896:12345-0@lo:400:kworker.0 Request processed in 35us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200970.579410:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3877 00000100:00100000:1.0:1788200970.579427:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715089152 00000100:00100000:1.0:1788200970.579430:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715089152 00000100:00100000:1.0:1788200970.579455:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715089408 00000100:00100000:1.0:1788200970.579458:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715089408 00000100:00100000:1.0:1788200970.579476:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715089024 00000100:00100000:1.0:1788200970.579480:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715089024 00000100:00100000:1.0:1788200970.579496:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715089536 00000100:00100000:1.0:1788200970.579499:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715089536 00000100:00100000:1.0:1788200970.579518:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2660 00000100:00100000:1.0:1788200970.579535:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715089152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200970.579569:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715089152:12345-0@lo:400:kworker.0 Request processed in 45us (2332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200970.579575:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2660 00000100:00100000:1.0:1788200970.579588:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2661 00000100:00100000:1.0:1788200970.579593:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715089408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200970.579618:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715089408:12345-0@lo:400:kworker.0 Request processed in 25us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200970.579623:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2661 00000100:00100000:1.0:1788200970.579632:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2662 00000100:00100000:1.0:1788200970.579637:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715089024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200970.579673:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715089024:12345-0@lo:400:kworker.0 Request processed in 36us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200970.579691:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2662 00000100:00100000:1.0:1788200970.579703:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2663 00000100:00100000:1.0:1788200970.579709:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715089536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200970.579735:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715089536:12345-0@lo:400:kworker.0 Request processed in 27us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200970.579741:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2663 00000100:00100000:1.0:1788200970.579804:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0073bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715089024:0@lo:400:kworker.0 00000100:00100000:1.0:1788200970.579815:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715089536:0@lo:400:kworker.0 00000100:00100000:1.0:1788200970.579824:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715088896:0@lo:400:kworker.0 00000100:00100000:1.0:1788200970.579832:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715089408:0@lo:400:kworker.0 00000100:00100000:2.0:1788200970.580095:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715088384 00000100:00100000:2.0:1788200970.580102:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715088384 00000100:00100000:2.0:1788200970.580131:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715088512 00000100:00100000:2.0:1788200970.580134:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715088512 00000100:00100000:2.0:1788200970.580150:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:2.0:1788200970.580156:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715088384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200970.580218:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715088384:12345-0@lo:400:kworker.0 Request processed in 62us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200970.580225:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:2.0:1788200970.580237:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:2.0:1788200970.580243:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715088512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200970.580271:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715088512:12345-0@lo:400:kworker.0 Request processed in 28us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200970.580276:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00080000:0.0:1788200970.580433:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788200970.580438:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788200970.580441:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788200970.580443:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788200970.580474:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715088256:0@lo:400:kworker.0 00000100:00100000:0.0:1788200970.580487:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715088768:0@lo:400:kworker.0 00000100:00100000:0.0:1788200970.580499:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715089280:0@lo:400:kworker.0 00000100:00100000:0.0:1788200970.580509:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715088640:0@lo:400:kworker.0 00000100:00100000:0.0:1788200970.580520:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0073b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715089152:0@lo:400:kworker.0 00000100:00100000:0.0:1788200970.580542:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715089664:0@lo:400:kworker.0 00000100:00100000:1.0:1788200970.583665:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715088512:0@lo:400:kworker.0 00000100:00100000:1.0:1788200970.583683:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715088384:0@lo:400:kworker.0 00000100:00100000:0.0:1788200970.718867:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200970.718913:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200970.718947:0:87181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695355520 00000100:00100000:0.0:1788200970.718955:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200970.718959:0:87181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695355520 00000100:00100000:0.0:1788200970.718982:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200970.719012:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200970.719063:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695356032 00000100:00100000:3.0:1788200970.719063:0:87181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00100000:0.0:1788200970.719069:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695356032 00000100:00100000:3.0:1788200970.719077:0:87181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695355520:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200970.719104:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695355904 00000100:00100000:0.0:1788200970.719117:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695355904 00000100:00100000:0.0:1788200970.719147:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2664 00000100:00100000:0.0:1788200970.719157:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4292087e-fa00-4621-b681-837afc99ae35+5:2401:x1875060695356032:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200970.719165:0:87181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695355520:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 90us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200970.719175:0:87181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00100000:0.0:1788200970.719196:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4292087e-fa00-4621-b681-837afc99ae35+5:2401:x1875060695356032:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 40us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200970.719205:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2664 00000100:00100000:0.0:1788200970.719223:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2665 00000100:00100000:0.0:1788200970.719231:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4292087e-fa00-4621-b681-837afc99ae35+5:2401:x1875060695355904:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788200970.719317:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695355776 00000100:00100000:1.0:1788200970.719323:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695355776 00000100:00100000:1.0:1788200970.719354:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695355648 00000100:00100000:1.0:1788200970.719357:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695355648 00000100:00100000:1.0:1788200970.719377:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1206 00000100:00100000:1.0:1788200970.719384:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695355776:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200970.728331:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1207 00000100:00100000:0.0:1788200970.728355:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+11:2401:x1875060695355648:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000080:0.0:1788200970.728393:0:69485:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc0058a9f80 x1875060695355648/t0(0) o400->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:91/0 lens 224/224 e 0 to 0 dl 1788200981 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788200970.728470:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+11:2401:x1875060695355648:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 126us (9488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200970.728477:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1207 00000100:00100000:0.0:1788200970.728557:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4292087e-fa00-4621-b681-837afc99ae35+5:2401:x1875060695355904:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 9326us (9544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200970.728576:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2665 00000100:00100000:0.0:1788200970.742544:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695355776:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23139us (23609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200970.742562:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1206 00010000:00010000:0.0:1788200971.024154:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788200971.087562:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715089792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788200971.087639:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200971.088478:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715089792 00000100:00100000:1.0:1788200971.088490:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715089792 00000100:00100000:1.0:1788200971.088562:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2162 00000100:00100000:1.0:1788200971.088573:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715089792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788200971.088604:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200971.092459:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715089792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3879us (4811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200971.092475:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2162 00000100:00100000:1.0:1788200971.092546:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715089920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788200971.092614:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200971.092657:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788200971.092665:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715090048:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788200971.092697:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200971.092794:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715089920 00000100:00100000:3.0:1788200971.092803:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715089920 00000100:00100000:3.0:1788200971.092856:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2163 00000100:00100000:3.0:1788200971.092866:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715089920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788200971.092908:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200971.092952:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715089920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200971.092958:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2163 00000100:00100000:1.0:1788200971.093178:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715089920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788200971.097198:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715089792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788200971.097469:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715090048 00000100:00100000:2.0:1788200971.097477:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715090048 00000100:00100000:2.0:1788200971.097542:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3878 00000100:00100000:2.0:1788200971.097553:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715090048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788200971.097589:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444970496 avail 1298731008 00010000:00000080:2.0:1788200971.097606:0:8457:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11cc11c00 x1875060715090048/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:92/0 lens 224/368 e 0 to 0 dl 1788200982 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788200971.097702:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715090048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (5003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200971.097710:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3878 00000100:00100000:3.0:1788200971.097877:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715090048:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788200972.050153:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200973.077748:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200973.648150:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715090176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788200973.648234:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200973.648298:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715090176 00000100:00100000:1.0:1788200973.648306:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715090176 00000100:00100000:1.0:1788200973.648371:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2164 00000100:00100000:1.0:1788200973.648382:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715090176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788200973.648416:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200973.648463:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715090176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200973.648483:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2164 00000100:00100000:1.0:1788200973.648545:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715090176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788200973.648725:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715090304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788200973.648758:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788200973.648801:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788200973.648928:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715090304 00000100:00100000:1.0:1788200973.648933:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715090304 00000100:00100000:1.0:1788200973.648974:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2165 00000100:00100000:1.0:1788200973.648982:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715090304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788200973.648999:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200973.649067:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715090304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200973.649073:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2165 00000100:00080000:0.0:1788200973.649132:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788200973.649159:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715090304:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788200974.096430:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200975.121001:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788200975.695390:0:87171:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182408 is committed 00010000:00010000:3.0:1788200975.695463:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6d800/0x96d0c9b8c9a1af2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200975.695475:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6d800/0x96d0c9b8c9a1af2b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200975.695483:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6d800/0x96d0c9b8c9a1af2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200975.695489:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6d800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788200975.695494:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6d800/0x96d0c9b8c9a1af2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200975.695513:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6d800/0x96d0c9b8c9a1af2b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200975.695533:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc11248c300) 00010000:00010000:3.0:1788200975.695537:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788200975.695542:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6d800/0x96d0c9b8c9a1af2b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200975.695548:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6d800/0x96d0c9b8c9a1af2b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200975.695567:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1af63 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200975.695573:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1af63 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200975.695579:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1af63 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200975.695585:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788200975.695588:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1af63 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200975.695594:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1af63 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200975.695601:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc11248c300) 00010000:00010000:3.0:1788200975.695605:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788200975.695608:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1af63 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200975.695620:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1af63 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788200975.696057:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715090432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788200975.696122:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200975.696339:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715090432 00000100:00100000:1.0:1788200975.696348:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715090432 00000100:00100000:1.0:1788200975.696400:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3879 00000100:00100000:1.0:1788200975.696410:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715090432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788200975.696469:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:1.0:1788200975.696525:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715090432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200975.696532:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3879 00000100:00100000:3.0:1788200975.696602:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715090432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788200975.700582:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715090688:0@lo:400:kworker.0 00000100:00100000:1.0:1788200975.700658:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200975.700691:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0073b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715091200:0@lo:400:kworker.0 00000100:00100000:1.0:1788200975.700717:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200975.700736:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715091712:0@lo:400:kworker.0 00000100:00100000:3.0:1788200975.700839:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715090944:0@lo:400:kworker.0 00000100:00100000:3.0:1788200975.700871:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200975.700893:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715091456:0@lo:400:kworker.0 00000100:00100000:3.0:1788200975.700918:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200975.700935:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715091968:0@lo:400:kworker.0 00000100:00100000:3.0:1788200975.700957:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200975.700984:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788200975.700991:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715090560:0@lo:400:kworker.0 00000100:00100000:3.0:1788200975.701048:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200975.701077:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715091072:0@lo:400:kworker.0 00000100:00100000:3.0:1788200975.701099:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200975.701119:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715091584:0@lo:400:kworker.0 00000100:00100000:3.0:1788200975.701147:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200975.701183:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715090688 00000100:00100000:3.0:1788200975.701191:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715090688 00000100:00100000:3.0:1788200975.701265:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715090944 00000100:00100000:3.0:1788200975.701269:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715090944 00000100:00100000:3.0:1788200975.701285:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715091968 00000100:00100000:3.0:1788200975.701288:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715091968 00000100:00100000:3.0:1788200975.701316:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715091072 00000100:00100000:3.0:1788200975.701319:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715091072 00000100:00100000:3.0:1788200975.701335:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715091584 00000100:00100000:3.0:1788200975.701338:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715091584 00000100:00100000:3.0:1788200975.701363:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:3.0:1788200975.701371:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715090688:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788200975.701396:0:69485:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc1331dfb80 x1875060715090688/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:96/0 lens 224/224 e 0 to 0 dl 1788200986 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788200975.701453:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715090688:12345-0@lo:400:kworker.0 Request processed in 83us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200975.701461:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:3.0:1788200975.701481:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:3.0:1788200975.701487:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715090944:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788200975.701499:0:69485:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004be4380 x1875060715090944/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:96/0 lens 224/224 e 0 to 0 dl 1788200986 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788200975.701532:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715090944:12345-0@lo:400:kworker.0 Request processed in 45us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200975.701538:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00100000:3.0:1788200975.701552:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:3.0:1788200975.701559:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715091968:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788200975.701571:0:69485:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004be7b80 x1875060715091968/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:96/0 lens 224/224 e 0 to 0 dl 1788200986 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788200975.701596:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715091968:12345-0@lo:400:kworker.0 Request processed in 38us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200975.701601:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00100000:3.0:1788200975.701613:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:3.0:1788200975.701628:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715091072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200975.701658:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715091072:12345-0@lo:400:kworker.0 Request processed in 33us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200975.701664:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00100000:3.0:1788200975.701678:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1212 00000100:00100000:3.0:1788200975.701684:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715091584:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788200975.701692:0:69485:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004d70e00 x1875060715091584/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:96/0 lens 224/224 e 0 to 0 dl 1788200986 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788200975.701714:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715091584:12345-0@lo:400:kworker.0 Request processed in 31us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200975.701719:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1212 00000100:00100000:3.0:1788200975.701736:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715091456 00000100:00100000:3.0:1788200975.701740:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715091456 00000100:00100000:3.0:1788200975.701909:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2666 00000100:00100000:3.0:1788200975.701915:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715091456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200975.701946:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715091456:12345-0@lo:400:kworker.0 Request processed in 31us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200975.701952:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2666 00000100:00100000:3.0:1788200975.701973:0:87177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715090560 00000100:00100000:3.0:1788200975.701977:0:87177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715090560 00000100:00100000:3.0:1788200975.702003:0:87177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788200975.702011:0:87177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b83a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715090560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200975.702067:0:87177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b83a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715090560:12345-0@lo:400:kworker.0 Request processed in 57us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200975.702073:0:87177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1788200975.702107:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788200975.702118:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788200975.702121:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788200975.702161:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715090560:0@lo:400:kworker.0 00000100:00100000:3.0:1788200975.702175:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715091072:0@lo:400:kworker.0 00000100:00100000:3.0:1788200975.702265:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715091584:0@lo:400:kworker.0 00000100:00100000:3.0:1788200975.702281:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715090944:0@lo:400:kworker.0 00000100:00100000:3.0:1788200975.702291:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715091456:0@lo:400:kworker.0 00000100:00100000:3.0:1788200975.702301:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715091968:0@lo:400:kworker.0 00000100:00100000:1.0:1788200975.702542:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200975.702600:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715090688:0@lo:400:kworker.0 00000100:00100000:1.0:1788200975.702617:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788200975.702627:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715090816:0@lo:400:kworker.0 00000100:00100000:1.0:1788200975.702663:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200975.702696:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0073bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715091328:0@lo:400:kworker.0 00000100:00100000:1.0:1788200975.702724:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200975.702830:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715090816 00000100:00100000:2.0:1788200975.702836:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715090816 00000100:00100000:2.0:1788200975.702871:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:2.0:1788200975.702878:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715090816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200975.702913:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715090816:12345-0@lo:400:kworker.0 Request processed in 36us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200975.702919:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00000100:00100000:1.0:1788200975.702961:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715091840:0@lo:400:kworker.0 00000100:00100000:1.0:1788200975.702987:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200975.703060:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715090816:0@lo:400:kworker.0 00000100:00100000:1.0:1788200975.703094:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715091200 00000100:00100000:1.0:1788200975.703098:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715091200 00000100:00100000:1.0:1788200975.703137:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3880 00000100:00100000:1.0:1788200975.703146:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715091200:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788200975.703164:0:8457:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc1331dce00 x1875060715091200/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:96/0 lens 224/224 e 0 to 0 dl 1788200986 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788200975.703303:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715091712 00000100:00100000:2.0:1788200975.703309:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715091712 00000100:00100000:2.0:1788200975.703338:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715091328 00000100:00100000:2.0:1788200975.703341:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715091328 00000100:00100000:2.0:1788200975.703364:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715091840 00000100:00100000:2.0:1788200975.703366:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715091840 00000100:00100000:2.0:1788200975.703389:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2667 00000100:00100000:2.0:1788200975.703397:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715091712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200975.703449:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715091712:12345-0@lo:400:kworker.0 Request processed in 38us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200975.703463:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2667 00000100:00100000:2.0:1788200975.703477:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2668 00000100:00100000:2.0:1788200975.703483:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715091328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200975.703513:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715091328:12345-0@lo:400:kworker.0 Request processed in 32us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200975.703518:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2668 00000100:00100000:2.0:1788200975.703528:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2669 00000100:00100000:2.0:1788200975.703534:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715091840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200975.703561:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715091840:12345-0@lo:400:kworker.0 Request processed in 27us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200975.703565:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2669 00000100:00100000:1.0:1788200975.703653:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715091200:12345-0@lo:400:kworker.0 Request processed in 509us (2934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200975.703660:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3880 00000100:00100000:1.0:1788200975.703701:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0073bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715091328:0@lo:400:kworker.0 00000100:00100000:1.0:1788200975.703710:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715091840:0@lo:400:kworker.0 00000100:00100000:1.0:1788200975.703719:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0073b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715091200:0@lo:400:kworker.0 00000100:00100000:1.0:1788200975.703727:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715091712:0@lo:400:kworker.0 00000100:00080000:3.0:1788200975.704847:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788200975.704863:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788200975.704867:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788200975.827457:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200975.827507:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200975.827530:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200975.827549:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200975.827574:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200975.827607:0:87181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695356160 00000100:00100000:3.0:1788200975.827619:0:87181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695356160 00000100:00100000:3.0:1788200975.827689:0:87181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 87 00000100:00100000:3.0:1788200975.827702:0:87181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b839c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2402:x1875060695356160:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200975.827781:0:87181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b839c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2402:x1875060695356160:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 82us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200975.827790:0:87181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 87 00000100:00100000:3.0:1788200975.827825:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695356288 00000100:00100000:3.0:1788200975.827829:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695356288 00000100:00100000:3.0:1788200975.827888:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695356416 00000100:00100000:3.0:1788200975.827892:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695356416 00000100:00100000:3.0:1788200975.827942:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1214 00000100:00100000:3.0:1788200975.827953:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+7:2403:x1875060695356288:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000080:3.0:1788200975.827977:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004d70a80 x1875060695356288/t0(0) o400->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:96/0 lens 224/224 e 0 to 0 dl 1788200986 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788200975.828004:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+7:2403:x1875060695356288:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 57us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200975.828011:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1214 00000100:00100000:3.0:1788200975.828068:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1215 00000100:00100000:3.0:1788200975.828076:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695356416:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200975.828102:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695356416:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 28us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200975.828107:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1215 00000100:00100000:3.0:1788200975.828127:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695356544 00000100:00100000:3.0:1788200975.828130:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695356544 00000100:00100000:3.0:1788200975.828158:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695356672 00000100:00100000:3.0:1788200975.828480:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695356672 00000100:00100000:3.0:1788200975.828573:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2670 00000100:00100000:3.0:1788200975.828584:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695356544:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200975.828625:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695356544:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 45us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200975.828632:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2670 00000100:00100000:3.0:1788200975.828656:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2671 00000100:00100000:3.0:1788200975.828666:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4292087e-fa00-4621-b681-837afc99ae35+5:2402:x1875060695356672:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200975.828712:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4292087e-fa00-4621-b681-837afc99ae35+5:2402:x1875060695356672:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 49us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200975.828721:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2671 00000100:00080000:3.0:1788200975.828991:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788200975.828996:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788200975.829000:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788200975.829005:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788200976.144008:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788200976.207529:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788200976.207554:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715092096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788200976.207622:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200976.207707:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715092096 00000100:00100000:2.0:1788200976.207716:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715092096 00000100:00100000:2.0:1788200976.207768:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2166 00000100:00100000:2.0:1788200976.207778:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715092096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788200976.207807:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788200976.207858:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715092096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200976.207865:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2166 00000100:00100000:3.0:1788200976.207941:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715092096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788200976.208155:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715092224:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788200976.208187:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200976.208261:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715092224 00000100:00100000:3.0:1788200976.208266:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715092224 00000100:00100000:3.0:1788200976.208303:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3881 00000100:00100000:3.0:1788200976.208310:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715092224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788200976.208334:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444970496 avail 1298731008 00010000:00000080:3.0:1788200976.208350:0:83817:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc133369c00 x1875060715092224/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:97/0 lens 224/368 e 0 to 0 dl 1788200987 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788200976.208389:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715092224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200976.208395:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3881 00000100:00100000:3.0:1788200976.208438:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715092224:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788200976.221358:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788200976.221383:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715092352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788200976.221462:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200976.221524:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715092352 00000100:00100000:1.0:1788200976.221532:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715092352 00000100:00100000:1.0:1788200976.221581:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2167 00000100:00100000:1.0:1788200976.221590:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715092352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788200976.221620:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200976.221670:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715092352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200976.221690:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2167 00000100:00100000:1.0:1788200976.221743:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715092352:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788200976.298605:0:88393:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:2.0:1788200976.378700:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200976.378839:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695356800 00000100:00100000:3.0:1788200976.378849:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695356800 00000100:00100000:3.0:1788200976.378916:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1176 00000100:00100000:3.0:1788200976.378926:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+7:67947:x1875060695356800:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:3.0:1788200976.378958:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788200976.378982:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1af78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786611 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200976.379078:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1af7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200976.379095:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1af7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200976.379109:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1af7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788200976.379158:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788200976.379161:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788200976.379395:0:66312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1af7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200976.379421:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1af78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786611 expref: 9 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200976.379452:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1af7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786611 expref: 8 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200976.379459:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc11d3a3200) 00010000:00010000:3.0:1788200976.379462:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788200976.379465:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ec800, rc 0) 00010000:00000080:3.0:1788200976.379472:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc00715bb80 x1875060695356800/t0(0) o101->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:97/0 lens 576/688 e 0 to 0 dl 1788200987 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788200976.379540:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+8:67947:x1875060695356800:12345-192.168.201.20@tcp:101:dd.0 Request processed in 616us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200976.379554:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1176 00000100:00100000:3.0:1788200976.391919:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200976.392836:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695357056 00000100:00100000:1.0:1788200976.392851:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695357056 00000100:00100000:2.0:1788200976.393048:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1177 00000100:00100000:2.0:1788200976.393061:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+8:67947:x1875060695357056:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:2.0:1788200976.393096:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788200976.393099:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788200976.393126:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1af7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786611 expref: 8 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393146:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc11d3a3200) 00010000:00010000:2.0:1788200976.393158:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788200976.393175:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6d200/0x96d0c9b8c9a1af86 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786618 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393477:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1af8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393491:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1af8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393502:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1af8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393515:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6dc00/0x96d0c9b8c9a1af94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393522:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6dc00/0x96d0c9b8c9a1af94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393528:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6dc00/0x96d0c9b8c9a1af94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393601:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c800/0x96d0c9b8c9a1af9b lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393618:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c800/0x96d0c9b8c9a1af9b lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393625:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c800/0x96d0c9b8c9a1af9b lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788200976.393737:0:66313:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:2.0:1788200976.393741:0:66313:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 0 -> 1788200967 00000004:00010000:2.0:1788200976.393744:0:66313:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 0 -> 1788200967 00000004:00010000:2.0:1788200976.393746:0:66313:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 0 -> 1788200967 00000004:00010000:2.0:1788200976.393749:0:66313:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:2.0:1788200976.393752:0:66313:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:2.0:1788200976.393759:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1af8d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393766:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1af8d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393772:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1af8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393779:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1af8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393784:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6c000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788200976.393789:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1af8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393796:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1af8d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393816:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc11248c400) 00010000:00010000:2.0:1788200976.393819:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788200976.393823:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1af8d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393829:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c000/0x96d0c9b8c9a1af8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393842:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6dc00/0x96d0c9b8c9a1af94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393848:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6dc00/0x96d0c9b8c9a1af94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393855:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6dc00/0x96d0c9b8c9a1af94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393860:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6dc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788200976.393863:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6dc00/0x96d0c9b8c9a1af94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393869:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6dc00/0x96d0c9b8c9a1af94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393877:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff8dc11248c500) 00010000:00010000:2.0:1788200976.393880:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788200976.393883:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6dc00/0x96d0c9b8c9a1af94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393889:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6dc00/0x96d0c9b8c9a1af94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393942:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6d200/0x96d0c9b8c9a1af86 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786618 expref: 10 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393958:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c800/0x96d0c9b8c9a1af9b lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786618 expref: 9 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.393966:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8dc11248c000) 00010000:00010000:2.0:1788200976.393968:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1788200976.393971:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006c6c800, rc 0) 00010000:00000080:2.0:1788200976.393978:0:66313:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004d72d80 x1875060695357056/t107374182409(0) o101->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:97/0 lens 752/824 e 0 to 0 dl 1788200987 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788200976.394703:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+9:67947:x1875060695357056:12345-192.168.201.20@tcp:101:dd.0 Request processed in 1641us (2791us total) trans 107374182409 rc 0/0 00000100:00100000:2.0:1788200976.394713:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1177 00000100:00100000:3.0:1788200976.406174:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200976.406284:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695357184 00000100:00100000:1.0:1788200976.406297:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695357184 00000100:00100000:1.0:1788200976.406356:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1178 00000100:00100000:1.0:1788200976.406367:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+9:67947:x1875060695357184:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:1.0:1788200976.406392:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788200976.406415:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad200/0x96d0c9b8c9a1afa9 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78661f expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200976.406483:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1afb0 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200976.406498:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1afb0 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200976.406511:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1afb0 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200976.406654:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ad200/0x96d0c9b8c9a1afa9 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78661f expref: 11 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200976.406675:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1afb0 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78661f expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200976.406685:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8dc11248c000) 00010000:00010000:1.0:1788200976.406695:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788200976.406699:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0079ada00, rc 0) 00010000:00000080:1.0:1788200976.406709:0:66757:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004d72300 x1875060695357184/t0(0) o101->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:97/0 lens 568/1272 e 0 to 0 dl 1788200987 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788200976.406798:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+10:67947:x1875060695357184:12345-192.168.201.20@tcp:101:dd.0 Request processed in 433us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200976.406807:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1178 00000100:00100000:1.0:1788200976.416968:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200976.417198:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695357440 00000100:00100000:0.0:1788200976.417220:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695357440 00000100:00100000:0.0:1788200976.417289:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1179 00000100:00100000:0.0:1788200976.417300:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+10:67947:x1875060695357440:12345-192.168.201.20@tcp:36:dd.0 00010000:00010000:0.0:1788200976.417555:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1afb7 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200976.417574:0:66314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c800/0x96d0c9b8c9a1af9b lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786618 expref: 10 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200976.417583:0:66314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1afb7 lrc: 4/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200976.417620:0:66314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c800/0x96d0c9b8c9a1af9b lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786618 expref: 10 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200976.417634:0:66314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c800/0x96d0c9b8c9a1af9b lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786618 expref: 10 pid: 66313 timeout: 3927 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788200976.417649:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66314:1875060715092480:192.168.201.20@tcp:104: 00000100:00100000:0.0:1788200976.417819:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ce63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788200976.422745:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200976.422755:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66314:1875060715092480:192.168.201.20@tcp:104: 00010000:00010000:1.0:1788200976.422785:0:66314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1afb7 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200976.422903:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695357568 00000100:00100000:2.0:1788200976.422911:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695357568 00010000:00010000:2.0:1788200976.422947:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c800/0x96d0c9b8c9a1af9b lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786618 expref: 11 pid: 66313 timeout: 3927 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200976.422985:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2552 00000100:00100000:2.0:1788200976.422996:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4292087e-fa00-4621-b681-837afc99ae35+11:2401:x1875060695357568:12345-192.168.201.20@tcp:102:ldlm_bl.0 00010000:00010000:2.0:1788200976.423119:0:6519:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c800/0x96d0c9b8c9a1af9b lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786618 expref: 11 pid: 66313 timeout: 3927 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.423132:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c800/0x96d0c9b8c9a1af9b lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786618 expref: 11 pid: 66313 timeout: 3927 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.423153:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c800/0x96d0c9b8c9a1af9b lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786618 expref: 11 pid: 66313 timeout: 3927 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.423162:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8dc11248c000) 00010000:00010000:2.0:1788200976.423165:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1788200976.423168:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1afb7 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.423177:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1afb7 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.423182:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1afb7 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200976.423214:0:6519:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c800/0x96d0c9b8c9a1af9b lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786618 expref: 11 pid: 66313 timeout: 3927 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200976.423309:0:66314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1afb7 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200976.423310:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4292087e-fa00-4621-b681-837afc99ae35+11:2401:x1875060695357568:12345-192.168.201.20@tcp:102:ldlm_bl.0 Request processed in 315us (584us total) trans 0 rc 0/0 00010000:00010000:1.0:1788200976.423327:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1afb7 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788200976.423328:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2552 00000004:00010000:1.0:1788200976.423491:0:66314:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:1.0:1788200976.423495:0:66314:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 1788200967 -> 1788200976 00000004:00010000:1.0:1788200976.423498:0:66314:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 1788200967 -> 1788200967 00000004:00010000:1.0:1788200976.423501:0:66314:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 1788200967 -> 1788200976 00000004:00010000:1.0:1788200976.423503:0:66314:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:1.0:1788200976.423510:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd26bdbe reply state 00000000e2819f17 transno 107374182410 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1afb7 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200976.423523:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1afb7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200976.423545:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8dc11248c000) 00010000:00010000:1.0:1788200976.423548:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788200976.423551:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:1.0:1788200976.423605:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004eb7800 x1875060695357440/t107374182410(0) o36->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:97/0 lens 488/456 e 0 to 0 dl 1788200987 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788200976.423652:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+12:67947:x1875060695357440:12345-192.168.201.20@tcp:36:dd.0 Request processed in 6354us (6692us total) trans 107374182410 rc 0/0 00000100:00100000:1.0:1788200976.423660:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1179 00000100:00100000:0.0:1788200976.426781:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200976.426875:0:66325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695357696 00000100:00100000:2.0:1788200976.426886:0:66325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695357696 00002000:00010000:2.0:1788200976.426927:0:66325:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000afe1:0x6:0x0] 00002000:00100000:2.0:1788200976.426933:0:66325:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8dc12ee2e680 with x1875060695357696 00000100:00100000:2.0:1788200976.426970:0:66325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:2.0:1788200976.426984:0:66325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:4292087e-fa00-4621-b681-837afc99ae35+12:2403:x1875060695357696:12345-192.168.201.20@tcp:10:dd.0 00000004:00010000:2.0:1788200976.427372:0:66325:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:2.0:1788200976.427382:0:66325:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 1788200976 -> 1788200976 00000004:00010000:2.0:1788200976.427385:0:66325:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 1788200967 -> 1788200967 00000004:00010000:2.0:1788200976.427388:0:66325:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 1788200976 -> 1788200976 00000004:00010000:2.0:1788200976.427390:0:66325:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1788200976.427407:0:66325:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12ee2e680 x1875060695357696/t107374182411(0) o10->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:97/0 lens 440/432 e 0 to 0 dl 1788200987 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788200976.427527:0:66325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:4292087e-fa00-4621-b681-837afc99ae35+13:2403:x1875060695357696:12345-192.168.201.20@tcp:10:dd.0 Request processed in 548us (753us total) trans 107374182411 rc 0/0 00000100:00100000:2.0:1788200976.427536:0:66325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 0 00002000:00010000:2.0:1788200976.427540:0:66325:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000afe1:0x6:0x0] 00002000:00100000:2.0:1788200976.427543:0:66325:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8dc12ee2e680 with x1875060695357696 00000100:00100000:0.0:1788200976.432390:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200976.432695:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695357952 00000100:00100000:2.0:1788200976.432707:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695357952 00000100:00100000:2.0:1788200976.432803:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 223 00000100:00100000:2.0:1788200976.432816:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4292087e-fa00-4621-b681-837afc99ae35+13:67947:x1875060695357952:12345-192.168.201.20@tcp:35:dd.0 00010000:00000080:2.0:1788200976.433003:0:66316:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12ee2c000 x1875060695357952/t107374182412(0) o35->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:97/0 lens 392/456 e 0 to 0 dl 1788200987 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788200976.433103:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4292087e-fa00-4621-b681-837afc99ae35+14:67947:x1875060695357952:12345-192.168.201.20@tcp:35:dd.0 Request processed in 290us (725us total) trans 107374182412 rc 0/0 00000100:00100000:2.0:1788200976.433112:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 223 00010000:00010000:1.0:1788200977.167285:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200978.192486:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788200978.403093:0:88490:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788200978.403162:0:88490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9e00/0x96d0c9b8c9a1ab34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ab3b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.403177:0:88490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9e00/0x96d0c9b8c9a1ab34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ab3b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.403186:0:88490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9e00/0x96d0c9b8c9a1ab34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ab3b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.403194:0:88490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9e00/0x96d0c9b8c9a1ab34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ab3b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.403214:0:88490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788200978.403220:0:88490:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788200978.403245:0:88490:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788200978.403249:0:88490:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788200978.403255:0:88490:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788200978.403293:0:88490:0:(import.c:65:import_set_state_nolock()) ffff8dc12b6be800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788200978.403420:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788200978.403428:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9e00/0x96d0c9b8c9a1ab34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1ab3b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200978.403436:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce9e00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788200978.403440:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9e00/0x96d0c9b8c9a1ab34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1ab3b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200978.403456:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9e00/0x96d0c9b8c9a1ab34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1ab3b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788200978.403464:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9e00/0x96d0c9b8c9a1ab34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1ab3b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788200978.403470:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788200978.403473:0:6521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788200978.403475:0:6521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788200978.403500:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9e00/0x96d0c9b8c9a1ab34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ab3b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200978.403507:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788200978.403535:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9e00/0x96d0c9b8c9a1ab34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ab3b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200978.403542:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9e00/0x96d0c9b8c9a1ab34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ab3b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200978.403555:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200978.403557:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200978.403559:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788200978.403565:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788200978.403582:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715092736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788200978.403646:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200978.403816:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715092736 00000100:00100000:2.0:1788200978.403824:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715092736 00000100:00100000:2.0:1788200978.403872:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:2.0:1788200978.403881:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715092736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788200978.403899:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788200978.403913:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc100031200/0x96d0c9b8c9a1ab3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ab34 expref: 24 pid: 87178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200978.403925:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788200978.403959:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9b18af6-fecc-4172-82c2-66531890fe11+23:3658:x1875060715092736:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200978.403966:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:2.0:1788200978.403999:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715092736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788200978.404970:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715092608:0@lo:39:umount.0 00000100:00100000:0.0:1788200978.405240:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200978.405289:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715092608 00000100:00100000:0.0:1788200978.405294:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715092608 00000100:00100000:0.0:1788200978.405336:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:0.0:1788200978.405344:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875060715092608:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788200978.405368:0:66313:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1ac4c 00000100:00080000:0.0:1788200978.405402:0:66313:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439800 : changing import state from FULL to CLOSED 00010000:00000080:0.0:1788200978.405430:0:66313:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12ee2ea00 x1875060715092608/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:99/0 lens 224/224 e 0 to 0 dl 1788200989 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788200978.405466:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3654:x1875060715092608:12345-0@lo:39:umount.0 Request processed in 123us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200978.405472:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000020:00000080:0.0:1788200978.405481:0:66313:0:(genops.c:885:class_export_put()) final put ffff8dc11d43f000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1788200978.405529:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788200978.405536:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d43f000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788200978.405578:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc11d439800 for lustre-MDT0000 00000100:00080000:1.0:1788200978.408004:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc12b6be800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788200978.408039:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715092608:0@lo:39:umount.0 00000100:00080000:3.0:1788200978.408313:0:88490:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788200978.408317:0:88490:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788200978.408321:0:88490:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788200978.409587:0:88490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1aa54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1aa5b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200978.409602:0:88490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1aa54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1aa5b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200978.409609:0:88490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1aa54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1aa5b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200978.409615:0:88490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1aa54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1aa5b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200978.409638:0:88490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788200978.409643:0:88490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100030400/0x96d0c9b8c9a1ab73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ab7a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200978.409649:0:88490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100030400/0x96d0c9b8c9a1ab73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ab7a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200978.409654:0:88490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100030400/0x96d0c9b8c9a1ab73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ab7a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200978.409659:0:88490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc100030400/0x96d0c9b8c9a1ab73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ab7a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200978.409681:0:88490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788200978.409687:0:88490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100030800/0x96d0c9b8c9a1ab26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ab2d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200978.409692:0:88490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100030800/0x96d0c9b8c9a1ab26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ab2d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200978.409705:0:88490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100030800/0x96d0c9b8c9a1ab26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ab2d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200978.409711:0:88490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc100030800/0x96d0c9b8c9a1ab26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ab2d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200978.409726:0:88490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788200978.409729:0:88490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100031400/0x96d0c9b8c9a1aa46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1aa4d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200978.409734:0:88490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100031400/0x96d0c9b8c9a1aa46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1aa4d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200978.409739:0:88490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100031400/0x96d0c9b8c9a1aa46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1aa4d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200978.409744:0:88490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc100031400/0x96d0c9b8c9a1aa46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1aa4d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788200978.409754:0:88490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788200978.409756:0:88490:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788200978.409797:0:88490:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788200978.409801:0:88490:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1788200978.409806:0:88490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1788200978.409812:0:88490:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00000004:00000080:3.0:1788200978.411289:0:88490:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00010000:00010000:1.0:1788200978.411810:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788200978.411819:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1aa54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1aa5b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.411841:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030600 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788200978.411846:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1aa54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1aa5b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.411855:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1aa54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1aa5b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788200978.411862:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1aa54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1aa5b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788200978.411868:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788200978.411871:0:13349:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1788200978.411875:0:13349:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1788200978.411917:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1aa54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1aa5b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.411924:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788200978.411957:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1aa54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1aa5b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.411964:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1aa54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1aa5b expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.411995:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788200978.411999:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc100030400/0x96d0c9b8c9a1ab73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1ab7a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.412004:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030400 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788200978.412007:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc100030400/0x96d0c9b8c9a1ab73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1ab7a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.412032:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc100030400/0x96d0c9b8c9a1ab73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1ab7a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788200978.412039:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc100030400/0x96d0c9b8c9a1ab73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1ab7a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788200978.412044:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788200978.412046:0:13349:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788200978.412048:0:13349:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788200978.412063:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc100030400/0x96d0c9b8c9a1ab73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ab7a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.412068:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788200978.412085:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc100030400/0x96d0c9b8c9a1ab73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ab7a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.412092:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc100030400/0x96d0c9b8c9a1ab73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ab7a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.412102:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788200978.412105:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc100030800/0x96d0c9b8c9a1ab26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1ab2d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.412116:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030800 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788200978.412119:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc100030800/0x96d0c9b8c9a1ab26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1ab2d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.412125:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc100030800/0x96d0c9b8c9a1ab26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1ab2d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788200978.412131:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc100030800/0x96d0c9b8c9a1ab26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1ab2d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788200978.412136:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788200978.412138:0:13349:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788200978.412140:0:13349:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788200978.412164:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc100030800/0x96d0c9b8c9a1ab26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ab2d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.412170:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788200978.412176:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc100030800/0x96d0c9b8c9a1ab26 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ab2d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.412182:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc100030800/0x96d0c9b8c9a1ab26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ab2d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.412192:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788200978.412195:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc100031400/0x96d0c9b8c9a1aa46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1aa4d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.412200:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100031400 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788200978.412202:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc100031400/0x96d0c9b8c9a1aa46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1aa4d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.412214:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc100031400/0x96d0c9b8c9a1aa46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1aa4d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788200978.412220:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc100031400/0x96d0c9b8c9a1aa46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1aa4d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788200978.412225:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788200978.412227:0:13349:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788200978.412228:0:13349:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788200978.412240:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc100031400/0x96d0c9b8c9a1aa46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1aa4d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.412244:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788200978.412250:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc100031400/0x96d0c9b8c9a1aa46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1aa4d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.412256:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc100031400/0x96d0c9b8c9a1aa46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1aa4d expref: -99 pid: 87170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.412264:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200978.412265:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200978.412267:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200978.412274:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200978.412291:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715092992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788200978.412359:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200978.412424:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788200978.412430:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715093120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788200978.412452:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200978.412497:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715092992 00000100:00100000:1.0:1788200978.412506:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715092992 00000100:00100000:1.0:1788200978.412548:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715093120 00000100:00100000:1.0:1788200978.412551:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715093120 00000100:00100000:1.0:1788200978.412573:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:1.0:1788200978.412582:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10a10ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715092992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788200978.412595:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788200978.412612:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fd200/0x96d0c9b8c9a1ab7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ab73 expref: 24 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.412624:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788200978.412658:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10a10ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+23:3655:x1875060715092992:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200978.412666:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:1.0:1788200978.412920:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:1.0:1788200978.412927:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+22:3655:x1875060715093120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788200978.412934:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788200978.412944:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007ce9600/0x96d0c9b8c9a1ab2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ab26 expref: 22 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.412953:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788200978.412976:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+21:3655:x1875060715093120:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200978.412981:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:1.0:1788200978.413010:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715093248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788200978.413061:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200978.413083:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788200978.413089:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715092864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788200978.413119:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200978.413144:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715093248 00000100:00100000:1.0:1788200978.413158:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715093248 00000100:00100000:1.0:1788200978.413182:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715092864 00000100:00100000:1.0:1788200978.413185:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715092864 00000100:00100000:1.0:1788200978.413200:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:1.0:1788200978.413205:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+22:3657:x1875060715093248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788200978.413212:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788200978.413221:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1aa4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1aa46 expref: 22 pid: 87177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.413232:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788200978.413256:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+21:3657:x1875060715093248:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200978.413262:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00100000:1.0:1788200978.413273:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:1.0:1788200978.413279:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+20:3657:x1875060715092864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788200978.413286:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788200978.413294:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc100030000/0x96d0c9b8c9a1aa5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1aa54 expref: 20 pid: 87178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.413302:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788200978.413320:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+19:3657:x1875060715092864:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200978.413326:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:1.0:1788200978.413358:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715092864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788200978.413366:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715093248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788200978.413518:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715093120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788200978.413526:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715092992:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788200978.414296:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788200978.414776:0:87171:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182412 is committed 00010000:00010000:1.0:1788200978.414810:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1afb7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.414820:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1afb7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.414828:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1afb7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.414835:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140758200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788200978.414840:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1afb7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.414848:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1afb7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.414862:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8dc11248c000) 00010000:00010000:1.0:1788200978.414865:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788200978.414869:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1afb7 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.414875:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140758200/0x96d0c9b8c9a1afb7 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200978.415075:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788200978.415254:0:88490:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1788200978.415263:0:88490:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc0034f7800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788200978.415269:0:88490:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc0034f4000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788200978.415274:0:88490:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc11cddf800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788200978.415278:0:88490:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc1401c6800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788200978.415285:0:88490:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc1401c1800 4292087e-fa00-4621-b681-837afc99ae35 192.168.201.20@tcp 8 (0 0 3) 0 0 0 0: 0000000000000000 107374182412 stale:0 00000020:00080000:3.0:1788200978.415290:0:88490:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff8dc004044d28) has exports, disconnecting them 00000020:00080000:3.0:1788200978.415295:0:88490:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc0034f7800), last request at 1788200939 00000020:00000080:3.0:1788200978.415302:0:88490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1ac45 00000100:00080000:3.0:1788200978.415310:0:88490:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f6000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788200978.415364:0:88490:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc0034f7800): rc 0 00000020:00000080:3.0:1788200978.415367:0:88490:0:(genops.c:885:class_export_put()) final put ffff8dc0034f7800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788200978.415395:0:88490:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc0034f4000), last request at 1788200975 00000020:00000080:3.0:1788200978.415399:0:88490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1ac3e 00000100:00080000:3.0:1788200978.415403:0:88490:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f7000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788200978.415740:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0034f7800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788200978.415783:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc0034f6000 for lustre-MDT0000 00010000:00010000:2.0:1788200978.417670:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788200978.417845:0:88490:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc0034f4000): rc 0 00000020:00000080:3.0:1788200978.417850:0:88490:0:(genops.c:885:class_export_put()) final put ffff8dc0034f4000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788200978.417868:0:88490:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc11cddf800), last request at 1788200975 00000020:00000080:3.0:1788200978.417876:0:88490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1ac37 00000100:00080000:3.0:1788200978.417886:0:88490:0:(import.c:65:import_set_state_nolock()) ffff8dc11cdda800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788200978.417918:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0034f4000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788200978.417970:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc0034f7000 for lustre-MDT0000 00010000:00010000:1.0:1788200978.418041:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788200978.418346:0:88490:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc11cddf800): rc 0 00000020:00000080:3.0:1788200978.418349:0:88490:0:(genops.c:885:class_export_put()) final put ffff8dc11cddf800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788200978.418474:0:88490:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc1401c6800), last request at 1788200934 00000020:00000080:3.0:1788200978.418485:0:88490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1aaa8 00000100:00080000:3.0:1788200978.418497:0:88490:0:(import.c:65:import_set_state_nolock()) ffff8dc106074000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788200978.418514:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788200978.418538:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11cddf800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788200978.418577:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc11cdda800 for lustre-MDT0000 00000020:00080000:3.0:1788200978.418767:0:88490:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc1401c6800): rc 0 00000020:00000080:3.0:1788200978.418770:0:88490:0:(genops.c:885:class_export_put()) final put ffff8dc1401c6800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:3.0:1788200978.418787:0:88490:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.201.20@tcp (ffff8dc1401c1800), last request at 1788200976 00000020:00000080:3.0:1788200978.418791:0:88490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1aaa1 00000020:00010000:3.0:1788200978.418800:0:88490:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc1401c1800: total 1 00000100:00080000:3.0:1788200978.418803:0:88490:0:(import.c:65:import_set_state_nolock()) ffff8dc001e2e000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788200978.418829:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1401c6800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788200978.418876:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc106074000 for lustre-MDT0000 00000020:00010000:2.0:1788200978.418907:0:6520:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc1401c1800: total 0 00010000:00010000:2.0:1788200978.418970:0:6520:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc1401c1800, canceled 0 locks, left on hash table 3. 00010000:00010000:2.0:1788200978.419009:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1ae8a lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865d2 expref: 7 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200978.419070:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0079ada00/0x96d0c9b8c9a1afb0 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78661f expref: 6 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200978.419086:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006c6c800/0x96d0c9b8c9a1af9b lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786618 expref: 5 pid: 66313 timeout: 3927 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788200978.419101:0:6520:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc1401c1800, canceled 3 locks, left on hash table 0. 00000020:00080000:3.0:1788200978.423142:0:88490:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.201.20@tcp (ffff8dc1401c1800): rc 0 00000004:00000080:3.0:1788200978.423161:0:88490:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa0dd4149bae0 00000100:00080000:3.0:1788200978.423187:0:88490:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788200978.423192:0:88490:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788200978.424543:0:88490:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788200978.424582:0:88490:0:(import.c:65:import_set_state_nolock()) ffff8dc12e647000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788200978.424651:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715093376:0@lo:39:umount.0 00000100:00100000:0.0:1788200978.424742:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788200978.426602:0:88490:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788200978.426610:0:88490:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969450 gen 3 00000004:00080000:3.0:1788200978.426631:0:88490:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788200978.426690:0:88490:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788200978.427259:0:88490:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f5800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788200978.427324:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200978.428274:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715093376 00000100:00100000:1.0:1788200978.428287:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715093376 00000100:00100000:1.0:1788200978.428351:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3882 00000100:00100000:1.0:1788200978.428362:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715093376:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788200978.428409:0:8457:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1aad9 00000100:00080000:1.0:1788200978.428418:0:8457:0:(import.c:65:import_set_state_nolock()) ffff8dc1031fa800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788200978.428438:0:8457:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411437 00000100:00100000:0.0:1788200978.429724:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715093504:0@lo:9:umount.0 00000100:00100000:0.0:1788200978.429785:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200978.429830:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715093504 00000100:00100000:0.0:1788200978.429836:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715093504 00000100:00100000:0.0:1788200978.429888:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5872 00000100:00100000:0.0:1788200978.429898:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715093504:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788200978.429920:0:26200:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1ab03 00000100:00080000:0.0:1788200978.429928:0:26200:0:(import.c:65:import_set_state_nolock()) ffff8dc13aa9b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788200978.429974:0:26200:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969450 00000100:00100000:0.0:1788200978.430121:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+2:3654:x1875060715093504:12345-0@lo:9:umount.0 Request processed in 224us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200978.430128:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5872 00000100:00080000:0.0:1788200978.430257:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788200978.430273:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788200978.430302:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f5800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788200978.430316:0:3654:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788200978.430318:0:3654:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788200978.430322:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715093504:0@lo:9:umount.0 00000100:00080000:3.0:1788200978.434504:0:88490:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788200978.434514:0:88490:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969450 gen 3 00000004:00080000:3.0:1788200978.434541:0:88490:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788200978.434603:0:88490:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788200978.434633:0:88490:0:(import.c:65:import_set_state_nolock()) ffff8dc12b6ba000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788200978.434686:0:88490:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8dc004044d28) has no exports 00000100:00100000:1.0:1788200978.435863:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3654:x1875060715093376:12345-0@lo:39:umount.0 Request processed in 7494us (11112us total) trans 77309411438 rc 0/0 00000100:00100000:1.0:1788200978.435877:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3882 00010000:00010000:1.0:1788200978.435933:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788200978.437544:0:88490:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8dc004044d28) has no exports 00000100:00080000:0.0:1788200978.438567:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc12e647000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788200978.438580:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715093376:0@lo:39:umount.0 00000100:00100000:1.0:1788200978.438667:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715093632:0@lo:9:umount.0 00000100:00100000:1.0:1788200978.438798:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200978.439244:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715093632 00000100:00100000:0.0:1788200978.439251:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715093632 00000100:00100000:0.0:1788200978.439302:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5873 00000100:00100000:0.0:1788200978.439311:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715093632:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788200978.439334:0:23974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1ab11 00000100:00080000:0.0:1788200978.439352:0:23974:0:(import.c:65:import_set_state_nolock()) ffff8dc005a4f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788200978.439468:0:23974:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969450 00000100:00100000:0.0:1788200978.439603:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3654:x1875060715093632:12345-0@lo:9:umount.0 Request processed in 293us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200978.439610:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5873 00010000:00010000:0.0:1788200978.439632:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788200978.439690:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788200978.439790:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc12b6ba000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788200978.439808:0:3654:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788200978.439810:0:3654:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788200978.439814:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715093632:0@lo:9:umount.0 00000020:00000080:2.0:1788200978.469765:0:6520:0:(genops.c:885:class_export_put()) final put ffff8dc1401c1800/4292087e-fa00-4621-b681-837afc99ae35 00000020:00000080:0.0:1788200978.469879:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1401c1800/4292087e-fa00-4621-b681-837afc99ae35 for lustre-MDT0000 00000020:00000080:0.0:1788200978.469933:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc001e2e000 for lustre-MDT0000 00010000:00010000:0.0:1788200978.469943:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200978.469945:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200978.469948:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788200978.516483:0:88490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1aabd 00000020:00000080:3.0:1788200978.516501:0:88490:0:(genops.c:885:class_export_put()) final put ffff8dc110732000/lustre-QMT0000_UUID 00000020:01000000:3.0:1788200978.516592:0:88490:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788200978.518912:0:88490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788200978.518934:0:88490:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788200978.518939:0:88490:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8dc004fd4d28) has no exports 00000020:00000080:0.0:1788200978.519821:0:88490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1aab6 00000020:00000080:0.0:1788200978.519834:0:88490:0:(genops.c:885:class_export_put()) final put ffff8dc120722800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788200978.519893:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110732000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788200978.524358:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc120722800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788200978.524588:0:88490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788200978.524601:0:88490:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788200978.524606:0:88490:0:(genops.c:885:class_export_put()) final put ffff8dc1098d1000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788200978.524609:0:88490:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1098d1000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788200978.524618:0:88490:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1788200978.524779:0:88490:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc00109eae0 - data ffff8dc00228ad80/ffff8dc0037aac00 00000020:01000000:0.0:1788200978.524949:0:88490:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc003bd7840 - data ffff8dc002153000/ffff8dc107673400 00000100:00080000:3.0:1788200978.571664:0:88490:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788200978.571673:0:88490:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788200978.571687:0:88490:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8dc004d70380 x1875060715093376/t77309411438(77309411438) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788200988 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788200978.571711:0:88490:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788200978.573680:0:88490:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788200978.573687:0:88490:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969450 gen 4 00000004:00080000:3.0:1788200978.573743:0:88490:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788200978.573746:0:88490:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788200978.576366:0:87189:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788200978.576439:0:87189:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x64:0x0] index 1 count 1 00000040:00080000:0.0:1788200978.576455:0:87189:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 25 count 2 00000100:00080000:3.0:1788200978.580991:0:88490:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788200978.580999:0:88490:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969450 gen 4 00000004:00080000:3.0:1788200978.581047:0:88490:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788200978.581050:0:88490:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788200978.581509:0:87191:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788200978.581514:0:87191:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x66:0x0] index 1 count 1 00000040:00080000:0.0:1788200978.581524:0:87191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 25 count 2 00000020:00000080:3.0:1788200978.583306:0:88490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1aa70 00000020:00000080:3.0:1788200978.583317:0:88490:0:(genops.c:885:class_export_put()) final put ffff8dc12e644000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788200978.583463:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12e644000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788200978.584252:0:88490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1aa85 00000020:00000080:3.0:1788200978.584259:0:88490:0:(genops.c:885:class_export_put()) final put ffff8dc110734000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788200978.584300:0:88490:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788200978.584305:0:88490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788200978.584315:0:88490:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788200978.584320:0:88490:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8dc004040000) has no exports 00000004:01000000:3.0:1788200978.584480:0:88490:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788200978.584488:0:88490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1ab0a 00000020:00000080:3.0:1788200978.584492:0:88490:0:(genops.c:885:class_export_put()) final put ffff8dc003953800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788200978.585322:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110734000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788200978.585467:0:88490:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788200978.585472:0:88490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788200978.585482:0:88490:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788200978.585486:0:88490:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8dc13f8719b8) has no exports 00000020:00000080:3.0:1788200978.585492:0:88490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1aafc 00000020:00000080:3.0:1788200978.585497:0:88490:0:(genops.c:885:class_export_put()) final put ffff8dc12b6b8000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788200978.585887:0:88490:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788200978.585902:0:88490:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788200978.585906:0:88490:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969450 gen 5 00000004:00080000:3.0:1788200978.585911:0:88490:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788200978.585914:0:88490:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788200978.585942:0:88490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788200978.585950:0:88490:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788200978.585955:0:88490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1aaee 00000020:00000080:3.0:1788200978.585959:0:88490:0:(genops.c:885:class_export_put()) final put ffff8dc110733000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788200978.585962:0:88490:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788200978.585965:0:88490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788200978.585969:0:88490:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788200978.585971:0:88490:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8dc139bb8000) has no exports 00000020:00000080:3.0:1788200978.585974:0:88490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1aae7 00000020:00000080:3.0:1788200978.585977:0:88490:0:(genops.c:885:class_export_put()) final put ffff8dc1257f1000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788200978.586945:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc003953800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788200978.586955:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12b6b8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788200978.586960:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc12b6ba000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788200978.586968:0:57134:0:(genops.c:885:class_export_put()) final put ffff8dc110731000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788200978.586980:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110731000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788200978.586983:0:57134:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00010000:01000000:3.0:1788200978.587260:0:88490:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788200978.587265:0:88490:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788200978.587268:0:88490:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969450 gen 5 00000004:00080000:3.0:1788200978.587274:0:88490:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788200978.587276:0:88490:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788200978.587444:0:88490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788200978.587456:0:88490:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788200978.587470:0:88490:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788200978.587475:0:88490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1aad2 00000020:00000080:3.0:1788200978.587481:0:88490:0:(genops.c:885:class_export_put()) final put ffff8dc110736000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788200978.587946:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110733000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788200978.587956:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1257f1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788200978.587961:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1257f5800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788200978.587966:0:57134:0:(genops.c:885:class_export_put()) final put ffff8dc110734800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788200978.587968:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110734800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788200978.587973:0:57134:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788200978.588221:0:88490:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788200978.588226:0:88490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788200978.588235:0:88490:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788200978.588239:0:88490:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8dc139bbb370) has no exports 00000020:00000080:3.0:1788200978.588246:0:88490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1aacb 00000020:00000080:3.0:1788200978.588251:0:88490:0:(genops.c:885:class_export_put()) final put ffff8dc12e642000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788200978.589532:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110736000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788200978.589545:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12e642000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788200978.591174:0:88490:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788200978.591182:0:88490:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788200978.591186:0:88490:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788200978.591193:0:88490:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788200978.591262:0:88490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788200978.591278:0:88490:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788200978.591319:0:88490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788200978.591323:0:88490:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788200978.591329:0:88490:0:(genops.c:885:class_export_put()) final put ffff8dc137d35000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788200978.591333:0:88490:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d35000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788200978.591340:0:88490:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788200978.591471:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc12e647000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788200978.591479:0:57134:0:(genops.c:885:class_export_put()) final put ffff8dc110733800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788200978.591482:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110733800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788200978.591487:0:57134:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788200978.591721:0:88490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1aa8c 00000020:00000080:0.0:1788200978.591729:0:88490:0:(genops.c:885:class_export_put()) final put ffff8dc110737000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788200978.591743:0:88490:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788200978.591747:0:88490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788200978.591753:0:88490:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788200978.591757:0:88490:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8dc002640000) has no exports 00000020:00000080:0.0:1788200978.591777:0:88490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788200978.591781:0:88490:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788200978.591784:0:88490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1aa93 00000020:00000080:0.0:1788200978.591788:0:88490:0:(genops.c:885:class_export_put()) final put ffff8dc110736800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788200978.591794:0:88490:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc13f809800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788200978.591798:0:88490:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc13f809800 3 00000020:01000004:0.0:1788200978.591801:0:88490:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dc13f809800 from lustre-MDT0000 00000020:00000080:0.0:1788200978.591817:0:88490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788200978.591821:0:88490:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788200978.591824:0:88490:0:(genops.c:885:class_export_put()) final put ffff8dc12e640000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788200978.591826:0:88490:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12e640000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788200978.591833:0:88490:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788200978.591862:0:88490:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788200978.591866:0:88490:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788200978.591881:0:88490:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788200978.591885:0:88490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788200978.591888:0:88490:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788200978.591894:0:88490:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8dc137d36000 c9b18af6-fecc-4172-82c2-66531890fe11 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788200978.591902:0:88490:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8dc1401c5000 0fa559bc-2180-4019-80c4-11831fedf9a9 192.168.201.20@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788200978.591906:0:88490:0:(genops.c:1553:class_disconnect_exports()) OBD device 3 (ffff8dc0040419b8) has exports, disconnecting them 00000020:00080000:0.0:1788200978.591910:0:88490:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8dc137d36000), last request at 1788200934 00000020:00000080:0.0:1788200978.591934:0:88490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1aa38 00000020:00010000:0.0:1788200978.591939:0:88490:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc137d36000: total 2 00000100:00080000:0.0:1788200978.591942:0:88490:0:(import.c:65:import_set_state_nolock()) ffff8dc137d37800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788200978.591953:0:88490:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc137d36000): rc 0 00000020:00080000:0.0:1788200978.591957:0:88490:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.201.20@tcp (ffff8dc1401c5000), last request at 1788200933 00000020:00010000:0.0:1788200978.591996:0:6521:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc137d36000: total 2 00010000:00010000:0.0:1788200978.592053:0:6521:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc137d36000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788200978.592082:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007ce8e00/0x96d0c9b8c9a1ac30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ac29 expref: 14 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200978.592098:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007ce8c00/0x96d0c9b8c9a1abc0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1abb9 expref: 13 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200978.592108:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006c6c400/0x96d0c9b8c9a1abce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1abc7 expref: 12 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200978.592117:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fd800/0x96d0c9b8c9a1abb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1abab expref: 11 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200978.592129:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1abdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1abd5 expref: 10 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200978.592138:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006c6d400/0x96d0c9b8c9a1abea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1abe3 expref: 9 pid: 87177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200978.592169:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006c6de00/0x96d0c9b8c9a1ac06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1abff expref: 8 pid: 87178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200978.592178:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fce00/0x96d0c9b8c9a1abf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1abf1 expref: 7 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200978.592189:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006c6c200/0x96d0c9b8c9a1ab88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ab81 expref: 6 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200978.592198:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007ce9200/0x96d0c9b8c9a1ab96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ab8f expref: 5 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200978.592206:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fd400/0x96d0c9b8c9a1ac14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ac0d expref: 4 pid: 87177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200978.592214:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007ce9a00/0x96d0c9b8c9a1aba4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ab9d expref: 3 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200978.592224:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0079aca00/0x96d0c9b8c9a1ac22 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ac1b expref: 2 pid: 87178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788200978.592235:0:6521:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc137d36000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788200978.592256:0:6521:0:(genops.c:885:class_export_put()) final put ffff8dc137d36000/c9b18af6-fecc-4172-82c2-66531890fe11 00010000:00010000:0.0:1788200978.592261:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200978.592263:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200978.592265:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788200978.592278:0:88490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1aa31 00000020:00010000:0.0:1788200978.592283:0:88490:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc1401c5000: total 3 00000100:00080000:0.0:1788200978.592286:0:88490:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c5800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788200978.592295:0:88490:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.201.20@tcp (ffff8dc1401c5000): rc 0 00000020:00080000:0.0:1788200978.592305:0:88490:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8dc0040419b8) has no exports 00000020:00010000:1.0:1788200978.592642:0:24979:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc1401c5000: total 3 00010000:00010000:1.0:1788200978.592646:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200978.592676:0:24979:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc1401c5000, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1788200978.592707:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007ce9400/0x96d0c9b8c9a1ab6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865c4 expref: 5 pid: 87181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.592722:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fd000/0x96d0c9b8c9a1ab5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865b6 expref: 4 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.592735:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc100031e00/0x96d0c9b8c9a1ab57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865af expref: 3 pid: 87176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.592748:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc100030c00/0x96d0c9b8c9a1ab65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7865bd expref: 2 pid: 87177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788200978.592759:0:24979:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc1401c5000, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1788200978.592781:0:24979:0:(genops.c:885:class_export_put()) final put ffff8dc1401c5000/0fa559bc-2180-4019-80c4-11831fedf9a9 00010000:00010000:1.0:1788200978.592787:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200978.592788:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200978.592790:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788200978.592800:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110737000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788200978.592804:0:57134:0:(genops.c:885:class_export_put()) final put ffff8dc105588000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788200978.592806:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc105588000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788200978.592810:0:57134:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788200978.592847:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110736800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788200978.592851:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d36000/c9b18af6-fecc-4172-82c2-66531890fe11 for MGS 00000020:00000080:1.0:1788200978.592879:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1401c5000/0fa559bc-2180-4019-80c4-11831fedf9a9 for MGS 00000020:00000080:1.0:1788200978.592893:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc137d37800 for MGS 00000020:00000080:1.0:1788200978.592897:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1401c5800 for MGS 00000100:00100000:0.0:1788200978.595221:0:87178:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8dc102e52200:87178] 2 exiting: rc = 0 00000100:00100000:0.0:1788200978.595344:0:87181:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff8dc005818600:87181] 3 exiting: rc = 0 00000100:00100000:0.0:1788200978.595549:0:87176:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8dc003b1ac00:87176] 0 exiting: rc = 1 00000100:00100000:0.0:1788200978.595603:0:87177:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8dc102e52c00:87177] 1 exiting: rc = 0 00000100:00100000:1.0:1788200978.595999:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596009:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596045:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596053:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596061:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596067:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596074:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596079:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596086:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596093:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596099:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596105:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596111:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596117:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596124:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596130:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596137:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596157:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596164:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596183:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596189:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596195:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596201:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596207:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596213:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596219:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596226:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596232:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596237:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596244:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596250:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596255:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596261:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596267:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596272:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596277:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596283:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596288:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596294:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596301:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596307:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596314:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596319:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596325:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596330:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596337:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596343:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596348:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596354:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596359:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596365:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596581:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596591:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596596:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596608:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596614:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596619:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596625:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596631:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596637:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596642:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596647:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596653:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788200978.596659:0:88490:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1788200978.597948:0:88490:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc104edcae0 - data ffff8dc0023df360/ffff8dc1330ffc00 00000020:01000000:1.0:1788200978.598246:0:88490:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc00109e060 - data ffff8dc0020d8ca8/ffff8dc12f0e3400 00000020:00000080:1.0:1788200978.598817:0:88490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1aa2a 00000020:00000080:1.0:1788200978.598829:0:88490:0:(genops.c:885:class_export_put()) final put ffff8dc137d30800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788200978.599198:0:88490:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc13f809800 from MGS, refs=2 00000020:01000004:1.0:1788200978.599203:0:88490:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc13f809800 2 00000020:01000004:1.0:1788200978.599206:0:88490:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dc13f809800 from MGS 00000020:00000080:1.0:1788200978.599230:0:88490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788200978.599238:0:88490:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788200978.599242:0:88490:0:(genops.c:885:class_export_put()) final put ffff8dc137d34800/MGS 00000020:00000080:1.0:1788200978.599245:0:88490:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d34800/MGS for MGS 00000020:01000000:1.0:1788200978.599253:0:88490:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788200978.599329:0:88490:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788200978.599332:0:88490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788200978.599342:0:88490:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788200978.599349:0:88490:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8dc005fad800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788200978.599355:0:88490:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8dc13f870000) has exports, disconnecting them 00000020:00080000:1.0:1788200978.599360:0:88490:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8dc005fad800), last request at 1788200934 00000020:00000080:1.0:1788200978.599365:0:88490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1ab49 00000020:00080000:1.0:1788200978.599580:0:88490:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc005fad800): rc 0 00000020:00000080:1.0:1788200978.599586:0:88490:0:(genops.c:885:class_export_put()) final put ffff8dc005fad800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788200978.599740:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d30800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788200978.600921:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005fad800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788200978.602161:0:88490:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788200978.602168:0:88490:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788200978.602172:0:88490:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788200978.602177:0:88490:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788200978.602202:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc12b6be800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788200978.602363:0:88490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788200978.602393:0:88490:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788200978.602399:0:88490:0:(genops.c:885:class_export_put()) final put ffff8dc005fab800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788200978.602404:0:88490:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005fab800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788200978.602409:0:88490:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788200978.602495:0:88490:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc13f809800 1 00000020:00000080:0.0:1788200978.602502:0:88490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1aa1c 00000020:00000080:0.0:1788200978.602508:0:88490:0:(genops.c:885:class_export_put()) final put ffff8dc137d34000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788200978.602516:0:88490:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788200978.602523:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d34000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788200978.602532:0:88490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788200978.602536:0:88490:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788200978.602541:0:88490:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8dc1401b0000) has no exports 00000020:00000080:0.0:1788200978.676595:0:88490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788200978.676612:0:88490:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788200978.676619:0:88490:0:(genops.c:885:class_export_put()) final put ffff8dc13f809000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788200978.676624:0:88490:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13f809000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788200978.676643:0:88490:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788200978.676842:0:88490:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dc13f80a800 00000020:02000400:0.0:1788200978.676921:0:88490:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1788200978.770495:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788200978.770536:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715093760:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788200978.770622:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200978.770674:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715093760 00000100:00100000:1.0:1788200978.770683:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715093760 00000100:00100000:1.0:1788200978.770752:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2168 00000100:00100000:1.0:1788200978.770764:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715093760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788200978.770795:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200978.770841:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715093760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200978.770850:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2168 00000100:00080000:1.0:1788200978.770875:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788200978.770914:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715093760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788200978.771524:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788200978.771536:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715093888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788200978.771580:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200978.771638:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715093888 00000100:00100000:1.0:1788200978.771643:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715093888 00000100:00100000:1.0:1788200978.771687:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2169 00000100:00100000:1.0:1788200978.771705:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715093888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788200978.771725:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200978.771763:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715093888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200978.771769:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2169 00000100:00100000:1.0:1788200978.771801:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715093888:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788200978.771905:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788200979.218128:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200980.240159:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200980.824528:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715094016:0@lo:400:kworker.0 00000400:00000100:1.0:1788200980.824592:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715094016 offset 0 length 224: 4 00000100:00100000:3.0:1788200980.824777:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715094400:0@lo:400:kworker.0 00000100:00100000:3.0:1788200980.824822:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200980.824871:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715094400 00000100:00100000:3.0:1788200980.824879:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715094400 00000100:00100000:3.0:1788200980.824923:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:3.0:1788200980.824931:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3655:x1875060715094400:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788200980.824945:0:66312:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788200980.824984:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3655:x1875060715094400:12345-0@lo:400:kworker.0 Request processed in 53us (162us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788200980.824991:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00080000:3.0:1788200980.825056:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788200980.825061:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788200980.825065:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788200980.825071:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788200980.825074:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3791 00000100:00080000:3.0:1788200980.825080:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788200980.825101:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004d70380 x1875060715094528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788200980.825974:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715094400:0@lo:400:kworker.0 00000100:00100000:3.0:1788200980.826051:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715094272:0@lo:400:kworker.0 00000100:00100000:3.0:1788200980.826097:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200980.826208:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788200980.826216:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715094144:0@lo:400:kworker.0 00000100:00100000:3.0:1788200980.826256:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200980.826292:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715094272 00000100:00100000:3.0:1788200980.826297:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715094272 00000100:00100000:3.0:1788200980.826336:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715094144 00000100:00100000:3.0:1788200980.826339:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715094144 00000100:00100000:3.0:1788200980.826367:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:3.0:1788200980.826376:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715094272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200980.826426:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715094272:12345-0@lo:400:kworker.0 Request processed in 51us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200980.826432:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:3.0:1788200980.826449:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:3.0:1788200980.826454:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1875060715094144:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788200980.826459:0:69485:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788200980.826481:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1875060715094144:12345-0@lo:400:kworker.0 Request processed in 26us (225us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788200980.826486:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00080000:3.0:1788200980.826503:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788200980.826524:0:3658:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788200980.826528:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788200980.826532:0:3658:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788200980.826537:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788200980.826540:0:3658:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3791 00000100:00080000:3.0:1788200980.826545:0:3658:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788200980.826566:0:3658:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11cc43b80 x1875060715094656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788200980.826577:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715094144:0@lo:400:kworker.0 00000100:00100000:3.0:1788200980.826600:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715094272:0@lo:400:kworker.0 00000100:00100000:0.0:1788200980.827091:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715094528:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788200980.827144:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200980.827169:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715094656:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788200980.827201:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200980.827233:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715094528 00000100:00100000:0.0:1788200980.827237:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715094528 00000100:00100000:0.0:1788200980.827256:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715094656 00000100:00100000:0.0:1788200980.827259:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715094656 00000100:00100000:0.0:1788200980.827272:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:0.0:1788200980.827277:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715094528:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1788200980.827298:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788200980.827327:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715094528:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 49us (184us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788200980.827334:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:0.0:1788200980.827375:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:0.0:1788200980.827380:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715094656:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1788200980.827387:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788200980.827409:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715094656:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 28us (207us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788200980.827414:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00080000:0.0:1788200980.827443:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788200980.827447:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788200980.827460:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715094528:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1788200980.827470:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788200980.827472:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788200980.827475:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715094656:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788200980.828597:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715094784:0@lo:400:kworker.0 00000100:00100000:1.0:1788200980.828829:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200980.828933:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715094912:0@lo:400:kworker.0 00000100:00100000:2.0:1788200980.828975:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200980.829048:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715094912 00000100:00100000:2.0:1788200980.829055:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715094912 00000100:00100000:2.0:1788200980.829097:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3883 00000100:00100000:2.0:1788200980.829104:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1875060715094912:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788200980.829365:0:83817:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788200980.829414:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1875060715094912:12345-0@lo:400:kworker.0 Request processed in 309us (437us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788200980.829423:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3883 00000100:00100000:2.0:1788200980.829493:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715095040:0@lo:400:kworker.0 00000100:00100000:2.0:1788200980.829519:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200980.829598:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cb50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715095168:0@lo:400:kworker.0 00000100:00100000:3.0:1788200980.829635:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200980.829667:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788200980.829672:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cb50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715095296:0@lo:400:kworker.0 00000100:00100000:3.0:1788200980.829694:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200980.829727:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715095040 00000100:00100000:2.0:1788200980.829731:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715095040 00000100:00080000:1.0:1788200980.829919:0:3657:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788200980.829925:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788200980.829929:0:3657:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788200980.829935:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200980.829938:0:3657:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3791 00000100:00080000:1.0:1788200980.829944:0:3657:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200980.829963:0:3657:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004eb4e00 x1875060715095424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788200980.829983:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715094912:0@lo:400:kworker.0 00000100:00100000:1.0:1788200980.830004:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715095424:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788200980.830052:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200980.830080:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715095424 00000100:00100000:1.0:1788200980.830084:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715095424 00000100:00100000:1.0:1788200980.830104:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3884 00000100:00100000:1.0:1788200980.830121:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715095424:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1788200980.830139:0:8457:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200980.830170:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715095424:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 60us (117us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788200980.830176:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3884 00000100:00080000:1.0:1788200980.830221:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788200980.830225:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788200980.830229:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715095424:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788200980.830474:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715095168 00000100:00100000:2.0:1788200980.830479:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715095168 00000100:00100000:2.0:1788200980.830507:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2672 00000100:00100000:2.0:1788200980.830513:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715095040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200980.830557:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715095040:12345-0@lo:400:kworker.0 Request processed in 44us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200980.830563:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2672 00000100:00100000:2.0:1788200980.830574:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2673 00000100:00100000:2.0:1788200980.830580:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715095168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200980.830605:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715095168:12345-0@lo:400:kworker.0 Request processed in 26us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200980.830612:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2673 00000100:00080000:2.0:1788200980.830628:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788200980.830633:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788200980.830679:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715095040:0@lo:400:kworker.0 00000100:00100000:3.0:1788200980.831221:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cb50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715095168:0@lo:400:kworker.0 00000100:00100000:0.0:1788200980.831401:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715094784 00000100:00100000:0.0:1788200980.831406:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715094784 00000100:00100000:0.0:1788200980.831460:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715095296 00000100:00100000:0.0:1788200980.831463:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715095296 00000100:00100000:0.0:1788200980.831483:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:0.0:1788200980.831490:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715094784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200980.831541:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715094784:12345-0@lo:400:kworker.0 Request processed in 52us (2712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200980.831547:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00100000:0.0:1788200980.831562:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:0.0:1788200980.831567:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3655:x1875060715095296:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788200980.831573:0:66312:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788200980.831600:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3655:x1875060715095296:12345-0@lo:400:kworker.0 Request processed in 31us (1905us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788200980.831617:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:0.0:1788200980.831668:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715094784:0@lo:400:kworker.0 00000100:00080000:2.0:1788200980.831907:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788200980.831972:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788200980.831977:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788200980.831981:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788200980.831986:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788200980.831991:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3791 00000100:00080000:3.0:1788200980.831997:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788200980.832042:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004b38380 x1875060715095552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788200980.832070:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cb50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715095296:0@lo:400:kworker.0 00000100:00100000:0.0:1788200980.832245:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715095552:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788200980.832285:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200980.832372:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715095552 00000100:00100000:2.0:1788200980.832377:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715095552 00000100:00100000:2.0:1788200980.832410:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:2.0:1788200980.832416:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715095552:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788200980.832437:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788200980.832486:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715095552:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 68us (200us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788200980.832493:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00080000:3.0:1788200980.832565:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200980.832570:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200980.832573:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715095552:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788200980.949003:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200980.949167:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788200980.949315:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695358208 00000100:00100000:2.0:1788200980.949326:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695358208 00000100:00100000:2.0:1788200980.949553:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1187 00000100:00100000:2.0:1788200980.949562:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875060695358208:12345-192.168.201.20@tcp:400:kworker.0 00000020:00080000:2.0:1788200980.949572:0:69485:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.20@tcp 00000100:00100000:2.0:1788200980.949635:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875060695358208:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 73us (642us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788200980.949643:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1187 00000100:00100000:3.0:1788200980.949836:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695358464 00000100:00100000:3.0:1788200980.949842:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695358464 00000100:00100000:3.0:1788200980.949889:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2674 00000100:00100000:3.0:1788200980.949897:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695358464:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788200980.949948:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695358464:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 52us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200980.949955:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2674 00000100:00080000:3.0:1788200980.949997:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000400:00000100:0.0:1788200980.950092:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695358080 offset 0 length 224: 4 00000100:00100000:0.0:1788200980.950169:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200980.950273:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200980.950566:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695358336 00000100:00100000:3.0:1788200980.950571:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695358336 00000100:00100000:3.0:1788200980.950617:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1218 00000100:00100000:3.0:1788200980.950625:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695358336:12345-192.168.201.20@tcp:400:kworker.0 00000100:00080000:2.0:1788200980.950742:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788200980.952891:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695358592 00000100:00100000:1.0:1788200980.952905:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695358592 00000100:00100000:1.0:1788200980.953003:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2675 00000100:00100000:1.0:1788200980.953049:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695358592:12345-192.168.201.20@tcp:400:kworker.0 00000100:00080000:2.0:1788200980.953144:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788200980.953744:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695358592:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 730us (3468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200980.953753:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2675 00000100:00100000:3.0:1788200980.956374:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695358336:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 5737us (6192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200980.956389:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1218 00000100:00100000:2.0:1788200980.957454:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200980.957939:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695358720 00000100:00100000:1.0:1788200980.957950:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695358720 00000100:00100000:1.0:1788200980.957998:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1188 00000100:00100000:1.0:1788200980.958007:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695358720:12345-192.168.201.20@tcp:38:ptlrpcd_01_01.0 00010000:00020000:1.0:1788200980.958072:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200980.958140:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695358720:12345-192.168.201.20@tcp:38:ptlrpcd_01_01.0 Request processed in 132us (691us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788200980.958148:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1188 00010000:00010000:0.0:1788200981.263768:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200982.287286:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200983.313299:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200983.888684:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788200983.888708:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715095680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788200983.888779:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200983.888826:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715095680 00000100:00100000:1.0:1788200983.888834:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715095680 00000100:00100000:1.0:1788200983.888887:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2170 00000100:00100000:1.0:1788200983.888897:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715095680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788200983.888926:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788200983.888970:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715095680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200983.888977:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2170 00000100:00080000:1.0:1788200983.889000:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788200983.889046:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715095808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788200983.889073:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200983.889117:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715095680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788200983.889225:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715095808 00000100:00100000:3.0:1788200983.889230:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715095808 00000100:00100000:3.0:1788200983.889287:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2171 00000100:00100000:3.0:1788200983.889304:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715095808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788200983.889328:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200983.889365:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715095808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200983.889370:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2171 00000100:00080000:1.0:1788200983.889718:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788200983.889743:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715095808:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788200984.335493:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788200984.403107:0:75739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788200984.403123:0:75739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411438 is committed 00000020:00000080:1.0:1788200984.403129:0:75739:0:(genops.c:885:class_export_put()) final put ffff8dc13339c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788200984.403174:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13339c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788200984.403233:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1031fa800 for lustre-MDT0001 00000001:00100000:0.0:1788200984.410193:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788200984.410202:0:9526:0:(genops.c:885:class_export_put()) final put ffff8dc003956800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788200984.410464:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc003956800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788200984.410517:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc005a4f800 for lustre-OST0001 00000001:00100000:2.0:1788200984.411440:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788200984.411446:0:8442:0:(genops.c:885:class_export_put()) final put ffff8dc12f1af000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788200984.413992:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12f1af000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788200984.423157:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc13aa9b800 for lustre-OST0000 00010000:00010000:2.0:1788200985.362434:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788200985.935716:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200985.935723:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788200985.935727:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200985.935735:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3832 00000100:00080000:1.0:1788200985.935741:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788200985.935747:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200985.935772:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc1331dc000 x1875060715096064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788200985.935800:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200985.935804:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788200985.935805:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200985.935809:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3832 00000100:00080000:1.0:1788200985.935811:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788200985.935832:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200985.935849:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc137c34380 x1875060715096320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788200985.935876:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200985.935880:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788200985.935882:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200985.935886:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3832 00000100:00080000:1.0:1788200985.935888:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788200985.935892:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200985.935905:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc137c37b80 x1875060715096576/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788200985.935927:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200985.935930:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788200985.935932:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200985.935935:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3832 00000100:00080000:1.0:1788200985.935937:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788200985.935940:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200985.935951:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc1060cc700 x1875060715096960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788200985.936005:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715096704:0@lo:400:kworker.0 00000100:00100000:1.0:1788200985.936102:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200985.936145:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788200985.936151:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715096448:0@lo:400:kworker.0 00000100:00100000:1.0:1788200985.936181:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200985.936220:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715096704 00000100:00100000:1.0:1788200985.936229:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715096704 00000100:00100000:3.0:1788200985.936453:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715095936:0@lo:400:kworker.0 00000400:00000100:3.0:1788200985.936480:0:3655:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715095936 offset 0 length 224: 4 00000100:00100000:3.0:1788200985.936518:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715096832:0@lo:400:kworker.0 00000100:00100000:3.0:1788200985.936544:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200985.936564:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788200985.936570:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715096192:0@lo:400:kworker.0 00000100:00100000:3.0:1788200985.936601:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200985.936627:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715096064:0@lo:38:kworker.0 00000100:00100000:3.0:1788200985.936648:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200985.936666:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715096320:0@lo:38:kworker.0 00000100:00100000:3.0:1788200985.936683:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200985.936700:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715096576:0@lo:38:kworker.0 00000100:00100000:3.0:1788200985.936721:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200985.936736:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715096960:0@lo:38:kworker.0 00000100:00100000:3.0:1788200985.936759:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200985.936786:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715096832 00000100:00100000:3.0:1788200985.936791:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715096832 00000100:00100000:3.0:1788200985.936844:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2676 00000100:00100000:3.0:1788200985.936853:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715096832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200985.936903:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715096832:12345-0@lo:400:kworker.0 Request processed in 51us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200985.936909:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2676 00000100:00100000:3.0:1788200985.936935:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715096448 00000100:00100000:3.0:1788200985.936939:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715096448 00000100:00100000:3.0:1788200985.936959:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715096192 00000100:00100000:3.0:1788200985.936961:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715096192 00000100:00100000:3.0:1788200985.936973:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715096064 00000100:00100000:3.0:1788200985.936975:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715096064 00000100:00100000:3.0:1788200985.936982:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715096320 00000100:00100000:3.0:1788200985.936984:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715096320 00000100:00100000:3.0:1788200985.936990:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715096960 00000100:00100000:3.0:1788200985.936992:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715096960 00000100:00100000:3.0:1788200985.937001:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:3.0:1788200985.937007:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715096448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200985.937081:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715096448:12345-0@lo:400:kworker.0 Request processed in 74us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200985.937088:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00100000:3.0:1788200985.937102:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:3.0:1788200985.937109:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715096192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200985.937136:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715096192:12345-0@lo:400:kworker.0 Request processed in 27us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200985.937142:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00100000:3.0:1788200985.937154:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1788200985.937158:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715096064:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788200985.937176:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788200985.937207:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715096064:12345-0@lo:38:kworker.0 Request processed in 47us (558us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788200985.937214:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1788200985.937226:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:3.0:1788200985.937230:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715096320:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788200985.937238:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788200985.937620:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715096320:12345-0@lo:38:kworker.0 Request processed in 387us (933us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788200985.937626:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00100000:3.0:1788200985.937640:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:3.0:1788200985.937644:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715096960:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788200985.937654:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788200985.937677:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715096960:12345-0@lo:38:kworker.0 Request processed in 31us (918us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788200985.937689:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00080000:3.0:1788200985.937732:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200985.937737:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200985.937741:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715096064:0@lo:38:kworker.0 00000100:00080000:3.0:1788200985.937753:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200985.937756:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200985.937758:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715096320:0@lo:38:kworker.0 00000100:00080000:3.0:1788200985.937767:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788200985.937770:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788200985.937772:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715096960:0@lo:38:kworker.0 00000100:00100000:3.0:1788200985.937809:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715096192:0@lo:400:kworker.0 00000100:00100000:3.0:1788200985.937821:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715096832:0@lo:400:kworker.0 00000100:00080000:3.0:1788200985.937859:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788200985.937863:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788200985.937865:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788200985.937894:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715096448:0@lo:400:kworker.0 00000100:00100000:1.0:1788200985.938038:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2677 00000100:00100000:1.0:1788200985.938046:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715096704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200985.938091:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715096704:12345-0@lo:400:kworker.0 Request processed in 47us (1989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200985.938097:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2677 00000100:00100000:1.0:1788200985.938128:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715096704:0@lo:400:kworker.0 00000100:00100000:2.0:1788200985.938373:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715096576 00000100:00100000:2.0:1788200985.938386:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715096576 00000100:00100000:2.0:1788200985.938432:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3885 00000100:00100000:2.0:1788200985.938437:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715096576:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788200985.938450:0:83817:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788200985.938500:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715096576:12345-0@lo:38:kworker.0 Request processed in 62us (1778us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788200985.938507:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3885 00000100:00080000:1.0:1788200985.938840:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788200985.938845:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788200985.938849:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715096576:0@lo:38:kworker.0 00000100:00100000:0.0:1788200986.074733:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200986.074838:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695359232 00000100:00100000:3.0:1788200986.074849:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695359232 00000100:00100000:3.0:1788200986.074900:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1192 00000100:00100000:3.0:1788200986.074908:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875060695359232:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:3.0:1788200986.074933:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788200986.075002:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875060695359232:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 94us (281us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788200986.075068:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1192 00000400:00000100:0.0:1788200986.075705:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695359104 offset 0 length 224: 4 00000100:00100000:0.0:1788200986.075730:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200986.075763:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200986.075797:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200986.075860:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695359360 00000100:00100000:1.0:1788200986.075866:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695359360 00000100:00100000:1.0:1788200986.075920:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1221 00000100:00100000:1.0:1788200986.075930:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695359360:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788200986.075980:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695359360:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 52us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200986.075986:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1221 00000100:00080000:0.0:1788200986.076052:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788200986.076263:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695359488 00000100:00100000:2.0:1788200986.076268:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695359488 00000100:00100000:2.0:1788200986.076311:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695359616 00000100:00100000:2.0:1788200986.076314:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695359616 00000100:00100000:2.0:1788200986.076336:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2678 00000100:00100000:2.0:1788200986.076344:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695359488:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788200986.076377:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695359488:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 35us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200986.076383:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2678 00000100:00100000:2.0:1788200986.076395:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2679 00000100:00080000:0.0:1788200986.076486:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788200986.076490:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788200986.076620:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695359616:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788200986.076661:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695359616:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 260us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200986.076667:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2679 00010000:00010000:1.0:1788200986.383282:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200987.407215:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200988.431584:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788200989.007301:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788200989.007328:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715097088:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788200989.007385:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715097216:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788200989.007397:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200989.007461:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715097088 00000100:00100000:0.0:1788200989.007468:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715097088 00000100:00100000:0.0:1788200989.007528:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2172 00000100:00100000:0.0:1788200989.007538:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715097088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788200989.007567:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788200989.009894:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788200989.010560:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715097088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3019us (3157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200989.010572:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2172 00000100:00100000:2.0:1788200989.010759:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715097088:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788200989.010971:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200989.012456:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715097216 00000100:00100000:2.0:1788200989.012468:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715097216 00000100:00080000:3.0:1788200989.012528:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788200989.012538:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2173 00000100:00100000:2.0:1788200989.012548:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715097216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788200989.012579:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788200989.012649:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715097216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (1678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200989.012656:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2173 00000100:00100000:3.0:1788200989.012691:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715097216:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788200989.455760:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200990.479681:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788200991.059368:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200991.059375:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788200991.059378:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200991.059386:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3837 00000100:00080000:1.0:1788200991.059398:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788200991.059405:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200991.059427:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc133332680 x1875060715097472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788200991.059468:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200991.059471:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788200991.059472:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200991.059476:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3837 00000100:00080000:1.0:1788200991.059478:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788200991.059482:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200991.059494:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc133330000 x1875060715097728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788200991.059508:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200991.059511:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788200991.059513:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200991.059516:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3837 00000100:00080000:1.0:1788200991.059518:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788200991.059522:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200991.059533:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12fb0c700 x1875060715097984/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788200991.059555:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200991.059557:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788200991.059559:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200991.059563:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3837 00000100:00080000:1.0:1788200991.059571:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788200991.059575:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200991.059587:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d50000 x1875060715098368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788200991.059617:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715097344:0@lo:400:kworker.0 00000400:00000100:1.0:1788200991.059670:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715097344 offset 0 length 224: 4 00000100:00100000:1.0:1788200991.059709:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00388ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715098240:0@lo:400:kworker.0 00000100:00100000:1.0:1788200991.059741:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200991.059770:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788200991.059777:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715098112:0@lo:400:kworker.0 00000100:00100000:1.0:1788200991.059801:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200991.059834:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715097472:0@lo:38:kworker.0 00000100:00100000:1.0:1788200991.059862:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200991.059881:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715097728:0@lo:38:kworker.0 00000100:00100000:1.0:1788200991.059902:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200991.059927:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715097984:0@lo:38:kworker.0 00000100:00100000:3.0:1788200991.059934:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715097472 00000100:00100000:3.0:1788200991.059943:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715097472 00000100:00100000:1.0:1788200991.059952:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200991.059972:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715098368:0@lo:38:kworker.0 00000100:00100000:3.0:1788200991.059976:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715097728 00000100:00100000:3.0:1788200991.059981:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715097728 00000100:00100000:1.0:1788200991.060000:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200991.060005:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:3.0:1788200991.060035:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715097472:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788200991.060056:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200991.060066:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715098368 00000100:00100000:1.0:1788200991.060071:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715098368 00000100:00100000:1.0:1788200991.060092:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:1.0:1788200991.060098:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715097728:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788200991.060106:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715097472:12345-0@lo:38:kworker.0 Request processed in 90us (241us total) trans 0 rc -19/-19 00010000:00020000:1.0:1788200991.060112:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788200991.060117:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:3.0:1788200991.060139:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:3.0:1788200991.060145:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715098368:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788200991.060155:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715097728:12345-0@lo:38:kworker.0 Request processed in 55us (251us total) trans 0 rc -19/-19 00010000:00020000:3.0:1788200991.060157:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200991.060182:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00100000:1.0:1788200991.060203:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715097984 00000100:00100000:1.0:1788200991.060207:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715097984 00000100:00100000:1.0:1788200991.060229:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3886 00000100:00100000:1.0:1788200991.060234:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715097984:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788200991.060244:0:23728:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200991.060272:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715097984:12345-0@lo:38:kworker.0 Request processed in 37us (320us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788200991.060278:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3886 00000100:00080000:1.0:1788200991.060322:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788200991.060326:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788200991.060329:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715097472:0@lo:38:kworker.0 00000100:00080000:1.0:1788200991.060338:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788200991.060341:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788200991.060344:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715097728:0@lo:38:kworker.0 00000100:00080000:1.0:1788200991.060350:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788200991.060354:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788200991.060357:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715097984:0@lo:38:kworker.0 00000100:00100000:3.0:1788200991.060553:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715098368:12345-0@lo:38:kworker.0 Request processed in 406us (552us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788200991.060561:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:3.0:1788200991.061146:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715097600:0@lo:400:kworker.0 00000100:00100000:3.0:1788200991.061192:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200991.061219:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788200991.061225:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715097856:0@lo:400:kworker.0 00000100:00100000:3.0:1788200991.061257:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788200991.061755:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715098240 00000100:00100000:2.0:1788200991.061764:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715098240 00000100:00100000:3.0:1788200991.061769:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715098112 00000100:00100000:3.0:1788200991.061776:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715098112 00000100:00100000:3.0:1788200991.061822:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2680 00000100:00100000:2.0:1788200991.061833:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2681 00000100:00100000:3.0:1788200991.061834:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715098112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788200991.061848:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715098240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788200991.061905:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715098112:12345-0@lo:400:kworker.0 Request processed in 75us (2103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788200991.061910:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715098240:12345-0@lo:400:kworker.0 Request processed in 63us (2166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200991.061918:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2680 00000100:00100000:2.0:1788200991.061925:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2681 00000100:00080000:3.0:1788200991.061952:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788200991.061957:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788200991.062893:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788200991.062901:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788200991.062905:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715098368:0@lo:38:kworker.0 00000100:00100000:1.0:1788200991.062936:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715097600 00000100:00100000:1.0:1788200991.062948:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715097600 00000100:00100000:1.0:1788200991.063043:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715097856 00000100:00100000:1.0:1788200991.063047:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715097856 00000100:00080000:2.0:1788200991.063084:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788200991.063181:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:1.0:1788200991.063190:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715097600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788200991.063240:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715098112:0@lo:400:kworker.0 00000100:00100000:1.0:1788200991.063259:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715097600:12345-0@lo:400:kworker.0 Request processed in 68us (2065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200991.063263:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00388ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715098240:0@lo:400:kworker.0 00000100:00100000:1.0:1788200991.063272:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00100000:1.0:1788200991.063295:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:1.0:1788200991.063303:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715097856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200991.063333:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715097856:12345-0@lo:400:kworker.0 Request processed in 32us (2075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200991.063339:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00000100:00100000:1.0:1788200991.063380:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715097856:0@lo:400:kworker.0 00000100:00100000:1.0:1788200991.063393:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715097600:0@lo:400:kworker.0 00000400:00000100:3.0:1788200991.196372:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695359744 offset 0 length 224: 4 00000100:00100000:3.0:1788200991.196413:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200991.196448:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788200991.196477:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200991.196543:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695360000 00000100:00100000:1.0:1788200991.196554:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695360000 00000100:00100000:1.0:1788200991.196632:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695359872 00000100:00100000:1.0:1788200991.196636:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695359872 00000100:00100000:1.0:1788200991.196656:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1224 00000100:00100000:1.0:1788200991.196666:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695360000:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200991.196729:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1196 00000100:00100000:0.0:1788200991.196735:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2399:x1875060695359872:12345-192.168.201.20@tcp:38:kworker.0 00000100:00100000:1.0:1788200991.196739:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695360000:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 76us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200991.196746:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1224 00010000:00020000:0.0:1788200991.196768:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788200991.196796:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2399:x1875060695359872:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 59us (346us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788200991.196802:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1196 00000100:00100000:3.0:1788200991.196951:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695360128 00000100:00100000:3.0:1788200991.196955:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695360128 00000100:00100000:3.0:1788200991.196992:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5874 00000100:00100000:3.0:1788200991.196999:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4292087e-fa00-4621-b681-837afc99ae35+5:2399:x1875060695360128:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:3.0:1788200991.197043:0:26202:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1ae67 00000100:00080000:3.0:1788200991.197052:0:26202:0:(import.c:65:import_set_state_nolock()) ffff8dc0078dc800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788200991.197099:0:26202:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969450 00000100:00100000:3.0:1788200991.197241:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4292087e-fa00-4621-b681-837afc99ae35+2:2399:x1875060695360128:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 242us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200991.197248:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5874 00000100:00100000:3.0:1788200991.197440:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788200991.197570:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695360256 00000100:00100000:1.0:1788200991.197584:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695360256 00000100:00100000:1.0:1788200991.197624:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5875 00000100:00100000:1.0:1788200991.197630:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4292087e-fa00-4621-b681-837afc99ae35+5:2399:x1875060695360256:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:1.0:1788200991.197646:0:26201:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1ae6e 00000100:00080000:1.0:1788200991.197661:0:26201:0:(import.c:65:import_set_state_nolock()) ffff8dc11d639800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788200991.197687:0:26201:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969450 00000100:00100000:1.0:1788200991.197763:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4292087e-fa00-4621-b681-837afc99ae35+2:2399:x1875060695360256:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 132us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200991.197770:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5875 00000100:00080000:2.0:1788200991.198041:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788200991.198046:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788200991.198049:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788200991.198448:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200991.198458:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200991.504048:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200992.542111:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788200993.551389:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788200994.132484:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788200994.132507:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715098496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788200994.132596:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200994.138633:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715098624:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788200994.138703:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200994.138765:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715098496 00000100:00100000:0.0:1788200994.138772:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715098496 00000100:00100000:0.0:1788200994.138822:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715098624 00000100:00100000:0.0:1788200994.138825:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715098624 00000100:00100000:0.0:1788200994.138843:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2174 00000100:00100000:0.0:1788200994.138851:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715098496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788200994.138892:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200994.138939:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715098496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (6343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200994.138946:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2174 00000100:00100000:0.0:1788200994.138962:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2175 00000100:00100000:0.0:1788200994.138968:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715098624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788200994.138982:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788200994.139009:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715098624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200994.139045:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2175 00000100:00080000:0.0:1788200994.139066:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788200994.139076:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788200994.139127:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715098624:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788200994.139146:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715098496:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788200994.575203:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788200995.599837:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788200996.175847:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200996.175855:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788200996.175859:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200996.175867:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3842 00000100:00080000:1.0:1788200996.175873:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788200996.175881:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200996.175908:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12fb0d180 x1875060715098880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788200996.175933:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200996.175936:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788200996.175938:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200996.175941:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3842 00000100:00080000:1.0:1788200996.175944:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788200996.175948:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200996.175968:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc133331500 x1875060715099136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788200996.175988:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200996.175991:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788200996.175993:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200996.175997:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3842 00000100:00080000:1.0:1788200996.175999:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788200996.176003:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200996.176040:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc133332680 x1875060715099392/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788200996.176064:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200996.176067:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788200996.176069:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200996.176072:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3842 00000100:00080000:1.0:1788200996.176075:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788200996.176089:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200996.176101:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12014e680 x1875060715099776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788200996.176137:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715099008:0@lo:400:kworker.0 00000100:00100000:1.0:1788200996.176206:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200996.176248:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788200996.176254:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715098752:0@lo:400:kworker.0 00000400:00000100:1.0:1788200996.176275:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715098752 offset 0 length 224: 4 00000100:00100000:1.0:1788200996.176297:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715099648:0@lo:400:kworker.0 00000100:00100000:1.0:1788200996.176349:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200996.176384:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715098880:0@lo:38:kworker.0 00000100:00100000:1.0:1788200996.176408:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200996.176424:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715099136:0@lo:38:kworker.0 00000100:00100000:1.0:1788200996.176443:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200996.176458:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715099392:0@lo:38:kworker.0 00000100:00100000:1.0:1788200996.176481:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200996.176498:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715099776:0@lo:38:kworker.0 00000100:00100000:1.0:1788200996.176522:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200996.176554:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715099264:0@lo:400:kworker.0 00000100:00100000:1.0:1788200996.176578:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200996.176597:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788200996.176603:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715099520:0@lo:400:kworker.0 00000100:00100000:1.0:1788200996.176626:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788200996.176655:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715099008 00000100:00100000:1.0:1788200996.176661:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715099008 00000100:00100000:1.0:1788200996.176709:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715098880 00000100:00100000:1.0:1788200996.176712:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715098880 00000100:00100000:1.0:1788200996.176721:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715099136 00000100:00100000:1.0:1788200996.176724:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715099136 00000100:00100000:1.0:1788200996.176731:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715099776 00000100:00100000:1.0:1788200996.176733:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715099776 00000100:00100000:1.0:1788200996.176738:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715099264 00000100:00100000:1.0:1788200996.176740:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715099264 00000100:00100000:1.0:1788200996.176755:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1225 00000100:00100000:1.0:1788200996.176763:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715099008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200996.176813:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715099008:12345-0@lo:400:kworker.0 Request processed in 50us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200996.176827:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1225 00000100:00100000:1.0:1788200996.176847:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1226 00000100:00100000:1.0:1788200996.176854:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715099264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200996.176891:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715099264:12345-0@lo:400:kworker.0 Request processed in 37us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200996.176897:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1226 00000100:00100000:1.0:1788200996.176909:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:1.0:1788200996.176913:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715098880:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788200996.176932:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200996.176965:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715098880:12345-0@lo:38:kworker.0 Request processed in 49us (555us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788200996.176971:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:1.0:1788200996.176982:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:1.0:1788200996.176985:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715099136:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788200996.176993:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200996.177039:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715099136:12345-0@lo:38:kworker.0 Request processed in 29us (572us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788200996.177045:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:1.0:1788200996.177057:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:1.0:1788200996.177061:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715099776:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788200996.177069:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200996.177103:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715099776:12345-0@lo:38:kworker.0 Request processed in 40us (580us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788200996.177109:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:1.0:1788200996.177136:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715099648 00000100:00100000:1.0:1788200996.177140:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715099648 00000100:00100000:1.0:1788200996.177166:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715099520 00000100:00100000:1.0:1788200996.177169:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715099520 00000100:00100000:1.0:1788200996.177188:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2682 00000100:00100000:1.0:1788200996.177194:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715099648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200996.177225:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715099648:12345-0@lo:400:kworker.0 Request processed in 32us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200996.177231:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2682 00000100:00100000:1.0:1788200996.177242:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2683 00000100:00100000:1.0:1788200996.177249:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715099520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788200996.177275:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715099520:12345-0@lo:400:kworker.0 Request processed in 27us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788200996.177281:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2683 00000100:00100000:1.0:1788200996.177312:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715099392 00000100:00100000:1.0:1788200996.177316:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715099392 00000100:00100000:1.0:1788200996.177338:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3887 00000100:00100000:1.0:1788200996.177342:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715099392:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788200996.177352:0:8458:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788200996.177378:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715099392:12345-0@lo:38:kworker.0 Request processed in 34us (896us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788200996.177383:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3887 00000100:00080000:1.0:1788200996.177409:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788200996.177412:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788200996.177414:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788200996.177453:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715099520:0@lo:400:kworker.0 00000100:00100000:1.0:1788200996.177464:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715099264:0@lo:400:kworker.0 00000100:00080000:1.0:1788200996.177503:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788200996.177507:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788200996.177511:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715098880:0@lo:38:kworker.0 00000100:00080000:1.0:1788200996.177518:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788200996.177521:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788200996.177524:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715099136:0@lo:38:kworker.0 00000100:00080000:1.0:1788200996.177531:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788200996.177535:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788200996.177537:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715099392:0@lo:38:kworker.0 00000100:00080000:1.0:1788200996.177545:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788200996.177548:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788200996.177552:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715099776:0@lo:38:kworker.0 00000100:00100000:1.0:1788200996.177579:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715099648:0@lo:400:kworker.0 00000100:00100000:1.0:1788200996.177589:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715099008:0@lo:400:kworker.0 00000100:00000400:2.0:1788200996.180168:0:3656:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788200980/real 1788200980] req@ffff8dc007159f80 x1875060715094016/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788200996 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788200996.180204:0:3656:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8dc007159f80 x1875060715094016/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788200996 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788200996.180658:0:3656:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788200996.180671:0:3656:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788200996.180674:0:3656:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.120@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788200996.180676:0:3656:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788200996.180680:0:3656:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc007159f80 x1875060715094016/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788200996 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788200996.180690:0:3656:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc007158e00 x1875060715095936/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201001 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788200996.180707:0:3656:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc133f4fb80 x1875060715097344/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201007 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788200996.180730:0:3656:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc12fb0e300 x1875060715098752/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201012 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788200996.180739:0:3656:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788200996.180742:0:3656:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788200996.180743:0:3656:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788200996.180745:0:3656:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:2.0:1788200996.180771:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715094016:0@lo:400:kworker.0 00000100:00100000:0.0:1788200996.180885:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715098752:0@lo:400:kworker.0 00000100:00100000:0.0:1788200996.180893:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715097344:0@lo:400:kworker.0 00000100:00100000:1.0:1788200996.185228:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715095936:0@lo:400:kworker.0 00000100:00080000:1.0:1788200996.185282:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788200996.185287:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788200996.185291:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788200996.185297:0:86307:0:(import.c:510:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 3785 00000100:00080000:1.0:1788200996.185306:0:86307:0:(import.c:624:import_select_connection()) MGC192.168.201.120@tcp: import ffff8dc104280800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788200996.185350:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005abdc00 x1875060715099904/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788200996.185453:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715099904:0@lo:250:kworker.0 00000400:00000100:3.0:1788200996.185512:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715099904 offset 0 length 520: 4 00000400:00000100:0.0:1788200996.244646:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695360384 offset 0 length 520: 4 00000100:00100000:0.0:1788200996.244687:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200996.244730:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788200996.244762:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695360512 00000100:00100000:0.0:1788200996.244773:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695360512 00000100:00100000:0.0:1788200996.244810:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695360640 00000100:00100000:0.0:1788200996.244813:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695360640 00000100:00100000:0.0:1788200996.244856:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1227 00000100:00100000:0.0:1788200996.244866:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695360640:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788200996.244938:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695360640:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 73us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200996.244946:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1227 00000100:00100000:0.0:1788200996.244963:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1200 00000100:00100000:0.0:1788200996.244967:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695360512:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:0.0:1788200996.244992:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788200996.245043:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695360512:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 48us (329us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788200996.245049:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1200 00000100:00080000:0.0:1788200996.245091:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788200996.623388:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788200996.692651:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4292087e-fa00-4621-b681-837afc99ae35 00000001:00100000:3.0:1788200996.692651:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4292087e-fa00-4621-b681-837afc99ae35 00000020:00000080:2.0:1788200996.692662:0:8442:0:(genops.c:885:class_export_put()) final put ffff8dc0078db800/4292087e-fa00-4621-b681-837afc99ae35 00000020:00000080:3.0:1788200996.692662:0:9526:0:(genops.c:885:class_export_put()) final put ffff8dc11d63d000/4292087e-fa00-4621-b681-837afc99ae35 00000020:00000080:1.0:1788200996.701268:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0078db800/4292087e-fa00-4621-b681-837afc99ae35 for lustre-OST0000 00000020:00000080:0.0:1788200996.701507:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d63d000/4292087e-fa00-4621-b681-837afc99ae35 for lustre-OST0001 00000020:00000080:0.0:1788200996.701553:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc0078dc800 for lustre-OST0000 00000020:00000080:0.0:1788200996.701558:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc11d639800 for lustre-OST0001 00010000:00010000:0.0:1788200997.647635:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788200998.692909:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788200999.251944:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715100032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788200999.252081:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788200999.252283:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715100032 00000100:00100000:3.0:1788200999.252295:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715100032 00000100:00100000:3.0:1788200999.252373:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2176 00000100:00100000:3.0:1788200999.252387:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715100032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788200999.252431:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788200999.252489:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715100032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788200999.252497:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2176 00000100:00080000:0.0:1788200999.252619:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788200999.252665:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715100032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788200999.254912:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715100160:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788200999.255008:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788200999.255181:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715100160 00000100:00100000:0.0:1788200999.255192:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715100160 00000100:00100000:0.0:1788200999.255295:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2177 00000100:00100000:0.0:1788200999.255306:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715100160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788200999.255342:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788200999.255428:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788200999.255735:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715100160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 429us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788200999.255744:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2177 00000100:00100000:1.0:1788200999.255834:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715100160:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788200999.695336:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201000.734972:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201001.307592:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201001.307605:0:57134:0:(pinger.c:247:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201001.307608:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201001.307613:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201001.307618:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201001.307628:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3847 00000100:00080000:3.0:1788201001.307634:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201001.307643:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201001.307696:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc137c34380 x1875060715100288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201001.307770:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201001.307774:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201001.307776:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201001.307780:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3847 00000100:00080000:3.0:1788201001.307796:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201001.307801:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201001.307814:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc137c37b80 x1875060715100544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201001.307847:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201001.307851:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201001.307853:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201001.307857:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3847 00000100:00080000:3.0:1788201001.307859:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201001.307863:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201001.307890:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11cc2b100 x1875060715100800/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201001.307940:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201001.307944:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201001.307946:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201001.307950:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3847 00000100:00080000:3.0:1788201001.307953:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201001.307956:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201001.307979:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11cc28000 x1875060715101184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201001.308072:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715100416:0@lo:400:kworker.0 00000100:00100000:1.0:1788201001.308879:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715100288:0@lo:38:kworker.0 00000100:00100000:1.0:1788201001.309211:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201001.309257:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715100544:0@lo:38:kworker.0 00000100:00100000:1.0:1788201001.309281:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201001.309309:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715100800:0@lo:38:kworker.0 00000100:00100000:1.0:1788201001.309338:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201001.309608:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201001.309647:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201001.309655:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715101056:0@lo:400:kworker.0 00000100:00100000:3.0:1788201001.309704:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201001.309818:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715101184:0@lo:38:kworker.0 00000100:00100000:1.0:1788201001.309848:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201001.309958:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715100288 00000100:00100000:1.0:1788201001.310061:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715100288 00000100:00100000:1.0:1788201001.310181:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715100544 00000100:00100000:1.0:1788201001.310186:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715100544 00000100:00100000:1.0:1788201001.310261:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715100416 00000100:00100000:1.0:1788201001.310265:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715100416 00000100:00100000:1.0:1788201001.310443:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715101184 00000100:00100000:1.0:1788201001.310447:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715101184 00000100:00100000:1.0:1788201001.310462:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00100000:1.0:1788201001.310474:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715100416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201001.310581:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715100672:0@lo:400:kworker.0 00000100:00100000:3.0:1788201001.310627:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201001.310648:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201001.310655:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715100928:0@lo:400:kworker.0 00000100:00100000:3.0:1788201001.310680:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201001.310722:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715100672 00000100:00100000:3.0:1788201001.310726:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715100672 00000100:00100000:3.0:1788201001.312214:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1229 00000100:00100000:3.0:1788201001.312245:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715100672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201001.312352:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715100672:12345-0@lo:400:kworker.0 Request processed in 121us (1724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201001.312472:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715100416:12345-0@lo:400:kworker.0 Request processed in 1999us (2861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201001.312834:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00000100:00100000:1.0:1788201001.313210:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:1.0:1788201001.313218:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715100288:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201001.313245:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201001.313330:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715100288:12345-0@lo:38:kworker.0 Request processed in 110us (4364us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201001.313336:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:1.0:1788201001.313352:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:1.0:1788201001.313356:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715100544:12345-0@lo:38:kworker.0 00000100:00080000:2.0:1788201001.313466:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201001.313585:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1229 00000100:00100000:3.0:1788201001.313612:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:3.0:1788201001.313618:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715101184:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788201001.313628:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201001.313662:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715101184:12345-0@lo:38:kworker.0 Request processed in 44us (3813us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201001.313668:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:3.0:1788201001.313696:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715101056 00000100:00100000:3.0:1788201001.313706:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715101056 00000100:00080000:2.0:1788201001.313837:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201001.314148:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715100928 00000100:00100000:3.0:1788201001.314154:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715100928 00010000:00020000:1.0:1788201001.316611:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201001.316719:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715100544:12345-0@lo:38:kworker.0 Request processed in 3359us (7434us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201001.316731:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:1.0:1788201001.316794:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715100800 00000100:00100000:1.0:1788201001.316802:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715100800 00000100:00100000:1.0:1788201001.316851:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3888 00000100:00100000:1.0:1788201001.316859:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715100800:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201001.316870:0:23728:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201001.316904:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715100800:12345-0@lo:38:kworker.0 Request processed in 44us (7564us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201001.316910:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3888 00000100:00080000:1.0:1788201001.317136:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201001.317144:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201001.317148:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715100288:0@lo:38:kworker.0 00000100:00080000:1.0:1788201001.317179:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201001.317183:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201001.317185:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715100544:0@lo:38:kworker.0 00000100:00080000:1.0:1788201001.317195:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201001.317199:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201001.317201:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715100800:0@lo:38:kworker.0 00000100:00080000:1.0:1788201001.317213:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201001.317216:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201001.317219:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715101184:0@lo:38:kworker.0 00000100:00100000:2.0:1788201001.318064:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2684 00000100:00100000:2.0:1788201001.318085:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715101056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201001.318186:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715101056:12345-0@lo:400:kworker.0 Request processed in 111us (8481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201001.318194:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2684 00000100:00100000:2.0:1788201001.318238:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2685 00000100:00100000:2.0:1788201001.318246:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715100928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201001.318284:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715100928:12345-0@lo:400:kworker.0 Request processed in 40us (7603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201001.318290:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2685 00000100:00100000:1.0:1788201001.320062:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715101056:0@lo:400:kworker.0 00000100:00100000:1.0:1788201001.320086:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715100416:0@lo:400:kworker.0 00000100:00100000:1.0:1788201001.320215:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715100928:0@lo:400:kworker.0 00000100:00100000:1.0:1788201001.320231:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715100672:0@lo:400:kworker.0 00000100:00080000:3.0:1788201001.322717:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201001.430148:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201001.430198:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201001.430235:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695360896 00000100:00100000:1.0:1788201001.430248:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695360896 00000100:00080000:0.0:1788201001.430550:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201001.430566:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695360768 00000100:00100000:0.0:1788201001.430571:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695360768 00000100:00100000:0.0:1788201001.430626:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1204 00000100:00100000:0.0:1788201001.430637:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2399:x1875060695360768:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:0.0:1788201001.430671:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201001.430735:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1230 00000100:00100000:1.0:1788201001.430744:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695360896:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201001.430814:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695360896:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 71us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201001.430823:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1230 00000100:00100000:0.0:1788201001.432507:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2399:x1875060695360768:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 1856us (2293us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201001.432522:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1204 00010000:00010000:2.0:1788201001.743423:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201002.767377:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788201003.384496:0:89111:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788201003.384506:0:89111:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788201003.384508:0:89111:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788201003.384711:0:89111:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dc1341d8000 00000020:01000004:3.0:1788201003.384752:0:89111:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788201003.384771:0:89111:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788201003.384792:0:89111:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8dc1401b4d28) 00000020:00000080:3.0:1788201003.384815:0:89111:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788201003.593225:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788201003.613254:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788201003.615528:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788201003.616751:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788201003.617155:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788201003.617554:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788201003.619152:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788201003.619660:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788201003.620845:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788201003.621603:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788201003.622505:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788201003.624902:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788201003.626058:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788201003.626589:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788201003.643013:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788201003.644296:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788201003.644719:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788201003.644984:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788201003.645280:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788201003.645462:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788201003.645795:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788201003.646069:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788201003.646314:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788201003.646666:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788201003.649239:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788201003.649692:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788201003.649976:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788201003.650373:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788201003.650675:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788201003.650924:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788201003.651200:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788201003.651398:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788201003.651700:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788201003.652060:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788201003.653156:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1788201003.653994:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788201003.654334:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788201003.654524:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788201003.654905:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788201003.655189:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788201003.655418:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788201003.655785:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1788201003.655987:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788201003.656199:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788201003.656382:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1788201003.656738:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788201003.657040:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788201003.658402:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788201003.660235:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1788201003.660506:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788201003.661077:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1788201003.661860:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788201003.662133:0:89111:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:1.0:1788201003.662839:0:89111:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788201003.663234:0:89111:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788201003.663249:0:89111:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788201003.663266:0:89111:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1afc5 00000020:01000004:1.0:1788201003.663275:0:89111:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788201003.663289:0:89111:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788201003.663296:0:89111:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dc1341d8000 from MGS 00000020:01000004:1.0:1788201003.663300:0:89111:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788201003.663313:0:89111:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8dc139bbb370) 00000020:00000080:1.0:1788201003.663340:0:89111:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:1.0:1788201003.663430:0:89111:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc1341d8000 from MGS, refs=2 00080000:01000000:1.0:1788201003.663436:0:89111:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788201003.663443:0:89111:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1afd3 00010000:00010000:1.0:1788201003.663611:0:89111:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1788201003.676283:0:89111:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788201003.679855:0:89115:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788201003.680555:0:89111:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788201003.680652:0:89111:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788201003.681722:0:89111:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788201003.682182:0:89111:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201003.682399:0:89111:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788201003.682409:0:89111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788201003.695063:0:89111:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788201003.695085:0:89111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788201003.696119:0:89111:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788201003.696132:0:89111:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788201003.701944:0:89111:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788201003.702002:0:89111:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1788201003.702004:0:89111:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.120@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1788201003.702010:0:89111:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.120@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:0.0:1788201003.702036:0:89111:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8dc104280800 already not connected (conn 69, was 0): CONNECTING 00000100:00100000:0.0:1788201003.702044:0:89111:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00010000:00010000:2.0:1788201003.792061:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201004.367494:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201004.367650:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715101312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201004.367754:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201004.367847:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cb51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715101440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201004.368011:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201004.377074:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715101440 00000100:00100000:0.0:1788201004.377098:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715101440 00000100:00100000:0.0:1788201004.377392:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2178 00000100:00100000:0.0:1788201004.377406:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715101440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201004.377453:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201004.377571:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715101440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 169us (9559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201004.377580:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2178 00000100:00100000:0.0:1788201004.377680:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cb51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715101440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201004.377757:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715101312 00000100:00100000:2.0:1788201004.377764:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715101312 00000100:00080000:3.0:1788201004.378353:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201004.378359:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201004.378595:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2179 00000100:00100000:2.0:1788201004.378608:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715101312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201004.378637:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201004.378722:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715101312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (10968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201004.378729:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2179 00000100:00100000:1.0:1788201004.378843:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715101312:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788201004.815454:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201005.843101:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201006.416079:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201006.416095:0:86307:0:(pinger.c:247:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201006.416099:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201006.416103:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201006.416108:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201006.416121:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3852 00000100:00080000:1.0:1788201006.416129:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788201006.416138:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201006.416201:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11d29f100 x1875060715101568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201006.416266:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201006.416270:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201006.416272:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201006.416276:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3852 00000100:00080000:1.0:1788201006.416279:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788201006.416283:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201006.416295:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715101696:0@lo:400:kworker.0 00000100:00100000:1.0:1788201006.416296:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11cc2aa00 x1875060715101824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201006.416350:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201006.416354:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201006.416356:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201006.416359:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3852 00000100:00080000:1.0:1788201006.416362:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788201006.416366:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201006.416377:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11cc28000 x1875060715102080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201006.416398:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201006.416401:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201006.416402:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201006.416406:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3852 00000100:00080000:1.0:1788201006.416408:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1788201006.416408:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201006.416411:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201006.416423:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc137c37b80 x1875060715102464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201006.416448:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715102208:0@lo:400:kworker.0 00000100:00100000:3.0:1788201006.416459:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201006.416465:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715102336:0@lo:400:kworker.0 00000100:00100000:1.0:1788201006.416485:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201006.416512:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715101952:0@lo:400:kworker.0 00000100:00100000:3.0:1788201006.416540:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201006.416593:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201006.416679:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715101696 00000100:00100000:1.0:1788201006.416689:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715101696 00000100:00100000:1.0:1788201006.416760:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715101952 00000100:00100000:1.0:1788201006.416763:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715101952 00000100:00100000:1.0:1788201006.416788:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1231 00000100:00100000:1.0:1788201006.416799:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715101696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201006.416879:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715101696:12345-0@lo:400:kworker.0 Request processed in 81us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201006.416887:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1231 00000100:00100000:1.0:1788201006.416942:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1232 00000100:00100000:1.0:1788201006.416949:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715101952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201006.416998:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715101952:12345-0@lo:400:kworker.0 Request processed in 50us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201006.417005:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1232 00000100:00100000:1.0:1788201006.417057:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715102208 00000100:00100000:1.0:1788201006.417061:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715102208 00000100:00100000:1.0:1788201006.417096:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715102336 00000100:00100000:1.0:1788201006.417099:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715102336 00000100:00100000:1.0:1788201006.417120:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2686 00000100:00100000:1.0:1788201006.417127:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715102208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201006.417180:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715102208:12345-0@lo:400:kworker.0 Request processed in 54us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201006.417187:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2686 00000100:00100000:1.0:1788201006.417198:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2687 00000100:00100000:1.0:1788201006.417205:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715102336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201006.417245:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715102336:12345-0@lo:400:kworker.0 Request processed in 41us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201006.417251:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2687 00000100:00100000:1.0:1788201006.417308:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715102208:0@lo:400:kworker.0 00000100:00100000:1.0:1788201006.417345:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715102336:0@lo:400:kworker.0 00000100:00100000:1.0:1788201006.417358:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715101696:0@lo:400:kworker.0 00000100:00100000:1.0:1788201006.417396:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715101952:0@lo:400:kworker.0 00000100:00080000:3.0:1788201006.417848:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201006.417854:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201006.417857:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201006.421290:0:3654:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788200996/real 1788200996] req@ffff8dc005abdc00 x1875060715099904/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788201006 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201006.421329:0:3654:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dc005abdc00 x1875060715099904/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788201006 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201006.421361:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715101568:0@lo:38:kworker.0 00000100:00100000:2.0:1788201006.421460:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201006.421504:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715101824:0@lo:38:kworker.0 00000100:00100000:2.0:1788201006.421528:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201006.421557:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715102080:0@lo:38:kworker.0 00000100:00100000:2.0:1788201006.421589:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201006.421614:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715102464:0@lo:38:kworker.0 00000100:00100000:0.0:1788201006.421621:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715101568 00000100:00100000:0.0:1788201006.421633:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715101568 00000100:00100000:2.0:1788201006.421635:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788201006.421652:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1788201006.421675:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715101824 00000100:00100000:0.0:1788201006.421678:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715101824 00000100:00080000:2.0:1788201006.421690:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788201006.421691:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715102464 00000100:00100000:0.0:1788201006.421693:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715102464 00000100:00100000:2.0:1788201006.421698:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715099904:0@lo:250:kworker.0 00000100:00100000:0.0:1788201006.421706:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:0.0:1788201006.421715:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715101568:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788201006.421736:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715102080 00000100:00100000:2.0:1788201006.421740:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715102080 00010000:00020000:0.0:1788201006.421744:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201006.421762:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3889 00000100:00100000:2.0:1788201006.421768:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715102080:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788201006.421777:0:8458:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1788201006.422188:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201006.422196:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201006.422199:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201006.422214:0:86307:0:(import.c:510:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 3847 00000100:00080000:3.0:1788201006.422220:0:86307:0:(import.c:589:import_select_connection()) MGC192.168.201.120@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201006.422226:0:86307:0:(import.c:624:import_select_connection()) MGC192.168.201.120@tcp: import ffff8dc104280800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201006.422258:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11cc44700 x1875060715102592/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201006.422338:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715101568:12345-0@lo:38:kworker.0 Request processed in 621us (877us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201006.422346:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00100000:0.0:1788201006.422372:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:0.0:1788201006.422377:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715101824:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201006.422390:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201006.422471:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:1.0:1788201006.422478:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715102464:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201006.422489:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201006.424406:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715102080:12345-0@lo:38:kworker.0 Request processed in 2624us (2803us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201006.424425:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3889 10000000:01000000:2.0:1788201006.424569:0:89111:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1788201006.424590:0:89111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8800/0x96d0c9b8c9a1ac1b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1ac22 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201006.424603:0:89111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8800/0x96d0c9b8c9a1ac1b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1ac22 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201006.424611:0:89111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788201006.424630:0:89111:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201006.424642:0:89111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8800/0x96d0c9b8c9a1ac1b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1ac22 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.424664:0:89111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc100030e00/0x96d0c9b8c9a1ab81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1ab88 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201006.424670:0:89111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc100030e00/0x96d0c9b8c9a1ab81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1ab88 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201006.424676:0:89111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201006.424705:0:89111:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201006.424710:0:89111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc100030e00/0x96d0c9b8c9a1ab81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1ab88 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.424721:0:89111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9800/0x96d0c9b8c9a1ab9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1aba4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201006.424727:0:89111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9800/0x96d0c9b8c9a1ab9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1aba4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201006.424733:0:89111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201006.424736:0:89111:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201006.424739:0:89111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007ce9800/0x96d0c9b8c9a1ab9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1aba4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.424748:0:89111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8a00/0x96d0c9b8c9a1abc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1abce expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201006.424754:0:89111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8a00/0x96d0c9b8c9a1abc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1abce expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201006.424759:0:89111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201006.424763:0:89111:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201006.424766:0:89111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8a00/0x96d0c9b8c9a1abc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1abce expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.424774:0:89111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8400/0x96d0c9b8c9a1abd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1abdc expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201006.424781:0:89111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8400/0x96d0c9b8c9a1abd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1abdc expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201006.424797:0:89111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201006.424801:0:89111:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201006.424805:0:89111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8400/0x96d0c9b8c9a1abd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1abdc expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.424815:0:89111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1abf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1abf8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201006.424821:0:89111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1abf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1abf8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201006.424827:0:89111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201006.424830:0:89111:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201006.424833:0:89111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1abf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1abf8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.424842:0:89111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1abff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1ac06 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201006.424848:0:89111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1abff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1ac06 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201006.424853:0:89111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201006.424856:0:89111:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201006.424860:0:89111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1abff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1ac06 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.424868:0:89111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1ac29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1ac30 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201006.424885:0:89111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1ac29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1ac30 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201006.424890:0:89111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201006.424894:0:89111:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201006.424898:0:89111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1ac29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1ac30 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.426799:0:89111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0078fdc00/0x96d0c9b8c9a1ab8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1ab96 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201006.426823:0:89111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fdc00/0x96d0c9b8c9a1ab8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1ab96 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201006.426830:0:89111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201006.426853:0:89111:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201006.426864:0:89111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0078fdc00/0x96d0c9b8c9a1ab8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1ab96 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.426888:0:89111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8000/0x96d0c9b8c9a1abab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1abb2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201006.426894:0:89111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8000/0x96d0c9b8c9a1abab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1abb2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201006.426899:0:89111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201006.426917:0:89111:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00020000:3.0:1788201006.426922:0:3654:0:(client.c:1404:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff8dc11cc44700 x1875060715102592/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788201006.428157:0:89111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8000/0x96d0c9b8c9a1abab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1abb2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.428252:0:89111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8200/0x96d0c9b8c9a1abb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1abc0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201006.428262:0:89111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8200/0x96d0c9b8c9a1abb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1abc0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201006.428269:0:89111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788201006.428285:0:89111:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201006.428291:0:89111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8200/0x96d0c9b8c9a1abb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1abc0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.428302:0:89111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad000/0x96d0c9b8c9a1abe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1abea expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201006.428308:0:89111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad000/0x96d0c9b8c9a1abe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1abea expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201006.428314:0:89111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788201006.428329:0:89111:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201006.428333:0:89111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad000/0x96d0c9b8c9a1abe3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1abea expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.428343:0:89111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8600/0x96d0c9b8c9a1ac0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1ac14 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201006.428351:0:89111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8600/0x96d0c9b8c9a1ac0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1ac14 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201006.428356:0:89111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788201006.428382:0:89111:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201006.428387:0:89111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007ce8600/0x96d0c9b8c9a1ac0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1ac14 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201006.434767:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715101824:12345-0@lo:38:kworker.0 Request processed in 11780us (12629us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201006.434790:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00100000:1.0:1788201006.440523:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715102464:12345-0@lo:38:kworker.0 Request processed in 18027us (18868us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201006.440546:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00080000:2.0:1788201006.457828:0:89111:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8dc104280800 already not connected (conn 70, was 0): CONNECTING 00000100:00080000:2.0:1788201006.457843:0:89111:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:3.0:1788201006.458051:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201006.458076:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:3.0:1788201006.458084:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:0:1875060715102592:0@lo:250:kworker.0 00000100:00080000:3.0:1788201006.458116:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201006.458120:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201006.458123:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201006.458142:0:86307:0:(import.c:510:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 3857 00000100:00080000:3.0:1788201006.458173:0:86307:0:(import.c:589:import_select_connection()) MGC192.168.201.120@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788201006.458183:0:86307:0:(import.c:624:import_select_connection()) MGC192.168.201.120@tcp: import ffff8dc104280800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201006.459337:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11cc45f80 x1875060715102720/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201006.459419:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201006.459425:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201006.459430:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715101568:0@lo:38:kworker.0 00000100:00080000:3.0:1788201006.459444:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201006.459448:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201006.459451:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715101824:0@lo:38:kworker.0 00000100:00080000:3.0:1788201006.459464:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201006.459468:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201006.459472:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715102080:0@lo:38:kworker.0 00000100:00080000:3.0:1788201006.459485:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201006.459488:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201006.459491:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715102464:0@lo:38:kworker.0 00000100:00100000:3.0:1788201006.459551:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715102720:0@lo:250:kworker.0 00000100:00100000:3.0:1788201006.459632:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201006.462871:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715102720 00000100:00100000:1.0:1788201006.462895:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715102720 00000100:00100000:1.0:1788201006.462980:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201006.462993:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3654:x1875060715102720:12345-0@lo:250:kworker.0 00010000:00080000:1.0:1788201006.463052:0:89116:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c9b18af6-fecc-4172-82c2-66531890fe11@0@lo t0 exp 0000000000000000 cur 3857 last 0 00000020:00000080:1.0:1788201006.463090:0:89116:0:(genops.c:1385:class_connect()) connect: client c9b18af6-fecc-4172-82c2-66531890fe11, cookie 0x96d0c9b8c9a1afda 00000100:00080000:1.0:1788201006.463444:0:89116:0:(import.c:65:import_set_state_nolock()) ffff8dc137d34800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201006.463574:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+5:3654:x1875060715102720:12345-0@lo:250:kworker.0 Request processed in 583us (3941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201006.463584:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201006.463698:0:3654:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.120@tcp: committing for last_committed 0 gen 26 00000100:00080000:3.0:1788201006.463711:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.120@tcp: connect to target with instance 0 00000100:00080000:3.0:1788201006.463721:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788201006.463727:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788201006.463731:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788201006.463734:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788201006.463790:0:3654:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788201006.463812:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715102720:0@lo:250:kworker.0 00000020:01000000:0.0:1788201006.463935:0:86307:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.201.120@tcp 10000000:01000000:0.0:1788201006.463962:0:86307:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1788201006.463967:0:86307:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788201006.463969:0:86307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788201006.463971:0:86307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201006.463972:0:86307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201006.463974:0:86307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201006.463975:0:86307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201006.463977:0:86307:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201006.463980:0:86307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201006.463982:0:86307:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788201006.464062:0:86307:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1788201006.464071:0:86307:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1788201006.464073:0:86307:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788201006.464074:0:86307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788201006.464075:0:86307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201006.464076:0:86307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201006.464077:0:86307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201006.464079:0:86307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201006.464080:0:86307:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201006.464081:0:86307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201006.464082:0:86307:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788201006.464107:0:86307:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1788201006.464113:0:86307:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1788201006.464121:0:86307:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788201006.464122:0:86307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788201006.464124:0:86307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201006.464125:0:86307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201006.464126:0:86307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201006.464127:0:86307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201006.464128:0:86307:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201006.464130:0:86307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201006.464131:0:86307:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788201006.464148:0:86307:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1788201006.464184:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715102976:0@lo:253:kworker.0 00000100:00100000:2.0:1788201006.464237:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201006.464244:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201006.464249:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715102848:0@lo:253:kworker.0 00000100:00100000:0.0:1788201006.464285:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201006.464287:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201006.464290:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715103104:0@lo:253:kworker.0 00000100:00100000:0.0:1788201006.464316:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201006.471160:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715102976 00000100:00100000:1.0:1788201006.471187:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715102976 00000100:00100000:1.0:1788201006.471272:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715102848 00000100:00100000:1.0:1788201006.471276:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715102848 00000100:00100000:1.0:1788201006.471288:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715103104 00000100:00100000:1.0:1788201006.471292:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715103104 00000100:00100000:1.0:1788201006.471312:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201006.471324:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+7:3655:x1875060715102976:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788201006.471374:0:89119:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00080000:1.0:1788201006.471447:0:89111:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1788201006.471480:0:89111:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788201006.471532:0:89111:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788201006.471539:0:89111:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788201006.471695:0:89111:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788201006.471739:0:89111:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.120@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788201006.471744:0:89111:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788201006.471745:0:89111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788201006.471747:0:89111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201006.471748:0:89111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201006.471750:0:89111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201006.471751:0:89111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201006.471753:0:89111:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201006.471754:0:89111:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788201006.471757:0:89111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201006.471759:0:89111:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788201006.471762:0:89111:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788201006.471764:0:89111:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788201006.471766:0:89111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788201006.471767:0:89111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201006.471768:0:89111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201006.471769:0:89111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201006.471770:0:89111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201006.471771:0:89111:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201006.471773:0:89111:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788201006.471774:0:89111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201006.471775:0:89111:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788201006.471806:0:89111:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788201006.471834:0:89111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715103232:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788201006.471955:0:89111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201006.472000:0:89111:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1259ae000 going to sleep for 11 seconds 10000000:01000000:1.0:1788201006.472239:0:89120:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788201006.472319:0:89119:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 111 00000100:00100000:0.0:1788201006.476800:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715103232 00000100:00100000:0.0:1788201006.476822:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715103232 00000100:00100000:0.0:1788201006.476882:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788201006.476894:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+8:3657:x1875060715102848:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788201006.477189:0:89116:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788201006.478642:0:89121:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788201006.478651:0:89121:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1788201006.478656:0:89121:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788201006.478659:0:89121:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788201006.479826:0:89121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788201006.480526:0:89119:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788201006.480565:0:89119:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788201006.486611:0:89119:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788201006.486638:0:89119:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788201006.486778:0:89120:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788201006.486785:0:89120:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788201006.486824:0:89120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc006c6cc00/0x96d0c9b8c9a1afe1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.486845:0:89120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006c6cc00/0x96d0c9b8c9a1afe1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788201006.486855:0:89120:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000071769s 00010000:00010000:2.0:1788201006.486861:0:89120:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc006c6cc00/0x96d0c9b8c9a1afe1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.486868:0:89120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc006c6cc00/0x96d0c9b8c9a1afe1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.486874:0:89120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc006c6cc00/0x96d0c9b8c9a1afe1 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.486883:0:89120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc006c6cc00/0x96d0c9b8c9a1afe1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.486890:0:89120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6cc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201006.486925:0:89120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc006c6cc00/0x96d0c9b8c9a1afe1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.486935:0:89120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc006c6cc00/0x96d0c9b8c9a1afe1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.486952:0:89120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc006c6cc00/0x96d0c9b8c9a1afe1 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.486961:0:89120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc006c6cc00/0x96d0c9b8c9a1afe1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.486986:0:89120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006c6cc00/0x96d0c9b8c9a1afe1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788201006.487250:0:89116:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788201006.487662:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:3655:x1875060715102976:12345-0@lo:253:kworker.0 Request processed in 16334us (23412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201006.487675:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201006.487735:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201006.487750:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+7:3655:x1875060715103104:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788201006.487792:0:89119:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000020:01000004:0.0:1788201006.488094:0:3655:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788201006.488098:0:3655:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788201006.488099:0:3655:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201006.488100:0:3655:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201006.488102:0:3655:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201006.488103:0:3655:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201006.488105:0:3655:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201006.488107:0:3655:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201006.488108:0:3655:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788201006.488112:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715102976:0@lo:253:kworker.0 20000000:01000000:0.0:1788201006.496898:0:89116:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788201006.496949:0:89116:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788201006.497156:0:89120:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788201006.497172:0:89120:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788201006.497204:0:89120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc006c6c800/0x96d0c9b8c9a1afe8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.497224:0:89120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006c6c800/0x96d0c9b8c9a1afe8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788201006.497235:0:89120:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000071769s 00010000:00010000:2.0:1788201006.497241:0:89120:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc006c6c800/0x96d0c9b8c9a1afe8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.497248:0:89120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc006c6c800/0x96d0c9b8c9a1afe8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.497257:0:89120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc006c6c800/0x96d0c9b8c9a1afe8 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.497276:0:89120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc006c6c800/0x96d0c9b8c9a1afe8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.497283:0:89120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6c800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201006.497289:0:89120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc006c6c800/0x96d0c9b8c9a1afe8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.497298:0:89120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc006c6c800/0x96d0c9b8c9a1afe8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.497316:0:89120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc006c6c800/0x96d0c9b8c9a1afe8 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.497326:0:89120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc006c6c800/0x96d0c9b8c9a1afe8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.497333:0:89120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006c6c800/0x96d0c9b8c9a1afe8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788201006.497793:0:89119:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788201006.498427:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+7:3657:x1875060715102848:12345-0@lo:253:kworker.0 Request processed in 21526us (34129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201006.498443:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788201006.498511:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788201006.498526:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+6:89111:x1875060715103232:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788201006.498600:0:89116:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788201006.498604:0:89116:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788201006.498607:0:89116:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:0.0:1788201006.498616:0:89116:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000020:01000004:2.0:1788201006.498723:0:3657:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788201006.498727:0:3657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201006.498729:0:3657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201006.498731:0:3657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201006.498732:0:3657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201006.498734:0:3657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201006.498735:0:3657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201006.498738:0:3657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201006.498740:0:3657:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788201006.498744:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715102848:0@lo:253:kworker.0 20000000:01000000:2.0:1788201006.521707:0:89119:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788201006.521734:0:89119:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788201006.521935:0:89120:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788201006.521941:0:89120:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788201006.522110:0:89120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc0079ac600/0x96d0c9b8c9a1afef lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201006.522196:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+6:89111:x1875060715103232:12345-0@lo:253:mount.lustre.0 Request processed in 23669us (50234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201006.522209:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788201006.522492:0:89120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0079ac600/0x96d0c9b8c9a1afef lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788201006.522506:0:89120:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000565910s 00010000:00010000:1.0:1788201006.522512:0:89120:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc0079ac600/0x96d0c9b8c9a1afef lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.522520:0:89120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc0079ac600/0x96d0c9b8c9a1afef lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.522527:0:89120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc0079ac600/0x96d0c9b8c9a1afef lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.522535:0:89120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc0079ac600/0x96d0c9b8c9a1afef lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.522542:0:89120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0079ac600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201006.522565:0:89120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc0079ac600/0x96d0c9b8c9a1afef lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.522575:0:89120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc0079ac600/0x96d0c9b8c9a1afef lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.522592:0:89120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc0079ac600/0x96d0c9b8c9a1afef lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.522602:0:89120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc0079ac600/0x96d0c9b8c9a1afef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.522608:0:89120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0079ac600/0x96d0c9b8c9a1afef lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201006.522729:0:89111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715103232:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788201006.522768:0:89111:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788201006.522773:0:89111:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201006.522775:0:89111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201006.522776:0:89111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201006.522778:0:89111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201006.522780:0:89111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201006.522781:0:89111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201006.522783:0:89111:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201006.522784:0:89111:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201006.522787:0:89111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201006.522788:0:89111:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788201006.522817:0:89111:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dc1341d8000 from lustre-MDT0000 10000000:01000000:2.0:1788201006.522860:0:89111:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788201006.522864:0:89111:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788201006.522874:0:89111:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dc1341d8000 10000000:01000000:2.0:1788201006.522879:0:89111:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788201006.522885:0:89111:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8dc1341d8000 10000000:01000000:2.0:1788201006.522888:0:89111:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788201006.522892:0:89111:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dc1341d8000 from 1 10000000:01000000:2.0:1788201006.522895:0:89111:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788201006.522945:0:89111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1aff6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.522955:0:89111:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1aff6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.525409:0:89111:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1aff6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201006.525459:0:89111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cb50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715103360:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201006.525552:0:89111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201006.525612:0:89111:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004f939c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201006.525683:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715103360 00000100:00100000:1.0:1788201006.525693:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715103360 00000100:00100000:1.0:1788201006.525754:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201006.525766:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+6:89111:x1875060715103360:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201006.525784:0:89118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201006.525808:0:89118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0079aca00/0x96d0c9b8c9a1affd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1aff6 expref: -99 pid: 89118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.525838:0:89118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0079aca00/0x96d0c9b8c9a1affd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1aff6 expref: 7 pid: 89118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.525849:0:89118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0079aca00/0x96d0c9b8c9a1affd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1aff6 expref: 7 pid: 89118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.525861:0:89118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0079aca00, rc 0) 00000100:00100000:1.0:1788201006.525912:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+7:89111:x1875060715103360:12345-0@lo:101:mount.lustre.0 Request processed in 136us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201006.525938:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788201006.526370:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+6:3655:x1875060715103104:12345-0@lo:253:kworker.0 Request processed in 38624us (62050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201006.526388:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201006.526651:0:89111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cb50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715103360:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201006.526693:0:89111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1aff6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1affd expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.526704:0:89111:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1aff6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1affd expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201006.526727:0:89111:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788201006.526739:0:89111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1aff6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1affd expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.526748:0:89111:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1aff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1affd expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201006.526757:0:89111:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788201006.526762:0:89111:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788201006.526769:0:89111:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8dc1341d8000 10000000:01000000:2.0:1788201006.526772:0:89111:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788201006.526776:0:89111:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788201006.526780:0:89111:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788201006.526807:0:89111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c800/0x96d0c9b8c9a1b004 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.526816:0:89111:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c800/0x96d0c9b8c9a1b004 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.526824:0:89111:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c800/0x96d0c9b8c9a1b004 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201006.526841:0:89111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cb50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715103488:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201006.526885:0:89111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201006.526929:0:89111:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004f939c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201006.526957:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715103488 00000100:00100000:2.0:1788201006.526962:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715103488 00000020:01000004:0.0:1788201006.527463:0:3655:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788201006.527467:0:3655:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788201006.527469:0:3655:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201006.527471:0:3655:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201006.527472:0:3655:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201006.527474:0:3655:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201006.527476:0:3655:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201006.527478:0:3655:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201006.527480:0:3655:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788201006.527484:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715103104:0@lo:253:kworker.0 00000100:00100000:2.0:1788201006.527763:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201006.527774:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+6:89111:x1875060715103488:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201006.527786:0:89116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201006.527805:0:89116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006c6c200/0x96d0c9b8c9a1b00b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b004 expref: -99 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.527833:0:89116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006c6c200/0x96d0c9b8c9a1b00b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b004 expref: 7 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.527844:0:89116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006c6c200/0x96d0c9b8c9a1b00b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b004 expref: 7 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.527853:0:89116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006c6c200, rc 0) 00000100:00100000:2.0:1788201006.531329:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+7:89111:x1875060715103488:12345-0@lo:101:mount.lustre.0 Request processed in 3541us (4428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201006.531347:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201006.531588:0:89111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cb50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715103488:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201006.531622:0:89111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c800/0x96d0c9b8c9a1b004 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b00b expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201006.531637:0:89111:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c800/0x96d0c9b8c9a1b004 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b00b expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201006.531767:0:89111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715103616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201006.531836:0:89111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201006.531896:0:89111:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0050f19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201006.532108:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715103616 00000100:00100000:1.0:1788201006.532117:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715103616 00000100:00100000:1.0:1788201006.532161:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788201006.532181:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+7:89111:x1875060715103616:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201006.532361:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+8:89111:x1875060715103616:12345-0@lo:501:mount.lustre.0 Request processed in 181us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201006.532368:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788201006.533119:0:89111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715103616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201006.533187:0:89111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715103744:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201006.533255:0:89111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201006.533287:0:89111:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0050f19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201006.533445:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715103744 00000100:00100000:2.0:1788201006.533452:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715103744 00000100:00100000:2.0:1788201006.533487:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788201006.533496:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+8:89111:x1875060715103744:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201006.534670:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+8:89111:x1875060715103744:12345-0@lo:503:mount.lustre.0 Request processed in 1161us (1400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201006.534682:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201006.534829:0:89111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715103744:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201006.535484:0:89122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc45f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:89122:1875060715103872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201006.535548:0:89122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201006.535589:0:89122:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0050f13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201006.535630:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715103872 00000100:00100000:1.0:1788201006.535638:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715103872 00000100:00100000:1.0:1788201006.535692:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788201006.535702:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+8:89122:x1875060715103872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201006.536599:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+8:89122:x1875060715103872:12345-0@lo:502:llog_process_th.0 Request processed in 896us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201006.536609:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201006.537120:0:89122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc45f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:89122:1875060715103872:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201006.537160:0:89122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201006.537239:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201006.537242:0:89122:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788201006.537249:0:89122:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788201006.537252:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201006.537272:0:89122:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8dc1401b0000) 00000020:00000080:3.0:1788201006.537303:0:89122:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:3.0:1788201006.537313:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788201006.537425:0:89122:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788201006.537433:0:89122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1b019 00000020:00000080:3.0:1788201006.537772:0:89122:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788201006.537777:0:89122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201006.537781:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201006.537783:0:89122:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788201006.537785:0:89122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201006.537789:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201006.537790:0:89122:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788201006.537793:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201006.537802:0:89122:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8dc1401b19b8) 00000020:00000080:3.0:1788201006.537815:0:89122:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:3.0:1788201006.537820:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788201006.537822:0:89122:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788201006.537825:0:89122:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788201006.537833:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788201006.537890:0:89122:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc1341d8000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788201006.537918:0:89122:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8dc1060e3370) 00000020:00000080:3.0:1788201006.537928:0:89122:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:3.0:1788201006.539808:0:89122:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788201006.539825:0:89122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1b02e 00000020:00000080:3.0:1788201006.540295:0:89122:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788201006.540306:0:89122:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788201006.540313:0:89122:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x96d0c9b8c9a1b035 00080000:01000000:3.0:1788201006.540322:0:89122:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788201006.540327:0:89122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1b03c 00000100:00100000:2.0:1788201006.550116:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201006.550174:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201006.550190:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695361152 00000100:00100000:3.0:1788201006.550209:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695361152 00000100:00100000:2.0:1788201006.550211:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695361024 00000100:00100000:2.0:1788201006.550215:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695361024 00000100:00100000:2.0:1788201006.550257:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1233 00000100:00100000:3.0:1788201006.550266:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1208 00000100:00100000:2.0:1788201006.550269:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695361152:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201006.550272:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695361024:12345-192.168.201.20@tcp:38:kworker.0 00010000:02000000:3.0:1788201006.550295:0:66312:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.20@tcp (not set up) 00000100:00100000:2.0:1788201006.550357:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695361152:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 90us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201006.550366:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1233 00000100:00080000:2.0:1788201006.551402:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201006.557037:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695361024:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 6731us (6839us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201006.557056:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1208 00000100:00100000:1.0:1788201006.557202:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201006.557277:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695361280 00000100:00100000:3.0:1788201006.557288:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695361280 00000100:00100000:3.0:1788201006.557335:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:3.0:1788201006.557344:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2399:x1875060695361280:12345-192.168.201.20@tcp:250:kworker.0 00010000:00080000:3.0:1788201006.557377:0:89119:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 0fa559bc-2180-4019-80c4-11831fedf9a9@192.168.201.20@tcp t0 exp 0000000000000000 cur 3858 last 0 00000020:00000080:3.0:1788201006.557412:0:89119:0:(genops.c:1385:class_connect()) connect: client 0fa559bc-2180-4019-80c4-11831fedf9a9, cookie 0x96d0c9b8c9a1b043 00000100:00080000:3.0:1788201006.557582:0:89119:0:(import.c:65:import_set_state_nolock()) ffff8dc110731800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201006.557640:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+5:2399:x1875060695361280:12345-192.168.201.20@tcp:250:kworker.0 Request processed in 295us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201006.557648:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 10 00010000:00010000:3.0:1788201006.678482:0:89122:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1788201006.678675:0:89122:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 4292087e-fa00-4621-b681-837afc99ae35 idx: 0 lr: 103079215113 srv lr: 107374182400 lx: 0 gen 23 00000001:00080000:3.0:1788201006.678741:0:89122:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 107374182400 lx: 0 gen 22 00000001:00000004:3.0:1788201006.678774:0:89122:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 107374182400 00000001:00080000:3.0:1788201006.678921:0:89122:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1788201006.679001:0:89122:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc12f982180: xid 1875060695353728, transno 107374182405, client gen 23, slot idx 0 00000001:00080000:3.0:1788201006.679012:0:89122:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc12f982000: xid 1875060695353984, transno 107374182406, client gen 23, slot idx 1 00000020:00000080:3.0:1788201006.680176:0:89122:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8dc12f0c19b8) 00000020:00000080:3.0:1788201006.680211:0:89122:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:3.0:1788201006.680306:0:89122:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788201006.680315:0:89122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1b05f 00000020:00000080:2.0:1788201006.683986:0:89122:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788201006.696573:0:89122:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x96d0c9b8c9a1b066 00000020:00000080:3.0:1788201006.699519:0:89122:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788201006.699541:0:89122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201006.699551:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201006.699554:0:89122:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788201006.699558:0:89122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788201006.699561:0:89122:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788201006.699563:0:89122:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201006.699564:0:89122:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201006.699566:0:89122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788201006.699569:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201006.699570:0:89122:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788201006.699573:0:89122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201006.699578:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201006.699579:0:89122:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788201006.699585:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788201006.699656:0:89122:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788201006.699673:0:89122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201006.699677:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201006.699678:0:89122:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788201006.699681:0:89122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201006.699683:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201006.699685:0:89122:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788201006.699688:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788201006.699694:0:89122:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:00000080:3.0:1788201006.699725:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201006.699745:0:89122:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8dc12f0c0000) 00000020:00000080:3.0:1788201006.699772:0:89122:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1788201006.699777:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788201006.699850:0:89122:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788201006.699857:0:89122:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788201006.699884:0:89122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1b074 00010000:00080000:3.0:1788201006.699936:0:89122:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc001db7800@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:3.0:1788201006.701845:0:89122:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1788201006.711937:0:89122:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201006.711958:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788201006.712135:0:89122:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788201006.712178:0:89122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1b07b 00000100:00080000:3.0:1788201006.712193:0:89122:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201006.712200:0:89122:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8dc001db7800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201006.712250:0:89122:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11cc45f80 x1875060715104000/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201006.712294:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715104000:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201006.712386:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788201006.713733:0:89122:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788201006.713793:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201006.713800:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201006.713805:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201006.713814:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3857 00000100:00080000:0.0:1788201006.713820:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201006.713829:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201006.713891:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13a440000 x1875060715104128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201006.713939:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201006.713943:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201006.713945:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201006.713949:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3857 00000100:00080000:0.0:1788201006.713951:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201006.713955:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201006.713965:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13a442a00 x1875060715104384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201006.713979:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201006.713983:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201006.713984:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201006.713988:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3857 00000100:00080000:0.0:1788201006.713990:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201006.713993:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201006.714005:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13a440a80 x1875060715104640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201006.714058:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201006.714061:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201006.714063:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201006.714066:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3857 00000100:00080000:0.0:1788201006.714069:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201006.714072:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201006.714089:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d57480 x1875060715105024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201006.714129:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715104512:0@lo:400:kworker.0 00000100:00100000:0.0:1788201006.714194:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788201006.714777:0:89122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201006.714787:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201006.714789:0:89122:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788201006.714792:0:89122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788201006.714796:0:89122:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1788201006.714798:0:89122:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201006.714799:0:89122:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201006.714801:0:89122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788201006.714803:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201006.714804:0:89122:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788201006.714806:0:89122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788201006.714812:0:89122:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788201006.714815:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201006.714824:0:89122:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788201006.714828:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788201006.714832:0:89122:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:1.0:1788201006.714861:0:89122:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788201006.714863:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201006.714883:0:89122:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8dc139bb8000) 00000020:00000080:1.0:1788201006.714923:0:89122:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1788201006.714930:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788201006.715058:0:89122:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788201006.715067:0:89122:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788201006.715075:0:89122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1b089 00010000:00080000:1.0:1788201006.715116:0:89122:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc12e640000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:1.0:1788201006.715390:0:89122:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:1.0:1788201006.715736:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715104768:0@lo:400:kworker.0 00000100:00100000:1.0:1788201006.715809:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201006.715870:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201006.715876:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715104896:0@lo:400:kworker.0 00000100:00100000:1.0:1788201006.715908:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201006.715966:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715104256:0@lo:400:kworker.0 00000100:00100000:2.0:1788201006.720099:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715104768 00000100:00100000:2.0:1788201006.720122:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715104768 00000100:00100000:2.0:1788201006.720195:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715104896 00000100:00100000:2.0:1788201006.720197:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715104896 00000100:00100000:2.0:1788201006.720223:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2688 00000100:00100000:2.0:1788201006.720233:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715104768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201006.720339:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2689 00000100:00100000:1.0:1788201006.720351:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715104896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201006.720362:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715104768:12345-0@lo:400:kworker.0 Request processed in 129us (4550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201006.720371:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2688 00000100:00100000:1.0:1788201006.720399:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715104896:12345-0@lo:400:kworker.0 Request processed in 50us (4489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201006.720406:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2689 00000100:00100000:2.0:1788201006.720454:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715104896:0@lo:400:kworker.0 00000100:00100000:2.0:1788201006.720469:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715104768:0@lo:400:kworker.0 00000040:01000000:1.0:1788201006.720518:0:89122:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788201006.720556:0:89122:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788201006.720652:0:89122:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000100:00100000:1.0:1788201006.721038:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715104000 00000100:00100000:1.0:1788201006.721052:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715104000 00000100:00100000:1.0:1788201006.721088:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3890 00000100:00100000:3.0:1788201006.721092:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715104128:0@lo:38:kworker.0 00000100:00100000:1.0:1788201006.721097:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715104000:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788201006.721128:0:23728:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3858 last 0 00000020:00000080:1.0:1788201006.721170:0:23728:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1b090 00000004:00100000:1.0:1788201006.721188:0:23728:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1788201006.721249:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201006.721975:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201006.721999:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715104384:0@lo:38:kworker.0 00000100:00100000:3.0:1788201006.722054:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201006.722073:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715104640:0@lo:38:kworker.0 00000100:00100000:3.0:1788201006.722099:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201006.722114:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715105024:0@lo:38:kworker.0 00000100:00100000:3.0:1788201006.722133:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201006.722172:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715104512 00000100:00100000:3.0:1788201006.722177:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715104512 00000100:00100000:3.0:1788201006.722212:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715104256 00000100:00100000:3.0:1788201006.722214:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715104256 00000100:00100000:3.0:1788201006.722223:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715104128 00000100:00100000:3.0:1788201006.722225:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715104128 00000100:00100000:3.0:1788201006.722242:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715104384 00000100:00100000:3.0:1788201006.722244:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715104384 00000100:00100000:3.0:1788201006.722251:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715105024 00000100:00100000:3.0:1788201006.722253:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715105024 00000100:00100000:3.0:1788201006.722264:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1234 00000100:00100000:3.0:1788201006.722271:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715104512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201006.722319:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715104512:12345-0@lo:400:kworker.0 Request processed in 49us (8125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201006.722326:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1234 00000100:00100000:3.0:1788201006.722345:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00100000:3.0:1788201006.722351:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715104256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201006.722389:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715104256:12345-0@lo:400:kworker.0 Request processed in 37us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201006.722395:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 00000100:00100000:3.0:1788201006.722407:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:3.0:1788201006.722411:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715104128:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788201006.722449:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715104128:12345-0@lo:38:kworker.0 Request processed in 37us (476us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788201006.722455:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00100000:3.0:1788201006.722466:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:3.0:1788201006.722470:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715104384:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788201006.722497:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715104384:12345-0@lo:38:kworker.0 Request processed in 25us (442us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788201006.722502:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00100000:3.0:1788201006.722512:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:3.0:1788201006.722517:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715105024:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788201006.722546:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715105024:12345-0@lo:38:kworker.0 Request processed in 27us (411us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788201006.722559:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00080000:3.0:1788201006.722599:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201006.722604:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788201006.722608:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715104128:0@lo:38:kworker.0 00000100:00080000:3.0:1788201006.722617:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201006.722620:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788201006.722623:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715104384:0@lo:38:kworker.0 00000100:00080000:3.0:1788201006.722631:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201006.722634:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788201006.722636:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715105024:0@lo:38:kworker.0 00000100:00100000:0.0:1788201006.722769:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715104256:0@lo:400:kworker.0 00000100:00100000:0.0:1788201006.722814:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715104512:0@lo:400:kworker.0 00000100:00100000:2.0:1788201006.722987:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715104640 00000100:00100000:2.0:1788201006.722993:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715104640 00000100:00100000:2.0:1788201006.723031:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3891 00000100:00100000:2.0:1788201006.723037:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715104640:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788201006.723081:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715104640:12345-0@lo:38:kworker.0 Request processed in 43us (980us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788201006.723095:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3891 00000100:00080000:1.0:1788201006.725381:0:23728:0:(import.c:65:import_set_state_nolock()) ffff8dc13f839000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201006.725496:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715104000:12345-0@lo:38:llog_process_th.0 Request processed in 4396us (13105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201006.725510:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3890 00000100:00080000:3.0:1788201006.726085:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201006.726093:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788201006.726098:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715104640:0@lo:38:kworker.0 00000100:00100000:3.0:1788201006.726114:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201006.726123:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:3.0:1788201006.726133:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788201006.726140:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788201006.726143:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db7800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788201006.726154:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715104000:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788201006.726387:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715105152:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201006.726459:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201006.726600:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715105152 00000100:00100000:3.0:1788201006.726616:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715105152 00000100:00100000:3.0:1788201006.726680:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3892 00000100:00100000:3.0:1788201006.726691:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715105152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788201006.726738:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:3.0:1788201006.726799:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715105152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201006.726807:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3892 00000100:00100000:1.0:1788201006.727989:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715105152:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788201006.731564:0:89122:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201006.731610:0:89122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].26, 64 off9856 00000040:00080000:0.0:1788201006.737564:0:89122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x68:0x0].1, 64 off8256 00000040:00080000:0.0:1788201006.738199:0:89128:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:0.0:1788201006.738206:0:89128:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1788201006.738526:0:89128:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 25, last_idx 26 00000040:00080000:0.0:1788201006.738550:0:89128:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1788201006.738712:0:89128:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:0.0:1788201006.738716:0:89128:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788201006.739942:0:89122:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201006.739961:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788201006.740052:0:89122:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788201006.740086:0:89122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1b097 00000100:00080000:2.0:1788201006.740098:0:89122:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201006.740104:0:89122:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dc12e640000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201006.740145:0:89122:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc007158e00 x1875060715105280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201006.740167:0:89122:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788201006.740233:0:89122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201006.740238:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201006.740240:0:89122:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788201006.740244:0:89122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788201006.740247:0:89122:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788201006.740249:0:89122:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201006.740251:0:89122:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201006.740252:0:89122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788201006.740255:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201006.740256:0:89122:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788201006.740258:0:89122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788201006.740262:0:89122:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788201006.740264:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201006.740266:0:89122:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788201006.740267:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788201006.740271:0:89122:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:2.0:1788201006.740297:0:89122:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788201006.740298:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201006.740309:0:89122:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8dc13f874d28) 00000020:00000080:2.0:1788201006.740323:0:89122:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1788201006.740339:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788201006.740414:0:89122:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788201006.740420:0:89122:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788201006.740426:0:89122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1b0a5 00010000:00080000:2.0:1788201006.740461:0:89122:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc001e28800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:2.0:1788201006.740615:0:89122:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1788201006.740684:0:89122:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788201006.740698:0:89122:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1788201006.740957:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715105280:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788201006.741076:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201006.741112:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715105280 00000100:00100000:0.0:1788201006.741122:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715105280 00000100:00100000:0.0:1788201006.741163:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5876 00000100:00100000:0.0:1788201006.741173:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3654:x1875060715105280:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1788201006.741206:0:26201:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3858 last 0 00000040:00080000:2.0:1788201006.741400:0:89122:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000040:00080000:2.0:1788201006.744046:0:89122:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201006.744088:0:89122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].26, 64 off9856 00000040:00080000:2.0:1788201006.744392:0:89122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6a:0x0].1, 64 off8256 00000040:00080000:3.0:1788201006.746441:0:89130:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:3.0:1788201006.746451:0:89130:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1788201006.746687:0:89130:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 25, last_idx 26 00000020:00000080:0.0:1788201006.746711:0:26201:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1b0ac 00000040:00080000:3.0:1788201006.746715:0:89130:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00002000:00100000:0.0:1788201006.746749:0:26201:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8dc1090d7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788201006.746755:0:26201:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788201006.746758:0:26201:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788201006.746831:0:26201:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000040:00080000:3.0:1788201006.746880:0:89130:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000100:00080000:0.0:1788201006.746881:0:26201:0:(import.c:65:import_set_state_nolock()) ffff8dc1090d6000 : changing import state from RECOVER to FULL 00000040:00080000:3.0:1788201006.746883:0:89130:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1788201006.747053:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715105280:12345-0@lo:8:llog_process_th.0 Request processed in 5877us (5975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201006.747066:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5876 00000020:00000080:0.0:1788201006.747633:0:89122:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201006.747649:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788201006.747710:0:89122:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788201006.747917:0:89122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1b0b3 00000100:00080000:0.0:1788201006.747927:0:89122:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788201006.747934:0:89122:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dc001e28800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201006.747975:0:89122:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d55180 x1875060715105408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201006.747995:0:89122:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788201006.748137:0:89122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201006.748142:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201006.748144:0:89122:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788201006.748147:0:89122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201006.748151:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201006.748152:0:89122:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788201006.748155:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788201006.748157:0:89122:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788201006.748160:0:89122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201006.748163:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201006.748164:0:89122:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788201006.748166:0:89122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201006.748169:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201006.748170:0:89122:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788201006.748173:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788201006.748211:0:89122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:89122:1875060715105536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201006.748292:0:89122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201006.748349:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715105536 00000100:00100000:2.0:1788201006.748358:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715105536 00000100:00100000:2.0:1788201006.748410:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201006.748420:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+8:89122:x1875060715105536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201006.748459:0:89122:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc108cfccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201006.748565:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+8:89122:x1875060715105536:12345-0@lo:502:llog_process_th.0 Request processed in 146us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201006.748573:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788201006.748628:0:89122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:89122:1875060715105536:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201006.748657:0:89122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201006.748662:0:89122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201006.748663:0:89122:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788201006.748668:0:89122:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788201006.748978:0:89111:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1788201006.749201:0:89111:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788201006.749223:0:89111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c800/0x96d0c9b8c9a1b004 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b00b expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.749236:0:89111:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c800/0x96d0c9b8c9a1b004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b00b expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201006.749306:0:89111:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc1341d8000 from 1 10000000:01000000:0.0:1788201006.749310:0:89111:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788201006.749421:0:89111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140759a00/0x96d0c9b8c9a1b0ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201006.749431:0:89111:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc140759a00/0x96d0c9b8c9a1b0ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201006.749443:0:89111:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc140759a00/0x96d0c9b8c9a1b0ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201006.749464:0:89111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715105664:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201006.749546:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715105408:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788201006.750449:0:89111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201006.750504:0:89111:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc108cfccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201006.753595:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715105664 00000100:00100000:2.0:1788201006.753623:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715105664 00000100:00100000:2.0:1788201006.753778:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788201006.753801:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+8:89111:x1875060715105664:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201006.753825:0:89116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201006.753854:0:89116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006c6d000/0x96d0c9b8c9a1b0c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b0ba expref: -99 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.753891:0:89116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006c6d000/0x96d0c9b8c9a1b0c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b0ba expref: 9 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.753936:0:89116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006c6d000/0x96d0c9b8c9a1b0c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b0ba expref: 9 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.753948:0:89116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006c6d000, rc 0) 00000100:00100000:2.0:1788201006.754738:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+9:89111:x1875060715105664:12345-0@lo:101:mount.lustre.0 Request processed in 946us (4287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201006.754750:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788201006.755042:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201006.755113:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201006.755126:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788201006.755136:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788201006.755143:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788201006.755148:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc12e640000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788201006.755164:0:3654:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788201006.755171:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715105280:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788201006.755231:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715105408 00000100:00100000:3.0:1788201006.755237:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715105408 00000100:00100000:3.0:1788201006.755267:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5877 00000100:00100000:3.0:1788201006.755274:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3654:x1875060715105408:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1788201006.755308:0:8491:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3858 last 0 00000020:00000080:3.0:1788201006.755365:0:8491:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1b0c8 00002000:00100000:3.0:1788201006.755384:0:8491:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8dc1201c9800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788201006.755388:0:8491:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788201006.755392:0:8491:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788201006.755497:0:8491:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788201006.755525:0:8491:0:(import.c:65:import_set_state_nolock()) ffff8dc1201c8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201006.755575:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715105408:12345-0@lo:8:llog_process_th.0 Request processed in 300us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201006.755582:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5877 00000100:00100000:3.0:1788201006.755617:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201006.755623:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788201006.755629:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788201006.755633:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788201006.755635:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001e28800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788201006.755649:0:3654:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788201006.755653:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715105408:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1788201006.755677:0:89130:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788201006.755757:0:89130:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3858227740462ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788201006.755765:0:89130:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788201006.756280:0:89111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715105664:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201006.756307:0:89111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc140759a00/0x96d0c9b8c9a1b0ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b0c1 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201006.756319:0:89111:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc140759a00/0x96d0c9b8c9a1b0ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b0c1 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201006.756928:0:89111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715105792:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788201006.756999:0:89111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201006.759683:0:89111:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc108cfccc0 going to sleep for 11 seconds 00000004:00080000:0.0:1788201006.759747:0:89128:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788201006.759864:0:89128:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3858231846846ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788201006.759872:0:89128:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788201006.759975:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715105792 00000100:00100000:1.0:1788201006.759989:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715105792 00000100:00100000:1.0:1788201006.760130:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788201006.760142:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+9:89111:x1875060715105792:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788201006.760197:0:89119:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788201006.760218:0:89119:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788201006.760223:0:89119:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788201006.760226:0:89119:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788201006.760229:0:89119:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 114 00000100:00100000:1.0:1788201006.760458:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+9:89111:x1875060715105792:12345-0@lo:256:mount.lustre.0 Request processed in 317us (3458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201006.760468:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788201006.760579:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201006.760597:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715105920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201006.760645:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201006.760685:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715105920 00000100:00100000:1.0:1788201006.760690:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715105920 00000100:00080000:2.0:1788201006.760838:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201006.760912:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201006.760925:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715106048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201006.760966:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201006.761123:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715106048 00000100:00100000:1.0:1788201006.761127:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715106048 00000100:00100000:1.0:1788201006.761151:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2180 00000100:00100000:1.0:1788201006.761157:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715105920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201006.761186:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201006.761227:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715105920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201006.761234:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2180 00000100:00100000:1.0:1788201006.761248:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2181 00000100:00100000:1.0:1788201006.761253:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715106048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201006.761270:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201006.761295:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715106048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201006.761301:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2181 00000100:00080000:2.0:1788201006.761419:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788201006.761600:0:89112:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788201006.762362:0:89111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715105792:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788201006.764160:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715106048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201006.764449:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715105920:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1788201006.765175:0:89111:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788201006.765205:0:89111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140759a00/0x96d0c9b8c9a1b0ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b0c1 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201006.765836:0:89111:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc140759a00/0x96d0c9b8c9a1b0ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b0c1 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201006.765849:0:89111:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc1341d8000 from 1 10000000:01000000:0.0:1788201006.765853:0:89111:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201006.765926:0:89111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a1b0cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201006.765937:0:89111:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a1b0cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201006.765949:0:89111:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a1b0cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201006.765982:0:89111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715106176:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201006.766168:0:89111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201006.766238:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715106176 00000100:00100000:1.0:1788201006.766248:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715106176 00000100:00100000:1.0:1788201006.766468:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788201006.766480:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+9:89111:x1875060715106176:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201006.766496:0:89119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201006.766515:0:89119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0079adc00/0x96d0c9b8c9a1b0d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b0cf expref: -99 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.766544:0:89119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0079adc00/0x96d0c9b8c9a1b0d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b0cf expref: 10 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.766556:0:89119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0079adc00/0x96d0c9b8c9a1b0d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b0cf expref: 10 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.766566:0:89119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0079adc00, rc 0) 00000100:00100000:1.0:1788201006.766607:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:89111:x1875060715106176:12345-0@lo:101:mount.lustre.0 Request processed in 130us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201006.766614:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201006.767145:0:89111:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc108cfccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201006.767177:0:89111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715106176:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201006.767197:0:89111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a1b0cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b0d6 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201006.767360:0:89111:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a1b0cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b0d6 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201006.767454:0:89111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715106304:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201006.767498:0:89111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201006.767530:0:89111:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc108cfccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201006.768782:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715106304 00000100:00100000:3.0:1788201006.768798:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715106304 00000100:00100000:3.0:1788201006.768876:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788201006.768888:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:89111:x1875060715106304:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201006.769158:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:89111:x1875060715106304:12345-0@lo:501:mount.lustre.0 Request processed in 271us (1658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201006.769166:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201006.769763:0:89111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715106304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201006.769834:0:89111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715106432:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201006.769907:0:89111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201006.769949:0:89111:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f4e780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201006.770142:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715106432 00000100:00100000:3.0:1788201006.770149:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715106432 00000100:00100000:3.0:1788201006.770195:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788201006.770204:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:89111:x1875060715106432:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201006.770697:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:89111:x1875060715106432:12345-0@lo:503:mount.lustre.0 Request processed in 493us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201006.770706:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201006.770844:0:89111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc2aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715106432:0@lo:503:mount.lustre.0 00000004:00080000:2.0:1788201006.774357:0:89112:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788201006.781680:0:89132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:89132:1875060715106560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201006.781813:0:89132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201006.781927:0:89132:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105f1d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201006.784220:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715106560 00000100:00100000:0.0:1788201006.784239:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715106560 00000100:00100000:1.0:1788201006.785070:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788201006.785085:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+10:89132:x1875060715106560:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201006.788596:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+10:89132:x1875060715106560:12345-0@lo:502:llog_process_th.0 Request processed in 3501us (6769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201006.788615:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201006.788995:0:89132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:89132:1875060715106560:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201006.789197:0:89132:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201006.789279:0:89132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201006.789283:0:89132:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788201006.789295:0:89132:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc1341d8000 00000020:00000080:2.0:1788201006.789298:0:89132:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788201006.789310:0:89132:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201006.789313:0:89132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201006.789314:0:89132:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788201006.789316:0:89132:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201006.789333:0:89132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201006.789334:0:89132:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788201006.789339:0:89132:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc1341d8000 00000020:00000080:2.0:1788201006.789341:0:89132:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788201006.789487:0:89132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:89132:1875060715106688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201006.789560:0:89132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201006.789652:0:89132:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105f1d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201006.792149:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715106688 00000100:00100000:3.0:1788201006.792169:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715106688 00000100:00100000:3.0:1788201006.792332:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788201006.792346:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:89132:x1875060715106688:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201006.792682:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:89132:x1875060715106688:12345-0@lo:502:llog_process_th.0 Request processed in 339us (3121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201006.792692:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788201006.792792:0:89132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:89132:1875060715106688:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201006.792842:0:89132:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201006.792851:0:89132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201006.792855:0:89132:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788201006.792862:0:89132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788201006.793143:0:89111:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1788201006.793177:0:89111:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201006.793202:0:89111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a1b0cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b0d6 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201006.793225:0:89111:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a1b0cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b0d6 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201006.793299:0:89111:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788201006.793303:0:89111:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dc1341d8000 10000000:01000000:3.0:1788201006.793306:0:89111:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dc1341d8000 10000000:01000000:3.0:1788201006.793311:0:89111:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201006.793318:0:89111:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc1341d8000 from 1 10000000:01000000:3.0:1788201006.793321:0:89111:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201006.793373:0:89111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1b0dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201006.793390:0:89111:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1b0dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201006.793401:0:89111:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1b0dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201006.793428:0:89111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715106816:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201006.793483:0:89111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201006.793526:0:89111:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc139bfec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201006.793559:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715106816 00000100:00100000:0.0:1788201006.793566:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715106816 00000100:00100000:0.0:1788201006.793607:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788201006.793616:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+10:89111:x1875060715106816:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201006.793627:0:89116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201006.793645:0:89116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140759600/0x96d0c9b8c9a1b0e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b0dd expref: -99 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201006.793673:0:89116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140759600/0x96d0c9b8c9a1b0e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b0dd expref: 11 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201006.793686:0:89116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140759600/0x96d0c9b8c9a1b0e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b0dd expref: 11 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201006.793697:0:89116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140759600, rc 0) 00000100:00100000:0.0:1788201006.793744:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:89111:x1875060715106816:12345-0@lo:101:mount.lustre.0 Request processed in 129us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201006.793750:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788201006.796409:0:89111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715106816:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201006.796445:0:89111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1b0dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b0e4 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201006.796459:0:89111:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1b0dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b0e4 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201006.796569:0:89111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715106944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201006.796637:0:89111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201006.796692:0:89111:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc139bfec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201006.797054:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715106944 00000100:00100000:1.0:1788201006.797063:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715106944 00000100:00100000:1.0:1788201006.797114:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788201006.797125:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:89111:x1875060715106944:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201006.797293:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:89111:x1875060715106944:12345-0@lo:501:mount.lustre.0 Request processed in 168us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201006.797300:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201006.797458:0:89111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715106944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201006.797493:0:89111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715107072:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201006.797549:0:89111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201006.797576:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715107072 00000100:00100000:3.0:1788201006.797576:0:89111:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc139bfec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201006.797590:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715107072 00000100:00100000:0.0:1788201006.797634:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788201006.797643:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0037a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:89111:x1875060715107072:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201006.797754:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0037a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:89111:x1875060715107072:12345-0@lo:503:mount.lustre.0 Request processed in 112us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201006.797761:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788201006.797935:0:89111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715107072:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201006.798891:0:89134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc2aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:89134:1875060715107200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201006.798972:0:89134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201006.799097:0:89134:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f4e840 going to sleep for 11 seconds 00000100:00100000:3.0:1788201006.799168:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715107200 00000100:00100000:3.0:1788201006.799183:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715107200 00000100:00100000:3.0:1788201006.799238:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201006.799247:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0037aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:89134:x1875060715107200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201006.799368:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0037aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:89134:x1875060715107200:12345-0@lo:502:llog_process_th.0 Request processed in 123us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201006.799376:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788201006.799530:0:89134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc2aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:89134:1875060715107200:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788201006.799608:0:89134:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788201006.799630:0:89134:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8dc139bb99b8) 00000020:00000080:1.0:1788201006.799662:0:89134:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788201006.799800:0:89134:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc1341d8000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788201006.799805:0:89134:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc1341d8000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788201006.799808:0:89134:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc1341d8000 4 00010000:00080000:1.0:1788201006.799848:0:89134:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc103484800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:1.0:1788201006.812009:0:89134:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1788201006.812308:0:89134:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788201006.812373:0:89134:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788201006.812392:0:89134:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x96d0c9b8c9a1b0f2 00000100:00080000:1.0:1788201006.812406:0:89134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201006.812414:0:89134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dc103484800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201006.812463:0:89134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11cc2aa00 x1875060715107328/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201006.821600:0:89134:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788201006.821936:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715107328:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201006.822379:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201006.823200:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715107328 00000100:00100000:1.0:1788201006.823224:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715107328 00000100:00100000:1.0:1788201006.823285:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1212 00000100:00100000:1.0:1788201006.823295:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715107328:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788201006.823400:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715107328:12345-0@lo:38:llog_process_th.0 Request processed in 104us (1022us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788201006.823408:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1212 00000100:00100000:2.0:1788201006.825138:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788201006.825157:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc103484800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201006.825165:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788201006.825170:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715107328:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788201006.827474:0:89134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:89134:1875060715107456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201006.827590:0:89134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201006.827653:0:89134:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102a8af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201006.827713:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715107456 00000100:00100000:1.0:1788201006.827722:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715107456 00000100:00100000:1.0:1788201006.827788:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788201006.827800:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0037ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:89134:x1875060715107456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201006.827984:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0037ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:89134:x1875060715107456:12345-0@lo:502:llog_process_th.0 Request processed in 185us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201006.827993:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788201006.828096:0:89134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:89134:1875060715107456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201006.828147:0:89134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc2b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:89134:1875060715107584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201006.828183:0:89134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201006.828284:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715107584 00000100:00100000:1.0:1788201006.828289:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715107584 00000100:00100000:1.0:1788201006.828317:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788201006.828326:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc008b20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:89134:x1875060715107584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201006.828390:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc008b20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:89134:x1875060715107584:12345-0@lo:502:llog_process_th.0 Request processed in 64us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201006.828397:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788201006.828432:0:89134:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f4ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201006.828444:0:89134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc2b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:89134:1875060715107584:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788201006.828463:0:89134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788201006.829065:0:89111:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788201006.829100:0:89111:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201006.829122:0:89111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1b0dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b0e4 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201006.829135:0:89111:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1b0dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b0e4 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788201006.829202:0:89111:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788201006.829205:0:89111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201006.829207:0:89111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201006.830313:0:89111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201006.830319:0:89111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201006.830323:0:89111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201006.830324:0:89111:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201006.830326:0:89111:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201006.830328:0:89111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201006.830330:0:89111:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788201006.830336:0:89111:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788201006.830340:0:89111:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788201006.830341:0:89111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201006.830342:0:89111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201006.830344:0:89111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201006.830345:0:89111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201006.830359:0:89111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201006.830360:0:89111:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201006.830361:0:89111:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201006.830361:0:89111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201006.830362:0:89111:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788201006.830397:0:89111:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788201006.830422:0:89111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715107712:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788201006.830516:0:89111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201006.830558:0:89111:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc139bfe000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201006.830610:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715107712 00000100:00100000:3.0:1788201006.830620:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715107712 00000100:00100000:3.0:1788201006.830679:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788201006.830689:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:89111:x1875060715107712:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788201006.830724:0:89118:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788201006.830745:0:89118:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788201006.855301:0:89118:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788201006.855322:0:89118:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788201006.856871:0:89120:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788201006.856883:0:89120:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788201006.856922:0:89120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc0079ad400/0x96d0c9b8c9a1b0f9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.856946:0:89120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc006c6d000/0x96d0c9b8c9a1b0c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b0ba expref: 11 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.856956:0:89120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dc0079ad400/0x96d0c9b8c9a1b0f9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.857006:0:89120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc006c6d000/0x96d0c9b8c9a1b0c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1b0ba expref: 11 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.857090:0:89120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc006c6d000/0x96d0c9b8c9a1b0c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1b0ba expref: 11 pid: 89116 timeout: 3958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201006.857109:0:89120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc2b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:89120:1875060715107840:0@lo:104: 00000100:00100000:1.0:1788201006.857160:0:89120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201006.858348:0:89120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc00729ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201006.858399:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715107840 00000100:00100000:1.0:1788201006.858411:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715107840 00000100:00100000:1.0:1788201006.858483:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788201006.858493:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9b18af6-fecc-4172-82c2-66531890fe11+3:89120:x1875060715107840:12345-0@lo:104: 00010000:00010000:1.0:1788201006.858511:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc140759a00/0x96d0c9b8c9a1b0ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1b0c1 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.858591:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201006.858598:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9b18af6-fecc-4172-82c2-66531890fe11+3:89120:x1875060715107840:12345-0@lo:104: Request processed in 106us (1439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201006.858606:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788201006.858658:0:89120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc2b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:89120:1875060715107840:0@lo:104: 00010000:00010000:1.0:1788201006.858684:0:89120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dc0079ad400/0x96d0c9b8c9a1b0f9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.858704:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201006.858711:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc140759a00/0x96d0c9b8c9a1b0ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1b0c1 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.858718:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140759a00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201006.858722:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc140759a00/0x96d0c9b8c9a1b0ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1b0c1 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.858730:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc140759a00/0x96d0c9b8c9a1b0ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1b0c1 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201006.858738:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc140759a00/0x96d0c9b8c9a1b0ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1b0c1 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201006.858762:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201006.858805:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc140759a00/0x96d0c9b8c9a1b0ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1b0c1 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.858811:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201006.858835:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc140759a00/0x96d0c9b8c9a1b0ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1b0c1 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.858841:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc140759a00/0x96d0c9b8c9a1b0ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1b0c1 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.858860:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201006.858861:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201006.858864:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201006.858883:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715107968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201006.858935:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201006.858980:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715107968 00000100:00100000:1.0:1788201006.858984:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715107968 00010000:00010000:1.0:1788201006.859002:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc006c6d000/0x96d0c9b8c9a1b0c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1b0ba expref: 12 pid: 89116 timeout: 3958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201006.859052:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2553 00000100:00100000:1.0:1788201006.859060:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+12:3656:x1875060715107968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201006.859072:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201006.859078:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc006c6d000/0x96d0c9b8c9a1b0c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1b0ba expref: 12 pid: 89116 timeout: 3958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.859091:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc006c6d000/0x96d0c9b8c9a1b0c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1b0ba expref: 12 pid: 89116 timeout: 3958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.859114:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006c6d000/0x96d0c9b8c9a1b0c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1b0ba expref: 12 pid: 89116 timeout: 3958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.859132:0:26215:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dc0079ad400/0x96d0c9b8c9a1b0f9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.859142:0:26215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0079ad400/0x96d0c9b8c9a1b0f9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788201006.859158:0:26215:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002276656s 00010000:00010000:1.0:1788201006.859163:0:26215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc0079ad400/0x96d0c9b8c9a1b0f9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.859171:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc0079ad400/0x96d0c9b8c9a1b0f9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.859178:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc0079ad400/0x96d0c9b8c9a1b0f9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.859185:0:26215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc0079ad400/0x96d0c9b8c9a1b0f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.859190:0:26215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0079ad400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201006.859195:0:26215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc0079ad400/0x96d0c9b8c9a1b0f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.859203:0:26215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc0079ad400/0x96d0c9b8c9a1b0f9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201006.859465:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:89111:x1875060715107712:12345-0@lo:253:mount.lustre.0 Request processed in 28774us (28946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201006.859478:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788201006.859518:0:89111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:89111:1875060715107712:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788201006.859534:0:89111:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788201006.859539:0:89111:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201006.859541:0:89111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201006.859543:0:89111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201006.859545:0:89111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201006.859547:0:89111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201006.859549:0:89111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201006.859551:0:89111:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201006.859553:0:89111:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201006.859555:0:89111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201006.859557:0:89111:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788201006.859573:0:89111:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788201006.865270:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201006.880117:0:89120:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dc0079ad400/0x96d0c9b8c9a1b0f9 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201006.880144:0:89120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc0079ad400/0x96d0c9b8c9a1b0f9 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.881573:0:26215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc0079ad400/0x96d0c9b8c9a1b0f9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.881607:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0079ad400/0x96d0c9b8c9a1b0f9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201006.881639:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201006.882439:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+10:3656:x1875060715107968:12345-0@lo:103:ldlm_bl.0 Request processed in 23372us (23496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201006.882454:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2553 00000100:00100000:2.0:1788201006.884190:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715107968:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788201006.887626:0:89111:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411350 00000040:01000000:2.0:1788201006.888670:0:89111:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788201006.888734:0:89140:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411350 00000020:00080000:1.0:1788201006.888740:0:89140:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411350 00000040:01000000:1.0:1788201006.889431:0:89141:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788201006.889467:0:89111:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1788201006.890645:0:89141:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201006.897592:0:89142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0e300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89142:1875060715108096:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788201006.897812:0:89142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201006.897863:0:89142:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f4e780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201006.897943:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715108096 00000100:00100000:3.0:1788201006.897954:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715108096 00000100:00100000:3.0:1788201006.898057:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3893 00000100:00100000:3.0:1788201006.898070:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89142:x1875060715108096:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788201006.898339:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89142:x1875060715108096:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 270us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201006.898348:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3893 00000040:00080000:0.0:1788201006.898388:0:89141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788201006.898484:0:89141:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1788201006.900831:0:89142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0e300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89142:1875060715108096:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788201006.902907:0:89111:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788201006.904426:0:89111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788201006.905123:0:89142:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788201006.905199:0:89142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89142:1875060715108224:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788201006.905321:0:89142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201006.905377:0:89142:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005c6c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201006.905400:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715108224 00000100:00100000:0.0:1788201006.905411:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715108224 00000100:00100000:0.0:1788201006.905488:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3894 00000100:00100000:0.0:1788201006.905499:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89142:x1875060715108224:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788201006.905662:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89142:x1875060715108224:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 164us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201006.905672:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3894 00000100:00100000:0.0:1788201006.905722:0:89142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89142:1875060715108224:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788201006.905809:0:89142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d57100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89142:1875060715108352:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788201006.905836:0:89142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201006.905863:0:89142:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1090620c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201006.905904:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715108352 00000100:00100000:1.0:1788201006.905910:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715108352 00000100:00100000:1.0:1788201006.906039:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3895 00000100:00100000:1.0:1788201006.906048:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89142:x1875060715108352:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788201006.906122:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:89142:x1875060715108352:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 75us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201006.906130:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3895 00000100:00100000:0.0:1788201006.906181:0:89142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d57100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:89142:1875060715108352:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788201006.906247:0:89142:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788201006.907110:0:89111:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788201006.907128:0:89111:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788201006.907556:0:89111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201006.909973:0:89142:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000040:00080000:3.0:1788201006.912407:0:89111:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000004:00080000:0.0:1788201006.912971:0:89142:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788201006.912978:0:89142:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1788201006.913052:0:89111:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788201006.913351:0:89111:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788201006.913516:0:89111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788201006.914462:0:89111:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4d:0x0] (8/32) registered 00010000:00080000:2.0:1788201006.918476:0:89111:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 107374182406 00010000:00080000:3.0:1788201006.931857:0:89143:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 89143 00010000:02000000:3.0:1788201006.931885:0:89143:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1788201006.931890:0:89143:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788201006.931920:0:89143:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:0.0:1788201006.932066:0:89111:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788201006.932093:0:89111:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788201006.932121:0:89111:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788201006.932161:0:89111:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788201006.934887:0:89111:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788201006.935385:0:89111:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1788201007.695099:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788201007.695112:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc1341d8000 from 115 10000000:01000000:1.0:1788201007.695121:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788201007.695192:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad400/0x96d0c9b8c9a1b100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201007.695225:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad400/0x96d0c9b8c9a1b100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201007.695241:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad400/0x96d0c9b8c9a1b100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201007.695280:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715108480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201007.695397:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201007.695455:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1060ca000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201007.695724:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715108480 00000100:00100000:3.0:1788201007.695735:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715108480 00000100:00100000:3.0:1788201007.695810:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788201007.695823:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+10:6529:x1875060715108480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201007.695841:0:89116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201007.695862:0:89116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064ece00/0x96d0c9b8c9a1b107 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b100 expref: -99 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.695904:0:89116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ece00/0x96d0c9b8c9a1b107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b100 expref: 11 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.695919:0:89116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064ece00/0x96d0c9b8c9a1b107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b100 expref: 11 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.695932:0:89116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ece00, rc 0) 00000100:00100000:3.0:1788201007.695997:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715108480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201007.696005:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788201007.696246:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715108480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201007.696266:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad400/0x96d0c9b8c9a1b100 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b107 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201007.696278:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad400/0x96d0c9b8c9a1b100 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b107 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201007.696344:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715108608:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788201007.696458:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201007.696579:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1060ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201007.700802:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715108608 00000100:00100000:0.0:1788201007.700825:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715108608 00000100:00100000:0.0:1788201007.700931:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788201007.700943:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715108608:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788201007.700980:0:89118:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788201007.701030:0:89118:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788201007.701034:0:89118:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 115 00000100:00100000:0.0:1788201007.701942:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715108608:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 996us (5478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201007.701955:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788201007.702125:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715108608:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788201007.702206:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788201007.702219:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad400/0x96d0c9b8c9a1b100 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b107 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201007.702232:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad400/0x96d0c9b8c9a1b100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b107 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201007.702259:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788201007.702263:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc0053a4000 from 52 10000000:01000000:1.0:1788201007.702266:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788201007.702307:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0079ada00/0x96d0c9b8c9a1b10e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201007.702313:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0079ada00/0x96d0c9b8c9a1b10e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201007.702320:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0079ada00/0x96d0c9b8c9a1b10e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201007.702340:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715108736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201007.702375:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201007.702420:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1060ca000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201007.702434:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715108736 00000100:00100000:2.0:1788201007.702441:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715108736 00000100:00100000:2.0:1788201007.702499:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788201007.702508:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715108736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201007.702520:0:89119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201007.702538:0:89119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006c6ce00/0x96d0c9b8c9a1b115 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b10e expref: -99 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.702568:0:89119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006c6ce00/0x96d0c9b8c9a1b115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b10e expref: 12 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.702580:0:89119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006c6ce00/0x96d0c9b8c9a1b115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b10e expref: 12 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.702604:0:89119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006c6ce00, rc 0) 00000100:00100000:2.0:1788201007.702658:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110010050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715108736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201007.702664:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788201007.703661:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715108736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201007.703687:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0079ada00/0x96d0c9b8c9a1b10e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b115 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201007.703699:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0079ada00/0x96d0c9b8c9a1b10e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b115 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201007.703792:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715108864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201007.703840:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201007.703869:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1060ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201007.703945:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715108864 00000100:00100000:0.0:1788201007.703952:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715108864 00000100:00100000:0.0:1788201007.703999:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788201007.704009:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715108864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201007.704203:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715108864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 195us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201007.704210:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788201007.704313:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715108864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201007.704344:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715108992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201007.704405:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201007.704432:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1060ca000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201007.704513:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715108992 00000100:00100000:3.0:1788201007.704519:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715108992 00000100:00100000:3.0:1788201007.704558:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788201007.704566:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715108992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201007.704685:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715108992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201007.704692:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788201007.704916:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715108992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201007.705987:0:89173:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1788201007.707651:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1788201007.707695:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201007.707732:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0079ada00/0x96d0c9b8c9a1b10e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b115 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.707745:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0079ada00/0x96d0c9b8c9a1b10e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b115 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201007.707758:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788201007.707761:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc0053a4000 from 112 10000000:01000000:3.0:1788201007.707765:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788201007.707816:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed200/0x96d0c9b8c9a1b11c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.707824:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed200/0x96d0c9b8c9a1b11c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.707836:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed200/0x96d0c9b8c9a1b11c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201007.707868:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715109120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201007.707966:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201007.708060:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f17be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201007.708221:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715109120 00000100:00100000:0.0:1788201007.708230:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715109120 00000100:00100000:0.0:1788201007.708301:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788201007.708313:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715109120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201007.708329:0:89118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201007.708346:0:89118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140759c00/0x96d0c9b8c9a1b123 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b11c expref: -99 pid: 89118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201007.708376:0:89118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140759c00/0x96d0c9b8c9a1b123 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b11c expref: 13 pid: 89118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201007.708389:0:89118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140759c00/0x96d0c9b8c9a1b123 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b11c expref: 13 pid: 89118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201007.708400:0:89118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140759c00, rc 0) 00000100:00100000:0.0:1788201007.708460:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107166050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715109120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201007.708470:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788201007.708626:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715109120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201007.708644:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed200/0x96d0c9b8c9a1b11c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b123 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201007.708654:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed200/0x96d0c9b8c9a1b11c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b123 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201007.708719:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715109248:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788201007.708757:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201007.708788:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1060ca240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201007.708811:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715109248 00000100:00100000:2.0:1788201007.708817:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715109248 00000100:00100000:3.0:1788201007.708840:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788201007.708850:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715109248:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788201007.708867:0:89116:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788201007.708897:0:89116:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788201007.708901:0:89116:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788201007.708905:0:89116:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788201007.708908:0:89116:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788201007.708911:0:89116:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 115 00000100:00100000:3.0:1788201007.709006:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715109248:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 158us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201007.709044:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788201007.710625:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715109248:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788201007.710749:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788201007.710761:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed200/0x96d0c9b8c9a1b11c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b123 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201007.710773:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed200/0x96d0c9b8c9a1b11c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b123 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201007.710784:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788201007.710787:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1788201007.710790:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788201007.710827:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0079ac000/0x96d0c9b8c9a1b12a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201007.710849:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0079ac000/0x96d0c9b8c9a1b12a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201007.710860:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0079ac000/0x96d0c9b8c9a1b12a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201007.710894:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715109376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201007.710956:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201007.711009:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1060ca240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201007.713826:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715109376 00000100:00100000:2.0:1788201007.713847:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715109376 00000100:00100000:2.0:1788201007.713952:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788201007.713966:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715109376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201007.713992:0:89119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201007.714044:0:89119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006c6d600/0x96d0c9b8c9a1b131 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b12a expref: -99 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.714083:0:89119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006c6d600/0x96d0c9b8c9a1b131 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b12a expref: 14 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.714096:0:89119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006c6d600/0x96d0c9b8c9a1b131 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b12a expref: 14 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.714108:0:89119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006c6d600, rc 0) 00000100:00100000:2.0:1788201007.714227:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125ad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715109376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 263us (3270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201007.714234:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788201007.714372:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715109376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201007.714397:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0079ac000/0x96d0c9b8c9a1b12a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b131 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201007.714409:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0079ac000/0x96d0c9b8c9a1b12a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b131 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201007.714511:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715109504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201007.714553:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201007.714604:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc109062480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201007.714663:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715109504 00000100:00100000:2.0:1788201007.714669:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715109504 00000100:00100000:2.0:1788201007.714708:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788201007.714717:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125ad9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715109504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201007.714920:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125ad9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715109504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 203us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201007.714928:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788201007.715013:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715109504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201007.715099:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715109632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201007.715145:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201007.715157:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc109062480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201007.715322:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715109632 00000100:00100000:2.0:1788201007.715327:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715109632 00000100:00100000:2.0:1788201007.715359:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788201007.715366:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715109632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201007.719279:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715109632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3898us (4118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201007.719300:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788201007.719329:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715109632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201007.723606:0:89174:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:2.0:1788201007.723734:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:2.0:1788201007.723768:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788201007.723861:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0079ac000/0x96d0c9b8c9a1b12a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b131 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.723875:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0079ac000/0x96d0c9b8c9a1b12a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b131 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201007.723895:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:2.0:1788201007.723898:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dc0053a4000 from 1 10000000:01000000:2.0:1788201007.723901:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788201007.723959:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006c6d000/0x96d0c9b8c9a1b138 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.723967:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc006c6d000/0x96d0c9b8c9a1b138 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.723980:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc006c6d000/0x96d0c9b8c9a1b138 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201007.724744:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140294e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715109760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201007.726075:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201007.726139:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f2e7840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201007.726768:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715109760 00000100:00100000:0.0:1788201007.726783:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715109760 00000100:00100000:0.0:1788201007.726870:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788201007.726891:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134204850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715109760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201007.726915:0:89119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201007.726945:0:89119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140758a00/0x96d0c9b8c9a1b13f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b138 expref: -99 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201007.726981:0:89119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140758a00/0x96d0c9b8c9a1b13f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b138 expref: 15 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201007.726994:0:89119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140758a00/0x96d0c9b8c9a1b13f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b138 expref: 15 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201007.727005:0:89119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140758a00, rc 0) 00000100:00100000:0.0:1788201007.732842:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134204850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715109760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 5946us (6756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201007.732860:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788201007.732892:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140294e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715109760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201007.732928:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc006c6d000/0x96d0c9b8c9a1b138 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b13f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.732944:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc006c6d000/0x96d0c9b8c9a1b138 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b13f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201007.732971:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788201007.732977:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006c6d000/0x96d0c9b8c9a1b138 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b13f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.732985:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc006c6d000/0x96d0c9b8c9a1b138 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b13f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201007.733003:0:6529:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788201007.733007:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc0053a4000 from 7 10000000:01000000:2.0:1788201007.733009:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201007.733073:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006c6d400/0x96d0c9b8c9a1b146 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.733081:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc006c6d400/0x96d0c9b8c9a1b146 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.733092:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc006c6d400/0x96d0c9b8c9a1b146 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201007.733146:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140294e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715109888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201007.733211:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201007.733260:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f2e7840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201007.733830:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715109888 00000100:00100000:0.0:1788201007.733842:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715109888 00000100:00100000:0.0:1788201007.733925:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788201007.733936:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002ae6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715109888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201007.733962:0:89118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201007.733980:0:89118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140759a00/0x96d0c9b8c9a1b14d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b146 expref: -99 pid: 89118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201007.734008:0:89118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140759a00/0x96d0c9b8c9a1b14d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b146 expref: 16 pid: 89118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201007.734101:0:89118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140759a00/0x96d0c9b8c9a1b14d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b146 expref: 16 pid: 89118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201007.734112:0:89118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140759a00, rc 0) 00000100:00100000:0.0:1788201007.734181:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002ae6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715109888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 246us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201007.734188:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788201007.734296:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140294e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715109888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201007.734312:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc006c6d400/0x96d0c9b8c9a1b146 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b14d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201007.734320:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc006c6d400/0x96d0c9b8c9a1b146 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b14d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201007.734401:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715110016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201007.734436:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201007.734470:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1060ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201007.734537:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715110016 00000100:00100000:0.0:1788201007.734542:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715110016 00000100:00100000:0.0:1788201007.734574:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788201007.734581:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002ae4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715110016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201007.739225:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002ae4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715110016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4629us (4775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201007.739246:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788201007.742112:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715110016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201007.742362:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140295880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715110144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201007.742485:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201007.742618:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f2e7840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201007.746595:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715110144 00000100:00100000:1.0:1788201007.746617:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715110144 00000100:00100000:2.0:1788201007.746784:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788201007.746800:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002ae4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715110144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201007.747080:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002ae4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715110144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 284us (4594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201007.747090:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788201007.747244:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140295880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715110144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201007.748226:0:89176:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788201007.748494:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788201007.748526:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201007.748541:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006c6d400/0x96d0c9b8c9a1b146 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b14d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.748554:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc006c6d400/0x96d0c9b8c9a1b146 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b14d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201007.748566:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788201007.748569:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc001db6000 from 52 10000000:01000000:2.0:1788201007.748573:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788201007.748617:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006c6de00/0x96d0c9b8c9a1b154 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.748627:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc006c6de00/0x96d0c9b8c9a1b154 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.748755:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc006c6de00/0x96d0c9b8c9a1b154 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201007.748784:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140297800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715110272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201007.748852:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201007.748912:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f63000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201007.748976:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715110272 00000100:00100000:0.0:1788201007.748984:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715110272 00000100:00100000:1.0:1788201007.749121:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788201007.749136:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002ae5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715110272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201007.749150:0:89116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201007.749171:0:89116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0079ade00/0x96d0c9b8c9a1b15b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b154 expref: -99 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201007.749201:0:89116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0079ade00/0x96d0c9b8c9a1b15b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b154 expref: 17 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201007.749298:0:89116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0079ade00/0x96d0c9b8c9a1b15b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b154 expref: 17 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201007.749308:0:89116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0079ade00, rc 0) 00000100:00100000:1.0:1788201007.760101:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002ae5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715110272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 10952us (11231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201007.760121:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788201007.760149:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140297800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715110272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201007.760187:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc006c6de00/0x96d0c9b8c9a1b154 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b15b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.760203:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc006c6de00/0x96d0c9b8c9a1b154 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b15b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201007.760312:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140297800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715110400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201007.760381:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201007.760421:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715110400 00000100:00100000:2.0:1788201007.760429:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715110400 00000100:00100000:2.0:1788201007.760473:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788201007.760481:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002ae5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715110400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201007.760634:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002ae5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715110400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201007.760654:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788201007.760697:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f63000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201007.760710:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140297800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715110400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201007.760738:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140297800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715110528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201007.760802:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201007.760817:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f63000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201007.761066:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715110528 00000100:00100000:0.0:1788201007.761071:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715110528 00000100:00100000:0.0:1788201007.761108:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788201007.761126:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002ae6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715110528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201007.761221:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002ae6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715110528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201007.761228:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788201007.761479:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140297800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715110528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201007.762244:0:89177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1788201007.762729:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1788201007.762758:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201007.762773:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006c6de00/0x96d0c9b8c9a1b154 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b15b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201007.762788:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc006c6de00/0x96d0c9b8c9a1b154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b15b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201007.762801:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788201007.762805:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1788201007.762808:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788201007.762860:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad600/0x96d0c9b8c9a1b162 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201007.762870:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad600/0x96d0c9b8c9a1b162 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201007.762893:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad600/0x96d0c9b8c9a1b162 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201007.762939:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715110656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201007.763010:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201007.763087:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1060ca240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201007.764167:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715110656 00000100:00100000:2.0:1788201007.764179:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715110656 00000100:00100000:2.0:1788201007.764286:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788201007.764298:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002ae5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715110656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201007.764316:0:89119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201007.764335:0:89119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006c6d800/0x96d0c9b8c9a1b169 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b162 expref: -99 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.764366:0:89119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006c6d800/0x96d0c9b8c9a1b169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b162 expref: 18 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.764379:0:89119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006c6d800/0x96d0c9b8c9a1b169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b162 expref: 18 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.764390:0:89119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006c6d800, rc 0) 00000100:00100000:2.0:1788201007.764467:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002ae5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715110656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (1457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201007.764474:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788201007.764556:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715110656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201007.764576:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad600/0x96d0c9b8c9a1b162 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b169 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.764586:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad600/0x96d0c9b8c9a1b162 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b169 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201007.764691:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715110784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201007.764731:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201007.769173:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f17bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201007.774785:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715110784 00000100:00100000:1.0:1788201007.774810:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715110784 00000100:00100000:1.0:1788201007.774908:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788201007.774921:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002ae6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715110784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201007.775199:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002ae6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715110784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 280us (10466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201007.775207:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788201007.775294:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715110784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201007.775365:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715110912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201007.775416:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201007.775450:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1060ca240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201007.775462:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715110912 00000100:00100000:1.0:1788201007.775466:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715110912 00000100:00100000:1.0:1788201007.775483:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788201007.775488:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002ae7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715110912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201007.779195:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002ae7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715110912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3696us (3769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201007.779214:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788201007.781121:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715110912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201007.789464:0:89181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1788201007.789671:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1788201007.789706:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788201007.789721:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad600/0x96d0c9b8c9a1b162 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b169 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201007.789746:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad600/0x96d0c9b8c9a1b162 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b169 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201007.789757:0:6529:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788201007.789760:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc001db6000 from 7 10000000:01000000:1.0:1788201007.789764:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201007.790048:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0079acc00/0x96d0c9b8c9a1b170 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201007.790057:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0079acc00/0x96d0c9b8c9a1b170 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201007.790071:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0079acc00/0x96d0c9b8c9a1b170 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201007.790106:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715111040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201007.790198:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201007.790248:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201007.790332:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715111040 00000100:00100000:2.0:1788201007.790343:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715111040 00000100:00100000:2.0:1788201007.790413:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788201007.790424:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b644450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715111040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201007.790441:0:89119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201007.790462:0:89119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006c6ca00/0x96d0c9b8c9a1b177 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b170 expref: -99 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.790494:0:89119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006c6ca00/0x96d0c9b8c9a1b177 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b170 expref: 19 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.790506:0:89119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006c6ca00/0x96d0c9b8c9a1b177 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b170 expref: 19 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.790516:0:89119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006c6ca00, rc 0) 00000100:00100000:2.0:1788201007.790566:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b644450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715111040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201007.790573:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788201007.792654:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715111040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201007.792688:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0079acc00/0x96d0c9b8c9a1b170 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b177 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201007.792703:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0079acc00/0x96d0c9b8c9a1b170 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b177 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201007.792808:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715111168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201007.792894:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201007.792958:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201007.793064:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715111168 00000100:00100000:2.0:1788201007.793072:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715111168 00000100:00100000:2.0:1788201007.793126:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788201007.793137:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b646c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715111168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201007.793294:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b646c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715111168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201007.793302:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788201007.793511:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715111168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201007.793544:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715111296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201007.793588:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201007.793607:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201007.793621:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715111296 00000100:00100000:1.0:1788201007.793626:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715111296 00000100:00100000:1.0:1788201007.793654:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788201007.793662:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715111296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201007.793754:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715111296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201007.793762:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788201007.793806:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715111296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201007.802297:0:89182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788201007.802552:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788201007.802586:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201007.802601:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0079acc00/0x96d0c9b8c9a1b170 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b177 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.802614:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0079acc00/0x96d0c9b8c9a1b170 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b177 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201007.802624:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788201007.802627:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc13aa9f000 from 52 10000000:01000000:3.0:1788201007.802630:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201007.802681:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1b17e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.802691:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1b17e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.802716:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1b17e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201007.802745:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715111424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201007.802827:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201007.802975:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f17bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201007.803374:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715111424 00000100:00100000:2.0:1788201007.803384:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715111424 00000100:00100000:2.0:1788201007.803473:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788201007.803486:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003ae0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715111424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201007.803501:0:89119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201007.803517:0:89119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006c6c600/0x96d0c9b8c9a1b185 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b17e expref: -99 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.803561:0:89119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006c6c600/0x96d0c9b8c9a1b185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b17e expref: 20 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.803572:0:89119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006c6c600/0x96d0c9b8c9a1b185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b17e expref: 20 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.803583:0:89119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006c6c600, rc 0) 00000100:00100000:2.0:1788201007.803637:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003ae0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715111424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201007.803645:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788201007.803725:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715111424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201007.803744:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1b17e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b185 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.803754:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1b17e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b185 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201007.803829:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715111552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201007.803869:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201007.804190:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f17bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201007.804277:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715111552 00000100:00100000:1.0:1788201007.804284:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715111552 00000100:00100000:1.0:1788201007.804313:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788201007.804321:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f0e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715111552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201007.804504:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f0e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715111552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 183us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201007.804511:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788201007.804615:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715111552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201007.804648:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715111680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201007.804690:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201007.804742:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f17bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201007.804772:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715111680 00000100:00100000:1.0:1788201007.804775:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715111680 00000100:00100000:1.0:1788201007.804831:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788201007.804838:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f0e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715111680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201007.804944:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f0e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715111680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201007.804962:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788201007.805087:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715111680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788201007.807241:0:89185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1788201007.807530:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1788201007.807563:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201007.807576:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1b17e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b185 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201007.807589:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1b17e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b185 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201007.807600:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788201007.807603:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1788201007.807606:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788201007.807652:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0079ac800/0x96d0c9b8c9a1b18c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201007.807660:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0079ac800/0x96d0c9b8c9a1b18c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201007.807672:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0079ac800/0x96d0c9b8c9a1b18c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201007.807701:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715111808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201007.807785:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201007.807868:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201007.807919:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715111808 00000100:00100000:2.0:1788201007.807930:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715111808 00000100:00100000:2.0:1788201007.808090:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788201007.808101:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f0e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715111808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201007.808117:0:89118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201007.808134:0:89118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006c6da00/0x96d0c9b8c9a1b193 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b18c expref: -99 pid: 89118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.808163:0:89118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006c6da00/0x96d0c9b8c9a1b193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b18c expref: 21 pid: 89118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.808174:0:89118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006c6da00/0x96d0c9b8c9a1b193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b18c expref: 21 pid: 89118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.808184:0:89118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006c6da00, rc 0) 00000100:00100000:2.0:1788201007.808241:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f0e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715111808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201007.808248:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788201007.808489:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715111808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201007.808505:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0079ac800/0x96d0c9b8c9a1b18c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b193 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201007.808523:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0079ac800/0x96d0c9b8c9a1b18c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b193 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201007.808597:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715111936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201007.808631:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201007.808913:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201007.808963:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715111936 00000100:00100000:3.0:1788201007.808968:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715111936 00000100:00100000:3.0:1788201007.809005:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788201007.809011:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f0e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715111936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201007.810790:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f0e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715111936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1774us (2154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201007.810802:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788201007.811794:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715111936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201007.811860:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715112064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201007.811945:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201007.811985:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201007.812010:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715112064 00000100:00100000:1.0:1788201007.812030:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715112064 00000100:00100000:1.0:1788201007.812077:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788201007.812086:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f0e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715112064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201007.815270:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f0e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715112064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3171us (3312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201007.815288:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788201007.815543:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715112064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201007.816390:0:89187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1788201007.816641:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1788201007.816679:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788201007.816693:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0079ac800/0x96d0c9b8c9a1b18c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b193 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.816706:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0079ac800/0x96d0c9b8c9a1b18c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b193 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201007.816717:0:6529:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788201007.816720:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc13aa9f000 from 7 10000000:01000000:3.0:1788201007.816723:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201007.816766:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1b19a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.816773:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1b19a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.816783:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1b19a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201007.816808:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715112192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201007.816870:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201007.816940:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105f1d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201007.816987:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715112192 00000100:00100000:0.0:1788201007.816994:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715112192 00000100:00100000:0.0:1788201007.820078:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788201007.820102:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12591ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715112192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201007.820126:0:89119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201007.820150:0:89119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140759000/0x96d0c9b8c9a1b1a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b19a expref: -99 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201007.820183:0:89119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140759000/0x96d0c9b8c9a1b1a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b19a expref: 22 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201007.820204:0:89119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140759000/0x96d0c9b8c9a1b1a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b19a expref: 22 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201007.820214:0:89119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140759000, rc 0) 00000100:00100000:0.0:1788201007.820320:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12591ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715112192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 227us (3449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201007.820327:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788201007.820592:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715112192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201007.820616:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1b19a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b1a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.820628:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1b19a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b1a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201007.824098:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715112320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201007.824241:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201007.824305:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105f1d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201007.824581:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715112320 00000100:00100000:0.0:1788201007.824590:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715112320 00000100:00100000:0.0:1788201007.824666:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788201007.824676:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125919450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715112320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201007.824828:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125919450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715112320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201007.824836:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788201007.824966:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715112320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201007.825006:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715112448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201007.825075:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201007.825092:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105f1d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201007.825103:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715112448 00000100:00100000:3.0:1788201007.825106:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715112448 00000100:00100000:3.0:1788201007.825128:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788201007.825133:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12591b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715112448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201007.825312:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12591b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715112448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201007.825318:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788201007.825355:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715112448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788201007.829293:0:89188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788201007.829505:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788201007.829537:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201007.829552:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1b19a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b1a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.829565:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1b19a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b1a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201007.829575:0:6529:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788201007.829578:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8dc12563cd28 from 1 10000000:01000000:2.0:1788201007.829581:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788201007.829632:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c000/0x96d0c9b8c9a1b1a8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.829640:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c000/0x96d0c9b8c9a1b1a8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.829654:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c000/0x96d0c9b8c9a1b1a8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201007.829687:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140297800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715112576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201007.829774:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201007.829828:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201007.830289:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715112576 00000100:00100000:3.0:1788201007.830299:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715112576 00000100:00100000:3.0:1788201007.830362:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788201007.830372:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125919c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715112576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201007.830388:0:89119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201007.830406:0:89119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1b1af lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b1a8 expref: -99 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.830433:0:89119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1b1af lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b1a8 expref: 23 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.830444:0:89119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1b1af lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b1a8 expref: 23 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.830455:0:89119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ecc00, rc 0) 00000100:00100000:3.0:1788201007.830508:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125919c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715112576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201007.830515:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788201007.830573:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140297800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715112576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201007.830589:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c000/0x96d0c9b8c9a1b1a8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b1af expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.830598:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c000/0x96d0c9b8c9a1b1a8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b1af expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201007.830619:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788201007.830625:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c000/0x96d0c9b8c9a1b1a8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b1af expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.830632:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c000/0x96d0c9b8c9a1b1a8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b1af expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201007.830645:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788201007.830648:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dc12563cd28 from 1 10000000:01000000:3.0:1788201007.830651:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788201007.830670:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064eda00/0x96d0c9b8c9a1b1b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.830678:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064eda00/0x96d0c9b8c9a1b1b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.830685:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064eda00/0x96d0c9b8c9a1b1b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201007.830700:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715112704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201007.830725:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201007.830741:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105f1dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201007.830754:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715112704 00000100:00100000:3.0:1788201007.830758:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715112704 00000100:00100000:3.0:1788201007.830778:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788201007.830783:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715112704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201007.830790:0:89116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201007.830798:0:89116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064ed400/0x96d0c9b8c9a1b1bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b1b6 expref: -99 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.830810:0:89116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ed400/0x96d0c9b8c9a1b1bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b1b6 expref: 24 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.830817:0:89116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064ed400/0x96d0c9b8c9a1b1bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b1b6 expref: 24 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.830833:0:89116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ed400, rc 0) 00000100:00100000:3.0:1788201007.830856:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715112704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201007.830862:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788201007.830899:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715112704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201007.830908:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064eda00/0x96d0c9b8c9a1b1b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b1bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.830915:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064eda00/0x96d0c9b8c9a1b1b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b1bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201007.830967:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715112832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201007.830988:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201007.830997:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105f1dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201007.831007:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715112832 00000100:00100000:3.0:1788201007.831010:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715112832 00000100:00100000:3.0:1788201007.831045:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788201007.831050:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715112832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201007.831118:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715112832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 68us (130us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201007.831124:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788201007.831147:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715112832:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788201007.831169:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788201007.831174:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064eda00/0x96d0c9b8c9a1b1b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b1bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.831186:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064eda00/0x96d0c9b8c9a1b1b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b1bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.888222:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201007.958402:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201007.958617:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695361408 00000100:00100000:3.0:1788201007.958631:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695361408 00000100:00100000:3.0:1788201007.958708:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 61 00000100:00100000:3.0:1788201007.958721:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+5:42467:x1875060695361408:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201007.958744:0:89116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201007.958767:0:89116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064ec000/0x96d0c9b8c9a1b1c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786626 expref: -99 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.958805:0:89116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ec000/0x96d0c9b8c9a1b1c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786626 expref: 6 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.958818:0:89116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064ec000/0x96d0c9b8c9a1b1c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786626 expref: 6 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201007.958829:0:89116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ec000, rc 0) 00000100:00100000:3.0:1788201007.958907:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+6:42467:x1875060695361408:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 188us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201007.958915:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 61 00000100:00100000:0.0:1788201007.964351:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201007.968578:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695361536 00000100:00100000:2.0:1788201007.968598:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695361536 00000100:00100000:2.0:1788201007.968688:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 62 00000100:00100000:2.0:1788201007.968699:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11073ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+6:42467:x1875060695361536:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201007.968731:0:89118:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1788201007.968753:0:89118:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201007.968762:0:89118:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1788201007.968765:0:89118:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1788201007.968768:0:89118:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1788201007.968770:0:89118:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 115 00000100:00100000:3.0:1788201007.979318:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11073ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+6:42467:x1875060695361536:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 Request processed in 10601us (14959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201007.979338:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 62 00000100:00100000:1.0:1788201007.990556:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201007.990599:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201007.990743:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695361664 00000100:00100000:3.0:1788201007.990756:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695361664 00000100:00100000:3.0:1788201007.990820:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1213 00000100:00100000:3.0:1788201007.990829:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695361664:12345-192.168.201.20@tcp:38:ll_cfg_requeue.0 00010000:00080000:3.0:1788201007.990869:0:66313:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '4292087e-fa00-4621-b681-837afc99ae35' at ffff8dc13f86b000, cookie 0x96d0c9b8c9a1b04a 00010000:00080000:3.0:1788201007.990886:0:66313:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp recovering/t107374182407 exp ffff8dc13f86b000 cur 3859 last 1788201006 00010000:02000400:3.0:1788201007.990896:0:66313:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:3.0:1788201007.990902:0:66313:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:3.0:1788201007.990931:0:66313:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788201007.991124:0:66313:0:(import.c:65:import_set_state_nolock()) ffff8dc106071000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201007.991210:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2399:x1875060695361664:12345-192.168.201.20@tcp:38:ll_cfg_requeue.0 Request processed in 381us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201007.991218:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1213 00000100:00100000:2.0:1788201007.991584:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695361792 00000100:00100000:2.0:1788201007.991590:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695361792 00000100:00100000:2.0:1788201007.991647:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 63 00000100:00100000:2.0:1788201007.991655:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+6:42467:x1875060695361792:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201007.991666:0:89119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201007.991689:0:89119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006c6d200/0x96d0c9b8c9a1b1cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78662d expref: -99 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.991718:0:89119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006c6d200/0x96d0c9b8c9a1b1cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78662d expref: 7 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.991730:0:89119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006c6d200/0x96d0c9b8c9a1b1cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78662d expref: 7 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201007.991741:0:89119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006c6d200, rc 0) 00000100:00100000:2.0:1788201007.991766:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+7:42467:x1875060695361792:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 113us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201007.991772:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 63 00000100:00100000:1.0:1788201008.000950:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201008.001078:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201008.001769:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695361920 00000100:00100000:0.0:1788201008.001784:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695361920 00000100:00100000:0.0:1788201008.001853:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 64 00000100:00100000:0.0:1788201008.001865:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+7:42467:x1875060695361920:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201008.002100:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+8:42467:x1875060695361920:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 237us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201008.002110:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 64 00000100:00100000:2.0:1788201008.007428:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695354880 00000100:00100000:2.0:1788201008.007453:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695354880 00000100:00100000:2.0:1788201008.007539:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1214 00000100:00100000:2.0:1788201008.007553:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2399:x1875060695354880:12345-192.168.201.20@tcp:36:mcreate.0 00010000:00080000:2.0:1788201008.007581:0:66314:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 107374182407, current: 107374182407, replaying 00000100:00100000:2.0:1788201008.007603:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2399:x1875060695354880:12345-192.168.201.20@tcp:36:mcreate.0 Request processed in 54us (6671us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201008.007622:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1214 00010000:00080000:2.0:1788201008.008101:0:89143:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:0.0:1788201008.008352:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201008.008423:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695362048 00000100:00100000:2.0:1788201008.008430:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695362048 00000100:00100000:2.0:1788201008.008477:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 65 00000100:00100000:2.0:1788201008.008486:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+8:42467:x1875060695362048:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201008.008771:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+8:42467:x1875060695362048:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 285us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201008.008780:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 65 00000100:00100000:1.0:1788201008.039979:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201008.040267:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695362176 00000100:00100000:2.0:1788201008.040282:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695362176 00000100:00100000:2.0:1788201008.040351:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 66 00000100:00100000:2.0:1788201008.040362:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+8:42467:x1875060695362176:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201008.040384:0:89119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201008.040408:0:89119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006c6dc00/0x96d0c9b8c9a1b1d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786634 expref: -99 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201008.040444:0:89119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006c6dc00/0x96d0c9b8c9a1b1d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786634 expref: 9 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201008.040455:0:89119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006c6dc00/0x96d0c9b8c9a1b1d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786634 expref: 9 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201008.040467:0:89119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006c6dc00, rc 0) 00000100:00100000:2.0:1788201008.040537:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+9:42467:x1875060695362176:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 176us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201008.040563:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 66 00000100:00100000:1.0:1788201008.048865:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201008.048983:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695362304 00000100:00100000:3.0:1788201008.049000:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695362304 00000100:00100000:3.0:1788201008.049324:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 67 00000100:00100000:3.0:1788201008.049337:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+9:42467:x1875060695362304:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201008.049536:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+9:42467:x1875060695362304:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 202us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201008.049545:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 67 00000100:00100000:1.0:1788201008.054737:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201008.059176:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695362432 00000100:00100000:3.0:1788201008.059295:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695362432 00000100:00100000:3.0:1788201008.059425:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 68 00000100:00100000:3.0:1788201008.059438:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+9:42467:x1875060695362432:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201008.059627:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+9:42467:x1875060695362432:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 191us (4905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201008.059642:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 68 00000100:00100000:0.0:1788201008.087834:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201008.098091:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695362560 00000100:00100000:2.0:1788201008.098114:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695362560 00000100:00100000:2.0:1788201008.098378:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 69 00000100:00100000:2.0:1788201008.098392:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+9:42467:x1875060695362560:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201008.098416:0:89119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201008.098439:0:89119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc100030c00/0x96d0c9b8c9a1b1d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78663b expref: -99 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201008.098475:0:89119:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc100030c00/0x96d0c9b8c9a1b1d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78663b expref: 10 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201008.098487:0:89119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc100030c00/0x96d0c9b8c9a1b1d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78663b expref: 10 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201008.098499:0:89119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc100030c00, rc 0) 00000100:00100000:2.0:1788201008.098619:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:42467:x1875060695362560:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 229us (10798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201008.098627:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 69 00000100:00100000:2.0:1788201008.113464:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201008.114537:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695362688 00000100:00100000:3.0:1788201008.114557:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695362688 00000100:00100000:3.0:1788201008.114765:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 70 00000100:00100000:3.0:1788201008.114778:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+10:42467:x1875060695362688:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201008.114969:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+10:42467:x1875060695362688:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 193us (1522us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201008.114980:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 70 00010000:00010000:2.0:1788201008.920995:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201009.491067:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201009.491101:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715112960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201009.491220:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201009.491301:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715112960 00000100:00100000:2.0:1788201009.491314:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715112960 00000100:00100000:2.0:1788201009.491408:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2182 00000100:00100000:2.0:1788201009.491431:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715112960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201009.491471:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201009.491531:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715112960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201009.491545:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2182 00000100:00080000:0.0:1788201009.491687:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201009.491731:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715112960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201009.495640:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201009.495673:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715113088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201009.495768:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201009.496009:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715113088 00000100:00100000:3.0:1788201009.496240:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715113088 00000100:00100000:3.0:1788201009.496321:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2183 00000100:00100000:3.0:1788201009.496334:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715113088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201009.496371:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201009.496430:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715113088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201009.496437:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2183 00000100:00080000:0.0:1788201009.498049:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201009.498887:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715113088:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788201009.936301:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201010.964163:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201011.670584:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201011.670636:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201011.670821:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695362816 00000100:00100000:2.0:1788201011.670835:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695362816 00000100:00100000:2.0:1788201011.670911:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 71 00000100:00100000:2.0:1788201011.670923:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695362816:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201011.671218:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695362944 00000100:00100000:3.0:1788201011.671223:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695362944 00000100:00100000:3.0:1788201011.671412:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1236 00000100:00100000:3.0:1788201011.671424:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695362944:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201011.671470:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695362944:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 50us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201011.671479:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1236 00000100:00080000:0.0:1788201011.671563:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201011.671669:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695362816:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 121us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201011.671679:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 71 00010000:00010000:2.0:1788201011.990160:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201012.047396:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715113216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201012.047512:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201012.047605:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715113216 00000100:00100000:0.0:1788201012.047615:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715113216 00000100:00100000:0.0:1788201012.047687:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3896 00000100:00100000:0.0:1788201012.047698:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715113216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201012.047747:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:0.0:1788201012.047813:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715113216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201012.047822:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3896 00000100:00100000:0.0:1788201012.047887:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715113216:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788201012.048330:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201012.048336:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201012.048340:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201012.048349:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201012.048378:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc140296680 x1875060715113472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201012.048413:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201012.048417:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201012.048418:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201012.048424:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201012.048435:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc140297b80 x1875060715113728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201012.048451:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201012.048454:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201012.048456:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201012.048472:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201012.048487:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc140296d80 x1875060715113984/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201012.048508:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201012.048511:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201012.048513:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201012.048518:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201012.048527:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc140294e00 x1875060715114368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201012.048548:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788201012.048551:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201012.048553:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc103484800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201012.048558:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dc103484800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201012.048582:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc1331b5c00 x1875060715114752/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201012.048609:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715113472:0@lo:38:kworker.0 00000100:00100000:2.0:1788201012.048671:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201012.048696:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715113728:0@lo:38:kworker.0 00000100:00100000:2.0:1788201012.048717:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201012.048733:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715113984:0@lo:38:kworker.0 00000100:00100000:2.0:1788201012.048757:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201012.048773:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715114368:0@lo:38:kworker.0 00000100:00100000:2.0:1788201012.048794:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201012.048840:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715114752:0@lo:38:kworker.0 00000100:00100000:2.0:1788201012.048865:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201012.048912:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715113472 00000100:00100000:2.0:1788201012.048918:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715113472 00000100:00100000:2.0:1788201012.048947:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715113728 00000100:00100000:2.0:1788201012.048950:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715113728 00000100:00100000:2.0:1788201012.048959:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715114368 00000100:00100000:2.0:1788201012.048961:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715114368 00000100:00100000:2.0:1788201012.048968:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715114752 00000100:00100000:2.0:1788201012.048971:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715114752 00000100:00100000:2.0:1788201012.048983:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:2.0:1788201012.048990:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715113472:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788201012.049062:0:66314:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3863 last 0 00000020:00000080:2.0:1788201012.049112:0:66314:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x96d0c9b8c9a1b1e0 00000004:00100000:2.0:1788201012.049133:0:66314:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201012.049319:0:66314:0:(import.c:65:import_set_state_nolock()) ffff8dc1201cc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201012.049379:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875060715113472:12345-0@lo:38:kworker.0 Request processed in 388us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201012.049387:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000100:00100000:2.0:1788201012.049408:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:2.0:1788201012.049412:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715113728:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788201012.049426:0:66314:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3863 last 0 00000020:00000080:2.0:1788201012.049450:0:66314:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x96d0c9b8c9a1b1e7 00000004:00100000:2.0:1788201012.049457:0:66314:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201012.049479:0:66314:0:(import.c:65:import_set_state_nolock()) ffff8dc0039c7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201012.049506:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875060715113728:12345-0@lo:38:kworker.0 Request processed in 92us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201012.049523:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:2.0:1788201012.049536:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:2.0:1788201012.049540:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715114368:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788201012.049553:0:66314:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3863 last 0 00000020:00000080:2.0:1788201012.049575:0:66314:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x96d0c9b8c9a1b1ee 00000004:00100000:2.0:1788201012.049581:0:66314:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201012.049593:0:66314:0:(import.c:65:import_set_state_nolock()) ffff8dc0039c0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201012.049620:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875060715114368:12345-0@lo:38:kworker.0 Request processed in 79us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201012.049627:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00100000:2.0:1788201012.049639:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1218 00000100:00100000:2.0:1788201012.049644:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715114752:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788201012.049656:0:66314:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3863 last 0 00000020:00000080:2.0:1788201012.049682:0:66314:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x96d0c9b8c9a1b1f5 00000004:00100000:2.0:1788201012.049687:0:66314:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201012.049700:0:66314:0:(import.c:65:import_set_state_nolock()) ffff8dc0039c6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201012.049723:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875060715114752:12345-0@lo:38:kworker.0 Request processed in 78us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201012.049729:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1218 00000100:00100000:2.0:1788201012.049753:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715113984 00000100:00100000:2.0:1788201012.049758:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715113984 00000100:00100000:2.0:1788201012.049779:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3897 00000100:00100000:2.0:1788201012.049784:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715113984:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788201012.049798:0:23728:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8dc13f869000, cookie 0x96d0c9b8c9a1b051 00010000:00080000:2.0:1788201012.049814:0:23728:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t81604378640 exp ffff8dc13f869000 cur 3863 last 1788201006 00000004:00100000:2.0:1788201012.049832:0:23728:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201012.049849:0:23728:0:(import.c:65:import_set_state_nolock()) ffff8dc12b6b8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201012.049889:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715113984:12345-0@lo:38:kworker.0 Request processed in 103us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201012.049896:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3897 00010000:00080000:2.0:1788201012.049935:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc140296680 x1875060715113472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201012.049951:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 26 00000100:00080000:2.0:1788201012.050824:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8dc140296680 x1875060715113472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201037 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201012.050836:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788201012.050841:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788201012.050846:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788201012.050852:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715113472:0@lo:38:kworker.0 00010000:00080000:2.0:1788201012.050878:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc140297b80 x1875060715113728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201012.050891:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 26 00000100:00100000:1.0:1788201012.054284:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715113600:0@lo:400:kworker.0 00000100:00100000:1.0:1788201012.054407:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201012.054467:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc139ba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715114496:0@lo:400:kworker.0 00000100:00100000:1.0:1788201012.054497:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201012.054528:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788201012.054535:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715113856:0@lo:400:kworker.0 00000100:00100000:1.0:1788201012.054575:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201012.054597:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc139ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715114624:0@lo:400:kworker.0 00000100:00100000:1.0:1788201012.054626:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201012.054676:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715113600 00000100:00100000:1.0:1788201012.054686:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715113600 00000100:00100000:1.0:1788201012.054742:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715113856 00000100:00100000:1.0:1788201012.054746:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715113856 00000100:00100000:1.0:1788201012.054774:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:1.0:1788201012.054783:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715113600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201012.054872:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715113600:12345-0@lo:400:kworker.0 Request processed in 89us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201012.054880:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00100000:1.0:1788201012.054904:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:1.0:1788201012.054911:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715113856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201012.054939:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715113856:12345-0@lo:400:kworker.0 Request processed in 29us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201012.054965:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00100000:1.0:1788201012.054998:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715114496 00000100:00100000:1.0:1788201012.055002:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715114496 00000100:00100000:1.0:1788201012.055209:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715114624 00000100:00100000:1.0:1788201012.055213:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715114624 00000100:00100000:1.0:1788201012.055240:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2690 00000100:00100000:1.0:1788201012.055247:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715114496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201012.055282:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715114496:12345-0@lo:400:kworker.0 Request processed in 35us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201012.055288:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2690 00000100:00100000:1.0:1788201012.055300:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2691 00000100:00100000:1.0:1788201012.055306:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715114624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201012.055332:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715114624:12345-0@lo:400:kworker.0 Request processed in 27us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201012.055338:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2691 00000100:00100000:1.0:1788201012.055391:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715113856:0@lo:400:kworker.0 00000100:00100000:1.0:1788201012.055403:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc139ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715114624:0@lo:400:kworker.0 00000100:00100000:1.0:1788201012.055413:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715113600:0@lo:400:kworker.0 00000100:00100000:1.0:1788201012.055423:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc139ba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715114496:0@lo:400:kworker.0 00010000:00080000:1.0:1788201012.055513:0:89143:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788201012.055520:0:89143:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 107374182407 00000020:00080000:1.0:1788201012.055527:0:89143:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788201012.055531:0:89143:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 107374182407, next_transno: 107374182407 00010000:00080000:1.0:1788201012.055536:0:89143:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (107374182407) 00000020:00080000:1.0:1788201012.055547:0:89143:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788201012.055559:0:89143:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695354880 t107374182407 from 192.168.201.20@tcp req@ffff8dc12fb0e300 x1875060695354880/t0(107374182407) o36->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:129/0 lens 528/0 e 0 to 0 dl 1788201019 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201012.056162:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201012.056169:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201012.056171:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201012.056187:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715113344:0@lo:400:kworker.0 00000100:00100000:0.0:1788201012.056246:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201012.056297:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715114240:0@lo:400:kworker.0 00000100:00100000:0.0:1788201012.056323:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201012.056351:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201012.056358:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715114112:0@lo:400:kworker.0 00000100:00100000:0.0:1788201012.056382:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201012.060143:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715113344 00000100:00100000:1.0:1788201012.060161:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715113344 00000100:00100000:1.0:1788201012.060252:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788201012.060264:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715113344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201012.060397:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715113344:12345-0@lo:400:kworker.0 Request processed in 136us (4150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201012.060405:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000004:00080000:1.0:1788201012.060453:0:89143:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4828us 00000100:00100000:1.0:1788201012.060517:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715113344:0@lo:400:kworker.0 00000100:00100000:1.0:1788201012.060570:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715114240 00000100:00100000:1.0:1788201012.060574:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715114240 00000100:00100000:1.0:1788201012.060614:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715114112 00000100:00100000:1.0:1788201012.060619:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715114112 00000100:00100000:1.0:1788201012.060643:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2692 00000100:00100000:1.0:1788201012.060649:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715114240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201012.060690:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715114240:12345-0@lo:400:kworker.0 Request processed in 42us (4367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201012.060697:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2692 00000100:00100000:1.0:1788201012.060708:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2693 00000100:00100000:1.0:1788201012.060715:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715114112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201012.060746:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715114112:12345-0@lo:400:kworker.0 Request processed in 32us (4363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201012.060752:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2693 00000100:00100000:1.0:1788201012.060820:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715114112:0@lo:400:kworker.0 00000100:00100000:1.0:1788201012.062356:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715114240:0@lo:400:kworker.0 00000100:00080000:1.0:1788201012.062434:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201012.062443:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201012.065332:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8dc140297b80 x1875060715113728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201037 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201012.065351:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788201012.065358:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788201012.065363:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788201012.065369:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715113728:0@lo:38:kworker.0 00000100:00080000:2.0:1788201012.065429:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 26 00000100:00080000:2.0:1788201012.065463:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1788201012.065467:0:3654:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1788201012.065470:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 85899345923 gen 3 00000100:00080000:2.0:1788201012.065475:0:3654:0:(recover.c:53:ptlrpc_replay_next()) import ffff8dc109813800 from lustre-MDT0000_UUID committed 85899345923 last 0 00000100:00080000:2.0:1788201012.065478:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1788201012.086124:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715113984:0@lo:38:kworker.0 00010000:00080000:0.0:1788201012.086183:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc140294e00 x1875060715114368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201012.086207:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 26 00000100:00080000:0.0:1788201012.087282:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8dc140294e00 x1875060715114368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201037 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201012.087316:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1788201012.087324:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788201012.087329:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1788201012.087336:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715114368:0@lo:38:kworker.0 00010000:00080000:0.0:1788201012.087377:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc1331b5c00 x1875060715114752/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201012.087391:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 26 00000100:00080000:0.0:1788201012.087400:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788201012.087404:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788201012.087407:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc103484800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788201012.087411:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715114752:0@lo:38:kworker.0 00010000:00080000:0.0:1788201012.087479:0:89338:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:0.0:1788201012.087486:0:89338:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:0.0:1788201012.087494:0:89338:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1788201012.088920:0:89338:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1788201012.090371:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715114880:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788201012.090475:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201012.090683:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715114880 00000100:00100000:0.0:1788201012.090694:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715114880 00000100:00100000:0.0:1788201012.090764:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3898 00000100:00100000:0.0:1788201012.090776:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715114880:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1788201012.090810:0:83817:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc1331b5c00 x1875060715114880/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:133/0 lens 224/0 e 0 to 0 dl 1788201023 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201012.090824:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715114880:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 51us (350us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201012.090843:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3898 00010000:00010000:3.0:1788201012.118234:0:89143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b1fc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.118331:0:89143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b1fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.118365:0:89143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b1fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.118386:0:89143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b203 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.118394:0:89143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b203 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.118402:0:89143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b203 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.118896:0:89143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b1fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.118906:0:89143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b1fc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.118913:0:89143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b1fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.118919:0:89143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ede00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201012.118925:0:89143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b1fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.118933:0:89143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b1fc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.118949:0:89143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc107112300) 00010000:00010000:3.0:1788201012.118953:0:89143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201012.118959:0:89143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b1fc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.118973:0:89143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b1fc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201012.119000:0:89143:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000da683e reply state 00000000289c421c transno 107374182407 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b203 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.119013:0:89143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b203 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.121579:0:89143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc107112c00) 00010000:00010000:3.0:1788201012.121583:0:89143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201012.121591:0:89143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788201012.121785:0:89143:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:3.0:1788201012.121828:0:89143:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201012.121832:0:89143:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182408 00000020:00080000:3.0:1788201012.121837:0:89143:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201012.121839:0:89143:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182408 00000100:00100000:0.0:1788201012.127563:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201012.127670:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695355392 00000100:00100000:3.0:1788201012.127683:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695355392 00000100:00100000:3.0:1788201012.128447:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1219 00000100:00100000:3.0:1788201012.128466:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+8:2399:x1875060695355392:12345-192.168.201.20@tcp:36:rm.0 00010000:00080000:3.0:1788201012.128494:0:66757:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 107374182408, current: 107374182408, replaying 00000100:00100000:3.0:1788201012.128518:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+8:2399:x1875060695355392:12345-192.168.201.20@tcp:36:rm.0 Request processed in 59us (969us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201012.128525:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1219 00000020:00080000:2.0:1788201012.132008:0:89143:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788201012.132044:0:89143:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182408, next_transno: 107374182408 00010000:00080000:2.0:1788201012.132051:0:89143:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (107374182408) 00000020:00080000:2.0:1788201012.132056:0:89143:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788201012.132076:0:89143:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695355392 t107374182408 from 192.168.201.20@tcp req@ffff8dc005d55180 x1875060695355392/t0(107374182408) o36->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:133/0 lens 512/0 e 0 to 0 dl 1788201023 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788201012.132229:0:89143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031400/0x96d0c9b8c9a1b20a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.132249:0:89143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031400/0x96d0c9b8c9a1b20a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.132266:0:89143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031400/0x96d0c9b8c9a1b20a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.132282:0:89143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1b211 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.132291:0:89143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1b211 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.132298:0:89143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1b211 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.132441:0:89143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1b218 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.132450:0:89143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1b218 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.132458:0:89143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1b218 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.132793:0:89143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1b218 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.132814:0:89143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1b218 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.132822:0:89143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1b218 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.132829:0:89143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201012.132834:0:89143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1b218 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.132843:0:89143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1b218 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.132859:0:89143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x7:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:2.0:1788201012.132863:0:89143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201012.132868:0:89143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1b218 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.132875:0:89143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1b218 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.132911:0:89143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031400/0x96d0c9b8c9a1b20a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.132917:0:89143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031400/0x96d0c9b8c9a1b20a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.132923:0:89143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031400/0x96d0c9b8c9a1b20a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.132928:0:89143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100031400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201012.132931:0:89143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031400/0x96d0c9b8c9a1b20a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.132936:0:89143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031400/0x96d0c9b8c9a1b20a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.132944:0:89143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661300) 00010000:00010000:2.0:1788201012.132946:0:89143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201012.132949:0:89143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031400/0x96d0c9b8c9a1b20a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.132955:0:89143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031400/0x96d0c9b8c9a1b20a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201012.132966:0:89143:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002322747d reply state 000000000af73663 transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1b211 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.132978:0:89143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1b211 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.132984:0:89143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc107112c00) 00010000:00010000:2.0:1788201012.132992:0:89143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201012.132996:0:89143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788201012.133143:0:89143:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788201012.133172:0:89143:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788201012.133175:0:89143:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000020:00080000:2.0:1788201012.133179:0:89143:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788201012.133181:0:89143:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000100:00100000:3.0:1788201012.141306:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201012.141391:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695357440 00000100:00100000:2.0:1788201012.141408:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695357440 00000100:00100000:2.0:1788201012.141488:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1220 00000100:00100000:2.0:1788201012.141501:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+10:2399:x1875060695357440:12345-192.168.201.20@tcp:36:dd.0 00010000:00080000:2.0:1788201012.141530:0:66312:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 107374182409, current: 107374182410, replaying 00000100:00100000:2.0:1788201012.141552:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+10:2399:x1875060695357440:12345-192.168.201.20@tcp:36:dd.0 Request processed in 48us (257us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201012.141561:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1220 00000020:00080000:2.0:1788201012.141593:0:89143:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788201012.141598:0:89143:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182410, next_transno: 107374182409 00010000:00080000:2.0:1788201012.141605:0:89143:0:(ldlm_lib.c:2284:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 107374182409, ql: 1, comp: 1, conn: 2, next: 107374182410, next_update 0 last_committed: 107374182406) 00000020:00080000:2.0:1788201012.141611:0:89143:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788201012.141623:0:89143:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695357440 t107374182410 from 192.168.201.20@tcp req@ffff8dc12efc8a80 x1875060695357440/t0(107374182410) o36->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:133/0 lens 488/0 e 0 to 0 dl 1788201023 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788201012.142886:0:89143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1b21f lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.142915:0:89143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1b21f lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.142944:0:89143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1b21f lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201012.143298:0:89143:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014cb445d reply state 000000002f3209a9 transno 107374182410 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1b21f lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.143313:0:89143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1b21f lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.143322:0:89143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8dc12b661600) 00010000:00010000:2.0:1788201012.143325:0:89143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201012.143330:0:89143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788201012.143489:0:89143:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788201012.143515:0:89143:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788201012.143519:0:89143:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182411 00000020:00080000:2.0:1788201012.143524:0:89143:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788201012.143526:0:89143:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182411 00000001:00080000:3.0:1788201012.148168:0:89112:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182407 is committed 00000100:00100000:3.0:1788201012.148310:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201012.148378:0:66326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695357696 00000100:00100000:3.0:1788201012.148392:0:66326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695357696 00000100:00100000:3.0:1788201012.148474:0:66326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1 00000100:00100000:3.0:1788201012.148487:0:66326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:4292087e-fa00-4621-b681-837afc99ae35+11:2399:x1875060695357696:12345-192.168.201.20@tcp:10:dd.0 00010000:00080000:3.0:1788201012.148511:0:66326:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 107374182411, current: 107374182411, replaying 00000100:00100000:3.0:1788201012.148528:0:66326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:4292087e-fa00-4621-b681-837afc99ae35+11:2399:x1875060695357696:12345-192.168.201.20@tcp:10:dd.0 Request processed in 45us (225us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201012.148536:0:66326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1 00000020:00080000:3.0:1788201012.148561:0:89143:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201012.148566:0:89143:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182411, next_transno: 107374182411 00010000:00080000:3.0:1788201012.148572:0:89143:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (107374182411) 00000020:00080000:3.0:1788201012.148575:0:89143:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201012.148586:0:89143:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695357696 t107374182411 from 192.168.201.20@tcp req@ffff8dc12efc8380 x1875060695357696/t0(107374182411) o10->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:133/0 lens 440/0 e 0 to 0 dl 1788201023 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788201012.148939:0:89143:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788201012.148960:0:89143:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201012.148963:0:89143:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182412 00000020:00080000:3.0:1788201012.148966:0:89143:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201012.148968:0:89143:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182412 00010000:00010000:0.0:1788201012.149403:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b203 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.149417:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b203 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.149425:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b203 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.149432:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201012.149437:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b203 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.149446:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b203 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.149469:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc107112c00) 00010000:00010000:0.0:1788201012.149472:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201012.149477:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b203 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.149484:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b203 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201012.159216:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201012.159355:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695363072 00000100:00100000:2.0:1788201012.159369:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695363072 00000100:00100000:2.0:1788201012.159442:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1221 00000100:00100000:2.0:1788201012.159453:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+11:2399:x1875060695363072:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1788201012.159484:0:69485:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc12efca680 x1875060695363072/t0(0) o101->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:133/0 lens 328/0 e 0 to 0 dl 1788201023 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201012.159500:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+11:2399:x1875060695363072:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 50us (299us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201012.159508:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1221 00000020:00080000:3.0:1788201012.159641:0:89143:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201012.159646:0:89143:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 107374182412 00010000:00080000:3.0:1788201012.159650:0:89143:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1788201012.159653:0:89143:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201012.159662:0:89143:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788201012.159681:0:89143:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1788201012.159688:0:89143:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc12efca680 x1875060695363072/t0(0) o101->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:133/0 lens 328/0 e 0 to 0 dl 1788201023 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788201012.159710:0:89143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201012.159740:0:89143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b226 lrc: 2/0,0 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786618 expref: -99 pid: 89143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.159772:0:89143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b226 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786618 expref: 12 pid: 89143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.159787:0:89143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b226 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786618 expref: 12 pid: 89143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.159799:0:89143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ede00, rc 0) 00010000:00080000:3.0:1788201012.159886:0:89143:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788201012.159900:0:89143:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1788201012.163499:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201012.163692:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695363200 00000100:00100000:1.0:1788201012.163706:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695363200 00000100:00100000:1.0:1788201012.163787:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1239 00000100:00100000:1.0:1788201012.163811:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+12:2399:x1875060695363200:12345-192.168.201.20@tcp:400:ptlrpcd_rcv.0 00010000:00080000:1.0:1788201012.163837:0:66757:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc12efcb100 x1875060695363200/t0(0) o400->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:133/0 lens 224/0 e 0 to 0 dl 1788201023 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201012.163856:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+12:2399:x1875060695363200:12345-192.168.201.20@tcp:400:ptlrpcd_rcv.0 Request processed in 60us (374us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201012.163864:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1239 00010000:00080000:3.0:1788201012.163932:0:89143:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1788201012.164171:0:89143:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 111669149696 00000001:00100000:1.0:1788201012.168346:0:89112:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4292087e-fa00-4621-b681-837afc99ae35 00000001:00100000:1.0:1788201012.168360:0:89112:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1788201012.168391:0:89112:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182411 is committed 00010000:00010000:3.0:1788201012.168531:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1b211 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.168548:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1b211 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.168559:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1b211 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.168577:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201012.168582:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1b211 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.168602:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1b211 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.168625:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1b211 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.168633:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1b211 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.168673:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1b21f lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.168680:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1b21f lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.168687:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1b21f lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.168693:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100031200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201012.168696:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1b21f lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.168702:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1b21f lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.168712:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1b21f lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.168718:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1b21f lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 89143 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788201012.168777:0:89143:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1788201012.168841:0:89143:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1788201012.168860:0:89143:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8dc1331b5c00 x1875060715114880/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:133/0 lens 224/0 e 0 to 0 dl 1788201023 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788201012.169166:0:89143:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.201.20@tcp: req@ffff8dc12efcb100 x1875060695363200/t0(0) o400->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:133/0 lens 224/0 e 0 to 0 dl 1788201023 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788201012.169239:0:89143:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:1.0:1788201012.170320:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1788201012.170336:0:3654:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8dc005d56300 x1875060715114880/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201028 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201012.170346:0:3654:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8dc005d56300 x1875060715114880/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201028 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201012.170355:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788201012.176173:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788201012.176189:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715114880:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788201012.183778:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201012.183854:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201012.183936:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695358976 00000100:00100000:0.0:1788201012.183951:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695358976 00000100:00100000:0.0:1788201012.184058:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1222 00000100:00100000:0.0:1788201012.184071:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+7:0:x1875060695358976:12345-192.168.201.20@tcp:16:kworker.0 00000100:00100000:0.0:1788201012.184249:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+7:0:x1875060695358976:12345-192.168.201.20@tcp:16:kworker.0 Request processed in 180us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201012.184257:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1222 00000100:00100000:2.0:1788201012.192186:0:66327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695358848 00000100:00100000:2.0:1788201012.192206:0:66327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695358848 00002000:00100000:2.0:1788201012.192279:0:66327:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff8dc007c36300 x1875060695358848/t0(0) o4->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:133/0 lens 496/0 e 0 to 0 dl 1788201023 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201012.192291:0:66327:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8dc007c36300 with x1875060695358848 00002000:00010000:2.0:1788201012.192306:0:66327:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b226 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786618 expref: 7 pid: 89143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201012.192375:0:66327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:2.0:1788201012.192387:0:66327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:4292087e-fa00-4621-b681-837afc99ae35+7:0:x1875060695358848:12345-192.168.201.20@tcp:4:dd.0 00000100:00100000:0.0:1788201012.194641:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715115008:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201012.194744:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201012.197042:0:66327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:4292087e-fa00-4621-b681-837afc99ae35+9:0:x1875060695358848:12345-192.168.201.20@tcp:4:dd.0 Request processed in 4623us (13153us total) trans 111669149697 rc 0/0 00000100:00100000:2.0:1788201012.197057:0:66327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2 00002000:00100000:2.0:1788201012.197070:0:66327:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff8dc007c36300 x1875060695358848/t111669149697(0) o4->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:133/0 lens 496/448 e 0 to 0 dl 1788201023 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201012.197080:0:66327:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8dc007c36300 with x1875060695358848 00002000:00010000:2.0:1788201012.197090:0:66327:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b226 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786618 expref: 9 pid: 89143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201012.197162:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715115008 00000100:00100000:2.0:1788201012.197170:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715115008 00000100:00100000:2.0:1788201012.197729:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3899 00000100:00100000:2.0:1788201012.197741:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715115008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201012.197776:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2174976 pending 28672 free 1444966400 avail 1298726912 00000100:00100000:2.0:1788201012.197863:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715115008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (3120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201012.197884:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3899 00000100:00100000:2.0:1788201012.197940:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715115008:0@lo:41:osp-pre-0-1.0 00000004:00000080:3.0:1788201012.229572:0:89143:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa0dd47f13e10 00100000:10000000:3.0:1788201012.229595:0:89143:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1788201012.236316:0:89129:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0xb0:0x0] 00000100:00100000:1.0:1788201012.236404:0:89129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89129:1875060715115136:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788201012.236499:0:89129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201012.236541:0:89129:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f63cc0 going to sleep for 11 seconds 00000004:00080000:1.0:1788201012.236560:0:89131:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x2a2:0x0] 00000100:00100000:1.0:1788201012.236580:0:89131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc139ba3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89131:1875060715115264:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788201012.236624:0:89131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201012.236643:0:89131:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc11d0f1240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201012.236669:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715115136 00000100:00100000:1.0:1788201012.236679:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715115136 00000100:00100000:1.0:1788201012.236733:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715115264 00000100:00100000:1.0:1788201012.236736:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715115264 00000100:00100000:1.0:1788201012.236757:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5878 00000100:00100000:1.0:1788201012.236767:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:89129:x1875060715115136:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788201012.237213:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5879 00000100:00100000:2.0:1788201012.237226:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:89131:x1875060715115264:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788201012.237266:0:26203:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 801 -> diff = -127 00002000:02000040:2.0:1788201012.237272:0:26203:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:675 to 0x2c0000401:801) 00002000:00080000:1.0:1788201012.238512:0:26199:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 801 -> diff = -625 00002000:02000040:1.0:1788201012.238523:0:26199:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:177 to 0x280000401:801) 00002000:00010000:2.0:1788201012.250085:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x321:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201012.250102:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b22d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250124:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x321:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:2.0:1788201012.250129:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x321:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201012.250137:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b22d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250156:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b22d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250168:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b22d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250176:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b22d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250197:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201012.250369:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x320:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201012.250375:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1b234 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250384:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x320:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:2.0:1788201012.250388:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x320:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201012.250392:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1b234 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250401:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1b234 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250409:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1b234 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250417:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1b234 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250433:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788201012.250478:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201012.250484:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000553df25f/0x96d0c9b8c9a1b23b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250492:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31f:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:2.0:1788201012.250496:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201012.250500:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000553df25f/0x96d0c9b8c9a1b23b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250522:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000553df25f/0x96d0c9b8c9a1b23b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250532:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000553df25f/0x96d0c9b8c9a1b23b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250540:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000553df25f/0x96d0c9b8c9a1b23b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250557:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788201012.250602:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201012.250607:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1b242 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250616:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31e:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:2.0:1788201012.250619:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201012.250623:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1b242 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250633:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1b242 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250640:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1b242 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250657:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1b242 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250672:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788201012.250717:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201012.250722:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1b249 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250730:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31d:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:2.0:1788201012.250733:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201012.250738:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1b249 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250746:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1b249 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250754:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1b249 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250762:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1b249 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250772:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788201012.250825:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201012.250830:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000201a2490/0x96d0c9b8c9a1b250 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250844:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31c:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:2.0:1788201012.250846:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201012.250850:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000201a2490/0x96d0c9b8c9a1b250 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250859:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000201a2490/0x96d0c9b8c9a1b250 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250867:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000201a2490/0x96d0c9b8c9a1b250 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250874:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000201a2490/0x96d0c9b8c9a1b250 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250888:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788201012.250929:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201012.250935:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8153134/0x96d0c9b8c9a1b257 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250942:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31b:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:2.0:1788201012.250945:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201012.250949:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8153134/0x96d0c9b8c9a1b257 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250956:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8153134/0x96d0c9b8c9a1b257 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250975:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8153134/0x96d0c9b8c9a1b257 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250982:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8153134/0x96d0c9b8c9a1b257 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.250990:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1788201012.251059:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201012.251064:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1b25e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251072:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31a:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:2.0:1788201012.251075:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201012.251078:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1b25e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251087:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1b25e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251094:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1b25e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251100:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1b25e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251118:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1788201012.251160:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x319:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201012.251165:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4dbdf92/0x96d0c9b8c9a1b265 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251173:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x319:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:2.0:1788201012.251176:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x319:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201012.251180:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4dbdf92/0x96d0c9b8c9a1b265 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251189:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4dbdf92/0x96d0c9b8c9a1b265 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251197:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4dbdf92/0x96d0c9b8c9a1b265 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251204:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4dbdf92/0x96d0c9b8c9a1b265 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251213:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:2.0:1788201012.251249:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x318:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201012.251254:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b318c7cf/0x96d0c9b8c9a1b26c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251262:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x318:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:2.0:1788201012.251270:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x318:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201012.251275:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b318c7cf/0x96d0c9b8c9a1b26c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251283:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b318c7cf/0x96d0c9b8c9a1b26c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251290:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b318c7cf/0x96d0c9b8c9a1b26c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251296:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b318c7cf/0x96d0c9b8c9a1b26c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251303:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:2.0:1788201012.251342:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x317:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201012.251346:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070573b83/0x96d0c9b8c9a1b273 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251354:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x317:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:2.0:1788201012.251356:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x317:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201012.251360:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070573b83/0x96d0c9b8c9a1b273 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251369:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070573b83/0x96d0c9b8c9a1b273 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251376:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070573b83/0x96d0c9b8c9a1b273 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251389:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070573b83/0x96d0c9b8c9a1b273 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251399:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:2.0:1788201012.251438:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x316:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201012.251443:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003efe90ca/0x96d0c9b8c9a1b27a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251450:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x316:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:2.0:1788201012.251453:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x316:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201012.251456:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003efe90ca/0x96d0c9b8c9a1b27a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251465:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003efe90ca/0x96d0c9b8c9a1b27a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251472:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003efe90ca/0x96d0c9b8c9a1b27a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251479:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003efe90ca/0x96d0c9b8c9a1b27a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251487:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:2.0:1788201012.251523:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x315:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201012.251528:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de3ebfb5/0x96d0c9b8c9a1b281 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251542:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x315:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:2.0:1788201012.251545:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x315:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201012.251549:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de3ebfb5/0x96d0c9b8c9a1b281 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251558:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de3ebfb5/0x96d0c9b8c9a1b281 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251566:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de3ebfb5/0x96d0c9b8c9a1b281 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251573:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de3ebfb5/0x96d0c9b8c9a1b281 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251582:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:2.0:1788201012.251620:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x314:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201012.251625:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008cd7a6f/0x96d0c9b8c9a1b288 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251633:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x314:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:2.0:1788201012.251635:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x314:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201012.251639:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008cd7a6f/0x96d0c9b8c9a1b288 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251647:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008cd7a6f/0x96d0c9b8c9a1b288 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251665:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008cd7a6f/0x96d0c9b8c9a1b288 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251673:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008cd7a6f/0x96d0c9b8c9a1b288 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251682:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:2.0:1788201012.251722:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x313:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201012.251726:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e5843d8/0x96d0c9b8c9a1b28f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251733:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x313:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:2.0:1788201012.251736:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x313:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201012.251739:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e5843d8/0x96d0c9b8c9a1b28f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251748:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e5843d8/0x96d0c9b8c9a1b28f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251755:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e5843d8/0x96d0c9b8c9a1b28f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251762:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e5843d8/0x96d0c9b8c9a1b28f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251782:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:2.0:1788201012.251835:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x312:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201012.251840:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec72f47e/0x96d0c9b8c9a1b296 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251848:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x312:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:2.0:1788201012.251851:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x312:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201012.251855:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec72f47e/0x96d0c9b8c9a1b296 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251863:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec72f47e/0x96d0c9b8c9a1b296 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251871:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec72f47e/0x96d0c9b8c9a1b296 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251878:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec72f47e/0x96d0c9b8c9a1b296 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251886:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:2.0:1788201012.251924:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x311:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201012.251930:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b4a355e/0x96d0c9b8c9a1b29d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251937:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x311:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:2.0:1788201012.251945:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x311:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201012.251950:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b4a355e/0x96d0c9b8c9a1b29d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251959:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b4a355e/0x96d0c9b8c9a1b29d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251967:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b4a355e/0x96d0c9b8c9a1b29d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251975:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b4a355e/0x96d0c9b8c9a1b29d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.251982:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00010000:00010000:2.0:1788201012.252388:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:2.0:1788201012.252396:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b22d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252406:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100031200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201012.252412:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b22d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252423:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b22d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252444:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b22d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252465:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b22d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252491:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:2.0:1788201012.252495:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1b234 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252502:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201012.252505:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1b234 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252513:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1b234 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252524:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1b234 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252532:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1b234 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252545:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:2.0:1788201012.252548:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000553df25f/0x96d0c9b8c9a1b23b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252555:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201012.252564:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000553df25f/0x96d0c9b8c9a1b23b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252573:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000553df25f/0x96d0c9b8c9a1b23b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252584:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000553df25f/0x96d0c9b8c9a1b23b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252591:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000553df25f/0x96d0c9b8c9a1b23b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252604:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:2.0:1788201012.252607:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1b242 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252613:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100031400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201012.252616:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1b242 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252622:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1b242 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252631:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1b242 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252639:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1b242 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252658:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:2.0:1788201012.252662:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1b249 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252668:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201012.252671:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1b249 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252679:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1b249 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252689:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1b249 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252696:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1b249 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252710:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:2.0:1788201012.252713:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000201a2490/0x96d0c9b8c9a1b250 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252719:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201012.252722:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000201a2490/0x96d0c9b8c9a1b250 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252740:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000201a2490/0x96d0c9b8c9a1b250 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252750:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000201a2490/0x96d0c9b8c9a1b250 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252758:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000201a2490/0x96d0c9b8c9a1b250 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252773:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:2.0:1788201012.252776:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8153134/0x96d0c9b8c9a1b257 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252782:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100031e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201012.252785:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8153134/0x96d0c9b8c9a1b257 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.252793:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8153134/0x96d0c9b8c9a1b257 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254067:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1788201012.254081:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1b25e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254095:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201012.254099:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1b25e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254109:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1b25e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254129:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1b25e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254136:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1b25e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254182:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1788201012.254187:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4dbdf92/0x96d0c9b8c9a1b265 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254194:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdc800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201012.254197:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4dbdf92/0x96d0c9b8c9a1b265 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254205:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4dbdf92/0x96d0c9b8c9a1b265 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254214:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4dbdf92/0x96d0c9b8c9a1b265 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254221:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4dbdf92/0x96d0c9b8c9a1b265 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254233:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788201012.254237:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b318c7cf/0x96d0c9b8c9a1b26c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254243:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdd800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201012.254247:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b318c7cf/0x96d0c9b8c9a1b26c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254265:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b318c7cf/0x96d0c9b8c9a1b26c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254276:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b318c7cf/0x96d0c9b8c9a1b26c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254283:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b318c7cf/0x96d0c9b8c9a1b26c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254296:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788201012.254300:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070573b83/0x96d0c9b8c9a1b273 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254306:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdce00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201012.254309:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070573b83/0x96d0c9b8c9a1b273 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254317:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070573b83/0x96d0c9b8c9a1b273 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254341:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070573b83/0x96d0c9b8c9a1b273 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254349:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070573b83/0x96d0c9b8c9a1b273 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254376:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788201012.254380:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003efe90ca/0x96d0c9b8c9a1b27a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254387:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdde00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201012.254390:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003efe90ca/0x96d0c9b8c9a1b27a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254397:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003efe90ca/0x96d0c9b8c9a1b27a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254407:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003efe90ca/0x96d0c9b8c9a1b27a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254414:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003efe90ca/0x96d0c9b8c9a1b27a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254425:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788201012.254429:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de3ebfb5/0x96d0c9b8c9a1b281 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254435:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdd400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201012.254438:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de3ebfb5/0x96d0c9b8c9a1b281 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254473:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de3ebfb5/0x96d0c9b8c9a1b281 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254484:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de3ebfb5/0x96d0c9b8c9a1b281 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254491:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de3ebfb5/0x96d0c9b8c9a1b281 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254505:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788201012.254509:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008cd7a6f/0x96d0c9b8c9a1b288 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254516:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdda00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201012.254518:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008cd7a6f/0x96d0c9b8c9a1b288 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254526:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008cd7a6f/0x96d0c9b8c9a1b288 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254536:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008cd7a6f/0x96d0c9b8c9a1b288 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254543:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008cd7a6f/0x96d0c9b8c9a1b288 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254566:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788201012.254570:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e5843d8/0x96d0c9b8c9a1b28f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254577:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdd200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201012.254580:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e5843d8/0x96d0c9b8c9a1b28f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254587:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e5843d8/0x96d0c9b8c9a1b28f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254597:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e5843d8/0x96d0c9b8c9a1b28f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254605:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e5843d8/0x96d0c9b8c9a1b28f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254618:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201012.254622:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec72f47e/0x96d0c9b8c9a1b296 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254628:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdc400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201012.254632:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec72f47e/0x96d0c9b8c9a1b296 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254650:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec72f47e/0x96d0c9b8c9a1b296 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254661:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec72f47e/0x96d0c9b8c9a1b296 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254669:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec72f47e/0x96d0c9b8c9a1b296 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254683:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201012.254687:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b4a355e/0x96d0c9b8c9a1b29d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254693:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdc000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201012.254697:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b4a355e/0x96d0c9b8c9a1b29d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254705:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b4a355e/0x96d0c9b8c9a1b29d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254716:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b4a355e/0x96d0c9b8c9a1b29d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254723:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b4a355e/0x96d0c9b8c9a1b29d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.254749:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201012.254751:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201012.254753:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201012.255168:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x310:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201012.255177:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1b2a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.255192:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x310:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:3.0:1788201012.255197:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x310:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201012.255204:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1b2a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.255218:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1b2a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.255228:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1b2a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.255237:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1b2a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.255263:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201012.255316:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201012.255321:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1b2a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.255340:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201012.255344:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1b2a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.255352:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1b2a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.255365:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1b2a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.255373:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1b2a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201012.255392:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201012.255394:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201012.255395:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201012.257159:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201012.257254:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8153134/0x96d0c9b8c9a1b257 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.257271:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8153134/0x96d0c9b8c9a1b257 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201012.257314:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201012.257316:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201012.257419:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201012.257429:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201012.263442:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x321:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.263463:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1b2ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.263490:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x321:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.263496:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x321:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.263504:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1b2ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.263527:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1b2ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.263561:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1b2ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.263571:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1b2ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.263598:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201012.263614:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.263622:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1b2ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.263630:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0079ac600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.263636:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1b2ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.263647:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1b2ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.263670:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1b2ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.263677:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1b2ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.263705:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.263713:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.263715:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201012.264099:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x320:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.264537:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f5078f9/0x96d0c9b8c9a1b2b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.264552:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x320:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.264556:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x320:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.264831:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f5078f9/0x96d0c9b8c9a1b2b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.264845:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f5078f9/0x96d0c9b8c9a1b2b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.264854:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f5078f9/0x96d0c9b8c9a1b2b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.264862:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f5078f9/0x96d0c9b8c9a1b2b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1788201012.265749:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788201012.265782:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201012.266236:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.266248:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f5078f9/0x96d0c9b8c9a1b2b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266263:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0079ad800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.266269:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f5078f9/0x96d0c9b8c9a1b2b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266300:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f5078f9/0x96d0c9b8c9a1b2b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266326:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f5078f9/0x96d0c9b8c9a1b2b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266334:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f5078f9/0x96d0c9b8c9a1b2b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266364:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.266366:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.266368:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201012.266516:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.266525:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdc8c332/0x96d0c9b8c9a1b2b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266538:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31f:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.266543:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.266550:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdc8c332/0x96d0c9b8c9a1b2b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266569:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdc8c332/0x96d0c9b8c9a1b2b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266579:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdc8c332/0x96d0c9b8c9a1b2b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266594:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdc8c332/0x96d0c9b8c9a1b2b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266616:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201012.266673:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.266679:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3f79d6f/0x96d0c9b8c9a1b2c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266687:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31e:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.266690:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.266694:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3f79d6f/0x96d0c9b8c9a1b2c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266703:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3f79d6f/0x96d0c9b8c9a1b2c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266709:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3f79d6f/0x96d0c9b8c9a1b2c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266716:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3f79d6f/0x96d0c9b8c9a1b2c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266734:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788201012.266742:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201012.266747:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdc8c332/0x96d0c9b8c9a1b2b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266763:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0079ad200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.266767:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdc8c332/0x96d0c9b8c9a1b2b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266775:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdc8c332/0x96d0c9b8c9a1b2b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266787:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdc8c332/0x96d0c9b8c9a1b2b9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266793:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdc8c332/0x96d0c9b8c9a1b2b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266819:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.266822:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3f79d6f/0x96d0c9b8c9a1b2c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266829:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0079ace00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.266832:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3f79d6f/0x96d0c9b8c9a1b2c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266840:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3f79d6f/0x96d0c9b8c9a1b2c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266849:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3f79d6f/0x96d0c9b8c9a1b2c0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266863:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3f79d6f/0x96d0c9b8c9a1b2c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266879:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.266881:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.266884:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.266892:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201012.266941:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.266948:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dbab8df/0x96d0c9b8c9a1b2c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266956:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31d:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.266960:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.266964:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dbab8df/0x96d0c9b8c9a1b2c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266973:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dbab8df/0x96d0c9b8c9a1b2c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266981:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dbab8df/0x96d0c9b8c9a1b2c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.266990:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dbab8df/0x96d0c9b8c9a1b2c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267005:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201012.267041:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.267046:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dbab8df/0x96d0c9b8c9a1b2c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267054:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0079ad000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.267057:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dbab8df/0x96d0c9b8c9a1b2c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267064:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dbab8df/0x96d0c9b8c9a1b2c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267076:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dbab8df/0x96d0c9b8c9a1b2c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267082:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dbab8df/0x96d0c9b8c9a1b2c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267095:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.267097:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.267098:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201012.267233:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.267238:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c001ff0/0x96d0c9b8c9a1b2ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267245:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31c:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.267249:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.267253:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c001ff0/0x96d0c9b8c9a1b2ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267274:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c001ff0/0x96d0c9b8c9a1b2ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267283:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c001ff0/0x96d0c9b8c9a1b2ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267289:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c001ff0/0x96d0c9b8c9a1b2ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267304:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201012.267312:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.267316:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c001ff0/0x96d0c9b8c9a1b2ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267323:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0079ac200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.267326:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c001ff0/0x96d0c9b8c9a1b2ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267333:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c001ff0/0x96d0c9b8c9a1b2ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267343:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c001ff0/0x96d0c9b8c9a1b2ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267350:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c001ff0/0x96d0c9b8c9a1b2ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267370:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.267372:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.267374:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201012.267420:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.267425:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb488efe/0x96d0c9b8c9a1b2d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267433:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31b:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.267436:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.267439:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb488efe/0x96d0c9b8c9a1b2d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267447:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb488efe/0x96d0c9b8c9a1b2d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267454:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb488efe/0x96d0c9b8c9a1b2d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267460:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb488efe/0x96d0c9b8c9a1b2d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267471:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201012.267477:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.267480:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb488efe/0x96d0c9b8c9a1b2d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267499:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.267502:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb488efe/0x96d0c9b8c9a1b2d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267508:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb488efe/0x96d0c9b8c9a1b2d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267518:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb488efe/0x96d0c9b8c9a1b2d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267524:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb488efe/0x96d0c9b8c9a1b2d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267538:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.267539:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.267541:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201012.267588:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.267593:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a8c53b9/0x96d0c9b8c9a1b2dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267600:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31a:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.267603:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.267607:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a8c53b9/0x96d0c9b8c9a1b2dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267615:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a8c53b9/0x96d0c9b8c9a1b2dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267629:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a8c53b9/0x96d0c9b8c9a1b2dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267636:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a8c53b9/0x96d0c9b8c9a1b2dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267650:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201012.267694:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x319:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.267700:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9ce98e9/0x96d0c9b8c9a1b2e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267708:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x319:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.267712:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x319:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.267716:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9ce98e9/0x96d0c9b8c9a1b2e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267726:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9ce98e9/0x96d0c9b8c9a1b2e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267734:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9ce98e9/0x96d0c9b8c9a1b2e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267741:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9ce98e9/0x96d0c9b8c9a1b2e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267766:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788201012.267773:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201012.267776:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a8c53b9/0x96d0c9b8c9a1b2dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267783:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.267786:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a8c53b9/0x96d0c9b8c9a1b2dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267793:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a8c53b9/0x96d0c9b8c9a1b2dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267815:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a8c53b9/0x96d0c9b8c9a1b2dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267822:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a8c53b9/0x96d0c9b8c9a1b2dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267835:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.267838:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9ce98e9/0x96d0c9b8c9a1b2e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267844:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.267847:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9ce98e9/0x96d0c9b8c9a1b2e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267865:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9ce98e9/0x96d0c9b8c9a1b2e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267875:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9ce98e9/0x96d0c9b8c9a1b2e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267881:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9ce98e9/0x96d0c9b8c9a1b2e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267892:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.267893:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.267895:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.267900:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201012.267943:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x318:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.267947:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f793d0a/0x96d0c9b8c9a1b2ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267955:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x318:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.267958:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x318:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.267961:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f793d0a/0x96d0c9b8c9a1b2ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267969:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f793d0a/0x96d0c9b8c9a1b2ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267976:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f793d0a/0x96d0c9b8c9a1b2ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.267990:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f793d0a/0x96d0c9b8c9a1b2ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268002:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201012.268010:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.268013:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f793d0a/0x96d0c9b8c9a1b2ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268044:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.268048:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f793d0a/0x96d0c9b8c9a1b2ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268054:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f793d0a/0x96d0c9b8c9a1b2ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268065:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f793d0a/0x96d0c9b8c9a1b2ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268073:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f793d0a/0x96d0c9b8c9a1b2ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268085:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.268087:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.268089:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201012.268346:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x317:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.268357:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcac13a0/0x96d0c9b8c9a1b2f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268365:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x317:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.268369:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x317:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.268373:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcac13a0/0x96d0c9b8c9a1b2f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268382:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcac13a0/0x96d0c9b8c9a1b2f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268390:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcac13a0/0x96d0c9b8c9a1b2f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268397:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcac13a0/0x96d0c9b8c9a1b2f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268411:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201012.268418:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.268422:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcac13a0/0x96d0c9b8c9a1b2f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268430:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.268433:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcac13a0/0x96d0c9b8c9a1b2f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268441:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcac13a0/0x96d0c9b8c9a1b2f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268458:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcac13a0/0x96d0c9b8c9a1b2f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268466:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcac13a0/0x96d0c9b8c9a1b2f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268496:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.268498:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.268499:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201012.268565:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x316:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.268577:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec17fbbf/0x96d0c9b8c9a1b2f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268585:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x316:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.268589:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x316:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.268593:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec17fbbf/0x96d0c9b8c9a1b2f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268609:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec17fbbf/0x96d0c9b8c9a1b2f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268618:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec17fbbf/0x96d0c9b8c9a1b2f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268633:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec17fbbf/0x96d0c9b8c9a1b2f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268667:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201012.268676:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1788201012.268678:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.268680:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec17fbbf/0x96d0c9b8c9a1b2f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.268691:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4699a99/0x96d0c9b8c9a1b2ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268692:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce9800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.268698:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec17fbbf/0x96d0c9b8c9a1b2f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.268706:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30f:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:0.0:1788201012.268714:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201012.268723:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4699a99/0x96d0c9b8c9a1b2ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268725:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec17fbbf/0x96d0c9b8c9a1b2f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.268746:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4699a99/0x96d0c9b8c9a1b2ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268754:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec17fbbf/0x96d0c9b8c9a1b2f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.268757:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4699a99/0x96d0c9b8c9a1b2ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268774:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec17fbbf/0x96d0c9b8c9a1b2f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268796:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.268810:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.268813:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201012.268859:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4699a99/0x96d0c9b8c9a1b2ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201012.268868:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x315:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201012.268880:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201012.268881:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fa2ed6b/0x96d0c9b8c9a1b306 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268893:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x315:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.268908:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x315:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.268914:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fa2ed6b/0x96d0c9b8c9a1b306 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268931:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fa2ed6b/0x96d0c9b8c9a1b306 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201012.268935:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.268945:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fa2ed6b/0x96d0c9b8c9a1b306 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.268946:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028224086/0x96d0c9b8c9a1b30d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268966:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fa2ed6b/0x96d0c9b8c9a1b306 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.268970:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30e:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:0.0:1788201012.268977:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201012.268982:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028224086/0x96d0c9b8c9a1b30d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.268992:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788201012.268995:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028224086/0x96d0c9b8c9a1b30d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.269006:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028224086/0x96d0c9b8c9a1b30d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.269006:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201012.269037:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4699a99/0x96d0c9b8c9a1b2ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.269046:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140758400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.269050:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4699a99/0x96d0c9b8c9a1b2ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.269057:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4699a99/0x96d0c9b8c9a1b2ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.269075:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4699a99/0x96d0c9b8c9a1b2ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.269093:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4699a99/0x96d0c9b8c9a1b2ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.271368:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.271386:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fa2ed6b/0x96d0c9b8c9a1b306 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.271402:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.271407:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fa2ed6b/0x96d0c9b8c9a1b306 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.271419:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fa2ed6b/0x96d0c9b8c9a1b306 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.271445:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fa2ed6b/0x96d0c9b8c9a1b306 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.271453:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fa2ed6b/0x96d0c9b8c9a1b306 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.271477:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.271480:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.271483:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201012.271651:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x314:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.271659:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028ec3b3c/0x96d0c9b8c9a1b314 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.271693:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x314:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.271698:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x314:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.271706:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028ec3b3c/0x96d0c9b8c9a1b314 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.271720:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028ec3b3c/0x96d0c9b8c9a1b314 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.271728:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028ec3b3c/0x96d0c9b8c9a1b314 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.271735:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028ec3b3c/0x96d0c9b8c9a1b314 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.271764:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201012.271775:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.271779:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028ec3b3c/0x96d0c9b8c9a1b314 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.271786:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce9c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.271789:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028ec3b3c/0x96d0c9b8c9a1b314 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.271796:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028ec3b3c/0x96d0c9b8c9a1b314 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.273473:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028ec3b3c/0x96d0c9b8c9a1b314 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.273482:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028ec3b3c/0x96d0c9b8c9a1b314 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.273512:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.273515:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.273518:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201012.273684:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x313:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.273692:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db328283/0x96d0c9b8c9a1b31b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.273706:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x313:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.273711:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x313:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.273719:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db328283/0x96d0c9b8c9a1b31b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.273732:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db328283/0x96d0c9b8c9a1b31b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.273742:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db328283/0x96d0c9b8c9a1b31b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.273749:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db328283/0x96d0c9b8c9a1b31b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.273781:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201012.273791:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.273797:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db328283/0x96d0c9b8c9a1b31b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.273818:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce9a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.273822:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db328283/0x96d0c9b8c9a1b31b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.273830:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db328283/0x96d0c9b8c9a1b31b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.273841:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db328283/0x96d0c9b8c9a1b31b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.273847:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db328283/0x96d0c9b8c9a1b31b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.273862:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.273864:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.273866:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201012.273904:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028224086/0x96d0c9b8c9a1b30d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201012.273930:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x312:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.273937:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d253a69/0x96d0c9b8c9a1b322 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.273945:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x312:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.273952:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x312:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.273957:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d253a69/0x96d0c9b8c9a1b322 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.273966:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d253a69/0x96d0c9b8c9a1b322 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.273974:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d253a69/0x96d0c9b8c9a1b322 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.273981:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d253a69/0x96d0c9b8c9a1b322 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.273994:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201012.274002:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.274007:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d253a69/0x96d0c9b8c9a1b322 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.274035:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce9200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.274039:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d253a69/0x96d0c9b8c9a1b322 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.274047:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d253a69/0x96d0c9b8c9a1b322 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.274058:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d253a69/0x96d0c9b8c9a1b322 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.274075:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d253a69/0x96d0c9b8c9a1b322 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.274093:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.274096:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028224086/0x96d0c9b8c9a1b30d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274099:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00002000:00010000:0.0:1788201012.274186:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201012.274191:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b75f5ab/0x96d0c9b8c9a1b329 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274201:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30d:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:0.0:1788201012.274204:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201012.274208:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b75f5ab/0x96d0c9b8c9a1b329 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274218:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b75f5ab/0x96d0c9b8c9a1b329 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274238:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b75f5ab/0x96d0c9b8c9a1b329 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274245:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b75f5ab/0x96d0c9b8c9a1b329 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274261:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788201012.274306:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201012.274311:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026b216d1/0x96d0c9b8c9a1b330 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274319:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30c:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:0.0:1788201012.274322:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201012.274326:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026b216d1/0x96d0c9b8c9a1b330 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274336:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026b216d1/0x96d0c9b8c9a1b330 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274344:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026b216d1/0x96d0c9b8c9a1b330 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274351:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026b216d1/0x96d0c9b8c9a1b330 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274371:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788201012.274411:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201012.274416:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d0f7a8f/0x96d0c9b8c9a1b337 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274424:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30b:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:0.0:1788201012.274426:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201012.274430:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d0f7a8f/0x96d0c9b8c9a1b337 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274438:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d0f7a8f/0x96d0c9b8c9a1b337 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274445:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d0f7a8f/0x96d0c9b8c9a1b337 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274452:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d0f7a8f/0x96d0c9b8c9a1b337 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274459:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788201012.274495:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201012.274500:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c3c003a/0x96d0c9b8c9a1b33e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274507:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30a:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:0.0:1788201012.274515:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201012.274519:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c3c003a/0x96d0c9b8c9a1b33e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274529:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c3c003a/0x96d0c9b8c9a1b33e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274536:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c3c003a/0x96d0c9b8c9a1b33e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274543:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c3c003a/0x96d0c9b8c9a1b33e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274552:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788201012.274592:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x309:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201012.274597:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000669d6cf6/0x96d0c9b8c9a1b345 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274605:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x309:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:0.0:1788201012.274608:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x309:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201012.274612:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000669d6cf6/0x96d0c9b8c9a1b345 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274621:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000669d6cf6/0x96d0c9b8c9a1b345 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274629:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000669d6cf6/0x96d0c9b8c9a1b345 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274643:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000669d6cf6/0x96d0c9b8c9a1b345 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274652:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788201012.274694:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x308:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201012.274699:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bb224c1/0x96d0c9b8c9a1b34c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274708:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x308:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:0.0:1788201012.274711:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x308:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201012.274715:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bb224c1/0x96d0c9b8c9a1b34c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274723:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bb224c1/0x96d0c9b8c9a1b34c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274731:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bb224c1/0x96d0c9b8c9a1b34c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274739:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bb224c1/0x96d0c9b8c9a1b34c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.274748:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1788201012.275127:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x307:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201012.275134:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054dc1ce6/0x96d0c9b8c9a1b353 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275149:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x307:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:0.0:1788201012.275152:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x307:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201012.275157:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054dc1ce6/0x96d0c9b8c9a1b353 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275166:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054dc1ce6/0x96d0c9b8c9a1b353 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275173:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054dc1ce6/0x96d0c9b8c9a1b353 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275181:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054dc1ce6/0x96d0c9b8c9a1b353 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275189:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1788201012.275231:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x306:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201012.275236:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006849ec2c/0x96d0c9b8c9a1b35a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275243:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x306:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:0.0:1788201012.275245:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x306:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201012.275249:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006849ec2c/0x96d0c9b8c9a1b35a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275257:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006849ec2c/0x96d0c9b8c9a1b35a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275274:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006849ec2c/0x96d0c9b8c9a1b35a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275280:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006849ec2c/0x96d0c9b8c9a1b35a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275289:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1788201012.275332:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x305:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201012.275337:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4377764/0x96d0c9b8c9a1b361 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275345:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x305:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:0.0:1788201012.275348:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x305:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201012.275352:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4377764/0x96d0c9b8c9a1b361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275360:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4377764/0x96d0c9b8c9a1b361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275368:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4377764/0x96d0c9b8c9a1b361 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275375:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4377764/0x96d0c9b8c9a1b361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275396:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:0.0:1788201012.275437:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x304:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201012.275441:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1b368 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275449:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x304:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:0.0:1788201012.275452:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x304:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201012.275456:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1b368 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275465:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1b368 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275472:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1b368 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275479:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1b368 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275487:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:0.0:1788201012.275522:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x303:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201012.275526:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081855616/0x96d0c9b8c9a1b36f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275534:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x303:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:0.0:1788201012.275543:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x303:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201012.275548:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081855616/0x96d0c9b8c9a1b36f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275558:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081855616/0x96d0c9b8c9a1b36f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275566:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081855616/0x96d0c9b8c9a1b36f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275573:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081855616/0x96d0c9b8c9a1b36f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275582:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:0.0:1788201012.275623:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x302:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201012.275628:0:26203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1b376 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275636:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x302:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:0.0:1788201012.275639:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x302:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201012.275642:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1b376 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275650:0:26203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1b376 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275657:0:26203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1b376 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275671:0:26203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1b376 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.275680:0:26203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00010000:00010000:1.0:1788201012.275767:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140759e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.275773:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028224086/0x96d0c9b8c9a1b30d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.275785:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028224086/0x96d0c9b8c9a1b30d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.275815:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028224086/0x96d0c9b8c9a1b30d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.275823:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028224086/0x96d0c9b8c9a1b30d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.275843:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:1.0:1788201012.275848:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b75f5ab/0x96d0c9b8c9a1b329 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.275854:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140759400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.275864:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b75f5ab/0x96d0c9b8c9a1b329 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.275872:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b75f5ab/0x96d0c9b8c9a1b329 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.275881:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b75f5ab/0x96d0c9b8c9a1b329 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.275889:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b75f5ab/0x96d0c9b8c9a1b329 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.275916:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:1.0:1788201012.275920:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026b216d1/0x96d0c9b8c9a1b330 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.275926:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140758000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.275929:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026b216d1/0x96d0c9b8c9a1b330 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.275936:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026b216d1/0x96d0c9b8c9a1b330 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.275945:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026b216d1/0x96d0c9b8c9a1b330 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.275952:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026b216d1/0x96d0c9b8c9a1b330 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.275973:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:1.0:1788201012.275976:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d0f7a8f/0x96d0c9b8c9a1b337 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.275982:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140758600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.275985:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d0f7a8f/0x96d0c9b8c9a1b337 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.275991:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d0f7a8f/0x96d0c9b8c9a1b337 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276001:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d0f7a8f/0x96d0c9b8c9a1b337 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276008:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d0f7a8f/0x96d0c9b8c9a1b337 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276055:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1788201012.276059:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c3c003a/0x96d0c9b8c9a1b33e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276066:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140758200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.276070:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c3c003a/0x96d0c9b8c9a1b33e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276088:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c3c003a/0x96d0c9b8c9a1b33e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276099:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c3c003a/0x96d0c9b8c9a1b33e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276120:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c3c003a/0x96d0c9b8c9a1b33e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276136:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788201012.276139:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000669d6cf6/0x96d0c9b8c9a1b345 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276145:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140758800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.276148:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000669d6cf6/0x96d0c9b8c9a1b345 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276155:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000669d6cf6/0x96d0c9b8c9a1b345 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276164:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000669d6cf6/0x96d0c9b8c9a1b345 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276171:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000669d6cf6/0x96d0c9b8c9a1b345 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276195:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788201012.276198:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bb224c1/0x96d0c9b8c9a1b34c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276204:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140759200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.276207:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bb224c1/0x96d0c9b8c9a1b34c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276214:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bb224c1/0x96d0c9b8c9a1b34c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276224:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bb224c1/0x96d0c9b8c9a1b34c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276230:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bb224c1/0x96d0c9b8c9a1b34c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276242:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788201012.276245:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054dc1ce6/0x96d0c9b8c9a1b353 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276251:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140759800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.276255:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054dc1ce6/0x96d0c9b8c9a1b353 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276272:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054dc1ce6/0x96d0c9b8c9a1b353 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276284:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054dc1ce6/0x96d0c9b8c9a1b353 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276300:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054dc1ce6/0x96d0c9b8c9a1b353 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276315:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788201012.276319:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006849ec2c/0x96d0c9b8c9a1b35a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276325:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140758e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.276328:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006849ec2c/0x96d0c9b8c9a1b35a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276336:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006849ec2c/0x96d0c9b8c9a1b35a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276345:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006849ec2c/0x96d0c9b8c9a1b35a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276352:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006849ec2c/0x96d0c9b8c9a1b35a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276395:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788201012.276399:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4377764/0x96d0c9b8c9a1b361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276406:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.276409:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4377764/0x96d0c9b8c9a1b361 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276416:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4377764/0x96d0c9b8c9a1b361 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276425:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4377764/0x96d0c9b8c9a1b361 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276432:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4377764/0x96d0c9b8c9a1b361 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276442:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201012.276445:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1b368 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276450:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f338400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.276454:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1b368 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276472:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1b368 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276482:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1b368 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276489:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1b368 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276502:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201012.276505:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081855616/0x96d0c9b8c9a1b36f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276511:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.276515:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081855616/0x96d0c9b8c9a1b36f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276522:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081855616/0x96d0c9b8c9a1b36f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276531:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081855616/0x96d0c9b8c9a1b36f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276539:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081855616/0x96d0c9b8c9a1b36f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276562:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.276565:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1b376 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276572:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.276575:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1b376 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276582:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1b376 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276593:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1b376 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276600:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1b376 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276612:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.276614:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.276616:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.276628:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.276635:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201012.276737:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x311:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.276743:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1df5e04/0x96d0c9b8c9a1b37d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276766:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x311:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.276770:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x311:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.276777:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1df5e04/0x96d0c9b8c9a1b37d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276788:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1df5e04/0x96d0c9b8c9a1b37d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276796:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1df5e04/0x96d0c9b8c9a1b37d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276814:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1df5e04/0x96d0c9b8c9a1b37d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276834:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201012.276843:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.276848:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1df5e04/0x96d0c9b8c9a1b37d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276854:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.276857:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1df5e04/0x96d0c9b8c9a1b37d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276865:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1df5e04/0x96d0c9b8c9a1b37d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276887:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1df5e04/0x96d0c9b8c9a1b37d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276895:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1df5e04/0x96d0c9b8c9a1b37d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276912:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.276914:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.276917:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201012.276962:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x310:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.276968:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056f7773b/0x96d0c9b8c9a1b384 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276976:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x310:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.276979:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x310:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.276983:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056f7773b/0x96d0c9b8c9a1b384 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.276992:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056f7773b/0x96d0c9b8c9a1b384 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277000:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056f7773b/0x96d0c9b8c9a1b384 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277008:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056f7773b/0x96d0c9b8c9a1b384 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277060:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201012.277068:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.277072:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056f7773b/0x96d0c9b8c9a1b384 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277080:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce8e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.277085:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056f7773b/0x96d0c9b8c9a1b384 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277092:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056f7773b/0x96d0c9b8c9a1b384 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277103:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056f7773b/0x96d0c9b8c9a1b384 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277110:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056f7773b/0x96d0c9b8c9a1b384 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277123:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.277125:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.277127:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201012.277174:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.277179:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b668b7cd/0x96d0c9b8c9a1b38b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277187:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30f:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.277195:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.277198:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b668b7cd/0x96d0c9b8c9a1b38b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277207:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b668b7cd/0x96d0c9b8c9a1b38b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277215:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b668b7cd/0x96d0c9b8c9a1b38b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277222:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b668b7cd/0x96d0c9b8c9a1b38b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277235:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201012.277242:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.277246:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b668b7cd/0x96d0c9b8c9a1b38b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277254:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce9400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.277258:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b668b7cd/0x96d0c9b8c9a1b38b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277265:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b668b7cd/0x96d0c9b8c9a1b38b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277275:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b668b7cd/0x96d0c9b8c9a1b38b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277293:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b668b7cd/0x96d0c9b8c9a1b38b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277309:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.277310:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.277312:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201012.277357:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.277363:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061ba0848/0x96d0c9b8c9a1b392 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277371:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30e:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.277374:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.277377:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061ba0848/0x96d0c9b8c9a1b392 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277387:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061ba0848/0x96d0c9b8c9a1b392 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277395:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061ba0848/0x96d0c9b8c9a1b392 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277403:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061ba0848/0x96d0c9b8c9a1b392 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277417:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201012.277432:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.277435:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061ba0848/0x96d0c9b8c9a1b392 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277441:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce9600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.277445:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061ba0848/0x96d0c9b8c9a1b392 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277453:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061ba0848/0x96d0c9b8c9a1b392 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277464:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061ba0848/0x96d0c9b8c9a1b392 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277471:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061ba0848/0x96d0c9b8c9a1b392 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277485:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.277487:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.277488:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201012.277528:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.277533:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049ab2300/0x96d0c9b8c9a1b399 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277541:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30d:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.277544:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.277548:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049ab2300/0x96d0c9b8c9a1b399 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277568:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049ab2300/0x96d0c9b8c9a1b399 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277576:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049ab2300/0x96d0c9b8c9a1b399 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277584:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049ab2300/0x96d0c9b8c9a1b399 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277595:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201012.277602:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.277605:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049ab2300/0x96d0c9b8c9a1b399 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277612:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce9e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.277616:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049ab2300/0x96d0c9b8c9a1b399 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277624:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049ab2300/0x96d0c9b8c9a1b399 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277635:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049ab2300/0x96d0c9b8c9a1b399 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277643:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049ab2300/0x96d0c9b8c9a1b399 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277663:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.277665:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.277667:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201012.277718:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.277725:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fca8c909/0x96d0c9b8c9a1b3a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277734:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30c:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.277737:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.277743:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fca8c909/0x96d0c9b8c9a1b3a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277754:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fca8c909/0x96d0c9b8c9a1b3a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277764:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fca8c909/0x96d0c9b8c9a1b3a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277773:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fca8c909/0x96d0c9b8c9a1b3a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.277784:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201012.277789:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.277792:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fca8c909/0x96d0c9b8c9a1b3a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.278432:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ce9000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.278437:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fca8c909/0x96d0c9b8c9a1b3a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.278445:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fca8c909/0x96d0c9b8c9a1b3a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.278458:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fca8c909/0x96d0c9b8c9a1b3a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.278465:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fca8c909/0x96d0c9b8c9a1b3a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.278483:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.278485:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.278487:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788201012.279347:0:26203:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:674 00002000:00010000:1.0:1788201012.279465:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.279474:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1b3a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201012.279486:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:89131:x1875060715115264:12345-0@lo:5:osp-pre-1-0.0 Request processed in 42257us (42854us total) trans 0 rc 0/0 00010000:00010000:1.0:1788201012.279491:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30b:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.279499:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30b:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1788201012.279502:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5879 00010000:00010000:1.0:1788201012.279509:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1b3a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.279524:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1b3a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.279542:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1b3a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.279550:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1b3a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.279571:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201012.279581:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.279586:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1b3a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.279594:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0079ac600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.279598:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1b3a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.279607:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1b3a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.279622:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1b3a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.279629:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e975dbdb/0x96d0c9b8c9a1b3a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.279649:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.279658:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.279661:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201012.279722:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.279728:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004194fab/0x96d0c9b8c9a1b3ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.279735:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30a:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.279739:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.279742:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004194fab/0x96d0c9b8c9a1b3ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.279752:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004194fab/0x96d0c9b8c9a1b3ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.279760:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004194fab/0x96d0c9b8c9a1b3ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.279767:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004194fab/0x96d0c9b8c9a1b3ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.279781:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201012.279789:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.279792:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004194fab/0x96d0c9b8c9a1b3ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.279817:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2c400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.279820:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004194fab/0x96d0c9b8c9a1b3ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.279838:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004194fab/0x96d0c9b8c9a1b3ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.279848:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004194fab/0x96d0c9b8c9a1b3ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.279855:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004194fab/0x96d0c9b8c9a1b3ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.279867:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.279868:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.279870:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201012.279916:0:89131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc139ba3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89131:1875060715115264:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788201012.279941:0:89131:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x321:0x0] from OST, last_created [0x2c0000401:0x321:0x0]last_used is [0x2c0000401:0x2a2:0x0] 00000100:00100000:0.0:1788201012.280056:0:89131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d57480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89131:1875060715115520:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788201012.280108:0:89131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201012.280138:0:89131:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0010eba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201012.280158:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715115392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201012.280187:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1788201012.280196:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x309:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.280204:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1b3b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.280213:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x309:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.280217:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x309:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.280222:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1b3b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.280232:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1b3b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201012.280241:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715115520 00010000:00010000:1.0:1788201012.280241:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1b3b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201012.280250:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715115520 00010000:00010000:1.0:1788201012.280259:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1b3b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.280275:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201012.280284:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788201012.280303:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5880 00000100:00100000:0.0:1788201012.280313:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140fa0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:89131:x1875060715115520:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788201012.280360:0:8446:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 802 00010000:00010000:1.0:1788201012.281373:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1b3b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.281388:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2dc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.281398:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1b3b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.281409:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1b3b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.281435:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1b3b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.281443:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009771f232/0x96d0c9b8c9a1b3b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.281475:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.281478:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.281487:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201012.281619:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x308:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.281635:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1b3bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.281655:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x308:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.281660:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x308:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.281667:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1b3bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.281679:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1b3bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.281689:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1b3bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.281697:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1b3bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.281721:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201012.281730:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.281735:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1b3bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.281743:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2d600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.281747:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1b3bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.281755:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1b3bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.281775:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1b3bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.281784:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f45cba1/0x96d0c9b8c9a1b3bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.281812:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.281815:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.281817:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201012.281875:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x307:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.281881:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cb75e62/0x96d0c9b8c9a1b3c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.281889:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x307:0x0].0x0 since=3863s v=(0 0) 00000100:00100000:0.0:1788201012.282111:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715115392 00000100:00100000:0.0:1788201012.282121:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715115392 00000100:00100000:0.0:1788201012.282182:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2184 00000100:00100000:0.0:1788201012.282191:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3656:x1875060715115392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201012.282225:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 896 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201012.282322:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3656:x1875060715115392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (2132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201012.282330:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2184 00000100:00100000:0.0:1788201012.282405:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715115392:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788201012.282459:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.283203:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x307:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.283223:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009cb75e62/0x96d0c9b8c9a1b3c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283241:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009cb75e62/0x96d0c9b8c9a1b3c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283254:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cb75e62/0x96d0c9b8c9a1b3c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283262:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009cb75e62/0x96d0c9b8c9a1b3c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283379:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201012.283489:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x306:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.283496:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1b3ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283506:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x306:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.283510:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x306:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.283514:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1b3ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283522:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1b3ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283529:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1b3ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283536:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1b3ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283555:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788201012.283571:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201012.283577:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009cb75e62/0x96d0c9b8c9a1b3c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283585:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2de00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.283595:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009cb75e62/0x96d0c9b8c9a1b3c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283605:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009cb75e62/0x96d0c9b8c9a1b3c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283623:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009cb75e62/0x96d0c9b8c9a1b3c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283630:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009cb75e62/0x96d0c9b8c9a1b3c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283655:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.283658:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1b3ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283664:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2d800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.283667:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1b3ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283674:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1b3ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283683:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1b3ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283690:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1fd6737/0x96d0c9b8c9a1b3ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283711:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.283713:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.283715:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201012.283763:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x305:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.283768:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000154502bb/0x96d0c9b8c9a1b3d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283776:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x305:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.283779:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x305:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.283783:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000154502bb/0x96d0c9b8c9a1b3d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283791:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000154502bb/0x96d0c9b8c9a1b3d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283811:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000154502bb/0x96d0c9b8c9a1b3d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283818:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000154502bb/0x96d0c9b8c9a1b3d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283832:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201012.283840:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.283844:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000154502bb/0x96d0c9b8c9a1b3d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283863:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2da00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.283866:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000154502bb/0x96d0c9b8c9a1b3d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283873:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000154502bb/0x96d0c9b8c9a1b3d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283883:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000154502bb/0x96d0c9b8c9a1b3d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283890:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000154502bb/0x96d0c9b8c9a1b3d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283902:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.283904:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.283905:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201012.283954:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x304:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.283961:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f5d0ebe/0x96d0c9b8c9a1b3d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283970:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x304:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.283973:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x304:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.283978:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f5d0ebe/0x96d0c9b8c9a1b3d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.283987:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f5d0ebe/0x96d0c9b8c9a1b3d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.284001:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f5d0ebe/0x96d0c9b8c9a1b3d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.284007:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f5d0ebe/0x96d0c9b8c9a1b3d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.284049:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201012.284058:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.284063:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f5d0ebe/0x96d0c9b8c9a1b3d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.284070:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2c800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.284074:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f5d0ebe/0x96d0c9b8c9a1b3d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.284081:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f5d0ebe/0x96d0c9b8c9a1b3d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.284093:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f5d0ebe/0x96d0c9b8c9a1b3d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.284100:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f5d0ebe/0x96d0c9b8c9a1b3d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.285369:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.285388:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.285391:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201012.285512:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x303:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.285521:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1b3df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.285536:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x303:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.285541:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x303:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.285548:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1b3df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.285561:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1b3df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.285571:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1b3df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.285578:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1b3df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.285603:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201012.285613:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201012.285618:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1b3df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.285626:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2cc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201012.285630:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1b3df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.285650:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1b3df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.285669:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1b3df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.285676:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004eb43efb/0x96d0c9b8c9a1b3df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.285692:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.285693:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.285696:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201012.285745:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x302:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201012.285751:0:26199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1b3e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.285760:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x302:0x0].0x0 since=3863s v=(0 0) 00010000:00010000:1.0:1788201012.285763:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x302:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201012.285766:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1b3e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.285776:0:26199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1b3e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.285784:0:26199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1b3e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.287125:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201012.287739:0:26199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1b3e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201012.287791:0:26199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201012.288413:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201012.288425:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1b3e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.288437:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2ce00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201012.288444:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1b3e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.288457:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1b3e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.288483:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1b3e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.288493:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000273a8a5/0x96d0c9b8c9a1b3e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201012.288527:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201012.288530:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201012.288540:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788201012.292756:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00080000:1.0:1788201012.294779:0:26199:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:176 00000100:00100000:1.0:1788201012.294927:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:89129:x1875060715115136:12345-0@lo:5:osp-pre-0-0.0 Request processed in 58153us (58420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201012.294941:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5878 00000100:00100000:1.0:1788201012.295047:0:89129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89129:1875060715115136:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788201012.295070:0:89129:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x321:0x0] from OST, last_created [0x280000401:0x321:0x0]last_used is [0x280000401:0xb0:0x0] 00000100:00100000:1.0:1788201012.296068:0:89129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140297b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89129:1875060715115776:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788201012.296154:0:89129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201012.296189:0:89129:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f4e540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201012.296219:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715115648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201012.296249:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201012.296371:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715115776 00000100:00100000:1.0:1788201012.296379:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715115776 00000100:00100000:1.0:1788201012.296447:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5881 00000100:00100000:1.0:1788201012.296459:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:89129:x1875060715115776:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788201012.296513:0:8448:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 802 00000100:00100000:1.0:1788201012.299864:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:89129:x1875060715115776:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3394us (3698us total) trans 4294969451 rc 0/0 00000100:00100000:1.0:1788201012.299880:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5881 00000100:00100000:1.0:1788201012.300587:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715115648 00000100:00100000:1.0:1788201012.300613:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715115648 00000100:00100000:1.0:1788201012.300693:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2185 00000100:00100000:1.0:1788201012.300706:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140295880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715115648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201012.300738:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201012.300820:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140295880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715115648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (4569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201012.300827:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2185 00000100:00100000:1.0:1788201012.300890:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715115648:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788201012.301085:0:9526:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969451 is committed 00000100:00100000:1.0:1788201012.301087:0:89129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140297b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:89129:1875060715115776:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788201012.301179:0:89129:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x321:0x0]-[0x280000401:0x341:0x0] 00000100:00100000:3.0:1788201012.301266:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140fa0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:89131:x1875060715115520:12345-0@lo:5:osp-pre-1-0.0 Request processed in 20953us (21157us total) trans 4294969451 rc 0/0 00000100:00100000:3.0:1788201012.301275:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5880 00000100:00100000:1.0:1788201012.301418:0:89131:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 2 00000100:00100000:1.0:1788201012.301426:0:89131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d57480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:89131:1875060715115520:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788201012.301439:0:89131:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x321:0x0]-[0x2c0000401:0x341:0x0] 00000001:00100000:1.0:1788201012.560463:0:75739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788201012.693204:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201012.693268:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201012.693327:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695363328 00000100:00100000:1.0:1788201012.693344:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695363328 00000100:00100000:1.0:1788201012.693438:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 73 00000100:00100000:0.0:1788201012.693441:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695363456 00000100:00100000:0.0:1788201012.693446:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695363456 00000100:00100000:1.0:1788201012.693451:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695363328:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201012.693519:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1240 00000100:00100000:0.0:1788201012.693526:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695363456:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201012.693551:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695363328:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 103us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201012.693561:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695363456:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 36us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201012.693568:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1240 00000100:00100000:1.0:1788201012.693570:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 73 00010000:00010000:3.0:1788201013.012476:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201013.232524:0:89397:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788201014.033410:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788201014.506231:0:89449:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788201014.506490:0:89449:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788201014.607224:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715115904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201014.607339:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201014.607461:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715115904 00000100:00100000:0.0:1788201014.607475:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715115904 00000100:00100000:0.0:1788201014.607565:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2186 00000100:00100000:0.0:1788201014.607580:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140296d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715115904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201014.607621:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201014.607682:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140296d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715115904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201014.607691:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2186 00000100:00080000:1.0:1788201014.607817:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201014.607871:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715115904:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201014.608181:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715116032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201014.608222:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201014.608292:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715116032 00000100:00100000:1.0:1788201014.608298:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715116032 00000100:00100000:1.0:1788201014.608336:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2187 00000100:00100000:1.0:1788201014.608347:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715116032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201014.608367:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788201014.609857:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201014.610081:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715116032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1730us (1851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201014.610094:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2187 00000100:00100000:0.0:1788201014.610280:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715116032:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788201015.060175:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788201015.792391:0:89500:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788201015.792798:0:89500:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788201016.080086:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201017.105069:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201017.167327:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201017.167363:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715116160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201017.167480:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201017.167530:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00586c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715116544:0@lo:400:kworker.0 00000100:00100000:2.0:1788201017.167570:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201017.167596:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715117056:0@lo:400:kworker.0 00000100:00100000:3.0:1788201017.167601:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715116544 00000100:00100000:3.0:1788201017.167612:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715116544 00000100:00100000:3.0:1788201017.167684:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:3.0:1788201017.167697:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715116544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201017.167794:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715116288:0@lo:400:kworker.0 00000100:00100000:1.0:1788201017.167820:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715116672:0@lo:400:kworker.0 00000100:00100000:3.0:1788201017.167989:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715116544:12345-0@lo:400:kworker.0 Request processed in 294us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201017.168000:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00080000:3.0:1788201017.168059:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201017.168093:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715116160 00000100:00100000:3.0:1788201017.168097:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715116160 00000100:00100000:2.0:1788201017.168102:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201017.168134:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3900 00000100:00100000:2.0:1788201017.168139:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715117568:0@lo:400:kworker.0 00000100:00100000:3.0:1788201017.168147:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715116160:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201017.168171:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:3.0:1788201017.168183:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:2.0:1788201017.168216:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00586c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715116544:0@lo:400:kworker.0 00000100:00100000:3.0:1788201017.168229:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715116160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201017.168237:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3900 00000100:00100000:2.0:1788201017.168241:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715116160:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201017.168282:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715117056 00000100:00100000:3.0:1788201017.168287:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715117056 00000100:00100000:2.0:1788201017.168300:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715117568 00000100:00100000:2.0:1788201017.168306:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715117568 00000100:00100000:3.0:1788201017.168331:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2694 00000100:00100000:3.0:1788201017.168341:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715117056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201017.168349:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2695 00000100:00100000:2.0:1788201017.168361:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715117568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201017.168388:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715117056:12345-0@lo:400:kworker.0 Request processed in 48us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201017.168396:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2694 00000100:00080000:3.0:1788201017.168435:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201017.168438:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201017.168465:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715117568:0@lo:400:kworker.0 00000100:00100000:3.0:1788201017.168477:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715117056:0@lo:400:kworker.0 00000100:00100000:3.0:1788201017.170047:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00586d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715116416:0@lo:400:kworker.0 00000100:00100000:3.0:1788201017.170364:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201017.170414:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715116928:0@lo:400:kworker.0 00000100:00100000:3.0:1788201017.170448:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201017.170467:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715117440:0@lo:400:kworker.0 00000100:00100000:3.0:1788201017.170493:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201017.171462:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715116416 00000100:00100000:3.0:1788201017.171476:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715116416 00000100:00100000:0.0:1788201017.171687:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201017.171746:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715116800:0@lo:400:kworker.0 00000100:00100000:0.0:1788201017.171781:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201017.171803:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715117312:0@lo:400:kworker.0 00000100:00100000:0.0:1788201017.171826:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201017.171882:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715116800 00000100:00100000:0.0:1788201017.171886:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715116800 00000100:00100000:3.0:1788201017.172173:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715117312 00000100:00100000:3.0:1788201017.172177:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715117312 00000100:00100000:3.0:1788201017.172203:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:3.0:1788201017.172214:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715116416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201017.172296:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715116416:12345-0@lo:400:kworker.0 Request processed in 84us (1934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201017.172304:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000100:00100000:3.0:1788201017.172325:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00100000:3.0:1788201017.172331:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715117312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201017.172365:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715117312:12345-0@lo:400:kworker.0 Request processed in 34us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201017.172371:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00100000:0.0:1788201017.172461:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:0.0:1788201017.172468:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715116800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201017.172515:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715116800:12345-0@lo:400:kworker.0 Request processed in 35us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201017.172521:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:0.0:1788201017.172777:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715116800:0@lo:400:kworker.0 00000100:00100000:0.0:1788201017.172792:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715117312:0@lo:400:kworker.0 00000100:00100000:0.0:1788201017.172857:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715117440 00000100:00100000:0.0:1788201017.172862:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715117440 00000100:00100000:0.0:1788201017.172900:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2696 00000100:00100000:0.0:1788201017.172907:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715117440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201017.172948:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715117440:12345-0@lo:400:kworker.0 Request processed in 42us (2454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201017.172954:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2696 00000100:00100000:0.0:1788201017.172986:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715116288 00000100:00100000:0.0:1788201017.172990:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715116288 00000100:00100000:0.0:1788201017.173042:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788201017.173050:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715116288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201017.173087:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715116288:12345-0@lo:400:kworker.0 Request processed in 39us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201017.173094:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788201017.173131:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715116288:0@lo:400:kworker.0 00000100:00100000:0.0:1788201017.173203:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00586d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715116416:0@lo:400:kworker.0 00000100:00100000:0.0:1788201017.173244:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715117440:0@lo:400:kworker.0 00000100:00100000:0.0:1788201017.173347:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715116928 00000100:00100000:0.0:1788201017.173352:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715116928 00000100:00100000:0.0:1788201017.173393:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3901 00000100:00100000:0.0:1788201017.173402:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715116928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201017.173446:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715116928:12345-0@lo:400:kworker.0 Request processed in 46us (2997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201017.173452:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3901 00000100:00100000:0.0:1788201017.173479:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715116928:0@lo:400:kworker.0 00000100:00100000:1.0:1788201017.173883:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201017.173934:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cb52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715117184:0@lo:400:kworker.0 00000100:00100000:0.0:1788201017.173989:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715116672 00000100:00100000:0.0:1788201017.173994:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715116672 00000100:00100000:0.0:1788201017.174048:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:0.0:1788201017.174056:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715116672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201017.174097:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715116672:12345-0@lo:400:kworker.0 Request processed in 42us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201017.174103:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00080000:3.0:1788201017.175694:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201017.175709:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201017.175748:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201017.176564:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715117568:12345-0@lo:400:kworker.0 Request processed in 8196us (8382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201017.176582:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2695 00000100:00100000:1.0:1788201017.180646:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201017.180739:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715117696:0@lo:400:kworker.0 00000100:00100000:1.0:1788201017.180796:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201017.180875:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715116672:0@lo:400:kworker.0 00000100:00100000:0.0:1788201017.181692:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715117696 00000100:00100000:0.0:1788201017.181705:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715117696 00000100:00100000:0.0:1788201017.181796:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:0.0:1788201017.181808:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715117696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201017.181913:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715117696:12345-0@lo:400:kworker.0 Request processed in 107us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201017.181922:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00100000:1.0:1788201017.182155:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715117696:0@lo:400:kworker.0 00000100:00100000:2.0:1788201017.183083:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715117184 00000100:00100000:2.0:1788201017.183095:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715117184 00000100:00100000:2.0:1788201017.183179:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2697 00000100:00100000:2.0:1788201017.183190:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715117184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201017.183287:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715117184:12345-0@lo:400:kworker.0 Request processed in 100us (2655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201017.183295:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2697 00000100:00100000:0.0:1788201017.183397:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cb52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715117184:0@lo:400:kworker.0 00000100:00080000:3.0:1788201017.183475:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201017.680992:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715117824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201017.681129:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201017.681250:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201017.681264:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715117952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201017.681300:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201017.681628:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715117824 00000100:00100000:1.0:1788201017.681641:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715117824 00000100:00100000:3.0:1788201017.681660:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715117952 00000100:00100000:3.0:1788201017.681673:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715117952 00000100:00100000:1.0:1788201017.681735:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2188 00000100:00100000:1.0:1788201017.681827:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715117824:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201017.681827:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2189 00000100:00100000:3.0:1788201017.681842:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715117952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201017.681881:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1788201017.681881:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201017.681974:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715117952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201017.681981:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2189 00000100:00100000:2.0:1788201017.682155:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715118080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201017.682223:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201017.682282:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715118080 00000100:00100000:2.0:1788201017.682288:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715118080 00000100:00100000:1.0:1788201017.682300:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715117824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 490us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201017.682311:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2188 00000100:00100000:2.0:1788201017.682333:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3902 00000100:00100000:2.0:1788201017.682343:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715118080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201017.682376:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2174976 pending 28672 free 1444966400 avail 1298726912 00000100:00100000:2.0:1788201017.682425:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715118080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201017.682431:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3902 00000100:00100000:1.0:1788201017.682839:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715118080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201017.689391:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715117952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201017.689449:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715117824:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788201017.690152:0:89112:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149697 is committed 00000100:00100000:3.0:1788201017.753471:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201017.753766:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695363584 00000100:00100000:0.0:1788201017.753782:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695363584 00000100:00100000:0.0:1788201017.753903:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1223 00000100:00100000:0.0:1788201017.753917:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+7:68272:x1875060695363584:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788201017.753955:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201017.753989:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339800/0x96d0c9b8c9a1b3ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786642 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201017.754140:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b3f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201017.754159:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201017.754176:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788201017.754283:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1788201017.754358:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201017.754362:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201017.754419:0:66312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201017.754453:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339800/0x96d0c9b8c9a1b3ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786642 expref: 9 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201017.754687:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b3f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786642 expref: 8 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201017.754698:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a1b700) 00010000:00010000:0.0:1788201017.754701:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201017.754717:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12f338600, rc 0) 00000100:00100000:0.0:1788201017.754851:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+8:68272:x1875060695363584:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 936us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201017.754860:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1223 00000100:00100000:3.0:1788201017.759344:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201017.759561:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695363712 00000100:00100000:1.0:1788201017.759575:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695363712 00000100:00100000:1.0:1788201017.759660:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1224 00000100:00100000:1.0:1788201017.759672:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+8:68272:x1875060695363712:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:1.0:1788201017.759724:0:66314:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444966400 avail 1298726912 00000100:00100000:1.0:1788201017.759820:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+8:68272:x1875060695363712:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 149us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201017.759828:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1224 00000100:00100000:0.0:1788201017.764082:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201017.764311:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695363840 00000100:00100000:3.0:1788201017.764325:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695363840 00000100:00100000:3.0:1788201017.764435:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1225 00000100:00100000:3.0:1788201017.764448:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+6:68272:x1875060695363840:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:3.0:1788201017.764501:0:69485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:3.0:1788201017.764594:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+6:68272:x1875060695363840:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 149us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201017.764603:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1225 00000100:00080000:0.0:1788201017.765220:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201017.768672:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201017.768822:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695363968 00000100:00100000:1.0:1788201017.768836:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695363968 00000100:00100000:1.0:1788201017.768901:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5882 00000100:00100000:1.0:1788201017.768913:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:2399:x1875060695363968:12345-192.168.201.20@tcp:8:lfs.0 00010000:00080000:1.0:1788201017.768962:0:26208:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp t0 exp 0000000000000000 cur 3869 last 0 00000020:00000080:1.0:1788201017.769003:0:26208:0:(genops.c:1385:class_connect()) connect: client 4292087e-fa00-4621-b681-837afc99ae35, cookie 0x96d0c9b8c9a1b3fb 00002000:00100000:1.0:1788201017.769068:0:26208:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4292087e-fa00-4621-b681-837afc99ae35/ffff8dc0078db800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788201017.769084:0:26208:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788201017.769189:0:26208:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788201017.769231:0:26208:0:(import.c:65:import_set_state_nolock()) ffff8dc0078dc800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201017.769323:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:4292087e-fa00-4621-b681-837afc99ae35+6:2399:x1875060695363968:12345-192.168.201.20@tcp:8:lfs.0 Request processed in 410us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201017.769332:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5882 00000100:00100000:3.0:1788201017.773079:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201017.773347:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695364096 00000100:00100000:1.0:1788201017.773362:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695364096 00000100:00100000:1.0:1788201017.773456:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2190 00000100:00080000:0.0:1788201017.773550:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201017.773587:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+6:68272:x1875060695364096:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:1.0:1788201017.773623:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201017.773770:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+6:68272:x1875060695364096:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 302us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201017.773779:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2190 00000100:00100000:0.0:1788201017.783827:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201017.783929:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695364224 00000100:00100000:1.0:1788201017.783943:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695364224 00000100:00100000:1.0:1788201017.784001:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5883 00000100:00100000:1.0:1788201017.784012:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2399:x1875060695364224:12345-192.168.201.20@tcp:8:lfs.0 00010000:00080000:1.0:1788201017.784094:0:26200:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp t0 exp 0000000000000000 cur 3869 last 0 00000020:00000080:1.0:1788201017.784136:0:26200:0:(genops.c:1385:class_connect()) connect: client 4292087e-fa00-4621-b681-837afc99ae35, cookie 0x96d0c9b8c9a1b402 00002000:00100000:1.0:1788201017.784153:0:26200:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4292087e-fa00-4621-b681-837afc99ae35/ffff8dc0078de800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788201017.784167:0:26200:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788201017.784268:0:26200:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788201017.784308:0:26200:0:(import.c:65:import_set_state_nolock()) ffff8dc0053a7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201017.784403:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4292087e-fa00-4621-b681-837afc99ae35+6:2399:x1875060695364224:12345-192.168.201.20@tcp:8:lfs.0 Request processed in 391us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201017.784413:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5883 00000001:00100000:2.0:1788201017.784904:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4292087e-fa00-4621-b681-837afc99ae35 00000001:00080000:2.0:1788201017.784917:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969451 is committed 00000100:00100000:0.0:1788201017.786909:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201017.787518:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695364352 00000100:00100000:1.0:1788201017.787532:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695364352 00000100:00100000:1.0:1788201017.787630:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2191 00000100:00100000:1.0:1788201017.787644:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+6:68272:x1875060695364352:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:1.0:1788201017.787698:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201017.787814:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+6:68272:x1875060695364352:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 173us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201017.787823:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2191 00000100:00080000:0.0:1788201017.787907:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201017.813373:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201017.813577:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695364480 00000100:00100000:1.0:1788201017.813593:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695364480 00000100:00100000:1.0:1788201017.813668:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 75 00000100:00100000:1.0:1788201017.813681:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2402:x1875060695364480:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201017.813800:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2402:x1875060695364480:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 121us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201017.813809:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 75 00010000:00010000:1.0:1788201018.133293:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201019.151173:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201019.733617:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715118208:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201019.733730:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201019.733818:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715118208 00000100:00100000:0.0:1788201019.733828:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715118208 00000100:00100000:0.0:1788201019.733902:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2192 00000100:00100000:0.0:1788201019.733913:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715118208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201019.733951:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201019.734004:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715118208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201019.734013:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2192 00000100:00080000:0.0:1788201019.734063:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201019.734108:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715118208:0@lo:13:osp-pre-0-1.0 00000001:00100000:2.0:1788201019.740664:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4292087e-fa00-4621-b681-837afc99ae35 00000100:00100000:0.0:1788201019.742325:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201019.742355:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715118336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201019.742456:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201019.742520:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715118336 00000100:00100000:0.0:1788201019.742530:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715118336 00000100:00100000:0.0:1788201019.742600:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2193 00000100:00100000:0.0:1788201019.742611:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715118336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201019.742652:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201019.742715:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715118336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201019.742722:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2193 00000100:00080000:0.0:1788201019.742748:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201019.742797:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715118336:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788201020.180100:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201021.200098:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201022.224537:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201022.288119:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715118848:0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.288214:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201022.288260:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715119360:0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.288291:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201022.288312:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715119872:0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.288332:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201022.288359:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788201022.288365:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715118464:0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.288408:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201022.288440:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715118976:0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.288486:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201022.288504:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715119488:0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.288524:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201022.288541:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715120000:0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.288565:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201022.288596:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc139ba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715118592:0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.288622:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201022.288652:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715119104:0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.288676:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201022.288693:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715119616:0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.288715:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201022.288735:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788201022.288740:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc139ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715118720:0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.288763:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201022.288773:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715119232:0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.288791:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201022.288808:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715119744:0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.288828:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201022.288865:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715118848 00000100:00100000:0.0:1788201022.288875:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715118848 00000100:00100000:0.0:1788201022.288935:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715118976 00000100:00100000:0.0:1788201022.288938:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715118976 00000100:00100000:0.0:1788201022.288953:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715119488 00000100:00100000:0.0:1788201022.288956:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715119488 00000100:00100000:0.0:1788201022.288969:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715120000 00000100:00100000:0.0:1788201022.288971:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715120000 00000100:00100000:0.0:1788201022.288994:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715118592 00000100:00100000:0.0:1788201022.288996:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715118592 00000100:00100000:0.0:1788201022.289006:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715118720 00000100:00100000:0.0:1788201022.289008:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715118720 00000100:00100000:0.0:1788201022.289052:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:0.0:1788201022.289063:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715118848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.289126:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715118848:12345-0@lo:400:kworker.0 Request processed in 64us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201022.289134:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00100000:0.0:1788201022.289153:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:0.0:1788201022.289160:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715118976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.289189:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715118976:12345-0@lo:400:kworker.0 Request processed in 29us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201022.289195:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:0.0:1788201022.289206:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:0.0:1788201022.289213:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715119488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.289240:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715119488:12345-0@lo:400:kworker.0 Request processed in 28us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201022.289246:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:0.0:1788201022.289257:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:0.0:1788201022.289264:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715120000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.289292:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715120000:12345-0@lo:400:kworker.0 Request processed in 29us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201022.289299:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00100000:0.0:1788201022.289309:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1251 00000100:00100000:0.0:1788201022.289316:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715118592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.289355:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715118592:12345-0@lo:400:kworker.0 Request processed in 40us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201022.289362:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1251 00000100:00100000:0.0:1788201022.289375:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:0.0:1788201022.289381:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715118720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.289409:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715118720:12345-0@lo:400:kworker.0 Request processed in 29us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201022.289415:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:0.0:1788201022.289436:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715119360 00000100:00100000:0.0:1788201022.289440:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715119360 00000100:00100000:0.0:1788201022.289467:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715119872 00000100:00100000:0.0:1788201022.289470:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715119872 00000100:00100000:0.0:1788201022.289486:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715119232 00000100:00100000:0.0:1788201022.289488:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715119232 00000100:00100000:0.0:1788201022.289509:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715119744 00000100:00100000:0.0:1788201022.289513:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715119744 00000100:00100000:0.0:1788201022.289533:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2698 00000100:00100000:0.0:1788201022.289540:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715119360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.289575:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715119360:12345-0@lo:400:kworker.0 Request processed in 36us (1284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201022.289581:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2698 00000100:00100000:0.0:1788201022.289592:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2699 00000100:00100000:0.0:1788201022.289598:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715119872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.289637:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715119872:12345-0@lo:400:kworker.0 Request processed in 26us (1290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201022.289644:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2699 00000100:00100000:0.0:1788201022.289655:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2700 00000100:00100000:0.0:1788201022.289669:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120021c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715119232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.289699:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120021c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715119232:12345-0@lo:400:kworker.0 Request processed in 31us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201022.289705:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2700 00000100:00100000:0.0:1788201022.289715:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2701 00000100:00100000:0.0:1788201022.289720:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715119744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.289740:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715119744:12345-0@lo:400:kworker.0 Request processed in 21us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201022.289746:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2701 00000100:00100000:0.0:1788201022.289770:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715118464 00000100:00100000:0.0:1788201022.289773:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715118464 00000100:00100000:0.0:1788201022.289800:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788201022.289807:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715118464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.289839:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715118464:12345-0@lo:400:kworker.0 Request processed in 33us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201022.289845:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788201022.289894:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715119104 00000100:00100000:0.0:1788201022.289898:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715119104 00000100:00100000:0.0:1788201022.289920:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715119616 00000100:00100000:0.0:1788201022.289923:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715119616 00000100:00100000:0.0:1788201022.289953:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3903 00000100:00100000:0.0:1788201022.289959:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715119104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.289993:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715119104:12345-0@lo:400:kworker.0 Request processed in 34us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201022.290000:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3903 00000100:00100000:0.0:1788201022.290011:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3904 00000100:00100000:0.0:1788201022.290042:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120022680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715119616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.290078:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120022680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715119616:12345-0@lo:400:kworker.0 Request processed in 61us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201022.290084:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3904 00000100:00080000:0.0:1788201022.290116:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201022.290121:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201022.290125:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201022.290128:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201022.290199:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc139ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715118720:0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.290212:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715119232:0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.290220:0:3655:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969451 gen 2 00000100:00100000:0.0:1788201022.290236:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715119744:0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.290247:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc139ba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715118592:0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.290257:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715119104:0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.290266:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715119616:0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.290307:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715118464:0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.290319:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715118976:0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.290329:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715119488:0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.290341:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715120000:0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.290353:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715118848:0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.290363:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715119360:0@lo:400:kworker.0 00000100:00100000:0.0:1788201022.290374:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715119872:0@lo:400:kworker.0 00000100:00100000:3.0:1788201022.292663:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201022.292695:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715120128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201022.292784:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201022.292897:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715120128 00000100:00100000:1.0:1788201022.292906:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715120128 00000100:00100000:1.0:1788201022.292972:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3905 00000100:00100000:1.0:1788201022.292983:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715120128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201022.293071:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:1.0:1788201022.293128:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715120128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 147us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201022.293137:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3905 00000100:00100000:1.0:1788201022.293206:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715120128:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201022.803330:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715120256:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201022.803439:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201022.807076:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715120512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201022.807175:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201022.807226:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201022.807252:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715120384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201022.807284:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201022.808292:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715120256 00000100:00100000:2.0:1788201022.808316:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715120256 00000100:00100000:2.0:1788201022.808392:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3906 00000100:00100000:2.0:1788201022.808404:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715120256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201022.808454:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444966400 avail 1298726912 00000100:00100000:2.0:1788201022.808546:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715120256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 144us (5107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201022.808569:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3906 00000100:00100000:2.0:1788201022.808646:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715120256:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201022.809091:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715120512 00000100:00100000:0.0:1788201022.809099:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715120512 00000100:00100000:0.0:1788201022.809136:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715120384 00000100:00100000:0.0:1788201022.809139:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715120384 00000100:00100000:0.0:1788201022.809155:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2194 00000100:00100000:0.0:1788201022.809162:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715120512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201022.809190:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201022.809250:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715120512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (2075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201022.809257:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2194 00000100:00100000:0.0:1788201022.809272:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2195 00000100:00100000:0.0:1788201022.809278:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715120384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201022.809294:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201022.809333:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715120384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (2049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201022.809339:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2195 00000100:00100000:3.0:1788201022.809449:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715120384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201022.809464:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715120512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201022.934534:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201022.934597:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201022.934655:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201022.934687:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201022.934715:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201022.934828:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695364864 00000100:00100000:1.0:1788201022.934852:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695364864 00000100:00100000:1.0:1788201022.934948:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695364736 00000100:00100000:1.0:1788201022.934952:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695364736 00000100:00100000:1.0:1788201022.934979:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1253 00000100:00100000:1.0:1788201022.934991:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695364864:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201022.935290:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695364864:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 299us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201022.935311:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1253 00000100:00100000:1.0:1788201022.935336:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1254 00000100:00100000:1.0:1788201022.935343:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+8:2403:x1875060695364736:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201022.935372:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+8:2403:x1875060695364736:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 30us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201022.935380:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1254 00000100:00100000:3.0:1788201022.935437:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695365120 00000100:00100000:3.0:1788201022.935443:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695365120 00000100:00100000:3.0:1788201022.935499:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695364992 00000100:00100000:3.0:1788201022.935505:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695364992 00000100:00080000:2.0:1788201022.935512:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201022.935520:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201022.935523:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201022.935526:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201022.935538:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2702 00000100:00100000:3.0:1788201022.935548:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695365120:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201022.935585:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695365120:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 38us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201022.935593:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2702 00000100:00100000:3.0:1788201022.935626:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2703 00000100:00100000:3.0:1788201022.935636:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695364992:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201022.935664:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695364992:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 31us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201022.935672:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2703 00000100:00100000:0.0:1788201022.936233:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695364608 00000100:00100000:0.0:1788201022.936241:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695364608 00000100:00100000:0.0:1788201022.936295:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 77 00000100:00100000:0.0:1788201022.936466:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2403:x1875060695364608:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201022.936521:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2403:x1875060695364608:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 219us (2006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201022.936530:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 77 00010000:00010000:2.0:1788201023.247814:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201024.272228:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201024.802664:0:89693:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00000100:00100000:1.0:1788201024.848714:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715120640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201024.848795:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201024.848858:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715120640 00000100:00100000:1.0:1788201024.848867:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715120640 00000100:00100000:1.0:1788201024.848921:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2196 00000100:00100000:1.0:1788201024.848932:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715120640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201024.848963:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201024.849009:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715120640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201024.849010:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715120768:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201024.849052:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2196 00000100:00100000:2.0:1788201024.849061:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788201024.857548:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201024.857678:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715120640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201024.858816:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715120768 00000100:00100000:0.0:1788201024.858843:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715120768 00000100:00100000:0.0:1788201024.859037:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2197 00000100:00100000:0.0:1788201024.859048:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715120768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201024.859079:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201024.859171:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715120768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (10094us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201024.859179:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2197 00000100:00100000:0.0:1788201024.859235:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715120768:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788201024.861795:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788201025.295268:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201026.321816:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201026.704537:0:89741:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:2.0:1788201027.343325:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201027.408110:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201027.408137:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715120896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201027.408213:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201027.410056:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715120896 00000100:00100000:1.0:1788201027.410069:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715120896 00000100:00100000:2.0:1788201027.410100:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715121408:0@lo:400:kworker.0 00000100:00100000:1.0:1788201027.410133:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3907 00000100:00100000:1.0:1788201027.410143:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715120896:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201027.410157:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1788201027.410178:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:2.0:1788201027.410189:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715121920:0@lo:400:kworker.0 00000100:00100000:2.0:1788201027.410212:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201027.410220:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715120896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201027.410227:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3907 00000100:00100000:2.0:1788201027.410228:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715122432:0@lo:400:kworker.0 00000100:00100000:2.0:1788201027.410247:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201027.410273:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788201027.410276:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715121408 00000100:00100000:1.0:1788201027.410280:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715121408 00000100:00100000:2.0:1788201027.410292:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715121024:0@lo:400:kworker.0 00000100:00100000:1.0:1788201027.410311:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715122432 00000100:00100000:1.0:1788201027.410314:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715122432 00000100:00100000:1.0:1788201027.410332:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:1.0:1788201027.410339:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715121408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201027.410399:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201027.410463:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:3.0:1788201027.410473:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715122432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201027.410548:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715121280:0@lo:400:kworker.0 00000100:00100000:1.0:1788201027.421654:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715121408:12345-0@lo:400:kworker.0 Request processed in 11306us (11486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201027.421670:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:1.0:1788201027.421727:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715121152:0@lo:400:kworker.0 00000100:00100000:1.0:1788201027.421769:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201027.421805:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715121664:0@lo:400:kworker.0 00000100:00100000:1.0:1788201027.421834:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201027.421854:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715122176:0@lo:400:kworker.0 00000100:00100000:1.0:1788201027.421879:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201027.421934:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715121152 00000100:00100000:1.0:1788201027.422032:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715121152 00000100:00100000:1.0:1788201027.422078:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:1.0:1788201027.422086:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715121152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201027.422138:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715121152:12345-0@lo:400:kworker.0 Request processed in 52us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201027.422144:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00080000:1.0:1788201027.422159:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201027.422174:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715121664 00000100:00100000:1.0:1788201027.422177:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715121664 00000100:00100000:1.0:1788201027.422211:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3908 00000100:00100000:1.0:1788201027.422218:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715121664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201027.422246:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715121664:12345-0@lo:400:kworker.0 Request processed in 30us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201027.422251:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3908 00000100:00100000:1.0:1788201027.422268:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715121920 00000100:00100000:1.0:1788201027.422272:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715121920 00000100:00100000:2.0:1788201027.422683:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715121536:0@lo:400:kworker.0 00000100:00100000:2.0:1788201027.422713:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201027.422735:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715122048:0@lo:400:kworker.0 00000100:00100000:2.0:1788201027.422757:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201027.422791:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715121408:0@lo:400:kworker.0 00000100:00100000:2.0:1788201027.422907:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715121536 00000100:00100000:2.0:1788201027.422911:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715121536 00000100:00100000:2.0:1788201027.422941:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715122048 00000100:00100000:2.0:1788201027.422944:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715122048 00000100:00100000:1.0:1788201027.423484:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715122176 00000100:00100000:1.0:1788201027.423489:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715122176 00000100:00100000:1.0:1788201027.423522:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2704 00000100:00100000:1.0:1788201027.423532:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715121920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201027.423597:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715121920:12345-0@lo:400:kworker.0 Request processed in 67us (13382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201027.423603:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2704 00000100:00100000:1.0:1788201027.423617:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2705 00000100:00100000:1.0:1788201027.423624:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715122176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201027.423654:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715122176:12345-0@lo:400:kworker.0 Request processed in 31us (1775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201027.423670:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2705 00000100:00100000:1.0:1788201027.423711:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715121152:0@lo:400:kworker.0 00000100:00100000:1.0:1788201027.423722:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715121664:0@lo:400:kworker.0 00000100:00100000:1.0:1788201027.423731:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715122176:0@lo:400:kworker.0 00000100:00100000:1.0:1788201027.423761:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:1.0:1788201027.423769:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715121536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201027.423799:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715121536:12345-0@lo:400:kworker.0 Request processed in 32us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201027.423805:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:1.0:1788201027.423833:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715121536:0@lo:400:kworker.0 00000100:00100000:1.0:1788201027.423844:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715121920:0@lo:400:kworker.0 00000100:00100000:1.0:1788201027.423898:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715120896:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201027.423935:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715121024 00000100:00100000:3.0:1788201027.424035:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715122432:12345-0@lo:400:kworker.0 Request processed in 13563us (13785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201027.424050:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:3.0:1788201027.424067:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:3.0:1788201027.424076:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715122048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201027.424105:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715122048:12345-0@lo:400:kworker.0 Request processed in 32us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201027.424111:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:1.0:1788201027.426032:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715121024 00000100:00100000:0.0:1788201027.428679:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201027.433694:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788201027.433723:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715121024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201027.433820:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715121024:12345-0@lo:400:kworker.0 Request processed in 112us (23420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201027.433827:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788201027.442989:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715121792:0@lo:400:kworker.0 00000100:00100000:0.0:1788201027.443071:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201027.443092:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715122304:0@lo:400:kworker.0 00000100:00100000:0.0:1788201027.443112:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201027.443163:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715121792 00000100:00100000:0.0:1788201027.443170:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715121792 00000100:00100000:0.0:1788201027.443208:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715122304 00000100:00100000:0.0:1788201027.443210:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715122304 00000100:00100000:0.0:1788201027.443227:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2706 00000100:00100000:0.0:1788201027.443234:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715121792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201027.443279:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715121792:12345-0@lo:400:kworker.0 Request processed in 45us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201027.443285:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2706 00000100:00100000:0.0:1788201027.443314:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2707 00000100:00100000:0.0:1788201027.443331:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715122304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201027.443364:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715122304:12345-0@lo:400:kworker.0 Request processed in 34us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201027.443370:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2707 00000100:00100000:0.0:1788201027.443479:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715121792:0@lo:400:kworker.0 00000100:00100000:0.0:1788201027.443488:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715122304:0@lo:400:kworker.0 00000100:00080000:0.0:1788201027.443562:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201027.443566:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201027.443568:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201027.446097:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715121280 00000100:00100000:3.0:1788201027.446111:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715121280 00000100:00100000:3.0:1788201027.446185:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:3.0:1788201027.446194:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715121280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201027.446271:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715121280:12345-0@lo:400:kworker.0 Request processed in 78us (17599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201027.446278:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:1.0:1788201027.449143:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715121024:0@lo:400:kworker.0 00000100:00100000:1.0:1788201027.449180:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715122048:0@lo:400:kworker.0 00000100:00100000:1.0:1788201027.449216:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715122432:0@lo:400:kworker.0 00000100:00080000:1.0:1788201027.450827:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201027.451365:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715121280:0@lo:400:kworker.0 00000100:00100000:0.0:1788201027.920584:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201027.920610:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715122560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201027.920690:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201027.920880:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715122560 00000100:00100000:2.0:1788201027.920891:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715122560 00000100:00100000:2.0:1788201027.920965:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3909 00000100:00100000:2.0:1788201027.920976:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715122560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201027.921012:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444966400 avail 1298726912 00000100:00100000:2.0:1788201027.921087:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715122560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201027.921094:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3909 00000100:00100000:2.0:1788201027.921142:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715122560:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201027.922300:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201027.922317:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715122688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201027.922370:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201027.922572:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715122688 00000100:00100000:1.0:1788201027.922579:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715122688 00000100:00100000:1.0:1788201027.922631:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2198 00000100:00100000:1.0:1788201027.922640:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715122688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201027.922664:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201027.922708:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715122688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201027.922715:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2198 00000100:00100000:3.0:1788201027.922801:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715122688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201027.922993:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201027.923004:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715122816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201027.923065:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201027.923247:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715122816 00000100:00100000:2.0:1788201027.923253:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715122816 00000100:00100000:2.0:1788201027.923305:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2199 00000100:00100000:2.0:1788201027.923313:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715122816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201027.923332:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201027.923376:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715122816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201027.923395:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2199 00000100:00100000:0.0:1788201027.923534:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715122816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201028.069749:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201028.069804:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201028.069840:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201028.069856:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201028.069899:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201028.070044:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695365248 00000100:00100000:1.0:1788201028.070055:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695365248 00000100:00100000:1.0:1788201028.070106:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 79 00000100:00100000:1.0:1788201028.070116:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2402:x1875060695365248:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201028.070186:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2402:x1875060695365248:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 71us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201028.070194:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 79 00000100:00100000:1.0:1788201028.070319:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695365504 00000100:00100000:1.0:1788201028.070323:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695365504 00000100:00100000:1.0:1788201028.070371:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695365376 00000100:00100000:1.0:1788201028.070375:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695365376 00000100:00100000:1.0:1788201028.070396:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1261 00000100:00100000:1.0:1788201028.070404:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695365504:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201028.070440:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695365504:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 36us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201028.070446:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1261 00000100:00100000:1.0:1788201028.070473:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1262 00000100:00100000:1.0:1788201028.070480:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+8:2402:x1875060695365376:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201028.070506:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+8:2402:x1875060695365376:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201028.070530:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1262 00000100:00080000:1.0:1788201028.070593:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201028.070597:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201028.071561:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695365760 00000100:00100000:0.0:1788201028.071569:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695365760 00000100:00100000:0.0:1788201028.071621:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695365632 00000100:00100000:0.0:1788201028.071625:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695365632 00000100:00100000:0.0:1788201028.071651:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2708 00000100:00100000:0.0:1788201028.071658:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4292087e-fa00-4621-b681-837afc99ae35+5:2402:x1875060695365760:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201028.071700:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4292087e-fa00-4621-b681-837afc99ae35+5:2402:x1875060695365760:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 43us (1860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201028.071706:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2708 00000100:00100000:0.0:1788201028.071719:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2709 00000100:00100000:0.0:1788201028.071735:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4292087e-fa00-4621-b681-837afc99ae35+5:2402:x1875060695365632:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201028.071762:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4292087e-fa00-4621-b681-837afc99ae35+5:2402:x1875060695365632:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201028.071767:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2709 00000100:00080000:1.0:1788201028.072479:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201028.072484:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788201028.368754:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201028.699863:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201028.699935:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695365888 00000100:00100000:0.0:1788201028.699947:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695365888 00000100:00100000:0.0:1788201028.700042:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1226 00000100:00100000:0.0:1788201028.700054:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+8:68740:x1875060695365888:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:0.0:1788201028.700092:0:66312:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444966400 avail 1298726912 00000100:00100000:0.0:1788201028.700163:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+8:68740:x1875060695365888:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 112us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201028.700170:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1226 00000100:00100000:2.0:1788201028.706293:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201028.706443:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695366016 00000100:00100000:3.0:1788201028.706454:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695366016 00000100:00100000:3.0:1788201028.706530:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1227 00000100:00100000:3.0:1788201028.706541:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:68740:x1875060695366016:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:3.0:1788201028.706576:0:66313:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:3.0:1788201028.706659:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:68740:x1875060695366016:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 120us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201028.706680:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1227 00000100:00100000:3.0:1788201028.716169:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201028.716264:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695366144 00000100:00100000:0.0:1788201028.716276:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695366144 00000100:00100000:0.0:1788201028.716339:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2200 00000100:00100000:0.0:1788201028.716349:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:68740:x1875060695366144:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:0.0:1788201028.716379:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201028.716457:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:68740:x1875060695366144:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 109us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201028.716464:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2200 00000100:00100000:1.0:1788201028.722899:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201028.723340:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695366272 00000100:00100000:0.0:1788201028.723353:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695366272 00000100:00100000:0.0:1788201028.723425:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2201 00000100:00100000:0.0:1788201028.723436:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:68740:x1875060695366272:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:0.0:1788201028.723463:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201028.723562:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:68740:x1875060695366272:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 127us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201028.723570:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2201 00000100:00100000:2.0:1788201028.767895:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201028.768051:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695366528 00000100:00100000:3.0:1788201028.768062:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695366528 00000100:00100000:3.0:1788201028.768140:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1228 00000100:00100000:3.0:1788201028.768152:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00586d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+8:68756:x1875060695366528:12345-192.168.201.20@tcp:101:cat.0 00010000:00010000:3.0:1788201028.768178:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201028.768202:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1b409 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786649 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201028.768581:0:69485:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b226 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786618 expref: 9 pid: 89143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201028.768602:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b410 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201028.768618:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b410 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201028.768632:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b410 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201028.768734:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b410 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201028.768742:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b410 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201028.768749:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b410 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201028.768769:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201028.768774:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b410 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201028.768783:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b410 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201028.768796:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8dc12b661600) 00010000:00010000:3.0:1788201028.768799:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201028.768804:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b410 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201028.768810:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b410 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201028.768873:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1b409 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786649 expref: 10 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201028.768884:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a1b700) 00010000:00010000:3.0:1788201028.768887:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201028.768891:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1b409 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786649 expref: 10 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201028.768901:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ec600, rc 0) 00000100:00100000:3.0:1788201028.769174:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00586d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+9:68756:x1875060695366528:12345-192.168.201.20@tcp:101:cat.0 Request processed in 1022us (1288us total) trans 111669149698 rc 301/301 00000100:00100000:3.0:1788201028.769183:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1228 00000100:00100000:3.0:1788201028.778875:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201028.779092:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695366656 00000100:00100000:1.0:1788201028.779104:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695366656 00000100:00100000:1.0:1788201028.779172:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1229 00000100:00100000:1.0:1788201028.779183:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+9:68756:x1875060695366656:12345-192.168.201.20@tcp:101:cat.0 00010000:00010000:1.0:1788201028.779207:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201028.779230:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d600/0x96d0c9b8c9a1b41e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786650 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201028.779309:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2de00/0x96d0c9b8c9a1b425 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201028.779324:0:66314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b226 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786618 expref: 10 pid: 89143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201028.779332:0:66314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2de00/0x96d0c9b8c9a1b425 lrc: 4/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201028.779576:0:66314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b226 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786618 expref: 10 pid: 89143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201028.779589:0:66314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b226 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786618 expref: 10 pid: 89143 timeout: 3980 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201028.779603:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66314:1875060715122944:192.168.201.20@tcp:104: 00000100:00100000:1.0:1788201028.779690:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201028.788630:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201028.788746:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66314:1875060715122944:192.168.201.20@tcp:104: 00010000:00010000:1.0:1788201028.788774:0:66314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2de00/0x96d0c9b8c9a1b425 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201028.788850:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695366784 00000100:00100000:3.0:1788201028.788858:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695366784 00010000:00010000:3.0:1788201028.788890:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b226 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786618 expref: 11 pid: 89143 timeout: 3980 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201028.788935:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2554 00000100:00100000:3.0:1788201028.788945:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00586c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4292087e-fa00-4621-b681-837afc99ae35+11:2400:x1875060695366784:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201028.788961:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00010000:3.0:1788201028.788983:0:6517:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 0 -> 8 00000004:00010000:3.0:1788201028.788986:0:6517:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 0 -> 1788200976 00000004:00010000:3.0:1788201028.788988:0:6517:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 0 -> 1788200967 00000004:00010000:3.0:1788201028.788990:0:6517:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 0 -> 1788200976 00010000:00010000:3.0:1788201028.788996:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b226 lrc: 4/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786618 expref: 11 pid: 89143 timeout: 3980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201028.789008:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b226 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786618 expref: 11 pid: 89143 timeout: 3980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201028.789062:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b226 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786618 expref: 11 pid: 89143 timeout: 3980 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201028.789285:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8dc12b661600) 00010000:00010000:3.0:1788201028.789291:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2de00/0x96d0c9b8c9a1b425 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201028.789300:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2de00/0x96d0c9b8c9a1b425 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201028.789323:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2de00/0x96d0c9b8c9a1b425 lrc: 4/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201028.789455:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201028.789510:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00586c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4292087e-fa00-4621-b681-837afc99ae35+10:2400:x1875060695366784:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 565us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201028.789528:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2554 00010000:00010000:2.0:1788201028.789750:0:66314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2de00/0x96d0c9b8c9a1b425 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201028.789758:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2de00/0x96d0c9b8c9a1b425 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201028.789811:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201028.789834:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2de00/0x96d0c9b8c9a1b425 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201028.789861:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d600/0x96d0c9b8c9a1b41e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786650 expref: 10 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201028.789876:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2de00/0x96d0c9b8c9a1b425 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786650 expref: 9 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201028.789883:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8dc12b661600) 00010000:00010000:2.0:1788201028.789886:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201028.789889:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2de00, rc 0) 00000100:00100000:2.0:1788201028.789936:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+9:68756:x1875060695366656:12345-192.168.201.20@tcp:101:cat.0 Request processed in 10754us (11071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201028.789950:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1229 00000100:00100000:2.0:1788201028.799842:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201028.799939:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695366912 00000100:00100000:3.0:1788201028.799950:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695366912 00000100:00100000:3.0:1788201028.800053:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1230 00000100:00100000:3.0:1788201028.800066:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+9:68756:x1875060695366912:12345-192.168.201.20@tcp:101:cat.0 00010000:00010000:3.0:1788201028.800103:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201028.800129:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b42c lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786657 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201028.800198:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b42c lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786657 expref: 10 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201028.800214:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b42c lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786657 expref: 10 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201028.800236:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8dc12b661600) 00010000:00010000:3.0:1788201028.800239:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201028.800243:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ede00, rc 0) 00000100:00100000:3.0:1788201028.800317:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+10:68756:x1875060695366912:12345-192.168.201.20@tcp:101:cat.0 Request processed in 254us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201028.800325:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1230 00000100:00100000:0.0:1788201028.817294:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201028.817449:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695367040 00000100:00100000:3.0:1788201028.817459:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695367040 00000100:00100000:3.0:1788201028.817537:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1231 00000100:00100000:3.0:1788201028.817548:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+10:2400:x1875060695367040:12345-192.168.201.20@tcp:101:cat.0 00010000:00010000:3.0:1788201028.817569:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201028.817590:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1b433 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78665e expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201028.817632:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1b433 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78665e expref: 11 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201028.817659:0:69485:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb size from disk: 8 -> 8 00000004:00010000:3.0:1788201028.817663:0:69485:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb mtime from disk: 1788200976 -> 1788200976 00000004:00010000:3.0:1788201028.817665:0:69485:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb atime from disk: 1788200967 -> 1788200967 00000004:00010000:3.0:1788201028.817667:0:69485:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb ctime from disk: 1788200976 -> 1788200976 00000004:00010000:3.0:1788201028.817670:0:69485:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000afe1:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 8 00002000:00010000:3.0:1788201028.817673:0:69485:0:(mdt_io.c:1550:mdt_lvb2reply()) size 8 00010000:00010000:3.0:1788201028.817681:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1b433 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78665e expref: 11 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201028.817695:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x6:0x0].0x0 (ffff8dc12b661600) 00010000:00010000:3.0:1788201028.817698:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201028.817702:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ec600, rc 0) 00000100:00100000:3.0:1788201028.817760:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+11:2400:x1875060695367040:12345-192.168.201.20@tcp:101:cat.0 Request processed in 214us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201028.817767:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1231 00000100:00100000:0.0:1788201028.825829:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201028.826004:0:66327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695367168 00000100:00100000:2.0:1788201028.826047:0:66327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695367168 00002000:00100000:2.0:1788201028.826221:0:66327:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff8dc11d29f480 x1875060695367168/t0(0) o3->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:149/0 lens 488/0 e 0 to 0 dl 1788201039 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201028.826232:0:66327:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8dc11d29f480 with x1875060695367168 00000100:00100000:2.0:1788201028.826425:0:66327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:2.0:1788201028.826435:0:66327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:4292087e-fa00-4621-b681-837afc99ae35+11:2401:x1875060695367168:12345-192.168.201.20@tcp:3:cat.0 00000100:00100000:2.0:1788201028.826623:0:66327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:4292087e-fa00-4621-b681-837afc99ae35+11:2401:x1875060695367168:12345-192.168.201.20@tcp:3:cat.0 Request processed in 189us (805us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788201028.826631:0:66327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 3 00002000:00100000:2.0:1788201028.826639:0:66327:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000afe1:0x6:0x0] req@ffff8dc11d29f480 x1875060695367168/t0(0) o3->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:149/0 lens 488/4536 e 0 to 0 dl 1788201039 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201028.826647:0:66327:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8dc11d29f480 with x1875060695367168 00000100:00100000:2.0:1788201028.843548:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201028.843921:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695367424 00000100:00100000:3.0:1788201028.843941:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695367424 00000100:00100000:3.0:1788201028.843996:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 224 00000100:00100000:3.0:1788201028.844006:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4292087e-fa00-4621-b681-837afc99ae35+11:68756:x1875060695367424:12345-192.168.201.20@tcp:35:cat.0 00000100:00100000:3.0:1788201028.844589:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4292087e-fa00-4621-b681-837afc99ae35+12:68756:x1875060695367424:12345-192.168.201.20@tcp:35:cat.0 Request processed in 581us (1047us total) trans 111669149699 rc 0/0 00000100:00100000:3.0:1788201028.844599:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 224 00010000:00010000:0.0:1788201029.391727:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201029.973654:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715123072:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201029.973749:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201029.973813:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715123072 00000100:00100000:3.0:1788201029.973820:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715123072 00000100:00100000:3.0:1788201029.973873:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2202 00000100:00100000:3.0:1788201029.973883:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715123072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201029.973910:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201029.973950:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715123072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201029.973957:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2202 00000100:00080000:3.0:1788201029.973976:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201029.974009:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715123072:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201029.978775:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201029.978800:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715123200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201029.978867:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201029.978945:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715123200 00000100:00100000:3.0:1788201029.978953:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715123200 00000100:00100000:3.0:1788201029.979013:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2203 00000100:00100000:3.0:1788201029.979043:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715123200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201029.979070:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201029.979114:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715123200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201029.979121:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2203 00000100:00080000:2.0:1788201029.979212:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201029.979248:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715123200:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788201030.421075:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201031.439239:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201032.464171:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201032.534982:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715123328:0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.535083:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201032.535124:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715123840:0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.535163:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201032.535184:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715124352:0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.535206:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201032.535233:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715124864:0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.535253:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201032.535278:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788201032.535284:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715123456:0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.535307:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201032.535324:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715123968:0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.535350:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201032.535366:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715124480:0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.535407:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201032.535439:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715123584:0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.535474:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201032.535492:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715124096:0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.535514:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201032.535533:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715124608:0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.535553:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201032.535571:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788201032.535576:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715123712:0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.535608:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201032.535619:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715124224:0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.535639:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201032.535661:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715124736:0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.535682:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201032.535713:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715123328 00000100:00100000:3.0:1788201032.535720:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715123328 00000100:00100000:3.0:1788201032.535765:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788201032.535773:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715123328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.535823:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715123328:12345-0@lo:400:kworker.0 Request processed in 50us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201032.535830:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788201032.535862:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715123840 00000100:00100000:3.0:1788201032.535866:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715123840 00000100:00100000:3.0:1788201032.535896:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715124352 00000100:00100000:3.0:1788201032.535899:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715124352 00000100:00100000:3.0:1788201032.535911:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715124864 00000100:00100000:3.0:1788201032.535913:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715124864 00000100:00100000:3.0:1788201032.535922:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715123456 00000100:00100000:3.0:1788201032.535924:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715123456 00000100:00100000:3.0:1788201032.535935:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715123584 00000100:00100000:3.0:1788201032.535937:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715123584 00000100:00100000:3.0:1788201032.535949:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715123712 00000100:00100000:3.0:1788201032.535951:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715123712 00000100:00100000:3.0:1788201032.535966:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:3.0:1788201032.535972:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715123840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.536003:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715123840:12345-0@lo:400:kworker.0 Request processed in 32us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201032.536040:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00100000:3.0:1788201032.536054:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:3.0:1788201032.536060:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715124352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.536090:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715124352:12345-0@lo:400:kworker.0 Request processed in 30us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201032.536095:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00100000:3.0:1788201032.536106:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:3.0:1788201032.536112:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715124864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.536154:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715124864:12345-0@lo:400:kworker.0 Request processed in 27us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201032.536159:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:3.0:1788201032.536170:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:3.0:1788201032.536176:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715123456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.536202:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715123456:12345-0@lo:400:kworker.0 Request processed in 27us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201032.536207:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:3.0:1788201032.536216:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:3.0:1788201032.536222:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00393dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715123584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.536256:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00393dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715123584:12345-0@lo:400:kworker.0 Request processed in 34us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201032.536261:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00000100:00100000:3.0:1788201032.536272:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:3.0:1788201032.536279:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00393c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715123712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.536301:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00393c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715123712:12345-0@lo:400:kworker.0 Request processed in 24us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201032.536313:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:3.0:1788201032.536339:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715123968 00000100:00100000:3.0:1788201032.536343:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715123968 00000100:00100000:3.0:1788201032.536366:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715124480 00000100:00100000:3.0:1788201032.536369:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715124480 00000100:00100000:3.0:1788201032.536388:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3910 00000100:00100000:3.0:1788201032.536394:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715123968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.536427:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715123968:12345-0@lo:400:kworker.0 Request processed in 33us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201032.536433:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3910 00000100:00100000:3.0:1788201032.536444:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3911 00000100:00100000:3.0:1788201032.536462:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00393f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715124480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.536489:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00393f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715124480:12345-0@lo:400:kworker.0 Request processed in 29us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201032.536495:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3911 00000100:00100000:3.0:1788201032.536520:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715124096 00000100:00100000:3.0:1788201032.536523:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715124096 00000100:00100000:3.0:1788201032.536547:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715124608 00000100:00100000:3.0:1788201032.536550:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715124608 00000100:00100000:3.0:1788201032.536567:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715124224 00000100:00100000:3.0:1788201032.536569:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715124224 00000100:00100000:3.0:1788201032.536584:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715124736 00000100:00100000:3.0:1788201032.536586:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715124736 00000100:00100000:3.0:1788201032.536604:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2710 00000100:00100000:3.0:1788201032.536610:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00393ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715124096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.536641:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00393ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715124096:12345-0@lo:400:kworker.0 Request processed in 31us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201032.536646:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2710 00000100:00100000:3.0:1788201032.536665:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2711 00000100:00100000:3.0:1788201032.536671:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00393ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715124608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.536698:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00393ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715124608:12345-0@lo:400:kworker.0 Request processed in 27us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201032.536703:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2711 00000100:00100000:3.0:1788201032.536713:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2712 00000100:00100000:3.0:1788201032.536719:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00393fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715124224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.536745:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00393fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715124224:12345-0@lo:400:kworker.0 Request processed in 26us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201032.536750:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2712 00000100:00100000:3.0:1788201032.536761:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2713 00000100:00100000:3.0:1788201032.536767:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00393c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715124736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.536790:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00393c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715124736:12345-0@lo:400:kworker.0 Request processed in 24us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201032.536796:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2713 00000100:00100000:3.0:1788201032.536841:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715123456:0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.536853:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715123968:0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.536862:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715124480:0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.536868:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715123328:0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.536876:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715123840:0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.536884:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715124352:0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.536893:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715124864:0@lo:400:kworker.0 00000100:00080000:3.0:1788201032.536933:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201032.536937:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201032.536940:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201032.536942:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201032.536959:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715123712:0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.536969:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715124224:0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.536978:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715124736:0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.536987:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715123584:0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.536995:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715124096:0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.537003:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715124608:0@lo:400:kworker.0 00000100:00100000:3.0:1788201032.543997:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715124992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201032.544099:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201032.544305:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715124992 00000100:00100000:0.0:1788201032.544314:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715124992 00000100:00100000:0.0:1788201032.544367:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3912 00000100:00100000:0.0:1788201032.544376:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00393c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715124992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201032.544408:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:0.0:1788201032.544465:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00393c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715124992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201032.544472:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3912 00000100:00100000:3.0:1788201032.544552:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715124992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201033.039596:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715125120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201033.039669:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201033.039773:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715125120 00000100:00100000:1.0:1788201033.039782:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715125120 00000100:00100000:1.0:1788201033.039839:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2204 00000100:00100000:1.0:1788201033.039848:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00393ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715125120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201033.039877:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201033.039924:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00393ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715125120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201033.039931:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2204 00000100:00100000:2.0:1788201033.039965:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715125120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201033.039983:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201033.039998:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715125248:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201033.040046:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201033.040172:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715125248 00000100:00100000:1.0:1788201033.040178:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715125248 00000100:00100000:1.0:1788201033.040225:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3913 00000100:00100000:1.0:1788201033.040232:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715125248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201033.040255:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444966400 avail 1298726912 00000100:00100000:1.0:1788201033.040299:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715125248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201033.040305:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3913 00000100:00100000:1.0:1788201033.040334:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715125248:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201033.042412:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715125376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201033.042486:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201033.042632:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715125376 00000100:00100000:2.0:1788201033.042639:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715125376 00000100:00100000:2.0:1788201033.042689:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2205 00000100:00100000:2.0:1788201033.042698:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00393e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715125376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201033.042723:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201033.042776:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00393e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715125376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201033.042783:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2205 00000100:00100000:3.0:1788201033.042850:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715125376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201033.178913:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201033.178962:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201033.178993:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201033.179077:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201033.179103:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201033.179132:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695367808 00000100:00100000:0.0:1788201033.179142:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695367808 00000100:00100000:2.0:1788201033.179350:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695368064 00000100:00100000:2.0:1788201033.179355:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695368064 00000100:00100000:2.0:1788201033.179386:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695367936 00000100:00100000:2.0:1788201033.179389:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695367936 00000100:00100000:2.0:1788201033.179415:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2714 00000100:00100000:2.0:1788201033.179426:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695368064:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201033.179506:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695368064:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 82us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201033.179515:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2714 00000100:00100000:2.0:1788201033.179532:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2715 00000100:00100000:2.0:1788201033.179539:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695367936:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201033.179563:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4292087e-fa00-4621-b681-837afc99ae35+5:2403:x1875060695367936:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201033.179568:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2715 00000100:00080000:2.0:1788201033.179708:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201033.179712:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201033.179726:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201033.180061:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695367680 00000100:00100000:3.0:1788201033.180066:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695367680 00000100:00100000:3.0:1788201033.180104:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1269 00000100:00100000:3.0:1788201033.180113:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+12:2403:x1875060695367680:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201033.180177:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+12:2403:x1875060695367680:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 66us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201033.180183:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1269 00000100:00100000:0.0:1788201033.180592:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1270 00000100:00100000:0.0:1788201033.180603:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695367808:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201033.180638:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695367808:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 39us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201033.180645:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1270 00000100:00080000:2.0:1788201033.180935:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201033.181001:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695367552 00000100:00100000:1.0:1788201033.181007:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695367552 00000100:00100000:1.0:1788201033.182611:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 81 00000100:00100000:1.0:1788201033.182629:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2403:x1875060695367552:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201033.182938:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2403:x1875060695367552:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 316us (4035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201033.182945:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 81 00010000:00010000:0.0:1788201033.487205:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201034.512317:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788201034.577634:0:89112:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149699 is committed 00000100:00100000:3.0:1788201035.087437:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201035.087464:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00393df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715125504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201035.087534:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201035.087587:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715125504 00000100:00100000:3.0:1788201035.087595:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715125504 00000100:00100000:3.0:1788201035.087650:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2206 00000100:00100000:3.0:1788201035.087661:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00393e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715125504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201035.087690:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201035.087736:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00393e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715125504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201035.087743:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2206 00000100:00100000:3.0:1788201035.087787:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00393df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715125504:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788201035.089564:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201035.089759:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201035.089776:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00393df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715125632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201035.089831:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201035.089911:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715125632 00000100:00100000:3.0:1788201035.089917:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715125632 00000100:00100000:3.0:1788201035.089967:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2207 00000100:00100000:3.0:1788201035.089977:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ac44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715125632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201035.090002:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201035.090078:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ac44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715125632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201035.090085:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2207 00000100:00100000:1.0:1788201035.090569:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00393df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715125632:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788201035.092278:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788201035.539245:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201036.495085:0:89936:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_131b skipping excluded test 131b 00010000:00010000:3.0:1788201036.562009:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201037.583254:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201037.647346:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201037.647405:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715125888:0@lo:400:kworker.0 00000100:00100000:1.0:1788201037.647481:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201037.647547:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715126016:0@lo:400:kworker.0 00000100:00100000:1.0:1788201037.647587:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201037.647639:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201037.647645:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715126400:0@lo:400:kworker.0 00000100:00100000:1.0:1788201037.647672:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201037.647703:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715126400 00000100:00100000:1.0:1788201037.647711:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715126400 00000100:00100000:1.0:1788201037.647759:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3914 00000100:00100000:1.0:1788201037.647769:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715126400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201037.647837:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715126400:12345-0@lo:400:kworker.0 Request processed in 69us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201037.647845:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3914 00000100:00100000:1.0:1788201037.647886:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715126400:0@lo:400:kworker.0 00000100:00100000:1.0:1788201037.648403:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715126528:0@lo:400:kworker.0 00000100:00100000:1.0:1788201037.648437:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201037.648473:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715126528 00000100:00100000:1.0:1788201037.648478:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715126528 00000100:00100000:1.0:1788201037.648522:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2716 00000100:00100000:1.0:1788201037.648530:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715126528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201037.648582:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715126528:12345-0@lo:400:kworker.0 Request processed in 40us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201037.648589:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2716 00000100:00080000:1.0:1788201037.648609:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201037.648634:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715126528:0@lo:400:kworker.0 00000100:00100000:1.0:1788201037.648700:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715127040:0@lo:400:kworker.0 00000100:00100000:1.0:1788201037.648724:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201037.648744:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201037.648750:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715126912:0@lo:400:kworker.0 00000100:00100000:1.0:1788201037.648774:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201037.648796:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715126912 00000100:00100000:1.0:1788201037.648800:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715126912 00000100:00100000:1.0:1788201037.648824:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3915 00000100:00100000:1.0:1788201037.648831:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715126912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201037.648864:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715126912:12345-0@lo:400:kworker.0 Request processed in 34us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201037.648880:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3915 00000100:00100000:1.0:1788201037.648906:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715126912:0@lo:400:kworker.0 00000100:00100000:1.0:1788201037.650657:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715127040 00000100:00100000:1.0:1788201037.650670:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715127040 00000100:00100000:1.0:1788201037.650728:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2717 00000100:00100000:1.0:1788201037.650737:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715127040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201037.650802:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715127040:12345-0@lo:400:kworker.0 Request processed in 66us (2076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201037.650808:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2717 00000100:00080000:1.0:1788201037.650828:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201037.650852:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715127040:0@lo:400:kworker.0 00000100:00100000:3.0:1788201037.651476:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715126144:0@lo:400:kworker.0 00000100:00100000:3.0:1788201037.651548:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201037.651584:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715126656:0@lo:400:kworker.0 00000100:00100000:3.0:1788201037.651609:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201037.651631:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715127168:0@lo:400:kworker.0 00000100:00100000:3.0:1788201037.651652:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201037.651676:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788201037.651683:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715125760:0@lo:400:kworker.0 00000100:00100000:3.0:1788201037.651710:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201037.651740:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715126272:0@lo:400:kworker.0 00000100:00100000:3.0:1788201037.651762:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201037.651782:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715126784:0@lo:400:kworker.0 00000100:00100000:3.0:1788201037.651805:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201037.651822:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715127296:0@lo:400:kworker.0 00000100:00100000:3.0:1788201037.651842:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201037.651871:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715125888 00000100:00100000:3.0:1788201037.651877:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715125888 00000100:00100000:3.0:1788201037.651910:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715126016 00000100:00100000:3.0:1788201037.651913:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715126016 00000100:00100000:3.0:1788201037.652009:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715126144 00000100:00100000:3.0:1788201037.652040:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715126144 00000100:00100000:3.0:1788201037.652058:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715126272 00000100:00100000:3.0:1788201037.652062:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715126272 00000100:00100000:3.0:1788201037.652074:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715126784 00000100:00100000:3.0:1788201037.652077:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715126784 00000100:00100000:3.0:1788201037.652088:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715127296 00000100:00100000:3.0:1788201037.652090:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715127296 00000100:00100000:3.0:1788201037.652105:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:3.0:1788201037.652112:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715125888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201037.652162:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715125888:12345-0@lo:400:kworker.0 Request processed in 51us (4681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201037.652169:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00100000:3.0:1788201037.652186:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:3.0:1788201037.652193:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715126016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201037.652219:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715126016:12345-0@lo:400:kworker.0 Request processed in 27us (4632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201037.652225:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:3.0:1788201037.652236:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:3.0:1788201037.652243:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00393ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715126144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201037.652656:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715125760 00000100:00100000:2.0:1788201037.652661:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715125760 00000100:00100000:2.0:1788201037.652691:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788201037.652697:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715125760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201037.652736:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715125760:12345-0@lo:400:kworker.0 Request processed in 39us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201037.652742:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788201037.652766:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715126656 00000100:00100000:2.0:1788201037.652769:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715126656 00000100:00100000:2.0:1788201037.652790:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715127168 00000100:00100000:2.0:1788201037.652792:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715127168 00000100:00100000:2.0:1788201037.652807:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2718 00000100:00100000:2.0:1788201037.652812:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00393e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715126656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201037.652837:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00393e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715126656:12345-0@lo:400:kworker.0 Request processed in 26us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201037.652842:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2718 00000100:00100000:2.0:1788201037.652851:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2719 00000100:00100000:2.0:1788201037.652856:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00393e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715127168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201037.652876:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00393e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715127168:12345-0@lo:400:kworker.0 Request processed in 21us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201037.652881:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2719 00000100:00100000:2.0:1788201037.652904:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:1.0:1788201037.653455:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:1.0:1788201037.653466:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00393d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715126784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201037.653508:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00393d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715126784:12345-0@lo:400:kworker.0 Request processed in 46us (1703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201037.653515:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00100000:1.0:1788201037.653531:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:1.0:1788201037.653550:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00393f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715127296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201037.653581:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00393f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715127296:12345-0@lo:400:kworker.0 Request processed in 43us (1737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201037.653587:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00080000:1.0:1788201037.653631:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201037.653636:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201037.653638:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201037.653668:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715126016:0@lo:400:kworker.0 00000100:00100000:1.0:1788201037.653693:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715125888:0@lo:400:kworker.0 00000100:00100000:1.0:1788201037.653744:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715125760:0@lo:400:kworker.0 00000100:00100000:1.0:1788201037.653755:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715126784:0@lo:400:kworker.0 00000100:00100000:1.0:1788201037.653765:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715127296:0@lo:400:kworker.0 00000100:00100000:1.0:1788201037.653774:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715126656:0@lo:400:kworker.0 00000100:00100000:1.0:1788201037.653783:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715127168:0@lo:400:kworker.0 00000100:00100000:2.0:1788201037.654035:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00393f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715126272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201037.654076:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00393f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715126272:12345-0@lo:400:kworker.0 Request processed in 1158us (2312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201037.654082:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00100000:3.0:1788201037.655054:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00393ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715126144:12345-0@lo:400:kworker.0 Request processed in 2808us (3514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201037.655065:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00100000:0.0:1788201037.656462:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201037.656483:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc139ba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715127424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201037.656605:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201037.656658:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715127424 00000100:00100000:0.0:1788201037.656665:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715127424 00000100:00100000:0.0:1788201037.656710:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3916 00000100:00100000:0.0:1788201037.656719:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715127424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201037.656749:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:0.0:1788201037.656795:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715127424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201037.656801:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3916 00000100:00100000:0.0:1788201037.656845:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc139ba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715127424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201037.657495:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715126272:0@lo:400:kworker.0 00000100:00100000:1.0:1788201037.657509:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715126144:0@lo:400:kworker.0 00000100:00100000:1.0:1788201038.159522:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201038.159770:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201038.159791:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137ced880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715127680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201038.159876:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201038.159943:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715127680 00000100:00100000:2.0:1788201038.159951:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715127680 00000100:00100000:2.0:1788201038.160007:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3917 00000100:00100000:2.0:1788201038.160033:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715127680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201038.160069:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444966400 avail 1298726912 00000100:00100000:1.0:1788201038.160210:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715127552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201038.161691:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715127680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1670us (1809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201038.161705:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3917 00000100:00100000:1.0:1788201038.162464:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201038.162556:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201038.162572:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715127808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201038.162606:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201038.162640:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715127552 00000100:00100000:1.0:1788201038.162647:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715127552 00000100:00100000:1.0:1788201038.162807:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715127808 00000100:00100000:1.0:1788201038.162811:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715127808 00000100:00100000:1.0:1788201038.162828:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2208 00000100:00100000:1.0:1788201038.162836:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140295880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715127552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201038.162867:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201038.162914:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140295880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715127552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201038.162936:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2208 00000100:00100000:1.0:1788201038.162952:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2209 00000100:00100000:1.0:1788201038.162959:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140297b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715127808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201038.162973:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201038.163006:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140297b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715127808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201038.163012:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2209 00000100:00100000:1.0:1788201038.163074:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715127808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201038.163107:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715127552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201038.169825:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137ced880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715127680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201038.296950:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201038.296999:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201038.297090:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201038.297123:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201038.297155:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201038.297194:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695368448 00000100:00100000:3.0:1788201038.297203:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695368448 00000100:00100000:3.0:1788201038.297275:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695368320 00000100:00100000:3.0:1788201038.297279:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695368320 00000100:00100000:3.0:1788201038.297317:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1277 00000100:00100000:3.0:1788201038.297328:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00393ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695368448:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201038.297443:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00393ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695368448:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 117us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201038.297452:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1277 00000100:00100000:3.0:1788201038.297472:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1278 00000100:00100000:3.0:1788201038.297478:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00393d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+10:2400:x1875060695368320:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201038.297503:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00393d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+10:2400:x1875060695368320:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201038.297509:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1278 00000100:00100000:3.0:1788201038.297541:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695368704 00000100:00100000:3.0:1788201038.297545:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695368704 00000100:00100000:3.0:1788201038.297572:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695368576 00000100:00100000:3.0:1788201038.297575:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695368576 00000100:00100000:3.0:1788201038.297596:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2720 00000100:00100000:3.0:1788201038.297603:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00393d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:4292087e-fa00-4621-b681-837afc99ae35+5:2400:x1875060695368704:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201038.297629:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00393d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:4292087e-fa00-4621-b681-837afc99ae35+5:2400:x1875060695368704:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201038.297635:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2720 00000100:00100000:3.0:1788201038.297645:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2721 00000100:00100000:3.0:1788201038.297652:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00393df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:4292087e-fa00-4621-b681-837afc99ae35+5:2400:x1875060695368576:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201038.297671:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00393df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:4292087e-fa00-4621-b681-837afc99ae35+5:2400:x1875060695368576:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 20us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201038.297677:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2721 00000100:00080000:3.0:1788201038.297692:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201038.297695:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201038.297698:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201038.297706:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201038.298056:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695368192 00000100:00100000:1.0:1788201038.298061:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695368192 00000100:00100000:1.0:1788201038.298093:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 83 00000100:00100000:1.0:1788201038.298100:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2400:x1875060695368192:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201038.298128:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2400:x1875060695368192:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 29us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201038.298135:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 83 00000001:02000400:3.0:1788201038.540074:0:89985:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 132a: PFL new component instantiate replay ========================================================== 14:30:36 (1788201036) 00010000:00010000:1.0:1788201038.611094:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201038.680369:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201038.680408:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695368832 00000100:00100000:0.0:1788201038.680418:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695368832 00000100:00100000:0.0:1788201038.680474:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1232 00000100:00100000:0.0:1788201038.680484:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+10:69489:x1875060695368832:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788201038.680505:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201038.680524:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339000/0x96d0c9b8c9a1b43a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786665 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.680588:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338c00/0x96d0c9b8c9a1b441 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.680609:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338c00/0x96d0c9b8c9a1b441 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.680620:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338c00/0x96d0c9b8c9a1b441 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.680635:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339400/0x96d0c9b8c9a1b448 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.680641:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339400/0x96d0c9b8c9a1b448 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.680662:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339400/0x96d0c9b8c9a1b448 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.680709:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338c00/0x96d0c9b8c9a1b441 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.680716:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338c00/0x96d0c9b8c9a1b441 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.680722:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338c00/0x96d0c9b8c9a1b441 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.680729:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338c00/0x96d0c9b8c9a1b441 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.680735:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f338c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201038.680740:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338c00/0x96d0c9b8c9a1b441 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.680748:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338c00/0x96d0c9b8c9a1b441 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.680766:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a1b700) 00010000:00010000:0.0:1788201038.680769:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201038.680774:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338c00/0x96d0c9b8c9a1b441 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.680781:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338c00/0x96d0c9b8c9a1b441 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.680792:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339400/0x96d0c9b8c9a1b448 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.680799:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339400/0x96d0c9b8c9a1b448 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.680805:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339400/0x96d0c9b8c9a1b448 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.680811:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201038.680814:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339400/0x96d0c9b8c9a1b448 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.680820:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339400/0x96d0c9b8c9a1b448 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.680827:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8dc103a1be00) 00010000:00010000:0.0:1788201038.680829:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201038.680832:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339400/0x96d0c9b8c9a1b448 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.680837:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339400/0x96d0c9b8c9a1b448 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.680880:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339000/0x96d0c9b8c9a1b43a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786665 expref: 11 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.680890:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a1b700) 00010000:00010000:0.0:1788201038.680893:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201038.680897:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339000/0x96d0c9b8c9a1b43a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786665 expref: 11 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.680906:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12f339000, rc 0) 00000100:00100000:0.0:1788201038.680958:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+10:69489:x1875060695368832:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 476us (600us total) trans 0 rc 301/301 00000100:00100000:0.0:1788201038.680966:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1232 00000100:00100000:2.0:1788201038.690532:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201038.695383:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695369088 00000100:00100000:0.0:1788201038.695400:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695369088 00000100:00100000:0.0:1788201038.695477:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1233 00000100:00100000:0.0:1788201038.695488:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+10:69489:x1875060695369088:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788201038.695512:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201038.695515:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788201038.695544:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b3f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786642 expref: 10 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.695562:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a1b700) 00010000:00010000:0.0:1788201038.695575:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201038.695592:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339e00/0x96d0c9b8c9a1b44f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78666c expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.696450:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1b456 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.696468:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1b456 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.696480:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1b456 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.696494:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338400/0x96d0c9b8c9a1b45d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.696501:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338400/0x96d0c9b8c9a1b45d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.696509:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338400/0x96d0c9b8c9a1b45d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.696914:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339a00/0x96d0c9b8c9a1b464 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.696923:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339a00/0x96d0c9b8c9a1b464 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.696931:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339a00/0x96d0c9b8c9a1b464 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201038.696941:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 0 00010000:00010000:0.0:1788201038.696965:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1b456 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.696972:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1b456 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.696988:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1b456 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.696995:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1b456 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.697001:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201038.697006:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1b456 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.697041:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1b456 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.697054:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a1b100) 00010000:00010000:0.0:1788201038.697058:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201038.697062:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1b456 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.697069:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1b456 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201038.697081:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6d0d8be reply state 000000001037e7b8 transno 111669149700 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338400/0x96d0c9b8c9a1b45d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.697092:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338400/0x96d0c9b8c9a1b45d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.697099:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8dc103a1b300) 00010000:00010000:0.0:1788201038.697502:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201038.697507:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201038.697541:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339e00/0x96d0c9b8c9a1b44f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78666c expref: 12 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.697571:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339a00/0x96d0c9b8c9a1b464 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78666c expref: 11 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201038.697578:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8dc103a1bf00) 00010000:00010000:0.0:1788201038.697580:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201038.697583:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12f339a00, rc 0) 00000100:00100000:0.0:1788201038.697668:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+12:69489:x1875060695369088:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 2181us (7144us total) trans 111669149700 rc 0/0 00000100:00100000:0.0:1788201038.697677:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1233 00000100:00100000:0.0:1788201038.706514:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201038.706632:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695369344 00000100:00100000:1.0:1788201038.706641:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695369344 00000100:00100000:1.0:1788201038.706703:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1234 00000100:00100000:1.0:1788201038.706714:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+12:69489:x1875060695369344:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1788201038.706739:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201038.706762:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d000/0x96d0c9b8c9a1b472 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786673 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.706897:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c200/0x96d0c9b8c9a1b479 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.706911:0:66314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339a00/0x96d0c9b8c9a1b464 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78666c expref: 13 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.706920:0:66314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c200/0x96d0c9b8c9a1b479 lrc: 4/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.706953:0:66314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339a00/0x96d0c9b8c9a1b464 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78666c expref: 13 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.706965:0:66314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339a00/0x96d0c9b8c9a1b464 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78666c expref: 13 pid: 66313 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201038.706978:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140296d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66314:1875060715127936:192.168.201.20@tcp:104: 00000100:00100000:1.0:1788201038.707078:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103892c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201038.710591:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201038.710685:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140296d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66314:1875060715127936:192.168.201.20@tcp:104: 00010000:00010000:3.0:1788201038.710716:0:66314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c200/0x96d0c9b8c9a1b479 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201038.712234:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695369472 00000100:00100000:1.0:1788201038.712245:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695369472 00010000:00010000:1.0:1788201038.712283:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339a00/0x96d0c9b8c9a1b464 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78666c expref: 14 pid: 66313 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201038.712324:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2555 00000100:00100000:1.0:1788201038.712334:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4292087e-fa00-4621-b681-837afc99ae35+14:2400:x1875060695369472:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201038.712359:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201038.712374:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339a00/0x96d0c9b8c9a1b464 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78666c expref: 14 pid: 66313 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.712388:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339a00/0x96d0c9b8c9a1b464 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78666c expref: 14 pid: 66313 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.712413:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339a00/0x96d0c9b8c9a1b464 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78666c expref: 14 pid: 66313 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.712428:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8dc103a1bf00) 00010000:00010000:1.0:1788201038.712434:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c200/0x96d0c9b8c9a1b479 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.712443:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c200/0x96d0c9b8c9a1b479 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.712451:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c200/0x96d0c9b8c9a1b479 lrc: 4/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201038.712484:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201038.712537:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4292087e-fa00-4621-b681-837afc99ae35+13:2400:x1875060695369472:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 205us (1957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201038.712545:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2555 00010000:00010000:2.0:1788201038.712771:0:66314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c200/0x96d0c9b8c9a1b479 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.712780:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c200/0x96d0c9b8c9a1b479 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201038.712798:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 0 00000004:00080000:2.0:1788201038.712946:0:66314:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x2a3:0x0], count =127 00000004:00080000:2.0:1788201038.712954:0:66314:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x2a3:0x0]+127 in llog 00000004:00080000:2.0:1788201038.712989:0:66314:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x322:0x0], index 1: 0 00010000:00010000:2.0:1788201038.713132:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c200/0x96d0c9b8c9a1b479 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.713152:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c200/0x96d0c9b8c9a1b479 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.713160:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c200/0x96d0c9b8c9a1b479 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.713166:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2c200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201038.713171:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c200/0x96d0c9b8c9a1b479 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.713179:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c200/0x96d0c9b8c9a1b479 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.713190:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8dc103a1bf00) 00010000:00010000:2.0:1788201038.713193:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201038.713197:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c200/0x96d0c9b8c9a1b479 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.713219:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c200/0x96d0c9b8c9a1b479 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.713273:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d000/0x96d0c9b8c9a1b472 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786673 expref: 13 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.713284:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12066fb00) 00010000:00010000:2.0:1788201038.713286:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201038.713290:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d000/0x96d0c9b8c9a1b472 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786673 expref: 13 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201038.713303:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2d000, rc 0) 00000100:00100000:2.0:1788201038.713352:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+12:69489:x1875060695369344:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 6630us (6840us total) trans 111669149701 rc 301/301 00000100:00100000:2.0:1788201038.713360:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1234 00000100:00100000:1.0:1788201038.716689:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201038.720626:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695369728 00000100:00100000:3.0:1788201038.720645:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695369728 00000100:00100000:3.0:1788201038.720710:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 225 00000100:00100000:3.0:1788201038.720720:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4292087e-fa00-4621-b681-837afc99ae35+12:69489:x1875060695369728:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:3.0:1788201038.721052:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4292087e-fa00-4621-b681-837afc99ae35+13:69489:x1875060695369728:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 332us (4370us total) trans 111669149702 rc 0/0 00000100:00100000:3.0:1788201038.721059:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 225 00000100:00100000:1.0:1788201038.728583:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201038.728677:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695369984 00000100:00100000:3.0:1788201038.728687:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695369984 00000100:00100000:3.0:1788201038.728748:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 226 00000100:00100000:3.0:1788201038.728760:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4292087e-fa00-4621-b681-837afc99ae35+13:69489:x1875060695369984:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:3.0:1788201038.728996:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4292087e-fa00-4621-b681-837afc99ae35+14:69489:x1875060695369984:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 238us (425us total) trans 111669149703 rc 0/0 00000100:00100000:3.0:1788201038.729004:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 226 00000001:00080000:2.0:1788201039.603580:0:89112:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149703 is committed 00010000:00010000:0.0:1788201039.609315:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338400/0x96d0c9b8c9a1b45d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201039.609340:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338400/0x96d0c9b8c9a1b45d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201039.609347:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338400/0x96d0c9b8c9a1b45d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201039.609353:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f338400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201039.609357:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338400/0x96d0c9b8c9a1b45d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201039.609364:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338400/0x96d0c9b8c9a1b45d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201039.609384:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8dc103a1b300) 00010000:00010000:0.0:1788201039.609387:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201039.609405:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338400/0x96d0c9b8c9a1b45d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201039.609412:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338400/0x96d0c9b8c9a1b45d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201039.633238:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201039.662300:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201039.669930:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695370112 00000100:00100000:3.0:1788201039.669946:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695370112 00000100:00100000:3.0:1788201039.672066:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1235 00000100:00100000:3.0:1788201039.672097:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+9:69498:x1875060695370112:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1788201039.672123:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201039.672146:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1b487 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78667a expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.672219:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1b48e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.672233:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1b48e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.672244:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1b48e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201039.672289:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788201039.672293:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201039.672311:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1b48e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.672345:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1b487 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78667a expref: 11 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.672361:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1b48e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78667a expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.672369:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048be400) 00010000:00010000:3.0:1788201039.672371:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201039.672374:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064edc00, rc 0) 00000100:00100000:3.0:1788201039.672443:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+10:69498:x1875060695370112:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 365us (10151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201039.672451:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1235 00000100:00100000:1.0:1788201039.687700:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201039.687829:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695370240 00000100:00100000:0.0:1788201039.687840:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695370240 00000100:00100000:0.0:1788201039.687897:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1236 00000100:00100000:0.0:1788201039.687907:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+10:69498:x1875060695370240:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:0.0:1788201039.687944:0:66313:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444966400 avail 1298726912 00000100:00100000:0.0:1788201039.688013:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+10:69498:x1875060695370240:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 107us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201039.688046:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1236 00000100:00100000:0.0:1788201039.693405:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201039.693494:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695370368 00000100:00100000:3.0:1788201039.693504:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695370368 00000100:00100000:3.0:1788201039.693582:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1237 00000100:00100000:3.0:1788201039.693595:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:69498:x1875060695370368:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:3.0:1788201039.693634:0:66314:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:3.0:1788201039.693836:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+6:69498:x1875060695370368:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 243us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201039.693845:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1237 00000100:00100000:2.0:1788201039.703129:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201039.703275:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695370496 00000100:00100000:3.0:1788201039.703286:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695370496 00000100:00100000:3.0:1788201039.703362:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2210 00000100:00100000:3.0:1788201039.703373:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:69498:x1875060695370496:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:3.0:1788201039.703405:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201039.703476:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:69498:x1875060695370496:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 104us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201039.703484:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2210 00000100:00100000:1.0:1788201039.709789:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201039.709931:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695370624 00000100:00100000:2.0:1788201039.709941:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695370624 00000100:00100000:2.0:1788201039.710001:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2211 00000100:00100000:2.0:1788201039.710046:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:69498:x1875060695370624:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:2.0:1788201039.710079:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201039.710159:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+5:69498:x1875060695370624:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 148us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201039.710167:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2211 00000100:00100000:3.0:1788201039.845958:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201039.846173:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695370880 00000100:00100000:0.0:1788201039.846184:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695370880 00000100:00100000:2.0:1788201039.846482:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1238 00000100:00100000:2.0:1788201039.846496:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+10:69505:x1875060695370880:12345-192.168.201.20@tcp:36:mcreate.0 00010000:00010000:2.0:1788201039.846552:0:66757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201039.846579:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1b48e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78667a expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201039.846599:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048be400) 00010000:00010000:2.0:1788201039.846610:0:66757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201039.846689:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdd400/0x96d0c9b8c9a1b495 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201039.846780:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdd400/0x96d0c9b8c9a1b495 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201039.846808:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdd400/0x96d0c9b8c9a1b495 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201039.846823:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdde00/0x96d0c9b8c9a1b49c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201039.846831:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdde00/0x96d0c9b8c9a1b49c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201039.846837:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdde00/0x96d0c9b8c9a1b49c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201039.847457:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdd400/0x96d0c9b8c9a1b495 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201039.847466:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdd400/0x96d0c9b8c9a1b495 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201039.847472:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdd400/0x96d0c9b8c9a1b495 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201039.847479:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdd400/0x96d0c9b8c9a1b495 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201039.847485:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdd400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201039.847489:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdd400/0x96d0c9b8c9a1b495 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201039.847497:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdd400/0x96d0c9b8c9a1b495 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201039.847507:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc006d06a00) 00010000:00010000:2.0:1788201039.847517:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201039.847521:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdd400/0x96d0c9b8c9a1b495 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201039.847528:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdd400/0x96d0c9b8c9a1b495 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201039.847547:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e6ed933 reply state 0000000010ade1bc transno 111669149704 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdde00/0x96d0c9b8c9a1b49c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201039.847559:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdde00/0x96d0c9b8c9a1b49c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201039.847565:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc006d06500) 00010000:00010000:2.0:1788201039.847567:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201039.847571:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201039.847889:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+11:69505:x1875060695370880:12345-192.168.201.20@tcp:36:mcreate.0 Request processed in 1394us (1938us total) trans 111669149704 rc 0/0 00000100:00100000:2.0:1788201039.847898:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1238 00000100:00100000:2.0:1788201039.871192:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201039.872766:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695371008 00000100:00100000:3.0:1788201039.872779:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695371008 00000100:00100000:3.0:1788201039.873447:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1239 00000100:00100000:3.0:1788201039.873460:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+11:69508:x1875060695371008:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:3.0:1788201039.873485:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201039.873508:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1b4a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786681 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.873574:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b4aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.873588:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b4aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.873612:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b4aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201039.873668:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788201039.873672:0:69485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201039.873695:0:69485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b4aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.873731:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1b4a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786681 expref: 13 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.873748:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b4aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786681 expref: 12 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.873758:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048beb00) 00010000:00010000:3.0:1788201039.873761:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201039.873765:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ec200, rc 0) 00000100:00100000:3.0:1788201039.873835:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+12:69508:x1875060695371008:12345-192.168.201.20@tcp:101:rm.0 Request processed in 378us (2651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201039.873842:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1239 00000100:00100000:3.0:1788201039.880169:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201039.880217:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695371136 00000100:00100000:3.0:1788201039.880227:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695371136 00000100:00100000:3.0:1788201039.880277:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1240 00000100:00100000:3.0:1788201039.880286:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+12:69508:x1875060695371136:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:3.0:1788201039.880305:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201039.880336:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1b4b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786688 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.880413:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1b4b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.880428:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1b4b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.880440:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1b4b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.880451:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d800/0x96d0c9b8c9a1b4bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.880458:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d800/0x96d0c9b8c9a1b4bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.880465:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d800/0x96d0c9b8c9a1b4bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.880543:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1b4c6 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.880552:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1b4c6 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.880558:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1b4c6 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201039.880601:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0xa:0x0]: returning size 0 00000004:00200000:3.0:1788201039.880605:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201039.880622:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1b4c6 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.880655:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1b4c6 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.880665:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1b4b8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.880673:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1b4b8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.880680:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1b4b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.880688:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1b4b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.880694:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064edc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201039.880959:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1b4b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.880969:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1b4b8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.880983:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048beb00) 00010000:00010000:3.0:1788201039.880986:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201039.880991:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1b4b8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.880999:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1b4b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.881040:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d800/0x96d0c9b8c9a1b4bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.881053:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d800/0x96d0c9b8c9a1b4bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.881060:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d800/0x96d0c9b8c9a1b4bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.881066:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201039.881069:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d800/0x96d0c9b8c9a1b4bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.881076:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d800/0x96d0c9b8c9a1b4bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.881095:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc006d06500) 00010000:00010000:3.0:1788201039.881098:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201039.881101:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d800/0x96d0c9b8c9a1b4bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.881107:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d800/0x96d0c9b8c9a1b4bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.881133:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1b4b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786688 expref: 14 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.881147:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1b4c6 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786688 expref: 13 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.881153:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff8dc0048be100) 00010000:00010000:3.0:1788201039.881155:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201039.881163:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782da00, rc 0) 00000100:00100000:3.0:1788201039.881342:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+13:69508:x1875060695371136:12345-192.168.201.20@tcp:101:rm.0 Request processed in 1055us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201039.881351:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1240 00000100:00100000:0.0:1788201039.885288:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201039.885369:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695371392 00000100:00100000:3.0:1788201039.885379:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695371392 00000100:00100000:3.0:1788201039.885439:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1241 00000100:00100000:3.0:1788201039.885450:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+13:69508:x1875060695371392:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:3.0:1788201039.885505:0:66757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788201039.885532:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1b4c6 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786688 expref: 13 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.885551:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff8dc0048be100) 00010000:00010000:3.0:1788201039.885567:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1b4aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786681 expref: 12 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.885577:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048beb00) 00010000:00010000:3.0:1788201039.885582:0:66757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201039.885605:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1b4cd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.885617:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1b4cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.885635:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1b4cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.885649:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1b4d4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.885675:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1b4d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.885682:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1b4d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.885768:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1b4db lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.885776:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1b4db lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.885783:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1b4db lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.885957:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1b4e2 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.885966:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1b4e2 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.885975:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1b4e2 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.885982:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1b4e2 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.885988:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1b4e2 lrc: 4/0,1 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.885994:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1b4e2 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.886062:0:66757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201039.886080:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1b4db lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.886086:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1b4db lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.886092:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1b4db lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.886098:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782cc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201039.886102:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1b4db lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.886109:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1b4db lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.886117:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff8dc0048be500) 00010000:00010000:3.0:1788201039.886119:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201039.886123:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1b4db lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.886128:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1b4db lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.886145:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1b4cd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.886152:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1b4cd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.886157:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1b4cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.886170:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1b4cd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.886175:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201039.886177:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1b4cd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.886184:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1b4cd lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.886191:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048bed00) 00010000:00010000:3.0:1788201039.886194:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201039.886197:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1b4cd lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.886202:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1b4cd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201039.886214:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000012cfe4bb reply state 000000001b3391ad transno 111669149705 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1b4d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.886224:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1b4d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201039.886229:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc006d06500) 00010000:00010000:3.0:1788201039.886231:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201039.886234:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201039.886300:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+13:69508:x1875060695371392:12345-192.168.201.20@tcp:36:rm.0 Request processed in 851us (1021us total) trans 111669149705 rc 0/0 00000100:00100000:3.0:1788201039.886308:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1241 00010000:00010000:0.0:1788201039.886578:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201039.886585:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1b4e2 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201039.886592:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201039.886595:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1b4e2 lrc: 2/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201039.886602:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1b4e2 lrc: 3/0,0 mode: PW/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201039.886611:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff8dc0048be500) 00010000:00010000:0.0:1788201039.886620:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201039.886623:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1b4e2 lrc: 1/0,0 mode: --/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201039.886629:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1b4e2 lrc: 0/0,0 mode: --/PW res: [0x20000afe1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201039.886643:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201039.886645:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201039.886647:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201040.208030:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201040.220411:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715128192:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201040.220490:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201040.220534:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715128192 00000100:00100000:0.0:1788201040.220543:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715128192 00000100:00100000:0.0:1788201040.220600:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2212 00000100:00100000:0.0:1788201040.220612:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715128192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201040.220654:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201040.220698:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715128192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201040.220706:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2212 00000100:00080000:0.0:1788201040.221993:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201040.222071:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715128192:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201040.222804:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715128064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201040.222858:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201040.225374:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715128064 00000100:00100000:3.0:1788201040.225389:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715128064 00000100:00100000:3.0:1788201040.225454:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2213 00000100:00100000:3.0:1788201040.225466:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715128064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201040.225492:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201040.225561:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715128064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (2702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201040.225569:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2213 00000100:00080000:0.0:1788201040.226900:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201040.226958:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715128064:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788201040.658929:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201041.679358:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201042.712645:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201042.767310:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715128448:0@lo:400:kworker.0 00000100:00100000:1.0:1788201042.767313:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715128320:0@lo:400:kworker.0 00000100:00100000:3.0:1788201042.767367:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715128576:0@lo:400:kworker.0 00000100:00100000:2.0:1788201042.767392:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201042.767399:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201042.770866:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715128704:0@lo:400:kworker.0 00000100:00100000:3.0:1788201042.772245:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715128448 00000100:00100000:3.0:1788201042.772256:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715128448 00000100:00100000:3.0:1788201042.773523:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:3.0:1788201042.773541:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715128448:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788201042.773570:0:69485:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc137cec700 x1875060715128448/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:163/0 lens 224/224 e 0 to 0 dl 1788201053 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201042.773634:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715128448:12345-0@lo:400:kworker.0 Request processed in 100us (6243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201042.773641:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00080000:3.0:1788201042.773695:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201042.773748:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715128320 00000100:00100000:3.0:1788201042.773753:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715128320 00000100:00100000:3.0:1788201042.773790:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788201042.773797:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715128320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201042.773833:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715128320:12345-0@lo:400:kworker.0 Request processed in 37us (6443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201042.773839:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788201042.786496:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201042.786554:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715129088:0@lo:400:kworker.0 00000100:00100000:2.0:1788201042.786615:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201042.786642:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715129600:0@lo:400:kworker.0 00000100:00100000:2.0:1788201042.786676:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201042.787211:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715129088 00000100:00100000:2.0:1788201042.787227:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715129088 00000100:00100000:2.0:1788201042.787299:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715129600 00000100:00100000:2.0:1788201042.787303:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715129600 00000100:00100000:2.0:1788201042.787332:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2722 00000100:00100000:2.0:1788201042.787341:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715129088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201042.787400:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715129088:12345-0@lo:400:kworker.0 Request processed in 60us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201042.787408:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2722 00000100:00100000:2.0:1788201042.787426:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2723 00000100:00100000:2.0:1788201042.787433:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715129600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201042.787461:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715129600:12345-0@lo:400:kworker.0 Request processed in 29us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201042.787467:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2723 00000100:00100000:1.0:1788201042.787521:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715128320:0@lo:400:kworker.0 00000100:00100000:1.0:1788201042.787531:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715128832:0@lo:400:kworker.0 00000100:00100000:1.0:1788201042.787563:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201042.787587:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715128576 00000100:00100000:1.0:1788201042.787591:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715128576 00000100:00100000:1.0:1788201042.787617:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715128832 00000100:00100000:1.0:1788201042.787620:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715128832 00000100:00080000:2.0:1788201042.787639:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201042.787645:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201042.787647:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:1.0:1788201042.787655:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715128576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201042.787677:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715129088:0@lo:400:kworker.0 00000100:00100000:1.0:1788201042.787697:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715128576:12345-0@lo:400:kworker.0 Request processed in 40us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201042.787697:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715129600:0@lo:400:kworker.0 00000100:00100000:1.0:1788201042.787710:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00100000:1.0:1788201042.787729:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1281 00000100:00100000:2.0:1788201042.787736:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715128576:0@lo:400:kworker.0 00000100:00100000:1.0:1788201042.787740:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715128832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201042.787771:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715128832:12345-0@lo:400:kworker.0 Request processed in 36us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201042.787778:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1281 00000100:00100000:1.0:1788201042.787811:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715128832:0@lo:400:kworker.0 00000100:00100000:1.0:1788201042.787831:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715129344:0@lo:400:kworker.0 00000100:00100000:1.0:1788201042.787859:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201042.787880:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715129344 00000100:00100000:1.0:1788201042.787883:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715129344 00000100:00100000:1.0:1788201042.787903:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:1.0:1788201042.787908:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715129344:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788201042.787928:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004eb5880 x1875060715129344/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:163/0 lens 224/224 e 0 to 0 dl 1788201053 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201042.787954:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715129344:12345-0@lo:400:kworker.0 Request processed in 46us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201042.787959:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:1.0:1788201042.787986:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715129344:0@lo:400:kworker.0 00000100:00100000:1.0:1788201042.787995:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715129856:0@lo:400:kworker.0 00000100:00100000:1.0:1788201042.788040:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201042.788059:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715129856 00000100:00100000:1.0:1788201042.788062:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715129856 00000100:00100000:1.0:1788201042.788085:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:1.0:1788201042.788092:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715129856:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788201042.788115:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004eb5500 x1875060715129856/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:163/0 lens 224/224 e 0 to 0 dl 1788201053 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201042.788143:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715129856:12345-0@lo:400:kworker.0 Request processed in 52us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201042.788149:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00100000:1.0:1788201042.788176:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715129856:0@lo:400:kworker.0 00000100:00100000:1.0:1788201042.788190:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788201042.788196:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715129472:0@lo:400:kworker.0 00000100:00100000:1.0:1788201042.788221:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201042.788248:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715129984:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201042.788277:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201042.788319:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715129472 00000100:00100000:1.0:1788201042.788328:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715129472 00000100:00100000:1.0:1788201042.788354:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715129984 00000100:00100000:1.0:1788201042.788357:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715129984 00000100:00100000:1.0:1788201042.788374:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3918 00000100:00100000:1.0:1788201042.788380:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715129472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201042.788415:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715129472:12345-0@lo:400:kworker.0 Request processed in 36us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201042.788422:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3918 00000100:00100000:1.0:1788201042.788434:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3919 00000100:00100000:1.0:1788201042.788440:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715129984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201042.788464:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:1.0:1788201042.788495:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715129984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201042.788500:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3919 00000100:00100000:1.0:1788201042.788534:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715129472:0@lo:400:kworker.0 00000100:00100000:1.0:1788201042.788547:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715129984:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201042.794144:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201042.794306:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715128704 00000100:00100000:0.0:1788201042.794316:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715128704 00000100:00100000:0.0:1788201042.794385:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:0.0:1788201042.794395:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715128704:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788201042.794420:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11cb51c00 x1875060715128704/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:163/0 lens 224/224 e 0 to 0 dl 1788201053 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201042.794459:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715128704:12345-0@lo:400:kworker.0 Request processed in 67us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201042.794466:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00080000:0.0:1788201042.794489:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201042.794535:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715128704:0@lo:400:kworker.0 00000100:00100000:0.0:1788201042.794547:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715129216:0@lo:400:kworker.0 00000100:00100000:0.0:1788201042.794576:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201042.794601:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715129216 00000100:00100000:0.0:1788201042.794605:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715129216 00000100:00100000:0.0:1788201042.794638:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2724 00000100:00100000:0.0:1788201042.794644:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715129216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201042.794677:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715129216:12345-0@lo:400:kworker.0 Request processed in 33us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201042.794684:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2724 00000100:00080000:0.0:1788201042.794698:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201042.794717:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715129216:0@lo:400:kworker.0 00000100:00100000:0.0:1788201042.794725:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715129728:0@lo:400:kworker.0 00000100:00100000:0.0:1788201042.794747:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201042.794779:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715129728 00000100:00100000:0.0:1788201042.794783:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715129728 00000100:00100000:0.0:1788201042.794813:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2725 00000100:00100000:0.0:1788201042.794820:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715129728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201042.794850:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715129728:12345-0@lo:400:kworker.0 Request processed in 30us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201042.794855:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2725 00000100:00080000:0.0:1788201042.794868:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201042.794888:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715129728:0@lo:400:kworker.0 00000100:00100000:0.0:1788201042.794976:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715128448:0@lo:400:kworker.0 00000100:00100000:0.0:1788201042.794984:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715128960:0@lo:400:kworker.0 00000100:00100000:0.0:1788201042.795011:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201042.795087:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715128960 00000100:00100000:0.0:1788201042.795091:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715128960 00000100:00100000:0.0:1788201042.795432:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3920 00000100:00100000:0.0:1788201042.795440:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715128960:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788201042.795458:0:8458:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004b38a80 x1875060715128960/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:163/0 lens 224/224 e 0 to 0 dl 1788201053 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201042.795488:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715128960:12345-0@lo:400:kworker.0 Request processed in 49us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201042.795494:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3920 00000100:00100000:0.0:1788201042.795593:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715128960:0@lo:400:kworker.0 00000100:00100000:3.0:1788201043.279280:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201043.279302:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715130112:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201043.279374:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201043.279665:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715130112 00000100:00100000:1.0:1788201043.279674:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715130112 00000100:00100000:1.0:1788201043.279727:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3921 00000100:00100000:1.0:1788201043.279736:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715130112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201043.279771:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444966400 avail 1298726912 00010000:00000080:1.0:1788201043.279787:0:8457:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004d71180 x1875060715130112/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:164/0 lens 224/368 e 0 to 0 dl 1788201054 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201043.279832:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715130112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201043.279839:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3921 00000100:00100000:1.0:1788201043.279906:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715130112:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201043.280303:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201043.280315:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715130368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201043.280354:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201043.280383:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715130368 00000100:00100000:3.0:1788201043.280387:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715130368 00000100:00100000:3.0:1788201043.280413:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2214 00000100:00100000:3.0:1788201043.280419:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715130368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201043.280440:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201043.280472:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715130368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201043.280479:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2214 00000100:00100000:3.0:1788201043.280512:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715130368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201043.280600:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201043.280610:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137ceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715130240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201043.280638:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201043.280697:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715130240 00000100:00100000:2.0:1788201043.280701:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715130240 00000100:00100000:2.0:1788201043.280729:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2215 00000100:00100000:2.0:1788201043.280735:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715130240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201043.280749:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201043.280785:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715130240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201043.280792:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2215 00000100:00100000:1.0:1788201043.281187:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137ceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715130240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201043.425671:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201043.425711:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201043.425745:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201043.425769:0:89116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695371520 00000100:00100000:3.0:1788201043.425779:0:89116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695371520 00000100:00100000:3.0:1788201043.425825:0:89116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00100000:3.0:1788201043.425833:0:89116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0037a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695371520:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201043.425898:0:89116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0037a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695371520:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 65us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201043.425905:0:89116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00100000:3.0:1788201043.425951:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201043.426094:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201043.426173:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695371648 00000100:00100000:1.0:1788201043.426177:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695371648 00000100:00100000:1.0:1788201043.426218:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695371776 00000100:00100000:1.0:1788201043.426229:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695371776 00000100:00100000:1.0:1788201043.426249:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1285 00000100:00100000:1.0:1788201043.426266:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+13:2401:x1875060695371648:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000080:1.0:1788201043.426291:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004d71f80 x1875060695371648/t0(0) o400->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:164/0 lens 224/224 e 0 to 0 dl 1788201054 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201043.426325:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+13:2401:x1875060695371648:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 70us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201043.426332:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1285 00000100:00100000:1.0:1788201043.426348:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1286 00000100:00100000:1.0:1788201043.426354:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695371776:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201043.426391:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695371776:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 37us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201043.426397:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1286 00000100:00100000:1.0:1788201043.426419:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695371904 00000100:00100000:1.0:1788201043.426422:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695371904 00000100:00100000:1.0:1788201043.426447:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695372032 00000100:00100000:1.0:1788201043.426450:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695372032 00000100:00100000:1.0:1788201043.426471:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2726 00000100:00100000:1.0:1788201043.426486:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4292087e-fa00-4621-b681-837afc99ae35+5:2401:x1875060695371904:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201043.426514:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4292087e-fa00-4621-b681-837afc99ae35+5:2401:x1875060695371904:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 30us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201043.426520:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2726 00000100:00100000:1.0:1788201043.426532:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2727 00000100:00100000:1.0:1788201043.426537:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4292087e-fa00-4621-b681-837afc99ae35+5:2401:x1875060695372032:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201043.426559:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4292087e-fa00-4621-b681-837afc99ae35+5:2401:x1875060695372032:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 22us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201043.426565:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2727 00000100:00080000:3.0:1788201043.427381:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201043.427387:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201043.427389:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201043.427392:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788201043.727416:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201044.753471:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201045.327270:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201045.327294:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715130496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201045.327368:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201045.327420:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715130496 00000100:00100000:3.0:1788201045.327427:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715130496 00000100:00100000:3.0:1788201045.327525:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2216 00000100:00100000:3.0:1788201045.327536:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715130496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201045.327580:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201045.327626:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715130496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201045.327633:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2216 00000100:00080000:3.0:1788201045.327655:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201045.327694:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715130496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201045.328488:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201045.328503:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715130624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201045.328554:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201045.332463:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715130624 00000100:00100000:3.0:1788201045.332478:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715130624 00000100:00080000:0.0:1788201045.332669:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201045.332810:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2217 00000100:00100000:3.0:1788201045.332823:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715130624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201045.332852:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201045.332934:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715130624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (4379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201045.332941:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2217 00000100:00100000:0.0:1788201045.333065:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715130624:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788201045.775784:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788201045.866771:0:89112:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149705 is committed 00010000:00010000:2.0:1788201045.867293:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdde00/0x96d0c9b8c9a1b49c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201045.867308:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdde00/0x96d0c9b8c9a1b49c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201045.867316:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdde00/0x96d0c9b8c9a1b49c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201045.867323:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdde00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201045.867328:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdde00/0x96d0c9b8c9a1b49c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201045.867336:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdde00/0x96d0c9b8c9a1b49c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201045.867353:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc006d06500) 00010000:00010000:2.0:1788201045.867357:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201045.867362:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdde00/0x96d0c9b8c9a1b49c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201045.867368:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdde00/0x96d0c9b8c9a1b49c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201045.867389:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1b4d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201045.867395:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1b4d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201045.867412:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1b4d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201045.867417:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201045.867420:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1b4d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201045.867426:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1b4d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201045.867435:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc006d06500) 00010000:00010000:2.0:1788201045.867437:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201045.867440:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1b4d4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201045.867445:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1b4d4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201046.799175:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201046.924976:0:90380:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:0.0:1788201047.076936:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201047.076980:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695372160 00000100:00100000:0.0:1788201047.076990:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695372160 00000100:00100000:0.0:1788201047.077072:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1242 00000100:00100000:0.0:1788201047.077084:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+9:69576:x1875060695372160:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:0.0:1788201047.077105:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201047.077127:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339a00/0x96d0c9b8c9a1b4e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78668f expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.077204:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1b4f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.077218:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1b4f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.077230:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1b4f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201047.077274:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201047.077278:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201047.077301:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1b4f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.077325:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339a00/0x96d0c9b8c9a1b4e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78668f expref: 11 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.077342:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1b4f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78668f expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.077349:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a1bf00) 00010000:00010000:0.0:1788201047.077365:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201047.077369:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12f339c00, rc 0) 00010000:00000080:0.0:1788201047.077378:0:66757:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004fa1880 x1875060695372160/t0(0) o101->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:168/0 lens 576/688 e 0 to 0 dl 1788201058 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201047.077459:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+10:69576:x1875060695372160:12345-192.168.201.20@tcp:101:dd.0 Request processed in 376us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201047.077466:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1242 00000100:00080000:0.0:1788201047.077492:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201047.094555:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201047.094630:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695372416 00000100:00100000:0.0:1788201047.094641:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695372416 00000100:00100000:0.0:1788201047.094706:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1243 00000100:00100000:0.0:1788201047.094716:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+10:69576:x1875060695372416:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:0.0:1788201047.094736:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201047.094739:0:69485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788201047.094765:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1b4f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78668f expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.094784:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a1bf00) 00010000:00010000:0.0:1788201047.094794:0:69485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201047.094808:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b4f7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786696 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.094935:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339000/0x96d0c9b8c9a1b4fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.094948:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339000/0x96d0c9b8c9a1b4fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.094958:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339000/0x96d0c9b8c9a1b4fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.094983:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339400/0x96d0c9b8c9a1b505 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.094991:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339400/0x96d0c9b8c9a1b505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.094998:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339400/0x96d0c9b8c9a1b505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.095092:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338c00/0x96d0c9b8c9a1b50c lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.095102:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338c00/0x96d0c9b8c9a1b50c lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.095109:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338c00/0x96d0c9b8c9a1b50c lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201047.095119:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 0 00010000:00010000:0.0:1788201047.095222:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339000/0x96d0c9b8c9a1b4fe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.095231:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339000/0x96d0c9b8c9a1b4fe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.095237:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339000/0x96d0c9b8c9a1b4fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.095244:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339000/0x96d0c9b8c9a1b4fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.095250:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201047.095261:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339000/0x96d0c9b8c9a1b4fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.095269:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339000/0x96d0c9b8c9a1b4fe lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.095279:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a1bb00) 00010000:00010000:0.0:1788201047.095282:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201047.095285:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339000/0x96d0c9b8c9a1b4fe lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.095291:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339000/0x96d0c9b8c9a1b4fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.095301:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339400/0x96d0c9b8c9a1b505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.095306:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339400/0x96d0c9b8c9a1b505 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.095311:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339400/0x96d0c9b8c9a1b505 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.095317:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201047.095319:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339400/0x96d0c9b8c9a1b505 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.095325:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339400/0x96d0c9b8c9a1b505 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.095332:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8dc103a1b500) 00010000:00010000:0.0:1788201047.095335:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201047.095343:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339400/0x96d0c9b8c9a1b505 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.095349:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339400/0x96d0c9b8c9a1b505 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.095385:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b4f7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786696 expref: 12 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.095400:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338c00/0x96d0c9b8c9a1b50c lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786696 expref: 11 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.095406:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8dc103a1b200) 00010000:00010000:0.0:1788201047.095409:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201047.095411:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12f338c00, rc 0) 00010000:00000080:0.0:1788201047.095418:0:69485:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc137cee300 x1875060695372416/t111669149706(0) o101->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:168/0 lens 776/848 e 0 to 0 dl 1788201058 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201047.095478:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+11:69576:x1875060695372416:12345-192.168.201.20@tcp:101:dd.0 Request processed in 763us (932us total) trans 111669149706 rc 0/0 00000100:00100000:0.0:1788201047.095485:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1243 00000100:00100000:0.0:1788201047.104535:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201047.104618:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695372544 00000100:00100000:1.0:1788201047.104629:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695372544 00000100:00100000:1.0:1788201047.104692:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1244 00000100:00100000:1.0:1788201047.104703:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+11:69576:x1875060695372544:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:1.0:1788201047.104725:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201047.104744:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c600/0x96d0c9b8c9a1b51a lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78669d expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.104779:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d200/0x96d0c9b8c9a1b521 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.104794:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d200/0x96d0c9b8c9a1b521 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.104806:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d200/0x96d0c9b8c9a1b521 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.104937:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c600/0x96d0c9b8c9a1b51a lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78669d expref: 13 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.104953:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d200/0x96d0c9b8c9a1b521 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78669d expref: 12 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.104962:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8dc103a1b200) 00010000:00010000:1.0:1788201047.104965:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788201047.104969:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2d200, rc 0) 00010000:00000080:1.0:1788201047.104979:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc140d90380 x1875060695372544/t0(0) o101->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:168/0 lens 568/1344 e 0 to 0 dl 1788201058 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201047.105077:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+12:69576:x1875060695372544:12345-192.168.201.20@tcp:101:dd.0 Request processed in 376us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201047.105085:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1244 00000100:00100000:0.0:1788201047.113613:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201047.113691:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695372800 00000100:00100000:2.0:1788201047.113703:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695372800 00000100:00100000:2.0:1788201047.113762:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1245 00000100:00100000:2.0:1788201047.113771:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+12:69576:x1875060695372800:12345-192.168.201.20@tcp:36:dd.0 00010000:00010000:2.0:1788201047.113821:0:66312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201047.113849:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338c00/0x96d0c9b8c9a1b50c lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786696 expref: 12 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201047.113867:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8dc103a1b200) 00010000:00010000:2.0:1788201047.113877:0:66312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201047.114071:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdcc00/0x96d0c9b8c9a1b528 lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201047.114084:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdcc00/0x96d0c9b8c9a1b528 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201047.114094:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdcc00/0x96d0c9b8c9a1b528 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788201047.114135:0:66312:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 111669149707 00000004:00010000:2.0:1788201047.114157:0:66312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bbe42195 reply state 00000000c96c31a6 transno 111669149708 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdcc00/0x96d0c9b8c9a1b528 lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201047.114170:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdcc00/0x96d0c9b8c9a1b528 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201047.114176:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8dc103a1b200) 00010000:00010000:2.0:1788201047.114178:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201047.114181:0:66312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:2.0:1788201047.114229:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc0073bad80 x1875060695372800/t111669149708(0) o36->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:168/0 lens 488/456 e 0 to 0 dl 1788201058 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201047.114298:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+14:69576:x1875060695372800:12345-192.168.201.20@tcp:36:dd.0 Request processed in 528us (693us total) trans 111669149708 rc 0/0 00000100:00100000:2.0:1788201047.114304:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1245 00000020:00080000:2.0:1788201047.114310:0:66312:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788201047.119916:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201047.119989:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695372928 00000100:00100000:3.0:1788201047.120000:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695372928 00000100:00100000:3.0:1788201047.120086:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1246 00000100:00100000:3.0:1788201047.120096:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+14:69576:x1875060695372928:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:3.0:1788201047.120120:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201047.120142:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1b52f lrc: 2/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7866a4 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.120214:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1b52f lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866a4 expref: 15 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.120228:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1b52f lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866a4 expref: 15 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.120245:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8dc103a1b200) 00010000:00010000:3.0:1788201047.120248:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201047.120251:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782d400, rc 0) 00010000:00000080:3.0:1788201047.120258:0:66313:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc0078e0e00 x1875060695372928/t0(0) o101->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:168/0 lens 376/584 e 0 to 0 dl 1788201058 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201047.120310:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+15:69576:x1875060695372928:12345-192.168.201.20@tcp:101:dd.0 Request processed in 216us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201047.120316:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1246 00000100:00100000:0.0:1788201047.135473:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201047.135555:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695373184 00000100:00100000:1.0:1788201047.135565:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695373184 00000100:00100000:1.0:1788201047.135631:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1247 00000100:00100000:1.0:1788201047.135642:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+15:69576:x1875060695373184:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:1.0:1788201047.135665:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201047.135668:0:66757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788201047.135697:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1b52f lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866a4 expref: 15 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.135718:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8dc103a1b200) 00010000:00010000:1.0:1788201047.135724:0:66757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201047.135747:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c600/0x96d0c9b8c9a1b536 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7866ab expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.135798:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c200/0x96d0c9b8c9a1b53d lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.135812:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c200/0x96d0c9b8c9a1b53d lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.135822:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c200/0x96d0c9b8c9a1b53d lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201047.135948:0:66757:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0xb1:0x0], count =625 00000004:00080000:1.0:1788201047.135957:0:66757:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0xb1:0x0]+625 in llog 00000004:00080000:1.0:1788201047.135984:0:66757:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x322:0x0], index 0: 0 00000004:00080000:1.0:1788201047.135991:0:66757:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x323:0x0], index 1: 0 00010000:00010000:1.0:1788201047.136107:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c200/0x96d0c9b8c9a1b53d lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866ab expref: 17 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.136115:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8dc103a1b200) 00010000:00010000:1.0:1788201047.136117:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788201047.136125:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c600/0x96d0c9b8c9a1b536 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866ab expref: 17 pid: 66757 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.136138:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c200/0x96d0c9b8c9a1b53d lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866ab expref: 16 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.136168:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8dc103a1b200) 00010000:00010000:1.0:1788201047.136170:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788201047.136173:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2c200, rc 0) 00010000:00000080:1.0:1788201047.136186:0:66757:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc0078e2680 x1875060695373184/t111669149709(0) o101->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:168/0 lens 376/608 e 0 to 0 dl 1788201058 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201047.136261:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+16:69576:x1875060695373184:12345-192.168.201.20@tcp:101:dd.0 Request processed in 620us (798us total) trans 111669149709 rc 0/0 00000100:00100000:1.0:1788201047.136269:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1247 00000100:00100000:0.0:1788201047.143829:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201047.143935:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695373312 00000100:00100000:1.0:1788201047.143947:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695373312 00000100:00100000:1.0:1788201047.144040:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5884 00000100:00100000:1.0:1788201047.144051:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4292087e-fa00-4621-b681-837afc99ae35+5:69576:x1875060695373312:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:1.0:1788201047.144068:0:26203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201047.144089:0:26203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f9ea44f/0x96d0c9b8c9a1b544 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7866b2 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201047.144119:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x322:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201047.144141:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x322:0x0].0x0 since=3898s v=(0 0) 00010000:00010000:1.0:1788201047.144146:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x322:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201047.144156:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f9ea44f/0x96d0c9b8c9a1b544 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866b2 expref: 6 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.144172:0:26203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005f9ea44f/0x96d0c9b8c9a1b544 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866b2 expref: 6 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.144184:0:26203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2d000, rc 0) 00000100:00100000:1.0:1788201047.144269:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4292087e-fa00-4621-b681-837afc99ae35+6:69576:x1875060695373312:12345-192.168.201.20@tcp:101:dd.0 Request processed in 218us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201047.144276:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5884 00000100:00080000:0.0:1788201047.144529:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201047.164613:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201047.164688:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695373440 00000100:00100000:1.0:1788201047.164700:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695373440 00000100:00100000:0.0:1788201047.164853:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5885 00000100:00100000:0.0:1788201047.164865:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4292087e-fa00-4621-b681-837afc99ae35+5:69576:x1875060695373440:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:0.0:1788201047.164890:0:8491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201047.164913:0:8491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffeeb63e/0x96d0c9b8c9a1b54b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7866b9 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201047.164941:0:8491:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x322:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201047.164963:0:8491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x322:0x0].0x0 since=3898s v=(0 0) 00010000:00010000:0.0:1788201047.164968:0:8491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x322:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201047.164977:0:8491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffeeb63e/0x96d0c9b8c9a1b54b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866b9 expref: 6 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.164995:0:8491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ffeeb63e/0x96d0c9b8c9a1b54b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866b9 expref: 6 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.165013:0:8491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12f339000, rc 0) 00000100:00080000:1.0:1788201047.165079:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201047.165080:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4292087e-fa00-4621-b681-837afc99ae35+6:69576:x1875060695373440:12345-192.168.201.20@tcp:101:dd.0 Request processed in 218us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201047.165087:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5885 00000100:00100000:2.0:1788201047.169691:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201047.169737:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695373568 00000100:00100000:2.0:1788201047.169750:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695373568 00000100:00100000:2.0:1788201047.169816:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5886 00000100:00100000:2.0:1788201047.169828:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:4292087e-fa00-4621-b681-837afc99ae35+6:69576:x1875060695373568:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:2.0:1788201047.169859:0:26212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201047.169883:0:26212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc7b5a1b/0x96d0c9b8c9a1b552 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7866c0 expref: -99 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201047.169911:0:26212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x323:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201047.169934:0:26212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x323:0x0].0x0 since=3898s v=(0 0) 00010000:00010000:2.0:1788201047.169940:0:26212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x323:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201047.169948:0:26212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc7b5a1b/0x96d0c9b8c9a1b552 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866c0 expref: 7 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201047.169965:0:26212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dc7b5a1b/0x96d0c9b8c9a1b552 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866c0 expref: 7 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201047.169979:0:26212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc004fdd600, rc 0) 00000100:00100000:2.0:1788201047.170054:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:4292087e-fa00-4621-b681-837afc99ae35+7:69576:x1875060695373568:12345-192.168.201.20@tcp:101:dd.0 Request processed in 227us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201047.170061:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5886 00000100:00100000:1.0:1788201047.180379:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201047.180412:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201047.180650:0:25502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695373696 00000100:00100000:1.0:1788201047.180661:0:25502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695373696 00002000:00010000:1.0:1788201047.180700:0:25502:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/802 (1048576->18446744073709551615) 00002000:00100000:1.0:1788201047.180705:0:25502:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc004be7100 with x1875060695373696 ext(1048576->18446744073709551615) 00002000:00010000:1.0:1788201047.180717:0:25502:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc004be7100. 00000100:00100000:1.0:1788201047.180738:0:25502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695373824 00000100:00100000:1.0:1788201047.180741:0:25502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695373824 00002000:00010000:1.0:1788201047.180754:0:25502:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/803 (0->18446744073709551615) 00002000:00100000:1.0:1788201047.180757:0:25502:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc004be5f80 with x1875060695373824 ext(0->18446744073709551615) 00002000:00010000:1.0:1788201047.180762:0:25502:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dc004be5f80. 00000100:00100000:1.0:1788201047.180779:0:25502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1000 00000100:00100000:1.0:1788201047.180789:0:25502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695373696:12345-192.168.201.20@tcp:10:dd.0 00000100:00100000:0.0:1788201047.182261:0:24857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1001 00000100:00100000:0.0:1788201047.182279:0:24857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4292087e-fa00-4621-b681-837afc99ae35+7:2401:x1875060695373824:12345-192.168.201.20@tcp:10:dd.0 00002000:00010000:0.0:1788201047.182624:0:24857:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x323:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788201047.182628:0:24857:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x323:0x0] updating lvb mtime from disk: 0 -> 1788201047 00002000:00010000:0.0:1788201047.182631:0:24857:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x323:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788201047.182633:0:24857:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x323:0x0] updating lvb ctime from disk: 0 -> 1788201047 00002000:00010000:0.0:1788201047.182635:0:24857:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x323:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788201047.182700:0:24857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4292087e-fa00-4621-b681-837afc99ae35+8:2401:x1875060695373824:12345-192.168.201.20@tcp:10:dd.0 Request processed in 427us (2287us total) trans 4294969452 rc 0/0 00000100:00100000:0.0:1788201047.182715:0:24857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1001 00002000:00010000:0.0:1788201047.182719:0:24857:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/803 (0->18446744073709551615) 00002000:00100000:0.0:1788201047.182722:0:24857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc004be5f80 with x1875060695373824 ext(0->18446744073709551615) 00002000:00010000:0.0:1788201047.182729:0:24857:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dc004be5f80. 00002000:00010000:1.0:1788201047.183098:0:25502:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x322:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1788201047.183102:0:25502:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x322:0x0] updating lvb mtime from disk: 0 -> 1788201047 00002000:00010000:1.0:1788201047.183104:0:25502:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x322:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788201047.183106:0:25502:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x322:0x0] updating lvb ctime from disk: 0 -> 1788201047 00002000:00010000:1.0:1788201047.183108:0:25502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x322:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788201047.183133:0:25502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4292087e-fa00-4621-b681-837afc99ae35+7:2401:x1875060695373696:12345-192.168.201.20@tcp:10:dd.0 Request processed in 2345us (2764us total) trans 4294969452 rc 0/0 00000100:00100000:1.0:1788201047.183140:0:25502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1000 00002000:00010000:1.0:1788201047.183143:0:25502:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/802 (1048576->18446744073709551615) 00002000:00100000:1.0:1788201047.183145:0:25502:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc004be7100 with x1875060695373696 ext(1048576->18446744073709551615) 00002000:00010000:1.0:1788201047.183157:0:25502:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc004be7100. 00000100:00100000:1.0:1788201047.271615:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201047.271773:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695374080 00000100:00100000:3.0:1788201047.271791:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695374080 00000100:00100000:3.0:1788201047.271841:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 227 00000100:00100000:3.0:1788201047.271852:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4292087e-fa00-4621-b681-837afc99ae35+16:69576:x1875060695374080:12345-192.168.201.20@tcp:35:dd.0 00010000:00000080:3.0:1788201047.272174:0:79137:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004c1f800 x1875060695374080/t111669149710(0) o35->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:168/0 lens 392/456 e 0 to 0 dl 1788201058 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201047.272274:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4292087e-fa00-4621-b681-837afc99ae35+17:69576:x1875060695374080:12345-192.168.201.20@tcp:35:dd.0 Request processed in 424us (668us total) trans 111669149710 rc 0/0 00000100:00100000:3.0:1788201047.272283:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 227 00000100:00100000:0.0:1788201047.314387:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201047.317462:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695374208 00000100:00100000:1.0:1788201047.317478:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695374208 00000100:00100000:1.0:1788201047.317566:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1248 00000100:00100000:1.0:1788201047.317577:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+17:69577:x1875060695374208:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1788201047.317602:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201047.317627:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d400/0x96d0c9b8c9a1b559 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7866c7 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.317691:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2ca00/0x96d0c9b8c9a1b560 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.317705:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2ca00/0x96d0c9b8c9a1b560 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.317717:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2ca00/0x96d0c9b8c9a1b560 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201047.317766:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788201047.317770:0:69485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201047.317790:0:69485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2ca00/0x96d0c9b8c9a1b560 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.317815:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d400/0x96d0c9b8c9a1b559 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866c7 expref: 19 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.317834:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2ca00/0x96d0c9b8c9a1b560 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866c7 expref: 18 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.317865:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12066f700) 00010000:00010000:1.0:1788201047.317868:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201047.317872:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2ca00, rc 0) 00010000:00000080:1.0:1788201047.317880:0:69485:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc0078e1f80 x1875060695374208/t0(0) o101->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:168/0 lens 576/688 e 0 to 0 dl 1788201058 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201047.317967:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+18:69577:x1875060695374208:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 392us (3592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201047.317973:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1248 00000100:00100000:0.0:1788201047.330310:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201047.330521:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695374464 00000100:00100000:1.0:1788201047.330532:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695374464 00000100:00100000:1.0:1788201047.330605:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1249 00000100:00100000:1.0:1788201047.330618:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+18:69577:x1875060695374464:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1788201047.330649:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201047.330678:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d400/0x96d0c9b8c9a1b567 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7866ce expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.330776:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c000/0x96d0c9b8c9a1b56e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.330792:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c000/0x96d0c9b8c9a1b56e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.330807:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c000/0x96d0c9b8c9a1b56e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.330821:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1b575 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.330853:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1b575 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.330860:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1b575 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.330954:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c000/0x96d0c9b8c9a1b56e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.330963:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c000/0x96d0c9b8c9a1b56e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.330969:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c000/0x96d0c9b8c9a1b56e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.330975:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c000/0x96d0c9b8c9a1b56e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.330980:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2c000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201047.330985:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c000/0x96d0c9b8c9a1b56e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.330992:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c000/0x96d0c9b8c9a1b56e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.331005:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12066f700) 00010000:00010000:1.0:1788201047.331008:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201047.331061:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c000/0x96d0c9b8c9a1b56e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.331068:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c000/0x96d0c9b8c9a1b56e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.331101:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1b575 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.331108:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1b575 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.331114:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1b575 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.331118:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2c400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201047.331121:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1b575 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.331128:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1b575 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.331136:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8dc12066fe00) 00010000:00010000:1.0:1788201047.331138:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201047.331140:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1b575 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.331147:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1b575 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.331182:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d400/0x96d0c9b8c9a1b567 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866ce expref: 19 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.331261:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12066f700) 00010000:00010000:1.0:1788201047.331264:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201047.331275:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d400/0x96d0c9b8c9a1b567 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866ce expref: 19 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.331287:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2d400, rc 0) 00010000:00000080:1.0:1788201047.331294:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc0078e0000 x1875060695374464/t0(0) o101->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:168/0 lens 800/608 e 0 to 0 dl 1788201058 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201047.331356:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+18:69577:x1875060695374464:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 740us (1057us total) trans 0 rc 301/301 00000100:00100000:1.0:1788201047.331364:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1249 00000100:00100000:0.0:1788201047.337370:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201047.337471:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695374592 00000100:00100000:3.0:1788201047.337482:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695374592 00000100:00100000:3.0:1788201047.337558:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1250 00000100:00100000:3.0:1788201047.337568:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+18:69577:x1875060695374592:12345-192.168.201.20@tcp:34:lfs.0 00010000:00010000:3.0:1788201047.337639:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1b57c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.337656:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1b57c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.337668:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1b57c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.337685:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1b583 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.337693:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1b583 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.337700:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1b583 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.337778:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1b58a lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.337805:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1b58a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.337813:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1b58a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201047.337853:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 2097152 00000004:00200000:3.0:1788201047.337858:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201047.337870:0:66312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1b58a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.337884:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1b57c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.337891:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1b57c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.337898:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1b57c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.337906:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1b57c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.337911:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201047.337916:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1b57c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.337924:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1b57c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.337937:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12066f700) 00010000:00010000:3.0:1788201047.337945:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201047.337951:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1b57c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.337972:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1b57c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.337990:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1b583 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.337996:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1b583 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.338002:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1b583 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.338007:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782cc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201047.338010:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1b583 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.338049:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1b583 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.338058:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8dc12f13a700) 00010000:00010000:3.0:1788201047.338060:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201047.338063:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1b583 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.338070:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1b583 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.338087:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1b58a lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.338099:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1b58a lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.338117:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1b58a lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.338122:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782da00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201047.338125:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1b58a lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.338132:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1b58a lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.338140:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8dc103a1b200) 00010000:00010000:3.0:1788201047.338143:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201047.338146:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1b58a lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201047.338152:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1b58a lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:3.0:1788201047.338175:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc0078e0a80 x1875060695374592/t0(0) o34->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:168/0 lens 472/728 e 0 to 0 dl 1788201058 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201047.338781:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+18:69577:x1875060695374592:12345-192.168.201.20@tcp:34:lfs.0 Request processed in 1210us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201047.338791:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1250 00000100:00100000:2.0:1788201047.395898:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201047.396072:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695374848 00000100:00100000:1.0:1788201047.396083:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695374848 00000100:00100000:1.0:1788201047.396145:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1251 00000100:00100000:1.0:1788201047.396156:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+18:69579:x1875060695374848:12345-192.168.201.20@tcp:101:md5sum.0 00010000:00010000:1.0:1788201047.396178:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201047.396219:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d400/0x96d0c9b8c9a1b591 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7866d5 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.396297:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1b598 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.396311:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1b598 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.396323:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1b598 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.396336:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c000/0x96d0c9b8c9a1b59f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.396343:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c000/0x96d0c9b8c9a1b59f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.396362:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c000/0x96d0c9b8c9a1b59f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.396492:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2dc00/0x96d0c9b8c9a1b5a6 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.396665:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2dc00/0x96d0c9b8c9a1b5a6 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.396673:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2dc00/0x96d0c9b8c9a1b5a6 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201047.396684:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 2097152 00010000:00010000:1.0:1788201047.396768:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1b598 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.396776:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1b598 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.396783:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1b598 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.396790:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1b598 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.396796:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2c400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201047.396800:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1b598 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.396807:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1b598 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.396831:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12066f700) 00010000:00010000:1.0:1788201047.396834:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201047.396840:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1b598 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.396846:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c400/0x96d0c9b8c9a1b598 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.396861:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c000/0x96d0c9b8c9a1b59f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.396866:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c000/0x96d0c9b8c9a1b59f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.396872:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c000/0x96d0c9b8c9a1b59f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.396876:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2c000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201047.396879:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c000/0x96d0c9b8c9a1b59f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.396884:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c000/0x96d0c9b8c9a1b59f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.396890:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8dc12066fe00) 00010000:00010000:1.0:1788201047.396893:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201047.396895:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c000/0x96d0c9b8c9a1b59f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.396901:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c000/0x96d0c9b8c9a1b59f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.396986:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d400/0x96d0c9b8c9a1b591 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866d5 expref: 21 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.397002:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2dc00/0x96d0c9b8c9a1b5a6 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866d5 expref: 20 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201047.397010:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8dc103a1b200) 00010000:00010000:1.0:1788201047.397012:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201047.397060:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2dc00, rc 0) 00010000:00000080:1.0:1788201047.397069:0:69485:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc137ced500 x1875060695374848/t111669149711(0) o101->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:168/0 lens 800/872 e 0 to 0 dl 1788201058 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201047.397349:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+20:69579:x1875060695374848:12345-192.168.201.20@tcp:101:md5sum.0 Request processed in 1193us (1459us total) trans 111669149711 rc 0/0 00000100:00100000:1.0:1788201047.397358:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1251 00000100:00100000:0.0:1788201047.424594:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201047.425673:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695374976 00000100:00100000:2.0:1788201047.425686:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695374976 00002000:00100000:2.0:1788201047.425734:0:8454:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x322:0x0] (0->32767) req@ffff8dc0078e2300 x1875060695374976/t0(0) o3->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:168/0 lens 488/0 e 0 to 0 dl 1788201058 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201047.425746:0:8454:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc0078e2300 with x1875060695374976 ext(0->32767) 00002000:00010000:2.0:1788201047.425753:0:8454:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dc0078e2300 00000100:00100000:2.0:1788201047.425794:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1002 00000100:00100000:2.0:1788201047.425803:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4292087e-fa00-4621-b681-837afc99ae35+8:2400:x1875060695374976:12345-192.168.201.20@tcp:3:md5sum.0 00000100:00100000:0.0:1788201047.428382:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4292087e-fa00-4621-b681-837afc99ae35+8:2400:x1875060695374976:12345-192.168.201.20@tcp:3:md5sum.0 Request processed in 2569us (3787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201047.428397:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1002 00002000:00100000:0.0:1788201047.428411:0:8454:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x322:0x0] (0->32767) req@ffff8dc0078e2300 x1875060695374976/t0(0) o3->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:168/0 lens 488/440 e 0 to 0 dl 1788201058 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201047.428422:0:8454:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc0078e2300 with x1875060695374976 ext(0->32767) 00002000:00010000:0.0:1788201047.428429:0:8454:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dc0078e2300 00000100:00100000:0.0:1788201047.453093:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201047.453249:0:24876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695375104 00000100:00100000:1.0:1788201047.453262:0:24876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695375104 00002000:00100000:1.0:1788201047.453320:0:24876:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x322:0x0] (32768->1048575) req@ffff8dc0078e0380 x1875060695375104/t0(0) o3->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:168/0 lens 488/0 e 0 to 0 dl 1788201058 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201047.453332:0:24876:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc0078e0380 with x1875060695375104 ext(32768->1048575) 00002000:00010000:1.0:1788201047.453338:0:24876:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dc0078e0380 00000100:00100000:1.0:1788201047.453374:0:24876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1003 00000100:00100000:1.0:1788201047.453386:0:24876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4292087e-fa00-4621-b681-837afc99ae35+8:2401:x1875060695375104:12345-192.168.201.20@tcp:3:md5sum.0 00000100:00100000:0.0:1788201047.465569:0:24876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4292087e-fa00-4621-b681-837afc99ae35+8:2401:x1875060695375104:12345-192.168.201.20@tcp:3:md5sum.0 Request processed in 12170us (12471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201047.465585:0:24876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1003 00002000:00100000:0.0:1788201047.465602:0:24876:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x322:0x0] (32768->1048575) req@ffff8dc0078e0380 x1875060695375104/t0(0) o3->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:168/0 lens 488/440 e 0 to 0 dl 1788201058 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201047.465614:0:24876:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc0078e0380 with x1875060695375104 ext(32768->1048575) 00002000:00010000:0.0:1788201047.465622:0:24876:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dc0078e0380 00000100:00100000:2.0:1788201047.506970:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201047.507068:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695375360 00000100:00100000:3.0:1788201047.507081:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695375360 00000100:00100000:3.0:1788201047.507147:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 228 00000100:00100000:3.0:1788201047.507175:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c5c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4292087e-fa00-4621-b681-837afc99ae35+20:69579:x1875060695375360:12345-192.168.201.20@tcp:35:md5sum.0 00010000:00000080:3.0:1788201047.507442:0:66316:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc137c5c850 x1875060695375360/t111669149712(0) o35->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:168/0 lens 392/456 e 0 to 0 dl 1788201058 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201047.507522:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c5c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4292087e-fa00-4621-b681-837afc99ae35+21:69579:x1875060695375360:12345-192.168.201.20@tcp:35:md5sum.0 Request processed in 351us (571us total) trans 111669149712 rc 0/0 00000100:00100000:3.0:1788201047.507530:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 228 00000100:00100000:2.0:1788201047.584788:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201047.586643:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695375488 00000100:00100000:0.0:1788201047.586673:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695375488 00000100:00100000:0.0:1788201047.586749:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1252 00000100:00100000:0.0:1788201047.586760:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+21:69581:x1875060695375488:12345-192.168.201.20@tcp:34:lfs.0 00010000:00010000:0.0:1788201047.586845:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b5b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.586863:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b5b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.586876:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b5b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.586892:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338c00/0x96d0c9b8c9a1b5bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.586899:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338c00/0x96d0c9b8c9a1b5bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.586906:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338c00/0x96d0c9b8c9a1b5bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.586992:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338400/0x96d0c9b8c9a1b5c2 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.587002:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338400/0x96d0c9b8c9a1b5c2 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.587009:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338400/0x96d0c9b8c9a1b5c2 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201047.587645:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 2097152 00000004:00200000:0.0:1788201047.587652:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201047.587673:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338400/0x96d0c9b8c9a1b5c2 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.587688:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b5b4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.587695:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b5b4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.587701:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b5b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.587708:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b5b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.587713:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f338600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201047.587718:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b5b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.587725:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b5b4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.587737:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12066f700) 00010000:00010000:0.0:1788201047.587739:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201047.587743:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b5b4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.587750:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b5b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.587763:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338c00/0x96d0c9b8c9a1b5bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.587779:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338c00/0x96d0c9b8c9a1b5bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.587790:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338c00/0x96d0c9b8c9a1b5bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.587795:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f338c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201047.587798:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338c00/0x96d0c9b8c9a1b5bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.587803:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338c00/0x96d0c9b8c9a1b5bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.587811:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8dc103a1bf00) 00010000:00010000:0.0:1788201047.587813:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201047.587816:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338c00/0x96d0c9b8c9a1b5bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.587822:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338c00/0x96d0c9b8c9a1b5bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.587835:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338400/0x96d0c9b8c9a1b5c2 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.587840:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338400/0x96d0c9b8c9a1b5c2 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.587847:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338400/0x96d0c9b8c9a1b5c2 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.587852:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f338400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201047.587854:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338400/0x96d0c9b8c9a1b5c2 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.587868:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338400/0x96d0c9b8c9a1b5c2 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.587875:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8dc103a1b200) 00010000:00010000:0.0:1788201047.587877:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201047.587880:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338400/0x96d0c9b8c9a1b5c2 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201047.587885:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338400/0x96d0c9b8c9a1b5c2 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:0.0:1788201047.587907:0:66757:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc137cee680 x1875060695375488/t0(0) o34->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:168/0 lens 472/728 e 0 to 0 dl 1788201058 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201047.588092:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+21:69581:x1875060695375488:12345-192.168.201.20@tcp:34:lfs.0 Request processed in 1332us (3314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201047.588100:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1252 00010000:00010000:0.0:1788201047.826877:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201047.887401:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715131008:0@lo:400:kworker.0 00000100:00100000:1.0:1788201047.887454:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715131136:0@lo:400:kworker.0 00000100:00100000:3.0:1788201047.887485:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201047.887556:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0073b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715130880:0@lo:400:kworker.0 00000100:00100000:0.0:1788201047.887721:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715130752:0@lo:400:kworker.0 00000100:00100000:1.0:1788201047.891751:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201047.891847:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715131648:0@lo:400:kworker.0 00000100:00100000:1.0:1788201047.891904:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201047.891936:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715132160:0@lo:400:kworker.0 00000100:00100000:1.0:1788201047.892917:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201047.892996:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715131648 00000100:00100000:1.0:1788201047.893005:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715131648 00000100:00100000:1.0:1788201047.893086:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715132160 00000100:00100000:1.0:1788201047.893089:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715132160 00000100:00100000:1.0:1788201047.893117:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2728 00000100:00100000:1.0:1788201047.893126:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715131648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201047.893198:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715131648:12345-0@lo:400:kworker.0 Request processed in 73us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201047.893205:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2728 00000100:00100000:1.0:1788201047.893226:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2729 00000100:00100000:1.0:1788201047.893232:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715132160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201047.893261:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715132160:12345-0@lo:400:kworker.0 Request processed in 29us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201047.893267:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2729 00000100:00080000:1.0:1788201047.893286:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201047.893316:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715131648:0@lo:400:kworker.0 00000100:00100000:1.0:1788201047.893327:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715132160:0@lo:400:kworker.0 00000100:00100000:1.0:1788201047.893353:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715131008 00000100:00100000:1.0:1788201047.893357:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715131008 00000100:00100000:1.0:1788201047.893386:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715131136 00000100:00100000:1.0:1788201047.893389:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715131136 00000100:00100000:1.0:1788201047.894723:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:1.0:1788201047.894744:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715131008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201047.896130:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715131008:12345-0@lo:400:kworker.0 Request processed in 1391us (8641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201047.896143:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000100:00100000:1.0:1788201047.896174:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:1.0:1788201047.896200:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715131136:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788201047.896218:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004c1c000 x1875060715131136/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:168/0 lens 224/224 e 0 to 0 dl 1788201058 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201047.896256:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715131136:12345-0@lo:400:kworker.0 Request processed in 75us (4516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201047.896262:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00080000:1.0:1788201047.896287:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201047.896292:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201047.896331:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715131136:0@lo:400:kworker.0 00000100:00100000:2.0:1788201047.896437:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201047.896486:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715131392:0@lo:400:kworker.0 00000100:00100000:2.0:1788201047.896532:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201047.896561:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715131904:0@lo:400:kworker.0 00000100:00100000:2.0:1788201047.896584:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201047.896608:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715131392 00000100:00100000:2.0:1788201047.896614:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715131392 00000100:00100000:2.0:1788201047.896651:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715131904 00000100:00100000:2.0:1788201047.896653:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715131904 00000100:00100000:2.0:1788201047.896673:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3922 00000100:00100000:2.0:1788201047.896680:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715131392:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788201047.896695:0:83817:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc137ceea00 x1875060715131392/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:168/0 lens 224/224 e 0 to 0 dl 1788201058 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201047.896723:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715131392:12345-0@lo:400:kworker.0 Request processed in 44us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201047.896745:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3922 00000100:00100000:2.0:1788201047.896760:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3923 00000100:00100000:2.0:1788201047.896766:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715131904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201047.896794:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715131904:12345-0@lo:400:kworker.0 Request processed in 28us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201047.896799:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3923 00000100:00100000:2.0:1788201047.896829:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715131904:0@lo:400:kworker.0 00000100:00100000:2.0:1788201047.896848:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715132416:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201047.896873:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201047.896893:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715132416 00000100:00100000:2.0:1788201047.896897:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715132416 00000100:00100000:2.0:1788201047.896917:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3924 00000100:00100000:2.0:1788201047.896923:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715132416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201047.896962:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:2.0:1788201047.896996:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715132416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201047.897003:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3924 00000100:00100000:2.0:1788201047.897046:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715132416:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201047.897066:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715131392:0@lo:400:kworker.0 00000100:00100000:1.0:1788201047.899716:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715130880 00000100:00100000:1.0:1788201047.899735:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715130880 00000100:00100000:1.0:1788201047.901127:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1289 00000100:00100000:1.0:1788201047.901140:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715130880:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788201047.901167:0:66757:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc137ceed80 x1875060715130880/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:168/0 lens 224/224 e 0 to 0 dl 1788201058 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201047.901263:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715130880:12345-0@lo:400:kworker.0 Request processed in 126us (4828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201047.901271:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1289 00000100:00080000:2.0:1788201047.901663:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201047.901706:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0073b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715130880:0@lo:400:kworker.0 00000100:00100000:3.0:1788201047.909250:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715131008:0@lo:400:kworker.0 00000100:00100000:3.0:1788201047.909265:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715131520:0@lo:400:kworker.0 00000100:00100000:3.0:1788201047.909323:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201047.909357:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715132032:0@lo:400:kworker.0 00000100:00100000:3.0:1788201047.909376:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201047.909442:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715131520 00000100:00100000:3.0:1788201047.909449:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715131520 00000100:00100000:3.0:1788201047.909621:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715132032 00000100:00100000:3.0:1788201047.909625:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715132032 00000100:00080000:1.0:1788201047.909889:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201047.917696:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2730 00000100:00100000:2.0:1788201047.917726:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715131520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201047.918376:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715131520:12345-0@lo:400:kworker.0 Request processed in 665us (9050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201047.918386:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2730 00000100:00100000:2.0:1788201047.918413:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2731 00000100:00100000:2.0:1788201047.918420:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715132032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201047.918451:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715132032:12345-0@lo:400:kworker.0 Request processed in 33us (9074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201047.918457:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2731 00000100:00100000:1.0:1788201047.918637:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715131520:0@lo:400:kworker.0 00000100:00100000:1.0:1788201047.918648:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715132032:0@lo:400:kworker.0 00000100:00100000:0.0:1788201047.919040:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201047.919080:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715131264:0@lo:400:kworker.0 00000100:00100000:0.0:1788201047.919116:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201047.919135:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715131776:0@lo:400:kworker.0 00000100:00100000:0.0:1788201047.919156:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201047.919172:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715132288:0@lo:400:kworker.0 00000100:00100000:0.0:1788201047.919208:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201047.921893:0:89119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715130752 00000100:00100000:1.0:1788201047.921909:0:89119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715130752 00000100:00100000:2.0:1788201047.922103:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715131264 00000100:00100000:2.0:1788201047.922107:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715131264 00000100:00100000:2.0:1788201047.922150:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:2.0:1788201047.922158:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715131264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201047.922267:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715131264:12345-0@lo:400:kworker.0 Request processed in 109us (3149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201047.922273:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00100000:2.0:1788201047.922292:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715131776 00000100:00100000:2.0:1788201047.922296:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715131776 00000100:00100000:2.0:1788201047.922315:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715132288 00000100:00100000:2.0:1788201047.922317:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715132288 00000100:00100000:2.0:1788201047.922329:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1291 00000100:00100000:2.0:1788201047.922334:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715131776:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788201047.922348:0:66313:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc0078e1180 x1875060715131776/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:168/0 lens 224/224 e 0 to 0 dl 1788201058 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201047.922378:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715131776:12345-0@lo:400:kworker.0 Request processed in 43us (3220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201047.922383:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1291 00000100:00100000:2.0:1788201047.922394:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1292 00000100:00100000:2.0:1788201047.922400:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715132288:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788201047.922412:0:66313:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc0078e2d80 x1875060715132288/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:168/0 lens 224/224 e 0 to 0 dl 1788201058 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201047.922438:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715132288:12345-0@lo:400:kworker.0 Request processed in 39us (3230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201047.922444:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1292 00000100:00080000:2.0:1788201047.922483:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201047.928248:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715131264:0@lo:400:kworker.0 00000100:00100000:0.0:1788201047.928292:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715131776:0@lo:400:kworker.0 00000100:00100000:0.0:1788201047.928305:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715132288:0@lo:400:kworker.0 00000100:00100000:1.0:1788201047.934916:0:89119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788201047.934938:0:89119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0037aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715130752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201047.935083:0:89119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0037aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715130752:12345-0@lo:400:kworker.0 Request processed in 153us (16042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201047.935090:0:89119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788201047.936189:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715130752:0@lo:400:kworker.0 00000100:00100000:3.0:1788201048.402602:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715132544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201048.402698:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201048.402759:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715132544 00000100:00100000:3.0:1788201048.402766:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715132544 00000100:00100000:3.0:1788201048.402813:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2218 00000100:00100000:3.0:1788201048.402822:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715132544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201048.402852:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201048.402902:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715132544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201048.402918:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2218 00000100:00100000:3.0:1788201048.402970:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715132544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201048.404200:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201048.404218:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715132672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201048.404270:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201048.404347:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715132672 00000100:00100000:0.0:1788201048.404353:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715132672 00000100:00100000:0.0:1788201048.404397:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3925 00000100:00100000:0.0:1788201048.404405:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715132672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201048.404438:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444966400 avail 1298726912 00010000:00000080:0.0:1788201048.404454:0:23728:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc00515c700 x1875060715132672/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:169/0 lens 224/368 e 0 to 0 dl 1788201059 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201048.404497:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715132672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201048.404504:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3925 00000100:00100000:0.0:1788201048.404542:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715132672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201048.408572:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715132800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201048.408650:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201048.408736:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715132800 00000100:00100000:3.0:1788201048.408745:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715132800 00000100:00100000:3.0:1788201048.408804:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2219 00000100:00100000:3.0:1788201048.408814:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715132800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201048.408846:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201048.419595:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715132800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10772us (10934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201048.419610:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2219 00000100:00100000:0.0:1788201048.421116:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715132800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201048.533674:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201048.533722:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201048.533751:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201048.533777:0:89118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695375616 00000100:00100000:3.0:1788201048.533782:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201048.533790:0:89118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695375616 00000100:00100000:3.0:1788201048.533812:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201048.533842:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695375872 00000100:00100000:3.0:1788201048.533846:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695375872 00000100:00100000:0.0:1788201048.533858:0:89118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 87 00000100:00100000:0.0:1788201048.533871:0:89118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0037ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695375616:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201048.533897:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695375744 00000100:00100000:3.0:1788201048.533902:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695375744 00000100:00100000:3.0:1788201048.533929:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1293 00000100:00100000:3.0:1788201048.533938:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695375872:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201048.533951:0:89118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0037ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695375616:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 82us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201048.533975:0:89118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 87 00000100:00100000:3.0:1788201048.533994:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695375872:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 56us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201048.534038:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1293 00000100:00100000:3.0:1788201048.534061:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1294 00000100:00100000:3.0:1788201048.534069:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+21:2401:x1875060695375744:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000080:3.0:1788201048.534086:0:66313:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc00515c380 x1875060695375744/t0(0) o400->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:169/0 lens 224/224 e 0 to 0 dl 1788201059 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201048.534116:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+21:2401:x1875060695375744:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 48us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201048.534122:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1294 00000100:00100000:3.0:1788201048.534145:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695376128 00000100:00100000:3.0:1788201048.534150:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695376128 00000100:00100000:3.0:1788201048.534191:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695376000 00000100:00100000:3.0:1788201048.534194:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695376000 00000100:00100000:3.0:1788201048.534216:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2732 00000100:00100000:3.0:1788201048.534222:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4292087e-fa00-4621-b681-837afc99ae35+8:2401:x1875060695376128:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201048.534259:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4292087e-fa00-4621-b681-837afc99ae35+8:2401:x1875060695376128:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 36us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201048.534267:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2733 00000100:00100000:0.0:1788201048.534284:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4292087e-fa00-4621-b681-837afc99ae35+7:2401:x1875060695376000:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201048.534314:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4292087e-fa00-4621-b681-837afc99ae35+7:2401:x1875060695376000:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 38us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201048.539635:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2732 00000100:00080000:3.0:1788201048.540911:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201048.542329:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2733 00010000:00010000:3.0:1788201048.848593:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201049.872185:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788201050.021420:0:90477:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788201050.021640:0:90477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1b0dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b0e4 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201050.021655:0:90477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1b0dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b0e4 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201050.021663:0:90477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1b0dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1b0e4 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201050.021670:0:90477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1b0dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1b0e4 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201050.021695:0:90477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788201050.021701:0:90477:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788201050.021729:0:90477:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201050.021734:0:90477:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788201050.021740:0:90477:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788201050.021764:0:90477:0:(import.c:65:import_set_state_nolock()) ffff8dc103484800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788201050.021827:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201050.021834:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1b0dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1b0e4 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.021842:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed600 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201050.021846:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1b0dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1b0e4 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.021855:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1b0dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1b0e4 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201050.021863:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1b0dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1b0e4 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201050.021869:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201050.021872:0:24979:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788201050.021874:0:24979:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:3.0:1788201050.022107:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0073b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715132928:0@lo:39:umount.0 00000100:00100000:3.0:1788201050.022188:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201050.022300:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715132928 00000100:00100000:2.0:1788201050.022309:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715132928 00010000:00010000:1.0:1788201050.022402:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1b0dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b0e4 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.022410:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201050.022436:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1b0dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b0e4 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.022444:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1b0dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b0e4 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.022467:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201050.022469:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201050.022471:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201050.022482:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715133056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201050.022518:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201050.022575:0:9535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715133056 00000100:00100000:1.0:1788201050.022579:0:9535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715133056 00000100:00100000:1.0:1788201050.022612:0:9535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:1.0:1788201050.022621:0:9535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10a10c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715133056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201050.022633:0:9535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201050.022646:0:9535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140759600/0x96d0c9b8c9a1b0e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b0dd expref: 24 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.022657:0:9535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201050.022688:0:9535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10a10c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9b18af6-fecc-4172-82c2-66531890fe11+23:3657:x1875060715133056:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201050.022695:0:9535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:1.0:1788201050.022754:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715133056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201050.022859:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:2.0:1788201050.022868:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875060715132928:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788201050.022889:0:66314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b1f5 00000100:00080000:2.0:1788201050.022918:0:66314:0:(import.c:65:import_set_state_nolock()) ffff8dc0039c6000 : changing import state from FULL to CLOSED 00010000:00000080:2.0:1788201050.022954:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc00515e680 x1875060715132928/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:171/0 lens 224/224 e 0 to 0 dl 1788201061 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201050.022992:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3654:x1875060715132928:12345-0@lo:39:umount.0 Request processed in 126us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201050.022999:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000020:00000080:2.0:1788201050.023038:0:66314:0:(genops.c:885:class_export_put()) final put ffff8dc0039c3800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1788201050.023088:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201050.023099:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0039c3800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788201050.023158:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc0039c6000 for lustre-MDT0000 00000100:00080000:3.0:1788201050.023241:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc103484800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788201050.023262:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0073b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715132928:0@lo:39:umount.0 00000100:00080000:1.0:1788201050.023568:0:90477:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788201050.023578:0:90477:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788201050.023583:0:90477:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788201050.025228:0:90477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c800/0x96d0c9b8c9a1b004 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b00b expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.025245:0:90477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c800/0x96d0c9b8c9a1b004 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b00b expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.025252:0:90477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c800/0x96d0c9b8c9a1b004 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1b00b expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.025258:0:90477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c800/0x96d0c9b8c9a1b004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1b00b expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.025323:0:90477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201050.025331:0:90477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad400/0x96d0c9b8c9a1b100 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b107 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.025338:0:90477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad400/0x96d0c9b8c9a1b100 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b107 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.025344:0:90477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad400/0x96d0c9b8c9a1b100 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1b107 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.025350:0:90477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad400/0x96d0c9b8c9a1b100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1b107 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201050.025625:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201050.025639:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c800/0x96d0c9b8c9a1b004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1b00b expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201050.025645:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6c800 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:3.0:1788201050.025649:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c800/0x96d0c9b8c9a1b004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1b00b expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201050.025656:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c800/0x96d0c9b8c9a1b004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1b00b expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201050.025663:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c800/0x96d0c9b8c9a1b004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1b00b expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201050.025669:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788201050.025671:0:13349:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788201050.025704:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c800/0x96d0c9b8c9a1b004 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b00b expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201050.025710:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201050.025734:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c800/0x96d0c9b8c9a1b004 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b00b expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201050.025741:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c800/0x96d0c9b8c9a1b004 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b00b expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201050.025754:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201050.025758:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad400/0x96d0c9b8c9a1b100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1b107 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201050.025763:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0079ad400 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:3.0:1788201050.025766:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad400/0x96d0c9b8c9a1b100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1b107 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201050.025779:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad400/0x96d0c9b8c9a1b100 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1b107 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201050.025786:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad400/0x96d0c9b8c9a1b100 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1b107 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201050.025791:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788201050.025793:0:13349:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1788201050.025806:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad400/0x96d0c9b8c9a1b100 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b107 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201050.025811:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201050.025828:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad400/0x96d0c9b8c9a1b100 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b107 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201050.025835:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201050.025836:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201050.025838:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201050.025847:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201050.025865:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00515df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715133184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201050.026221:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201050.026285:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00515e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715133312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201050.026310:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201050.026346:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715133184 00000100:00100000:3.0:1788201050.026353:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715133184 00000100:00100000:3.0:1788201050.026393:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715133312 00000100:00100000:3.0:1788201050.026396:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715133312 00000100:00100000:3.0:1788201050.026419:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:3.0:1788201050.026428:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715133184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201050.026448:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788201050.026807:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:0.0:1788201050.026818:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715133312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201050.026826:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201050.026844:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ece00/0x96d0c9b8c9a1b107 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b100 expref: 24 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201050.026858:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201050.026915:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+23:3655:x1875060715133312:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201050.026922:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00010000:00010000:3.0:1788201050.027217:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006c6c200/0x96d0c9b8c9a1b00b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b004 expref: 22 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201050.027227:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201050.027321:0:90477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788201050.027329:0:90477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad400/0x96d0c9b8c9a1b100 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b107 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201050.027355:0:90477:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788201050.027368:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201050.027380:0:90477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a1b0cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b0d6 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.027387:0:90477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a1b0cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b0d6 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.027394:0:90477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a1b0cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1b0d6 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.027400:0:90477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a1b0cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1b0d6 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.027413:0:90477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201050.027419:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201050.027424:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a1b0cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1b0d6 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.027430:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140758c00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201050.027434:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a1b0cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1b0d6 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.027441:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a1b0cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1b0d6 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201050.027448:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a1b0cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1b0d6 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201050.027473:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788201050.027476:0:24979:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788201050.027477:0:24979:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788201050.027498:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a1b0cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b0d6 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.027503:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201050.027517:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a1b0cf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b0d6 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.027522:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc140758c00/0x96d0c9b8c9a1b0cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b0d6 expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.027531:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201050.027532:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201050.027534:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201050.027544:0:90477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1aff6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1affd expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.027550:0:90477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1aff6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1affd expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.027567:0:90477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1aff6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1affd expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.027573:0:90477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1aff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1affd expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.027584:0:90477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788201050.027587:0:90477:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788201050.027596:0:90477:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1788201050.027628:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201050.027633:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1aff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1affd expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.027639:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006c6cc00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201050.027641:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1aff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1affd expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.027648:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1aff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1affd expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201050.027654:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1aff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1affd expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201050.027659:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201050.027661:0:6521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788201050.027663:0:6521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788201050.027677:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1aff6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1affd expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.027682:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788201050.027714:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c9b18af6-fecc-4172-82c2-66531890fe11+21:3657:x1875060715133184:12345-0@lo:103:ldlm_bl.0 Request processed in 1287us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201050.027722:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:3.0:1788201050.027747:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715133440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201050.027781:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201050.027815:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715133440 00000100:00100000:3.0:1788201050.027821:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715133440 00000100:00100000:3.0:1788201050.027852:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:3.0:1788201050.027859:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+21:3656:x1875060715133440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201050.027868:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201050.027878:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0079adc00/0x96d0c9b8c9a1b0d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b0cf expref: 21 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201050.027888:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201050.027935:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+20:3656:x1875060715133440:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201050.027941:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:3.0:1788201050.027973:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715133440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201050.028001:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00515e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715133312:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201050.028718:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1aff6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1affd expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.028728:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc006c6cc00/0x96d0c9b8c9a1aff6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1affd expref: -99 pid: 89111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.028740:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201050.028741:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201050.028743:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788201050.028761:0:90477:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788201050.028773:0:90477:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:1.0:1788201050.028778:0:90477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1788201050.028785:0:90477:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:3.0:1788201050.031655:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201050.031687:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715133568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201050.031772:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201050.031876:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715133568 00000100:00100000:2.0:1788201050.031886:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715133568 00000100:00100000:2.0:1788201050.031961:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:2.0:1788201050.031971:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9b18af6-fecc-4172-82c2-66531890fe11+20:3658:x1875060715133568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201050.031985:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201050.032005:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0079aca00/0x96d0c9b8c9a1affd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1aff6 expref: 20 pid: 89118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201050.032045:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201050.032083:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9b18af6-fecc-4172-82c2-66531890fe11+19:3658:x1875060715133568:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201050.032090:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:3.0:1788201050.032292:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715133568:0@lo:103:ldlm_bl.0 00000004:00000080:1.0:1788201050.032432:0:90477:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000100:00100000:0.0:1788201050.032820:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00515df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715133184:0@lo:103:ldlm_bl.0 00000001:00080000:3.0:1788201050.033187:0:89112:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149712 is committed 00010000:00010000:0.0:1788201050.033260:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdcc00/0x96d0c9b8c9a1b528 lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201050.033271:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdcc00/0x96d0c9b8c9a1b528 lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201050.033279:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdcc00/0x96d0c9b8c9a1b528 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201050.033301:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdcc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201050.033307:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdcc00/0x96d0c9b8c9a1b528 lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201050.033315:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdcc00/0x96d0c9b8c9a1b528 lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201050.033330:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8dc103a1b200) 00010000:00010000:0.0:1788201050.033333:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201050.033338:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdcc00/0x96d0c9b8c9a1b528 lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201050.033344:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc004fdcc00/0x96d0c9b8c9a1b528 lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788201050.033673:0:90477:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:1.0:1788201050.033680:0:90477:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc0039c1800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201050.033686:0:90477:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc106309000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201050.033691:0:90477:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc1401c1800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201050.033695:0:90477:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc13f869000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201050.033702:0:90477:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc13f86b000 4292087e-fa00-4621-b681-837afc99ae35 192.168.201.20@tcp 12 (0 0 7) 0 0 0 0: 0000000000000000 111669149712 stale:0 00000020:00080000:1.0:1788201050.033707:0:90477:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff8dc1401b19b8) has exports, disconnecting them 00000020:00080000:1.0:1788201050.033712:0:90477:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc0039c1800), last request at 1788201012 00000020:00000080:1.0:1788201050.033718:0:90477:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b1ee 00000100:00080000:1.0:1788201050.033728:0:90477:0:(import.c:65:import_set_state_nolock()) ffff8dc0039c0800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201050.033754:0:90477:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc0039c1800): rc 0 00000020:00000080:1.0:1788201050.033756:0:90477:0:(genops.c:885:class_export_put()) final put ffff8dc0039c1800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788201050.033769:0:90477:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc106309000), last request at 1788201047 00000020:00000080:1.0:1788201050.033772:0:90477:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b1e7 00000100:00080000:1.0:1788201050.033787:0:90477:0:(import.c:65:import_set_state_nolock()) ffff8dc0039c7800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788201050.033804:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788201050.033812:0:90477:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc106309000): rc 0 00000020:00000080:1.0:1788201050.033814:0:90477:0:(genops.c:885:class_export_put()) final put ffff8dc106309000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788201050.033819:0:90477:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc1401c1800), last request at 1788201047 00000020:00000080:1.0:1788201050.033822:0:90477:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b1e0 00000100:00080000:1.0:1788201050.033826:0:90477:0:(import.c:65:import_set_state_nolock()) ffff8dc1201cc000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788201050.033839:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788201050.033845:0:90477:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc1401c1800): rc 0 00000020:00000080:1.0:1788201050.033855:0:90477:0:(genops.c:885:class_export_put()) final put ffff8dc1401c1800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788201050.033861:0:90477:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc13f869000), last request at 1788201006 00000020:00000080:1.0:1788201050.033868:0:90477:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b051 00000100:00080000:1.0:1788201050.033879:0:90477:0:(import.c:65:import_set_state_nolock()) ffff8dc12b6b8000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788201050.034045:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201050.034099:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788201050.034108:0:90477:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc13f869000): rc 0 00000020:00000080:1.0:1788201050.034110:0:90477:0:(genops.c:885:class_export_put()) final put ffff8dc13f869000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:1.0:1788201050.034115:0:90477:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.201.20@tcp (ffff8dc13f86b000), last request at 1788201048 00000020:00000080:1.0:1788201050.034119:0:90477:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b04a 00000020:00010000:1.0:1788201050.034126:0:90477:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc13f86b000: total 4 00000100:00080000:1.0:1788201050.034129:0:90477:0:(import.c:65:import_set_state_nolock()) ffff8dc106071000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201050.034156:0:90477:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.201.20@tcp (ffff8dc13f86b000): rc 0 00000004:00000080:1.0:1788201050.034162:0:90477:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa0dd41ddbae0 00000100:00080000:1.0:1788201050.034179:0:90477:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788201050.034183:0:90477:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00010000:0.0:1788201050.034537:0:6520:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc13f86b000: total 4 00010000:00010000:0.0:1788201050.034598:0:6520:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc13f86b000, canceled 0 locks, left on hash table 7. 00010000:00010000:0.0:1788201050.034626:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2dc00/0x96d0c9b8c9a1b5a6 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866d5 expref: 8 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201050.034646:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2de00/0x96d0c9b8c9a1b425 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786650 expref: 7 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201050.034660:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1b433 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78665e expref: 6 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201050.034671:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d200/0x96d0c9b8c9a1b521 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78669d expref: 5 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201050.034698:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c200/0x96d0c9b8c9a1b53d lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866ab expref: 4 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201050.034714:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2ca00/0x96d0c9b8c9a1b560 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866c7 expref: 3 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201050.034729:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1b42c lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786657 expref: 2 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201050.034745:0:6520:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc13f86b000, canceled 7 locks, left on hash table 0. 00000100:00080000:1.0:1788201050.039292:0:90477:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788201050.039331:0:90477:0:(import.c:65:import_set_state_nolock()) ffff8dc001db7800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788201050.040009:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715133696:0@lo:39:umount.0 00000100:00100000:3.0:1788201050.040109:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788201050.040273:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0039c1800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788201050.040330:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc106309000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788201050.040349:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1401c1800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788201050.040371:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13f869000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788201050.040400:0:41592:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc0039c0800 for lustre-MDT0000 00000020:00000080:3.0:1788201050.040405:0:41592:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc0039c7800 for lustre-MDT0000 00000020:00000080:3.0:1788201050.040408:0:41592:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1201cc000 for lustre-MDT0000 00000020:00000080:3.0:1788201050.040412:0:41592:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc12b6b8000 for lustre-MDT0000 00000100:00100000:2.0:1788201050.040576:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715133696 00000100:00100000:2.0:1788201050.040585:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715133696 00000100:00100000:2.0:1788201050.040633:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3926 00000100:00100000:2.0:1788201050.040644:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715133696:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788201050.040674:0:8457:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b090 00000100:00080000:2.0:1788201050.040683:0:8457:0:(import.c:65:import_set_state_nolock()) ffff8dc13f839000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788201050.040704:0:8457:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411438 00000100:00100000:2.0:1788201050.040877:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3654:x1875060715133696:12345-0@lo:39:umount.0 Request processed in 234us (767us total) trans 77309411439 rc 0/0 00000100:00100000:2.0:1788201050.040884:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3926 00010000:00010000:2.0:1788201050.041105:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201050.041186:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db7800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788201050.041194:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715133696:0@lo:39:umount.0 00000100:00080000:1.0:1788201050.046589:0:90477:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788201050.046600:0:90477:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969451 gen 3 00000004:00080000:1.0:1788201050.046626:0:90477:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788201050.046683:0:90477:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788201050.046711:0:90477:0:(import.c:65:import_set_state_nolock()) ffff8dc12e640000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788201050.046737:0:90477:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788201050.046739:0:90477:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 3 00000004:00080000:1.0:1788201050.046749:0:90477:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788201050.046819:0:90477:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788201050.046831:0:90477:0:(import.c:65:import_set_state_nolock()) ffff8dc001e28800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788201050.046877:0:90477:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8dc1401b19b8) has no exports 00000100:00100000:2.0:1788201050.047079:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715133824:0@lo:9:umount.0 00000100:00100000:2.0:1788201050.047164:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201050.047203:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715133952:0@lo:9:umount.0 00000100:00100000:2.0:1788201050.047226:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201050.047283:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715133824 00000100:00100000:2.0:1788201050.047291:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715133824 00000100:00100000:2.0:1788201050.047347:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715133952 00000100:00100000:2.0:1788201050.047350:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715133952 00000100:00100000:2.0:1788201050.047374:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5887 00000100:00100000:2.0:1788201050.047384:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715133824:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788201050.047408:0:26203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b0ac 00000100:00080000:2.0:1788201050.047415:0:26203:0:(import.c:65:import_set_state_nolock()) ffff8dc1090d6000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788201050.047461:0:26203:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969452 00000100:00100000:2.0:1788201050.047610:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2:3654:x1875060715133824:12345-0@lo:9:umount.0 Request processed in 226us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201050.047617:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5887 00000100:00100000:2.0:1788201050.047633:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5888 00000100:00100000:2.0:1788201050.047639:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715133952:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788201050.047650:0:26203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b0c8 00000100:00080000:2.0:1788201050.047655:0:26203:0:(import.c:65:import_set_state_nolock()) ffff8dc1201c8000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788201050.047677:0:26203:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969452 00000100:00100000:2.0:1788201050.047746:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2:3654:x1875060715133952:12345-0@lo:9:umount.0 Request processed in 107us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201050.047752:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5888 00010000:00010000:2.0:1788201050.047772:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201050.047809:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc12e640000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788201050.047814:0:3654:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788201050.047816:0:3654:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201050.047819:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715133824:0@lo:9:umount.0 00000100:00080000:2.0:1788201050.047829:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001e28800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788201050.047837:0:3654:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788201050.047839:0:3654:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201050.047841:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715133952:0@lo:9:umount.0 00000100:00080000:3.0:1788201050.048217:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201050.048222:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1788201050.048868:0:90477:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8dc1401b19b8) has no exports 00010000:00010000:2.0:1788201050.050129:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788201050.083331:0:6520:0:(genops.c:885:class_export_put()) final put ffff8dc13f86b000/4292087e-fa00-4621-b681-837afc99ae35 00010000:00010000:2.0:1788201050.083974:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201050.083978:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201050.083981:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788201050.087634:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13f86b000/4292087e-fa00-4621-b681-837afc99ae35 for lustre-MDT0000 00000020:00000080:2.0:1788201050.092860:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc106071000 for lustre-MDT0000 00000020:00000080:1.0:1788201050.107121:0:90477:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b066 00000020:00000080:1.0:1788201050.107139:0:90477:0:(genops.c:885:class_export_put()) final put ffff8dc005a49800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788201050.107210:0:90477:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788201050.107266:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005a49800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788201050.107289:0:90477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201050.107304:0:90477:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788201050.107308:0:90477:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8dc12f0c19b8) has no exports 00000020:00000080:0.0:1788201050.108317:0:90477:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b05f 00000020:00000080:0.0:1788201050.108341:0:90477:0:(genops.c:885:class_export_put()) final put ffff8dc120723000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788201050.108646:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc120723000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788201050.108712:0:90477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201050.108724:0:90477:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788201050.108727:0:90477:0:(genops.c:885:class_export_put()) final put ffff8dc120724000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788201050.108729:0:90477:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc120724000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788201050.108737:0:90477:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1788201050.108873:0:90477:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc12b66ba80 - data ffff8dc11db7bbd0/ffff8dc008e86800 00000020:01000000:1.0:1788201050.109320:0:90477:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc007fd05a0 - data ffff8dc133978000/ffff8dc1076f8c00 00000100:00080000:0.0:1788201050.162591:0:90477:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788201050.162601:0:90477:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788201050.162615:0:90477:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8dc0039d1880 x1875060715133696/t77309411439(77309411439) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201060 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201050.162640:0:90477:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788201050.164294:0:90477:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788201050.164300:0:90477:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969451 gen 4 00000004:00080000:0.0:1788201050.164421:0:90477:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201050.164425:0:90477:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788201050.164734:0:89128:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788201050.164739:0:89128:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x68:0x0] index 1 count 1 00000040:00080000:1.0:1788201050.164759:0:89128:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 26 count 2 00000100:00080000:0.0:1788201050.166993:0:90477:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788201050.167000:0:90477:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 4 00000004:00080000:0.0:1788201050.167038:0:90477:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201050.167042:0:90477:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788201050.167567:0:89130:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788201050.167572:0:89130:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6a:0x0] index 1 count 1 00000040:00080000:3.0:1788201050.167584:0:89130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 26 count 2 00000020:00000080:1.0:1788201050.173888:0:90477:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b019 00000020:00000080:1.0:1788201050.173900:0:90477:0:(genops.c:885:class_export_put()) final put ffff8dc110733000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788201050.174259:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110733000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788201050.175119:0:90477:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b02e 00000020:00000080:1.0:1788201050.175129:0:90477:0:(genops.c:885:class_export_put()) final put ffff8dc110730800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788201050.175150:0:90477:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788201050.175156:0:90477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201050.175168:0:90477:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788201050.175172:0:90477:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8dc1401b0000) has no exports 00000020:00000080:3.0:1788201050.175272:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110730800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1788201050.175602:0:90477:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788201050.175612:0:90477:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b0b3 00000020:00000080:1.0:1788201050.175618:0:90477:0:(genops.c:885:class_export_put()) final put ffff8dc110736800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788201050.175722:0:90477:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788201050.175727:0:90477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201050.175736:0:90477:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788201050.175739:0:90477:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8dc13f874d28) has no exports 00000020:00000080:1.0:1788201050.175745:0:90477:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b0a5 00000020:00000080:1.0:1788201050.175750:0:90477:0:(genops.c:885:class_export_put()) final put ffff8dc001e2e000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788201050.176058:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110736800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1788201050.176680:0:90477:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788201050.176686:0:90477:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788201050.176700:0:90477:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 5 00000004:00080000:1.0:1788201050.176706:0:90477:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201050.176708:0:90477:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201050.176744:0:90477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201050.176754:0:90477:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201050.176762:0:90477:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b097 00000020:00000080:1.0:1788201050.176768:0:90477:0:(genops.c:885:class_export_put()) final put ffff8dc137d35000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788201050.176772:0:90477:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788201050.176775:0:90477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201050.176780:0:90477:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788201050.176783:0:90477:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8dc139bb8000) has no exports 00000020:00000080:1.0:1788201050.176787:0:90477:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b089 00000020:00000080:1.0:1788201050.176790:0:90477:0:(genops.c:885:class_export_put()) final put ffff8dc11d439800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788201050.177185:0:90477:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788201050.177272:0:90477:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788201050.177276:0:90477:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969451 gen 5 00000004:00080000:1.0:1788201050.177280:0:90477:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201050.177281:0:90477:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201050.177304:0:90477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201050.177310:0:90477:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788201050.177320:0:90477:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788201050.177326:0:90477:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b07b 00000020:00000080:1.0:1788201050.177331:0:90477:0:(genops.c:885:class_export_put()) final put ffff8dc13aa9b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788201050.177335:0:90477:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788201050.177338:0:90477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201050.177343:0:90477:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788201050.177345:0:90477:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8dc12f0c0000) has no exports 00000020:00000080:1.0:1788201050.177348:0:90477:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b074 00000020:00000080:1.0:1788201050.177350:0:90477:0:(genops.c:885:class_export_put()) final put ffff8dc11d43a000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788201050.178118:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc001e2e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788201050.178131:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc001e28800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788201050.178158:0:57134:0:(genops.c:885:class_export_put()) final put ffff8dc137d36000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201050.178160:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d36000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788201050.178166:0:57134:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201050.178266:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d35000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788201050.178271:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d439800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788201050.178275:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc12e640000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788201050.178279:0:57134:0:(genops.c:885:class_export_put()) final put ffff8dc137d32800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201050.178281:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d32800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788201050.178285:0:57134:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201050.178312:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13aa9b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788201050.178317:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d43a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788201050.200799:0:90477:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788201050.200808:0:90477:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788201050.200812:0:90477:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788201050.200829:0:90477:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201050.200886:0:90477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201050.200902:0:90477:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201050.200935:0:90477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201050.200940:0:90477:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201050.200945:0:90477:0:(genops.c:885:class_export_put()) final put ffff8dc110734000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788201050.200950:0:90477:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110734000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788201050.200961:0:90477:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201050.202076:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc001db7800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788201050.202088:0:57134:0:(genops.c:885:class_export_put()) final put ffff8dc110731000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201050.202090:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110731000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788201050.202099:0:57134:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201050.203570:0:90477:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b035 00000020:00000080:0.0:1788201050.203595:0:90477:0:(genops.c:885:class_export_put()) final put ffff8dc110730000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788201050.203617:0:90477:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788201050.203622:0:90477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201050.203633:0:90477:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788201050.203637:0:90477:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8dc1060e3370) has no exports 00000020:00000080:0.0:1788201050.203666:0:90477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201050.203671:0:90477:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788201050.203676:0:90477:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b03c 00000020:00000080:0.0:1788201050.203680:0:90477:0:(genops.c:885:class_export_put()) final put ffff8dc110732800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788201050.203687:0:90477:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc1341d8000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788201050.203689:0:90477:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc1341d8000 3 00000020:01000004:0.0:1788201050.203692:0:90477:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dc1341d8000 from lustre-MDT0000 00000020:00000080:0.0:1788201050.203708:0:90477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201050.203711:0:90477:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788201050.203714:0:90477:0:(genops.c:885:class_export_put()) final put ffff8dc110734800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788201050.203716:0:90477:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110734800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788201050.203729:0:90477:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788201050.203786:0:90477:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788201050.203789:0:90477:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788201050.203792:0:90477:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788201050.203794:0:90477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201050.203797:0:90477:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788201050.203804:0:90477:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8dc110735800 0fa559bc-2180-4019-80c4-11831fedf9a9 192.168.201.20@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201050.203810:0:90477:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8dc137d37800 c9b18af6-fecc-4172-82c2-66531890fe11 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201050.203814:0:90477:0:(genops.c:1553:class_disconnect_exports()) OBD device 3 (ffff8dc139bbb370) has exports, disconnecting them 00000020:00080000:0.0:1788201050.203818:0:90477:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.201.20@tcp (ffff8dc110735800), last request at 1788201006 00000020:00000080:0.0:1788201050.203838:0:90477:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b043 00000020:00010000:0.0:1788201050.203843:0:90477:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc110735800: total 2 00000100:00080000:0.0:1788201050.203848:0:90477:0:(import.c:65:import_set_state_nolock()) ffff8dc110731800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788201050.203870:0:90477:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.201.20@tcp (ffff8dc110735800): rc 0 00000020:00080000:0.0:1788201050.203873:0:90477:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8dc137d37800), last request at 1788201006 00000020:00000080:0.0:1788201050.203923:0:90477:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1afda 00000020:00010000:0.0:1788201050.203926:0:90477:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc137d37800: total 2 00000100:00080000:0.0:1788201050.203929:0:90477:0:(import.c:65:import_set_state_nolock()) ffff8dc137d34800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788201050.203945:0:90477:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc137d37800): rc 0 00000020:00080000:0.0:1788201050.203948:0:90477:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8dc139bbb370) has no exports 00000100:00100000:0.0:1788201050.203993:0:89118:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8dc004f52600:89118] 1 exiting: rc = 0 00000100:00100000:0.0:1788201050.204095:0:89119:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8dc10a190200:89119] 2 exiting: rc = 0 00000100:00100000:3.0:1788201050.204198:0:89116:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8dc121fa2600:89116] 0 exiting: rc = 1 00000020:00000080:3.0:1788201050.204246:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110730000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788201050.204250:0:57134:0:(genops.c:885:class_export_put()) final put ffff8dc110732000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788201050.204252:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110732000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788201050.204255:0:57134:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788201050.204298:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110732800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1788201050.204355:0:24979:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc110735800: total 0 00010000:00010000:1.0:1788201050.204394:0:24979:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc110735800, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1788201050.204426:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006c6dc00/0x96d0c9b8c9a1b1d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786634 expref: 5 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.204444:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006c6d200/0x96d0c9b8c9a1b1cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78662d expref: 4 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.204468:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc100030c00/0x96d0c9b8c9a1b1d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78663b expref: 3 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.204479:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ec000/0x96d0c9b8c9a1b1c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786626 expref: 2 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.204489:0:24979:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc110735800, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1788201050.204508:0:24979:0:(genops.c:885:class_export_put()) final put ffff8dc110735800/0fa559bc-2180-4019-80c4-11831fedf9a9 00000020:00010000:1.0:1788201050.204525:0:24979:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc137d37800: total 1 00010000:00010000:1.0:1788201050.204543:0:24979:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc137d37800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788201050.204558:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006c6ca00/0x96d0c9b8c9a1b177 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b170 expref: 14 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.204570:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0079ade00/0x96d0c9b8c9a1b15b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b154 expref: 13 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.204590:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006c6d800/0x96d0c9b8c9a1b169 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b162 expref: 12 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.204602:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006c6c600/0x96d0c9b8c9a1b185 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b17e expref: 11 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.204612:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006c6ce00/0x96d0c9b8c9a1b115 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b10e expref: 10 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.204621:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006c6da00/0x96d0c9b8c9a1b193 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b18c expref: 9 pid: 89118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.204630:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140759c00/0x96d0c9b8c9a1b123 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b11c expref: 8 pid: 89118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.204643:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140759000/0x96d0c9b8c9a1b1a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b19a expref: 7 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.204654:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006c6d600/0x96d0c9b8c9a1b131 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b12a expref: 6 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.204664:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1b1af lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b1a8 expref: 5 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.204676:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140759a00/0x96d0c9b8c9a1b14d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b146 expref: 4 pid: 89118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.204688:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140758a00/0x96d0c9b8c9a1b13f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b138 expref: 3 pid: 89119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.204711:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ed400/0x96d0c9b8c9a1b1bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b1b6 expref: 2 pid: 89116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201050.204722:0:24979:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc137d37800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1788201050.204735:0:24979:0:(genops.c:885:class_export_put()) final put ffff8dc137d37800/c9b18af6-fecc-4172-82c2-66531890fe11 00010000:00010000:1.0:1788201050.204740:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201050.204742:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201050.204744:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788201050.204846:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110735800/0fa559bc-2180-4019-80c4-11831fedf9a9 for MGS 00000020:00000080:3.0:1788201050.204876:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d37800/c9b18af6-fecc-4172-82c2-66531890fe11 for MGS 00000020:00000080:3.0:1788201050.204887:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc110731800 for MGS 00000020:00000080:3.0:1788201050.204891:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc137d34800 for MGS 00000100:00100000:0.0:1788201050.204954:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.204964:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.204970:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.204975:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.204980:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.204986:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.204992:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.204997:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.205004:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.205009:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788201050.205063:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201050.210277:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210299:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210306:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210313:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210319:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210325:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210331:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210337:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210342:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210347:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210353:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210358:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210364:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210370:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210375:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210381:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210386:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210410:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210416:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210421:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210426:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210431:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210437:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210442:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210448:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210454:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210460:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210465:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210471:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210477:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210483:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210490:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210497:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210502:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210508:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210513:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210518:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210524:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210529:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210535:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210540:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210545:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210550:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210556:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210561:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210568:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210573:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210579:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210584:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210590:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210595:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210600:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210613:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201050.210618:0:90477:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788201050.215472:0:90477:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc0073e0c00 - data ffff8dc0023db0d8/ffff8dc12f314400 00000020:01000000:0.0:1788201050.215597:0:90477:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc003bd7960 - data ffff8dc0022a5798/ffff8dc139e81800 00000020:00000080:0.0:1788201050.215985:0:90477:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1afd3 00000020:00000080:0.0:1788201050.215992:0:90477:0:(genops.c:885:class_export_put()) final put ffff8dc137d31800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788201050.216007:0:90477:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc1341d8000 from MGS, refs=2 00000020:01000004:0.0:1788201050.216010:0:90477:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc1341d8000 2 00000020:01000004:0.0:1788201050.216012:0:90477:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dc1341d8000 from MGS 00000020:00000080:1.0:1788201050.216339:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d31800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788201050.216400:0:90477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201050.216407:0:90477:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788201050.216411:0:90477:0:(genops.c:885:class_export_put()) final put ffff8dc137d30800/MGS 00000020:00000080:0.0:1788201050.216413:0:90477:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d30800/MGS for MGS 00000020:01000000:0.0:1788201050.216420:0:90477:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788201050.216494:0:90477:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788201050.216498:0:90477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201050.216508:0:90477:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788201050.216513:0:90477:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8dc103486000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201050.216518:0:90477:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8dc139bb99b8) has exports, disconnecting them 00000020:00080000:0.0:1788201050.216521:0:90477:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8dc103486000), last request at 1788201006 00000020:00000080:0.0:1788201050.216525:0:90477:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b0f2 00000020:00080000:0.0:1788201050.216532:0:90477:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc103486000): rc 0 00000020:00000080:0.0:1788201050.216535:0:90477:0:(genops.c:885:class_export_put()) final put ffff8dc103486000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788201050.217035:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc103486000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788201050.218230:0:90477:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788201050.218236:0:90477:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788201050.218240:0:90477:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788201050.218245:0:90477:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788201050.218362:0:41592:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc103484800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788201050.218494:0:90477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201050.218505:0:90477:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788201050.218509:0:90477:0:(genops.c:885:class_export_put()) final put ffff8dc0078dd000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788201050.218512:0:90477:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0078dd000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788201050.218516:0:90477:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788201050.218591:0:90477:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc1341d8000 1 00000020:00000080:1.0:1788201050.218596:0:90477:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1afc5 00000020:00000080:1.0:1788201050.218601:0:90477:0:(genops.c:885:class_export_put()) final put ffff8dc137d37000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788201050.218613:0:90477:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788201050.218616:0:90477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201050.218620:0:90477:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788201050.218623:0:90477:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8dc1401b4d28) has no exports 00000020:00000080:3.0:1788201050.218715:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d37000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788201050.274836:0:90477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201050.274850:0:90477:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788201050.274856:0:90477:0:(genops.c:885:class_export_put()) final put ffff8dc006e37000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788201050.274862:0:90477:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc006e37000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788201050.274874:0:90477:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788201050.275032:0:90477:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dc006e30000 00000020:02000400:0.0:1788201050.275106:0:90477:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1788201050.447712:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201050.447738:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715134080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201050.447829:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201050.447919:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715134080 00000100:00100000:2.0:1788201050.447928:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715134080 00000100:00100000:2.0:1788201050.447997:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2220 00000100:00100000:2.0:1788201050.448008:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715134080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201050.448084:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201050.448148:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715134080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201050.448155:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2220 00000100:00100000:2.0:1788201050.448232:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715134080:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788201050.448639:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201050.449375:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201050.449388:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715134208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201050.449432:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201050.449470:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715134208 00000100:00100000:2.0:1788201050.449475:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715134208 00000100:00100000:2.0:1788201050.449509:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2221 00000100:00100000:2.0:1788201050.449516:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715134208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201050.449537:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201050.449583:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715134208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201050.449590:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2221 00000100:00080000:2.0:1788201050.449619:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201050.449644:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715134208:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788201050.895686:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201051.927266:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788201052.500803:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788201052.500814:0:9526:0:(genops.c:885:class_export_put()) final put ffff8dc1201c9800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788201052.500837:0:9526:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969452 is committed 00000020:00000080:1.0:1788201052.500850:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1201c9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788201052.500903:0:41592:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1201c8000 for lustre-OST0001 00000001:00100000:1.0:1788201052.509988:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788201052.509998:0:8442:0:(genops.c:885:class_export_put()) final put ffff8dc1090d7000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788201052.510085:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969452 is committed 00000020:00000080:2.0:1788201052.510155:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1090d7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788201052.510199:0:41592:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1090d6000 for lustre-OST0000 00000100:00100000:3.0:1788201052.636370:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201052.636411:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201052.636614:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695376384 00000100:00100000:1.0:1788201052.636624:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695376384 00000100:00100000:1.0:1788201052.636700:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5889 00000100:00100000:1.0:1788201052.636714:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695376384:12345-192.168.201.20@tcp:16:kworker.0 00000100:00100000:1.0:1788201052.636836:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695376384:12345-192.168.201.20@tcp:16:kworker.0 Request processed in 125us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201052.636844:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5889 00000100:00100000:2.0:1788201052.637049:0:24873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695376256 00000100:00100000:2.0:1788201052.637054:0:24873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695376256 00002000:00100000:2.0:1788201052.637090:0:24873:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x322:0x0] (1048576->2097151) req@ffff8dc00515d880 x1875060695376256/t0(0) o4->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:173/0 lens 488/0 e 0 to 0 dl 1788201063 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201052.637110:0:24873:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc00515d880 with x1875060695376256 ext(1048576->2097151) 00002000:00010000:2.0:1788201052.637116:0:24873:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc00515d880 00000100:00100000:2.0:1788201052.637144:0:24873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1004 00000100:00100000:2.0:1788201052.637152:0:24873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695376256:12345-192.168.201.20@tcp:4:md5sum.0 00000100:00080000:3.0:1788201052.640212:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201052.705934:0:24873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4292087e-fa00-4621-b681-837afc99ae35+8:2400:x1875060695376256:12345-192.168.201.20@tcp:4:md5sum.0 Request processed in 68772us (69564us total) trans 4294969453 rc 0/0 00000100:00100000:2.0:1788201052.705949:0:24873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1004 00002000:00100000:2.0:1788201052.705963:0:24873:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x322:0x0] (1048576->2097151) req@ffff8dc00515d880 x1875060695376256/t4294969453(0) o4->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:173/0 lens 488/448 e 0 to 0 dl 1788201063 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201052.705974:0:24873:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc00515d880 with x1875060695376256 ext(1048576->2097151) 00002000:00010000:2.0:1788201052.705980:0:24873:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc00515d880 00010000:00010000:1.0:1788201052.945188:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201053.007341:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00515ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715134592:0@lo:400:kworker.0 00000100:00100000:3.0:1788201053.007410:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201053.007445:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715135104:0@lo:400:kworker.0 00000100:00100000:3.0:1788201053.007468:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201053.007491:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788201053.007497:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00515dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715134464:0@lo:400:kworker.0 00000100:00100000:3.0:1788201053.007517:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201053.007533:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715134976:0@lo:400:kworker.0 00000100:00100000:3.0:1788201053.007554:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201053.007584:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715134592 00000100:00100000:3.0:1788201053.007591:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715134592 00000100:00100000:3.0:1788201053.007637:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715134464 00000100:00100000:3.0:1788201053.007640:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715134464 00000100:00100000:3.0:1788201053.007657:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1295 00000100:00100000:3.0:1788201053.007667:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715134592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201053.007714:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715134592:12345-0@lo:400:kworker.0 Request processed in 49us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201053.007720:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1295 00000100:00100000:3.0:1788201053.007738:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:3.0:1788201053.007742:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1875060715134464:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788201053.007748:0:66312:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788201053.007771:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1875060715134464:12345-0@lo:400:kworker.0 Request processed in 27us (253us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788201053.007793:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:3.0:1788201053.007816:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715134976 00000100:00100000:3.0:1788201053.007821:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715134976 00000100:00100000:3.0:1788201053.007865:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3927 00000100:00100000:3.0:1788201053.007869:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1875060715134976:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788201053.007875:0:23728:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788201053.007900:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1875060715134976:12345-0@lo:400:kworker.0 Request processed in 29us (344us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788201053.007905:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3927 00000100:00080000:3.0:1788201053.007920:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201053.007951:0:3658:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788201053.007955:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788201053.007959:0:3658:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788201053.007964:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201053.007967:0:3658:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3863 00000100:00080000:3.0:1788201053.007973:0:3658:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201053.007991:0:3658:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc14014f800 x1875060715135488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201053.008008:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00515dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715134464:0@lo:400:kworker.0 00000100:00080000:3.0:1788201053.008041:0:3658:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788201053.008044:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788201053.008047:0:3658:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788201053.008051:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201053.008053:0:3658:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3863 00000100:00080000:3.0:1788201053.008063:0:3658:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201053.008076:0:3658:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc14014dc00 x1875060715135616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201053.008084:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715134976:0@lo:400:kworker.0 00000100:00100000:3.0:1788201053.008111:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00515ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715134592:0@lo:400:kworker.0 00000100:00100000:1.0:1788201053.008205:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00515df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715134720:0@lo:400:kworker.0 00000100:00100000:1.0:1788201053.008236:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201053.008263:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715135232:0@lo:400:kworker.0 00000100:00100000:1.0:1788201053.008285:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201053.008305:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788201053.008310:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00515f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715134336:0@lo:400:kworker.0 00000400:00000100:1.0:1788201053.008328:0:3655:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715134336 offset 0 length 224: 4 00000100:00100000:1.0:1788201053.008347:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715134848:0@lo:400:kworker.0 00000100:00100000:1.0:1788201053.008375:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201053.008393:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715135360:0@lo:400:kworker.0 00000100:00100000:1.0:1788201053.008411:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201053.008436:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715135104 00000100:00100000:1.0:1788201053.008440:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715135104 00000100:00100000:1.0:1788201053.008472:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715135232 00000100:00100000:1.0:1788201053.008474:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715135232 00000100:00100000:1.0:1788201053.008494:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2734 00000100:00100000:1.0:1788201053.008502:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715135104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201053.008535:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715135104:12345-0@lo:400:kworker.0 Request processed in 35us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201053.008542:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2734 00000100:00100000:1.0:1788201053.008555:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2735 00000100:00100000:1.0:1788201053.008561:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715135232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201053.008586:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715135232:12345-0@lo:400:kworker.0 Request processed in 25us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201053.008592:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2735 00000100:00100000:1.0:1788201053.008611:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715134720 00000100:00100000:1.0:1788201053.008613:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715134720 00000100:00100000:1.0:1788201053.008628:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715134848 00000100:00100000:1.0:1788201053.008630:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715134848 00000100:00100000:1.0:1788201053.008644:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715135360 00000100:00100000:1.0:1788201053.008646:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715135360 00000100:00100000:1.0:1788201053.008654:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:1.0:1788201053.008660:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715134848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201053.008683:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715134848:12345-0@lo:400:kworker.0 Request processed in 24us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201053.008696:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00100000:1.0:1788201053.008707:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:1.0:1788201053.008711:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00586c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3655:x1875060715134720:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788201053.008715:0:69485:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788201053.008737:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00586c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3655:x1875060715134720:12345-0@lo:400:kworker.0 Request processed in 24us (500us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788201053.008742:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:1.0:1788201053.008751:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:1.0:1788201053.008755:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3655:x1875060715135360:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788201053.008758:0:69485:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788201053.008776:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3655:x1875060715135360:12345-0@lo:400:kworker.0 Request processed in 20us (363us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788201053.008780:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00080000:1.0:1788201053.008795:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201053.008799:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201053.008800:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201053.008817:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715134848:0@lo:400:kworker.0 00000100:00080000:1.0:1788201053.008824:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788201053.008827:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788201053.008829:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788201053.008833:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201053.008836:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3863 00000100:00080000:1.0:1788201053.008840:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201053.008856:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12ee2c000 x1875060715135744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201053.008878:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715135360:0@lo:400:kworker.0 00000100:00080000:1.0:1788201053.008888:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788201053.008891:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788201053.008893:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788201053.008895:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201053.008898:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3863 00000100:00080000:1.0:1788201053.008901:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201053.008911:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12ee2ce00 x1875060715135872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201053.008918:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00515df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715134720:0@lo:400:kworker.0 00000100:00100000:1.0:1788201053.008927:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715135232:0@lo:400:kworker.0 00000100:00100000:2.0:1788201053.009251:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715135488:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788201053.009287:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201053.009302:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715135616:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788201053.009323:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201053.009349:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715135744:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788201053.009368:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201053.009382:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715135872:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788201053.009408:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201053.009434:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715135488 00000100:00100000:2.0:1788201053.009438:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715135488 00000100:00100000:2.0:1788201053.009457:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715135744 00000100:00100000:2.0:1788201053.009460:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715135744 00000100:00100000:2.0:1788201053.009466:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715135872 00000100:00100000:2.0:1788201053.009468:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715135872 00000100:00100000:2.0:1788201053.009477:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:2.0:1788201053.009482:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715135488:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1788201053.009500:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201053.009528:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715135488:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 45us (241us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201053.009533:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00100000:2.0:1788201053.009545:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:2.0:1788201053.009549:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715135744:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788201053.009557:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201053.009579:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715135744:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 28us (209us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201053.009584:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:2.0:1788201053.009595:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:2.0:1788201053.009606:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715135872:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788201053.009615:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201053.009637:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715135872:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 30us (228us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201053.009642:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00080000:2.0:1788201053.009665:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201053.009669:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201053.009672:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715135488:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1788201053.009679:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201053.009682:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201053.009684:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715135744:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1788201053.009690:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201053.009693:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201053.009696:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715135872:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788201053.009770:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715135616 00000100:00100000:0.0:1788201053.009781:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715135616 00000100:00100000:0.0:1788201053.009807:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3928 00000100:00100000:0.0:1788201053.009812:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715135616:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1788201053.009822:0:8457:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201053.009871:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715135616:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 57us (546us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201053.009877:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3928 00000100:00080000:0.0:1788201053.009900:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201053.009904:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201053.009907:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715135616:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788201053.011175:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715135104:0@lo:400:kworker.0 00000400:00000100:1.0:1788201053.653041:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695376512 offset 0 length 224: 4 00000100:00100000:1.0:1788201053.653102:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201053.653137:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201053.653168:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201053.653216:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201053.653345:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695377024 00000100:00100000:3.0:1788201053.653357:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695377024 00000100:00100000:3.0:1788201053.653434:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695376896 00000100:00100000:3.0:1788201053.653437:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695376896 00000100:00100000:3.0:1788201053.653464:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2736 00000100:00100000:3.0:1788201053.653475:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4292087e-fa00-4621-b681-837afc99ae35+7:2400:x1875060695377024:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201053.653547:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4292087e-fa00-4621-b681-837afc99ae35+7:2400:x1875060695377024:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 75us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201053.653555:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2736 00000100:00100000:3.0:1788201053.653572:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2737 00000100:00100000:3.0:1788201053.653578:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4292087e-fa00-4621-b681-837afc99ae35+8:2400:x1875060695376896:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201053.653597:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4292087e-fa00-4621-b681-837afc99ae35+8:2400:x1875060695376896:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 20us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201053.653603:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2737 00000100:00080000:1.0:1788201053.653724:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201053.654293:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695376768 00000100:00100000:0.0:1788201053.654300:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695376768 00000100:00100000:0.0:1788201053.654354:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695376640 00000100:00100000:0.0:1788201053.654358:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695376640 00000100:00100000:0.0:1788201053.654377:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1297 00000100:00100000:0.0:1788201053.654385:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695376768:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201053.654437:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695376768:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 54us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201053.654444:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1297 00000100:00100000:0.0:1788201053.654458:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1260 00000100:00100000:0.0:1788201053.654462:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1875060695376640:12345-192.168.201.20@tcp:400:kworker.0 00000020:00080000:0.0:1788201053.654468:0:66313:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.20@tcp 00000100:00100000:0.0:1788201053.654486:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1875060695376640:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (1318us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788201053.654491:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1260 00000100:00080000:1.0:1788201053.654786:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201053.692427:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201053.692544:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695377152 00000100:00100000:3.0:1788201053.692555:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695377152 00000100:00100000:3.0:1788201053.692607:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1261 00000100:00100000:3.0:1788201053.692617:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875060695377152:12345-192.168.201.20@tcp:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1788201053.692658:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201053.692734:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875060695377152:12345-192.168.201.20@tcp:38:ptlrpcd_00_00.0 Request processed in 117us (329us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201053.692742:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1261 00010000:00010000:3.0:1788201053.968649:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201054.991258:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201055.567836:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201055.567859:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715136000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201055.567926:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201055.567979:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715136000 00000100:00100000:2.0:1788201055.567987:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715136000 00000100:00100000:2.0:1788201055.568069:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2222 00000100:00100000:2.0:1788201055.568081:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715136000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201055.568111:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201055.568158:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715136000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201055.568184:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2222 00000100:00100000:2.0:1788201055.568235:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715136000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201055.568476:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715136128:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201055.568502:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201055.568629:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715136128 00000100:00100000:3.0:1788201055.568634:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715136128 00000100:00100000:3.0:1788201055.568663:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2223 00000100:00100000:3.0:1788201055.568670:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715136128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201055.568687:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17088320 pending 1073152 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788201055.568721:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715136128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201055.568727:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2223 00000100:00100000:2.0:1788201055.568852:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715136128:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788201055.569187:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201055.569192:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1788201055.579093:0:75739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788201055.579109:0:75739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411439 is committed 00000020:00000080:2.0:1788201055.579115:0:75739:0:(genops.c:885:class_export_put()) final put ffff8dc13f83f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201055.579192:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13f83f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788201055.579262:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc13f839000 for lustre-MDT0001 00010000:00010000:2.0:1788201056.017289:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201057.042520:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201058.064567:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201058.127392:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201058.127399:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201058.127403:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201058.127411:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3904 00000100:00080000:3.0:1788201058.127417:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201058.127425:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201058.127449:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc14014ca80 x1875060715136384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201058.127505:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201058.127508:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201058.127510:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201058.127514:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3904 00000100:00080000:3.0:1788201058.127516:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201058.127520:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201058.127531:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc14014c700 x1875060715136640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201058.127559:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201058.127563:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201058.127565:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201058.127568:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3904 00000100:00080000:3.0:1788201058.127571:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201058.127574:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201058.127598:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc14014c000 x1875060715136896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201058.127619:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201058.127621:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201058.127623:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201058.127626:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3904 00000100:00080000:3.0:1788201058.127628:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201058.127632:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201058.127640:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc14014e680 x1875060715137280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201058.127678:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715136768:0@lo:400:kworker.0 00000100:00100000:3.0:1788201058.127748:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201058.127793:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201058.127798:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715137024:0@lo:400:kworker.0 00000100:00100000:3.0:1788201058.127818:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201058.127849:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715137024 00000100:00100000:3.0:1788201058.127855:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715137024 00000100:00100000:3.0:1788201058.127902:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2738 00000100:00100000:3.0:1788201058.127910:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715137024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201058.127956:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715137024:12345-0@lo:400:kworker.0 Request processed in 47us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201058.127963:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2738 00000100:00100000:3.0:1788201058.128039:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715137024:0@lo:400:kworker.0 00000100:00100000:0.0:1788201058.128258:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715136384:0@lo:38:kworker.0 00000100:00100000:0.0:1788201058.128311:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201058.128338:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715136640:0@lo:38:kworker.0 00000100:00100000:0.0:1788201058.128356:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201058.128367:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715136896:0@lo:38:kworker.0 00000100:00100000:0.0:1788201058.128384:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201058.128397:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715137280:0@lo:38:kworker.0 00000100:00100000:0.0:1788201058.128415:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201058.128528:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715136512:0@lo:400:kworker.0 00000100:00100000:2.0:1788201058.128555:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201058.128580:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788201058.128593:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715136256:0@lo:400:kworker.0 00000400:00000100:2.0:1788201058.128609:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715136256 offset 0 length 224: 4 00000100:00100000:2.0:1788201058.128627:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715137152:0@lo:400:kworker.0 00000100:00100000:2.0:1788201058.128643:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201058.128664:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715136768 00000100:00100000:2.0:1788201058.128668:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715136768 00000100:00100000:2.0:1788201058.128690:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715136384 00000100:00100000:2.0:1788201058.128692:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715136384 00000100:00100000:2.0:1788201058.128699:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715136640 00000100:00100000:2.0:1788201058.128700:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715136640 00000100:00100000:2.0:1788201058.128706:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715137280 00000100:00100000:2.0:1788201058.128708:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715137280 00000100:00100000:2.0:1788201058.128714:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715136512 00000100:00100000:2.0:1788201058.128716:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715136512 00000100:00100000:2.0:1788201058.128736:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1298 00000100:00100000:2.0:1788201058.128742:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715136768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201058.128775:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715136768:12345-0@lo:400:kworker.0 Request processed in 33us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201058.128781:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1298 00000100:00100000:2.0:1788201058.128793:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1299 00000100:00100000:2.0:1788201058.128798:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715136512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201058.128821:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715136512:12345-0@lo:400:kworker.0 Request processed in 23us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201058.128827:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1299 00000100:00100000:2.0:1788201058.128836:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:2.0:1788201058.128839:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715136384:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788201058.128856:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201058.128879:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715136384:12345-0@lo:38:kworker.0 Request processed in 38us (568us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201058.128885:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:2.0:1788201058.128893:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:2.0:1788201058.128897:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715136640:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788201058.128905:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201058.128920:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715136640:12345-0@lo:38:kworker.0 Request processed in 22us (564us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201058.128925:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00100000:2.0:1788201058.128932:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:2.0:1788201058.128936:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715137280:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788201058.128943:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201058.128965:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715137280:12345-0@lo:38:kworker.0 Request processed in 28us (549us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201058.128970:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00100000:2.0:1788201058.128992:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715136512:0@lo:400:kworker.0 00000100:00080000:2.0:1788201058.129047:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201058.129052:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201058.129055:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715136384:0@lo:38:kworker.0 00000100:00080000:2.0:1788201058.129061:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201058.129064:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201058.129067:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715136640:0@lo:38:kworker.0 00000100:00080000:2.0:1788201058.129073:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201058.129076:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201058.129078:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715137280:0@lo:38:kworker.0 00000100:00100000:2.0:1788201058.129099:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715136768:0@lo:400:kworker.0 00000100:00080000:1.0:1788201058.129255:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201058.129260:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201058.129373:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715136896 00000100:00100000:3.0:1788201058.129377:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715136896 00000100:00100000:3.0:1788201058.129407:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3929 00000100:00100000:3.0:1788201058.129412:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715136896:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788201058.129422:0:23728:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201058.129456:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715136896:12345-0@lo:38:kworker.0 Request processed in 43us (1071us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201058.129462:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3929 00000100:00100000:3.0:1788201058.129481:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715137152 00000100:00100000:3.0:1788201058.129484:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715137152 00000100:00100000:3.0:1788201058.129514:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2739 00000100:00100000:3.0:1788201058.129520:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12014ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715137152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201058.129554:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12014ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715137152:12345-0@lo:400:kworker.0 Request processed in 35us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201058.129560:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2739 00000100:00100000:2.0:1788201058.129697:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715137152:0@lo:400:kworker.0 00000100:00080000:2.0:1788201058.129714:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201058.129718:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201058.129721:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715136896:0@lo:38:kworker.0 00000100:00080000:1.0:1788201058.129763:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788201058.646892:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969453 is committed 00000400:00000100:1.0:1788201058.773064:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695377280 offset 0 length 224: 4 00000100:00100000:1.0:1788201058.773106:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201058.773148:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201058.773188:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201058.773223:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201058.773355:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695377664 00000100:00100000:3.0:1788201058.773365:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695377664 00000100:00100000:3.0:1788201058.773434:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695377792 00000100:00100000:3.0:1788201058.773438:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695377792 00000100:00100000:3.0:1788201058.773464:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2740 00000100:00100000:3.0:1788201058.773472:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695377664:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201058.773545:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695377664:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 73us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201058.773552:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2740 00000100:00100000:3.0:1788201058.773570:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2741 00000100:00100000:3.0:1788201058.773586:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4292087e-fa00-4621-b681-837afc99ae35+7:2402:x1875060695377792:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201058.773608:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4292087e-fa00-4621-b681-837afc99ae35+7:2402:x1875060695377792:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 33us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201058.773613:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2741 00000100:00100000:2.0:1788201058.774056:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695377536 00000100:00100000:2.0:1788201058.774062:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695377536 00000100:00100000:2.0:1788201058.774094:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695377408 00000100:00100000:2.0:1788201058.774097:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695377408 00000100:00100000:2.0:1788201058.774116:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1300 00000100:00100000:2.0:1788201058.774124:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695377536:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201058.774188:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695377536:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 65us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201058.774196:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1300 00000100:00100000:2.0:1788201058.774211:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1265 00000100:00100000:2.0:1788201058.774216:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695377408:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:2.0:1788201058.774235:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201058.774261:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695377408:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 43us (1037us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201058.774267:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1265 00000100:00080000:1.0:1788201058.777389:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201058.777399:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201058.777402:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788201059.087241:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201060.111278:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201060.687317:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715137408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201060.687395:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201060.687508:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715137408 00000100:00100000:2.0:1788201060.687516:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715137408 00000100:00100000:0.0:1788201060.687550:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201060.687560:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715137536:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201060.687566:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2224 00000100:00100000:2.0:1788201060.687576:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715137408:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201060.687591:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788201060.687607:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788201060.687624:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715137536 00000100:00100000:0.0:1788201060.687627:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715137536 00000100:00100000:0.0:1788201060.687648:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2225 00000100:00100000:2.0:1788201060.687652:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715137408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201060.687655:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715137536:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201060.687659:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2224 00002000:00000024:0.0:1788201060.687672:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201060.687720:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715137536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201060.687726:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2225 00000100:00100000:2.0:1788201060.687985:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715137536:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788201060.688053:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201060.688058:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201060.688079:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715137408:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788201061.135268:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201062.159306:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201063.191037:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201063.249608:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201063.249615:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201063.249619:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201063.249627:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3909 00000100:00080000:1.0:1788201063.249632:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201063.249639:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201063.249663:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc125641f80 x1875060715137792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201063.249694:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201063.249697:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201063.249699:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201063.249718:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3909 00000100:00080000:1.0:1788201063.249720:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201063.249724:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201063.249751:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005254a80 x1875060715138048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201063.249766:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201063.249769:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201063.249771:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201063.249774:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3909 00000100:00080000:1.0:1788201063.249777:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201063.249780:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201063.249790:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005254700 x1875060715138304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201063.249809:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201063.249812:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201063.249814:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201063.249817:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3909 00000100:00080000:1.0:1788201063.249819:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201063.249822:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201063.249832:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005254380 x1875060715138688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201063.249877:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715138432:0@lo:400:kworker.0 00000100:00100000:1.0:1788201063.249955:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201063.250000:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788201063.250035:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715137664:0@lo:400:kworker.0 00000400:00000100:1.0:1788201063.250059:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715137664 offset 0 length 224: 4 00000100:00100000:1.0:1788201063.250082:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715138560:0@lo:400:kworker.0 00000100:00100000:1.0:1788201063.250104:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201063.251241:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715138432 00000100:00100000:0.0:1788201063.251255:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715138432 00000100:00100000:0.0:1788201063.251321:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715138560 00000100:00100000:0.0:1788201063.251325:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715138560 00000100:00100000:0.0:1788201063.251349:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2742 00000100:00100000:0.0:1788201063.251358:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715138432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201063.251425:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715138432:12345-0@lo:400:kworker.0 Request processed in 68us (1470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201063.251444:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2742 00000100:00100000:0.0:1788201063.251462:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2743 00000100:00100000:0.0:1788201063.251469:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715138560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201063.251499:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715138560:12345-0@lo:400:kworker.0 Request processed in 31us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201063.251505:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2743 00000100:00080000:0.0:1788201063.251536:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201063.251540:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201063.251574:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715137792:0@lo:38:kworker.0 00000100:00100000:0.0:1788201063.251610:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201063.251632:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715138048:0@lo:38:kworker.0 00000100:00100000:0.0:1788201063.251657:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201063.251677:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715138304:0@lo:38:kworker.0 00000100:00100000:0.0:1788201063.251698:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201063.251716:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715138688:0@lo:38:kworker.0 00000100:00100000:0.0:1788201063.251735:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201063.251768:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715137920:0@lo:400:kworker.0 00000100:00100000:0.0:1788201063.251791:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201063.251811:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201063.251817:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715138176:0@lo:400:kworker.0 00000100:00100000:0.0:1788201063.251835:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201063.251874:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715137792 00000100:00100000:0.0:1788201063.251877:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715137792 00000100:00100000:0.0:1788201063.251891:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715138048 00000100:00100000:0.0:1788201063.251893:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715138048 00000100:00100000:0.0:1788201063.251910:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715138688 00000100:00100000:0.0:1788201063.251925:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715138688 00000100:00100000:0.0:1788201063.251933:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715137920 00000100:00100000:0.0:1788201063.251936:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715137920 00000100:00100000:0.0:1788201063.251957:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715138176 00000100:00100000:0.0:1788201063.251960:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715138176 00000100:00100000:0.0:1788201063.251974:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1301 00000100:00100000:0.0:1788201063.251980:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715137920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201063.252040:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715137920:12345-0@lo:400:kworker.0 Request processed in 36us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201063.252047:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1301 00000100:00100000:0.0:1788201063.252059:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1302 00000100:00100000:0.0:1788201063.252066:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715138176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201063.252095:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715138176:12345-0@lo:400:kworker.0 Request processed in 30us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201063.252101:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1302 00000100:00100000:0.0:1788201063.252113:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:0.0:1788201063.252117:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715137792:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201063.252135:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201063.252167:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715137792:12345-0@lo:38:kworker.0 Request processed in 47us (556us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201063.252172:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:0.0:1788201063.252184:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:0.0:1788201063.252187:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715138048:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201063.252195:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201063.252216:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715138048:12345-0@lo:38:kworker.0 Request processed in 28us (558us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201063.252227:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00000100:00100000:0.0:1788201063.252238:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:0.0:1788201063.252242:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715138688:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201063.252251:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201063.252273:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715138688:12345-0@lo:38:kworker.0 Request processed in 29us (537us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201063.252277:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:0.0:1788201063.252310:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715138304 00000100:00100000:0.0:1788201063.252314:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715138304 00000100:00100000:0.0:1788201063.252335:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3930 00000100:00100000:0.0:1788201063.252339:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715138304:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201063.252348:0:8458:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201063.252373:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715138304:12345-0@lo:38:kworker.0 Request processed in 32us (673us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201063.252379:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3930 00000100:00080000:0.0:1788201063.252402:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201063.252432:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715138176:0@lo:400:kworker.0 00000100:00100000:0.0:1788201063.252443:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715137920:0@lo:400:kworker.0 00000100:00080000:0.0:1788201063.252474:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201063.252480:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201063.252483:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715137792:0@lo:38:kworker.0 00000100:00080000:0.0:1788201063.252491:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201063.252494:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201063.252497:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715138048:0@lo:38:kworker.0 00000100:00080000:0.0:1788201063.252514:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201063.252517:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201063.252520:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715138304:0@lo:38:kworker.0 00000100:00080000:0.0:1788201063.252527:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201063.252530:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201063.252533:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715138688:0@lo:38:kworker.0 00000100:00100000:1.0:1788201063.258155:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715138560:0@lo:400:kworker.0 00000100:00100000:1.0:1788201063.258178:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715138432:0@lo:400:kworker.0 00000400:00000100:1.0:1788201063.911103:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695377920 offset 0 length 224: 4 00000100:00100000:1.0:1788201063.911142:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201063.911254:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201063.911270:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201063.911338:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201063.911367:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695378304 00000100:00100000:1.0:1788201063.911375:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695378304 00000100:00100000:1.0:1788201063.911425:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695378432 00000100:00100000:1.0:1788201063.911428:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695378432 00000100:00100000:1.0:1788201063.911451:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2744 00000100:00100000:1.0:1788201063.911460:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695378304:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201063.911526:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695378304:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 67us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201063.911533:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2744 00000100:00100000:1.0:1788201063.911552:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2745 00000100:00100000:1.0:1788201063.911557:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4292087e-fa00-4621-b681-837afc99ae35+7:2403:x1875060695378432:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201063.911580:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4292087e-fa00-4621-b681-837afc99ae35+7:2403:x1875060695378432:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 22us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201063.911595:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2745 00000100:00100000:1.0:1788201063.911614:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695378176 00000100:00100000:1.0:1788201063.911617:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695378176 00000100:00100000:1.0:1788201063.911642:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695378048 00000100:00100000:1.0:1788201063.911645:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695378048 00000100:00100000:1.0:1788201063.911657:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1303 00000100:00100000:1.0:1788201063.911663:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695378176:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201063.911691:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695378176:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 28us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201063.911696:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1303 00000100:00100000:1.0:1788201063.911709:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1269 00000100:00100000:1.0:1788201063.911713:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695378048:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:1.0:1788201063.911734:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201063.911755:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695378048:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 40us (418us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201063.911761:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1269 00000100:00080000:1.0:1788201063.911776:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201063.911779:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201063.911781:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788201064.217309:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201065.231319:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201065.809326:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788201065.809430:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715138816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201065.809525:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201065.810097:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715138816 00000100:00100000:2.0:1788201065.810108:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715138816 00000100:00100000:2.0:1788201065.810188:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2226 00000100:00100000:2.0:1788201065.810201:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715138816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201065.810240:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788201065.810302:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715138944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201065.810328:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715138816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201065.810338:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2226 00000100:00100000:1.0:1788201065.810345:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788201065.810567:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201065.810772:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715138816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201065.813885:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715138944 00000100:00100000:1.0:1788201065.813909:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715138944 00000100:00100000:1.0:1788201065.814145:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2227 00000100:00100000:1.0:1788201065.814162:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715138944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201065.814207:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201065.814322:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715138944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 165us (3976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201065.814329:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2227 00000100:00100000:0.0:1788201065.814531:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715138944:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788201065.814708:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788201066.261309:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201067.279588:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201068.303250:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201068.368113:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201068.368122:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201068.368126:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1788201068.368261:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201068.368278:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715139072:0@lo:400:kworker.0 00000400:00000100:3.0:1788201068.368336:0:3655:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715139072 offset 0 length 224: 4 00000100:00080000:1.0:1788201068.368421:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3914 00000100:00080000:1.0:1788201068.368426:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788201068.368433:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201068.368466:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005254e00 x1875060715139200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201068.368509:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201068.368512:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201068.368514:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201068.368518:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3914 00000100:00080000:1.0:1788201068.368521:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788201068.368525:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201068.368531:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201068.368540:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715139328:0@lo:400:kworker.0 00000100:00100000:3.0:1788201068.368677:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715139200:0@lo:38:kworker.0 00000100:00100000:1.0:1788201068.368725:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201068.368771:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201068.368853:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715139328 00000100:00100000:1.0:1788201068.368861:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715139328 00000100:00100000:1.0:1788201068.368914:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715139200 00000100:00100000:1.0:1788201068.368917:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715139200 00000100:00100000:1.0:1788201068.368937:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:1.0:1788201068.368947:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715139328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201068.368996:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715139328:12345-0@lo:400:kworker.0 Request processed in 51us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201068.369003:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00100000:1.0:1788201068.369050:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:1.0:1788201068.369055:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715139200:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201068.369076:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201068.369108:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715139200:12345-0@lo:38:kworker.0 Request processed in 52us (337us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201068.369114:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00080000:2.0:1788201068.369257:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201068.374300:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201068.374316:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201068.374322:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715139200:0@lo:38:kworker.0 00000100:00100000:1.0:1788201068.374379:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715139328:0@lo:400:kworker.0 00000100:00100000:1.0:1788201068.374432:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005255880 x1875060715139456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201068.374473:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715139456:0@lo:38:kworker.0 00000100:00100000:1.0:1788201068.374535:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201068.374596:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715139456 00000100:00100000:1.0:1788201068.374603:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715139456 00000100:00100000:1.0:1788201068.374637:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:1.0:1788201068.374644:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715139456:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201068.374665:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201068.374702:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715139456:12345-0@lo:38:kworker.0 Request processed in 57us (166us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201068.374709:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00080000:1.0:1788201068.374735:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201068.374738:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201068.374742:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715139456:0@lo:38:kworker.0 00000100:00080000:1.0:1788201068.374783:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201068.374787:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201068.374789:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201068.374793:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3914 00000100:00080000:1.0:1788201068.374798:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788201068.374803:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201068.374812:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715139584:0@lo:400:kworker.0 00000100:00100000:1.0:1788201068.374853:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201068.374880:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715139584 00000100:00100000:1.0:1788201068.374884:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715139584 00000100:00100000:1.0:1788201068.374923:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1305 00000100:00100000:1.0:1788201068.374929:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715139584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201068.374968:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715139584:12345-0@lo:400:kworker.0 Request processed in 39us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201068.374975:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1305 00000100:00080000:1.0:1788201068.375001:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201068.375044:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715139584:0@lo:400:kworker.0 00000100:00100000:1.0:1788201068.375070:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005255880 x1875060715139712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201068.375089:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715139712:0@lo:38:kworker.0 00000100:00100000:1.0:1788201068.375117:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201068.377146:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715139840:0@lo:400:kworker.0 00000100:00100000:1.0:1788201068.377204:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201068.377241:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715139840 00000100:00100000:1.0:1788201068.377248:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715139840 00000100:00100000:1.0:1788201068.377299:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2746 00000100:00100000:1.0:1788201068.377309:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715139840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201068.377354:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715139840:12345-0@lo:400:kworker.0 Request processed in 47us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201068.377362:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2746 00000100:00080000:1.0:1788201068.377389:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201068.377425:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715139840:0@lo:400:kworker.0 00000100:00080000:1.0:1788201068.377455:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201068.377459:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201068.377462:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201068.377467:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3914 00000100:00080000:1.0:1788201068.377471:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788201068.377476:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201068.377485:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715139968:0@lo:400:kworker.0 00000100:00100000:1.0:1788201068.377514:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201068.377557:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715139968 00000100:00100000:1.0:1788201068.377561:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715139968 00000100:00100000:1.0:1788201068.377606:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2747 00000100:00100000:1.0:1788201068.377614:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140e9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715139968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201068.377649:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140e9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715139968:12345-0@lo:400:kworker.0 Request processed in 37us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201068.377655:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2747 00000100:00100000:0.0:1788201068.378088:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715139712 00000100:00100000:0.0:1788201068.378094:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715139712 00000100:00100000:0.0:1788201068.378119:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3931 00000100:00100000:0.0:1788201068.378124:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715139712:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201068.378156:0:83817:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201068.378198:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715139712:12345-0@lo:38:kworker.0 Request processed in 73us (3080us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201068.378205:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3931 00000100:00080000:0.0:1788201068.378252:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201068.378257:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201068.378260:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715139712:0@lo:38:kworker.0 00000100:00080000:0.0:1788201068.378442:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201068.378481:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12f6b1880 x1875060715140096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201068.378508:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715140096:0@lo:38:kworker.0 00000100:00100000:0.0:1788201068.378543:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201068.378575:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715140096 00000100:00100000:0.0:1788201068.378655:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715140096 00000100:00100000:0.0:1788201068.378681:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:0.0:1788201068.378686:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715140096:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201068.378697:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201068.378730:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715140096:12345-0@lo:38:kworker.0 Request processed in 43us (186us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201068.378736:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00080000:0.0:1788201068.378763:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201068.378767:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201068.378770:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715140096:0@lo:38:kworker.0 00000100:00100000:1.0:1788201068.379280:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715139968:0@lo:400:kworker.0 00000100:00100000:0.0:1788201069.014752:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000400:00000100:0.0:1788201069.014780:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695378560 offset 0 length 224: 4 00000100:00100000:0.0:1788201069.014802:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201069.014837:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201069.014859:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201069.014890:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695378688 00000100:00100000:0.0:1788201069.014899:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695378688 00000100:00100000:0.0:1788201069.014932:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695378816 00000100:00100000:0.0:1788201069.014935:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695378816 00000100:00100000:0.0:1788201069.014973:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1306 00000100:00100000:0.0:1788201069.014983:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695378816:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201069.015078:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695378816:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 96us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201069.015086:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1306 00000100:00100000:0.0:1788201069.015106:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1273 00000100:00100000:0.0:1788201069.015111:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695378688:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:0.0:1788201069.020932:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201069.021004:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695378688:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 5890us (6261us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201069.021031:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1273 00000100:00100000:0.0:1788201069.021074:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695378944 00000100:00100000:0.0:1788201069.021085:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695378944 00000100:00100000:0.0:1788201069.021138:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695379072 00000100:00100000:0.0:1788201069.021142:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695379072 00000100:00100000:0.0:1788201069.021166:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2748 00000100:00100000:0.0:1788201069.021176:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695378944:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201069.021212:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695378944:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 39us (6409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201069.021218:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2748 00000100:00100000:0.0:1788201069.021231:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2749 00000100:00100000:0.0:1788201069.021237:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4292087e-fa00-4621-b681-837afc99ae35+7:2402:x1875060695379072:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201069.021259:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4292087e-fa00-4621-b681-837afc99ae35+7:2402:x1875060695379072:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (6400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201069.021264:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2749 00000100:00080000:0.0:1788201069.021293:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201069.021298:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201069.021300:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000400:00000100:1.0:1788201069.047602:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695379200 offset 0 length 520: 4 00010000:00010000:3.0:1788201069.332108:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1788201069.402685:0:3655:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201053/real 1788201053] req@ffff8dc00515f800 x1875060715134336/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788201069 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201069.402731:0:3655:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8dc00515f800 x1875060715134336/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788201069 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201069.402740:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788201069.402744:0:3655:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788201069.402748:0:3655:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.120@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788201069.402750:0:3655:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788201069.402754:0:3655:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc00515f800 x1875060715134336/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788201069 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201069.402763:0:3655:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc14014df80 x1875060715136256/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201074 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201069.402787:0:3655:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc12b637100 x1875060715137664/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201079 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201069.402826:0:3655:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc005257100 x1875060715139072/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201084 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788201069.402836:0:3655:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788201069.402847:0:3655:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788201069.402849:0:3655:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788201069.402851:0:3655:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:1.0:1788201069.402888:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715139072:0@lo:400:kworker.0 00000100:00100000:1.0:1788201069.402894:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00515f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715134336:0@lo:400:kworker.0 00000100:00080000:1.0:1788201069.402927:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201069.402932:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788201069.402934:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201069.402939:0:57134:0:(import.c:510:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 3857 00000100:00080000:1.0:1788201069.402946:0:57134:0:(import.c:624:import_select_connection()) MGC192.168.201.120@tcp: import ffff8dc104280800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201069.402990:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005257100 x1875060715140224/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201069.403007:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201069.403009:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201069.403011:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201069.403036:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3919 00000100:00080000:1.0:1788201069.403039:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788201069.403043:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201069.403061:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005254700 x1875060715140352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201069.403083:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201069.403086:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201069.403088:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201069.403091:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3919 00000100:00080000:1.0:1788201069.403093:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788201069.403104:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201069.403118:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005256680 x1875060715140608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201069.403133:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201069.403150:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201069.403151:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201069.403154:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3919 00000100:00080000:1.0:1788201069.403157:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788201069.403160:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201069.403172:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005255f80 x1875060715140864/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201069.403198:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201069.403201:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201069.403202:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201069.403206:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3919 00000100:00080000:1.0:1788201069.403208:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788201069.403211:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201069.403221:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005255880 x1875060715141248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201069.403247:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715140736:0@lo:400:kworker.0 00000100:00100000:1.0:1788201069.403314:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201069.403349:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201069.403355:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715140480:0@lo:400:kworker.0 00000100:00100000:1.0:1788201069.403379:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201069.403456:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715140992:0@lo:400:kworker.0 00000100:00100000:1.0:1788201069.403485:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201069.403515:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715140992 00000100:00100000:1.0:1788201069.403523:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715140992 00000100:00100000:1.0:1788201069.403588:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2750 00000100:00100000:1.0:1788201069.403599:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715140992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201069.403645:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715140992:12345-0@lo:400:kworker.0 Request processed in 48us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201069.403653:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2750 00000100:00100000:1.0:1788201069.403697:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715140992:0@lo:400:kworker.0 00000100:00100000:1.0:1788201069.403710:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201069.403716:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715141120:0@lo:400:kworker.0 00000100:00100000:1.0:1788201069.403754:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201069.403875:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715137664:0@lo:400:kworker.0 00000100:00100000:0.0:1788201069.403898:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715140224:0@lo:250:kworker.0 00000400:00000100:0.0:1788201069.403921:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715140224 offset 0 length 520: 4 00000100:00100000:0.0:1788201069.403954:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715140352:0@lo:38:kworker.0 00000100:00100000:0.0:1788201069.403980:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201069.404007:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715140608:0@lo:38:kworker.0 00000100:00100000:0.0:1788201069.404045:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201069.404059:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715140864:0@lo:38:kworker.0 00000100:00100000:0.0:1788201069.404092:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201069.404110:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715141248:0@lo:38:kworker.0 00000100:00100000:0.0:1788201069.404129:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201069.404159:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715140736 00000100:00100000:0.0:1788201069.404163:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715140736 00000100:00100000:0.0:1788201069.404188:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715140480 00000100:00100000:0.0:1788201069.404190:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715140480 00000100:00100000:0.0:1788201069.404200:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715140352 00000100:00100000:0.0:1788201069.404203:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715140352 00000100:00100000:0.0:1788201069.404210:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715140608 00000100:00100000:0.0:1788201069.404212:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715140608 00000100:00100000:0.0:1788201069.404218:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715141248 00000100:00100000:0.0:1788201069.404220:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715141248 00000100:00100000:0.0:1788201069.404228:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1307 00000100:00100000:0.0:1788201069.404234:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715140736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201069.404274:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715140736:12345-0@lo:400:kworker.0 Request processed in 39us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201069.404280:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1307 00000100:00100000:0.0:1788201069.404293:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1308 00000100:00100000:0.0:1788201069.404299:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715140480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201069.404328:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715140480:12345-0@lo:400:kworker.0 Request processed in 30us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201069.404343:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1308 00000100:00100000:0.0:1788201069.404355:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:0.0:1788201069.404359:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715140352:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201069.404376:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201069.404406:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715140352:12345-0@lo:38:kworker.0 Request processed in 46us (426us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201069.404413:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00100000:0.0:1788201069.404423:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:0.0:1788201069.404427:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715140608:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201069.404435:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201069.404457:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715140608:12345-0@lo:38:kworker.0 Request processed in 29us (412us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201069.404463:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00100000:0.0:1788201069.404473:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:0.0:1788201069.404477:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715141248:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201069.404485:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201069.404510:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715141248:12345-0@lo:38:kworker.0 Request processed in 31us (380us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201069.404515:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00100000:0.0:1788201069.404534:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715141120 00000100:00100000:0.0:1788201069.404537:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715141120 00000100:00100000:0.0:1788201069.404560:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2751 00000100:00100000:0.0:1788201069.404566:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715141120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201069.404601:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715141120:12345-0@lo:400:kworker.0 Request processed in 34us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201069.404614:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2751 00000100:00100000:0.0:1788201069.404654:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715140864 00000100:00100000:0.0:1788201069.404658:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715140864 00000100:00100000:0.0:1788201069.404680:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3932 00000100:00100000:0.0:1788201069.404685:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715140864:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201069.404696:0:8458:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201069.404726:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715140864:12345-0@lo:38:kworker.0 Request processed in 39us (633us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201069.404731:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3932 00000100:00080000:0.0:1788201069.404763:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201069.404769:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201069.404772:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715140352:0@lo:38:kworker.0 00000100:00080000:0.0:1788201069.404780:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201069.404783:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201069.404786:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715140608:0@lo:38:kworker.0 00000100:00080000:0.0:1788201069.404793:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201069.404797:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201069.404800:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715140864:0@lo:38:kworker.0 00000100:00080000:0.0:1788201069.404819:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201069.404822:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201069.404824:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715141248:0@lo:38:kworker.0 00000100:00100000:0.0:1788201069.404859:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715140480:0@lo:400:kworker.0 00000100:00100000:0.0:1788201069.404867:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715140736:0@lo:400:kworker.0 00000100:00100000:2.0:1788201069.404973:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715136256:0@lo:400:kworker.0 00000100:00100000:1.0:1788201069.405107:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715141120:0@lo:400:kworker.0 00010000:00010000:3.0:1788201070.352264:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201070.927858:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201070.927882:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715141376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201070.927969:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201070.928647:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715141376 00000100:00100000:1.0:1788201070.928657:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715141376 00000100:00100000:1.0:1788201070.928720:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2228 00000100:00100000:1.0:1788201070.928729:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715141376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201070.928760:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788201070.928822:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715141376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201070.928829:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2228 00000100:00080000:0.0:1788201070.928897:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201070.932792:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715141504:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201070.932864:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201070.932937:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715141376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201070.933060:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715141504 00000100:00100000:0.0:1788201070.933067:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715141504 00000100:00100000:0.0:1788201070.933125:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2229 00000100:00100000:0.0:1788201070.933136:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715141504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201070.933166:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201070.933215:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715141504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201070.933222:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2229 00000100:00080000:3.0:1788201070.933646:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201070.933676:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715141504:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788201071.376250:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201072.400253:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201073.424876:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201074.134269:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201074.134374:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201074.142633:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201074.142665:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201074.142698:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695379712 00000100:00100000:0.0:1788201074.142707:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695379712 00000100:00100000:0.0:1788201074.142788:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695379584 00000100:00100000:0.0:1788201074.142791:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695379584 00000100:00100000:0.0:1788201074.142816:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2752 00000100:00100000:0.0:1788201074.142826:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:4292087e-fa00-4621-b681-837afc99ae35+7:2401:x1875060695379712:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201074.142898:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:4292087e-fa00-4621-b681-837afc99ae35+7:2401:x1875060695379712:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 73us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201074.142906:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2752 00000100:00100000:0.0:1788201074.142922:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2753 00000100:00100000:0.0:1788201074.142929:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695379584:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201074.142955:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695379584:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201074.142979:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2753 00000100:00080000:0.0:1788201074.142999:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201074.143004:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201074.149589:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695379328 00000100:00100000:1.0:1788201074.149605:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695379328 00000100:00100000:1.0:1788201074.149661:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695379456 00000100:00100000:1.0:1788201074.149665:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695379456 00000100:00100000:1.0:1788201074.149716:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1309 00000100:00100000:1.0:1788201074.150601:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695379456:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201074.150684:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695379456:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 92us (16310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201074.152359:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1277 00000100:00100000:3.0:1788201074.152371:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695379328:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:3.0:1788201074.152395:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201074.152444:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695379328:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 74us (18186us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201074.152452:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1277 00000100:00080000:0.0:1788201074.153271:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201074.157875:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1309 00010000:00010000:1.0:1788201074.456869:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201074.516566:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201074.516577:0:86307:0:(pinger.c:247:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201074.516581:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201074.516585:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201074.516589:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201074.516598:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3920 00000100:00080000:2.0:1788201074.516603:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201074.516611:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201074.516651:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12014ea00 x1875060715141632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201074.516695:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201074.516699:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201074.516701:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201074.516704:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3920 00000100:00080000:2.0:1788201074.516707:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201074.516710:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201074.516734:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12014c000 x1875060715141888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201074.516766:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201074.516770:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201074.516771:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201074.516775:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3920 00000100:00080000:2.0:1788201074.516778:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201074.516781:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201074.516797:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11cb52680 x1875060715142144/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201074.516834:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201074.516837:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201074.516838:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201074.516842:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3920 00000100:00080000:2.0:1788201074.516845:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201074.516848:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201074.516860:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc137cef480 x1875060715142528/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201074.516886:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715141632:0@lo:38:kworker.0 00000100:00100000:2.0:1788201074.516956:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201074.516988:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715141888:0@lo:38:kworker.0 00000100:00100000:2.0:1788201074.517010:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201074.517122:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cb52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715142144:0@lo:38:kworker.0 00000100:00100000:2.0:1788201074.517178:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201074.517198:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715142528:0@lo:38:kworker.0 00000100:00100000:2.0:1788201074.517295:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201074.517325:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715141760:0@lo:400:kworker.0 00000100:00100000:2.0:1788201074.517346:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201074.517365:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201074.517370:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715142016:0@lo:400:kworker.0 00000100:00100000:2.0:1788201074.517389:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201074.517415:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715142272:0@lo:400:kworker.0 00000100:00100000:2.0:1788201074.517436:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201074.517453:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201074.517458:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715142400:0@lo:400:kworker.0 00000100:00100000:2.0:1788201074.517476:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201074.518189:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715141632 00000100:00100000:1.0:1788201074.518201:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715141632 00000100:00100000:1.0:1788201074.518243:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715141888 00000100:00100000:1.0:1788201074.518247:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715141888 00000100:00100000:1.0:1788201074.518257:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715142528 00000100:00100000:1.0:1788201074.518260:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715142528 00000100:00100000:1.0:1788201074.518267:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715141760 00000100:00100000:1.0:1788201074.518269:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715141760 00000100:00100000:1.0:1788201074.518311:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715142016 00000100:00100000:1.0:1788201074.518314:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715142016 00000100:00100000:1.0:1788201074.518334:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1310 00000100:00100000:1.0:1788201074.518344:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715141760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201074.518423:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715141760:12345-0@lo:400:kworker.0 Request processed in 82us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201074.518430:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1310 00000100:00100000:1.0:1788201074.518448:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1311 00000100:00100000:1.0:1788201074.518454:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715142016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201074.518864:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:2.0:1788201074.518870:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715141632:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788201074.518890:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201074.518919:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715141632:12345-0@lo:38:kworker.0 Request processed in 49us (1964us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201074.518925:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:2.0:1788201074.518939:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:2.0:1788201074.518943:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715141888:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788201074.518951:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201074.518970:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715141888:12345-0@lo:38:kworker.0 Request processed in 26us (1960us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201074.518976:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00100000:2.0:1788201074.518984:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:2.0:1788201074.518988:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715142528:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788201074.519005:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201074.519154:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715142016:12345-0@lo:400:kworker.0 Request processed in 25us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201074.519162:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1311 00000100:00100000:1.0:1788201074.519183:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715142144 00000100:00100000:1.0:1788201074.519187:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715142144 00000100:00100000:2.0:1788201074.519569:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715142528:12345-0@lo:38:kworker.0 Request processed in 578us (2272us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201074.519575:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00100000:2.0:1788201074.519597:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715142272 00000100:00100000:2.0:1788201074.519601:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715142272 00000100:00100000:2.0:1788201074.519629:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715142400 00000100:00100000:2.0:1788201074.519632:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715142400 00000100:00100000:2.0:1788201074.519650:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2754 00000100:00100000:2.0:1788201074.519655:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715142272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201074.519689:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715142272:12345-0@lo:400:kworker.0 Request processed in 34us (2252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201074.519694:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2754 00000100:00100000:2.0:1788201074.519705:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2755 00000100:00100000:2.0:1788201074.519710:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715142400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201074.519744:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715142400:12345-0@lo:400:kworker.0 Request processed in 34us (2267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201074.519750:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2755 00000100:00100000:2.0:1788201074.519793:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715142016:0@lo:400:kworker.0 00000100:00100000:2.0:1788201074.519803:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715141760:0@lo:400:kworker.0 00000100:00080000:2.0:1788201074.519832:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201074.519836:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201074.519840:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715141632:0@lo:38:kworker.0 00000100:00080000:2.0:1788201074.519847:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201074.519850:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201074.519860:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715141888:0@lo:38:kworker.0 00000100:00080000:2.0:1788201074.519870:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201074.519872:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201074.519875:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715142528:0@lo:38:kworker.0 00000100:00100000:2.0:1788201074.519905:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715142400:0@lo:400:kworker.0 00000100:00100000:2.0:1788201074.519915:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715142272:0@lo:400:kworker.0 00000100:00100000:1.0:1788201074.520414:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3933 00000100:00100000:1.0:1788201074.520426:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715142144:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201074.520442:0:83817:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201074.521560:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715142144:12345-0@lo:38:kworker.0 Request processed in 52us (3299us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201074.521576:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3933 00000100:00080000:1.0:1788201074.521622:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201074.521626:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201074.521628:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201074.521868:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201074.521874:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201074.521877:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cb52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715142144:0@lo:38:kworker.0 00000020:01000004:1.0:1788201075.304685:0:91096:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788201075.304692:0:91096:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788201075.304694:0:91096:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788201075.304824:0:91096:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dc0084be800 00000020:01000004:1.0:1788201075.304839:0:91096:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788201075.304852:0:91096:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788201075.304865:0:91096:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8dc139bb99b8) 00000020:00000080:1.0:1788201075.304883:0:91096:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1788201075.472725:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788201075.515289:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788201075.531639:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788201075.532804:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788201075.533575:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1788201075.533864:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788201075.534273:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788201075.534515:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1788201075.534774:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788201075.542644:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788201075.545592:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1788201075.548425:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788201075.548987:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1788201075.549738:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788201075.550575:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1788201075.561316:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1788201075.564641:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1788201075.576730:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788201075.580360:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788201075.581449:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788201075.583341:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788201075.583970:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1788201075.584953:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788201075.585958:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1788201075.590173:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1788201075.590595:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1788201075.590943:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788201075.591603:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788201075.591923:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788201075.592361:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788201075.592611:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788201075.592932:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788201075.593628:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788201075.595367:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788201075.597396:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788201075.598317:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788201075.599351:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788201075.600369:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788201075.601408:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788201075.606047:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788201075.606621:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788201075.606835:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788201075.607313:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788201075.608449:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788201075.609296:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788201075.613150:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788201075.614757:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788201075.615544:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788201075.617740:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788201075.618942:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788201075.619727:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788201075.620931:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788201075.621981:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788201075.622832:0:91096:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1788201075.625373:0:91096:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788201075.625621:0:91096:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788201075.625630:0:91096:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788201075.625644:0:91096:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1b5d0 00000020:01000004:3.0:1788201075.625652:0:91096:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788201075.625663:0:91096:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788201075.625668:0:91096:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dc0084be800 from MGS 00000020:01000004:3.0:1788201075.625671:0:91096:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788201075.625681:0:91096:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8dc12f0c0000) 00000020:00000080:3.0:1788201075.625693:0:91096:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:3.0:1788201075.625772:0:91096:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc0084be800 from MGS, refs=2 00080000:01000000:3.0:1788201075.625778:0:91096:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788201075.625784:0:91096:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1b5de 00010000:00010000:3.0:1788201075.625915:0:91096:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1788201075.640682:0:91096:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788201075.651164:0:91100:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788201075.656706:0:91096:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788201075.656779:0:91096:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788201075.658684:0:91096:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788201075.659760:0:91096:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201075.659941:0:91096:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788201075.659947:0:91096:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788201075.663810:0:91096:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788201075.663824:0:91096:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788201075.664637:0:91096:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788201075.664644:0:91096:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788201075.667350:0:91096:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788201075.667383:0:91096:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1788201075.667385:0:91096:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.120@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1788201075.667389:0:91096:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.120@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1788201075.667394:0:91096:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8dc104280800 already not connected (conn 72, was 0): CONNECTING 00000100:00100000:1.0:1788201075.667401:0:91096:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:2.0:1788201076.048840:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715142656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201076.048910:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201076.049044:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715142656 00000100:00100000:3.0:1788201076.049053:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715142656 00000100:00100000:3.0:1788201076.049106:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2230 00000100:00100000:3.0:1788201076.049115:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715142656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201076.049143:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201076.049208:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715142656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201076.049215:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2230 00000100:00080000:2.0:1788201076.049342:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201076.049377:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715142656:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201076.053243:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715142784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201076.053324:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201076.053495:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715142784 00000100:00100000:2.0:1788201076.053503:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715142784 00000100:00100000:2.0:1788201076.053569:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2231 00000100:00100000:2.0:1788201076.053579:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125641c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715142784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201076.053607:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00080000:3.0:1788201076.053756:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201076.063898:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125641c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715142784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10249us (10503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201076.063918:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2231 00000100:00100000:0.0:1788201076.064995:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715142784:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788201076.495320:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201077.519941:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201078.543362:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201079.254137:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201079.254186:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201079.254222:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201079.254294:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201079.254324:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201079.254455:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695379968 00000100:00100000:1.0:1788201079.254465:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695379968 00000100:00100000:1.0:1788201079.254527:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695379840 00000100:00100000:1.0:1788201079.254542:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695379840 00000100:00100000:1.0:1788201079.254563:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1312 00000100:00100000:1.0:1788201079.254573:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695379968:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201079.254652:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695379968:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 80us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201079.254660:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1312 00000100:00100000:1.0:1788201079.254679:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1281 00000100:00100000:1.0:1788201079.254684:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2399:x1875060695379840:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:1.0:1788201079.254704:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201079.254728:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2399:x1875060695379840:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 41us (433us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201079.254734:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1281 00000100:00100000:1.0:1788201079.254778:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695380352 00000100:00100000:1.0:1788201079.254782:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695380352 00000100:00100000:1.0:1788201079.254800:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:1.0:1788201079.254805:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2399:x1875060695380352:12345-192.168.201.20@tcp:250:kworker.0 00010000:00080000:1.0:1788201079.254818:0:91102:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 0fa559bc-2180-4019-80c4-11831fedf9a9@192.168.201.20@tcp t0 exp 0000000000000000 cur 3930 last 0 00000020:00000080:1.0:1788201079.254844:0:91102:0:(genops.c:1385:class_connect()) connect: client 0fa559bc-2180-4019-80c4-11831fedf9a9, cookie 0x96d0c9b8c9a1b5e5 00000100:00080000:1.0:1788201079.254993:0:91102:0:(import.c:65:import_set_state_nolock()) ffff8dc005d70800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201079.255053:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+5:2399:x1875060695380352:12345-192.168.201.20@tcp:250:kworker.0 Request processed in 245us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201079.255060:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00080000:0.0:1788201079.256375:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201079.259767:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695380224 00000100:00100000:3.0:1788201079.259782:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695380224 00000100:00100000:3.0:1788201079.259910:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695380096 00000100:00100000:3.0:1788201079.259915:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695380096 00000100:00100000:1.0:1788201079.259978:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2756 00000100:00100000:1.0:1788201079.259991:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4292087e-fa00-4621-b681-837afc99ae35+7:2400:x1875060695380224:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201079.260090:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4292087e-fa00-4621-b681-837afc99ae35+7:2400:x1875060695380224:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 103us (5903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201079.260098:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2756 00000100:00080000:0.0:1788201079.272219:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201079.272230:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201079.273261:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2757 00000100:00100000:3.0:1788201079.273276:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695380096:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201079.273351:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695380096:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 79us (19128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201079.273359:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2757 00010000:00010000:3.0:1788201079.574549:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201079.631199:0:3654:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201069/real 1788201069] req@ffff8dc005257100 x1875060715140224/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788201079 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201079.631233:0:3654:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dc005257100 x1875060715140224/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788201079 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201079.631252:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201079.631276:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788201079.631286:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715140224:0@lo:250:kworker.0 10000000:01000000:1.0:1788201079.631513:0:91096:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1788201079.631532:0:91096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c000/0x96d0c9b8c9a1b1a8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1b1af expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201079.631544:0:91096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c000/0x96d0c9b8c9a1b1a8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1b1af expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201079.631551:0:91096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788201079.631574:0:91096:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201079.631584:0:91096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc006c6c000/0x96d0c9b8c9a1b1a8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1b1af expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.631602:0:91096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0079ada00/0x96d0c9b8c9a1b10e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1b115 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201079.631610:0:91096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0079ada00/0x96d0c9b8c9a1b10e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1b115 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201079.631616:0:91096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201079.631619:0:91096:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201079.631651:0:91096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0079ada00/0x96d0c9b8c9a1b10e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1b115 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.631661:0:91096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0079ac000/0x96d0c9b8c9a1b12a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1b131 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201079.631668:0:91096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0079ac000/0x96d0c9b8c9a1b12a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1b131 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201079.631673:0:91096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201079.631677:0:91096:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201079.631680:0:91096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0079ac000/0x96d0c9b8c9a1b12a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1b131 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.631688:0:91096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc006c6de00/0x96d0c9b8c9a1b154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1b15b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201079.631694:0:91096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc006c6de00/0x96d0c9b8c9a1b154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1b15b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201079.631700:0:91096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201079.631703:0:91096:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201079.631706:0:91096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc006c6de00/0x96d0c9b8c9a1b154 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1b15b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.631714:0:91096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad600/0x96d0c9b8c9a1b162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1b169 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201079.631721:0:91096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad600/0x96d0c9b8c9a1b162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1b169 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201079.631736:0:91096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201079.631740:0:91096:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201079.631743:0:91096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0079ad600/0x96d0c9b8c9a1b162 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1b169 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.631751:0:91096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1b17e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1b185 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201079.631757:0:91096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1b17e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1b185 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201079.631762:0:91096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201079.631765:0:91096:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201079.631768:0:91096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1b17e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1b185 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.631777:0:91096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0079ac800/0x96d0c9b8c9a1b18c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1b193 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201079.631783:0:91096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0079ac800/0x96d0c9b8c9a1b18c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1b193 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201079.631788:0:91096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201079.631791:0:91096:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201079.631794:0:91096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0079ac800/0x96d0c9b8c9a1b18c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1b193 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.631802:0:91096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064eda00/0x96d0c9b8c9a1b1b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1b1bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201079.631818:0:91096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064eda00/0x96d0c9b8c9a1b1b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1b1bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201079.631823:0:91096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201079.631827:0:91096:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201079.631830:0:91096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064eda00/0x96d0c9b8c9a1b1b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1b1bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.631843:0:91096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed200/0x96d0c9b8c9a1b11c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1b123 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201079.631850:0:91096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed200/0x96d0c9b8c9a1b11c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1b123 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201079.631855:0:91096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201079.631859:0:91096:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201079.631862:0:91096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed200/0x96d0c9b8c9a1b11c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1b123 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.631873:0:91096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc006c6d000/0x96d0c9b8c9a1b138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1b13f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201079.631880:0:91096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc006c6d000/0x96d0c9b8c9a1b138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1b13f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201079.631885:0:91096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201079.631888:0:91096:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201079.631891:0:91096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc006c6d000/0x96d0c9b8c9a1b138 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1b13f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.631911:0:91096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc006c6d400/0x96d0c9b8c9a1b146 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1b14d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201079.631918:0:91096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc006c6d400/0x96d0c9b8c9a1b146 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1b14d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201079.631924:0:91096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788201079.631927:0:91096:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201079.631931:0:91096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc006c6d400/0x96d0c9b8c9a1b146 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1b14d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.631950:0:91096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0079acc00/0x96d0c9b8c9a1b170 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1b177 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201079.631957:0:91096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0079acc00/0x96d0c9b8c9a1b170 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1b177 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201079.631962:0:91096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788201079.631965:0:91096:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201079.631969:0:91096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0079acc00/0x96d0c9b8c9a1b170 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1b177 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.631977:0:91096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1b19a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1b1a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201079.631983:0:91096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1b19a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1b1a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201079.631990:0:91096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788201079.632001:0:91096:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201079.632005:0:91096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1b19a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1b1a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788201079.632052:0:91096:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8dc104280800 already not connected (conn 72, was 0): DISCONN 00000100:00080000:1.0:1788201079.632058:0:91096:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201079.632063:0:91096:0:(import.c:510:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 3920 00000100:00080000:1.0:1788201079.632069:0:91096:0:(import.c:589:import_select_connection()) MGC192.168.201.120@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788201079.632074:0:91096:0:(import.c:624:import_select_connection()) MGC192.168.201.120@tcp: import ffff8dc104280800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201079.632104:0:91096:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005257b80 x1875060715142912/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201079.632132:0:91096:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:2.0:1788201079.632512:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201079.632518:0:57134:0:(pinger.c:247:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201079.632521:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201079.632525:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201079.632527:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201079.632532:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3925 00000100:00080000:2.0:1788201079.632534:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201079.632539:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201079.632560:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11cb52680 x1875060715143040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201079.632601:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201079.632605:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201079.632607:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201079.632610:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3925 00000100:00080000:2.0:1788201079.632612:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201079.632616:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201079.632640:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc137cec380 x1875060715143296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201079.632655:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201079.632658:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201079.632659:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201079.632662:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3925 00000100:00080000:2.0:1788201079.632664:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201079.632668:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201079.632678:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12014c000 x1875060715143552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201079.632703:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201079.632706:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201079.632707:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201079.632711:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3925 00000100:00080000:2.0:1788201079.632713:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201079.632716:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201079.632725:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc1060cca80 x1875060715143936/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201079.632808:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715143168:0@lo:400:kworker.0 00000100:00100000:0.0:1788201079.632876:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201079.632924:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201079.632931:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715143424:0@lo:400:kworker.0 00000100:00100000:0.0:1788201079.632965:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201079.632992:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715143808:0@lo:400:kworker.0 00000100:00100000:0.0:1788201079.633039:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201079.633059:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201079.633064:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715143680:0@lo:400:kworker.0 00000100:00100000:0.0:1788201079.633086:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201079.633125:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715143168 00000100:00100000:0.0:1788201079.633133:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715143168 00000100:00100000:0.0:1788201079.633185:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715143424 00000100:00100000:0.0:1788201079.633188:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715143424 00000100:00100000:0.0:1788201079.633213:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:0.0:1788201079.633221:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715143168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201079.633269:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715143168:12345-0@lo:400:kworker.0 Request processed in 49us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201079.633276:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000100:00100000:0.0:1788201079.633299:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1314 00000100:00100000:0.0:1788201079.633305:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715143424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201079.633331:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715143424:12345-0@lo:400:kworker.0 Request processed in 27us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201079.633337:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1314 00000100:00100000:0.0:1788201079.633356:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715143808 00000100:00100000:0.0:1788201079.633359:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715143808 00000100:00100000:0.0:1788201079.633381:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715143680 00000100:00100000:0.0:1788201079.633384:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715143680 00000100:00100000:0.0:1788201079.633417:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2758 00000100:00100000:0.0:1788201079.633423:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715143808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201079.633456:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715143808:12345-0@lo:400:kworker.0 Request processed in 32us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201079.633461:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2758 00000100:00100000:0.0:1788201079.633471:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2759 00000100:00100000:0.0:1788201079.633477:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715143680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201079.633500:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715143680:12345-0@lo:400:kworker.0 Request processed in 24us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201079.633505:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2759 00000100:00100000:0.0:1788201079.633554:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715143680:0@lo:400:kworker.0 00000100:00100000:0.0:1788201079.633565:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715143808:0@lo:400:kworker.0 00000100:00100000:0.0:1788201079.633590:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715143424:0@lo:400:kworker.0 00000100:00100000:0.0:1788201079.633599:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715143168:0@lo:400:kworker.0 00000100:00080000:0.0:1788201079.633612:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201079.633616:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201079.633623:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201079.634487:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715142912:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788201079.634533:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201079.634573:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cb52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715143040:0@lo:38:kworker.0 00000100:00100000:3.0:1788201079.634597:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201079.634642:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715143296:0@lo:38:kworker.0 00000100:00100000:3.0:1788201079.634664:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201079.634682:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715143552:0@lo:38:kworker.0 00000100:00100000:3.0:1788201079.634704:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201079.634720:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715143936:0@lo:38:kworker.0 00000100:00100000:3.0:1788201079.634738:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201079.634769:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715143552 00000100:00100000:3.0:1788201079.634774:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715143552 00000100:00100000:3.0:1788201079.634797:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3934 00000100:00100000:3.0:1788201079.634803:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715143552:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788201079.634823:0:8458:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201079.634857:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715143552:12345-0@lo:38:kworker.0 Request processed in 52us (151us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201079.634864:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3934 00000100:00100000:3.0:1788201079.634886:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715143040 00000100:00100000:3.0:1788201079.634890:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715143040 00000100:00100000:3.0:1788201079.634905:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715143296 00000100:00100000:3.0:1788201079.634908:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715143296 00000100:00100000:3.0:1788201079.634917:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715143936 00000100:00100000:3.0:1788201079.634920:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715143936 00000100:00100000:3.0:1788201079.634930:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:3.0:1788201079.635006:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715143040:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788201079.635044:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201079.635075:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715143040:12345-0@lo:38:kworker.0 Request processed in 139us (477us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201079.635081:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:3.0:1788201079.635093:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:3.0:1788201079.635105:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715143296:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788201079.635186:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201079.635212:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715143296:12345-0@lo:38:kworker.0 Request processed in 106us (546us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201079.635217:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00100000:3.0:1788201079.635230:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:3.0:1788201079.635234:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715143936:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788201079.635243:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201079.635266:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715143936:12345-0@lo:38:kworker.0 Request processed in 30us (527us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201079.635270:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00080000:3.0:1788201079.635307:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201079.635312:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201079.635315:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cb52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715143040:0@lo:38:kworker.0 00000100:00080000:3.0:1788201079.635323:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201079.635326:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201079.635329:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715143296:0@lo:38:kworker.0 00000100:00080000:3.0:1788201079.635336:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201079.635339:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201079.635342:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715143552:0@lo:38:kworker.0 00000100:00080000:3.0:1788201079.635349:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201079.635352:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201079.635354:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715143936:0@lo:38:kworker.0 00000100:00100000:2.0:1788201079.635641:0:91104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715142912 00000100:00100000:2.0:1788201079.635646:0:91104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715142912 00000100:00100000:2.0:1788201079.635675:0:91104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201079.635681:0:91104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3654:x1875060715142912:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788201079.635696:0:91104:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c9b18af6-fecc-4172-82c2-66531890fe11@0@lo t0 exp 0000000000000000 cur 3931 last 0 00000020:00000080:2.0:1788201079.635721:0:91104:0:(genops.c:1385:class_connect()) connect: client c9b18af6-fecc-4172-82c2-66531890fe11, cookie 0x96d0c9b8c9a1b5ec 00000100:00080000:2.0:1788201079.635842:0:91104:0:(import.c:65:import_set_state_nolock()) ffff8dc0038aa800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201079.635891:0:91104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+5:3654:x1875060715142912:12345-0@lo:250:mount.lustre.0 Request processed in 210us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201079.635898:0:91104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201079.635952:0:3654:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.120@tcp: committing for last_committed 0 gen 27 00000100:00080000:2.0:1788201079.635959:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.120@tcp: connect to target with instance 0 00000100:00080000:2.0:1788201079.635966:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788201079.635970:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788201079.635973:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788201079.635976:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788201079.635992:0:3654:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788201079.635999:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715142912:0@lo:250:mount.lustre.0 00000020:01000000:2.0:1788201079.636057:0:57134:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.201.120@tcp 10000000:01000000:2.0:1788201079.636073:0:57134:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1788201079.636076:0:57134:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788201079.636077:0:57134:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201079.636079:0:57134:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201079.636080:0:57134:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201079.636081:0:57134:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201079.636083:0:57134:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201079.636084:0:57134:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201079.636086:0:57134:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201079.636087:0:57134:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1788201079.636132:0:57134:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1788201079.636139:0:57134:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1788201079.636141:0:57134:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788201079.636142:0:57134:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788201079.636143:0:57134:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201079.636144:0:57134:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201079.636145:0:57134:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201079.636146:0:57134:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201079.636148:0:57134:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201079.636149:0:57134:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201079.636150:0:57134:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1788201079.636163:0:57134:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1788201079.636167:0:57134:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1788201079.636169:0:57134:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788201079.636170:0:57134:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788201079.636171:0:57134:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201079.636173:0:57134:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201079.636174:0:57134:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201079.636175:0:57134:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201079.636176:0:57134:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201079.636177:0:57134:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201079.636178:0:57134:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1788201079.636196:0:57134:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1788201079.636221:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715144192:0@lo:253:kworker.0 00000100:00100000:2.0:1788201079.636254:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201079.636280:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201079.636286:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715144064:0@lo:253:kworker.0 00000100:00100000:2.0:1788201079.636312:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201079.636331:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715144320:0@lo:253:kworker.0 00000100:00100000:2.0:1788201079.636355:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201079.636374:0:91103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715144192 00000100:00100000:2.0:1788201079.636378:0:91103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715144192 00000100:00080000:1.0:1788201079.636594:0:91096:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1788201079.636604:0:91096:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788201079.636647:0:91096:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788201079.636651:0:91096:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788201079.636759:0:91096:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788201079.636781:0:91096:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.120@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788201079.636784:0:91096:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788201079.636786:0:91096:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788201079.636787:0:91096:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201079.636788:0:91096:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201079.636789:0:91096:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201079.636790:0:91096:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201079.636791:0:91096:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201079.636793:0:91096:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788201079.636794:0:91096:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201079.636795:0:91096:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788201079.636797:0:91096:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788201079.636799:0:91096:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788201079.636801:0:91096:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788201079.636802:0:91096:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201079.636808:0:91096:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201079.636809:0:91096:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201079.636810:0:91096:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201079.636811:0:91096:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201079.636812:0:91096:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788201079.636813:0:91096:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201079.636814:0:91096:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788201079.636826:0:91096:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788201079.636835:0:91096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715144448:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788201079.636869:0:91096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201079.639334:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715144064 00000100:00100000:0.0:1788201079.639348:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715144064 00000100:00100000:0.0:1788201079.639402:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715144320 00000100:00100000:0.0:1788201079.639406:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715144320 00000100:00100000:0.0:1788201079.639417:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715144448 00000100:00100000:0.0:1788201079.639419:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715144448 00000100:00100000:0.0:1788201079.639433:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788201079.639442:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+8:3658:x1875060715144192:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788201079.639472:0:91102:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:0.0:1788201079.639684:0:91105:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788201079.639775:0:91102:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 115 20000000:01000000:0.0:1788201079.643996:0:91106:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788201079.644005:0:91106:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788201079.644008:0:91106:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788201079.644011:0:91106:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788201079.645763:0:91106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788201079.645894:0:91102:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788201079.645907:0:91102:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788201079.646124:0:91096:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140ffbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201079.649237:0:91103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201079.649257:0:91103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+8:3658:x1875060715144064:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788201079.649309:0:91103:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788201079.651092:0:91102:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788201079.651107:0:91102:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788201079.651158:0:91103:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788201079.651419:0:91105:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788201079.651424:0:91105:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788201079.651449:0:91105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc007a2c600/0x96d0c9b8c9a1b5f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.651466:0:91105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007a2c600/0x96d0c9b8c9a1b5f3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788201079.651475:0:91105:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000051918s 00010000:00010000:1.0:1788201079.651480:0:91105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc007a2c600/0x96d0c9b8c9a1b5f3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.651486:0:91105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc007a2c600/0x96d0c9b8c9a1b5f3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.651492:0:91105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc007a2c600/0x96d0c9b8c9a1b5f3 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.651500:0:91105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc007a2c600/0x96d0c9b8c9a1b5f3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.651505:0:91105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2c600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201079.651509:0:91105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc007a2c600/0x96d0c9b8c9a1b5f3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.651542:0:91105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc007a2c600/0x96d0c9b8c9a1b5f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.651556:0:91105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc007a2c600/0x96d0c9b8c9a1b5f3 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.651564:0:91105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc007a2c600/0x96d0c9b8c9a1b5f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.651570:0:91105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007a2c600/0x96d0c9b8c9a1b5f3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201079.652273:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+8:3658:x1875060715144192:12345-0@lo:253:kworker.0 Request processed in 12826us (16013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201079.652285:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788201079.652331:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788201079.652342:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+7:3655:x1875060715144320:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788201079.652367:0:91102:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000020:01000004:2.0:1788201079.652583:0:3658:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788201079.652586:0:3658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788201079.652587:0:3658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201079.652589:0:3658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201079.652590:0:3658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201079.652591:0:3658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201079.652593:0:3658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201079.652595:0:3658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201079.652596:0:3658:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788201079.652599:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715144192:0@lo:253:kworker.0 00000100:00100000:3.0:1788201079.652863:0:91104:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:3.0:1788201079.652881:0:91104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:2.0:1788201079.661324:0:91107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201079.661343:0:91107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+7:91096:x1875060715144448:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788201079.661388:0:91107:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788201079.661403:0:91107:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788201079.661405:0:91107:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1788201079.661411:0:91107:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788201079.663525:0:91103:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788201079.663541:0:91103:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788201079.663740:0:91102:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788201079.663992:0:91107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+7:91096:x1875060715144448:12345-0@lo:253:mount.lustre.0 Request processed in 2651us (27117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201079.664004:0:91107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788201079.664318:0:91096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715144448:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788201079.664333:0:91096:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788201079.664337:0:91096:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788201079.664339:0:91096:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201079.664340:0:91096:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201079.664341:0:91096:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201079.664342:0:91096:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201079.664344:0:91096:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201079.664345:0:91096:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201079.664346:0:91096:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201079.664348:0:91096:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201079.664349:0:91096:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788201079.664370:0:91096:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dc0084be800 from lustre-MDT0000 10000000:01000000:3.0:1788201079.664410:0:91096:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788201079.664414:0:91096:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788201079.664423:0:91096:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dc0084be800 10000000:01000000:3.0:1788201079.664427:0:91096:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788201079.664432:0:91096:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8dc0084be800 10000000:01000000:3.0:1788201079.664434:0:91096:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788201079.664438:0:91096:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dc0084be800 from 1 10000000:01000000:3.0:1788201079.664441:0:91096:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788201079.664481:0:91096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1b5fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201079.664493:0:91096:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1b5fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201079.664502:0:91096:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1b5fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201079.664522:0:91096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715144576:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201079.664573:0:91096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201079.664605:0:91096:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc003a3a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201079.664624:0:91104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715144576 00000100:00100000:3.0:1788201079.664641:0:91104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715144576 00000100:00100000:3.0:1788201079.664675:0:91104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201079.664684:0:91104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+7:91096:x1875060715144576:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201079.664696:0:91104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201079.664711:0:91104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782d200/0x96d0c9b8c9a1b601 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b5fa expref: -99 pid: 91104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201079.664732:0:91104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782d200/0x96d0c9b8c9a1b601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b5fa expref: 8 pid: 91104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201079.664743:0:91104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782d200/0x96d0c9b8c9a1b601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b5fa expref: 8 pid: 91104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201079.664752:0:91104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782d200, rc 0) 00000100:00100000:3.0:1788201079.664782:0:91104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:91096:x1875060715144576:12345-0@lo:101:mount.lustre.0 Request processed in 99us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201079.664788:0:91104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788201079.664815:0:91096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715144576:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201079.664826:0:91096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1b5fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b601 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201079.664834:0:91096:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1b5fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b601 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201079.664847:0:91096:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788201079.664864:0:91096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1b5fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b601 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201079.664872:0:91096:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1b5fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b601 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201079.664879:0:91096:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788201079.664893:0:91096:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201079.664898:0:91096:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8dc0084be800 10000000:01000000:3.0:1788201079.664901:0:91096:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788201079.664904:0:91096:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788201079.664906:0:91096:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 20000000:01000000:1.0:1788201079.665047:0:91105:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788201079.665051:0:91105:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788201079.665065:0:91105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc007a2d400/0x96d0c9b8c9a1b608 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.665075:0:91105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007a2d400/0x96d0c9b8c9a1b608 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788201079.665085:0:91105:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000051918s 00010000:00010000:1.0:1788201079.665089:0:91105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc007a2d400/0x96d0c9b8c9a1b608 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.665096:0:91105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc007a2d400/0x96d0c9b8c9a1b608 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.665103:0:91105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc007a2d400/0x96d0c9b8c9a1b608 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.665110:0:91105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc007a2d400/0x96d0c9b8c9a1b608 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.665123:0:91105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2d400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201079.665136:0:91105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc007a2d400/0x96d0c9b8c9a1b608 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.665144:0:91105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc007a2d400/0x96d0c9b8c9a1b608 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.665155:0:91105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc007a2d400/0x96d0c9b8c9a1b608 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.665163:0:91105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc007a2d400/0x96d0c9b8c9a1b608 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.665169:0:91105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007a2d400/0x96d0c9b8c9a1b608 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201079.665618:0:91103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+7:3658:x1875060715144064:12345-0@lo:253:kworker.0 Request processed in 16367us (29303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201079.665635:0:91103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:2.0:1788201079.665745:0:3658:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788201079.665748:0:3658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201079.665750:0:3658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201079.665751:0:3658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201079.665752:0:3658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201079.665754:0:3658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201079.665755:0:3658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201079.665757:0:3658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201079.665758:0:3658:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788201079.665761:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715144064:0@lo:253:kworker.0 20000000:01000000:0.0:1788201079.679766:0:91102:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788201079.679789:0:91102:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788201079.680181:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+6:3655:x1875060715144320:12345-0@lo:253:kworker.0 Request processed in 27837us (43819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201079.680193:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:3.0:1788201079.680372:0:3655:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788201079.680375:0:3655:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788201079.680377:0:3655:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201079.680379:0:3655:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201079.680380:0:3655:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201079.680382:0:3655:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201079.680383:0:3655:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201079.680386:0:3655:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201079.680397:0:3655:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788201079.680401:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715144320:0@lo:253:kworker.0 20000000:01000000:1.0:1788201079.680488:0:91105:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788201079.680494:0:91105:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788201079.680516:0:91105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc007a2c000/0x96d0c9b8c9a1b60f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.680531:0:91105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007a2c000/0x96d0c9b8c9a1b60f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788201079.680540:0:91105:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000051918s 00010000:00010000:1.0:1788201079.680546:0:91105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc007a2c000/0x96d0c9b8c9a1b60f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.680553:0:91105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc007a2c000/0x96d0c9b8c9a1b60f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.680579:0:91105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc007a2c000/0x96d0c9b8c9a1b60f lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.680586:0:91105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc007a2c000/0x96d0c9b8c9a1b60f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.680593:0:91105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2c000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201079.680598:0:91105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc007a2c000/0x96d0c9b8c9a1b60f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.680606:0:91105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc007a2c000/0x96d0c9b8c9a1b60f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.680618:0:91105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc007a2c000/0x96d0c9b8c9a1b60f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.680658:0:91105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc007a2c000/0x96d0c9b8c9a1b60f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201079.680665:0:91105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007a2c000/0x96d0c9b8c9a1b60f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201079.683292:0:91096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd200/0x96d0c9b8c9a1b616 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201079.683321:0:91096:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd200/0x96d0c9b8c9a1b616 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201079.683335:0:91096:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd200/0x96d0c9b8c9a1b616 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201079.683360:0:91096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715144704:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201079.683439:0:91096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201079.683477:0:91096:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0050409c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201079.683668:0:91107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715144704 00000100:00100000:3.0:1788201079.683676:0:91107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715144704 00000100:00100000:3.0:1788201079.683729:0:91107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788201079.683738:0:91107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+6:91096:x1875060715144704:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201079.683752:0:91107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201079.683765:0:91107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782d800/0x96d0c9b8c9a1b61d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b616 expref: -99 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201079.683786:0:91107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782d800/0x96d0c9b8c9a1b61d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b616 expref: 7 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201079.683807:0:91107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782d800/0x96d0c9b8c9a1b61d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b616 expref: 7 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201079.683815:0:91107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782d800, rc 0) 00000100:00100000:3.0:1788201079.683863:0:91107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+7:91096:x1875060715144704:12345-0@lo:101:mount.lustre.0 Request processed in 125us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201079.683870:0:91107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201079.684012:0:91096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715144704:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201079.684062:0:91096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd200/0x96d0c9b8c9a1b616 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b61d expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201079.684072:0:91096:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd200/0x96d0c9b8c9a1b616 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b61d expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201079.684148:0:91096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715144832:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201079.684175:0:91096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201079.684195:0:91096:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc109832e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201079.685277:0:91103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715144832 00000100:00100000:3.0:1788201079.685285:0:91103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715144832 00000100:00100000:3.0:1788201079.685328:0:91103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201079.685336:0:91103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+7:91096:x1875060715144832:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201079.685498:0:91103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+8:91096:x1875060715144832:12345-0@lo:501:mount.lustre.0 Request processed in 162us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201079.685505:0:91103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788201079.685588:0:91096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715144832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201079.685635:0:91096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715144960:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201079.685683:0:91096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201079.685711:0:91096:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125a96540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201079.685804:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715144960 00000100:00100000:0.0:1788201079.685808:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715144960 00000100:00100000:0.0:1788201079.685844:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788201079.685851:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+8:91096:x1875060715144960:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201079.688293:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+8:91096:x1875060715144960:12345-0@lo:503:mount.lustre.0 Request processed in 2434us (2601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201079.688307:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788201079.688510:0:91096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715144960:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201079.691224:0:91108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:91108:1875060715145088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201079.691298:0:91108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201079.691344:0:91108:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140ffbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201079.691403:0:91103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715145088 00000100:00100000:1.0:1788201079.691416:0:91103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715145088 00000100:00100000:1.0:1788201079.691462:0:91103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788201079.691471:0:91103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+8:91108:x1875060715145088:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201079.692360:0:91103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+8:91108:x1875060715145088:12345-0@lo:502:llog_process_th.0 Request processed in 887us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201079.692369:0:91103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788201079.692523:0:91108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:91108:1875060715145088:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201079.692554:0:91108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201079.692565:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201079.692568:0:91108:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788201079.692573:0:91108:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788201079.692581:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201079.692596:0:91108:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8dc004fd4d28) 00000020:00000080:0.0:1788201079.692618:0:91108:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:0.0:1788201079.692633:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788201079.692711:0:91108:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788201079.692717:0:91108:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1b62b 00000020:00000080:0.0:1788201079.694281:0:91108:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788201079.694292:0:91108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201079.694301:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201079.694303:0:91108:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788201079.694307:0:91108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201079.694311:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201079.694312:0:91108:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788201079.694316:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201079.694329:0:91108:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8dc004fd19b8) 00000020:00000080:0.0:1788201079.694350:0:91108:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:0.0:1788201079.694355:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788201079.694357:0:91108:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788201079.694359:0:91108:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788201079.694365:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788201079.694428:0:91108:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc0084be800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788201079.694440:0:91108:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8dc004fd3370) 00000020:00000080:0.0:1788201079.694449:0:91108:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:0.0:1788201079.694504:0:91108:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788201079.694530:0:91108:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1b640 00000020:00000080:0.0:1788201079.694654:0:91108:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788201079.694661:0:91108:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788201079.694666:0:91108:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x96d0c9b8c9a1b647 00080000:01000000:0.0:1788201079.694671:0:91108:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788201079.694674:0:91108:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1b64e 00010000:00010000:2.0:1788201079.912155:0:91108:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1788201079.915055:0:91108:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 4292087e-fa00-4621-b681-837afc99ae35 idx: 0 lr: 107374182411 srv lr: 111669149696 lx: 0 gen 23 00000001:00080000:2.0:1788201079.915102:0:91108:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 111669149696 lx: 0 gen 22 00000001:00000004:2.0:1788201079.915234:0:91108:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 111669149696 00000001:00080000:2.0:1788201079.915412:0:91108:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1788201079.915472:0:91108:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc005040480: xid 1875060695369984, transno 111669149703, client gen 23, slot idx 0 00000001:00080000:2.0:1788201079.915483:0:91108:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc005040a80: xid 1875060695369728, transno 111669149702, client gen 23, slot idx 1 00000020:00000080:2.0:1788201079.916825:0:91108:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8dc13f874d28) 00000020:00000080:2.0:1788201079.916851:0:91108:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1788201079.916928:0:91108:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788201079.916947:0:91108:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1b66a 00000020:00000080:1.0:1788201079.923137:0:91108:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788201079.942438:0:91108:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x96d0c9b8c9a1b671 00000020:00000080:1.0:1788201079.943788:0:91108:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788201079.943802:0:91108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201079.943809:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201079.943812:0:91108:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788201079.943815:0:91108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788201079.943818:0:91108:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1788201079.943819:0:91108:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201079.943821:0:91108:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201079.943823:0:91108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788201079.943825:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201079.943827:0:91108:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788201079.943829:0:91108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201079.943836:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201079.943837:0:91108:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788201079.943842:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788201079.943890:0:91108:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788201079.943906:0:91108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201079.943909:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201079.943910:0:91108:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788201079.943913:0:91108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201079.943916:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201079.943917:0:91108:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788201079.943920:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788201079.943925:0:91108:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:00000080:1.0:1788201079.943958:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201079.943973:0:91108:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8dc139bbb370) 00000020:00000080:1.0:1788201079.943992:0:91108:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1788201079.943998:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788201079.944092:0:91108:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788201079.944098:0:91108:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788201079.944114:0:91108:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1b67f 00010000:00080000:1.0:1788201079.944154:0:91108:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc110734800@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:1.0:1788201079.950099:0:91108:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1788201079.953433:0:91108:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201079.953450:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788201079.953493:0:91108:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788201079.953521:0:91108:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1b686 00000100:00080000:2.0:1788201079.953533:0:91108:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201079.953539:0:91108:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8dc110734800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201079.953586:0:91108:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005abf800 x1875060715145216/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201079.953617:0:91108:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788201079.953691:0:91108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201079.953695:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201079.953697:0:91108:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788201079.953700:0:91108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788201079.953703:0:91108:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1788201079.953705:0:91108:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201079.953707:0:91108:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201079.953708:0:91108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788201079.953711:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201079.953712:0:91108:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788201079.953715:0:91108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788201079.953719:0:91108:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788201079.953723:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201079.953724:0:91108:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788201079.953727:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788201079.953731:0:91108:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:2.0:1788201079.953753:0:91108:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788201079.953756:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201079.953768:0:91108:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8dc13f870000) 00000020:00000080:2.0:1788201079.953783:0:91108:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1788201079.953788:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788201079.953848:0:91108:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788201079.953854:0:91108:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788201079.953859:0:91108:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1b694 00010000:00080000:2.0:1788201079.953890:0:91108:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc13339f800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:2.0:1788201079.954135:0:91108:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:3.0:1788201079.954860:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715145216:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201079.954941:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201079.955256:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715145216 00000100:00100000:2.0:1788201079.955264:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715145216 00000100:00100000:2.0:1788201079.955337:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3935 00000100:00100000:2.0:1788201079.955344:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715145216:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788201079.955371:0:83817:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3931 last 0 00000020:00000080:2.0:1788201079.955402:0:83817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1b69b 00000004:00100000:2.0:1788201079.955417:0:83817:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201079.955497:0:83817:0:(import.c:65:import_set_state_nolock()) ffff8dc13aa9c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201079.955552:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715145216:12345-0@lo:38:llog_process_th.0 Request processed in 207us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201079.955559:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3935 00000100:00100000:3.0:1788201079.959993:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201079.960010:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:3.0:1788201079.960041:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788201079.960049:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788201079.960052:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc110734800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788201079.960074:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715145216:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788201079.960401:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715145344:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201079.960470:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201079.960577:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715145344 00000100:00100000:1.0:1788201079.960584:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715145344 00000100:00100000:1.0:1788201079.960640:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3936 00000100:00100000:1.0:1788201079.960651:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715145344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201079.960682:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:1.0:1788201079.960727:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715145344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201079.960734:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3936 00000100:00100000:0.0:1788201079.960814:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715145344:0@lo:41:osp-pre-1-0.0 00000040:01000000:1.0:1788201079.968370:0:91108:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788201079.968409:0:91108:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788201079.969376:0:91108:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 25, last_idx 26 00000040:00080000:1.0:1788201079.971208:0:91108:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201079.971239:0:91108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].27, 64 off9920 00000040:00080000:0.0:1788201079.982352:0:91108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6c:0x0].1, 64 off8256 00000040:00080000:2.0:1788201079.984892:0:91114:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 27 synced_idx: 0 lgh_last_idx: 27 00000040:00080000:2.0:1788201079.984899:0:91114:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1788201079.985410:0:91114:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 26, last_idx 27 00000040:00080000:3.0:1788201079.985434:0:91114:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1788201079.985587:0:91114:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:3.0:1788201079.985591:0:91114:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788201079.987168:0:91108:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201079.987185:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788201079.987230:0:91108:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788201079.987255:0:91108:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1b6a2 00000100:00080000:2.0:1788201079.987266:0:91108:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201079.987272:0:91108:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dc13339f800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201079.987305:0:91108:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005abf800 x1875060715145472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201079.987332:0:91108:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1788201079.987460:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715145472:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788201079.987548:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201079.987616:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715145472 00000100:00100000:3.0:1788201079.987641:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715145472 00000100:00100000:3.0:1788201079.987670:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5890 00000100:00100000:3.0:1788201079.987677:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3654:x1875060715145472:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1788201079.987701:0:26211:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3931 last 0 00000020:00000080:3.0:1788201079.987732:0:26211:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1b6a9 00002000:00100000:3.0:1788201079.987747:0:26211:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8dc119913800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788201079.987751:0:26211:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788201079.987754:0:26211:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788201079.987825:0:26211:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788201079.987847:0:26211:0:(import.c:65:import_set_state_nolock()) ffff8dc119917000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201079.987896:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715145472:12345-0@lo:8:llog_process_th.0 Request processed in 218us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201079.987904:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5890 00000020:01000000:2.0:1788201079.988691:0:91108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201079.988698:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201079.988701:0:91108:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788201079.988704:0:91108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788201079.988706:0:91108:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788201079.988708:0:91108:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201079.988710:0:91108:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201079.988711:0:91108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788201079.988715:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201079.988728:0:91108:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788201079.988732:0:91108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788201079.988737:0:91108:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788201079.988741:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201079.988742:0:91108:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788201079.988745:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788201079.988749:0:91108:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:2.0:1788201079.988770:0:91108:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788201079.988773:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201079.988788:0:91108:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8dc13f8719b8) 00000020:00000080:2.0:1788201079.988807:0:91108:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1788201079.988812:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788201079.988888:0:91108:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788201079.988894:0:91108:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788201079.988900:0:91108:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1b6b7 00010000:00080000:2.0:1788201079.989006:0:91108:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc103486000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:2.0:1788201079.989306:0:91108:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1788201079.989370:0:91108:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788201079.989386:0:91108:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1788201079.989650:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201079.989662:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788201079.989670:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788201079.989674:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788201079.989677:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13339f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000040:00080000:2.0:1788201079.990288:0:91108:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 25, last_idx 26 00000040:00080000:2.0:1788201079.993302:0:91108:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201079.993331:0:91108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].27, 64 off9920 00000040:00080000:2.0:1788201079.993459:0:91108:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6e:0x0].1, 64 off8256 00000100:00100000:1.0:1788201079.995726:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201079.995746:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715145600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201079.995820:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788201079.996212:0:3654:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788201079.996242:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715145472:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1788201079.996274:0:91114:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788201079.996339:0:91114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3931468321965ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788201079.996345:0:91114:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788201080.003456:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715145600 00000100:00100000:3.0:1788201080.003471:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715145600 00000100:00100000:3.0:1788201080.003543:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2232 00000100:00100000:3.0:1788201080.003554:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715145600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201080.003586:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788201080.003683:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715145600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (7862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201080.003690:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2232 00000100:00080000:1.0:1788201080.003934:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201080.004916:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715145600:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788201080.005707:0:91116:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 27 synced_idx: 0 lgh_last_idx: 27 00000040:00080000:0.0:1788201080.005725:0:91116:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1788201080.005947:0:91116:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 26, last_idx 27 00000040:00080000:0.0:1788201080.005972:0:91116:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1788201080.006505:0:91116:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:0.0:1788201080.006510:0:91116:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788201080.011247:0:91108:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201080.011261:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788201080.011305:0:91108:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788201080.011331:0:91108:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1b6be 00000100:00080000:2.0:1788201080.011342:0:91108:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201080.011349:0:91108:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dc103486000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201080.011402:0:91108:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005abd880 x1875060715145728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201080.011437:0:91108:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788201080.011488:0:91108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201080.011493:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201080.011495:0:91108:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788201080.011498:0:91108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201080.011502:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201080.011504:0:91108:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788201080.011507:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788201080.011509:0:91108:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788201080.011512:0:91108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201080.011514:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201080.011515:0:91108:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788201080.011518:0:91108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201080.011520:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201080.011522:0:91108:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788201080.011525:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788201080.011558:0:91108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:91108:1875060715145856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201080.011649:0:91108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201080.011692:0:91104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715145856 00000100:00100000:2.0:1788201080.011698:0:91104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715145856 00000100:00100000:2.0:1788201080.011748:0:91104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201080.011758:0:91104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:91108:x1875060715145856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201080.011874:0:91104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:91108:x1875060715145856:12345-0@lo:502:llog_process_th.0 Request processed in 116us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201080.011882:0:91104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201080.011930:0:91108:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1257063c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201080.011951:0:91108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:91108:1875060715145856:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201080.011977:0:91108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201080.011986:0:91108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201080.011988:0:91108:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788201080.011992:0:91108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:3.0:1788201080.012418:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715145728:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788201080.012459:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788201080.012526:0:91096:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788201080.012554:0:91096:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788201080.012569:0:91096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd200/0x96d0c9b8c9a1b616 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b61d expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201080.012580:0:91096:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd200/0x96d0c9b8c9a1b616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b61d expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201080.012588:0:91096:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc0084be800 from 1 10000000:01000000:3.0:1788201080.012592:0:91096:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788201080.012618:0:91096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782c400/0x96d0c9b8c9a1b6c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201080.012651:0:91096:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc00782c400/0x96d0c9b8c9a1b6c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201080.012660:0:91096:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc00782c400/0x96d0c9b8c9a1b6c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201080.012674:0:91096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715145984:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201080.012705:0:91096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201080.012720:0:91096:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140ffb840 going to sleep for 11 seconds 00000100:00100000:3.0:1788201080.012754:0:91103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715145984 00000100:00100000:3.0:1788201080.012759:0:91103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715145984 00000100:00100000:3.0:1788201080.012788:0:91103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788201080.012796:0:91103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+8:91096:x1875060715145984:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201080.012805:0:91103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201080.012817:0:91103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782de00/0x96d0c9b8c9a1b6cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b6c5 expref: -99 pid: 91103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201080.012840:0:91103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782de00/0x96d0c9b8c9a1b6cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b6c5 expref: 9 pid: 91103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201080.012850:0:91103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782de00/0x96d0c9b8c9a1b6cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b6c5 expref: 9 pid: 91103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201080.012859:0:91103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782de00, rc 0) 00000100:00100000:3.0:1788201080.012890:0:91103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+9:91096:x1875060715145984:12345-0@lo:101:mount.lustre.0 Request processed in 95us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201080.012896:0:91103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788201080.012941:0:91096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715145984:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201080.012953:0:91096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc00782c400/0x96d0c9b8c9a1b6c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b6cc expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201080.012962:0:91096:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc00782c400/0x96d0c9b8c9a1b6c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b6cc expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201080.013507:0:91096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715146112:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788201080.013545:0:91096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201080.013568:0:91096:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005fd3900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201080.013802:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715145728 00000100:00100000:2.0:1788201080.013807:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715145728 00000100:00100000:2.0:1788201080.013833:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5891 00000100:00100000:2.0:1788201080.013839:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3654:x1875060715145728:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1788201080.013867:0:26210:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3931 last 0 00000020:00000080:2.0:1788201080.013893:0:26210:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1b6d3 00002000:00100000:2.0:1788201080.013906:0:26210:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8dc10630b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788201080.013911:0:26210:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788201080.013914:0:26210:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788201080.013996:0:26210:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788201080.014041:0:26210:0:(import.c:65:import_set_state_nolock()) ffff8dc106308000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201080.014089:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715145728:12345-0@lo:8:llog_process_th.0 Request processed in 249us (1629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201080.014097:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5891 00000100:00100000:2.0:1788201080.014119:0:91104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715146112 00000100:00100000:2.0:1788201080.014123:0:91104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715146112 00000100:00100000:2.0:1788201080.014146:0:91104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788201080.014152:0:91104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+9:91096:x1875060715146112:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788201080.014166:0:91104:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788201080.014182:0:91104:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788201080.014187:0:91104:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788201080.014190:0:91104:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788201080.014192:0:91104:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 118 00000100:00100000:2.0:1788201080.014260:0:91104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+9:91096:x1875060715146112:12345-0@lo:256:mount.lustre.0 Request processed in 108us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201080.014275:0:91104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:1.0:1788201080.015009:0:91097:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788201080.015297:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201080.015307:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788201080.015315:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788201080.015320:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788201080.015323:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc103486000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788201080.015343:0:3654:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788201080.015350:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715145728:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788201080.015400:0:91096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715146112:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788201080.015985:0:91096:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788201080.016006:0:91096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782c400/0x96d0c9b8c9a1b6c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b6cc expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201080.016046:0:91096:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc00782c400/0x96d0c9b8c9a1b6c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b6cc expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201080.016055:0:91096:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc0084be800 from 1 10000000:01000000:3.0:1788201080.016058:0:91096:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201080.016097:0:91096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782c600/0x96d0c9b8c9a1b6da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201080.016105:0:91096:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc00782c600/0x96d0c9b8c9a1b6da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201080.016115:0:91096:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc00782c600/0x96d0c9b8c9a1b6da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201080.016135:0:91096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715146240:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201080.016182:0:91096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201080.016215:0:91096:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005fd3900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201080.016238:0:91107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715146240 00000100:00100000:3.0:1788201080.016244:0:91107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715146240 00000100:00100000:3.0:1788201080.016277:0:91107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788201080.016285:0:91107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+9:91096:x1875060715146240:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201080.016296:0:91107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201080.016308:0:91107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782dc00/0x96d0c9b8c9a1b6e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b6da expref: -99 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201080.016329:0:91107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782dc00/0x96d0c9b8c9a1b6e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b6da expref: 10 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201080.016339:0:91107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782dc00/0x96d0c9b8c9a1b6e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b6da expref: 10 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201080.016348:0:91107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782dc00, rc 0) 00000100:00100000:3.0:1788201080.016377:0:91107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+10:91096:x1875060715146240:12345-0@lo:101:mount.lustre.0 Request processed in 93us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201080.016384:0:91107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788201080.016428:0:91096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715146240:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201080.016440:0:91096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc00782c600/0x96d0c9b8c9a1b6da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b6e1 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201080.016449:0:91096:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc00782c600/0x96d0c9b8c9a1b6da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b6e1 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201080.016504:0:91096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715146368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201080.016530:0:91096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201080.016543:0:91096:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005fd3900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201080.016558:0:91103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715146368 00000100:00100000:3.0:1788201080.016562:0:91103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715146368 00000100:00100000:3.0:1788201080.016586:0:91103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788201080.016592:0:91103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:91096:x1875060715146368:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201080.016726:0:91103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:91096:x1875060715146368:12345-0@lo:501:mount.lustre.0 Request processed in 132us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201080.016733:0:91103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788201080.016766:0:91096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715146368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201080.016792:0:91096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715146496:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201080.016833:0:91096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201080.016846:0:91096:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005fd3900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201080.016858:0:91107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715146496 00000100:00100000:3.0:1788201080.016861:0:91107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715146496 00000100:00100000:3.0:1788201080.016881:0:91107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788201080.016887:0:91107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+10:91096:x1875060715146496:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201080.016951:0:91107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+10:91096:x1875060715146496:12345-0@lo:503:mount.lustre.0 Request processed in 63us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201080.016961:0:91107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788201080.016993:0:91096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715146496:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201080.017186:0:91118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:91118:1875060715146624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201080.017218:0:91118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201080.017236:0:91103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715146624 00000100:00100000:3.0:1788201080.017240:0:91103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715146624 00000100:00100000:3.0:1788201080.017262:0:91103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788201080.017269:0:91103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:91118:x1875060715146624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201080.017399:0:91118:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005fd3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201080.017784:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201080.017795:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715146752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201080.017832:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201080.017865:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715146752 00000100:00100000:0.0:1788201080.017869:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715146752 00000100:00100000:0.0:1788201080.017907:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2233 00000100:00100000:0.0:1788201080.017913:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715146752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201080.017945:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201080.017986:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715146752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201080.017992:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2233 00000100:00100000:0.0:1788201080.018047:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715146752:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788201080.018064:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788201080.018526:0:91116:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788201080.018608:0:91116:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3931490590906ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788201080.018615:0:91116:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788201080.022607:0:91103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:91118:x1875060715146624:12345-0@lo:502:llog_process_th.0 Request processed in 5329us (5379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201080.022632:0:91103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201080.022752:0:91118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:91118:1875060715146624:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201080.022789:0:91118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201080.022800:0:91118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201080.022802:0:91118:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788201080.022810:0:91118:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc0084be800 00000020:00000080:2.0:1788201080.022812:0:91118:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788201080.022819:0:91118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201080.022822:0:91118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201080.022823:0:91118:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788201080.022825:0:91118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201080.022828:0:91118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201080.022829:0:91118:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788201080.022833:0:91118:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc0084be800 00000020:00000080:2.0:1788201080.022835:0:91118:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788201080.022925:0:91118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:91118:1875060715146880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201080.022988:0:91118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201080.023042:0:91118:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105d39f00 going to sleep for 11 seconds 00000004:00080000:1.0:1788201080.023208:0:91097:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788201080.023372:0:91107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715146880 00000100:00100000:3.0:1788201080.023380:0:91107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715146880 00000100:00100000:3.0:1788201080.024718:0:91107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788201080.024732:0:91107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+10:91118:x1875060715146880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201080.024879:0:91107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+10:91118:x1875060715146880:12345-0@lo:502:llog_process_th.0 Request processed in 150us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201080.024887:0:91107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788201080.029797:0:91118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:91118:1875060715146880:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201080.029844:0:91118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201080.029854:0:91118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201080.029856:0:91118:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788201080.029861:0:91118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788201080.031274:0:91096:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1788201080.031309:0:91096:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201080.031327:0:91096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782c600/0x96d0c9b8c9a1b6da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b6e1 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201080.031340:0:91096:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc00782c600/0x96d0c9b8c9a1b6da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b6e1 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201080.031408:0:91096:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788201080.031411:0:91096:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dc0084be800 10000000:01000000:2.0:1788201080.031414:0:91096:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dc0084be800 10000000:01000000:2.0:1788201080.031424:0:91096:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788201080.031430:0:91096:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc0084be800 from 1 10000000:01000000:2.0:1788201080.031433:0:91096:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788201080.031466:0:91096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc400/0x96d0c9b8c9a1b6e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201080.031475:0:91096:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc400/0x96d0c9b8c9a1b6e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201080.031484:0:91096:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc400/0x96d0c9b8c9a1b6e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201080.031507:0:91096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715147008:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201080.031567:0:91096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201080.031605:0:91096:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105d39540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201080.034546:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715147008 00000100:00100000:1.0:1788201080.034561:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715147008 00000100:00100000:1.0:1788201080.034629:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788201080.034639:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+10:91096:x1875060715147008:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201080.034654:0:91102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201080.034671:0:91102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007a2d400/0x96d0c9b8c9a1b6ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b6e8 expref: -99 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201080.034697:0:91102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007a2d400/0x96d0c9b8c9a1b6ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b6e8 expref: 11 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201080.034708:0:91102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007a2d400/0x96d0c9b8c9a1b6ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b6e8 expref: 11 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201080.034717:0:91102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2d400, rc 0) 00000100:00100000:1.0:1788201080.034785:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:91096:x1875060715147008:12345-0@lo:101:mount.lustre.0 Request processed in 148us (3218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201080.034793:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788201080.034847:0:91096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715147008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201080.034863:0:91096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc400/0x96d0c9b8c9a1b6e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b6ef expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201080.034873:0:91096:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc400/0x96d0c9b8c9a1b6e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b6ef expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201080.034959:0:91096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715147136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201080.034988:0:91096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201080.035012:0:91096:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004f93d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201080.035175:0:91103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715147136 00000100:00100000:2.0:1788201080.035180:0:91103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715147136 00000100:00100000:2.0:1788201080.035202:0:91103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788201080.035208:0:91103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:91096:x1875060715147136:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201080.035326:0:91103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:91096:x1875060715147136:12345-0@lo:501:mount.lustre.0 Request processed in 117us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201080.035332:0:91103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788201080.035413:0:91096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715147136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201080.035439:0:91096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715147264:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201080.035478:0:91096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201080.035499:0:91096:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004f93d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201080.035590:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715147264 00000100:00100000:2.0:1788201080.035594:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715147264 00000100:00100000:2.0:1788201080.035616:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788201080.035631:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:91096:x1875060715147264:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201080.035713:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:91096:x1875060715147264:12345-0@lo:503:mount.lustre.0 Request processed in 90us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201080.035727:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788201080.035791:0:91096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715147264:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201080.036169:0:91120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:91120:1875060715147392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201080.036204:0:91120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201080.036227:0:91120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004f93840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201080.036265:0:91104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715147392 00000100:00100000:2.0:1788201080.036269:0:91104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715147392 00000100:00100000:2.0:1788201080.036298:0:91104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788201080.036306:0:91104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:91120:x1875060715147392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201080.036372:0:91104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:91120:x1875060715147392:12345-0@lo:502:llog_process_th.0 Request processed in 66us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201080.036379:0:91104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788201080.036500:0:91120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:91120:1875060715147392:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788201080.036550:0:91120:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788201080.036565:0:91120:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8dc139bb8000) 00000020:00000080:1.0:1788201080.036590:0:91120:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788201080.036676:0:91120:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc0084be800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788201080.036680:0:91120:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc0084be800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788201080.036683:0:91120:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc0084be800 4 00010000:00080000:1.0:1788201080.036709:0:91120:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc106074000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:2.0:1788201080.047925:0:91120:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1788201080.049353:0:91120:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788201080.051760:0:91120:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788201080.051783:0:91120:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x96d0c9b8c9a1b6fd 00000100:00080000:2.0:1788201080.051796:0:91120:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201080.051804:0:91120:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dc106074000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201080.051841:0:91120:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005abd880 x1875060715147520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201080.051902:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715147520:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201080.051984:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788201080.053749:0:91120:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788201080.054466:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715147520 00000100:00100000:2.0:1788201080.054477:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715147520 00000100:00100000:2.0:1788201080.054515:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:2.0:1788201080.054524:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715147520:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788201080.067077:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715147520:12345-0@lo:38:llog_process_th.0 Request processed in 12543us (15082us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788201080.067093:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000100:00100000:2.0:1788201080.067249:0:91120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:91120:1875060715147648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201080.067330:0:91120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201080.067370:0:91103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715147648 00000100:00100000:2.0:1788201080.067378:0:91103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715147648 00000100:00100000:2.0:1788201080.068065:0:91103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788201080.068075:0:91103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:91120:x1875060715147648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201080.068197:0:91103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:91120:x1875060715147648:12345-0@lo:502:llog_process_th.0 Request processed in 124us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201080.068205:0:91103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788201080.068251:0:91120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201080.068271:0:91120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:91120:1875060715147648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201080.068312:0:91120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:91120:1875060715147776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201080.068345:0:91120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201080.068362:0:91120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201080.068476:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715147776 00000100:00100000:0.0:1788201080.068481:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715147776 00000100:00100000:0.0:1788201080.068515:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788201080.068529:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:91120:x1875060715147776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201080.068595:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:91120:x1875060715147776:12345-0@lo:502:llog_process_th.0 Request processed in 67us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201080.068602:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788201080.069088:0:91120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:91120:1875060715147776:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788201080.069108:0:91120:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788201080.069172:0:91096:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788201080.069190:0:91096:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788201080.069203:0:91096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc400/0x96d0c9b8c9a1b6e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b6ef expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201080.069213:0:91096:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc400/0x96d0c9b8c9a1b6e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b6ef expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788201080.069258:0:91096:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788201080.069260:0:91096:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201080.069262:0:91096:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201080.069263:0:91096:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201080.069264:0:91096:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201080.069265:0:91096:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201080.069270:0:91096:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201080.069271:0:91096:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201080.069273:0:91096:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201080.069274:0:91096:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788201080.069277:0:91096:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788201080.069280:0:91096:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788201080.069281:0:91096:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201080.069281:0:91096:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201080.069282:0:91096:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201080.069283:0:91096:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201080.069284:0:91096:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201080.069285:0:91096:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201080.069286:0:91096:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201080.069287:0:91096:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201080.069288:0:91096:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788201080.069302:0:91096:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788201080.069313:0:91096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715147904:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788201080.069347:0:91096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201080.069366:0:91096:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201080.071098:0:91103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715147904 00000100:00100000:2.0:1788201080.071108:0:91103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715147904 00000100:00100000:2.0:1788201080.074877:0:91103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788201080.074905:0:91103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:91096:x1875060715147904:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788201080.075085:0:91103:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788201080.075103:0:91103:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788201080.077068:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201080.077080:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc106074000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201080.077087:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788201080.077092:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715147520:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1788201080.084327:0:91103:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788201080.084351:0:91103:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788201080.084641:0:91105:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788201080.084648:0:91105:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788201080.084673:0:91105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc12f338800/0x96d0c9b8c9a1b704 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201080.084694:0:91105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc00782de00/0x96d0c9b8c9a1b6cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b6c5 expref: 11 pid: 91103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201080.084702:0:91105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dc12f338800/0x96d0c9b8c9a1b704 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201080.084742:0:91105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc00782de00/0x96d0c9b8c9a1b6cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1b6c5 expref: 11 pid: 91103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201080.084757:0:91105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc00782de00/0x96d0c9b8c9a1b6cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1b6c5 expref: 11 pid: 91103 timeout: 4031 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201080.084772:0:91105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cef480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:91105:1875060715148032:0@lo:104: 00000100:00100000:0.0:1788201080.084841:0:91105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201080.084881:0:91105:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103439300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201080.084907:0:6515:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788201080.084924:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715148032 00000100:00100000:0.0:1788201080.087475:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715148032 00000100:00100000:0.0:1788201080.087550:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788201080.087560:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107166850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9b18af6-fecc-4172-82c2-66531890fe11+3:91105:x1875060715148032:12345-0@lo:104: 00010000:00010000:0.0:1788201080.087593:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc00782c400/0x96d0c9b8c9a1b6c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1b6cc expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201080.087703:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201080.087710:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107166850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9b18af6-fecc-4172-82c2-66531890fe11+3:91105:x1875060715148032:12345-0@lo:104: Request processed in 151us (2868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201080.087718:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788201080.087792:0:91105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cef480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:91105:1875060715148032:0@lo:104: 00010000:00010000:0.0:1788201080.087815:0:91105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dc12f338800/0x96d0c9b8c9a1b704 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201080.090975:0:91103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:91096:x1875060715147904:12345-0@lo:253:mount.lustre.0 Request processed in 16074us (21617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201080.090990:0:91103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788201080.091073:0:91096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:91096:1875060715147904:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788201080.091088:0:91096:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788201080.091091:0:91096:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201080.091093:0:91096:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201080.091095:0:91096:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201080.091104:0:91096:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201080.091106:0:91096:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201080.091107:0:91096:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201080.091109:0:91096:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201080.091110:0:91096:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201080.091112:0:91096:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201080.091114:0:91096:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788201080.091129:0:91096:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788201080.097838:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201080.097863:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc00782c400/0x96d0c9b8c9a1b6c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1b6cc expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201080.097892:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c400 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:3.0:1788201080.097897:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782c400/0x96d0c9b8c9a1b6c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1b6cc expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201080.097908:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc00782c400/0x96d0c9b8c9a1b6c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1b6cc expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201080.097916:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782c400/0x96d0c9b8c9a1b6c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1b6cc expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201080.097922:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201080.097984:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc00782c400/0x96d0c9b8c9a1b6c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1b6cc expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201080.097992:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788201080.098058:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715148160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201080.098126:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201080.098240:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc00782c400/0x96d0c9b8c9a1b6c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1b6cc expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201080.098249:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc00782c400/0x96d0c9b8c9a1b6c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1b6cc expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201080.098272:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201080.098274:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201080.098276:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201080.100056:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715148160 00000100:00100000:0.0:1788201080.100067:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715148160 00010000:00010000:0.0:1788201080.100101:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc00782de00/0x96d0c9b8c9a1b6cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1b6c5 expref: 11 pid: 91103 timeout: 4031 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201080.100135:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:0.0:1788201080.100144:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+11:3655:x1875060715148160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201080.100156:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201080.100161:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc00782de00/0x96d0c9b8c9a1b6cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1b6c5 expref: 11 pid: 91103 timeout: 4031 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201080.100174:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc00782de00/0x96d0c9b8c9a1b6cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1b6c5 expref: 11 pid: 91103 timeout: 4031 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201080.100189:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782de00/0x96d0c9b8c9a1b6cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1b6c5 expref: 11 pid: 91103 timeout: 4031 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201080.100204:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dc12f338800/0x96d0c9b8c9a1b704 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201080.100220:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc12f338800/0x96d0c9b8c9a1b704 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788201080.100234:0:6518:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015586988s 00010000:00010000:0.0:1788201080.100240:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc12f338800/0x96d0c9b8c9a1b704 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201080.100246:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc12f338800/0x96d0c9b8c9a1b704 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201080.100252:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc12f338800/0x96d0c9b8c9a1b704 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201080.100259:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc12f338800/0x96d0c9b8c9a1b704 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201080.100265:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f338800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201080.100269:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc12f338800/0x96d0c9b8c9a1b704 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201080.100277:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc12f338800/0x96d0c9b8c9a1b704 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201080.100289:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc12f338800/0x96d0c9b8c9a1b704 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201080.100299:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201080.101070:0:91105:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dc12f338800/0x96d0c9b8c9a1b704 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201080.101081:0:91105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc12f338800/0x96d0c9b8c9a1b704 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201080.101098:0:91105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc12f338800/0x96d0c9b8c9a1b704 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201080.101294:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+10:3655:x1875060715148160:12345-0@lo:103:ldlm_bl.0 Request processed in 1150us (3165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201080.101303:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00000100:00100000:1.0:1788201080.103502:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715148160:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788201080.115236:0:91096:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411350 00000040:01000000:2.0:1788201080.116407:0:91096:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788201080.116679:0:91126:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411350 00000020:00080000:3.0:1788201080.116683:0:91126:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411350 00000040:01000000:1.0:1788201080.116785:0:91127:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1788201080.117312:0:91127:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788201080.118836:0:91096:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1788201080.119427:0:91128:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91128:1875060715148288:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788201080.119498:0:91128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201080.119538:0:91128:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038e0900 going to sleep for 11 seconds 00000040:01000000:3.0:1788201080.119914:0:91096:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788201080.119970:0:91096:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788201080.120543:0:91096:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788201080.120553:0:91096:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788201080.120592:0:91096:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788201080.121088:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715148288 00000100:00100000:0.0:1788201080.121110:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715148288 00000100:00100000:0.0:1788201080.121160:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3937 00000100:00100000:0.0:1788201080.121170:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91128:x1875060715148288:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788201080.121285:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91128:x1875060715148288:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 116us (1785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201080.121292:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3937 00000100:00100000:0.0:1788201080.121353:0:91128:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91128:1875060715148288:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788201080.121399:0:91128:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788201080.121438:0:91128:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cef480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91128:1875060715148416:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788201080.121480:0:91128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201080.121510:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715148416 00000100:00100000:0.0:1788201080.121513:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715148416 00000100:00100000:0.0:1788201080.121537:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3938 00000100:00100000:0.0:1788201080.121544:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91128:x1875060715148416:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788201080.121650:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91128:x1875060715148416:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 106us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201080.121656:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3938 00000100:00100000:0.0:1788201080.121677:0:91128:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103439cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201080.121691:0:91128:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cef480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91128:1875060715148416:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788201080.121747:0:91128:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cef480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91128:1875060715148544:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788201080.121770:0:91128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201080.121788:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715148544 00000100:00100000:0.0:1788201080.121792:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715148544 00000100:00100000:0.0:1788201080.121811:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3939 00000100:00100000:0.0:1788201080.121816:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91128:x1875060715148544:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788201080.121903:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:91128:x1875060715148544:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 86us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201080.121909:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3939 00000100:00100000:0.0:1788201080.121938:0:91128:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103439300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201080.121951:0:91128:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cef480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:91128:1875060715148544:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788201080.121985:0:91128:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201080.124087:0:91128:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788201080.124171:0:91128:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1788201080.126005:0:91127:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788201080.126117:0:91127:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788201080.126122:0:91127:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1788201080.127199:0:91096:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788201080.127753:0:91096:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788201080.127784:0:91096:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788201080.127893:0:91096:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788201080.128382:0:91096:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4e:0x0] (8/32) registered 00010000:00080000:1.0:1788201080.134853:0:91096:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 111669149703 00010000:00080000:3.0:1788201080.135863:0:91129:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 91129 00010000:02000000:3.0:1788201080.135879:0:91129:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:01000004:0.0:1788201080.141203:0:91096:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788201080.141226:0:91096:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788201080.141249:0:91096:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788201080.141280:0:91096:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00010000:00080000:3.0:1788201080.171366:0:91129:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788201080.171376:0:91129:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:00000004:3.0:1788201080.172812:0:91096:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788201080.173217:0:91096:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788201080.591176:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201080.660006:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201080.660767:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695380480 00000100:00100000:1.0:1788201080.660779:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695380480 00000100:00100000:1.0:1788201080.660834:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:1.0:1788201080.660844:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+5:42467:x1875060695380480:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201080.660861:0:91102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201080.660881:0:91102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007a2c400/0x96d0c9b8c9a1b70b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7866dc expref: -99 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201080.660921:0:91102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007a2c400/0x96d0c9b8c9a1b70b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866dc expref: 6 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201080.660932:0:91102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007a2c400/0x96d0c9b8c9a1b70b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866dc expref: 6 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201080.660942:0:91102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2c400, rc 0) 00000100:00100000:1.0:1788201080.661006:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+6:42467:x1875060695380480:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 162us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201080.661047:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:0.0:1788201080.669385:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201080.669475:0:91104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695380608 00000100:00100000:2.0:1788201080.669487:0:91104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695380608 00000100:00100000:2.0:1788201080.669550:0:91104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:2.0:1788201080.669561:0:91104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107670450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+6:42467:x1875060695380608:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201080.669591:0:91104:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1788201080.669622:0:91104:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201080.669627:0:91104:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1788201080.669630:0:91104:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1788201080.669633:0:91104:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1788201080.669635:0:91104:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 119 00000100:00100000:2.0:1788201080.674076:0:91104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107670450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0fa559bc-2180-4019-80c4-11831fedf9a9+6:42467:x1875060695380608:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 Request processed in 4503us (4698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201080.674092:0:91104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:0.0:1788201080.684227:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201080.686132:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695380736 00000100:00100000:3.0:1788201080.686148:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695380736 00000100:00100000:3.0:1788201080.686193:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1286 00000100:00100000:3.0:1788201080.686203:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2399:x1875060695380736:12345-192.168.201.20@tcp:38:ll_cfg_requeue.0 00010000:00080000:3.0:1788201080.686237:0:69485:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '4292087e-fa00-4621-b681-837afc99ae35' at ffff8dc001db0800, cookie 0x96d0c9b8c9a1b655 00010000:00080000:3.0:1788201080.686243:0:69485:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp recovering/t111669149704 exp ffff8dc001db0800 cur 3932 last 1788201079 00010000:02000400:3.0:1788201080.686265:0:69485:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:3.0:1788201080.686271:0:69485:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:3.0:1788201080.686291:0:69485:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788201080.686450:0:69485:0:(import.c:65:import_set_state_nolock()) ffff8dc12f19b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201080.686519:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+6:2399:x1875060695380736:12345-192.168.201.20@tcp:38:ll_cfg_requeue.0 Request processed in 316us (2300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201080.686527:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1286 00000100:00100000:0.0:1788201080.693754:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201080.693848:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695380864 00000100:00100000:1.0:1788201080.693860:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695380864 00000100:00100000:1.0:1788201080.693950:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:1.0:1788201080.693960:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+6:42467:x1875060695380864:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201080.693980:0:91102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201080.693996:0:91102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007a2d600/0x96d0c9b8c9a1b712 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7866e3 expref: -99 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201080.694054:0:91102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007a2d600/0x96d0c9b8c9a1b712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866e3 expref: 7 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201080.694066:0:91102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007a2d600/0x96d0c9b8c9a1b712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866e3 expref: 7 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201080.694075:0:91102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2d600, rc 0) 00000100:00100000:1.0:1788201080.694134:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+7:42467:x1875060695380864:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 176us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201080.694142:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:0.0:1788201080.704206:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201080.704301:0:91103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695380992 00000100:00100000:3.0:1788201080.704311:0:91103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695380992 00000100:00100000:3.0:1788201080.704368:0:91103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:3.0:1788201080.704387:0:91103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+7:42467:x1875060695380992:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201080.704547:0:91103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+8:42467:x1875060695380992:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 170us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201080.704556:0:91103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:0.0:1788201080.706977:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201080.707065:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201080.707154:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695370880 00000100:00100000:2.0:1788201080.707163:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695370880 00000100:00100000:2.0:1788201080.707218:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1287 00000100:00100000:2.0:1788201080.707228:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2399:x1875060695370880:12345-192.168.201.20@tcp:36:mcreate.0 00010000:00080000:2.0:1788201080.707247:0:66757:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 111669149704, current: 111669149704, replaying 00000100:00100000:2.0:1788201080.707276:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2399:x1875060695370880:12345-192.168.201.20@tcp:36:mcreate.0 Request processed in 50us (211us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201080.707283:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1287 00010000:00080000:3.0:1788201080.707340:0:91129:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1788201080.707401:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695381120 00000100:00100000:1.0:1788201080.707405:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695381120 00000100:00100000:1.0:1788201080.707438:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:1.0:1788201080.707445:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc008e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+8:42467:x1875060695381120:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201080.707570:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc008e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+8:42467:x1875060695381120:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 125us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201080.707577:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:2.0:1788201080.721180:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201080.721542:0:91103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695381248 00000100:00100000:3.0:1788201080.721552:0:91103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695381248 00000100:00100000:3.0:1788201080.721616:0:91103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:3.0:1788201080.721626:0:91103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc008e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+8:42467:x1875060695381248:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201080.721644:0:91103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201080.721659:0:91103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1b719 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7866ea expref: -99 pid: 91103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201080.721685:0:91103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1b719 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866ea expref: 9 pid: 91103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201080.721715:0:91103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1b719 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866ea expref: 9 pid: 91103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201080.721724:0:91103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782c400, rc 0) 00000100:00100000:3.0:1788201080.721786:0:91103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc008e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+9:42467:x1875060695381248:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 161us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201080.721793:0:91103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:3.0:1788201080.723728:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201080.723820:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695381376 00000100:00100000:1.0:1788201080.723828:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695381376 00000100:00100000:1.0:1788201080.723885:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:1.0:1788201080.723894:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc008e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+9:42467:x1875060695381376:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201080.724088:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc008e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+9:42467:x1875060695381376:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 194us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201080.724096:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:1.0:1788201080.744006:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201080.754490:0:91103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695381504 00000100:00100000:3.0:1788201080.754505:0:91103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695381504 00000100:00100000:2.0:1788201080.754662:0:91103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:2.0:1788201080.754674:0:91103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc008e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+9:42467:x1875060695381504:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201080.754824:0:91103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc008e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+9:42467:x1875060695381504:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 151us (10828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201080.754832:0:91103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:3.0:1788201080.759759:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201080.759864:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695381632 00000100:00100000:1.0:1788201080.759877:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695381632 00000100:00100000:1.0:1788201080.759938:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00100000:1.0:1788201080.759948:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc008e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+9:42467:x1875060695381632:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201080.759965:0:91102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201080.759981:0:91102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007a2dc00/0x96d0c9b8c9a1b720 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7866f1 expref: -99 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201080.760010:0:91102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007a2dc00/0x96d0c9b8c9a1b720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866f1 expref: 10 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201080.760059:0:91102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007a2dc00/0x96d0c9b8c9a1b720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866f1 expref: 10 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201080.760069:0:91102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2dc00, rc 0) 00000100:00100000:1.0:1788201080.760126:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc008e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+10:42467:x1875060695381632:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 179us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201080.760133:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00100000:0.0:1788201080.762458:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201080.762541:0:91103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695381760 00000100:00100000:2.0:1788201080.762550:0:91103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695381760 00000100:00100000:2.0:1788201080.762605:0:91103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00100000:2.0:1788201080.762624:0:91103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc008e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+10:42467:x1875060695381760:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201080.762744:0:91103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc008e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0fa559bc-2180-4019-80c4-11831fedf9a9+10:42467:x1875060695381760:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 121us (293us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201080.762753:0:91103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 35 10000000:01000000:1.0:1788201081.041477:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788201081.041485:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc0084be800 from 119 10000000:01000000:1.0:1788201081.041491:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788201081.041532:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007a2de00/0x96d0c9b8c9a1b727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.041553:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007a2de00/0x96d0c9b8c9a1b727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.041565:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007a2de00/0x96d0c9b8c9a1b727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201081.041589:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715148672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201081.041663:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201081.041707:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007465b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201081.042257:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715148672 00000100:00100000:0.0:1788201081.042265:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715148672 00000100:00100000:0.0:1788201081.043561:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788201081.043575:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc008e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+10:6529:x1875060715148672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201081.043589:0:91102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201081.043613:0:91102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc12f339400/0x96d0c9b8c9a1b72e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b727 expref: -99 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201081.043649:0:91102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc12f339400/0x96d0c9b8c9a1b72e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b727 expref: 11 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201081.043659:0:91102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc12f339400/0x96d0c9b8c9a1b72e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b727 expref: 11 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201081.043669:0:91102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12f339400, rc 0) 00000100:00100000:0.0:1788201081.043728:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc008e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715148672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (2065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201081.043736:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788201081.043789:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715148672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201081.043804:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007a2de00/0x96d0c9b8c9a1b727 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b72e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201081.043812:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007a2de00/0x96d0c9b8c9a1b727 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b72e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201081.043865:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715148800:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788201081.043898:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201081.043935:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004bde780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201081.043949:0:91103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715148800 00000100:00100000:0.0:1788201081.043953:0:91103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715148800 00000100:00100000:0.0:1788201081.045294:0:91103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788201081.045305:0:91103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1076f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715148800:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788201081.045324:0:91103:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788201081.045339:0:91103:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788201081.045345:0:91103:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 119 00000100:00100000:0.0:1788201081.045565:0:91103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1076f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715148800:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 262us (1666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201081.045574:0:91103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788201081.045670:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715148800:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788201081.045720:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788201081.045729:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007a2de00/0x96d0c9b8c9a1b727 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b72e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.045740:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007a2de00/0x96d0c9b8c9a1b727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b72e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201081.045751:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788201081.045753:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc0053a4000 from 52 10000000:01000000:1.0:1788201081.045756:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788201081.045780:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007a2c200/0x96d0c9b8c9a1b735 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.045788:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007a2c200/0x96d0c9b8c9a1b735 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.045797:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007a2c200/0x96d0c9b8c9a1b735 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201081.045824:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715148928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201081.045861:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201081.052205:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007465a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201081.052344:0:91107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715148928 00000100:00100000:2.0:1788201081.052354:0:91107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715148928 00000100:00100000:2.0:1788201081.052400:0:91107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788201081.052410:0:91107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1076fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715148928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201081.052427:0:91107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201081.052446:0:91107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc004fdc000/0x96d0c9b8c9a1b73c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b735 expref: -99 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.052473:0:91107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc004fdc000/0x96d0c9b8c9a1b73c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b735 expref: 12 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.052498:0:91107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc004fdc000/0x96d0c9b8c9a1b73c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b735 expref: 12 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.052507:0:91107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc004fdc000, rc 0) 00000100:00100000:2.0:1788201081.052595:0:91107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1076fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715148928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (6733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201081.052611:0:91107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788201081.052705:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715148928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201081.052721:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007a2c200/0x96d0c9b8c9a1b735 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b73c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.052730:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007a2c200/0x96d0c9b8c9a1b735 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b73c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201081.052800:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715149056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201081.052835:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201081.052857:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007465a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201081.052902:0:91107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715149056 00000100:00100000:2.0:1788201081.052906:0:91107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715149056 00000100:00100000:2.0:1788201081.052924:0:91107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788201081.052930:0:91107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1076fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715149056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201081.053097:0:91107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1076fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715149056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 166us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201081.053113:0:91107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788201081.053251:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715149056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201081.053279:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715149184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201081.053317:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201081.053343:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007465a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201081.053434:0:91107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715149184 00000100:00100000:2.0:1788201081.053439:0:91107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715149184 00000100:00100000:2.0:1788201081.053457:0:91107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788201081.053462:0:91107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1076fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715149184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201081.053542:0:91107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1076fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715149184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201081.053549:0:91107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788201081.053622:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715149184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201081.054421:0:91160:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788201081.054771:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788201081.054793:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788201081.054803:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007a2c200/0x96d0c9b8c9a1b735 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b73c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.054825:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007a2c200/0x96d0c9b8c9a1b735 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b73c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201081.054834:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788201081.054836:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc0053a4000 from 116 10000000:01000000:2.0:1788201081.054840:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788201081.054867:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd000/0x96d0c9b8c9a1b743 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.054875:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd000/0x96d0c9b8c9a1b743 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.054897:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd000/0x96d0c9b8c9a1b743 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201081.054915:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715149312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201081.054957:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201081.054995:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc109832c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201081.055190:0:91104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715149312 00000100:00100000:2.0:1788201081.055197:0:91104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715149312 00000100:00100000:2.0:1788201081.055225:0:91104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788201081.055233:0:91104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1076f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715149312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201081.055245:0:91104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201081.055256:0:91104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc004fddc00/0x96d0c9b8c9a1b74a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b743 expref: -99 pid: 91104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.055277:0:91104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc004fddc00/0x96d0c9b8c9a1b74a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b743 expref: 13 pid: 91104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.055299:0:91104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc004fddc00/0x96d0c9b8c9a1b74a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b743 expref: 13 pid: 91104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.055308:0:91104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc004fddc00, rc 0) 00000100:00100000:2.0:1788201081.055341:0:91104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1076f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715149312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201081.055348:0:91104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788201081.055384:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715149312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201081.055397:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd000/0x96d0c9b8c9a1b743 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b74a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.055405:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd000/0x96d0c9b8c9a1b743 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b74a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201081.055465:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715149440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788201081.055494:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201081.055511:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc109832c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201081.055521:0:91104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715149440 00000100:00100000:2.0:1788201081.055523:0:91104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715149440 00000100:00100000:2.0:1788201081.055540:0:91104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788201081.055545:0:91104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1076f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715149440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201081.055559:0:91104:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788201081.055573:0:91104:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201081.055578:0:91104:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1788201081.055581:0:91104:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1788201081.055584:0:91104:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1788201081.055590:0:91104:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 119 00000100:00100000:2.0:1788201081.055666:0:91104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1076f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715149440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201081.055674:0:91104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788201081.055700:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715149440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788201081.055764:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788201081.055771:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd000/0x96d0c9b8c9a1b743 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b74a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.055779:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd000/0x96d0c9b8c9a1b743 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b74a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201081.055786:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788201081.055788:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:2.0:1788201081.055791:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788201081.055804:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc200/0x96d0c9b8c9a1b751 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.055811:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc200/0x96d0c9b8c9a1b751 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.055819:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc200/0x96d0c9b8c9a1b751 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201081.055831:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715149568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201081.055853:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201081.055865:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103892540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201081.055877:0:91104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715149568 00000100:00100000:2.0:1788201081.055880:0:91104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715149568 00000100:00100000:2.0:1788201081.056043:0:91104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788201081.056050:0:91104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1076f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715149568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201081.056057:0:91104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201081.056065:0:91104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc004fdde00/0x96d0c9b8c9a1b758 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b751 expref: -99 pid: 91104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.056078:0:91104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc004fdde00/0x96d0c9b8c9a1b758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b751 expref: 14 pid: 91104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.056087:0:91104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc004fdde00/0x96d0c9b8c9a1b758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b751 expref: 14 pid: 91104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.056094:0:91104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc004fdde00, rc 0) 00000100:00100000:2.0:1788201081.056170:0:91104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1076f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715149568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201081.056177:0:91104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788201081.056204:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715149568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201081.056214:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc200/0x96d0c9b8c9a1b751 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b758 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.056222:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc200/0x96d0c9b8c9a1b751 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b758 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201081.056269:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715149696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201081.056291:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201081.056309:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103892540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201081.056319:0:91104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715149696 00000100:00100000:2.0:1788201081.056322:0:91104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715149696 00000100:00100000:2.0:1788201081.056344:0:91104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788201081.056349:0:91104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715149696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201081.056472:0:91104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715149696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201081.056479:0:91104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788201081.056507:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715149696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201081.056529:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715149824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201081.056566:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201081.056579:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103892540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201081.056589:0:91104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715149824 00000100:00100000:2.0:1788201081.056592:0:91104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715149824 00000100:00100000:2.0:1788201081.056619:0:91104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788201081.056626:0:91104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715149824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201081.057377:0:91104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715149824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 749us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201081.057385:0:91104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788201081.058469:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715149824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201081.060071:0:91161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:3.0:1788201081.060321:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:3.0:1788201081.060343:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788201081.060354:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc200/0x96d0c9b8c9a1b751 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b758 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201081.060422:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc200/0x96d0c9b8c9a1b751 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b758 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201081.060432:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1788201081.060435:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dc0053a4000 from 1 10000000:01000000:3.0:1788201081.060438:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788201081.060470:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1b75f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201081.060479:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1b75f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201081.060500:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1b75f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201081.060522:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715149952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201081.060583:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201081.060635:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140a45e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201081.060681:0:91107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715149952 00000100:00100000:2.0:1788201081.060688:0:91107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715149952 00000100:00100000:2.0:1788201081.060740:0:91107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788201081.060749:0:91107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140a5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715149952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201081.060762:0:91107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201081.060773:0:91107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc004fdda00/0x96d0c9b8c9a1b766 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b75f expref: -99 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.060797:0:91107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc004fdda00/0x96d0c9b8c9a1b766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b75f expref: 15 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.060817:0:91107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc004fdda00/0x96d0c9b8c9a1b766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b75f expref: 15 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.060825:0:91107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc004fdda00, rc 0) 00000100:00100000:2.0:1788201081.060872:0:91107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140a5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715149952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201081.060879:0:91107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788201081.061069:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715149952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201081.061083:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1b75f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b766 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201081.061092:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1b75f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b766 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201081.061213:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788201081.061219:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1b75f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b766 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201081.061227:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1b75f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b766 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201081.061234:0:6529:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201081.061235:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc0053a4000 from 7 10000000:01000000:0.0:1788201081.061238:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201081.061253:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12f338400/0x96d0c9b8c9a1b76d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201081.061260:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc12f338400/0x96d0c9b8c9a1b76d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201081.061268:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc12f338400/0x96d0c9b8c9a1b76d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201081.061291:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715150080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201081.061338:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201081.061441:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715150080 00000100:00100000:2.0:1788201081.061446:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715150080 00000100:00100000:2.0:1788201081.061471:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788201081.061478:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140a5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715150080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201081.061486:0:91102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201081.061494:0:91102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc004fdd400/0x96d0c9b8c9a1b774 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b76d expref: -99 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.061508:0:91102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc004fdd400/0x96d0c9b8c9a1b774 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b76d expref: 16 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.061516:0:91102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc004fdd400/0x96d0c9b8c9a1b774 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b76d expref: 16 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.061524:0:91102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc004fdd400, rc 0) 00000100:00100000:2.0:1788201081.061548:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140a5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715150080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 70us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201081.061553:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788201081.061596:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004bde300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201081.061619:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715150080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201081.061629:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc12f338400/0x96d0c9b8c9a1b76d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b774 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201081.061637:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc12f338400/0x96d0c9b8c9a1b76d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b774 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201081.061686:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715150208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201081.061710:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201081.061761:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004bde300 going to sleep for 11 seconds 00000100:00100000:2.0:1788201081.061999:0:91107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715150208 00000100:00100000:2.0:1788201081.062004:0:91107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715150208 00000100:00100000:2.0:1788201081.062295:0:91107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788201081.062303:0:91107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140a5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715150208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201081.062485:0:91107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140a5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715150208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201081.062492:0:91107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788201081.062556:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715150208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201081.062587:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715150336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201081.062638:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201081.062667:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007465cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201081.062721:0:91103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715150336 00000100:00100000:0.0:1788201081.062726:0:91103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715150336 00000100:00100000:0.0:1788201081.062759:0:91103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788201081.062766:0:91103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715150336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201081.062840:0:91103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715150336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201081.062847:0:91103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788201081.062885:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715150336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201081.064003:0:91162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788201081.064449:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788201081.064473:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201081.064482:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12f338400/0x96d0c9b8c9a1b76d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b774 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.064493:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc12f338400/0x96d0c9b8c9a1b76d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b774 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201081.064501:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788201081.064504:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc001db6000 from 52 10000000:01000000:1.0:1788201081.064506:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788201081.064533:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d200/0x96d0c9b8c9a1b77b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.064542:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d200/0x96d0c9b8c9a1b77b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.064552:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d200/0x96d0c9b8c9a1b77b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201081.064570:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715150464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201081.064621:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201081.064682:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007465cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201081.064713:0:91103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715150464 00000100:00100000:0.0:1788201081.064719:0:91103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715150464 00000100:00100000:0.0:1788201081.064782:0:91103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201081.064801:0:91103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715150464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201081.064812:0:91103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201081.064822:0:91103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc12f338c00/0x96d0c9b8c9a1b782 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b77b expref: -99 pid: 91103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201081.064844:0:91103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc12f338c00/0x96d0c9b8c9a1b782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b77b expref: 17 pid: 91103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201081.064855:0:91103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc12f338c00/0x96d0c9b8c9a1b782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b77b expref: 17 pid: 91103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201081.064863:0:91103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12f338c00, rc 0) 00000100:00100000:0.0:1788201081.064993:0:91103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715150464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201081.065000:0:91103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788201081.065461:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715150464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201081.065476:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d200/0x96d0c9b8c9a1b77b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b782 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.065486:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d200/0x96d0c9b8c9a1b77b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b782 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201081.065554:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715150592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201081.065580:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201081.065646:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004d740c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201081.065677:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715150592 00000100:00100000:1.0:1788201081.065681:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715150592 00000100:00100000:1.0:1788201081.065744:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788201081.065761:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715150592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201081.065873:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715150592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201081.065879:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788201081.066096:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715150592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201081.066133:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715150720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201081.066167:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201081.066495:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004d740c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201081.066584:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715150720 00000100:00100000:1.0:1788201081.066589:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715150720 00000100:00100000:1.0:1788201081.066628:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788201081.066634:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715150720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201081.066712:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715150720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201081.066718:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788201081.066755:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715150720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201081.067446:0:91163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1788201081.067494:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1788201081.067514:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201081.067521:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d200/0x96d0c9b8c9a1b77b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b782 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.067531:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d200/0x96d0c9b8c9a1b77b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b782 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201081.067541:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788201081.067543:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1788201081.067546:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788201081.067568:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007a2ca00/0x96d0c9b8c9a1b789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.067576:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007a2ca00/0x96d0c9b8c9a1b789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.067584:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007a2ca00/0x96d0c9b8c9a1b789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201081.067621:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715150848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201081.067652:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201081.067667:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc11199e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201081.067680:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715150848 00000100:00100000:1.0:1788201081.067684:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715150848 00000100:00100000:1.0:1788201081.067702:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788201081.067708:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715150848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201081.067716:0:91102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201081.067727:0:91102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007a2cc00/0x96d0c9b8c9a1b790 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b789 expref: -99 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.067744:0:91102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007a2cc00/0x96d0c9b8c9a1b790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b789 expref: 18 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.067754:0:91102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007a2cc00/0x96d0c9b8c9a1b790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b789 expref: 18 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.067762:0:91102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2cc00, rc 0) 00000100:00100000:1.0:1788201081.067789:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715150848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201081.067796:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788201081.067824:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715150848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201081.067835:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007a2ca00/0x96d0c9b8c9a1b789 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b790 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.067844:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007a2ca00/0x96d0c9b8c9a1b789 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b790 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201081.067887:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715150976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201081.067911:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201081.067923:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc11199e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201081.067934:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715150976 00000100:00100000:1.0:1788201081.067937:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715150976 00000100:00100000:1.0:1788201081.067952:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788201081.067957:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715150976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201081.068077:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715150976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201081.068085:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788201081.068111:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715150976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201081.068134:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715151104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201081.068168:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201081.068181:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc11199e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201081.068191:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715151104 00000100:00100000:1.0:1788201081.068194:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715151104 00000100:00100000:1.0:1788201081.068210:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788201081.068215:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715151104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201081.069059:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715151104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 842us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201081.069068:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788201081.069163:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715151104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201081.069846:0:91164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1788201081.070843:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1788201081.070866:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788201081.070876:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007a2ca00/0x96d0c9b8c9a1b789 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b790 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.070947:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007a2ca00/0x96d0c9b8c9a1b789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b790 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201081.070970:0:6529:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788201081.070972:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc001db6000 from 7 10000000:01000000:2.0:1788201081.070975:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201081.071004:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc004fdce00/0x96d0c9b8c9a1b797 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.071012:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc004fdce00/0x96d0c9b8c9a1b797 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.071089:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc004fdce00/0x96d0c9b8c9a1b797 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201081.071159:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715151232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201081.071204:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201081.071269:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004d74c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201081.071526:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715151232 00000100:00100000:3.0:1788201081.071533:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715151232 00000100:00100000:3.0:1788201081.071573:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788201081.071583:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715151232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201081.071594:0:91102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201081.071615:0:91102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782c200/0x96d0c9b8c9a1b79e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b797 expref: -99 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201081.071636:0:91102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782c200/0x96d0c9b8c9a1b79e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b797 expref: 19 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201081.071647:0:91102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782c200/0x96d0c9b8c9a1b79e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b797 expref: 19 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201081.071656:0:91102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782c200, rc 0) 00000100:00100000:3.0:1788201081.071698:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715151232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201081.071705:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201081.071804:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715151232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201081.071816:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc004fdce00/0x96d0c9b8c9a1b797 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b79e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.071825:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc004fdce00/0x96d0c9b8c9a1b797 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b79e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201081.071877:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715151360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201081.071913:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201081.071935:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a875840 going to sleep for 11 seconds 00000100:00100000:3.0:1788201081.072044:0:91104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715151360 00000100:00100000:3.0:1788201081.072049:0:91104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715151360 00000100:00100000:3.0:1788201081.072075:0:91104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788201081.072082:0:91104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715151360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201081.072247:0:91104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715151360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201081.072255:0:91104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788201081.072328:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715151360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201081.072355:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715151488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201081.072401:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201081.072422:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004d74c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201081.072518:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715151488 00000100:00100000:3.0:1788201081.072523:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715151488 00000100:00100000:3.0:1788201081.072549:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788201081.072556:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715151488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201081.072639:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715151488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201081.072645:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788201081.072683:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715151488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788201081.073661:0:91165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788201081.073948:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788201081.073975:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201081.073983:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc004fdce00/0x96d0c9b8c9a1b797 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b79e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.073992:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc004fdce00/0x96d0c9b8c9a1b797 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b79e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201081.074195:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788201081.074199:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc13aa9f000 from 52 10000000:01000000:2.0:1788201081.074202:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788201081.074226:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd800/0x96d0c9b8c9a1b7a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.074234:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd800/0x96d0c9b8c9a1b7a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.074243:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd800/0x96d0c9b8c9a1b7a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201081.074261:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715151616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201081.074302:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201081.074430:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004d740c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201081.074471:0:91104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715151616 00000100:00100000:3.0:1788201081.074477:0:91104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715151616 00000100:00100000:3.0:1788201081.074547:0:91104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788201081.074556:0:91104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715151616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201081.074566:0:91104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201081.074577:0:91104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782c800/0x96d0c9b8c9a1b7ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b7a5 expref: -99 pid: 91104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201081.074597:0:91104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782c800/0x96d0c9b8c9a1b7ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b7a5 expref: 20 pid: 91104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201081.074619:0:91104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782c800/0x96d0c9b8c9a1b7ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b7a5 expref: 20 pid: 91104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201081.074627:0:91104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782c800, rc 0) 00000100:00100000:3.0:1788201081.074671:0:91104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715151616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201081.074678:0:91104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788201081.074744:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715151616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201081.074757:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd800/0x96d0c9b8c9a1b7a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b7ac expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.074766:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd800/0x96d0c9b8c9a1b7a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b7ac expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201081.074812:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715151744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201081.074839:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201081.074988:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004d740c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201081.077987:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715151744 00000100:00100000:1.0:1788201081.078000:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715151744 00000100:00100000:1.0:1788201081.078082:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788201081.078093:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715151744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201081.078299:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715151744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 207us (3458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201081.078307:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788201081.078358:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715151744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201081.078468:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715151872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201081.078517:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201081.078542:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a875600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201081.078555:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715151872 00000100:00100000:1.0:1788201081.078558:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715151872 00000100:00100000:1.0:1788201081.078575:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788201081.078581:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715151872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201081.078664:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715151872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201081.078677:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788201081.078713:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715151872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201081.080660:0:91166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788201081.080813:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788201081.080838:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788201081.080855:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd800/0x96d0c9b8c9a1b7a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b7ac expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.080865:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd800/0x96d0c9b8c9a1b7a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b7ac expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201081.080874:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788201081.080876:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1788201081.080878:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788201081.080973:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc800/0x96d0c9b8c9a1b7b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.080982:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc800/0x96d0c9b8c9a1b7b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.080993:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc800/0x96d0c9b8c9a1b7b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201081.081040:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715152000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201081.081096:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201081.081129:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004d74600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201081.081212:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715152000 00000100:00100000:1.0:1788201081.081218:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715152000 00000100:00100000:1.0:1788201081.081260:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788201081.081268:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715152000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201081.081279:0:91102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201081.081291:0:91102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007a2ce00/0x96d0c9b8c9a1b7ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b7b3 expref: -99 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.081311:0:91102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007a2ce00/0x96d0c9b8c9a1b7ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b7b3 expref: 21 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.081321:0:91102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007a2ce00/0x96d0c9b8c9a1b7ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b7b3 expref: 21 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.081329:0:91102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2ce00, rc 0) 00000100:00100000:3.0:1788201081.081449:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715152000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201081.081463:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc800/0x96d0c9b8c9a1b7b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b7ba expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201081.081471:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc800/0x96d0c9b8c9a1b7b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b7ba expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201081.081521:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715152128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201081.081690:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201081.081742:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125952540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201081.081770:0:91104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715152128 00000100:00100000:2.0:1788201081.081774:0:91104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715152128 00000100:00100000:2.0:1788201081.081828:0:91104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788201081.081835:0:91104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715152128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201081.082041:0:91104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715152128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 206us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201081.082049:0:91104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788201081.082125:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715152128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201081.082154:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715152256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201081.082196:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201081.082236:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715152000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 968us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201081.082242:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788201081.082332:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004bde900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201081.082450:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715152256 00000100:00100000:1.0:1788201081.082454:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715152256 00000100:00100000:1.0:1788201081.082469:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788201081.082475:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715152256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201081.083133:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715152256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 656us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201081.083150:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788201081.083224:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715152256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788201081.083999:0:91167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1788201081.084192:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1788201081.084216:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788201081.084224:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc800/0x96d0c9b8c9a1b7b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b7ba expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.084234:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc800/0x96d0c9b8c9a1b7b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b7ba expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201081.084242:0:6529:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788201081.084244:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc13aa9f000 from 7 10000000:01000000:1.0:1788201081.084247:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201081.084270:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007a2c800/0x96d0c9b8c9a1b7c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.084277:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007a2c800/0x96d0c9b8c9a1b7c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.084286:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007a2c800/0x96d0c9b8c9a1b7c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201081.084301:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715152384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201081.084337:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201081.084376:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007465cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201081.084456:0:91107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715152384 00000100:00100000:3.0:1788201081.084461:0:91107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715152384 00000100:00100000:3.0:1788201081.084495:0:91107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788201081.084502:0:91107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715152384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201081.084511:0:91107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201081.084522:0:91107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782ca00/0x96d0c9b8c9a1b7c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b7c1 expref: -99 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201081.084542:0:91107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782ca00/0x96d0c9b8c9a1b7c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b7c1 expref: 22 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201081.084551:0:91107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782ca00/0x96d0c9b8c9a1b7c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b7c1 expref: 22 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201081.084567:0:91107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782ca00, rc 0) 00000100:00100000:3.0:1788201081.084596:0:91107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715152384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201081.084613:0:91107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788201081.084679:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715152384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201081.084691:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007a2c800/0x96d0c9b8c9a1b7c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b7c8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.084700:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007a2c800/0x96d0c9b8c9a1b7c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b7c8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201081.084747:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715152512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201081.084772:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201081.084791:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007465cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201081.084827:0:91107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715152512 00000100:00100000:3.0:1788201081.084831:0:91107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715152512 00000100:00100000:3.0:1788201081.084858:0:91107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788201081.084865:0:91107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715152512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201081.085059:0:91107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715152512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201081.085066:0:91107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788201081.085135:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715152512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201081.085159:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715152640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201081.085192:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201081.085217:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007465cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201081.085252:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715152640 00000100:00100000:3.0:1788201081.085257:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715152640 00000100:00100000:3.0:1788201081.085285:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788201081.085291:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715152640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201081.085354:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715152640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201081.085360:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788201081.085444:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715152640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201081.086322:0:91168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788201081.086512:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788201081.086538:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201081.086546:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007a2c800/0x96d0c9b8c9a1b7c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b7c8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.086555:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007a2c800/0x96d0c9b8c9a1b7c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b7c8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201081.086563:0:6529:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788201081.086566:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8dc12563cd28 from 1 10000000:01000000:2.0:1788201081.086568:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788201081.086590:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc004fdcc00/0x96d0c9b8c9a1b7cf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.086597:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc004fdcc00/0x96d0c9b8c9a1b7cf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.086616:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc004fdcc00/0x96d0c9b8c9a1b7cf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201081.086631:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715152768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201081.086662:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201081.086717:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004d74600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201081.086745:0:91107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715152768 00000100:00100000:1.0:1788201081.086750:0:91107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715152768 00000100:00100000:1.0:1788201081.086806:0:91107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788201081.086813:0:91107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715152768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201081.086822:0:91107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201081.086832:0:91107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007a2da00/0x96d0c9b8c9a1b7d6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b7cf expref: -99 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.086848:0:91107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007a2da00/0x96d0c9b8c9a1b7d6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b7cf expref: 23 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.086857:0:91107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007a2da00/0x96d0c9b8c9a1b7d6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b7cf expref: 23 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201081.086866:0:91107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007a2da00, rc 0) 00000100:00100000:1.0:1788201081.086907:0:91107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715152768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201081.086920:0:91107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788201081.086975:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715152768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201081.086986:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc004fdcc00/0x96d0c9b8c9a1b7cf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b7d6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.086994:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc004fdcc00/0x96d0c9b8c9a1b7cf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b7d6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201081.087009:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788201081.087054:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc004fdcc00/0x96d0c9b8c9a1b7cf lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b7d6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.087061:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc004fdcc00/0x96d0c9b8c9a1b7cf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b7d6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201081.087067:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788201081.087070:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dc12563cd28 from 1 10000000:01000000:2.0:1788201081.087072:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788201081.087086:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100030c00/0x96d0c9b8c9a1b7dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.087093:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc100030c00/0x96d0c9b8c9a1b7dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.087100:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc100030c00/0x96d0c9b8c9a1b7dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201081.087112:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715152896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201081.087135:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201081.087444:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004d74600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201081.087492:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715152896 00000100:00100000:3.0:1788201081.087497:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715152896 00000100:00100000:3.0:1788201081.087530:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788201081.087538:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715152896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201081.087546:0:91102:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201081.087553:0:91102:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782d600/0x96d0c9b8c9a1b7e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1b7dd expref: -99 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201081.087577:0:91102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782d600/0x96d0c9b8c9a1b7e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b7dd expref: 24 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201081.087585:0:91102:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782d600/0x96d0c9b8c9a1b7e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b7dd expref: 24 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201081.087592:0:91102:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782d600, rc 0) 00000100:00100000:3.0:1788201081.087740:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715152896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 203us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201081.087747:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788201081.087848:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715152896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201081.087858:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc100030c00/0x96d0c9b8c9a1b7dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b7e4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.087866:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc100030c00/0x96d0c9b8c9a1b7dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b7e4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201081.088463:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715153024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201081.088504:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201081.088572:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004d74600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201081.088626:0:91103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715153024 00000100:00100000:0.0:1788201081.088630:0:91103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715153024 00000100:00100000:0.0:1788201081.088694:0:91103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788201081.088702:0:91103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715153024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201081.088786:0:91103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715153024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 85us (281us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201081.088793:0:91103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788201081.088854:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715153024:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788201081.088881:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788201081.088899:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100030c00/0x96d0c9b8c9a1b7dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b7e4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201081.088908:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc100030c00/0x96d0c9b8c9a1b7dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b7e4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201081.170416:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715153152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201081.170484:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201081.170578:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715153152 00000100:00100000:1.0:1788201081.170586:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715153152 00000100:00100000:1.0:1788201081.170648:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2234 00000100:00100000:1.0:1788201081.170656:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715153152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201081.170678:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788201081.170720:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715153152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201081.170727:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2234 00000100:00080000:3.0:1788201081.170781:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201081.170819:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715153152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201081.171201:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201081.171211:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715153280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201081.171240:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201081.172037:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715153280 00000100:00100000:0.0:1788201081.172051:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715153280 00000100:00080000:2.0:1788201081.172416:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201081.172438:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2235 00000100:00100000:0.0:1788201081.172452:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715153280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201081.172474:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201081.172540:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715153280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201081.172599:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715153280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201081.182306:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2235 00010000:00010000:1.0:1788201081.616172:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201082.641209:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201083.666885:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201084.374136:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201084.374292:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201084.374336:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201084.374367:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201084.374400:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695382272 00000100:00100000:3.0:1788201084.374411:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695382272 00000100:00100000:3.0:1788201084.374467:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695382144 00000100:00100000:3.0:1788201084.374471:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695382144 00000100:00100000:3.0:1788201084.374494:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2760 00000100:00100000:3.0:1788201084.374517:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:4292087e-fa00-4621-b681-837afc99ae35+7:2403:x1875060695382272:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201084.374593:0:91107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695381888 00000100:00100000:1.0:1788201084.374598:0:91107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695381888 00000100:00100000:3.0:1788201084.374606:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:4292087e-fa00-4621-b681-837afc99ae35+7:2403:x1875060695382272:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 93us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201084.374614:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2760 00000100:00100000:1.0:1788201084.374627:0:91107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 71 00000100:00100000:3.0:1788201084.374630:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2761 00000100:00100000:1.0:1788201084.374634:0:91107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2402:x1875060695381888:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201084.374634:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cb52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695382144:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201084.374660:0:91107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2402:x1875060695381888:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201084.374663:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cb52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:4292087e-fa00-4621-b681-837afc99ae35+6:2402:x1875060695382144:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 29us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201084.374666:0:91107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 71 00000100:00100000:3.0:1788201084.374669:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2761 00000100:00080000:1.0:1788201084.375213:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201084.375218:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201084.375319:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695382016 00000100:00100000:2.0:1788201084.375325:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695382016 00000100:00100000:2.0:1788201084.375408:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1315 00000100:00100000:2.0:1788201084.375419:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695382016:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201084.375459:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:2403:x1875060695382016:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 42us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201084.375465:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1315 00000100:00080000:1.0:1788201084.377733:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788201084.697954:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201085.263698:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201085.263720:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715153408:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201085.263797:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201085.263896:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715153408 00000100:00100000:0.0:1788201085.263904:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715153408 00000100:00100000:0.0:1788201085.263956:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3940 00000100:00100000:0.0:1788201085.263965:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715153408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201085.263999:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:0.0:1788201085.264065:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715153408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201085.264072:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3940 00000100:00100000:0.0:1788201085.264121:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715153408:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1788201085.265475:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201085.265480:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201085.265483:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201085.265490:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3931 00000100:00080000:0.0:1788201085.265495:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201085.265501:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201085.265523:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13ab54a80 x1875060715153664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201085.265578:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201085.265589:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201085.265591:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201085.265595:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3931 00000100:00080000:0.0:1788201085.265597:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201085.265600:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201085.265625:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12014c000 x1875060715153920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201085.265650:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201085.265653:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201085.265655:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201085.265659:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3931 00000100:00080000:0.0:1788201085.265661:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201085.265665:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201085.265676:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12014ea00 x1875060715154176/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201085.265711:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201085.265714:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201085.265715:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201085.265719:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3931 00000100:00080000:0.0:1788201085.265721:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201085.265724:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201085.265734:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc00a9b7100 x1875060715154560/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201085.265752:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788201085.265760:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201085.265762:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc106074000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201085.265767:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dc106074000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201085.265779:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc00a9b5180 x1875060715154944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201085.265806:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715153536:0@lo:400:kworker.0 00000100:00100000:0.0:1788201085.268694:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201085.268762:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715154432:0@lo:400:kworker.0 00000100:00100000:0.0:1788201085.268815:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201085.269051:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715153536 00000100:00100000:1.0:1788201085.269060:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715153536 00000100:00100000:1.0:1788201085.269111:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788201085.269128:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715153536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201085.269178:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715153536:12345-0@lo:400:kworker.0 Request processed in 52us (3321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201085.269184:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788201085.269525:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715154432 00000100:00100000:2.0:1788201085.269539:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715154432 00000100:00100000:2.0:1788201085.269582:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2762 00000100:00100000:2.0:1788201085.269590:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715154432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201085.269631:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715154432:12345-0@lo:400:kworker.0 Request processed in 43us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201085.269648:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2762 00000100:00080000:2.0:1788201085.269750:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201085.270556:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715153536:0@lo:400:kworker.0 00000100:00100000:0.0:1788201085.270574:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715154432:0@lo:400:kworker.0 00000100:00100000:0.0:1788201085.270605:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788201085.270615:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715153792:0@lo:400:kworker.0 00000100:00100000:0.0:1788201085.270653:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201085.270679:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715154688:0@lo:400:kworker.0 00000100:00100000:0.0:1788201085.270705:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201085.270744:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715153664:0@lo:38:kworker.0 00000100:00100000:0.0:1788201085.270777:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201085.270796:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715153920:0@lo:38:kworker.0 00000100:00100000:0.0:1788201085.270817:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201085.270844:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715154176:0@lo:38:kworker.0 00000100:00100000:2.0:1788201085.271520:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715153792 00000100:00100000:2.0:1788201085.271527:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715153792 00000100:00100000:2.0:1788201085.271581:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715153664 00000100:00100000:2.0:1788201085.271584:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715153664 00000100:00100000:2.0:1788201085.271603:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715153920 00000100:00100000:2.0:1788201085.271606:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715153920 00000100:00100000:2.0:1788201085.271619:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:2.0:1788201085.271628:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715153792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201085.271680:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715153792:12345-0@lo:400:kworker.0 Request processed in 54us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201085.271687:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:2.0:1788201085.271703:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:2.0:1788201085.271707:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715153664:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788201085.271748:0:66314:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3936 last 0 00000020:00000080:2.0:1788201085.271782:0:66314:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x96d0c9b8c9a1b7eb 00000004:00100000:2.0:1788201085.271797:0:66314:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1788201085.273475:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201085.273665:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715154176 00000100:00100000:1.0:1788201085.273672:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715154176 00000100:00100000:1.0:1788201085.273707:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3941 00000100:00100000:1.0:1788201085.273715:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715154176:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788201085.273740:0:23728:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8dc001db5000, cookie 0x96d0c9b8c9a1b65c 00010000:00080000:1.0:1788201085.273745:0:23728:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t81604378640 exp ffff8dc001db5000 cur 3936 last 1788201079 00000004:00100000:1.0:1788201085.273761:0:23728:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788201085.273789:0:23728:0:(import.c:65:import_set_state_nolock()) ffff8dc106072800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201085.274056:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715154560:0@lo:38:kworker.0 00000100:00100000:0.0:1788201085.274098:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201085.274111:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715154944:0@lo:38:kworker.0 00000100:00100000:0.0:1788201085.274135:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788201085.274167:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 27 00000100:00080000:0.0:1788201085.274179:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1788201085.274183:0:3654:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1788201085.274185:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 85899345923 gen 3 00000100:00080000:0.0:1788201085.274189:0:3654:0:(recover.c:53:ptlrpc_replay_next()) import ffff8dc109813800 from lustre-MDT0000_UUID committed 85899345923 last 0 00000100:00080000:0.0:1788201085.274192:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1788201085.274681:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715154176:12345-0@lo:38:kworker.0 Request processed in 142us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201085.274690:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3941 00010000:00080000:1.0:1788201085.274763:0:91129:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788201085.274768:0:91129:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 111669149704 00000020:00080000:1.0:1788201085.274774:0:91129:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788201085.274778:0:91129:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 111669149704, next_transno: 111669149704 00010000:00080000:1.0:1788201085.274782:0:91129:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (111669149704) 00000020:00080000:1.0:1788201085.274784:0:91129:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788201085.274794:0:91129:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695370880 t111669149704 from 192.168.201.20@tcp req@ffff8dc005d5a300 x1875060695370880/t0(111669149704) o36->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:201/0 lens 528/0 e 0 to 0 dl 1788201091 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201085.275401:0:66314:0:(import.c:65:import_set_state_nolock()) ffff8dc137d37000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201085.275457:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875060715153664:12345-0@lo:38:kworker.0 Request processed in 3747us (4679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201085.275466:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00100000:2.0:1788201085.275482:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715154560 00000100:00100000:2.0:1788201085.275486:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715154560 00000100:00100000:2.0:1788201085.275498:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715154944 00000100:00100000:2.0:1788201085.275501:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715154944 00000100:00100000:2.0:1788201085.275510:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1289 00000100:00100000:2.0:1788201085.275537:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715153920:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788201085.275563:0:66314:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3936 last 0 00000020:00000080:2.0:1788201085.275597:0:66314:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x96d0c9b8c9a1b7f2 00000004:00100000:2.0:1788201085.275607:0:66314:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201085.275625:0:66314:0:(import.c:65:import_set_state_nolock()) ffff8dc137d32800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201085.275652:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875060715153920:12345-0@lo:38:kworker.0 Request processed in 124us (4834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201085.275658:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1289 00000100:00100000:2.0:1788201085.275671:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:2.0:1788201085.275676:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715154560:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788201085.275687:0:66314:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3936 last 0 00000020:00000080:2.0:1788201085.275706:0:66314:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x96d0c9b8c9a1b7f9 00000004:00100000:2.0:1788201085.275711:0:66314:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201085.275723:0:66314:0:(import.c:65:import_set_state_nolock()) ffff8dc137d36000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201085.275746:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875060715154560:12345-0@lo:38:kworker.0 Request processed in 69us (1648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201085.275752:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00100000:2.0:1788201085.275763:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1291 00000100:00100000:2.0:1788201085.275767:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715154944:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788201085.275780:0:66314:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3936 last 0 00000020:00000080:2.0:1788201085.275800:0:66314:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x96d0c9b8c9a1b800 00000004:00100000:2.0:1788201085.275805:0:66314:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201085.275816:0:66314:0:(import.c:65:import_set_state_nolock()) ffff8dc137d34800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201085.275839:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875060715154944:12345-0@lo:38:kworker.0 Request processed in 71us (1703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201085.275845:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1291 00000100:00100000:2.0:1788201085.277659:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715154688 00000100:00100000:2.0:1788201085.277670:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715154688 00000100:00100000:2.0:1788201085.277718:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2763 00000100:00100000:2.0:1788201085.277727:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715154688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201085.277793:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715154688:12345-0@lo:400:kworker.0 Request processed in 67us (7085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201085.277800:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2763 00000100:00080000:2.0:1788201085.277879:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201085.277884:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201085.277968:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715153792:0@lo:400:kworker.0 00000100:00100000:2.0:1788201085.277986:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715154688:0@lo:400:kworker.0 00000001:00100000:2.0:1788201085.280747:0:75739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788201085.281745:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788201085.282040:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788201085.282226:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715154048:0@lo:400:kworker.0 00000100:00100000:0.0:1788201085.282982:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201085.283054:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715154816:0@lo:400:kworker.0 00000100:00100000:0.0:1788201085.283086:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201085.283114:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201085.283120:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715154304:0@lo:400:kworker.0 00000100:00100000:0.0:1788201085.283141:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201085.283178:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715154816 00000100:00100000:0.0:1788201085.283186:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715154816 00000100:00100000:0.0:1788201085.283235:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715154304 00000100:00100000:0.0:1788201085.283239:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715154304 00000100:00100000:0.0:1788201085.283262:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2764 00000100:00100000:0.0:1788201085.283283:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715154816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201085.284000:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715154176:0@lo:38:kworker.0 00010000:00080000:2.0:1788201085.284046:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc00a9b7100 x1875060715154560/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201085.284064:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 27 00010000:00080000:1.0:1788201085.284461:0:91360:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1788201085.284465:0:91360:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1788201085.284471:0:91360:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00100000:0.0:1788201085.285051:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715154816:12345-0@lo:400:kworker.0 Request processed in 1769us (1961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201085.285061:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2764 00000100:00100000:0.0:1788201085.285090:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2765 00000100:00100000:0.0:1788201085.285114:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715154304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201085.285146:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715154304:12345-0@lo:400:kworker.0 Request processed in 36us (2003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201085.285153:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2765 00000100:00080000:0.0:1788201085.285179:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201085.285183:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201085.285204:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715154048 00000100:00100000:0.0:1788201085.285209:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715154048 00000100:00100000:0.0:1788201085.285247:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1317 00000100:00100000:0.0:1788201085.285254:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715154048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201085.285308:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715154048:12345-0@lo:400:kworker.0 Request processed in 54us (2328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201085.285314:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1317 00000100:00080000:0.0:1788201085.285329:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201085.285364:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715154304:0@lo:400:kworker.0 00000100:00100000:0.0:1788201085.285376:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715154048:0@lo:400:kworker.0 00000100:00100000:0.0:1788201085.285385:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715154816:0@lo:400:kworker.0 00000100:00080000:1.0:1788201085.286459:0:91360:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:2.0:1788201085.288538:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8dc00a9b7100 x1875060715154560/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201110 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201085.288552:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788201085.288558:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788201085.288563:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788201085.288568:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715154560:0@lo:38:kworker.0 00010000:00080000:2.0:1788201085.288612:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc00a9b5180 x1875060715154944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201085.288629:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 27 00000100:00080000:2.0:1788201085.288655:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788201085.288660:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788201085.288662:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc106074000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788201085.288668:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715154944:0@lo:38:kworker.0 00000100:00100000:2.0:1788201085.288706:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715155072:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788201085.288772:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788201085.288817:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc13ab54a80 x1875060715153664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201085.288828:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 27 00000100:00080000:2.0:1788201085.289712:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8dc13ab54a80 x1875060715153664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201110 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201085.289721:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788201085.289725:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788201085.289729:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788201085.289734:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715153664:0@lo:38:kworker.0 00010000:00080000:2.0:1788201085.289752:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc12014c000 x1875060715153920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201085.289763:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 27 00000100:00100000:0.0:1788201085.291079:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715155072 00000100:00100000:0.0:1788201085.291091:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715155072 00000100:00100000:0.0:1788201085.291153:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3942 00000100:00100000:0.0:1788201085.291162:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715155072:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1788201085.291179:0:83817:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc005abf800 x1875060715155072/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:206/0 lens 224/0 e 0 to 0 dl 1788201096 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201085.291190:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715155072:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 31us (2420us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201085.291212:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3942 00000004:00080000:1.0:1788201085.291766:0:91129:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 14938us 00000100:00080000:2.0:1788201085.313129:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8dc12014c000 x1875060715153920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201110 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201085.313142:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788201085.313147:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788201085.313151:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788201085.313157:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715153920:0@lo:38:kworker.0 00010000:00010000:1.0:1788201085.319660:0:91129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c600/0x96d0c9b8c9a1b807 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.319685:0:91129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c600/0x96d0c9b8c9a1b807 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.319701:0:91129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c600/0x96d0c9b8c9a1b807 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.319713:0:91129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1b80e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.319719:0:91129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1b80e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.319725:0:91129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1b80e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.322788:0:91129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c600/0x96d0c9b8c9a1b807 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.322808:0:91129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c600/0x96d0c9b8c9a1b807 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.322815:0:91129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c600/0x96d0c9b8c9a1b807 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.322831:0:91129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2c600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201085.328183:0:91129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c600/0x96d0c9b8c9a1b807 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.328200:0:91129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c600/0x96d0c9b8c9a1b807 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.328217:0:91129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12066f800) 00010000:00010000:1.0:1788201085.328220:0:91129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201085.328225:0:91129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c600/0x96d0c9b8c9a1b807 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.328231:0:91129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c600/0x96d0c9b8c9a1b807 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201085.328254:0:91129:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb1ec38f reply state 00000000e1dc4c24 transno 111669149704 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1b80e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.328267:0:91129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1b80e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.328274:0:91129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc12066f400) 00010000:00010000:1.0:1788201085.328277:0:91129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201085.328280:0:91129:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788201085.328416:0:91129:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:1.0:1788201085.328439:0:91129:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788201085.328442:0:91129:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149705 00000020:00080000:1.0:1788201085.328447:0:91129:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788201085.328462:0:91129:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149705 00000100:00100000:1.0:1788201085.340659:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201085.342927:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695371392 00000100:00100000:0.0:1788201085.342941:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695371392 00000100:00100000:0.0:1788201085.343041:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1292 00000100:00100000:0.0:1788201085.343051:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+8:2399:x1875060695371392:12345-192.168.201.20@tcp:36:rm.0 00010000:00080000:0.0:1788201085.343070:0:66757:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 111669149705, current: 111669149705, replaying 00000100:00100000:0.0:1788201085.343085:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+8:2399:x1875060695371392:12345-192.168.201.20@tcp:36:rm.0 Request processed in 36us (2438us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201085.343092:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1292 00000020:00080000:0.0:1788201085.343116:0:91129:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201085.343120:0:91129:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 111669149705, next_transno: 111669149705 00010000:00080000:0.0:1788201085.343124:0:91129:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (111669149705) 00000020:00080000:0.0:1788201085.343127:0:91129:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201085.343136:0:91129:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695371392 t111669149705 from 192.168.201.20@tcp req@ffff8dc005256d80 x1875060695371392/t0(111669149705) o36->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:206/0 lens 512/0 e 0 to 0 dl 1788201096 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201085.343212:0:91129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339e00/0x96d0c9b8c9a1b815 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.343227:0:91129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339e00/0x96d0c9b8c9a1b815 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.343238:0:91129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339e00/0x96d0c9b8c9a1b815 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.343250:0:91129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338a00/0x96d0c9b8c9a1b81c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.343257:0:91129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338a00/0x96d0c9b8c9a1b81c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.343269:0:91129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338a00/0x96d0c9b8c9a1b81c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.343699:0:91129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339800/0x96d0c9b8c9a1b823 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.343708:0:91129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339800/0x96d0c9b8c9a1b823 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.343715:0:91129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339800/0x96d0c9b8c9a1b823 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.344481:0:91129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339800/0x96d0c9b8c9a1b823 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.344490:0:91129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339800/0x96d0c9b8c9a1b823 lrc: 2/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.344497:0:91129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339800/0x96d0c9b8c9a1b823 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.344503:0:91129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201085.344507:0:91129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339800/0x96d0c9b8c9a1b823 lrc: 3/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.344514:0:91129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339800/0x96d0c9b8c9a1b823 lrc: 4/0,0 mode: EX/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.344538:0:91129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0xa:0x0].0x0 (ffff8dc0048beb00) 00010000:00010000:0.0:1788201085.344541:0:91129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201085.344546:0:91129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339800/0x96d0c9b8c9a1b823 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.344558:0:91129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339800/0x96d0c9b8c9a1b823 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.344581:0:91129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339e00/0x96d0c9b8c9a1b815 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.344588:0:91129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339e00/0x96d0c9b8c9a1b815 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.344593:0:91129:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339e00/0x96d0c9b8c9a1b815 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.344597:0:91129:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339e00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201085.344600:0:91129:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339e00/0x96d0c9b8c9a1b815 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.344605:0:91129:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339e00/0x96d0c9b8c9a1b815 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.344614:0:91129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048bed00) 00010000:00010000:0.0:1788201085.344616:0:91129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201085.344619:0:91129:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339e00/0x96d0c9b8c9a1b815 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.344625:0:91129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339e00/0x96d0c9b8c9a1b815 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201085.344639:0:91129:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad8fc85c reply state 00000000fc4344a9 transno 111669149705 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338a00/0x96d0c9b8c9a1b81c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.344651:0:91129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338a00/0x96d0c9b8c9a1b81c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.344664:0:91129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc12066f400) 00010000:00010000:0.0:1788201085.344666:0:91129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201085.344669:0:91129:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788201085.344751:0:91129:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788201085.344772:0:91129:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201085.344775:0:91129:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149706 00000020:00080000:0.0:1788201085.344779:0:91129:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201085.344780:0:91129:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149706 00000100:00100000:0.0:1788201085.374572:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201085.374735:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695372800 00000100:00100000:2.0:1788201085.374746:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695372800 00000100:00100000:2.0:1788201085.374808:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1293 00000100:00100000:2.0:1788201085.374818:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+10:2399:x1875060695372800:12345-192.168.201.20@tcp:36:dd.0 00010000:00080000:2.0:1788201085.374836:0:69485:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 111669149706, current: 111669149708, replaying 00000100:00100000:2.0:1788201085.374864:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+10:2399:x1875060695372800:12345-192.168.201.20@tcp:36:dd.0 Request processed in 49us (302us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201085.374871:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1293 00000020:00080000:3.0:1788201085.375191:0:91129:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201085.375195:0:91129:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 111669149708, next_transno: 111669149706 00010000:00080000:3.0:1788201085.375201:0:91129:0:(ldlm_lib.c:2284:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 111669149706, ql: 1, comp: 1, conn: 2, next: 111669149708, next_update 0 last_committed: 111669149703) 00000020:00080000:3.0:1788201085.375205:0:91129:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201085.375215:0:91129:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695372800 t111669149708 from 192.168.201.20@tcp req@ffff8dc00a9b5880 x1875060695372800/t0(111669149708) o36->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:206/0 lens 488/0 e 0 to 0 dl 1788201096 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788201085.375553:0:91129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1b82a lrc: 3/0,1 mode: --/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.375569:0:91129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1b82a lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.375581:0:91129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1b82a lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788201085.375622:0:91129:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 111669149708 00000004:00010000:3.0:1788201085.375643:0:91129:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a56beca reply state 000000007ad5654e transno 111669149708 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1b82a lrc: 3/0,1 mode: PW/PW res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.375666:0:91129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1b82a lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.375673:0:91129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8dc103a1ea00) 00010000:00010000:3.0:1788201085.375676:0:91129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201085.375679:0:91129:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788201085.375791:0:91129:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788201085.375800:0:91129:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000020:00080000:3.0:1788201085.375809:0:91129:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201085.375812:0:91129:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149709 00000020:00080000:3.0:1788201085.375815:0:91129:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201085.375816:0:91129:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149709 00000100:00100000:3.0:1788201085.399600:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201085.399914:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695373184 00000100:00100000:0.0:1788201085.399926:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695373184 00000100:00100000:0.0:1788201085.400012:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1294 00000100:00100000:0.0:1788201085.400038:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+13:2399:x1875060695373184:12345-192.168.201.20@tcp:101:dd.0 00010000:00080000:0.0:1788201085.400059:0:66314:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 111669149709, current: 111669149709, replaying 00000100:00100000:0.0:1788201085.400074:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+13:2399:x1875060695373184:12345-192.168.201.20@tcp:101:dd.0 Request processed in 39us (484us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201085.400081:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1294 00000020:00080000:0.0:1788201085.400106:0:91129:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201085.400110:0:91129:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 111669149709, next_transno: 111669149709 00010000:00080000:0.0:1788201085.400114:0:91129:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (111669149709) 00000020:00080000:0.0:1788201085.400117:0:91129:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201085.400125:0:91129:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695373184 t111669149709 from 192.168.201.20@tcp req@ffff8dc00515f800 x1875060695373184/t0(111669149709) o101->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:206/0 lens 640/0 e 0 to 0 dl 1788201096 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1788201085.400145:0:91129:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201085.400164:0:91129:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338800/0x96d0c9b8c9a1b831 lrc: 2/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7866ab expref: -99 pid: 91129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.400229:0:91129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338000/0x96d0c9b8c9a1b838 lrc: 3/0,1 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.400244:0:91129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338000/0x96d0c9b8c9a1b838 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.400254:0:91129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338000/0x96d0c9b8c9a1b838 lrc: 3/0,1 mode: EX/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201085.400397:0:91129:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0xb1:0x0], count =625 00000004:00080000:0.0:1788201085.400402:0:91129:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0xb1:0x0]+625 in llog 00000004:00080000:0.0:1788201085.400436:0:91129:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x322:0x0], index 0: 0 00000004:00080000:0.0:1788201085.400443:0:91129:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x323:0x0], index 1: 0 00010000:00010000:0.0:1788201085.400546:0:91129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338000/0x96d0c9b8c9a1b838 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866ab expref: 16 pid: 91129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.400555:0:91129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8dc103a1ea00) 00010000:00010000:0.0:1788201085.400558:0:91129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788201085.400571:0:91129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338800/0x96d0c9b8c9a1b831 lrc: 0/0,0 mode: --/EX res: [0x20000afe1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866ab expref: 16 pid: 91129 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.400585:0:91129:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338000/0x96d0c9b8c9a1b838 lrc: 3/0,0 mode: CR/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866ab expref: 15 pid: 91129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.400615:0:91129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8dc103a1ea00) 00010000:00010000:0.0:1788201085.400618:0:91129:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788201085.400620:0:91129:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12f338000, rc 0) 00010000:00080000:0.0:1788201085.400675:0:91129:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788201085.400697:0:91129:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201085.400700:0:91129:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149710 00000020:00080000:0.0:1788201085.400703:0:91129:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201085.400706:0:91129:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149710 00000100:00100000:1.0:1788201085.417448:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201085.417491:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201085.417541:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201085.417564:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201085.417892:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201085.417938:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695382656 00000100:00100000:1.0:1788201085.417947:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695382656 00000100:00100000:1.0:1788201085.417992:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695382784 00000100:00100000:1.0:1788201085.417996:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695382784 00000100:00100000:1.0:1788201085.418034:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2766 00000100:00100000:1.0:1788201085.418046:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695382656:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201085.418112:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695382656:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 68us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201085.418119:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2766 00000100:00100000:1.0:1788201085.418136:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2767 00000100:00100000:1.0:1788201085.418143:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4292087e-fa00-4621-b681-837afc99ae35+7:2401:x1875060695382784:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201085.418169:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4292087e-fa00-4621-b681-837afc99ae35+7:2401:x1875060695382784:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201085.418175:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2767 00000100:00100000:1.0:1788201085.418192:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695382528 00000100:00100000:1.0:1788201085.418196:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695382528 00000100:00100000:1.0:1788201085.418221:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695382912 00000100:00100000:1.0:1788201085.418224:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695382912 00000100:00100000:1.0:1788201085.418242:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1318 00000100:00100000:1.0:1788201085.418248:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695382528:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201085.418274:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695382528:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201085.418350:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1318 00000100:00100000:1.0:1788201085.418365:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1319 00000100:00100000:1.0:1788201085.418371:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+15:2399:x1875060695382912:12345-192.168.201.20@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1788201085.418388:0:66312:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc13a442680 x1875060695382912/t0(0) o400->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:206/0 lens 224/0 e 0 to 0 dl 1788201096 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201085.418406:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+15:2399:x1875060695382912:12345-192.168.201.20@tcp:400:ldlm_lock_repla.0 Request processed in 36us (515us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201085.418411:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1319 00000020:00080000:1.0:1788201085.418437:0:91129:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788201085.418441:0:91129:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 111669149710 00010000:00080000:1.0:1788201085.418444:0:91129:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1788201085.418447:0:91129:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788201085.418453:0:91129:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1788201085.418455:0:91129:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1788201085.418605:0:91129:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 115964116992 00000001:00100000:1.0:1788201085.425282:0:91097:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4292087e-fa00-4621-b681-837afc99ae35 00000001:00100000:1.0:1788201085.425345:0:91097:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1788201085.425365:0:91097:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149709 is committed 00000001:00080000:1.0:1788201085.425420:0:91129:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1788201085.425460:0:91129:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1788201085.425475:0:91129:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8dc005abf800 x1875060715155072/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:206/0 lens 224/0 e 0 to 0 dl 1788201096 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788201085.426419:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1b80e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.426434:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1b80e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.426442:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1b80e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.426447:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2d800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201085.426451:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1b80e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.426460:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1b80e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.426478:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc12066f400) 00010000:00010000:2.0:1788201085.426481:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201085.426485:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1b80e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.426491:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1b80e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.426543:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338a00/0x96d0c9b8c9a1b81c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.426549:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338a00/0x96d0c9b8c9a1b81c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.426555:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338a00/0x96d0c9b8c9a1b81c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.426560:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f338a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201085.426563:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338a00/0x96d0c9b8c9a1b81c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.426569:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338a00/0x96d0c9b8c9a1b81c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.426577:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc12066f400) 00010000:00010000:2.0:1788201085.426580:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201085.426583:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338a00/0x96d0c9b8c9a1b81c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.426589:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338a00/0x96d0c9b8c9a1b81c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.426606:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1b82a lrc: 3/0,1 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.426613:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1b82a lrc: 2/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.426619:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1b82a lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.426629:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782de00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201085.426633:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1b82a lrc: 3/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.426639:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1b82a lrc: 4/0,0 mode: TXN/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.426646:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8dc103a1ea00) 00010000:00010000:2.0:1788201085.426649:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201085.426651:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1b82a lrc: 2/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.426657:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1b82a lrc: 0/0,0 mode: --/TXN res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 91129 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201085.427914:0:91107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695382400 00000100:00100000:2.0:1788201085.427925:0:91107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695382400 00000100:00100000:2.0:1788201085.427977:0:91107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 73 00000100:00100000:2.0:1788201085.427987:0:91107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695382400:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201085.428071:0:91107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695382400:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 85us (10629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201085.428079:0:91107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 73 00010000:00080000:1.0:1788201085.428338:0:91129:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.201.20@tcp: req@ffff8dc13a442680 x1875060695382912/t0(0) o400->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:206/0 lens 224/0 e 0 to 0 dl 1788201096 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1788201085.428393:0:91129:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:3.0:1788201085.429773:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788201085.429786:0:3654:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8dc005257b80 x1875060715155072/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201101 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201085.429795:0:3654:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8dc005257b80 x1875060715155072/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201101 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201085.429802:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788201085.429816:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788201085.429821:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715155072:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1788201085.429899:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201085.429911:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00515c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715155200:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201085.429965:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201085.430005:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715155200 00000100:00100000:3.0:1788201085.430011:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715155200 00000100:00100000:3.0:1788201085.430078:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3943 00000100:00100000:3.0:1788201085.430087:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715155200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201085.430116:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444966400 avail 1298726912 00000100:00100000:3.0:1788201085.430153:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715155200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201085.430159:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3943 00000100:00100000:3.0:1788201085.430189:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00515c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715155200:0@lo:41:osp-pre-0-1.0 00000004:00000080:0.0:1788201085.476734:0:91129:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa0dd47a63e10 00100000:10000000:0.0:1788201085.476751:0:91129:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1788201085.487796:0:91117:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x323:0x0] 00000100:00100000:3.0:1788201085.488381:0:91117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00515c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:91117:1875060715155328:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788201085.488449:0:91117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201085.488481:0:91117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc101359000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201085.488504:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715155328 00000100:00100000:3.0:1788201085.488510:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715155328 00000100:00100000:3.0:1788201085.488562:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5892 00000100:00100000:3.0:1788201085.488574:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:91117:x1875060715155328:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788201085.488601:0:26202:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 833 -> diff = -30 00002000:02000040:3.0:1788201085.488605:0:26202:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:804 to 0x2c0000401:833) 00000004:00080000:2.0:1788201085.489377:0:91115:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x322:0x0] 00000100:00100000:2.0:1788201085.489405:0:91115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab54a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:91115:1875060715155456:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788201085.489442:0:91115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201085.489463:0:91115:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004d74600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201085.489479:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715155456 00000100:00100000:2.0:1788201085.489491:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715155456 00000100:00100000:2.0:1788201085.489521:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5893 00000100:00100000:2.0:1788201085.489539:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:91115:x1875060715155456:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788201085.489556:0:26210:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 833 -> diff = -31 00002000:02000040:2.0:1788201085.489559:0:26210:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:803 to 0x280000401:833) 00002000:00010000:3.0:1788201085.503362:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x341:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.503378:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1b83f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.503397:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x341:0x0].0x0 since=3936s v=(0 0) 00010000:00010000:3.0:1788201085.503402:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x341:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.503408:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1b83f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.503438:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1b83f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.503448:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1b83f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.503456:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1b83f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.508399:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201085.508825:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x340:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.508847:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1b846 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.508864:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x340:0x0].0x0 since=3936s v=(0 0) 00010000:00010000:3.0:1788201085.508869:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x340:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.508875:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1b846 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.508889:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1b846 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.508898:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1b846 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.508920:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1b846 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.510277:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201085.510297:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1b83f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.510309:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201085.510313:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1b83f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.510324:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1b83f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.510343:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1b83f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.510351:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1b83f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.510377:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201085.510381:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1b846 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.510405:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201085.510409:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1b846 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.510415:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1b846 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.510426:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1b846 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.510434:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201085.510436:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201085.510438:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.516411:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201085.516428:0:26202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1b846 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201085.516609:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.516618:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1b84d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.516632:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33f:0x0].0x0 since=3936s v=(0 0) 00010000:00010000:3.0:1788201085.516638:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.516644:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1b84d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.516661:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1b84d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.516674:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1b84d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.516682:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1b84d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.516722:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201085.516739:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201085.516746:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1b84d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.516753:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201085.516757:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1b84d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.516765:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1b84d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.516782:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1b84d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.516789:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1b84d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.516802:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.516803:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.516805:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201085.516937:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.516943:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1b854 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.516950:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33e:0x0].0x0 since=3936s v=(0 0) 00010000:00010000:3.0:1788201085.516959:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.516964:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1b854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.516972:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1b854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.516979:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1b854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.516985:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1b854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.516997:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201085.517055:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.517061:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0453d66/0x96d0c9b8c9a1b85b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.517068:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33d:0x0].0x0 since=3936s v=(0 0) 00010000:00010000:3.0:1788201085.517070:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.517074:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0453d66/0x96d0c9b8c9a1b85b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.517082:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0453d66/0x96d0c9b8c9a1b85b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.517089:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0453d66/0x96d0c9b8c9a1b85b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.517100:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0453d66/0x96d0c9b8c9a1b85b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.517114:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201085.517121:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201085.517126:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1b854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.517132:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782de00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201085.517136:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1b854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.517144:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1b854 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.517154:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1b854 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.517161:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1b854 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.517173:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201085.517176:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0453d66/0x96d0c9b8c9a1b85b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.517209:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdca00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201085.517212:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0453d66/0x96d0c9b8c9a1b85b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.517220:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0453d66/0x96d0c9b8c9a1b85b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.517230:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0453d66/0x96d0c9b8c9a1b85b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.517237:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0453d66/0x96d0c9b8c9a1b85b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.517250:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.517251:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.517253:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201085.517913:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.517920:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b9c1e9e/0x96d0c9b8c9a1b862 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.517929:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33c:0x0].0x0 since=3936s v=(0 0) 00010000:00010000:3.0:1788201085.517932:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.517937:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b9c1e9e/0x96d0c9b8c9a1b862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.517946:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b9c1e9e/0x96d0c9b8c9a1b862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.517961:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b9c1e9e/0x96d0c9b8c9a1b862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.517967:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b9c1e9e/0x96d0c9b8c9a1b862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.517981:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201085.517990:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201085.517994:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b9c1e9e/0x96d0c9b8c9a1b862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.518001:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdc600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201085.518005:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b9c1e9e/0x96d0c9b8c9a1b862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.518011:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b9c1e9e/0x96d0c9b8c9a1b862 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.518046:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b9c1e9e/0x96d0c9b8c9a1b862 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.518052:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b9c1e9e/0x96d0c9b8c9a1b862 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.518067:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.518074:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.518076:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201085.518126:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.518131:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1b869 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.518139:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33b:0x0].0x0 since=3936s v=(0 0) 00010000:00010000:3.0:1788201085.518142:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.518145:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1b869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.518154:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1b869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.518162:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1b869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.518169:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1b869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.518183:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201085.518190:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201085.518193:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1b869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.518200:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201085.518203:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1b869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.518220:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1b869 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.518232:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1b869 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.518239:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1b869 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.518261:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.518262:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.518264:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201085.518454:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201085.520209:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.520221:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049e5587d/0x96d0c9b8c9a1b870 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.520236:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33a:0x0].0x0 since=3936s v=(0 0) 00010000:00010000:3.0:1788201085.520241:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.520247:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049e5587d/0x96d0c9b8c9a1b870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.520258:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049e5587d/0x96d0c9b8c9a1b870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.520267:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049e5587d/0x96d0c9b8c9a1b870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.520899:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049e5587d/0x96d0c9b8c9a1b870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.520986:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201085.521096:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x339:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.521102:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1b877 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.521111:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x339:0x0].0x0 since=3936s v=(0 0) 00010000:00010000:3.0:1788201085.521115:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x339:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.521120:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1b877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.521129:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1b877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.521138:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1b877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.521145:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1b877 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201085.524904:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x341:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.524918:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b87e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.524932:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x341:0x0].0x0 since=3936s v=(0 0) 00010000:00010000:2.0:1788201085.524937:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x341:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.524943:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b87e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.524958:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b87e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.524968:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b87e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.524975:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b87e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.525211:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201085.525221:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049e5587d/0x96d0c9b8c9a1b870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.525230:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201085.525234:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e5587d/0x96d0c9b8c9a1b870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.525243:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e5587d/0x96d0c9b8c9a1b870 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.525262:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049e5587d/0x96d0c9b8c9a1b870 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.525270:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049e5587d/0x96d0c9b8c9a1b870 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.525306:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201085.525310:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1b877 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.525316:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064eda00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201085.525319:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1b877 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.525341:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1b877 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.525350:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1b877 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.525357:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201085.525360:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b87e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.525366:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100031200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201085.525368:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b87e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.525375:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b87e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.525384:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b87e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.525391:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201085.525392:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201085.525394:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.530577:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201085.530593:0:26202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1b877 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.530653:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201085.530769:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x338:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.530776:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3011c0a/0x96d0c9b8c9a1b885 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.530788:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x338:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:3.0:1788201085.530793:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x338:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.530799:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3011c0a/0x96d0c9b8c9a1b885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.530816:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3011c0a/0x96d0c9b8c9a1b885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.530826:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3011c0a/0x96d0c9b8c9a1b885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.530844:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3011c0a/0x96d0c9b8c9a1b885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.530862:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201085.530869:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201085.530875:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3011c0a/0x96d0c9b8c9a1b885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.530883:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201085.530893:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3011c0a/0x96d0c9b8c9a1b885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.530902:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3011c0a/0x96d0c9b8c9a1b885 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.530919:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3011c0a/0x96d0c9b8c9a1b885 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.530926:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3011c0a/0x96d0c9b8c9a1b885 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.530942:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.530944:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.530945:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201085.530986:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x337:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.530991:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1b88c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.530998:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x337:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:3.0:1788201085.531000:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x337:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.531004:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1b88c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531012:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1b88c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531049:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1b88c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531056:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1b88c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531073:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201085.531112:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x336:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.531117:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000847d8716/0x96d0c9b8c9a1b893 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531124:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x336:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:3.0:1788201085.531127:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x336:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.531130:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000847d8716/0x96d0c9b8c9a1b893 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531138:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000847d8716/0x96d0c9b8c9a1b893 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531145:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000847d8716/0x96d0c9b8c9a1b893 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531151:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000847d8716/0x96d0c9b8c9a1b893 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531186:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201085.531193:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201085.531197:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1b88c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531204:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201085.531208:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1b88c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531216:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1b88c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531227:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1b88c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531234:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1b88c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531248:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201085.531251:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000847d8716/0x96d0c9b8c9a1b893 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531257:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201085.531260:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000847d8716/0x96d0c9b8c9a1b893 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531278:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000847d8716/0x96d0c9b8c9a1b893 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531404:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000847d8716/0x96d0c9b8c9a1b893 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531413:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000847d8716/0x96d0c9b8c9a1b893 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531427:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.531429:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.531431:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201085.531471:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x335:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.531476:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017ceb2d1/0x96d0c9b8c9a1b89a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531483:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x335:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:3.0:1788201085.531487:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x335:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.531491:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017ceb2d1/0x96d0c9b8c9a1b89a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531500:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017ceb2d1/0x96d0c9b8c9a1b89a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531507:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017ceb2d1/0x96d0c9b8c9a1b89a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531520:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017ceb2d1/0x96d0c9b8c9a1b89a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531545:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201085.531552:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201085.531555:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017ceb2d1/0x96d0c9b8c9a1b89a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531562:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ecc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201085.531565:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017ceb2d1/0x96d0c9b8c9a1b89a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531573:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017ceb2d1/0x96d0c9b8c9a1b89a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531583:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017ceb2d1/0x96d0c9b8c9a1b89a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531590:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017ceb2d1/0x96d0c9b8c9a1b89a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531603:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.531605:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.531606:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201085.531645:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x334:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.531655:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f25da42e/0x96d0c9b8c9a1b8a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531662:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x334:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:3.0:1788201085.531665:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x334:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.531668:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f25da42e/0x96d0c9b8c9a1b8a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531677:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f25da42e/0x96d0c9b8c9a1b8a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531685:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f25da42e/0x96d0c9b8c9a1b8a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531693:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f25da42e/0x96d0c9b8c9a1b8a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531706:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201085.531712:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201085.531716:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f25da42e/0x96d0c9b8c9a1b8a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531723:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201085.531727:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f25da42e/0x96d0c9b8c9a1b8a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531734:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f25da42e/0x96d0c9b8c9a1b8a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531750:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f25da42e/0x96d0c9b8c9a1b8a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531757:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f25da42e/0x96d0c9b8c9a1b8a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531772:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.531774:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.531776:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201085.531816:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x333:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.531821:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1b8a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531828:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x333:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:3.0:1788201085.531892:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x333:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.531898:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1b8a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531907:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1b8a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531915:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1b8a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531922:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1b8a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531945:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201085.531951:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201085.531955:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1b8a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531960:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ede00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201085.531963:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1b8a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531970:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1b8a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531980:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1b8a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.531988:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1b8a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.532001:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.532003:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.532004:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201085.532062:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x332:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.532067:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1b8af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.532074:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x332:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:3.0:1788201085.532082:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x332:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.532086:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1b8af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.532095:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1b8af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.532102:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1b8af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.532109:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1b8af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.532121:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201085.532128:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201085.532132:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1b8af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.532139:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201085.532142:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1b8af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.532150:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1b8af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.532159:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1b8af lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.532176:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1b8af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.532574:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.532576:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.532578:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201085.532628:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x331:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.532634:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1b8b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.532642:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x331:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:3.0:1788201085.532646:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x331:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.532650:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1b8b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.532658:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1b8b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.532665:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1b8b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.532671:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1b8b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.532685:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201085.532698:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201085.532702:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1b8b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.532709:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ece00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201085.532713:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1b8b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.532721:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1b8b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.532733:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1b8b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.532741:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1b8b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.532756:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.532758:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.532760:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201085.532800:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x330:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.532805:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1b8bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.532813:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x330:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:3.0:1788201085.532816:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x330:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.532820:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1b8bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.532953:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.536271:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1b8bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.537258:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1b8bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.537272:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1b8bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.537353:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201085.537370:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201085.537376:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1b8bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.537384:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201085.537389:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1b8bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.537398:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1b8bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.537417:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1b8bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.537424:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1b8bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.537469:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.537471:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.537472:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201085.537591:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.537598:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028ebed8b/0x96d0c9b8c9a1b8c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.537608:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32f:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:3.0:1788201085.537612:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.537618:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028ebed8b/0x96d0c9b8c9a1b8c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.537628:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028ebed8b/0x96d0c9b8c9a1b8c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.537635:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028ebed8b/0x96d0c9b8c9a1b8c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.537643:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028ebed8b/0x96d0c9b8c9a1b8c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.537655:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201085.537661:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201085.537665:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028ebed8b/0x96d0c9b8c9a1b8c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.537682:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201085.537686:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028ebed8b/0x96d0c9b8c9a1b8c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.537694:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028ebed8b/0x96d0c9b8c9a1b8c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.537704:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028ebed8b/0x96d0c9b8c9a1b8c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.537710:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028ebed8b/0x96d0c9b8c9a1b8c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.537724:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.537726:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.537728:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201085.537762:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.537767:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1b8cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.537774:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32e:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:3.0:1788201085.537777:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.537781:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1b8cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.537790:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1b8cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.537802:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1b8cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.537810:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1b8cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.537820:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201085.539453:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.539462:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1b8d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.539474:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32d:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:3.0:1788201085.539478:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.539483:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1b8d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.539494:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1b8d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.539503:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1b8d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.539511:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1b8d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.539549:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201085.539559:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201085.539564:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1b8cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.539571:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064eca00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201085.539576:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1b8cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.539584:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1b8cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.539597:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1b8cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.539604:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1b8cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.539619:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201085.539622:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1b8d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.539628:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064edc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201085.539631:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1b8d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.539648:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1b8d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.539657:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1b8d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.539664:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1b8d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.539675:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.539676:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.539678:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201085.539719:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.539724:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae91ee5a/0x96d0c9b8c9a1b8d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.539732:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32c:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:3.0:1788201085.539736:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.539740:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae91ee5a/0x96d0c9b8c9a1b8d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.539749:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae91ee5a/0x96d0c9b8c9a1b8d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.539756:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae91ee5a/0x96d0c9b8c9a1b8d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.539767:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae91ee5a/0x96d0c9b8c9a1b8d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.539779:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201085.539785:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201085.539789:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae91ee5a/0x96d0c9b8c9a1b8d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.539795:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201085.539798:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae91ee5a/0x96d0c9b8c9a1b8d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.539806:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae91ee5a/0x96d0c9b8c9a1b8d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.539815:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae91ee5a/0x96d0c9b8c9a1b8d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.539821:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae91ee5a/0x96d0c9b8c9a1b8d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.541928:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201085.541947:0:26210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b87e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.542066:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.542451:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.542454:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.542456:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201085.542573:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.542587:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1b8e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.542600:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32b:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:3.0:1788201085.542604:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.542610:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1b8e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.542624:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1b8e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.542634:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1b8e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.542642:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1b8e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.542657:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201085.542693:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.542698:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dff0c9c0/0x96d0c9b8c9a1b8e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.542706:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32a:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:3.0:1788201085.542709:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.542713:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dff0c9c0/0x96d0c9b8c9a1b8e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.542722:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dff0c9c0/0x96d0c9b8c9a1b8e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.542735:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dff0c9c0/0x96d0c9b8c9a1b8e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.542742:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dff0c9c0/0x96d0c9b8c9a1b8e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.542754:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201085.542762:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201085.542767:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1b8e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.542775:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fdc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201085.542779:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1b8e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.542787:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1b8e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.542803:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1b8e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.542810:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1b8e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.542822:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201085.542831:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dff0c9c0/0x96d0c9b8c9a1b8e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.543380:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fc000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201085.543384:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dff0c9c0/0x96d0c9b8c9a1b8e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.543392:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dff0c9c0/0x96d0c9b8c9a1b8e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.543404:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dff0c9c0/0x96d0c9b8c9a1b8e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.543411:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dff0c9c0/0x96d0c9b8c9a1b8e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.543427:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.543428:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.543430:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201085.543481:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x329:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.543487:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ccbc01a/0x96d0c9b8c9a1b8ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.543495:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x329:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:3.0:1788201085.543498:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x329:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.543503:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ccbc01a/0x96d0c9b8c9a1b8ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.543628:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.544159:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ccbc01a/0x96d0c9b8c9a1b8ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.544167:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ccbc01a/0x96d0c9b8c9a1b8ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.544175:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ccbc01a/0x96d0c9b8c9a1b8ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.544984:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201085.545088:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x328:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.545096:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af862cf6/0x96d0c9b8c9a1b8f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.545106:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x328:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:3.0:1788201085.545109:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x328:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.545114:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af862cf6/0x96d0c9b8c9a1b8f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.545123:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af862cf6/0x96d0c9b8c9a1b8f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.545131:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af862cf6/0x96d0c9b8c9a1b8f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.545153:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af862cf6/0x96d0c9b8c9a1b8f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.546804:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201085.546816:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ccbc01a/0x96d0c9b8c9a1b8ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.546827:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fcc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201085.546840:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ccbc01a/0x96d0c9b8c9a1b8ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.546850:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ccbc01a/0x96d0c9b8c9a1b8ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.546899:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ccbc01a/0x96d0c9b8c9a1b8ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.546908:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ccbc01a/0x96d0c9b8c9a1b8ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.546932:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201085.546935:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af862cf6/0x96d0c9b8c9a1b8f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.546941:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201085.546944:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af862cf6/0x96d0c9b8c9a1b8f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.546951:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af862cf6/0x96d0c9b8c9a1b8f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.546960:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af862cf6/0x96d0c9b8c9a1b8f5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201085.546968:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201085.546969:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201085.546971:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.553415:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201085.553433:0:26202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af862cf6/0x96d0c9b8c9a1b8f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.553483:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201085.553610:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x327:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.553617:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000083d94f3/0x96d0c9b8c9a1b8fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.553632:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x327:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:3.0:1788201085.553637:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x327:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.553644:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000083d94f3/0x96d0c9b8c9a1b8fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.553658:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000083d94f3/0x96d0c9b8c9a1b8fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.553667:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000083d94f3/0x96d0c9b8c9a1b8fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.553675:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000083d94f3/0x96d0c9b8c9a1b8fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.553710:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201085.553752:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x326:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.553767:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f02c746/0x96d0c9b8c9a1b903 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.553775:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x326:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:3.0:1788201085.553778:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x326:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.553782:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f02c746/0x96d0c9b8c9a1b903 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.553791:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f02c746/0x96d0c9b8c9a1b903 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.553799:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f02c746/0x96d0c9b8c9a1b903 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.553805:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f02c746/0x96d0c9b8c9a1b903 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.553818:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201085.553824:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201085.553829:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000083d94f3/0x96d0c9b8c9a1b8fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.553848:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fce00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201085.553859:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000083d94f3/0x96d0c9b8c9a1b8fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.553869:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000083d94f3/0x96d0c9b8c9a1b8fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.553885:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000083d94f3/0x96d0c9b8c9a1b8fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.553892:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000083d94f3/0x96d0c9b8c9a1b8fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.553906:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201085.553909:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f02c746/0x96d0c9b8c9a1b903 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.553915:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fc800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201085.553918:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f02c746/0x96d0c9b8c9a1b903 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.553924:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f02c746/0x96d0c9b8c9a1b903 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.553932:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f02c746/0x96d0c9b8c9a1b903 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.553938:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f02c746/0x96d0c9b8c9a1b903 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.553953:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.553957:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.553958:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201085.553997:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x325:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.554001:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004755534c/0x96d0c9b8c9a1b90a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.554009:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x325:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:3.0:1788201085.554011:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x325:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.554038:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004755534c/0x96d0c9b8c9a1b90a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.554046:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004755534c/0x96d0c9b8c9a1b90a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.554054:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004755534c/0x96d0c9b8c9a1b90a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.554059:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004755534c/0x96d0c9b8c9a1b90a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.554071:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201085.554077:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201085.554081:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004755534c/0x96d0c9b8c9a1b90a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.554096:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201085.554099:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004755534c/0x96d0c9b8c9a1b90a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.554106:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004755534c/0x96d0c9b8c9a1b90a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.554117:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004755534c/0x96d0c9b8c9a1b90a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.554124:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004755534c/0x96d0c9b8c9a1b90a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.554136:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.554137:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.554139:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201085.554179:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x324:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201085.554184:0:26202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004309391d/0x96d0c9b8c9a1b911 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.554192:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x324:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:3.0:1788201085.554195:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x324:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201085.554199:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004309391d/0x96d0c9b8c9a1b911 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.554208:0:26202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004309391d/0x96d0c9b8c9a1b911 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.554221:0:26202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004309391d/0x96d0c9b8c9a1b911 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.554228:0:26202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004309391d/0x96d0c9b8c9a1b911 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.554239:0:26202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201085.554245:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201085.554249:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004309391d/0x96d0c9b8c9a1b911 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.554255:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201085.554258:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004309391d/0x96d0c9b8c9a1b911 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.554266:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004309391d/0x96d0c9b8c9a1b911 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.554275:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004309391d/0x96d0c9b8c9a1b911 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.554281:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004309391d/0x96d0c9b8c9a1b911 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201085.554303:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.554310:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201085.554312:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788201085.554338:0:26202:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:803 00000100:00100000:3.0:1788201085.554421:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:91117:x1875060715155328:12345-0@lo:5:osp-pre-1-0.0 Request processed in 65846us (65968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201085.554431:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5892 00000100:00100000:3.0:1788201085.554483:0:91117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00515c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:91117:1875060715155328:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788201085.554498:0:91117:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x341:0x0] from OST, last_created [0x2c0000401:0x341:0x0]last_used is [0x2c0000401:0x323:0x0] 00000100:00100000:3.0:1788201085.554576:0:91117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00515df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:91117:1875060715155712:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788201085.554609:0:91117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201085.554632:0:91117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc109062e40 going to sleep for 11 seconds 00010000:00010000:0.0:1788201085.554962:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201085.555350:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201085.555364:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00515c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715155584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201085.555403:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201085.555445:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715155712 00000100:00100000:3.0:1788201085.555451:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715155712 00000100:00100000:3.0:1788201085.555487:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5894 00000100:00100000:3.0:1788201085.555496:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:91117:x1875060715155712:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788201085.555544:0:26199:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 834 00000100:00100000:0.0:1788201085.555941:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715155584 00000100:00100000:0.0:1788201085.555958:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715155584 00000100:00100000:0.0:1788201085.555999:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2236 00000100:00100000:0.0:1788201085.556008:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715155584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201085.556041:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 896 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201085.556099:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715155584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201085.556105:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2236 00010000:00010000:2.0:1788201085.559548:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201085.559618:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00515c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715155584:0@lo:13:osp-pre-1-0.0 00002000:00010000:2.0:1788201085.559751:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x340:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.559760:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1b918 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.559775:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x340:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.559780:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x340:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.559786:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1b918 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.559801:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1b918 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.559810:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1b918 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.559818:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1b918 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.559909:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201085.559919:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.559925:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1b918 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.559944:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.559949:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1b918 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.559958:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1b918 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.559975:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1b918 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.559982:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1b918 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.560000:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.560002:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.560003:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201085.560122:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.560129:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1b91f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.560138:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33f:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.560142:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.560146:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1b91f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.560156:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1b91f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.560172:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1b91f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.560180:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1b91f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.560197:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201085.560206:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.560210:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1b91f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.560216:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.560219:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1b91f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.560226:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1b91f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.560235:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1b91f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.560242:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1b91f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.560253:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.560260:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.560262:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201085.561469:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:91117:x1875060715155712:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5969us (6855us total) trans 4294969453 rc 0/0 00000100:00100000:3.0:1788201085.561481:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5894 00000100:00100000:3.0:1788201085.561548:0:91117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00515df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:91117:1875060715155712:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788201085.561564:0:91117:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x341:0x0]-[0x2c0000401:0x361:0x0] 00002000:00010000:2.0:1788201085.561978:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.561985:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1b926 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.561998:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33e:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.562002:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.562007:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1b926 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.562031:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1b926 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.562040:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1b926 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.562047:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1b926 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.562064:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201085.562073:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.562078:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1b926 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.562086:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100031400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.562090:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1b926 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.562107:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1b926 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.562121:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1b926 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.562128:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1b926 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.562145:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.562146:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.562148:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201085.562212:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.562219:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1b92d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.562228:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33d:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.562232:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.562236:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1b92d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.562244:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1b92d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.562251:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1b92d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.562264:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1b92d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.562275:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201085.562282:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.564364:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1b92d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564385:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.564392:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1b92d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564403:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1b92d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564422:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1b92d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564430:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1b92d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564452:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.564454:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.564457:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201085.564568:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.564580:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1b934 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564591:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33c:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.564595:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.564601:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1b934 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564611:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1b934 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564620:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1b934 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564628:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1b934 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564647:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201085.564656:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.564661:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1b934 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564668:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.564671:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1b934 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564678:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1b934 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564695:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1b934 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564702:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1b934 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564715:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.564717:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.564719:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201085.564758:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.564763:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1b93b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564770:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33b:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.564773:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.564776:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1b93b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564784:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1b93b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564791:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1b93b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564797:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1b93b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564819:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201085.564826:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.564830:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1b93b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564849:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100031e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.564852:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1b93b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564861:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1b93b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564872:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1b93b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564879:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1b93b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564893:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.564894:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.564896:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201085.564936:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.564941:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1b942 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564948:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33a:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.564956:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.564960:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1b942 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564969:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1b942 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564977:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1b942 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564984:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1b942 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.564997:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201085.565004:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.565007:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1b942 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.565031:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.565035:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1b942 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.565043:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1b942 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.565053:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1b942 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.565070:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1b942 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.565084:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.565085:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.565087:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201085.565125:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x339:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.565131:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1b949 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.565138:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x339:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.565142:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x339:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.565146:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1b949 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.565154:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1b949 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.565162:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1b949 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.565169:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1b949 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.565181:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201085.565192:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.565196:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1b949 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.565203:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.565206:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1b949 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.565215:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1b949 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.565225:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1b949 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.565233:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1b949 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.565245:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.565246:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.565248:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201085.565285:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x338:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.568768:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1b950 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.568788:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x338:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.568793:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x338:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.568800:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1b950 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.568892:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1b950 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.568906:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1b950 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.568914:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1b950 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.568937:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201085.568954:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.568960:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1b950 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.568967:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.568972:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1b950 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.568982:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1b950 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.569000:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1b950 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.569008:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1b950 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.569056:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.569058:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.569061:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201085.569183:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x337:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.569190:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1b957 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.569199:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x337:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.569203:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x337:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.569208:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1b957 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.569217:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1b957 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.569226:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1b957 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.569235:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1b957 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.569251:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201085.569258:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.569262:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1b957 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.569279:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.569283:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1b957 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.569303:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1b957 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.569315:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1b957 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.569323:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1b957 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.569336:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.569338:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.569340:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201085.569386:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x336:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.569391:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1b95e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.569398:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x336:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.569400:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x336:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.569404:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1b95e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.569413:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1b95e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.569427:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1b95e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.569433:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1b95e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.569446:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201085.569454:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.569459:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1b95e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.569466:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.569469:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1b95e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.569476:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1b95e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.569488:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1b95e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.569495:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1b95e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.569507:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.569514:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.569516:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201085.569598:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201085.573258:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x335:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.573270:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1b965 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.573902:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x335:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.573909:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x335:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.573917:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1b965 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.573933:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1b965 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.573943:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1b965 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.573951:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1b965 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.573978:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201085.573995:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.574002:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1b965 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.574010:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.574077:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1b965 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.574100:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1b965 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.574116:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1b965 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.574122:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1b965 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.574138:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.574140:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.574142:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201085.574202:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x334:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.575540:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1b96c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.575554:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x334:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.575559:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x334:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.575565:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1b96c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.575577:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1b96c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.575586:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1b96c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.575600:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1b96c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.575621:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201085.575698:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x333:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.575703:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1b973 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.575712:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x333:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.575715:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x333:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.575719:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1b973 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.575727:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1b973 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.575736:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1b973 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.575743:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1b973 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.575760:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788201085.575769:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201085.575773:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1b96c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.575785:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.575789:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1b96c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.575798:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1b96c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.575811:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1b96c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.575818:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1b96c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.575844:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.575848:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1b973 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.575854:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adea00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.575858:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1b973 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.575865:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1b973 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.575874:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1b973 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.575886:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1b973 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.575898:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.575899:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.575901:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201085.575937:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x332:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.575941:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1b97a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.575949:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x332:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.575952:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x332:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.575956:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1b97a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.575965:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1b97a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.575972:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1b97a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.575979:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1b97a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.575989:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201085.576042:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x331:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.576047:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1b981 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576055:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x331:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.576058:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x331:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.576062:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1b981 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576071:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1b981 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576078:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1b981 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576086:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1b981 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576098:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788201085.576103:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201085.576107:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1b97a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576113:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfe00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.576116:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1b97a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576134:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1b97a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576143:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1b97a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576150:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1b97a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576162:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.576164:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1b981 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576171:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adee00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.576174:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1b981 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576182:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1b981 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576190:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1b981 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576197:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1b981 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576217:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.576219:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.576221:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201085.576259:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x330:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.576264:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1b988 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576271:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x330:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.576274:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x330:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.576278:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1b988 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576286:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1b988 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576294:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1b988 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576312:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1b988 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576324:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201085.576329:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.576332:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1b988 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576349:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.576352:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1b988 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576359:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1b988 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576369:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1b988 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576375:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1b988 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576387:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.576389:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.576390:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201085.576432:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.576438:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1b98f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576445:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32f:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.576448:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.576452:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1b98f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576460:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1b98f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576473:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1b98f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576480:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1b98f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576492:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201085.576498:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.576502:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1b98f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576509:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.576512:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1b98f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576519:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1b98f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576539:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1b98f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576547:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1b98f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576559:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.576565:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.576567:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201085.576601:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.576606:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1b996 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576614:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32e:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.576617:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.576621:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1b996 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576630:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1b996 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576637:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1b996 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576645:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1b996 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576655:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201085.576660:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.576663:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1b996 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576670:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.576673:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1b996 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576691:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1b996 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576701:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1b996 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576707:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1b996 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576718:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.576720:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.576721:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201085.576754:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.576759:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1b99d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576766:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32d:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.576769:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.576774:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1b99d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576782:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1b99d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576789:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1b99d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576800:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1b99d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576811:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201085.576816:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.576819:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1b99d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576826:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adec00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.576829:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1b99d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576837:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1b99d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576846:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1b99d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576853:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1b99d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576865:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.576867:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.576869:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201085.576907:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.576917:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1b9a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576925:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32c:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.576928:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.576932:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1b9a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576940:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1b9a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576947:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1b9a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576954:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1b9a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576965:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201085.576971:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.576975:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1b9a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576982:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.576985:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1b9a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.576993:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1b9a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577010:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1b9a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577038:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1b9a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577052:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.577053:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.577055:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201085.577091:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.577096:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1b9ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577104:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32b:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.577107:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.577111:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1b9ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577120:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1b9ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577127:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1b9ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577135:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1b9ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577155:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201085.577161:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.577164:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1b9ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577171:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfa00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.577174:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1b9ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577181:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1b9ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577192:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1b9ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577199:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1b9ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577211:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.577213:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.577214:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201085.577249:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.577253:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1b9b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577261:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32a:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.577268:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.577272:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1b9b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577281:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1b9b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577289:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1b9b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577296:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1b9b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577308:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201085.577314:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.577317:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1b9b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577323:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.577326:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1b9b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577334:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1b9b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577344:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1b9b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577361:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1b9b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577373:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.577375:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.577377:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201085.577413:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x329:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.577418:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b9b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577426:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x329:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.577429:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x329:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.577433:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b9b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577442:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b9b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577449:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b9b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577456:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b9b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577467:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201085.577476:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.577480:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b9b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577487:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100031200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.577490:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b9b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577498:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b9b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577507:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b9b9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577513:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1b9b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577538:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.577540:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.577541:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201085.577581:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x328:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.577586:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a33625e/0x96d0c9b8c9a1b9c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577593:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x328:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.577595:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x328:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.577599:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a33625e/0x96d0c9b8c9a1b9c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577617:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a33625e/0x96d0c9b8c9a1b9c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577624:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a33625e/0x96d0c9b8c9a1b9c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577630:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a33625e/0x96d0c9b8c9a1b9c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577641:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201085.577648:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.577652:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a33625e/0x96d0c9b8c9a1b9c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577659:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc005da6400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.577661:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a33625e/0x96d0c9b8c9a1b9c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577668:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a33625e/0x96d0c9b8c9a1b9c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577676:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a33625e/0x96d0c9b8c9a1b9c0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577682:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a33625e/0x96d0c9b8c9a1b9c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577707:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.577708:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.577709:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201085.577748:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x327:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.577752:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026732ca5/0x96d0c9b8c9a1b9c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577760:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x327:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.577762:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x327:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.577766:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026732ca5/0x96d0c9b8c9a1b9c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577775:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026732ca5/0x96d0c9b8c9a1b9c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577782:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026732ca5/0x96d0c9b8c9a1b9c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577789:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026732ca5/0x96d0c9b8c9a1b9c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577803:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201085.577810:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.577814:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026732ca5/0x96d0c9b8c9a1b9c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577833:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc005da7400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.577837:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026732ca5/0x96d0c9b8c9a1b9c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577845:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026732ca5/0x96d0c9b8c9a1b9c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577855:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026732ca5/0x96d0c9b8c9a1b9c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577863:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026732ca5/0x96d0c9b8c9a1b9c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577878:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.577880:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.577882:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201085.577922:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x326:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.577927:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dedf1ff/0x96d0c9b8c9a1b9ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577935:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x326:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.577938:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x326:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.577941:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dedf1ff/0x96d0c9b8c9a1b9ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577950:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dedf1ff/0x96d0c9b8c9a1b9ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577963:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dedf1ff/0x96d0c9b8c9a1b9ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577970:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dedf1ff/0x96d0c9b8c9a1b9ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577981:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201085.577988:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.577992:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dedf1ff/0x96d0c9b8c9a1b9ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.577998:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc005da7c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.578001:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dedf1ff/0x96d0c9b8c9a1b9ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578007:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dedf1ff/0x96d0c9b8c9a1b9ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578035:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dedf1ff/0x96d0c9b8c9a1b9ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578042:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dedf1ff/0x96d0c9b8c9a1b9ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578053:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.578059:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.578062:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201085.578103:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x325:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.578108:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bf27744/0x96d0c9b8c9a1b9d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578115:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x325:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.578118:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x325:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.578122:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bf27744/0x96d0c9b8c9a1b9d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578130:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bf27744/0x96d0c9b8c9a1b9d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578137:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bf27744/0x96d0c9b8c9a1b9d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578144:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bf27744/0x96d0c9b8c9a1b9d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578156:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201085.578161:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.578165:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bf27744/0x96d0c9b8c9a1b9d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578171:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc005da6600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.578175:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bf27744/0x96d0c9b8c9a1b9d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578192:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bf27744/0x96d0c9b8c9a1b9d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578203:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bf27744/0x96d0c9b8c9a1b9d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578210:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bf27744/0x96d0c9b8c9a1b9d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578222:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.578223:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.578225:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201085.578299:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x324:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.578304:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f8d7d07/0x96d0c9b8c9a1b9dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578312:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x324:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.578315:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x324:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.578319:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f8d7d07/0x96d0c9b8c9a1b9dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578328:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f8d7d07/0x96d0c9b8c9a1b9dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578336:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f8d7d07/0x96d0c9b8c9a1b9dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578348:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f8d7d07/0x96d0c9b8c9a1b9dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578360:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201085.578367:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.578370:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f8d7d07/0x96d0c9b8c9a1b9dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578377:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc005da6800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.578380:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f8d7d07/0x96d0c9b8c9a1b9dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578388:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f8d7d07/0x96d0c9b8c9a1b9dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578397:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f8d7d07/0x96d0c9b8c9a1b9dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578404:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f8d7d07/0x96d0c9b8c9a1b9dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578415:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.578417:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.578418:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201085.578450:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x323:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201085.578458:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d23757ed/0x96d0c9b8c9a1b9e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578466:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x323:0x0].0x0 since=3937s v=(0 0) 00010000:00010000:2.0:1788201085.578469:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x323:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201085.578473:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d23757ed/0x96d0c9b8c9a1b9e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578481:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d23757ed/0x96d0c9b8c9a1b9e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578489:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d23757ed/0x96d0c9b8c9a1b9e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578496:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d23757ed/0x96d0c9b8c9a1b9e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578506:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201085.578511:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201085.578514:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d23757ed/0x96d0c9b8c9a1b9e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.578519:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc005da6e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201085.578522:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d23757ed/0x96d0c9b8c9a1b9e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201085.578822:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201085.578936:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788201085.585665:0:26210:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:802 00000100:00100000:0.0:1788201085.585776:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:91115:x1875060715155456:12345-0@lo:5:osp-pre-0-0.0 Request processed in 96242us (96327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201085.585789:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5893 00000100:00100000:0.0:1788201085.585854:0:91115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab54a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:91115:1875060715155456:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788201085.585869:0:91115:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x341:0x0] from OST, last_created [0x280000401:0x341:0x0]last_used is [0x280000401:0x322:0x0] 00000100:00100000:0.0:1788201085.585939:0:91115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:91115:1875060715155968:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788201085.585978:0:91115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201085.586001:0:91115:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038e0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201085.586036:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715155840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201085.586062:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201085.586103:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715155968 00000100:00100000:0.0:1788201085.586110:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715155968 00000100:00100000:0.0:1788201085.586152:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5895 00000100:00100000:0.0:1788201085.586161:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:91115:x1875060715155968:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788201085.586195:0:8491:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 834 00000100:00100000:0.0:1788201085.587869:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:91115:x1875060715155968:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1704us (1886us total) trans 4294969454 rc 0/0 00000100:00100000:0.0:1788201085.587888:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5895 00000100:00100000:0.0:1788201085.587926:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715155840 00000100:00100000:0.0:1788201085.587932:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715155840 00000100:00100000:0.0:1788201085.587963:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2237 00000100:00100000:0.0:1788201085.587971:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715155840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201085.587988:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788201085.588043:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715155840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (1979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201085.588049:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2237 00000100:00100000:0.0:1788201085.588095:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715155840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201085.588129:0:91115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:91115:1875060715155968:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788201085.588139:0:91115:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x341:0x0]-[0x280000401:0x361:0x0] 00010000:00010000:2.0:1788201085.590470:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d23757ed/0x96d0c9b8c9a1b9e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.590508:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d23757ed/0x96d0c9b8c9a1b9e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.590516:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d23757ed/0x96d0c9b8c9a1b9e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201085.590553:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.590555:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201085.590558:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201085.654256:0:91383:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788201085.717596:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201086.287575:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715156096:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201086.287668:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201086.287883:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715156096 00000100:00100000:1.0:1788201086.287892:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715156096 00000100:00100000:1.0:1788201086.287952:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2238 00000100:00100000:1.0:1788201086.287962:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715156096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201086.287986:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788201086.288079:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715156096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201086.288086:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2238 00000100:00100000:3.0:1788201086.288283:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715156096:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201086.290191:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715156224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201086.290259:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201086.290436:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715156224 00000100:00100000:3.0:1788201086.290443:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715156224 00000100:00100000:3.0:1788201086.290496:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2239 00000100:00100000:3.0:1788201086.290504:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715156224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201086.290531:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201086.290569:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715156224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201086.290576:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2239 00000100:00100000:0.0:1788201086.290687:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715156224:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788201086.736984:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788201086.885493:0:91435:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788201086.885751:0:91435:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788201087.769165:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788201087.814383:0:91486:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788201087.814649:0:91486:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788201088.785203:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201089.808386:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201090.383870:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715156480:0@lo:400:kworker.0 00000100:00100000:0.0:1788201090.383948:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201090.383982:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715156992:0@lo:400:kworker.0 00000100:00100000:0.0:1788201090.384010:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201090.384063:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715157504:0@lo:400:kworker.0 00000100:00100000:0.0:1788201090.384107:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201090.384131:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788201090.384138:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715156352:0@lo:400:kworker.0 00000100:00100000:0.0:1788201090.384164:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201090.384187:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715156864:0@lo:400:kworker.0 00000100:00100000:0.0:1788201090.384219:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201090.384235:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715157376:0@lo:400:kworker.0 00000100:00100000:0.0:1788201090.384254:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201090.384268:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715157888:0@lo:400:kworker.0 00000100:00100000:0.0:1788201090.384290:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201090.384314:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12014c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715156736:0@lo:400:kworker.0 00000100:00100000:0.0:1788201090.384335:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201090.384348:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715157248:0@lo:400:kworker.0 00000100:00100000:0.0:1788201090.384369:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201090.384382:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715157760:0@lo:400:kworker.0 00000100:00100000:0.0:1788201090.384399:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201090.384414:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788201090.384418:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715156608:0@lo:400:kworker.0 00000100:00100000:0.0:1788201090.384437:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201090.384460:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715157120:0@lo:400:kworker.0 00000100:00100000:0.0:1788201090.384479:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201090.384495:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715157632:0@lo:400:kworker.0 00000100:00100000:0.0:1788201090.384513:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201090.384543:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715156480 00000100:00100000:0.0:1788201090.384557:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715156480 00000100:00100000:0.0:1788201090.384605:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715156864 00000100:00100000:0.0:1788201090.384608:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715156864 00000100:00100000:0.0:1788201090.384620:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715157376 00000100:00100000:0.0:1788201090.384622:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715157376 00000100:00100000:0.0:1788201090.384630:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715157888 00000100:00100000:0.0:1788201090.384632:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715157888 00000100:00100000:0.0:1788201090.384639:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715156736 00000100:00100000:0.0:1788201090.384641:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715156736 00000100:00100000:0.0:1788201090.384650:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715156608 00000100:00100000:0.0:1788201090.384652:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715156608 00000100:00100000:0.0:1788201090.384664:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:0.0:1788201090.384671:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10318b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715156480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201090.384716:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10318b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715156480:12345-0@lo:400:kworker.0 Request processed in 45us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201090.384723:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:0.0:1788201090.385956:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:0.0:1788201090.385971:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715156864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201090.386051:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715156864:12345-0@lo:400:kworker.0 Request processed in 84us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201090.386057:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:0.0:1788201090.386074:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:0.0:1788201090.386082:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715157376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201090.386111:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715157376:12345-0@lo:400:kworker.0 Request processed in 31us (1856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201090.386117:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00100000:0.0:1788201090.386129:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:0.0:1788201090.386134:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715157888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201090.386171:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715157888:12345-0@lo:400:kworker.0 Request processed in 36us (1880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201090.386176:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00000100:00100000:0.0:1788201090.386189:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:0.0:1788201090.386195:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715156736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201090.386231:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715156736:12345-0@lo:400:kworker.0 Request processed in 36us (1894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201090.386236:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00100000:0.0:1788201090.386251:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1788201090.386258:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715156608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201090.386284:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715156608:12345-0@lo:400:kworker.0 Request processed in 27us (1846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201090.386289:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1788201090.386315:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715156992 00000100:00100000:0.0:1788201090.386321:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715156992 00000100:00100000:0.0:1788201090.386348:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715157504 00000100:00100000:0.0:1788201090.386350:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715157504 00000100:00100000:0.0:1788201090.386364:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3944 00000100:00100000:0.0:1788201090.386371:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715156992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201090.386402:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715156992:12345-0@lo:400:kworker.0 Request processed in 31us (2392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201090.386408:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3944 00000100:00100000:0.0:1788201090.386418:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3945 00000100:00100000:0.0:1788201090.386423:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715157504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201090.386942:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715156352 00000100:00100000:1.0:1788201090.386947:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715156352 00000100:00100000:1.0:1788201090.386979:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788201090.386986:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715156352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201090.387053:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715156352:12345-0@lo:400:kworker.0 Request processed in 68us (2888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201090.387059:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788201090.387129:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201090.387133:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201090.387145:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715157248 00000100:00100000:1.0:1788201090.387149:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715157248 00000100:00100000:1.0:1788201090.387181:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715157760 00000100:00100000:1.0:1788201090.387185:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715157760 00000100:00100000:1.0:1788201090.387212:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715157120 00000100:00100000:1.0:1788201090.387216:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715157120 00000100:00100000:1.0:1788201090.387236:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715157632 00000100:00100000:1.0:1788201090.387239:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715157632 00000100:00100000:1.0:1788201090.387258:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2768 00000100:00100000:1.0:1788201090.387265:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715157248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201090.387310:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715157248:12345-0@lo:400:kworker.0 Request processed in 46us (2939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201090.387316:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2768 00000100:00100000:1.0:1788201090.387329:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2769 00000100:00100000:1.0:1788201090.387336:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715157760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201090.387363:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715157760:12345-0@lo:400:kworker.0 Request processed in 29us (2963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201090.387369:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2769 00000100:00100000:1.0:1788201090.387381:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2770 00000100:00100000:1.0:1788201090.387387:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715157120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201090.387413:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715157120:12345-0@lo:400:kworker.0 Request processed in 27us (2933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201090.387419:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2770 00000100:00100000:1.0:1788201090.387430:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2771 00000100:00100000:1.0:1788201090.387436:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715157632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201090.387479:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715157632:12345-0@lo:400:kworker.0 Request processed in 44us (2964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201090.387485:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2771 00000100:00080000:1.0:1788201090.387518:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201090.387522:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201090.387544:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715158016:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201090.387580:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201090.387619:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715156352:0@lo:400:kworker.0 00000100:00100000:1.0:1788201090.387636:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715156864:0@lo:400:kworker.0 00000100:00100000:1.0:1788201090.387659:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715157376:0@lo:400:kworker.0 00000100:00100000:1.0:1788201090.387674:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715157888:0@lo:400:kworker.0 00000100:00100000:1.0:1788201090.387685:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715156480:0@lo:400:kworker.0 00000100:00100000:1.0:1788201090.387694:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715156992:0@lo:400:kworker.0 00000100:00100000:2.0:1788201090.387812:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715156608:0@lo:400:kworker.0 00000100:00100000:2.0:1788201090.387824:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715157120:0@lo:400:kworker.0 00000100:00100000:2.0:1788201090.387835:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715157632:0@lo:400:kworker.0 00000100:00100000:2.0:1788201090.387846:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12014c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715156736:0@lo:400:kworker.0 00000100:00100000:2.0:1788201090.387854:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715157248:0@lo:400:kworker.0 00000100:00100000:2.0:1788201090.387864:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715157760:0@lo:400:kworker.0 00000100:00100000:3.0:1788201090.388369:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715158016 00000100:00100000:3.0:1788201090.388376:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715158016 00000100:00100000:3.0:1788201090.388403:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3946 00000100:00100000:3.0:1788201090.388411:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715158016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788201090.388438:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:3.0:1788201090.388494:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715158016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201090.388501:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3946 00000100:00100000:0.0:1788201090.396692:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715157504:12345-0@lo:400:kworker.0 Request processed in 10256us (12573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201090.396724:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3945 00000100:00100000:1.0:1788201090.406525:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715157504:0@lo:400:kworker.0 00000100:00100000:1.0:1788201090.406606:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715158016:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201090.510160:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201090.511009:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695383040 00000100:00100000:0.0:1788201090.511051:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695383040 00000100:00100000:0.0:1788201090.511139:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1295 00000100:00100000:0.0:1788201090.511150:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+7:69907:x1875060695383040:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788201090.511171:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201090.511193:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339e00/0x96d0c9b8c9a1b9ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7866f8 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201090.511269:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b9f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201090.511284:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201090.511295:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201090.511344:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201090.511348:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201090.511387:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201090.511424:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339e00/0x96d0c9b8c9a1b9ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866f8 expref: 9 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201090.511470:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b9f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866f8 expref: 8 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201090.511497:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048bed00) 00010000:00010000:0.0:1788201090.511500:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201090.511503:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12f338600, rc 0) 00000100:00100000:0.0:1788201090.511568:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+8:69907:x1875060695383040:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 420us (1417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201090.511575:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1295 00000100:00080000:1.0:1788201090.517672:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201090.518267:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201090.518383:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695383168 00000100:00100000:1.0:1788201090.518392:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695383168 00000100:00100000:1.0:1788201090.518471:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1296 00000100:00100000:1.0:1788201090.518481:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+8:69907:x1875060695383168:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:1.0:1788201090.518517:0:66313:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444966400 avail 1298726912 00000100:00100000:1.0:1788201090.518592:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+8:69907:x1875060695383168:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 112us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201090.518600:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1296 00000100:00100000:3.0:1788201090.528448:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201090.528492:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201090.528527:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201090.528556:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201090.528591:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695383552 00000100:00100000:3.0:1788201090.528601:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695383552 00000100:00100000:3.0:1788201090.528654:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695383680 00000100:00100000:3.0:1788201090.528657:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695383680 00000100:00100000:3.0:1788201090.528704:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2772 00000100:00100000:3.0:1788201090.528713:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695383552:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201090.528965:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695383552:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 250us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201090.528973:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2772 00000100:00100000:3.0:1788201090.528994:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2773 00000100:00100000:3.0:1788201090.529003:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:4292087e-fa00-4621-b681-837afc99ae35+7:2401:x1875060695383680:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201090.529063:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:4292087e-fa00-4621-b681-837afc99ae35+7:2401:x1875060695383680:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 61us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201090.529070:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2773 00000100:00080000:3.0:1788201090.529090:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201090.529094:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201090.529683:0:91107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695383296 00000100:00100000:2.0:1788201090.529689:0:91107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695383296 00000100:00100000:2.0:1788201090.529730:0:91107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 75 00000100:00100000:2.0:1788201090.529749:0:91107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695383296:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201090.529794:0:91107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695383296:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 46us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201090.529800:0:91107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 75 00000100:00100000:0.0:1788201090.531000:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695383424 00000100:00100000:0.0:1788201090.531009:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695383424 00000100:00100000:0.0:1788201090.531090:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1326 00000100:00100000:0.0:1788201090.531099:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695383424:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201090.531155:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695383424:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 57us (2627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201090.531161:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1326 00000100:00080000:3.0:1788201090.532102:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201090.533049:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201090.533176:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695383808 00000100:00100000:2.0:1788201090.533184:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695383808 00000100:00100000:1.0:1788201090.533253:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1297 00000100:00100000:1.0:1788201090.533265:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:69907:x1875060695383808:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:1.0:1788201090.533299:0:66313:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:1.0:1788201090.533364:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:69907:x1875060695383808:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 100us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201090.533371:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1297 00000100:00100000:2.0:1788201090.549089:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201090.549748:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695383936 00000100:00100000:0.0:1788201090.549769:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695383936 00000100:00100000:0.0:1788201090.549843:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2240 00000100:00100000:0.0:1788201090.549854:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+6:69907:x1875060695383936:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:0.0:1788201090.549893:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788201090.549978:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+6:69907:x1875060695383936:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 126us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201090.549985:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2240 00000100:00100000:2.0:1788201090.553548:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201090.555612:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695384064 00000100:00100000:0.0:1788201090.555642:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695384064 00000100:00100000:0.0:1788201090.555719:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2241 00000100:00100000:0.0:1788201090.555730:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+7:69907:x1875060695384064:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:0.0:1788201090.555773:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201090.555860:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+7:69907:x1875060695384064:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 131us (2322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201090.555867:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2241 00010000:00010000:3.0:1788201090.832202:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201090.895888:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201090.895913:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715158144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201090.895985:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201090.896235:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715158144 00000100:00100000:3.0:1788201090.896244:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715158144 00000100:00100000:3.0:1788201090.896300:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2242 00000100:00100000:3.0:1788201090.896310:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715158144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201090.896332:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201090.896379:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715158144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201090.896385:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2242 00000100:00100000:2.0:1788201090.896483:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715158144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201090.896552:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715158400:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201090.896581:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201090.896745:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715158272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201090.896783:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201090.896945:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715158272 00000100:00100000:2.0:1788201090.896950:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715158272 00000100:00100000:2.0:1788201090.896987:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2243 00000100:00100000:2.0:1788201090.896994:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715158272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201090.897006:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788201090.897070:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715158272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201090.897076:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2243 00000100:00100000:2.0:1788201090.897106:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715158272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201090.897531:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715158400 00000100:00100000:0.0:1788201090.897536:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715158400 00000100:00100000:0.0:1788201090.897575:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3947 00000100:00100000:0.0:1788201090.897583:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715158400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201090.897608:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444966400 avail 1298726912 00000100:00100000:0.0:1788201090.897659:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715158400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201090.897666:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3947 00000100:00100000:2.0:1788201090.897869:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715158400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201091.408274:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715158528:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201091.408355:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201091.409984:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715158656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201091.410058:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201091.410498:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715158528 00000100:00100000:1.0:1788201091.410512:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715158528 00000100:00100000:1.0:1788201091.410565:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715158656 00000100:00100000:1.0:1788201091.410577:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715158656 00000100:00100000:1.0:1788201091.410596:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2244 00000100:00100000:1.0:1788201091.410605:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715158528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201091.410627:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788201091.410685:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715158528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (2330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201091.410692:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2244 00000100:00100000:1.0:1788201091.410709:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2245 00000100:00100000:1.0:1788201091.410714:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715158656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201091.410723:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201091.410754:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715158656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201091.410760:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2245 00000100:00100000:3.0:1788201091.411376:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715158656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201091.415658:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715158528:0@lo:13:osp-pre-0-1.0 00000001:00080000:1.0:1788201091.421956:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969454 is committed 00000001:00080000:3.0:1788201091.425619:0:9526:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969453 is committed 00010000:00010000:1.0:1788201091.855314:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201092.879425:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201093.908629:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201094.933320:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201095.503299:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201095.504394:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715158912:0@lo:400:kworker.0 00000100:00100000:0.0:1788201095.504468:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201095.504515:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201095.504522:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715159040:0@lo:400:kworker.0 00000100:00100000:0.0:1788201095.504561:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201095.504596:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715158912 00000100:00100000:0.0:1788201095.504603:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715158912 00000100:00100000:0.0:1788201095.504642:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788201095.504651:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715158912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201095.504698:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715158912:12345-0@lo:400:kworker.0 Request processed in 48us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201095.504721:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788201095.504767:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715158912:0@lo:400:kworker.0 00000100:00100000:0.0:1788201095.504800:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715159040 00000100:00100000:0.0:1788201095.504804:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715159040 00000100:00100000:0.0:1788201095.504838:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:0.0:1788201095.504845:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715159040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201095.504876:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715159040:12345-0@lo:400:kworker.0 Request processed in 32us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201095.504882:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000100:00080000:0.0:1788201095.504897:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201095.504920:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715159040:0@lo:400:kworker.0 00000100:00100000:0.0:1788201095.507473:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715159168:0@lo:400:kworker.0 00000100:00100000:0.0:1788201095.508082:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201095.508209:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715159168 00000100:00100000:1.0:1788201095.508218:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715159168 00000100:00100000:1.0:1788201095.508278:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:1.0:1788201095.508288:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715159168:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788201095.508367:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201095.508476:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715158784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201095.508656:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715159424:0@lo:400:kworker.0 00000100:00100000:3.0:1788201095.508766:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715159296:0@lo:400:kworker.0 00000100:00100000:1.0:1788201095.508830:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715159168:12345-0@lo:400:kworker.0 Request processed in 543us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201095.508838:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:1.0:1788201095.508861:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715159552:0@lo:400:kworker.0 00000100:00100000:1.0:1788201095.508888:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201095.508908:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715160064:0@lo:400:kworker.0 00000100:00100000:1.0:1788201095.508941:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201095.508984:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715159552 00000100:00100000:1.0:1788201095.508988:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715159552 00000100:00100000:1.0:1788201095.509010:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715160064 00000100:00100000:1.0:1788201095.509013:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715160064 00000100:00100000:1.0:1788201095.509052:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3948 00000100:00100000:1.0:1788201095.509059:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a441500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715159552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201095.509095:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a441500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715159552:12345-0@lo:400:kworker.0 Request processed in 37us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201095.509102:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3948 00000100:00100000:1.0:1788201095.509126:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3949 00000100:00100000:1.0:1788201095.509132:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715160064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201095.509158:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715160064:12345-0@lo:400:kworker.0 Request processed in 26us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201095.509163:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3949 00000100:00100000:1.0:1788201095.509201:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715159552:0@lo:400:kworker.0 00000100:00100000:1.0:1788201095.509211:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715160064:0@lo:400:kworker.0 00000100:00100000:0.0:1788201095.512954:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201095.513009:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715159680:0@lo:400:kworker.0 00000100:00100000:0.0:1788201095.513067:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201095.513092:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715160192:0@lo:400:kworker.0 00000100:00100000:0.0:1788201095.513174:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201095.513222:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715159168:0@lo:400:kworker.0 00000100:00100000:0.0:1788201095.513262:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715159680 00000100:00100000:0.0:1788201095.513267:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715159680 00000100:00100000:0.0:1788201095.513322:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715160192 00000100:00100000:0.0:1788201095.513325:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715160192 00000100:00100000:0.0:1788201095.513375:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2774 00000100:00100000:0.0:1788201095.513452:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715159680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201095.513500:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715159680:12345-0@lo:400:kworker.0 Request processed in 51us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201095.513506:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2774 00000100:00100000:0.0:1788201095.513521:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2775 00000100:00100000:0.0:1788201095.513527:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715160192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201095.513620:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715160192:12345-0@lo:400:kworker.0 Request processed in 93us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201095.513626:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2775 00000100:00100000:0.0:1788201095.513653:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715159680:0@lo:400:kworker.0 00000100:00100000:0.0:1788201095.513660:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969454 gen 2 00000100:00100000:0.0:1788201095.513674:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715160192:0@lo:400:kworker.0 00000100:00080000:0.0:1788201095.513713:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201095.513843:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715158784 00000100:00100000:1.0:1788201095.513847:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715158784 00000100:00100000:1.0:1788201095.513880:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3950 00000100:00100000:1.0:1788201095.513888:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715158784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201095.513913:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:1.0:1788201095.513947:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715158784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201095.513953:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3950 00000100:00100000:2.0:1788201095.514042:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201095.514071:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715159936:0@lo:400:kworker.0 00000100:00100000:2.0:1788201095.514095:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201095.514110:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715160448:0@lo:400:kworker.0 00000100:00100000:2.0:1788201095.514143:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201095.514259:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715159424 00000100:00100000:1.0:1788201095.514269:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715159424 00000100:00100000:1.0:1788201095.514307:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715159936 00000100:00100000:1.0:1788201095.514311:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715159936 00000100:00100000:1.0:1788201095.514324:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715160448 00000100:00100000:1.0:1788201095.514325:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715160448 00000100:00100000:1.0:1788201095.514338:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:1.0:1788201095.514345:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715159424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201095.514398:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715159424:12345-0@lo:400:kworker.0 Request processed in 54us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201095.514404:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00100000:1.0:1788201095.514417:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:1.0:1788201095.514424:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715159936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201095.514449:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715159936:12345-0@lo:400:kworker.0 Request processed in 26us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201095.514455:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:1.0:1788201095.514464:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:1.0:1788201095.514469:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715160448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201095.514492:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715160448:12345-0@lo:400:kworker.0 Request processed in 23us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201095.514498:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00080000:2.0:1788201095.516082:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201095.516140:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715159424:0@lo:400:kworker.0 00000100:00100000:2.0:1788201095.516155:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715159936:0@lo:400:kworker.0 00000100:00100000:2.0:1788201095.516165:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715160448:0@lo:400:kworker.0 00000100:00100000:0.0:1788201095.516667:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715158784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201095.518270:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201095.518319:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715159808:0@lo:400:kworker.0 00000100:00100000:3.0:1788201095.518367:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201095.518526:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715159296 00000100:00100000:1.0:1788201095.518542:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715159296 00000100:00100000:1.0:1788201095.518608:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:1.0:1788201095.518616:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715159296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201095.518665:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715159296:12345-0@lo:400:kworker.0 Request processed in 49us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201095.518671:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:3.0:1788201095.519418:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715160320:0@lo:400:kworker.0 00000100:00100000:3.0:1788201095.519447:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788201095.519492:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201095.523712:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715159296:0@lo:400:kworker.0 00000100:00100000:0.0:1788201095.525453:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715159808 00000100:00100000:0.0:1788201095.525465:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715159808 00000100:00100000:0.0:1788201095.525653:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715160320 00000100:00100000:0.0:1788201095.525657:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715160320 00000100:00100000:1.0:1788201095.525705:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2776 00000100:00100000:1.0:1788201095.525720:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715159808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201095.525810:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715159808:12345-0@lo:400:kworker.0 Request processed in 94us (7441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201095.525818:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2776 00000100:00100000:2.0:1788201095.529207:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715159808:0@lo:400:kworker.0 00000100:00080000:3.0:1788201095.530626:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201095.533148:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2777 00000100:00100000:0.0:1788201095.533165:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715160320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201095.533262:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715160320:12345-0@lo:400:kworker.0 Request processed in 102us (13813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201095.533269:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2777 00000100:00100000:3.0:1788201095.533427:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969453 gen 2 00000100:00100000:3.0:1788201095.533445:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715160320:0@lo:400:kworker.0 00000100:00100000:0.0:1788201095.650557:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201095.650666:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201095.650720:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201095.650750:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201095.650811:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695384576 00000100:00100000:2.0:1788201095.650821:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695384576 00000100:00100000:2.0:1788201095.650875:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2778 00000100:00100000:2.0:1788201095.650885:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695384576:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201095.650946:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:4292087e-fa00-4621-b681-837afc99ae35+6:2400:x1875060695384576:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 63us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201095.650954:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2778 00000100:00080000:2.0:1788201095.651100:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201095.653053:0:91107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695384192 00000100:00100000:3.0:1788201095.653065:0:91107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695384192 00000100:00100000:3.0:1788201095.653116:0:91107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 77 00000100:00100000:3.0:1788201095.653125:0:91107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695384192:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201095.653184:0:91107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695384192:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 59us (2464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201095.653191:0:91107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 77 00000100:00100000:0.0:1788201095.654120:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201095.654148:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695384704 00000100:00100000:0.0:1788201095.654153:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695384704 00000100:00100000:0.0:1788201095.654196:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2779 00000100:00100000:0.0:1788201095.654205:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4292087e-fa00-4621-b681-837afc99ae35+7:2401:x1875060695384704:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201095.654376:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4292087e-fa00-4621-b681-837afc99ae35+7:2401:x1875060695384704:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 172us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201095.654383:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2779 00000100:00100000:1.0:1788201095.654674:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695384320 00000100:00100000:1.0:1788201095.654679:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695384320 00000100:00100000:1.0:1788201095.654713:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695384448 00000100:00100000:1.0:1788201095.654716:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695384448 00000100:00100000:1.0:1788201095.654738:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1333 00000100:00100000:1.0:1788201095.654745:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+8:2400:x1875060695384320:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201095.654779:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+8:2400:x1875060695384320:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 35us (4231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201095.654786:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1333 00000100:00100000:1.0:1788201095.654799:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1334 00000100:00100000:1.0:1788201095.654804:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695384448:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201095.654822:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695384448:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 19us (4073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201095.654827:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1334 00000100:00080000:2.0:1788201095.657171:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201095.657192:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201095.657196:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788201095.951265:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201096.017122:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201096.017129:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00714ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715160576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201096.017141:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715160704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201096.017249:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715160832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201096.026168:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201096.026235:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715160704 00000100:00100000:1.0:1788201096.026246:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715160704 00000100:00100000:1.0:1788201096.026313:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2246 00000100:00100000:1.0:1788201096.026323:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715160704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201096.026382:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788201096.026435:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715160704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201096.026455:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2246 00000100:00100000:2.0:1788201096.029282:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715160704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201096.035817:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201096.035982:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715160576 00000100:00100000:1.0:1788201096.035992:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715160576 00000100:00100000:1.0:1788201096.036076:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3951 00000100:00100000:1.0:1788201096.036087:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13c270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715160576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201096.036124:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444966400 avail 1298726912 00000100:00100000:1.0:1788201096.036195:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13c270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715160576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201096.036202:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3951 00000100:00100000:2.0:1788201096.036606:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00714ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715160576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201096.039728:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201096.049048:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715160832 00000100:00100000:0.0:1788201096.049063:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715160832 00000100:00100000:1.0:1788201096.049277:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2247 00000100:00100000:1.0:1788201096.049289:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715160832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201096.049332:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201096.049435:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715160832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (9713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201096.049443:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2247 00000100:00100000:3.0:1788201096.049754:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715160832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201096.529550:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201096.529579:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715160960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201096.529656:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201096.529842:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715160960 00000100:00100000:3.0:1788201096.529851:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715160960 00000100:00100000:1.0:1788201096.529997:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2248 00000100:00100000:1.0:1788201096.530008:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715160960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201096.530048:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201096.530116:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715160960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201096.530123:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2248 00000100:00100000:0.0:1788201096.530280:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715160960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201096.537311:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a441500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715161088:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201096.537401:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201096.537515:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715161088 00000100:00100000:1.0:1788201096.537536:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715161088 00000100:00100000:1.0:1788201096.537589:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2249 00000100:00100000:1.0:1788201096.537598:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715161088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201096.537620:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788201096.537669:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715161088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201096.537676:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2249 00000100:00100000:2.0:1788201096.538083:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a441500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715161088:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788201096.975765:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201097.590440:0:91680:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:3.0:1788201098.002499:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201099.023347:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201099.624138:0:91728:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1788201100.047394:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201100.623437:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715161216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201100.623554:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201100.623926:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00714fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715161344:0@lo:400:kworker.0 00000100:00100000:1.0:1788201100.623940:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715161216 00000100:00100000:1.0:1788201100.623951:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715161216 00000100:00100000:3.0:1788201100.624007:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201100.624065:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3952 00000100:00100000:1.0:1788201100.624085:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715161216:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201100.624095:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cf31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715161856:0@lo:400:kworker.0 00000100:00100000:3.0:1788201100.624123:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1788201100.624125:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:3.0:1788201100.624157:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715162368:0@lo:400:kworker.0 00000100:00100000:1.0:1788201100.624201:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715161216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201100.624203:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201100.624219:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3952 00000100:00100000:3.0:1788201100.624237:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788201100.624243:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715161728:0@lo:400:kworker.0 00000100:00100000:3.0:1788201100.624273:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201100.624289:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715162240:0@lo:400:kworker.0 00000100:00100000:3.0:1788201100.624308:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201100.624319:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715162752:0@lo:400:kworker.0 00000100:00100000:3.0:1788201100.624331:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201100.624351:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00714ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715161472:0@lo:400:kworker.0 00000100:00100000:3.0:1788201100.624367:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201100.624378:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cf33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715161984:0@lo:400:kworker.0 00000100:00100000:3.0:1788201100.624414:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201100.624434:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715162496:0@lo:400:kworker.0 00000100:00100000:3.0:1788201100.624456:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201100.624476:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788201100.624481:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00714c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715161600:0@lo:400:kworker.0 00000100:00100000:3.0:1788201100.624499:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201100.624510:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715162112:0@lo:400:kworker.0 00000100:00100000:3.0:1788201100.624530:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201100.624546:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715162624:0@lo:400:kworker.0 00000100:00100000:3.0:1788201100.624565:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201100.624589:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715161856 00000100:00100000:3.0:1788201100.624595:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715161856 00000100:00100000:3.0:1788201100.624635:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715162368 00000100:00100000:3.0:1788201100.624636:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715162368 00000100:00100000:3.0:1788201100.624645:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715161728 00000100:00100000:3.0:1788201100.624647:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715161728 00000100:00100000:3.0:1788201100.624654:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715162752 00000100:00100000:3.0:1788201100.624655:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715162752 00000100:00100000:3.0:1788201100.624661:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715161472 00000100:00100000:3.0:1788201100.624662:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715161472 00000100:00100000:3.0:1788201100.624671:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715161600 00000100:00100000:3.0:1788201100.624672:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715161600 00000100:00100000:3.0:1788201100.624682:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1335 00000100:00100000:3.0:1788201100.624688:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715161856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201100.624897:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715162240 00000100:00100000:2.0:1788201100.624904:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715162240 00000100:00100000:2.0:1788201100.624947:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715162496 00000100:00100000:2.0:1788201100.624951:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715162496 00000100:00100000:2.0:1788201100.624970:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715162112 00000100:00100000:2.0:1788201100.624973:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715162112 00000100:00100000:2.0:1788201100.624988:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715162624 00000100:00100000:2.0:1788201100.624990:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715162624 00000100:00100000:2.0:1788201100.625009:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2780 00000100:00100000:2.0:1788201100.625034:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715162240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201100.625116:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715161856:12345-0@lo:400:kworker.0 Request processed in 425us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201100.625125:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1335 00000100:00100000:0.0:1788201100.625144:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715161984 00000100:00100000:0.0:1788201100.625151:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715161984 00000100:00100000:3.0:1788201100.625159:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:3.0:1788201100.625183:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715162368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201100.625193:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3953 00000100:00100000:0.0:1788201100.625207:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715161984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201100.625409:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:1.0:1788201100.625419:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715161728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201100.625485:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715162240:12345-0@lo:400:kworker.0 Request processed in 469us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201100.625492:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2780 00000100:00100000:2.0:1788201100.625503:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2781 00000100:00100000:2.0:1788201100.625510:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715162496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201100.625616:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715162496:12345-0@lo:400:kworker.0 Request processed in 106us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201100.625623:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2781 00000100:00100000:2.0:1788201100.625634:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2782 00000100:00100000:2.0:1788201100.625640:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715162112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201100.625667:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715162112:12345-0@lo:400:kworker.0 Request processed in 28us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201100.625673:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2782 00000100:00100000:2.0:1788201100.625683:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2783 00000100:00100000:2.0:1788201100.625689:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715162624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201100.625712:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715162624:12345-0@lo:400:kworker.0 Request processed in 24us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201100.625718:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2783 00000100:00080000:2.0:1788201100.625741:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201100.625745:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201100.625748:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201100.625751:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201100.625813:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715161216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201100.625874:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:2.0:1788201100.625882:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715162752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201100.625912:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715162752:12345-0@lo:400:kworker.0 Request processed in 32us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201100.625918:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00100000:2.0:1788201100.625934:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:2.0:1788201100.625940:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715161472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201100.625976:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715161472:12345-0@lo:400:kworker.0 Request processed in 36us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201100.625982:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00100000:2.0:1788201100.625994:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:2.0:1788201100.626000:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715161600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201100.626047:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715161600:12345-0@lo:400:kworker.0 Request processed in 47us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201100.626053:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:1.0:1788201100.626121:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715161728:12345-0@lo:400:kworker.0 Request processed in 704us (1857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201100.626128:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:1.0:1788201100.626169:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715161344 00000100:00100000:1.0:1788201100.626173:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715161344 00000100:00100000:1.0:1788201100.626198:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788201100.626204:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715161344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201100.626246:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715161344:12345-0@lo:400:kworker.0 Request processed in 42us (2238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201100.626258:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788201100.626334:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00714c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715161600:0@lo:400:kworker.0 00000100:00100000:1.0:1788201100.626345:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715162112:0@lo:400:kworker.0 00000100:00100000:1.0:1788201100.626359:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715162624:0@lo:400:kworker.0 00000100:00100000:1.0:1788201100.626369:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00714ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715161472:0@lo:400:kworker.0 00000100:00100000:1.0:1788201100.626380:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715162496:0@lo:400:kworker.0 00000100:00100000:2.0:1788201100.628420:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715161728:0@lo:400:kworker.0 00000100:00100000:2.0:1788201100.628440:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715162240:0@lo:400:kworker.0 00000100:00100000:2.0:1788201100.628452:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715162752:0@lo:400:kworker.0 00000100:00100000:2.0:1788201100.628463:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00714fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715161344:0@lo:400:kworker.0 00000100:00100000:2.0:1788201100.628474:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cf31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715161856:0@lo:400:kworker.0 00000100:00100000:2.0:1788201100.628486:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715162368:0@lo:400:kworker.0 00000100:00100000:3.0:1788201100.630724:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715162368:12345-0@lo:400:kworker.0 Request processed in 5528us (6504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201100.630746:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00100000:0.0:1788201100.633513:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715161984:12345-0@lo:400:kworker.0 Request processed in 8301us (9087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201100.633529:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3953 00000100:00100000:1.0:1788201100.639443:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cf33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715161984:0@lo:400:kworker.0 00000100:00100000:0.0:1788201100.759010:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201100.759141:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201100.759186:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201100.759212:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201100.759293:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201100.759364:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695384960 00000100:00100000:0.0:1788201100.759377:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695384960 00000100:00100000:0.0:1788201100.759474:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695385088 00000100:00100000:0.0:1788201100.759478:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695385088 00000100:00100000:0.0:1788201100.759507:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1341 00000100:00100000:0.0:1788201100.759519:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+8:2401:x1875060695384960:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201100.759631:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+8:2401:x1875060695384960:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 113us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201100.759640:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1341 00000100:00100000:0.0:1788201100.759661:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1342 00000100:00100000:0.0:1788201100.759668:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695385088:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201100.759694:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695385088:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201100.759700:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1342 00000100:00100000:0.0:1788201100.759723:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695385216 00000100:00100000:0.0:1788201100.759726:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695385216 00000100:00100000:0.0:1788201100.759756:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695385344 00000100:00100000:0.0:1788201100.759759:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695385344 00000100:00100000:0.0:1788201100.759783:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2784 00000100:00100000:0.0:1788201100.759789:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695385216:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201100.759830:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695385216:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 29us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201100.759838:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2784 00000100:00100000:0.0:1788201100.759850:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2785 00000100:00100000:0.0:1788201100.759856:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4292087e-fa00-4621-b681-837afc99ae35+7:2401:x1875060695385344:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201100.759890:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4292087e-fa00-4621-b681-837afc99ae35+7:2401:x1875060695385344:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 34us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201100.759897:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2785 00000100:00080000:0.0:1788201100.760106:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201100.760112:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201100.760115:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201100.760118:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201100.760946:0:91107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695384832 00000100:00100000:1.0:1788201100.760956:0:91107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695384832 00000100:00100000:1.0:1788201100.761064:0:91107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 79 00000100:00100000:1.0:1788201100.761074:0:91107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695384832:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201100.761142:0:91107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695384832:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 70us (1955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201100.761149:0:91107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 79 00010000:00010000:3.0:1788201101.071450:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201101.135941:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201101.136073:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201101.136103:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715163008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201101.136203:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201101.136303:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715163008 00000100:00100000:2.0:1788201101.136313:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715163008 00000100:00100000:2.0:1788201101.136378:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2250 00000100:00100000:2.0:1788201101.136389:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715163008:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201101.136802:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201101.136827:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715163136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201101.136871:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201101.136926:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715163136 00000100:00100000:0.0:1788201101.136931:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715163136 00000100:00100000:0.0:1788201101.136969:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3954 00000100:00100000:0.0:1788201101.136976:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715163136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201101.137042:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444966400 avail 1298726912 00000100:00100000:0.0:1788201101.137096:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715163136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201101.137105:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3954 00000100:00100000:0.0:1788201101.137159:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715163136:0@lo:41:osp-pre-0-1.0 00002000:00000024:2.0:1788201101.140315:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788201101.140468:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715163008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4075us (4259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201101.140499:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2250 00000100:00100000:3.0:1788201101.141511:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715163008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201101.142139:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715162880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201101.142220:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201101.142354:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715162880 00000100:00100000:0.0:1788201101.142363:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715162880 00000100:00100000:0.0:1788201101.142534:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2251 00000100:00100000:0.0:1788201101.142547:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715162880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201101.142594:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201101.142662:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715162880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201101.142688:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2251 00000100:00100000:2.0:1788201101.142783:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715162880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201101.647736:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201101.647773:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715163264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201101.647883:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201101.647945:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715163264 00000100:00100000:1.0:1788201101.647956:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715163264 00000100:00100000:1.0:1788201101.648045:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2252 00000100:00100000:1.0:1788201101.648076:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715163264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201101.648112:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788201101.648171:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715163264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201101.648179:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2252 00000100:00100000:1.0:1788201101.648241:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715163264:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201101.649125:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201101.649142:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715163392:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201101.649204:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201101.649381:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715163392 00000100:00100000:0.0:1788201101.649403:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715163392 00000100:00100000:0.0:1788201101.649457:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2253 00000100:00100000:0.0:1788201101.649466:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715163392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201101.649489:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201101.649546:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715163392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201101.649552:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2253 00000100:00100000:0.0:1788201101.649597:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715163392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201101.897737:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201101.898135:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695385472 00000100:00100000:3.0:1788201101.898150:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695385472 00000100:00100000:3.0:1788201101.898233:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1298 00000100:00100000:3.0:1788201101.898276:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+8:70374:x1875060695385472:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:3.0:1788201101.898336:0:66313:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444966400 avail 1298726912 00000100:00100000:3.0:1788201101.898467:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+8:70374:x1875060695385472:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 223us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201101.898475:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1298 00000100:00100000:3.0:1788201101.901569:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201101.901744:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695385600 00000100:00100000:0.0:1788201101.901755:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695385600 00000100:00100000:0.0:1788201101.901820:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1299 00000100:00100000:0.0:1788201101.901832:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:70374:x1875060695385600:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:0.0:1788201101.901871:0:66757:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:0.0:1788201101.901952:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+6:70374:x1875060695385600:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 121us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201101.901960:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1299 00000100:00100000:1.0:1788201101.906277:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201101.906382:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695385728 00000100:00100000:2.0:1788201101.906392:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695385728 00000100:00100000:2.0:1788201101.906452:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2254 00000100:00100000:2.0:1788201101.906462:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+6:70374:x1875060695385728:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:2.0:1788201101.906490:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788201101.906568:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+6:70374:x1875060695385728:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 107us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201101.906576:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2254 00000100:00100000:3.0:1788201101.909385:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201101.913777:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695385856 00000100:00100000:2.0:1788201101.913792:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695385856 00000100:00100000:2.0:1788201101.913873:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2255 00000100:00100000:2.0:1788201101.913883:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+7:70374:x1875060695385856:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:2.0:1788201101.913910:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201101.913991:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4292087e-fa00-4621-b681-837afc99ae35+7:70374:x1875060695385856:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 108us (4615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201101.913999:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2255 00000100:00100000:1.0:1788201101.976334:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201101.976599:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695386112 00000100:00100000:2.0:1788201101.976610:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695386112 00000100:00100000:2.0:1788201101.976673:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1300 00000100:00100000:2.0:1788201101.976685:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+8:70390:x1875060695386112:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1788201101.976706:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201101.976730:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da6400/0x96d0c9b8c9a1b9f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7866ff expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.976823:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1b9ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.976837:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1b9ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.976850:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1b9ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.976865:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7c00/0x96d0c9b8c9a1ba06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.976872:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7c00/0x96d0c9b8c9a1ba06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.976878:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7c00/0x96d0c9b8c9a1ba06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.977171:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1b9ff lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.977181:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1b9ff lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.977188:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1b9ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.977195:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1b9ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.977298:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc005da7400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201101.977310:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1b9ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.977319:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1b9ff lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.977330:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048bed00) 00010000:00010000:2.0:1788201101.977333:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201101.977337:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1b9ff lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.977343:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1b9ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.977358:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7c00/0x96d0c9b8c9a1ba06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.977365:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7c00/0x96d0c9b8c9a1ba06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.977370:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7c00/0x96d0c9b8c9a1ba06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.977375:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc005da7c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201101.977378:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7c00/0x96d0c9b8c9a1ba06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.977384:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7c00/0x96d0c9b8c9a1ba06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.977390:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8dc12196ee00) 00010000:00010000:2.0:1788201101.977392:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201101.977402:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7c00/0x96d0c9b8c9a1ba06 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.977408:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7c00/0x96d0c9b8c9a1ba06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.977445:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da6400/0x96d0c9b8c9a1b9f8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866ff expref: 9 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.977460:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048bed00) 00010000:00010000:2.0:1788201101.977462:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201101.977466:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da6400/0x96d0c9b8c9a1b9f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866ff expref: 9 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201101.977476:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc005da6400, rc 0) 00000100:00100000:2.0:1788201101.977640:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+8:70390:x1875060695386112:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 957us (1316us total) trans 0 rc 301/301 00000100:00100000:2.0:1788201101.977649:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1300 00000100:00100000:3.0:1788201101.999122:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201101.999229:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695386240 00000100:00100000:0.0:1788201101.999266:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695386240 00000100:00100000:0.0:1788201101.999334:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1301 00000100:00100000:0.0:1788201101.999345:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+8:70390:x1875060695386240:12345-192.168.201.20@tcp:34:lfs.0 00010000:00010000:0.0:1788201101.999423:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339a00/0x96d0c9b8c9a1ba0d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999456:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339a00/0x96d0c9b8c9a1ba0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999468:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339a00/0x96d0c9b8c9a1ba0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999487:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339e00/0x96d0c9b8c9a1ba14 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999494:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339e00/0x96d0c9b8c9a1ba14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999502:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339e00/0x96d0c9b8c9a1ba14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999595:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1ba1b lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999605:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1ba1b lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999612:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1ba1b lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201101.999653:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 1048576 00000004:00200000:0.0:1788201101.999658:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201101.999670:0:66312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1ba1b lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999684:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339a00/0x96d0c9b8c9a1ba0d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999700:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339a00/0x96d0c9b8c9a1ba0d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999706:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339a00/0x96d0c9b8c9a1ba0d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999714:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339a00/0x96d0c9b8c9a1ba0d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999719:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201101.999724:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339a00/0x96d0c9b8c9a1ba0d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999730:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339a00/0x96d0c9b8c9a1ba0d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999743:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048bed00) 00010000:00010000:0.0:1788201101.999745:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201101.999749:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339a00/0x96d0c9b8c9a1ba0d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999755:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339a00/0x96d0c9b8c9a1ba0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999771:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339e00/0x96d0c9b8c9a1ba14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999777:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339e00/0x96d0c9b8c9a1ba14 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999783:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339e00/0x96d0c9b8c9a1ba14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999793:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339e00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201101.999796:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339e00/0x96d0c9b8c9a1ba14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999803:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339e00/0x96d0c9b8c9a1ba14 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999812:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8dc10bed3200) 00010000:00010000:0.0:1788201101.999814:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201101.999817:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339e00/0x96d0c9b8c9a1ba14 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999823:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339e00/0x96d0c9b8c9a1ba14 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999837:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1ba1b lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999844:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1ba1b lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999849:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1ba1b lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999853:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201101.999856:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1ba1b lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999862:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1ba1b lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999880:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8dc103a1ea00) 00010000:00010000:0.0:1788201101.999882:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201101.999885:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1ba1b lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201101.999891:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f339c00/0x96d0c9b8c9a1ba1b lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201101.999972:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+8:70390:x1875060695386240:12345-192.168.201.20@tcp:34:lfs.0 Request processed in 628us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201101.999981:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1301 00000100:00100000:2.0:1788201102.046933:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201102.047067:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695386496 00000100:00100000:3.0:1788201102.047078:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695386496 00000100:00100000:3.0:1788201102.047154:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1302 00000100:00100000:3.0:1788201102.047165:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+8:70393:x1875060695386496:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1788201102.047186:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201102.047208:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1ba22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786706 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201102.047309:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba29 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201102.047323:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201102.047334:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201102.047349:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc800/0x96d0c9b8c9a1ba30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201102.047356:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc800/0x96d0c9b8c9a1ba30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201102.047363:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc800/0x96d0c9b8c9a1ba30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201102.047445:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba29 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201102.047453:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba29 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201102.047459:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201102.047466:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201102.047472:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201102.047483:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201102.047492:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba29 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201102.047505:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048bed00) 00010000:00010000:3.0:1788201102.047508:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201102.047512:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba29 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201102.047519:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201102.047533:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc800/0x96d0c9b8c9a1ba30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201102.047540:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc800/0x96d0c9b8c9a1ba30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201102.047546:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc800/0x96d0c9b8c9a1ba30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201102.047551:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fc800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201102.047554:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc800/0x96d0c9b8c9a1ba30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201102.047560:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc800/0x96d0c9b8c9a1ba30 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201102.047568:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8dc11d3a3d00) 00010000:00010000:3.0:1788201102.047570:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201102.047578:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc800/0x96d0c9b8c9a1ba30 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201102.047584:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc800/0x96d0c9b8c9a1ba30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201102.047621:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1ba22 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786706 expref: 9 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201102.047632:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048bed00) 00010000:00010000:3.0:1788201102.047634:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201102.047638:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1ba22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786706 expref: 9 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201102.047646:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fd000, rc 0) 00000100:00100000:3.0:1788201102.047715:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+8:70393:x1875060695386496:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 552us (793us total) trans 0 rc 301/301 00000100:00100000:3.0:1788201102.047723:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1302 00000100:00080000:0.0:1788201102.048100:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201102.050988:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201102.051194:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695386624 00000100:00100000:1.0:1788201102.051213:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695386624 00000100:00100000:1.0:1788201102.051284:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1303 00000100:00100000:1.0:1788201102.051295:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+8:70393:x1875060695386624:12345-192.168.201.20@tcp:34:lfs.0 00010000:00010000:1.0:1788201102.051371:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1ba37 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051387:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1ba37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051399:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1ba37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051415:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c600/0x96d0c9b8c9a1ba3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051422:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c600/0x96d0c9b8c9a1ba3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051428:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c600/0x96d0c9b8c9a1ba3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051525:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1ba45 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051534:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1ba45 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051541:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1ba45 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201102.051595:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 1048576 00000004:00200000:1.0:1788201102.051600:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201102.051613:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1ba45 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051626:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1ba37 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051633:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1ba37 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051640:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1ba37 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051648:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1ba37 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051653:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2d800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201102.051658:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1ba37 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051665:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1ba37 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051684:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048bed00) 00010000:00010000:1.0:1788201102.051687:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201102.051692:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1ba37 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051698:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2d800/0x96d0c9b8c9a1ba37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051711:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c600/0x96d0c9b8c9a1ba3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051718:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c600/0x96d0c9b8c9a1ba3e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051724:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c600/0x96d0c9b8c9a1ba3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051729:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2c600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201102.051732:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c600/0x96d0c9b8c9a1ba3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051737:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c600/0x96d0c9b8c9a1ba3e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051744:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8dc103b47c00) 00010000:00010000:1.0:1788201102.051746:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201102.051748:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c600/0x96d0c9b8c9a1ba3e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051754:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007a2c600/0x96d0c9b8c9a1ba3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051779:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1ba45 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051785:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1ba45 lrc: 2/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051791:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1ba45 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051796:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201102.051799:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1ba45 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051805:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1ba45 lrc: 4/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051812:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8dc103a1ea00) 00010000:00010000:1.0:1788201102.051815:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201102.051817:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1ba45 lrc: 2/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.051822:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1ba45 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201102.051898:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+8:70393:x1875060695386624:12345-192.168.201.20@tcp:34:lfs.0 Request processed in 604us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201102.051907:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1303 00010000:00010000:3.0:1788201102.095390:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201102.105350:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201102.105500:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695386880 00000100:00100000:1.0:1788201102.105510:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695386880 00000100:00100000:1.0:1788201102.105580:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1304 00000100:00100000:1.0:1788201102.105605:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+8:70398:x1875060695386880:12345-192.168.201.20@tcp:101:md5sum.0 00010000:00010000:1.0:1788201102.105626:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201102.105645:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1ba4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78670d expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.105719:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1ba53 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.105733:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1ba53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.105744:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1ba53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.105758:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1ba5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.105765:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1ba5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.105772:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1ba5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.105882:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1ba61 lrc: 3/1,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.105890:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1ba61 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.105897:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1ba61 lrc: 3/1,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201102.105918:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000afe1:0x9:0x0]: returning size 1048576 00010000:00010000:1.0:1788201102.106416:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1ba53 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.106425:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1ba53 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.106431:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1ba53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.106437:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1ba53 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.106442:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064edc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201102.106446:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1ba53 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.106453:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1ba53 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.106464:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048bed00) 00010000:00010000:1.0:1788201102.106467:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201102.106471:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1ba53 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.106477:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1ba53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.106491:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1ba5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.106508:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1ba5a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.106513:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1ba5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.106517:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064eca00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201102.106519:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1ba5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.106525:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1ba5a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.106533:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8dc103b47c00) 00010000:00010000:1.0:1788201102.106536:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201102.106539:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1ba5a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.106558:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1ba5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.106622:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1ba4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78670d expref: 11 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.106636:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1ba61 lrc: 3/0,0 mode: PR/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78670d expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201102.106643:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8dc103a1ea00) 00010000:00010000:1.0:1788201102.106645:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201102.106653:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ec200, rc 0) 00000100:00100000:1.0:1788201102.106719:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+10:70398:x1875060695386880:12345-192.168.201.20@tcp:101:md5sum.0 Request processed in 1117us (1378us total) trans 115964116993 rc 0/0 00000100:00100000:1.0:1788201102.106727:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1304 00000100:00100000:2.0:1788201102.140489:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201102.140590:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695387008 00000100:00100000:1.0:1788201102.140599:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695387008 00002000:00100000:1.0:1788201102.140657:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x322:0x0] (0->32767) req@ffff8dc11cf33b80 x1875060695387008/t0(0) o3->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:223/0 lens 488/0 e 0 to 0 dl 1788201113 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201102.140668:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc11cf33b80 with x1875060695387008 ext(0->32767) 00002000:00010000:1.0:1788201102.140674:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dc11cf33b80 00000100:00100000:1.0:1788201102.140708:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1005 00000100:00100000:1.0:1788201102.140717:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cf33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4292087e-fa00-4621-b681-837afc99ae35+7:2403:x1875060695387008:12345-192.168.201.20@tcp:3:md5sum.0 00000100:00080000:0.0:1788201102.141382:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201102.143648:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cf33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4292087e-fa00-4621-b681-837afc99ae35+7:2403:x1875060695387008:12345-192.168.201.20@tcp:3:md5sum.0 Request processed in 2921us (3157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201102.143662:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1005 00002000:00100000:1.0:1788201102.143674:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x322:0x0] (0->32767) req@ffff8dc11cf33b80 x1875060695387008/t0(0) o3->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:223/0 lens 488/440 e 0 to 0 dl 1788201113 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201102.143684:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc11cf33b80 with x1875060695387008 ext(0->32767) 00002000:00010000:1.0:1788201102.143690:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dc11cf33b80 00000100:00100000:2.0:1788201102.169429:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201102.169485:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201102.169586:0:25933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695387136 00000100:00100000:3.0:1788201102.169597:0:25933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695387136 00002000:00100000:3.0:1788201102.169642:0:25933:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x322:0x0] (32768->1048575) req@ffff8dc11cf31c00 x1875060695387136/t0(0) o3->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:223/0 lens 488/0 e 0 to 0 dl 1788201113 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201102.169654:0:25933:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc11cf31c00 with x1875060695387136 ext(32768->1048575) 00002000:00010000:3.0:1788201102.169660:0:25933:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dc11cf31c00 00000100:00100000:3.0:1788201102.169693:0:25933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695387264 00000100:00100000:3.0:1788201102.169697:0:25933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695387264 00002000:00100000:3.0:1788201102.169727:0:25933:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x322:0x0] (1048576->2097151) req@ffff8dc005352d80 x1875060695387264/t0(0) o3->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:223/0 lens 488/0 e 0 to 0 dl 1788201113 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201102.169755:0:25933:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc005352d80 with x1875060695387264 ext(1048576->2097151) 00002000:00010000:3.0:1788201102.169759:0:25933:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc005352d80 00000100:00100000:3.0:1788201102.169783:0:25933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1006 00000100:00100000:3.0:1788201102.169794:0:25933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cf31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4292087e-fa00-4621-b681-837afc99ae35+7:2401:x1875060695387136:12345-192.168.201.20@tcp:3:md5sum.0 00000100:00100000:3.0:1788201102.170100:0:25936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1007 00000100:00100000:3.0:1788201102.170108:0:25936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695387264:12345-192.168.201.20@tcp:3:md5sum.0 00000100:00080000:2.0:1788201102.170354:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201102.199208:0:25933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cf31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4292087e-fa00-4621-b681-837afc99ae35+7:2401:x1875060695387136:12345-192.168.201.20@tcp:3:md5sum.0 Request processed in 29406us (29778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201102.199791:0:25933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1006 00002000:00100000:3.0:1788201102.199805:0:25933:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x322:0x0] (32768->1048575) req@ffff8dc11cf31c00 x1875060695387136/t0(0) o3->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:223/0 lens 488/440 e 0 to 0 dl 1788201113 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201102.199815:0:25933:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc11cf31c00 with x1875060695387136 ext(32768->1048575) 00002000:00010000:3.0:1788201102.199822:0:25933:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dc11cf31c00 00000100:00100000:3.0:1788201102.257197:0:25936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695387264:12345-192.168.201.20@tcp:3:md5sum.0 Request processed in 87078us (87700us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1788201102.257228:0:25936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1007 00002000:00100000:3.0:1788201102.257250:0:25936:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x322:0x0] (1048576->2097151) req@ffff8dc005352d80 x1875060695387264/t0(0) o3->4292087e-fa00-4621-b681-837afc99ae35@192.168.201.20@tcp:223/0 lens 488/440 e 0 to 0 dl 1788201113 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201102.257261:0:25936:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc005352d80 with x1875060695387264 ext(1048576->2097151) 00002000:00010000:3.0:1788201102.257267:0:25936:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc005352d80 00000100:00100000:0.0:1788201102.289682:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201102.290402:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695387520 00000100:00100000:3.0:1788201102.290414:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695387520 00000100:00100000:3.0:1788201102.290493:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 229 00000100:00100000:3.0:1788201102.290504:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4292087e-fa00-4621-b681-837afc99ae35+10:70398:x1875060695387520:12345-192.168.201.20@tcp:35:md5sum.0 00000001:00080000:3.0:1788201102.290830:0:66316:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 115964116994 00000100:00100000:3.0:1788201102.290950:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4292087e-fa00-4621-b681-837afc99ae35+12:70398:x1875060695387520:12345-192.168.201.20@tcp:35:md5sum.0 Request processed in 448us (1278us total) trans 115964116995 rc 0/0 00000100:00100000:3.0:1788201102.290958:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 229 00000020:00080000:3.0:1788201102.290962:0:66316:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788201103.119355:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201104.150800:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201105.167479:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201105.744434:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201105.744456:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715163520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201105.744522:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201105.744809:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715163520 00000100:00100000:2.0:1788201105.744817:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715163520 00000100:00100000:2.0:1788201105.744875:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3955 00000100:00100000:2.0:1788201105.744885:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715163520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201105.744944:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445400576 avail 1299161088 00000100:00100000:2.0:1788201105.744993:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715163520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201105.745000:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3955 00000100:00100000:3.0:1788201105.745259:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715163520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201105.745628:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715163904:0@lo:400:kworker.0 00000100:00100000:3.0:1788201105.745661:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201105.745682:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715164416:0@lo:400:kworker.0 00000100:00100000:3.0:1788201105.745707:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201105.745725:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715164928:0@lo:400:kworker.0 00000100:00100000:3.0:1788201105.745745:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201105.745763:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788201105.745768:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715163776:0@lo:400:kworker.0 00000100:00100000:3.0:1788201105.745800:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201105.745820:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715164288:0@lo:400:kworker.0 00000100:00100000:3.0:1788201105.745841:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201105.745854:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715164800:0@lo:400:kworker.0 00000100:00100000:3.0:1788201105.745872:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201105.745910:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715163904 00000100:00100000:3.0:1788201105.745914:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715163904 00000100:00100000:3.0:1788201105.746140:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715163776 00000100:00100000:3.0:1788201105.746145:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715163776 00000100:00100000:3.0:1788201105.746166:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:3.0:1788201105.746186:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715163904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201105.746233:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715163904:12345-0@lo:400:kworker.0 Request processed in 60us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201105.746239:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:3.0:1788201105.746255:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:3.0:1788201105.746261:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715163776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201105.746288:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715163776:12345-0@lo:400:kworker.0 Request processed in 27us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201105.746293:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:3.0:1788201105.746311:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715164416 00000100:00100000:3.0:1788201105.746314:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715164416 00000100:00100000:3.0:1788201105.746339:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715164928 00000100:00100000:3.0:1788201105.746343:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715164928 00000100:00100000:3.0:1788201105.746361:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715164800 00000100:00100000:3.0:1788201105.746363:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715164800 00000100:00100000:3.0:1788201105.746380:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2786 00000100:00100000:3.0:1788201105.746385:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715164416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201105.746416:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715164416:12345-0@lo:400:kworker.0 Request processed in 30us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201105.746421:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2786 00000100:00100000:3.0:1788201105.746433:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2787 00000100:00100000:3.0:1788201105.746439:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715164928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201105.746464:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715164928:12345-0@lo:400:kworker.0 Request processed in 26us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201105.746476:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2787 00000100:00100000:3.0:1788201105.746487:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2788 00000100:00100000:3.0:1788201105.746492:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715164800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201105.746521:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715164800:12345-0@lo:400:kworker.0 Request processed in 29us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201105.746526:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2788 00000100:00080000:3.0:1788201105.746548:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201105.746552:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201105.746554:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201105.746556:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201105.746585:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715163776:0@lo:400:kworker.0 00000100:00100000:3.0:1788201105.746596:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715164800:0@lo:400:kworker.0 00000100:00100000:3.0:1788201105.746605:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715163904:0@lo:400:kworker.0 00000100:00100000:3.0:1788201105.746612:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715164416:0@lo:400:kworker.0 00000100:00100000:3.0:1788201105.746620:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715164928:0@lo:400:kworker.0 00000100:00100000:0.0:1788201105.746927:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715164288 00000100:00100000:0.0:1788201105.746943:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715164288 00000100:00100000:0.0:1788201105.746980:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3956 00000100:00100000:0.0:1788201105.746987:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715164288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201105.747055:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715164288:12345-0@lo:400:kworker.0 Request processed in 69us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201105.747066:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3956 00000100:00100000:0.0:1788201105.747095:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715163648:0@lo:400:kworker.0 00000100:00100000:0.0:1788201105.747125:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201105.747154:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715164160:0@lo:400:kworker.0 00000100:00100000:0.0:1788201105.747186:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201105.747205:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715164672:0@lo:400:kworker.0 00000100:00100000:0.0:1788201105.747237:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201105.747258:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788201105.747263:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715164032:0@lo:400:kworker.0 00000100:00100000:0.0:1788201105.747282:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201105.747299:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715164544:0@lo:400:kworker.0 00000100:00100000:0.0:1788201105.747332:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201105.747350:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715165056:0@lo:400:kworker.0 00000100:00100000:0.0:1788201105.747369:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201105.747395:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715163648 00000100:00100000:0.0:1788201105.747399:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715163648 00000100:00100000:0.0:1788201105.747427:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788201105.747434:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715163648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201105.747466:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715163648:12345-0@lo:400:kworker.0 Request processed in 33us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201105.747472:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788201105.747496:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715164160 00000100:00100000:0.0:1788201105.747500:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715164160 00000100:00100000:0.0:1788201105.747525:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715164672 00000100:00100000:0.0:1788201105.747528:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715164672 00000100:00100000:0.0:1788201105.747538:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715164032 00000100:00100000:0.0:1788201105.747539:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715164032 00000100:00100000:0.0:1788201105.747550:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715165056 00000100:00100000:0.0:1788201105.747553:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715165056 00000100:00100000:0.0:1788201105.747564:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:0.0:1788201105.747570:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715164160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201105.747599:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715164160:12345-0@lo:400:kworker.0 Request processed in 30us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201105.747613:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00100000:0.0:1788201105.747626:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:0.0:1788201105.747632:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715164672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201105.747660:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715164672:12345-0@lo:400:kworker.0 Request processed in 28us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201105.747665:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00100000:0.0:1788201105.747676:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:0.0:1788201105.747681:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715164032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201105.747706:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715164032:12345-0@lo:400:kworker.0 Request processed in 25us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201105.747711:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:0.0:1788201105.747721:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:0.0:1788201105.747726:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715165056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201105.747749:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715165056:12345-0@lo:400:kworker.0 Request processed in 23us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201105.747754:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:0.0:1788201105.747769:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715164544 00000100:00100000:0.0:1788201105.747773:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715164544 00000100:00100000:0.0:1788201105.747810:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2789 00000100:00100000:0.0:1788201105.747817:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715164544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201105.747843:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715164544:12345-0@lo:400:kworker.0 Request processed in 27us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201105.747848:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2789 00000100:00080000:0.0:1788201105.747876:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201105.747879:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201105.747887:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201105.747913:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715164288:0@lo:400:kworker.0 00000100:00100000:0.0:1788201105.747939:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715164032:0@lo:400:kworker.0 00000100:00100000:0.0:1788201105.747948:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715164544:0@lo:400:kworker.0 00000100:00100000:0.0:1788201105.747956:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715165056:0@lo:400:kworker.0 00000100:00100000:0.0:1788201105.747963:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715163648:0@lo:400:kworker.0 00000100:00100000:0.0:1788201105.747971:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715164160:0@lo:400:kworker.0 00000100:00100000:0.0:1788201105.747978:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715164672:0@lo:400:kworker.0 00000100:00100000:1.0:1788201105.900655:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201105.900698:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201105.900723:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201105.900744:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201105.900767:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201105.900801:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695388160 00000100:00100000:1.0:1788201105.900816:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695388160 00000100:00100000:1.0:1788201105.900869:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695388032 00000100:00100000:1.0:1788201105.900872:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695388032 00000100:00100000:1.0:1788201105.900897:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2790 00000100:00100000:1.0:1788201105.900906:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4292087e-fa00-4621-b681-837afc99ae35+7:2401:x1875060695388160:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201105.900986:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4292087e-fa00-4621-b681-837afc99ae35+7:2401:x1875060695388160:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 80us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201105.900994:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2790 00000100:00100000:1.0:1788201105.901012:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2791 00000100:00100000:1.0:1788201105.901048:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695388032:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201105.901072:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695388032:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201105.901079:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2791 00000100:00100000:1.0:1788201105.901097:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695387904 00000100:00100000:1.0:1788201105.901100:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695387904 00000100:00100000:1.0:1788201105.901127:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695387776 00000100:00100000:1.0:1788201105.901130:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695387776 00000100:00100000:1.0:1788201105.901165:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1349 00000100:00100000:1.0:1788201105.901182:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695387904:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201105.901209:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+6:2401:x1875060695387904:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 38us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201105.901216:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1349 00000100:00100000:1.0:1788201105.901229:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1350 00000100:00100000:1.0:1788201105.901235:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+12:2401:x1875060695387776:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201105.901260:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+12:2401:x1875060695387776:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201105.901273:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1350 00000100:00080000:1.0:1788201105.901294:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201105.901298:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201105.901301:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201105.901303:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201105.902505:0:91107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695387648 00000100:00100000:3.0:1788201105.902513:0:91107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695387648 00000100:00100000:3.0:1788201105.902564:0:91107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 81 00000100:00100000:3.0:1788201105.902574:0:91107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695387648:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201105.902623:0:91107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2401:x1875060695387648:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 52us (1977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201105.902630:0:91107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 81 00010000:00010000:3.0:1788201106.191287:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201106.255429:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715165184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201106.255499:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201106.255755:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715165184 00000100:00100000:0.0:1788201106.255763:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715165184 00000100:00100000:0.0:1788201106.255830:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3957 00000100:00100000:0.0:1788201106.255840:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715165184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201106.255873:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444966400 avail 1298726912 00000100:00100000:0.0:1788201106.255945:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715165184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201106.255952:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3957 00000100:00100000:3.0:1788201106.256059:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715165184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201106.256989:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201106.257003:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715165312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201106.257071:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201106.257877:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715165312 00000100:00100000:2.0:1788201106.257886:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715165312 00000100:00100000:2.0:1788201106.257943:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2256 00000100:00100000:2.0:1788201106.257952:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715165312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201106.257976:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788201106.258045:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715165312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201106.258051:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2256 00000100:00100000:2.0:1788201106.258093:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715165312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201106.260479:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715165440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201106.260544:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201106.260618:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715165440 00000100:00100000:0.0:1788201106.260626:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715165440 00000100:00100000:0.0:1788201106.260726:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2257 00000100:00100000:0.0:1788201106.260735:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715165440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201106.260763:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201106.264387:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715165440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3643us (3833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201106.264401:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2257 00000100:00100000:2.0:1788201106.266325:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715165440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201106.767851:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201106.767876:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715165568:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201106.767944:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201106.768093:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715165568 00000100:00100000:0.0:1788201106.768101:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715165568 00000100:00100000:0.0:1788201106.768153:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2258 00000100:00100000:0.0:1788201106.768173:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715165568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201106.768198:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201106.768258:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715165568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201106.768265:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2258 00000100:00100000:1.0:1788201106.768781:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715165696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201106.768809:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201106.768855:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715165568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201106.769037:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715165696 00000100:00100000:0.0:1788201106.769043:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715165696 00000100:00100000:0.0:1788201106.769078:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2259 00000100:00100000:0.0:1788201106.769085:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715165696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201106.769097:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788201106.769141:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715165696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201106.769148:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2259 00000100:00100000:3.0:1788201106.770777:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715165696:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788201107.215898:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788201107.286900:0:91097:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116995 is committed 00010000:00010000:1.0:1788201108.242735:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201109.263284:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201109.406837:0:91924:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 133: check resend of ongoing requests for lwp during failover ========================================================== 14:31:48 (1788201108) 00000100:00100000:2.0:1788201109.488793:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201109.488879:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695388416 00000100:00100000:3.0:1788201109.488890:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695388416 00000100:00100000:3.0:1788201109.488973:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1305 00000100:00100000:3.0:1788201109.488985:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+6:70975:x1875060695388416:12345-192.168.201.20@tcp:36:mkdir.0 00000100:00100000:3.0:1788201109.489136:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715165824:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788201109.489189:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201109.489215:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fb11000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201109.489237:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715165824 00000100:00100000:3.0:1788201109.489241:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715165824 00000100:00100000:3.0:1788201109.489268:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3958 00000100:00100000:3.0:1788201109.489275:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66313:x1875060715165824:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788201109.489341:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66313:x1875060715165824:12345-0@lo:1000:mdt00_001.0 Request processed in 66us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201109.489348:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3958 00000100:00100000:3.0:1788201109.489389:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715165824:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788201109.489426:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715165952:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788201109.489445:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201109.489458:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fb11000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201109.489469:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715165952 00000100:00100000:3.0:1788201109.489472:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715165952 00000100:00100000:3.0:1788201109.489491:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3959 00000100:00100000:3.0:1788201109.489496:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66313:x1875060715165952:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788201109.489576:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66313:x1875060715165952:12345-0@lo:1000:mdt00_001.0 Request processed in 79us (130us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201109.489583:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3959 00000100:00100000:3.0:1788201109.489605:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715165952:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788201109.489649:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba6f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.489659:0:66313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba6f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.489669:0:66313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba6f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201109.489678:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715166080:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1788201109.489697:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201109.489708:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fb116c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201109.489716:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715166080 00000100:00100000:3.0:1788201109.489719:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715166080 00000100:00100000:3.0:1788201109.489735:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3960 00000100:00100000:3.0:1788201109.489740:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66313:x1875060715166080:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1788201109.489747:0:83817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201109.489759:0:83817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1ba76 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ba6f expref: -99 pid: 83817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.489780:0:83817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b9f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866f8 expref: 8 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.489789:0:83817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1ba76 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ba6f expref: 7 pid: 83817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.489815:0:83817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b9f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866f8 expref: 8 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.489827:0:83817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b9f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866f8 expref: 8 pid: 66757 timeout: 4060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201109.489837:0:83817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:83817:1875060715166208:192.168.201.20@tcp:104: 00000100:00100000:3.0:1788201109.489890:0:83817:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fb11000 going to sleep for 11 seconds 00000100:00080000:2.0:1788201109.490460:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201109.494912:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201109.497215:0:83817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:83817:1875060715166208:192.168.201.20@tcp:104: 00010000:00010000:1.0:1788201109.497257:0:83817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1ba76 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ba6f expref: 7 pid: 83817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.497270:0:83817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048bed00) 00010000:00010000:1.0:1788201109.497273:0:83817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201109.497292:0:83817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1ba76 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ba6f expref: 7 pid: 83817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.497302:0:83817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fc000, rc 0) 00000100:00100000:1.0:1788201109.497370:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66313:x1875060715166080:12345-0@lo:101:mdt00_001.0 Request processed in 7628us (7671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201109.497378:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3960 00000100:00100000:3.0:1788201109.499381:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715166080:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1788201109.499408:0:66313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba6f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ba76 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.499420:0:66313:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba6f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ba76 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201109.502087:0:9535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695388544 00000100:00100000:2.0:1788201109.502102:0:9535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695388544 00010000:00010000:2.0:1788201109.502160:0:9535:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b9f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866f8 expref: 9 pid: 66757 timeout: 4060 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201109.502200:0:9535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2557 00000100:00100000:2.0:1788201109.502211:0:9535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4292087e-fa00-4621-b681-837afc99ae35+9:2403:x1875060695388544:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201109.502233:0:9535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201109.502241:0:9535:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b9f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866f8 expref: 9 pid: 66757 timeout: 4060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.502256:0:9535:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b9f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866f8 expref: 9 pid: 66757 timeout: 4060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.502280:0:9535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338600/0x96d0c9b8c9a1b9f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866f8 expref: 9 pid: 66757 timeout: 4060 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.502296:0:9535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048bed00) 00010000:00010000:2.0:1788201109.502303:0:9535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1ba76 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ba6f expref: 6 pid: 83817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.502314:0:9535:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1ba76 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ba6f expref: 6 pid: 83817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.502322:0:9535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1ba76 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ba6f expref: 6 pid: 83817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.502359:0:9535:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1ba76 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ba6f expref: 6 pid: 83817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201109.502385:0:9535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004c1e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9535:1875060715166336:0@lo:105: 00000100:00100000:2.0:1788201109.502446:0:9535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201109.502488:0:9535:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1038929c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201109.502513:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715166336 00000100:00100000:2.0:1788201109.502522:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715166336 00000100:00100000:2.0:1788201109.502548:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788201109.502554:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:9535:x1875060715166336:12345-0@lo:105: 00010000:00010000:2.0:1788201109.502565:0:6515:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba6f lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ba76 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.502574:0:6515:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba6f lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ba76 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.502583:0:6515:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba6f lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ba76 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.502591:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba6f lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x96d0c9b8c9a1ba76 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.502598:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba6f lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x96d0c9b8c9a1ba76 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.502607:0:6515:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba6f lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x96d0c9b8c9a1ba76 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.502624:0:6515:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8dc0078fd800) 00000100:00100000:2.0:1788201109.502661:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:9535:x1875060715166336:12345-0@lo:105: Request processed in 107us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201109.502668:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788201109.502702:0:9535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004c1e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9535:1875060715166336:0@lo:105: 00010000:00010000:2.0:1788201109.502714:0:9535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201109.502752:0:9535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4292087e-fa00-4621-b681-837afc99ae35+8:2403:x1875060695388544:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 543us (7849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201109.502765:0:9535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2557 00000100:00080000:1.0:1788201109.502955:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788201109.503325:0:66313:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba6f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ba76 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.503336:0:66313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba6f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ba76 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201109.503356:0:66313:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1788201109.503388:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fc800/0x96d0c9b8c9a1ba7d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.503405:0:66313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fc800/0x96d0c9b8c9a1ba7d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.503416:0:66313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fc800/0x96d0c9b8c9a1ba7d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201109.503432:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715166464:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1788201109.503466:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201109.503489:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fb116c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201109.503605:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715166464 00000100:00100000:2.0:1788201109.503610:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715166464 00000100:00100000:2.0:1788201109.503684:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3961 00000100:00100000:2.0:1788201109.503693:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66313:x1875060715166464:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1788201109.503707:0:23728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201109.503722:0:23728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1ba84 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ba7d expref: -99 pid: 23728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.503743:0:23728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1ba84 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ba7d expref: 8 pid: 23728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.503754:0:23728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1ba84 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ba7d expref: 8 pid: 23728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.503762:0:23728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff8dc12196e900) 00010000:00010000:2.0:1788201109.503765:0:23728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201109.503768:0:23728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc005da7400, rc 0) 00000100:00100000:2.0:1788201109.503810:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66313:x1875060715166464:12345-0@lo:101:mdt00_001.0 Request processed in 118us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201109.503816:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3961 00000100:00100000:1.0:1788201109.503870:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715166464:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1788201109.503884:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fc800/0x96d0c9b8c9a1ba7d lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ba84 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.503892:0:66313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fc800/0x96d0c9b8c9a1ba7d lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ba84 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201109.503902:0:66313:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1788201109.503946:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125640a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715166592:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201109.503974:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201109.510307:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc106470240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201109.517205:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715166592 00000100:00100000:3.0:1788201109.517226:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715166592 00000100:00100000:3.0:1788201109.517332:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3962 00000100:00100000:3.0:1788201109.517345:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66313:x1875060715166592:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788201109.517487:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66313:x1875060715166592:12345-0@lo:1000:mdt00_001.0 Request processed in 144us (13510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201109.517495:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3962 00000100:00100000:1.0:1788201109.517970:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125640a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715166592:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201109.518174:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715166720:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201109.518216:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201109.518249:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc106470240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201109.518264:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715166720 00000100:00100000:1.0:1788201109.518268:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715166720 00000100:00100000:1.0:1788201109.518331:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3963 00000100:00100000:1.0:1788201109.518339:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66313:x1875060715166720:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201109.518431:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66313:x1875060715166720:12345-0@lo:1000:mdt00_001.0 Request processed in 93us (214us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201109.518438:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3963 00000100:00100000:1.0:1788201109.518464:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715166720:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201109.518531:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715166848:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201109.518553:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201109.524476:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc106470240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201109.527172:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715166848 00000100:00100000:2.0:1788201109.527186:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715166848 00000100:00100000:2.0:1788201109.527240:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3964 00000100:00100000:2.0:1788201109.527251:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66313:x1875060715166848:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788201109.527396:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66313:x1875060715166848:12345-0@lo:1000:mdt00_001.0 Request processed in 147us (8841us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201109.527410:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3964 00000100:00100000:1.0:1788201109.527665:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715166848:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201109.527747:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715166976:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201109.527778:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201109.527807:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc106470240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201109.527820:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715166976 00000100:00100000:1.0:1788201109.527824:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715166976 00000100:00100000:1.0:1788201109.527848:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3965 00000100:00100000:1.0:1788201109.527854:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66313:x1875060715166976:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201109.527901:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66313:x1875060715166976:12345-0@lo:1000:mdt00_001.0 Request processed in 46us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201109.527908:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3965 00000100:00100000:1.0:1788201109.527930:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715166976:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201109.527963:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc2b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715167104:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201109.527981:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201109.527993:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc106470240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201109.528004:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715167104 00000100:00100000:1.0:1788201109.528637:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715167104 00000100:00100000:1.0:1788201109.528665:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3966 00000100:00100000:1.0:1788201109.528675:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66313:x1875060715167104:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201109.528744:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66313:x1875060715167104:12345-0@lo:1000:mdt00_001.0 Request processed in 69us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201109.528750:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3966 00000100:00100000:1.0:1788201109.528777:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc2b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715167104:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201109.528814:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc2b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715167232:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201109.528836:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201109.528848:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc106470240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201109.528857:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715167232 00000100:00100000:1.0:1788201109.528860:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715167232 00000100:00100000:1.0:1788201109.528875:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3967 00000100:00100000:1.0:1788201109.528880:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66313:x1875060715167232:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201109.528920:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66313:x1875060715167232:12345-0@lo:1000:mdt00_001.0 Request processed in 39us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201109.528926:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3967 00000100:00100000:1.0:1788201109.528949:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc2b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715167232:0@lo:1000:mdt00_001.0 00000040:00080000:1.0:1788201109.530566:0:66313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x1:0x0].6, 1000 off41872 00000040:00080000:1.0:1788201109.530625:0:66313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x1:0x0].5, 1152 off40504 00000004:00080000:1.0:1788201109.530631:0:66313:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc1064700c0 with version 16 00000004:00080000:3.0:1788201109.530796:0:75745:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc007566d80 version 16 rpc_version 16 00000020:00100000:3.0:1788201109.530826:0:75745:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788201109.530836:0:75745:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc0078e2680 x1875060715167488/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201109.530856:0:75745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e2680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715167488:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201109.530908:0:75745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201109.530941:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fb11900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201109.530993:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715167488 00000100:00100000:1.0:1788201109.530999:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715167488 00000100:00100000:1.0:1788201109.531192:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3968 00000100:00100000:1.0:1788201109.531201:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75745:x1875060715167488:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788201109.552304:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75745:x1875060715167488:12345-0@lo:1000:osp_up0-1.0 Request processed in 21097us (21388us total) trans 115964116996 rc 0/0 00000100:00100000:2.0:1788201109.552319:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3968 00000100:00100000:1.0:1788201109.552426:0:75745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e2680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715167488:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1788201109.552550:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6800/0x96d0c9b8c9a1ba8b lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.552567:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6800/0x96d0c9b8c9a1ba8b lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.552581:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6800/0x96d0c9b8c9a1ba8b lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201109.552599:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007931264f reply state 000000008600447e transno 77309411440 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6800/0x96d0c9b8c9a1ba8b lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.552611:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6800/0x96d0c9b8c9a1ba8b lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.552619:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc12196e000) 00010000:00010000:2.0:1788201109.552622:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201109.552626:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788201109.552631:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xe:0x0]: returning size 4096 00000004:00080000:2.0:1788201109.552640:0:66313:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1788201109.552651:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba6f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ba76 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.552659:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba6f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ba76 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.552678:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba6f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ba76 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.552701:0:66313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1788201109.552708:0:66313:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1788201109.552713:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fc800/0x96d0c9b8c9a1ba7d lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ba84 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.552720:0:66313:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fc800/0x96d0c9b8c9a1ba7d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ba84 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201109.552796:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+8:70975:x1875060695388416:12345-192.168.201.20@tcp:36:mkdir.0 Request processed in 63813us (64011us total) trans 77309411440 rc 0/0 00000100:00100000:2.0:1788201109.552804:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1305 00010000:00010000:1.0:1788201109.552958:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201109.552970:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba6f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1ba76 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.552978:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd800 already unused, calling callback (ffffffffc189cee0) 00010000:00010000:1.0:1788201109.552984:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba6f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1ba76 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201109.552992:0:24979:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba6f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1ba76 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.553055:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba6f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ba76 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.553061:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201109.553087:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba6f lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ba76 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.553093:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fd800/0x96d0c9b8c9a1ba6f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ba76 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.553120:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201109.553121:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201109.553123:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201109.553130:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201109.553143:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715167616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201109.553183:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201109.553604:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715167616 00000100:00100000:3.0:1788201109.553612:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715167616 00000100:00100000:3.0:1788201109.553657:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:3.0:1788201109.553667:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10a10f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3658:x1875060715167616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201109.553685:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201109.553705:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1ba76 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ba6f expref: 9 pid: 83817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.553717:0:26207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048bed00) 00010000:00010000:3.0:1788201109.553724:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201109.553764:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10a10f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3658:x1875060715167616:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201109.553771:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:2.0:1788201109.553900:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715167616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201109.609278:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201109.609999:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695388672 00000100:00100000:0.0:1788201109.610038:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695388672 00000100:00100000:0.0:1788201109.610099:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1306 00000100:00100000:0.0:1788201109.610119:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+8:70983:x1875060695388672:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788201109.610138:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201109.610157:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1ba92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786714 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.610219:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1ba99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.610251:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1ba99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.610262:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1ba99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201109.610309:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201109.610312:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201109.610331:0:66312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1ba99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.610352:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1ba92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786714 expref: 10 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.610368:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1ba99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786714 expref: 9 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.610376:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048be800) 00010000:00010000:0.0:1788201109.610379:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201109.610382:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782d400, rc 0) 00000100:00100000:0.0:1788201109.610438:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+9:70983:x1875060695388672:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 330us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201109.610445:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1306 00000100:00100000:0.0:1788201109.628975:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201109.629433:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695388800 00000100:00100000:3.0:1788201109.629444:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695388800 00000100:00100000:3.0:1788201109.629506:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1307 00000100:00100000:3.0:1788201109.629517:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+9:70983:x1875060695388800:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1788201109.629549:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201109.629570:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1baa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78671b expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.629636:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1baa7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.629650:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1baa7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.629660:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1baa7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.629670:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fce00/0x96d0c9b8c9a1baae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.629691:0:66757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1ba84 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ba7d expref: 7 pid: 23728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.629698:0:66757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fce00/0x96d0c9b8c9a1baae lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.629730:0:66757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1ba84 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1ba7d expref: 7 pid: 23728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201109.629744:0:66757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:66757:1875060715167744:0@lo:104: 00000100:00100000:3.0:1788201109.629789:0:66757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201109.629831:0:66757:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fb113c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201109.629849:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715167744 00000100:00100000:3.0:1788201109.629853:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715167744 00000100:00100000:3.0:1788201109.629881:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788201109.629887:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:66757:x1875060715167744:12345-0@lo:104: 00010000:00010000:3.0:1788201109.629899:0:19665:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fc800/0x96d0c9b8c9a1ba7d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1ba84 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.629943:0:19665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201109.629949:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:66757:x1875060715167744:12345-0@lo:104: Request processed in 62us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201109.629955:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00010000:00010000:3.0:1788201109.629975:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201109.629981:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fc800/0x96d0c9b8c9a1ba7d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1ba84 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.629999:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fc800 already unused, calling callback (ffffffffc189cee0) 00010000:00010000:3.0:1788201109.631118:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fc800/0x96d0c9b8c9a1ba7d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1ba84 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201109.631141:0:6520:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fc800/0x96d0c9b8c9a1ba7d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1ba84 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.631186:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fc800/0x96d0c9b8c9a1ba7d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1ba84 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.631193:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201109.631224:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fc800/0x96d0c9b8c9a1ba7d lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1ba84 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.631233:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0078fc800/0x96d0c9b8c9a1ba7d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1ba84 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.631255:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201109.631257:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201109.631259:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201109.631270:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201109.631292:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715167872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201109.631360:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201109.631413:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715167872 00000100:00100000:3.0:1788201109.631420:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715167872 00010000:00010000:3.0:1788201109.631445:0:26213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1ba84 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ba7d expref: 8 pid: 23728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201109.631492:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2558 00000100:00100000:3.0:1788201109.631501:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3657:x1875060715167872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201109.631513:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788201109.631591:0:66757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:66757:1875060715167744:0@lo:104: 00010000:00010000:3.0:1788201109.631612:0:66757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fce00/0x96d0c9b8c9a1baae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201109.634253:0:91097:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116996 is committed 00010000:00010000:3.0:1788201109.634360:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1ba84 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ba7d expref: 7 pid: 23728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.635136:0:26213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff8dc12196e900) 00010000:00010000:3.0:1788201109.635142:0:26213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fce00/0x96d0c9b8c9a1baae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.635152:0:26213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fce00/0x96d0c9b8c9a1baae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.635159:0:26213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fce00/0x96d0c9b8c9a1baae lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.635192:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201109.635282:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715167872:12345-0@lo:103:ldlm_bl.0 Request processed in 3780us (3919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201109.635291:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2558 00000100:00100000:3.0:1788201109.635351:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715167872:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201109.635403:0:66757:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fce00/0x96d0c9b8c9a1baae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.635424:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fce00/0x96d0c9b8c9a1baae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201109.635534:0:66757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc2b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:66757:1875060715168000:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788201109.635575:0:66757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201109.635603:0:66757:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc106470000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201109.635733:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715168000 00000100:00100000:3.0:1788201109.635744:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715168000 00000100:00100000:3.0:1788201109.635854:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3969 00000100:00100000:3.0:1788201109.635862:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66757:x1875060715168000:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788201109.635922:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66757:x1875060715168000:12345-0@lo:1000:mdt00_003.0 Request processed in 61us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201109.635928:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3969 00000100:00100000:1.0:1788201109.636220:0:66757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc2b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:66757:1875060715168000:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788201109.636265:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1bab5 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.636276:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1bab5 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.636285:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1bab5 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201109.636307:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1bab5 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.636322:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1baa7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.636329:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1baa7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.636334:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1baa7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.636341:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1baa7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.636357:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201109.636362:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1baa7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.636371:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1baa7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.636383:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048be800) 00010000:00010000:1.0:1788201109.636386:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201109.636390:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1baa7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.636396:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1baa7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.636408:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fce00/0x96d0c9b8c9a1baae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.636414:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fce00/0x96d0c9b8c9a1baae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.636420:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fce00/0x96d0c9b8c9a1baae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.636425:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fce00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201109.636427:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fce00/0x96d0c9b8c9a1baae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.636433:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fce00/0x96d0c9b8c9a1baae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.636450:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff8dc12196e900) 00010000:00010000:1.0:1788201109.636453:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201109.636456:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fce00/0x96d0c9b8c9a1baae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.636462:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fce00/0x96d0c9b8c9a1baae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.636498:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1baa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78671b expref: 11 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.636513:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1bab5 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78671b expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.636521:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc103b47200) 00010000:00010000:1.0:1788201109.636523:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201109.636525:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064eca00, rc 0) 00000100:00100000:1.0:1788201109.636745:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+10:70983:x1875060695388800:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 7229us (7782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201109.636753:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1307 00000100:00100000:1.0:1788201109.639287:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201109.639822:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695388928 00000100:00100000:3.0:1788201109.639833:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695388928 00000100:00100000:3.0:1788201109.639925:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1308 00000100:00100000:3.0:1788201109.639936:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+8:70983:x1875060695388928:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1788201109.639962:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201109.639980:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1babc lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786722 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.640361:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc800/0x96d0c9b8c9a1bac3 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.640377:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc800/0x96d0c9b8c9a1bac3 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.640389:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc800/0x96d0c9b8c9a1bac3 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201109.640444:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xe:0x0]: returning size 4096 00000004:00200000:3.0:1788201109.640448:0:66313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1788201109.640482:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1babc lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786722 expref: 10 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.640495:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc800/0x96d0c9b8c9a1bac3 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786722 expref: 9 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.640513:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc12196e000) 00010000:00010000:3.0:1788201109.640516:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1788201109.640520:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fc800, rc 0) 00000100:00100000:2.0:1788201109.642196:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+9:70983:x1875060695388928:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 2253us (2910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201109.642490:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1308 00000100:00100000:3.0:1788201109.645517:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201109.646100:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695389056 00000100:00100000:2.0:1788201109.646120:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695389056 00000100:00100000:2.0:1788201109.646178:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1309 00000100:00100000:2.0:1788201109.646189:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+9:70983:x1875060695389056:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1788201109.646218:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201109.646237:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6e00/0x96d0c9b8c9a1baca lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786729 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.646314:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1bad1 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.646327:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1bad1 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.646338:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1bad1 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.646390:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7c00/0x96d0c9b8c9a1bad8 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.646397:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7c00/0x96d0c9b8c9a1bad8 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.646404:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7c00/0x96d0c9b8c9a1bad8 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.646444:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1bad1 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.646451:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1bad1 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.646457:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1bad1 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.646464:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1bad1 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.646469:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc005da7400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201109.646478:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1bad1 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.646485:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1bad1 lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.646497:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc12196e000) 00010000:00010000:2.0:1788201109.646500:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201109.646504:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1bad1 lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.646511:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7400/0x96d0c9b8c9a1bad1 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.646524:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7c00/0x96d0c9b8c9a1bad8 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.646529:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7c00/0x96d0c9b8c9a1bad8 lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.646534:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7c00/0x96d0c9b8c9a1bad8 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.646540:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc005da7c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201109.646542:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7c00/0x96d0c9b8c9a1bad8 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.646547:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7c00/0x96d0c9b8c9a1bad8 lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.646554:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0xf7117594 (ffff8dc12196ee00) 00010000:00010000:2.0:1788201109.646556:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201109.646564:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7c00/0x96d0c9b8c9a1bad8 lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.646569:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7c00/0x96d0c9b8c9a1bad8 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.646602:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6e00/0x96d0c9b8c9a1baca lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786729 expref: 10 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.646612:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc12196e000) 00010000:00010000:2.0:1788201109.646614:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201109.646618:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6e00/0x96d0c9b8c9a1baca lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786729 expref: 10 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.646626:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc005da6e00, rc 0) 00000100:00100000:2.0:1788201109.646690:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+9:70983:x1875060695389056:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 502us (1181us total) trans 0 rc 301/301 00000100:00100000:2.0:1788201109.646697:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1309 00000100:00100000:3.0:1788201109.654435:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201109.654616:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695389184 00000100:00100000:1.0:1788201109.654628:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695389184 00000100:00100000:1.0:1788201109.654736:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1310 00000100:00100000:1.0:1788201109.654748:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+9:70983:x1875060695389184:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1788201109.654771:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201109.654797:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1badf lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786730 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.654891:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1bae6 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.654906:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1bae6 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.654917:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1bae6 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.654931:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1baed lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.654937:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1baed lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.654943:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1baed lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.654993:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1bae6 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.654999:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1bae6 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.655047:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1bae6 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.655054:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1bae6 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.655060:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201109.655070:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1bae6 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.655077:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1bae6 lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.655089:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc12196e000) 00010000:00010000:1.0:1788201109.655092:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201109.655096:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1bae6 lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.655103:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1bae6 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.655128:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1baed lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.655134:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1baed lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.655139:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1baed lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.655144:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ece00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201109.655146:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1baed lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.655152:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1baed lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.655159:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0xf7117594 (ffff8dc103b47300) 00010000:00010000:1.0:1788201109.655161:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201109.655169:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1baed lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.655175:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1baed lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.655216:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1badf lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786730 expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.655227:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc12196e000) 00010000:00010000:1.0:1788201109.655229:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201109.655233:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1badf lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786730 expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.655242:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064edc00, rc 0) 00000100:00100000:1.0:1788201109.655306:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+9:70983:x1875060695389184:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 559us (886us total) trans 0 rc 301/301 00000100:00100000:1.0:1788201109.655312:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1310 00000100:00100000:0.0:1788201109.659275:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201109.659342:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695389312 00000100:00100000:2.0:1788201109.659353:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695389312 00000100:00100000:2.0:1788201109.659422:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1311 00000100:00100000:2.0:1788201109.659432:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+9:70983:x1875060695389312:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1788201109.659452:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201109.659473:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6e00/0x96d0c9b8c9a1baf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786737 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.659549:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7c00/0x96d0c9b8c9a1bafb lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.659583:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7c00/0x96d0c9b8c9a1bafb lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.659596:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7c00/0x96d0c9b8c9a1bafb lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201109.659642:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xe:0x0]: returning size 4096 00000004:00200000:2.0:1788201109.659646:0:66313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201109.659665:0:66313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7c00/0x96d0c9b8c9a1bafb lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.659696:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6e00/0x96d0c9b8c9a1baf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786737 expref: 11 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.659719:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7c00/0x96d0c9b8c9a1bafb lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786737 expref: 10 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.659728:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc12196e000) 00010000:00010000:2.0:1788201109.659731:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788201109.659735:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc005da7c00, rc 0) 00000100:00100000:2.0:1788201109.660171:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4292087e-fa00-4621-b681-837afc99ae35+10:70983:x1875060695389312:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 739us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201109.660179:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1311 00000100:00100000:3.0:1788201109.673540:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201109.673608:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695389568 00000100:00100000:2.0:1788201109.673618:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695389568 00000100:00100000:2.0:1788201109.673680:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1312 00000100:00100000:2.0:1788201109.673690:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+10:70983:x1875060695389568:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1788201109.673710:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201109.673742:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6e00/0x96d0c9b8c9a1bb02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78673e expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201109.673839:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xe:0x0]: returning size 4096 00010000:00010000:2.0:1788201109.673950:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6e00/0x96d0c9b8c9a1bb02 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78673e expref: 12 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.673962:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12196ee00) 00010000:00010000:2.0:1788201109.673964:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201109.673968:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6e00/0x96d0c9b8c9a1bb02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78673e expref: 12 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201109.673980:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc005da6e00, rc 0) 00000100:00100000:2.0:1788201109.674063:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4292087e-fa00-4621-b681-837afc99ae35+11:70983:x1875060695389568:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 374us (534us total) trans 77309411441 rc 301/301 00000100:00100000:2.0:1788201109.674068:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1312 00000100:00100000:0.0:1788201109.682212:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201109.682318:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695389824 00000100:00100000:3.0:1788201109.682328:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695389824 00000100:00100000:3.0:1788201109.682389:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1313 00000100:00100000:3.0:1788201109.682399:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+11:70983:x1875060695389824:12345-192.168.201.20@tcp:36:lfs.0 00010000:00010000:3.0:1788201109.682464:0:69485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201109.682488:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7c00/0x96d0c9b8c9a1bafb lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786737 expref: 11 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.682507:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc12196e000) 00010000:00010000:3.0:1788201109.682512:0:69485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201109.682588:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1bb10 lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.682602:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1bb10 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.682612:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1bb10 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.682627:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1bb17 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.682652:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1bb17 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.682660:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1bb17 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.683859:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1bb1e lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.684524:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1bb1e lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.684626:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1bb1e lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201109.684646:0:69485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6705f02 reply state 00000000b9294553 transno 77309411442 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1bb1e lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.684657:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1bb1e lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.684665:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xf:0x0].0x0 (ffff8dc0048bee00) 00010000:00010000:0.0:1788201109.684667:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201109.684671:0:69485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788201109.684677:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xf:0x0]: returning size 4096 00010000:00010000:0.0:1788201109.684687:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1bb10 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.684693:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1bb10 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.684699:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1bb10 lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.684706:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1bb10 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.684711:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201109.684715:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1bb10 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.684732:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1bb10 lrc: 5/0,0 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.684743:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc12196e000) 00010000:00010000:0.0:1788201109.684745:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201109.684749:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1bb10 lrc: 3/0,0 mode: --/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.684755:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1bb10 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201109.684768:0:69485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6705f02 reply state 00000000b9294553 transno 77309411442 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1bb17 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.684777:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1bb17 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.684782:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0xf7117594 (ffff8dc125aec400) 00010000:00010000:0.0:1788201109.684784:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201109.684787:0:69485:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788201109.684973:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4292087e-fa00-4621-b681-837afc99ae35+12:70983:x1875060695389824:12345-192.168.201.20@tcp:36:lfs.0 Request processed in 2574us (2770us total) trans 77309411442 rc 0/0 00000100:00100000:0.0:1788201109.684981:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1313 00000100:00100000:3.0:1788201109.686965:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201109.687226:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695390080 00000100:00100000:2.0:1788201109.687236:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695390080 00000100:00100000:2.0:1788201109.687296:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 230 00000100:00100000:2.0:1788201109.687307:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4292087e-fa00-4621-b681-837afc99ae35+12:70983:x1875060695390080:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:2.0:1788201109.687512:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4292087e-fa00-4621-b681-837afc99ae35+13:70983:x1875060695390080:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 206us (552us total) trans 77309411443 rc 0/0 00000100:00100000:2.0:1788201109.687519:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 230 00000100:00100000:3.0:1788201109.733327:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201109.733367:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201109.733391:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201109.733431:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201109.733462:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695390720 00000100:00100000:3.0:1788201109.733471:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695390720 00000100:00100000:0.0:1788201109.733502:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695390208 00000100:00100000:0.0:1788201109.733506:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695390208 00000100:00100000:0.0:1788201109.733538:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695390336 00000100:00100000:0.0:1788201109.733541:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695390336 00000100:00100000:3.0:1788201109.733542:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5896 00000100:00100000:3.0:1788201109.733552:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:4292087e-fa00-4621-b681-837afc99ae35+7:2399:x1875060695390720:12345-192.168.201.20@tcp:9:umount.0 00000100:00100000:0.0:1788201109.733557:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695390848 00000100:00100000:0.0:1788201109.733558:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695390848 00000100:00100000:0.0:1788201109.733575:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 696 00000020:00000080:3.0:1788201109.733580:0:26211:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b402 00000020:00010000:3.0:1788201109.733587:0:26211:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc0078de800: total 0 00000100:00080000:3.0:1788201109.733591:0:26211:0:(import.c:65:import_set_state_nolock()) ffff8dc0053a7000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788201109.733592:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133332680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:0fa559bc-2180-4019-80c4-11831fedf9a9+12:2402:x1875060695390208:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201109.733603:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201109.733621:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007a2d600/0x96d0c9b8c9a1b712 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866e3 expref: 12 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1788201109.733631:0:26211:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969453 00010000:00010000:0.0:1788201109.733637:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201109.733683:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133332680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:0fa559bc-2180-4019-80c4-11831fedf9a9+11:2402:x1875060695390208:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 92us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201109.733690:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 696 00000100:00100000:0.0:1788201109.733705:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 697 00000100:00100000:0.0:1788201109.733711:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133332300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:0fa559bc-2180-4019-80c4-11831fedf9a9+10:2402:x1875060695390336:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201109.733718:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201109.733726:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007a2c400/0x96d0c9b8c9a1b70b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866dc expref: 10 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.733735:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201109.733739:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:4292087e-fa00-4621-b681-837afc99ae35+5:2399:x1875060695390720:12345-192.168.201.20@tcp:9:umount.0 Request processed in 189us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201109.733746:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5896 00000100:00100000:0.0:1788201109.733747:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133332300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:0fa559bc-2180-4019-80c4-11831fedf9a9+9:2402:x1875060695390336:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 37us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201109.733753:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 697 00000100:00100000:0.0:1788201109.733762:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 698 00000100:00080000:3.0:1788201109.733763:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201109.733768:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133331880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:0fa559bc-2180-4019-80c4-11831fedf9a9+8:2400:x1875060695390848:12345-192.168.201.20@tcp:103:ldlm_bl.0 00000020:00010000:3.0:1788201109.733773:0:6521:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc0078de800: total 0 00010000:00010000:0.0:1788201109.733775:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201109.733776:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201109.733784:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1b719 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866ea expref: 8 pid: 91103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.733793:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201109.733795:0:6521:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc0078de800, canceled 0 locks, left on hash table 2. 00000100:00100000:0.0:1788201109.733812:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133331880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:0fa559bc-2180-4019-80c4-11831fedf9a9+7:2400:x1875060695390848:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 46us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201109.733818:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 698 00010000:00010000:3.0:1788201109.733834:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f9ea44f/0x96d0c9b8c9a1b544 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866b2 expref: 4 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.733889:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc7b5a1b/0x96d0c9b8c9a1b552 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866c0 expref: 3 pid: 26212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.733903:0:6521:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc0078de800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788201109.733915:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201109.733917:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201109.733919:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201109.740441:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201109.741942:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695391104 00000100:00100000:1.0:1788201109.741955:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695391104 00000100:00080000:3.0:1788201109.742011:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201109.742061:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5897 00000100:00100000:1.0:1788201109.742074:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:4292087e-fa00-4621-b681-837afc99ae35+6:2399:x1875060695391104:12345-192.168.201.20@tcp:9:umount.0 00000020:00000080:1.0:1788201109.742131:0:26212:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b3fb 00000020:00010000:1.0:1788201109.742139:0:26212:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc0078db800: total 0 00000100:00080000:1.0:1788201109.742144:0:26212:0:(import.c:65:import_set_state_nolock()) ffff8dc0078dc800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788201109.742200:0:26212:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969454 00000020:00010000:3.0:1788201109.742224:0:13349:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc0078db800: total 0 00010000:00010000:3.0:1788201109.742264:0:13349:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc0078db800, canceled 0 locks, left on hash table 1. 00002000:00010000:3.0:1788201109.742294:0:13349:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x322:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:3.0:1788201109.742297:0:13349:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x322:0x0] updating lvb atime from disk: 0 -> 1788201047 00002000:00010000:3.0:1788201109.742300:0:13349:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x322:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:3.0:1788201109.742325:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffeeb63e/0x96d0c9b8c9a1b54b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866b9 expref: 4 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.742349:0:13349:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc0078db800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788201109.742366:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201109.742368:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201109.742370:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201109.742403:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:4292087e-fa00-4621-b681-837afc99ae35+2:2399:x1875060695391104:12345-192.168.201.20@tcp:9:umount.0 Request processed in 332us (1970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201109.742411:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5897 00000100:00100000:0.0:1788201109.752171:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201109.752269:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695391616 00000100:00100000:1.0:1788201109.752280:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695391616 00000100:00100000:1.0:1788201109.752372:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1314 00000100:00100000:1.0:1788201109.752381:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+10:2399:x1875060695391616:12345-192.168.201.20@tcp:39:umount.0 00000020:00000080:1.0:1788201109.752415:0:66757:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b655 00000020:00010000:1.0:1788201109.752428:0:66757:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc001db0800: total 0 00000100:00080000:1.0:1788201109.752433:0:66757:0:(import.c:65:import_set_state_nolock()) ffff8dc12f19b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788201109.752464:0:66757:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 115964116996 00000100:00100000:1.0:1788201109.752606:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4292087e-fa00-4621-b681-837afc99ae35+8:2399:x1875060695391616:12345-192.168.201.20@tcp:39:umount.0 Request processed in 226us (445us total) trans 115964116997 rc 0/0 00000100:00100000:1.0:1788201109.752612:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1314 00000020:00010000:3.0:1788201109.752657:0:24979:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc001db0800: total 0 00010000:00010000:3.0:1788201109.752696:0:24979:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc001db0800, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1788201109.752723:0:24979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048be800) 00010000:00010000:3.0:1788201109.752726:0:24979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201109.752731:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1ba99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786714 expref: 7 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.752766:0:24979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8dc103a1ea00) 00010000:00010000:3.0:1788201109.752769:0:24979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201109.752771:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1ba61 lrc: 0/0,0 mode: --/PR res: [0x20000afe1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78670d expref: 6 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.752780:0:24979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc103b47200) 00010000:00010000:3.0:1788201109.752781:0:24979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201109.752783:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1bab5 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78671b expref: 5 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.752792:0:24979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000afe1:0x9:0x0].0x0 (ffff8dc103a1ea00) 00010000:00010000:3.0:1788201109.752793:0:24979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1788201109.752795:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12f338000/0x96d0c9b8c9a1b838 lrc: 0/0,0 mode: --/CR res: [0x20000afe1:0x9:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866ab expref: 4 pid: 91129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.752805:0:24979:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc001db0800, canceled 4 locks, left on hash table 0. 00010000:00010000:3.0:1788201109.752813:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201109.752815:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201109.752816:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201109.765865:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201109.766152:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695391872 00000100:00100000:1.0:1788201109.766162:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695391872 00000100:00100000:1.0:1788201109.766349:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1315 00000100:00100000:1.0:1788201109.766361:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+13:2399:x1875060695391872:12345-192.168.201.20@tcp:39:umount.0 00000020:00000080:1.0:1788201109.766404:0:66312:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a16382 00000020:00010000:1.0:1788201109.766430:0:66312:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc0053a4800: total 0 00000100:00080000:1.0:1788201109.766434:0:66312:0:(import.c:65:import_set_state_nolock()) ffff8dc003b68000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788201109.766480:0:66312:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411443 00000020:00010000:3.0:1788201109.766624:0:6520:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc0053a4800: total 0 00000100:00100000:1.0:1788201109.766630:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4292087e-fa00-4621-b681-837afc99ae35+11:2399:x1875060695391872:12345-192.168.201.20@tcp:39:umount.0 Request processed in 272us (779us total) trans 77309411444 rc 0/0 00000100:00100000:1.0:1788201109.766638:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1315 00010000:00010000:3.0:1788201109.766673:0:6520:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc0053a4800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788201109.766704:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6800/0x96d0c9b8c9a1ba8b lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.766717:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6800/0x96d0c9b8c9a1ba8b lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.766724:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6800/0x96d0c9b8c9a1ba8b lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.766847:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1bb17 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.766855:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1bb17 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.766944:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1bb17 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.766950:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fdc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201109.766954:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1bb17 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.766962:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1bb17 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.766973:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0xf7117594 (ffff8dc125aec400) 00010000:00010000:1.0:1788201109.767075:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201109.767080:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1bb17 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.767087:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fdc00/0x96d0c9b8c9a1bb17 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.767119:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1bb1e lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.767125:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1bb1e lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.767131:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1bb1e lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.767136:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782de00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201109.767139:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1bb1e lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.767154:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1bb1e lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.767162:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xf:0x0].0x0 (ffff8dc0048bee00) 00010000:00010000:1.0:1788201109.767165:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201109.767168:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1bb1e lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201109.767174:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1bb1e lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.769162:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc12196e000) 00010000:00010000:3.0:1788201109.769171:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1788201109.769183:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc800/0x96d0c9b8c9a1bac3 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786722 expref: 9 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.769211:0:6520:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc0053a4800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788201109.769255:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201109.769257:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201109.769260:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201109.771187:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc005da6800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201109.771200:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6800/0x96d0c9b8c9a1ba8b lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.771496:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6800/0x96d0c9b8c9a1ba8b lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.771515:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc12196e000) 00010000:00010000:0.0:1788201109.771518:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201109.771523:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6800/0x96d0c9b8c9a1ba8b lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201109.771530:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6800/0x96d0c9b8c9a1ba8b lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201109.805872:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201109.805996:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695392128 00000100:00100000:1.0:1788201109.806054:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695392128 00000100:00100000:1.0:1788201109.806114:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 82 00000100:00100000:1.0:1788201109.806125:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+7:2399:x1875060695392128:12345-192.168.201.20@tcp:251:umount.0 00000020:00000080:1.0:1788201109.806169:0:91102:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b5e5 00000020:00010000:1.0:1788201109.806178:0:91102:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc005d77800: total 0 00000100:00080000:1.0:1788201109.806183:0:91102:0:(import.c:65:import_set_state_nolock()) ffff8dc005d70800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788201109.806303:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0fa559bc-2180-4019-80c4-11831fedf9a9+3:2399:x1875060695392128:12345-192.168.201.20@tcp:251:umount.0 Request processed in 178us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201109.806310:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 82 00000020:00010000:3.0:1788201109.806611:0:6521:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc005d77800: total 0 00010000:00010000:3.0:1788201109.806616:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201109.806663:0:6521:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc005d77800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788201109.806692:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007a2dc00/0x96d0c9b8c9a1b720 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7866f1 expref: 2 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201109.806705:0:6521:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc005d77800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788201109.806714:0:6521:0:(genops.c:885:class_export_put()) final put ffff8dc005d77800/0fa559bc-2180-4019-80c4-11831fedf9a9 00010000:00010000:3.0:1788201109.806731:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201109.806733:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201109.806735:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201109.806764:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005d77800/0fa559bc-2180-4019-80c4-11831fedf9a9 for MGS 00000020:00000080:1.0:1788201109.806797:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc005d70800 for MGS 00010000:00010000:1.0:1788201110.287670:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201110.864247:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715168128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201110.864320:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201110.864379:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715168128 00000100:00100000:3.0:1788201110.864388:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715168128 00000100:00100000:3.0:1788201110.864446:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3970 00000100:00100000:3.0:1788201110.864455:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715168128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788201110.864486:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445392384 avail 1299152896 00000100:00100000:3.0:1788201110.864542:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715168128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201110.864549:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3970 00000100:00100000:3.0:1788201110.864594:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715168128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201110.864703:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715168384:0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.864730:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201110.864764:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715168896:0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.864784:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201110.864799:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715169408:0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.864819:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201110.864839:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788201110.864844:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715168512:0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.864878:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201110.864895:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715169024:0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.864914:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201110.864931:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715169536:0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.864950:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201110.864977:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715168384 00000100:00100000:3.0:1788201110.864981:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715168384 00000100:00100000:3.0:1788201110.865037:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715168512 00000100:00100000:3.0:1788201110.865041:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715168512 00000100:00100000:3.0:1788201110.865069:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:3.0:1788201110.865076:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715168384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.865123:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715168384:12345-0@lo:400:kworker.0 Request processed in 47us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201110.865130:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:3.0:1788201110.865142:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:3.0:1788201110.865147:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715168512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.865170:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715168512:12345-0@lo:400:kworker.0 Request processed in 23us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201110.865175:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00100000:3.0:1788201110.865191:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715168896 00000100:00100000:3.0:1788201110.865199:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715168896 00000100:00100000:3.0:1788201110.865222:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3971 00000100:00100000:3.0:1788201110.865227:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715168896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.865256:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715168896:12345-0@lo:400:kworker.0 Request processed in 29us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201110.865261:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3971 00000100:00100000:3.0:1788201110.865279:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715169408 00000100:00100000:3.0:1788201110.865282:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715169408 00000100:00100000:3.0:1788201110.865304:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715169024 00000100:00100000:3.0:1788201110.865307:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715169024 00000100:00100000:3.0:1788201110.865322:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715169536 00000100:00100000:3.0:1788201110.865324:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715169536 00000100:00100000:3.0:1788201110.865340:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2792 00000100:00100000:3.0:1788201110.865346:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715169408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.865374:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715169408:12345-0@lo:400:kworker.0 Request processed in 28us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201110.865380:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2792 00000100:00100000:3.0:1788201110.865389:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2793 00000100:00100000:3.0:1788201110.865395:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715169024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.865418:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715169024:12345-0@lo:400:kworker.0 Request processed in 24us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201110.865423:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2793 00000100:00100000:3.0:1788201110.865434:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2794 00000100:00100000:3.0:1788201110.865439:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715169536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.865462:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715169536:12345-0@lo:400:kworker.0 Request processed in 23us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201110.865467:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2794 00000100:00080000:3.0:1788201110.865498:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201110.865502:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201110.865504:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201110.865506:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201110.865528:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715168256:0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.865556:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201110.865579:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715168768:0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.865600:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201110.865616:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715169280:0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.865633:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201110.865648:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788201110.865653:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715168640:0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.865675:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201110.865689:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715169152:0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.865708:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201110.865724:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715169664:0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.865741:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201110.865762:0:91107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715168256 00000100:00100000:3.0:1788201110.865765:0:91107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715168256 00000100:00100000:3.0:1788201110.865789:0:91107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788201110.865795:0:91107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715168256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.865824:0:91107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715168256:12345-0@lo:400:kworker.0 Request processed in 30us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201110.865829:0:91107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788201110.865854:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715168768 00000100:00100000:3.0:1788201110.865858:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715168768 00000100:00100000:3.0:1788201110.865886:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715169280 00000100:00100000:3.0:1788201110.865889:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715169280 00000100:00100000:3.0:1788201110.865898:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715168640 00000100:00100000:3.0:1788201110.865900:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715168640 00000100:00100000:3.0:1788201110.865910:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715169664 00000100:00100000:3.0:1788201110.865912:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715169664 00000100:00100000:3.0:1788201110.865923:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1353 00000100:00100000:3.0:1788201110.865929:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715168768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.865956:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715168768:12345-0@lo:400:kworker.0 Request processed in 27us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201110.865962:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1353 00000100:00100000:3.0:1788201110.865974:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:3.0:1788201110.865980:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715169280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.866003:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715169280:12345-0@lo:400:kworker.0 Request processed in 24us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201110.866008:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00100000:3.0:1788201110.866041:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:3.0:1788201110.866048:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715168640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.866073:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715168640:12345-0@lo:400:kworker.0 Request processed in 26us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201110.866078:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:3.0:1788201110.866102:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:3.0:1788201110.866108:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715169664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.866131:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715169664:12345-0@lo:400:kworker.0 Request processed in 24us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201110.866135:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:3.0:1788201110.866154:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715169152 00000100:00100000:3.0:1788201110.866162:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715169152 00000100:00100000:3.0:1788201110.866188:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2795 00000100:00100000:3.0:1788201110.866194:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715169152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.866219:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715169152:12345-0@lo:400:kworker.0 Request processed in 26us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201110.866225:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2795 00000100:00080000:3.0:1788201110.866245:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201110.866248:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201110.866249:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201110.866274:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715168640:0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.866283:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715169152:0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.866292:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715169664:0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.866299:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715168256:0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.866307:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715168768:0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.866315:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715169280:0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.866345:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715168512:0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.866355:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715169024:0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.866364:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715169536:0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.866372:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715168384:0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.866380:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116996 gen 3 00000004:00080000:3.0:1788201110.866384:0:3657:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116996 committed transno 115964116996 00000100:00100000:3.0:1788201110.866400:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715168896:0@lo:400:kworker.0 00000100:00100000:3.0:1788201110.866418:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715169408:0@lo:400:kworker.0 00000100:00100000:1.0:1788201110.946521:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201110.946620:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695392256 00000100:00100000:0.0:1788201110.946643:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695392256 00000100:00100000:0.0:1788201110.946687:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 84 00000100:00100000:0.0:1788201110.946695:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2399:x1875060695392256:12345-192.168.201.20@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788201110.946722:0:91102:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 93ba7067-43b5-4e46-8db7-27c040fa03d9@192.168.201.20@tcp t0 exp 0000000000000000 cur 3962 last 0 00000020:00000080:0.0:1788201110.946749:0:91102:0:(genops.c:1385:class_connect()) connect: client 93ba7067-43b5-4e46-8db7-27c040fa03d9, cookie 0x96d0c9b8c9a1bb25 00000100:00080000:0.0:1788201110.946796:0:91102:0:(import.c:65:import_set_state_nolock()) ffff8dc103483800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201110.946961:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+5:2399:x1875060695392256:12345-192.168.201.20@tcp:250:mount.lustre.0 Request processed in 265us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201110.946970:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 84 00000100:00100000:3.0:1788201110.952595:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201110.961365:0:91107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695392384 00000100:00100000:0.0:1788201110.961381:0:91107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695392384 00000100:00100000:1.0:1788201110.961602:0:91107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00100000:1.0:1788201110.961615:0:91107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+5:71006:x1875060695392384:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788201110.961648:0:91107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201110.961665:0:91107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064ece00/0x96d0c9b8c9a1bb2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786753 expref: -99 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201110.961694:0:91107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ece00/0x96d0c9b8c9a1bb2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786753 expref: 6 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201110.961704:0:91107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064ece00/0x96d0c9b8c9a1bb2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786753 expref: 6 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201110.961713:0:91107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ece00, rc 0) 00000100:00100000:1.0:1788201110.961780:0:91107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+6:71006:x1875060695392384:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 167us (9194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201110.961788:0:91107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00100000:2.0:1788201110.980380:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201110.980540:0:91103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695392512 00000100:00100000:1.0:1788201110.980551:0:91103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695392512 00000100:00100000:1.0:1788201110.980614:0:91103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00100000:1.0:1788201110.980624:0:91103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+6:71006:x1875060695392512:12345-192.168.201.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788201110.980744:0:91103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+6:71006:x1875060695392512:12345-192.168.201.20@tcp:501:mount.lustre.0 Request processed in 121us (374us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201110.980752:0:91103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00100000:0.0:1788201110.989646:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201110.989745:0:91107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695392640 00000100:00100000:1.0:1788201110.989755:0:91107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695392640 00000100:00100000:1.0:1788201110.989809:0:91107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 87 00000100:00100000:1.0:1788201110.989819:0:91107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+6:71006:x1875060695392640:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788201110.989835:0:91107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201110.989873:0:91107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1bb33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78675a expref: -99 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201110.989900:0:91107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1bb33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78675a expref: 7 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201110.989910:0:91107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1bb33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78675a expref: 7 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201110.989920:0:91107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ed600, rc 0) 00000100:00100000:1.0:1788201110.989975:0:91107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+7:71006:x1875060695392640:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 157us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201110.989982:0:91107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 87 00000100:00100000:3.0:1788201110.992876:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201110.993006:0:91103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695392768 00000100:00100000:1.0:1788201110.993051:0:91103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695392768 00000100:00100000:1.0:1788201110.993110:0:91103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 88 00000100:00100000:1.0:1788201110.993120:0:91103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+7:71006:x1875060695392768:12345-192.168.201.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788201110.993287:0:91103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71006:x1875060695392768:12345-192.168.201.20@tcp:501:mount.lustre.0 Request processed in 168us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201110.993294:0:91103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 88 00000100:00100000:2.0:1788201110.996343:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201110.996940:0:91107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695392896 00000100:00100000:1.0:1788201110.996950:0:91107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695392896 00000100:00100000:1.0:1788201110.997007:0:91107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 89 00000100:00100000:1.0:1788201110.997138:0:91107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71006:x1875060695392896:12345-192.168.201.20@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788201110.997321:0:91107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71006:x1875060695392896:12345-192.168.201.20@tcp:503:mount.lustre.0 Request processed in 305us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201110.997329:0:91107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 89 00000100:00100000:2.0:1788201111.007557:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201111.007864:0:91103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695393024 00000100:00100000:1.0:1788201111.007875:0:91103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695393024 00000100:00100000:1.0:1788201111.007952:0:91103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 90 00000100:00100000:1.0:1788201111.007962:0:91103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71025:x1875060695393024:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788201111.008150:0:91103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71025:x1875060695393024:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 190us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201111.008158:0:91103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 90 00000100:00100000:2.0:1788201111.068454:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201111.068634:0:91104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695393152 00000100:00100000:3.0:1788201111.068644:0:91104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695393152 00000100:00100000:3.0:1788201111.068707:0:91104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 91 00000100:00100000:3.0:1788201111.068719:0:91104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107670450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71025:x1875060695393152:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788201111.068872:0:91104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107670450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71025:x1875060695393152:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 155us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201111.068881:0:91104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 91 00000100:00100000:2.0:1788201111.080650:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201111.081365:0:91103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695393280 00000100:00100000:1.0:1788201111.081378:0:91103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695393280 00000100:00100000:1.0:1788201111.081448:0:91103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 92 00000100:00100000:1.0:1788201111.081458:0:91103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71025:x1875060695393280:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788201111.081608:0:91103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71025:x1875060695393280:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 150us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201111.081616:0:91103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 92 00000100:00100000:2.0:1788201111.089575:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201111.089670:0:91104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695393408 00000100:00100000:3.0:1788201111.089680:0:91104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695393408 00000100:00100000:3.0:1788201111.089740:0:91104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 93 00000100:00100000:3.0:1788201111.089751:0:91104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71006:x1875060695393408:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788201111.089768:0:91104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201111.089788:0:91104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1bb3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78678b expref: -99 pid: 91104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201111.089814:0:91104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1bb3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78678b expref: 9 pid: 91104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201111.089826:0:91104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1bb3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78678b expref: 9 pid: 91104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201111.089836:0:91104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fda00, rc 0) 00000100:00100000:3.0:1788201111.089915:0:91104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71006:x1875060695393408:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 158us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201111.089936:0:91104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 93 00000100:00100000:2.0:1788201111.093144:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201111.093247:0:91103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695393536 00000100:00100000:1.0:1788201111.093256:0:91103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695393536 00000100:00100000:1.0:1788201111.093363:0:91103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 94 00000100:00100000:1.0:1788201111.093374:0:91103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc008e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71006:x1875060695393536:12345-192.168.201.20@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788201111.093410:0:91103:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788201111.093435:0:91103:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788201111.093439:0:91103:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788201111.093442:0:91103:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788201111.093445:0:91103:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788201111.093448:0:91103:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 119 00000100:00100000:1.0:1788201111.096836:0:91103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc008e86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71006:x1875060695393536:12345-192.168.201.20@tcp:256:mount.lustre.0 Request processed in 3453us (3692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201111.096874:0:91103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 94 00000100:00100000:2.0:1788201111.106462:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201111.106564:0:91104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695393664 00000100:00100000:3.0:1788201111.106574:0:91104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695393664 00000100:00100000:3.0:1788201111.106677:0:91104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 95 00000100:00100000:3.0:1788201111.106688:0:91104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc008e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71006:x1875060695393664:12345-192.168.201.20@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788201111.106705:0:91104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201111.106721:0:91104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1bb41 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786792 expref: -99 pid: 91104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201111.106750:0:91104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1bb41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786792 expref: 10 pid: 91104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201111.106761:0:91104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1bb41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786792 expref: 10 pid: 91104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201111.106771:0:91104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fc800, rc 0) 00000100:00100000:3.0:1788201111.106854:0:91104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc008e84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71006:x1875060695393664:12345-192.168.201.20@tcp:101:mount.lustre.0 Request processed in 167us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201111.106861:0:91104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 95 00000100:00100000:2.0:1788201111.110541:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201111.110647:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695393792 00000100:00100000:0.0:1788201111.110657:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695393792 00000100:00100000:0.0:1788201111.110755:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 96 00000100:00100000:0.0:1788201111.110767:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc008e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71006:x1875060695393792:12345-192.168.201.20@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788201111.111141:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc008e87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71006:x1875060695393792:12345-192.168.201.20@tcp:501:mount.lustre.0 Request processed in 375us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201111.111149:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 96 00000100:00100000:2.0:1788201111.113217:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201111.113613:0:91103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695393920 00000100:00100000:1.0:1788201111.113620:0:91103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695393920 00000100:00100000:1.0:1788201111.113669:0:91103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 97 00000100:00100000:1.0:1788201111.113678:0:91103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc008e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71006:x1875060695393920:12345-192.168.201.20@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788201111.113804:0:91103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc008e86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71006:x1875060695393920:12345-192.168.201.20@tcp:503:mount.lustre.0 Request processed in 126us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201111.113812:0:91103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 97 00000100:00100000:2.0:1788201111.118453:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201111.119795:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695394048 00000100:00100000:0.0:1788201111.119808:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695394048 00000100:00100000:0.0:1788201111.119886:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 98 00000100:00100000:0.0:1788201111.119897:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc008e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71031:x1875060695394048:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788201111.120098:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc008e84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71031:x1875060695394048:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 202us (1656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201111.120106:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 98 00000100:00100000:2.0:1788201111.129602:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201111.129753:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695394176 00000100:00100000:0.0:1788201111.129764:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695394176 00000100:00100000:0.0:1788201111.129824:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 99 00000100:00100000:0.0:1788201111.129834:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc008e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71031:x1875060695394176:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788201111.130107:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc008e87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71031:x1875060695394176:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 273us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201111.130115:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 99 00000100:00100000:2.0:1788201111.139537:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201111.139576:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201111.140660:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695394304 00000100:00100000:0.0:1788201111.140673:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695394304 00000100:00100000:0.0:1788201111.140726:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695394560 00000100:00100000:0.0:1788201111.140730:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695394560 00000100:00100000:0.0:1788201111.140756:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1316 00000100:00100000:0.0:1788201111.140764:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695394304:12345-192.168.201.20@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788201111.140797:0:66757:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp t0 exp 0000000000000000 cur 3962 last 0 00000020:00000080:0.0:1788201111.140845:0:66757:0:(genops.c:1385:class_connect()) connect: client 6e293f14-c501-4bc5-9dd4-a18ef02756b4, cookie 0x96d0c9b8c9a1bb48 00000004:00100000:0.0:1788201111.140870:0:66757:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788201111.140989:0:66757:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201111.141091:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695394304:12345-192.168.201.20@tcp:38:mount.lustre.0 Request processed in 316us (1552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201111.141100:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1316 00000100:00100000:0.0:1788201111.141117:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1317 00000100:00100000:0.0:1788201111.141122:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695394560:12345-192.168.201.20@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788201111.141135:0:66757:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp t0 exp 0000000000000000 cur 3962 last 0 00000020:00000080:0.0:1788201111.141164:0:66757:0:(genops.c:1385:class_connect()) connect: client 6e293f14-c501-4bc5-9dd4-a18ef02756b4, cookie 0x96d0c9b8c9a1bb4f 00000004:00100000:0.0:1788201111.141174:0:66757:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788201111.141231:0:66757:0:(import.c:65:import_set_state_nolock()) ffff8dc12e644000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201111.141254:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695394560:12345-192.168.201.20@tcp:38:mount.lustre.0 Request processed in 130us (1677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201111.141260:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1317 00000100:00100000:2.0:1788201111.149323:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201111.149369:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201111.149486:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695394688 00000100:00100000:0.0:1788201111.149497:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695394688 00000100:00100000:0.0:1788201111.149568:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695394432 00000100:00100000:0.0:1788201111.149572:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695394432 00000100:00100000:0.0:1788201111.149596:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1318 00000100:00100000:0.0:1788201111.149606:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:0:x1875060695394688:12345-192.168.201.20@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788201111.149638:0:66313:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:0.0:1788201111.149734:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:0:x1875060695394688:12345-192.168.201.20@tcp:41:mount.lustre.0 Request processed in 129us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201111.149740:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1318 00000100:00100000:0.0:1788201111.149756:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1319 00000100:00100000:0.0:1788201111.149762:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:0:x1875060695394432:12345-192.168.201.20@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788201111.149779:0:66313:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444962304 avail 1298722816 00000100:00100000:0.0:1788201111.149814:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:0:x1875060695394432:12345-192.168.201.20@tcp:41:mount.lustre.0 Request processed in 52us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201111.149820:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1319 00000100:00080000:1.0:1788201111.149937:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201111.149942:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201111.153781:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201111.155049:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695394816 00000100:00100000:2.0:1788201111.155060:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695394816 00000100:00100000:2.0:1788201111.155162:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1320 00000100:00100000:2.0:1788201111.155173:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13336aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:71006:x1875060695394816:12345-192.168.201.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788201111.155221:0:66312:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444962304 avail 1298722816 00000100:00100000:2.0:1788201111.155303:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13336aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:71006:x1875060695394816:12345-192.168.201.20@tcp:41:mount.lustre.0 Request processed in 133us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201111.155310:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1320 00000100:00100000:2.0:1788201111.159091:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201111.159396:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695394944 00000100:00100000:0.0:1788201111.159407:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695394944 00000100:00100000:0.0:1788201111.159520:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1321 00000100:00100000:0.0:1788201111.159543:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:71006:x1875060695394944:12345-192.168.201.20@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788201111.159635:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:71006:x1875060695394944:12345-192.168.201.20@tcp:40:mount.lustre.0 Request processed in 105us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201111.159657:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1321 00000100:00100000:3.0:1788201111.172866:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201111.172914:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201111.172950:0:66323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695395328 00000100:00100000:3.0:1788201111.172950:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201111.172962:0:66323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695395328 00000100:00100000:1.0:1788201111.173044:0:66323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:1.0:1788201111.173057:0:66323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:71006:x1875060695395328:12345-192.168.201.20@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788201111.173181:0:66323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:71006:x1875060695395328:12345-192.168.201.20@tcp:900:mount.lustre.0 Request processed in 128us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201111.173190:0:66323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:0.0:1788201111.173322:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695395072 00000100:00100000:0.0:1788201111.173327:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695395072 00000100:00100000:0.0:1788201111.173359:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695395200 00000100:00100000:0.0:1788201111.173362:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695395200 00000100:00100000:0.0:1788201111.173388:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5898 00000100:00100000:0.0:1788201111.173395:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2399:x1875060695395072:12345-192.168.201.20@tcp:8:mount.lustre.0 00000100:00100000:2.0:1788201111.173403:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5899 00000100:00100000:2.0:1788201111.173410:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2399:x1875060695395200:12345-192.168.201.20@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788201111.173421:0:23974:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp t0 exp 0000000000000000 cur 3962 last 0 00010000:00080000:2.0:1788201111.173433:0:8446:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp t0 exp 0000000000000000 cur 3962 last 0 00000020:00000080:0.0:1788201111.173453:0:23974:0:(genops.c:1385:class_connect()) connect: client 6e293f14-c501-4bc5-9dd4-a18ef02756b4, cookie 0x96d0c9b8c9a1bb56 00000020:00000080:2.0:1788201111.173459:0:8446:0:(genops.c:1385:class_connect()) connect: client 6e293f14-c501-4bc5-9dd4-a18ef02756b4, cookie 0x96d0c9b8c9a1bb5d 00002000:00100000:0.0:1788201111.173467:0:23974:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6e293f14-c501-4bc5-9dd4-a18ef02756b4/ffff8dc0059d5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788201111.173468:0:8446:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6e293f14-c501-4bc5-9dd4-a18ef02756b4/ffff8dc137d34000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788201111.173486:0:23974:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:2.0:1788201111.173496:0:8446:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788201111.173576:0:23974:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788201111.173604:0:23974:0:(import.c:65:import_set_state_nolock()) ffff8dc0059d6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201111.173645:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695395072:12345-192.168.201.20@tcp:8:mount.lustre.0 Request processed in 249us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201111.173653:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5898 00002000:00080000:2.0:1788201111.173742:0:8446:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788201111.173761:0:8446:0:(import.c:65:import_set_state_nolock()) ffff8dc1031fb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201111.173799:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695395200:12345-192.168.201.20@tcp:8:mount.lustre.0 Request processed in 387us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201111.173806:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5899 00000100:00100000:3.0:1788201111.179646:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201111.179747:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695395456 00000100:00100000:1.0:1788201111.179757:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695395456 00000100:00100000:1.0:1788201111.179819:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 231 00000100:00100000:1.0:1788201111.179829:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:71006:x1875060695395456:12345-192.168.201.20@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788201111.179935:0:66315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788201111.180053:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:71006:x1875060695395456:12345-192.168.201.20@tcp:33:mount.lustre.0 Request processed in 191us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201111.180061:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 231 00010000:00010000:3.0:1788201111.313150:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201111.375318:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201111.375342:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715169792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201111.375423:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201111.375521:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715169792 00000100:00100000:2.0:1788201111.375529:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715169792 00000100:00100000:2.0:1788201111.375588:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2260 00000100:00100000:2.0:1788201111.375599:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715169792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201111.375620:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788201111.375665:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715169792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201111.375672:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2260 00000100:00100000:1.0:1788201111.375760:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715169792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201111.375938:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201111.375948:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715169920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201111.375979:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201111.376165:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715169920 00000100:00100000:1.0:1788201111.376170:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715169920 00000100:00100000:1.0:1788201111.376197:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2261 00000100:00100000:1.0:1788201111.376204:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715169920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201111.376216:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201111.376246:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715169920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201111.376252:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2261 00000100:00100000:2.0:1788201111.376307:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201111.376317:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715170048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201111.376348:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201111.376421:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715170048 00000100:00100000:1.0:1788201111.376425:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715170048 00000100:00100000:1.0:1788201111.376461:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3972 00000100:00100000:1.0:1788201111.376468:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715170048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201111.376487:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444962304 avail 1298722816 00000100:00100000:1.0:1788201111.376521:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715170048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201111.376528:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3972 00000100:00100000:2.0:1788201111.376599:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715170048:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201111.376734:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715169920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201111.889957:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201111.889997:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715170176:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201111.890112:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201111.890260:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715170176 00000100:00100000:3.0:1788201111.890268:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715170176 00000100:00100000:3.0:1788201111.890323:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2262 00000100:00100000:3.0:1788201111.890333:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715170176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201111.890355:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201111.890400:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715170176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201111.890406:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2262 00000100:00100000:2.0:1788201111.890682:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201111.890693:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715170304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201111.890722:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201111.890779:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715170304 00000100:00100000:1.0:1788201111.890783:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715170304 00000100:00100000:1.0:1788201111.890809:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2263 00000100:00100000:1.0:1788201111.890815:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715170304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201111.890825:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788201111.890874:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715170304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201111.890896:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2263 00000100:00100000:2.0:1788201111.890982:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715170304:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201111.891171:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715170176:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788201112.335297:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201113.215826:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201113.215960:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695395584 00000100:00100000:0.0:1788201113.215977:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695395584 00000100:00100000:0.0:1788201113.216201:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1322 00000100:00100000:0.0:1788201113.216214:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:71074:x1875060695395584:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788201113.216250:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201113.216274:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1bb64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7867c3 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201113.216338:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1bb6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201113.216351:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1bb6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201113.216364:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1bb6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201113.216408:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201113.216412:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201113.216430:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1bb6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201113.216454:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1bb64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867c3 expref: 8 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201113.216472:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1bb6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867c3 expref: 7 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201113.216480:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048bea00) 00010000:00010000:0.0:1788201113.216482:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201113.216486:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782c000, rc 0) 00000100:00100000:0.0:1788201113.216549:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:71074:x1875060695395584:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 340us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201113.216556:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1322 00000100:00080000:1.0:1788201113.216621:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201113.223185:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201113.224589:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695395712 00000100:00100000:2.0:1788201113.224604:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695395712 00000100:00100000:2.0:1788201113.224674:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1323 00000100:00100000:2.0:1788201113.224684:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:71074:x1875060695395712:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:2.0:1788201113.224753:0:66313:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444962304 avail 1298722816 00000100:00100000:2.0:1788201113.225473:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:71074:x1875060695395712:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 788us (2296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201113.225482:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1323 00000100:00100000:0.0:1788201113.229796:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201113.229965:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695395840 00000100:00100000:1.0:1788201113.229975:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695395840 00000100:00100000:1.0:1788201113.230082:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1324 00000100:00100000:1.0:1788201113.230093:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:71074:x1875060695395840:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:1.0:1788201113.230130:0:69485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:1.0:1788201113.230189:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:71074:x1875060695395840:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 98us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201113.230196:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1324 00000100:00080000:3.0:1788201113.233889:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201113.234209:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201113.234472:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695395968 00000100:00100000:1.0:1788201113.234483:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695395968 00000100:00100000:1.0:1788201113.234552:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2264 00000100:00100000:1.0:1788201113.234562:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:71074:x1875060695395968:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:1.0:1788201113.234595:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788201113.234669:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:71074:x1875060695395968:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 109us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201113.234677:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2264 00000100:00080000:3.0:1788201113.237275:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201113.238834:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201113.238955:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695396096 00000100:00100000:3.0:1788201113.238965:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695396096 00000100:00100000:3.0:1788201113.239088:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2265 00000100:00100000:3.0:1788201113.239100:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:71074:x1875060695396096:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:3.0:1788201113.239134:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201113.239202:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:71074:x1875060695396096:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 105us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201113.239210:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2265 00000100:00080000:1.0:1788201113.240326:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788201113.359461:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201114.095496:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201114.095567:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695396224 00000100:00100000:0.0:1788201114.095577:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695396224 00000100:00100000:0.0:1788201114.095636:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1325 00000100:00100000:0.0:1788201114.095648:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:71108:x1875060695396224:12345-192.168.201.20@tcp:101:cp.0 00010000:00010000:0.0:1788201114.095671:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201114.095691:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1bb72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7867ca expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.095754:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1bb79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.095768:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1bb79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.095781:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1bb79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.095808:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1bb80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.095816:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1bb80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.095823:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1bb80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.096077:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1bb87 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.096086:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1bb87 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.096102:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1bb87 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201114.096138:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1bb87 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.096151:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1bb79 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.096157:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1bb79 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.096163:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1bb79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.096168:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1bb79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.096173:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782de00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201114.096177:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1bb79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.096184:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1bb79 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.096194:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048bea00) 00010000:00010000:0.0:1788201114.096197:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201114.096201:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1bb79 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.096348:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1bb79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.096364:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1bb80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.096370:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1bb80 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.096375:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1bb80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.096380:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201114.096383:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1bb80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.096388:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1bb80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.096395:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff8dc0048be600) 00010000:00010000:0.0:1788201114.096398:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201114.096401:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1bb80 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.096406:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1bb80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.096435:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1bb72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867ca expref: 9 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.096447:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1bb87 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867ca expref: 8 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201114.096464:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc0048bef00) 00010000:00010000:0.0:1788201114.096466:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201114.096469:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782d400, rc 0) 00000100:00100000:0.0:1788201114.096557:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:71108:x1875060695396224:12345-192.168.201.20@tcp:101:cp.0 Request processed in 910us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201114.096565:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1325 00000100:00100000:0.0:1788201114.100655:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201114.100734:0:66324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695396352 00000100:00100000:1.0:1788201114.100744:0:66324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695396352 00000100:00100000:1.0:1788201114.100813:0:66324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:1.0:1788201114.100824:0:66324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b35850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:71108:x1875060695396352:12345-192.168.201.20@tcp:900:cp.0 00000100:00100000:1.0:1788201114.100914:0:66324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b35850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:71108:x1875060695396352:12345-192.168.201.20@tcp:900:cp.0 Request processed in 92us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201114.100931:0:66324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:1.0:1788201114.104615:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201114.104689:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695396480 00000100:00100000:2.0:1788201114.104699:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695396480 00000100:00100000:2.0:1788201114.104756:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1326 00000100:00100000:2.0:1788201114.104766:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:71108:x1875060695396480:12345-192.168.201.20@tcp:101:cp.0 00010000:00010000:2.0:1788201114.104786:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201114.104819:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6200/0x96d0c9b8c9a1bb8e lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7867d1 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.105004:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7a00/0x96d0c9b8c9a1bb95 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.105083:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7a00/0x96d0c9b8c9a1bb95 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.105102:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7a00/0x96d0c9b8c9a1bb95 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201114.105160:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xe:0x0]: returning size 4096 00000004:00200000:2.0:1788201114.105164:0:66313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1788201114.105222:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6200/0x96d0c9b8c9a1bb8e lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867d1 expref: 8 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.105239:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7a00/0x96d0c9b8c9a1bb95 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867d1 expref: 7 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.105261:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc12196ee00) 00010000:00010000:2.0:1788201114.105264:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1788201114.105268:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc005da7a00, rc 0) 00000100:00100000:2.0:1788201114.105325:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:71108:x1875060695396480:12345-192.168.201.20@tcp:101:cp.0 Request processed in 560us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201114.105332:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1326 00000100:00100000:1.0:1788201114.113645:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201114.113709:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695396608 00000100:00100000:2.0:1788201114.113718:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695396608 00000100:00100000:2.0:1788201114.113770:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1327 00000100:00100000:2.0:1788201114.113780:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:71108:x1875060695396608:12345-192.168.201.20@tcp:101:cp.0 00010000:00010000:2.0:1788201114.113926:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201114.113947:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7800/0x96d0c9b8c9a1bb9c lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7867d8 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114007:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6c00/0x96d0c9b8c9a1bba3 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114054:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6c00/0x96d0c9b8c9a1bba3 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114066:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6c00/0x96d0c9b8c9a1bba3 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114080:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6600/0x96d0c9b8c9a1bbaa lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114087:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6600/0x96d0c9b8c9a1bbaa lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114105:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6600/0x96d0c9b8c9a1bbaa lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114175:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6400/0x96d0c9b8c9a1bbb1 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114182:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6400/0x96d0c9b8c9a1bbb1 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xf:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114189:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6400/0x96d0c9b8c9a1bbb1 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xf:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201114.114220:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xf:0x0]: returning size 4096 00000004:00200000:2.0:1788201114.114223:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201114.114239:0:66312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6400/0x96d0c9b8c9a1bbb1 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xf:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114251:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6c00/0x96d0c9b8c9a1bba3 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114258:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6c00/0x96d0c9b8c9a1bba3 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114264:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6c00/0x96d0c9b8c9a1bba3 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114270:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6c00/0x96d0c9b8c9a1bba3 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114276:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc005da6c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201114.114280:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6c00/0x96d0c9b8c9a1bba3 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114292:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6c00/0x96d0c9b8c9a1bba3 lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114305:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc12196ee00) 00010000:00010000:2.0:1788201114.114308:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201114.114311:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6c00/0x96d0c9b8c9a1bba3 lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114318:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6c00/0x96d0c9b8c9a1bba3 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114330:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6600/0x96d0c9b8c9a1bbaa lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114505:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6600/0x96d0c9b8c9a1bbaa lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114512:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6600/0x96d0c9b8c9a1bbaa lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114517:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc005da6600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201114.114521:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6600/0x96d0c9b8c9a1bbaa lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114527:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6600/0x96d0c9b8c9a1bbaa lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114535:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0xf7117594 (ffff8dc12196e700) 00010000:00010000:2.0:1788201114.114537:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201114.114541:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6600/0x96d0c9b8c9a1bbaa lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114556:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6600/0x96d0c9b8c9a1bbaa lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114590:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7800/0x96d0c9b8c9a1bb9c lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867d8 expref: 9 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114604:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6400/0x96d0c9b8c9a1bbb1 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xf:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867d8 expref: 8 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.114611:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xf:0x0].0x0 (ffff8dc12196ed00) 00010000:00010000:2.0:1788201114.114614:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788201114.114616:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc005da6400, rc 0) 00000100:00100000:3.0:1788201114.116517:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:71108:x1875060695396608:12345-192.168.201.20@tcp:101:cp.0 Request processed in 2007us (2150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201114.116530:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1327 00000100:00100000:0.0:1788201114.130407:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201114.130588:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695396736 00000100:00100000:3.0:1788201114.130607:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695396736 00000100:00100000:3.0:1788201114.130663:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1328 00000100:00100000:3.0:1788201114.130674:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13336ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:71108:x1875060695396736:12345-192.168.201.20@tcp:101:cp.0 00010000:00010000:3.0:1788201114.130693:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201114.130713:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1bbb8 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7867df expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201114.130778:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1bbbf lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201114.130806:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1bbbf lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201114.130818:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1bbbf lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201114.130833:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1bbc6 lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201114.130839:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1bbc6 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201114.130846:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1bbc6 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201114.130898:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1bbbf lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201114.130906:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1bbbf lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201114.130911:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1bbbf lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201114.130923:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1bbbf lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201114.130928:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fc400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201114.130932:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1bbbf lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201114.130940:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1bbbf lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201114.130953:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xf:0x0].0x0 (ffff8dc12196ed00) 00010000:00010000:3.0:1788201114.130956:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201114.130960:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1bbbf lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201114.130967:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1bbbf lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201114.130979:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1bbc6 lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201114.130985:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1bbc6 lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201114.130991:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1bbc6 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201114.130997:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201114.131000:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1bbc6 lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201114.131048:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1bbc6 lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201114.131057:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xf:0x0].0xb1bed465 (ffff8dc125aec000) 00010000:00010000:3.0:1788201114.131059:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201114.131062:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1bbc6 lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201114.131067:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd200/0x96d0c9b8c9a1bbc6 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201114.131100:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1bbb8 lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867df expref: 9 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201114.131110:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xf:0x0].0x0 (ffff8dc12196ed00) 00010000:00010000:3.0:1788201114.131113:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201114.131116:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1bbb8 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867df expref: 9 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201114.131125:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fc600, rc 0) 00000100:00100000:3.0:1788201114.131182:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13336ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:71108:x1875060695396736:12345-192.168.201.20@tcp:101:cp.0 Request processed in 510us (786us total) trans 0 rc 301/301 00000100:00100000:3.0:1788201114.131189:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1328 00000100:00100000:1.0:1788201114.138977:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201114.139156:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695396864 00000100:00100000:2.0:1788201114.139169:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695396864 00000100:00100000:2.0:1788201114.139234:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1329 00000100:00100000:2.0:1788201114.139246:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:71108:x1875060695396864:12345-192.168.201.20@tcp:101:cp.0 00010000:00010000:2.0:1788201114.139267:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201114.139288:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7800/0x96d0c9b8c9a1bbcd lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7867e6 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.139365:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6600/0x96d0c9b8c9a1bbd4 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.139379:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6600/0x96d0c9b8c9a1bbd4 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.139390:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6600/0x96d0c9b8c9a1bbd4 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.139416:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6c00/0x96d0c9b8c9a1bbdb lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.139424:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6c00/0x96d0c9b8c9a1bbdb lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.139432:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6c00/0x96d0c9b8c9a1bbdb lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.139476:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6600/0x96d0c9b8c9a1bbd4 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.139483:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6600/0x96d0c9b8c9a1bbd4 lrc: 4/1,0 mode: CR/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.139489:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6600/0x96d0c9b8c9a1bbd4 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.139495:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6600/0x96d0c9b8c9a1bbd4 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.139501:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc005da6600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201114.139505:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6600/0x96d0c9b8c9a1bbd4 lrc: 4/0,0 mode: CR/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.139511:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6600/0x96d0c9b8c9a1bbd4 lrc: 5/0,0 mode: CR/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.139522:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xf:0x0].0x0 (ffff8dc12196ed00) 00010000:00010000:2.0:1788201114.139525:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201114.139529:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6600/0x96d0c9b8c9a1bbd4 lrc: 3/0,0 mode: --/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.139541:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6600/0x96d0c9b8c9a1bbd4 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.139553:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6c00/0x96d0c9b8c9a1bbdb lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.139559:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6c00/0x96d0c9b8c9a1bbdb lrc: 2/0,0 mode: PR/PR res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.139564:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6c00/0x96d0c9b8c9a1bbdb lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.139569:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc005da6c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201114.139572:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6c00/0x96d0c9b8c9a1bbdb lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.139578:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6c00/0x96d0c9b8c9a1bbdb lrc: 4/0,0 mode: PR/PR res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.139586:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xf:0x0].0xb1bed465 (ffff8dc12196e700) 00010000:00010000:2.0:1788201114.139589:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201114.139592:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6c00/0x96d0c9b8c9a1bbdb lrc: 2/0,0 mode: --/PR res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.139597:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6c00/0x96d0c9b8c9a1bbdb lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.139630:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7800/0x96d0c9b8c9a1bbcd lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867e6 expref: 9 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.139651:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xf:0x0].0x0 (ffff8dc12196ed00) 00010000:00010000:2.0:1788201114.139653:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201114.139657:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7800/0x96d0c9b8c9a1bbcd lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867e6 expref: 9 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201114.139666:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc005da7800, rc 0) 00000100:00100000:2.0:1788201114.139723:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:71108:x1875060695396864:12345-192.168.201.20@tcp:101:cp.0 Request processed in 480us (757us total) trans 0 rc 301/301 00000100:00100000:2.0:1788201114.139730:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1329 00000100:00100000:3.0:1788201114.149072:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201114.149909:0:66322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695396992 00000100:00100000:0.0:1788201114.149920:0:66322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695396992 00000100:00100000:0.0:1788201114.149969:0:66322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:0.0:1788201114.149981:0:66322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:71108:x1875060695396992:12345-192.168.201.20@tcp:700:cp.0 00000020:02000000:0.0:1788201114.149994:0:66322:0:(tgt_handler.c:884:tgt_request_handle()) *** cfs_fail_loc=123, val=2147483648*** 00000100:00100000:0.0:1788201114.156372:0:66322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:71108:x1875060695396992:12345-192.168.201.20@tcp:700:cp.0 Request processed in 6382us (7298us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201114.156386:0:66322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 13 00010000:00010000:1.0:1788201114.383275:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201115.412167:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788201115.477352:0:91097:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000001:00100000:1.0:1788201115.477366:0:91097:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4292087e-fa00-4621-b681-837afc99ae35 00000001:00080000:1.0:1788201115.477374:0:91097:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116997 is committed 00000020:00000080:1.0:1788201115.477380:0:91097:0:(genops.c:885:class_export_put()) final put ffff8dc001db0800/4292087e-fa00-4621-b681-837afc99ae35 00000020:00000080:1.0:1788201115.477399:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc001db0800/4292087e-fa00-4621-b681-837afc99ae35 for lustre-MDT0000 00000020:00000080:1.0:1788201115.477459:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc12f19b800 for lustre-MDT0000 00000001:00100000:3.0:1788201115.477869:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000001:00100000:3.0:1788201115.477877:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4292087e-fa00-4621-b681-837afc99ae35 00000020:00000080:3.0:1788201115.477879:0:8442:0:(genops.c:885:class_export_put()) final put ffff8dc0078db800/4292087e-fa00-4621-b681-837afc99ae35 00000020:00000080:3.0:1788201115.477902:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0078db800/4292087e-fa00-4621-b681-837afc99ae35 for lustre-OST0000 00000020:00000080:3.0:1788201115.477942:0:41592:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc0078dc800 for lustre-OST0000 00000001:00100000:2.0:1788201115.482095:0:75739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000001:00100000:2.0:1788201115.482109:0:75739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4292087e-fa00-4621-b681-837afc99ae35 00000001:00080000:2.0:1788201115.482117:0:75739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411444 is committed 00000020:00000080:2.0:1788201115.482128:0:75739:0:(genops.c:885:class_export_put()) final put ffff8dc0053a4800/4292087e-fa00-4621-b681-837afc99ae35 00000020:00080000:2.0:1788201115.482148:0:75739:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8dc106470240 refcount 2 committed 0 result 0 batchid 73014444094 00000020:00080000:2.0:1788201115.482152:0:75739:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc12f000e00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8dc1064700c0 00000020:00080000:2.0:1788201115.482156:0:75739:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000090a1:0x1:0x0].5 00000020:00080000:2.0:1788201115.482159:0:75739:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc12f000500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dc0058a4e00 00000020:00080000:2.0:1788201115.482161:0:75739:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2400088d0:0x1:0x0].6 00000020:00080000:0.0:1788201115.482266:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444094 committed batchid 73014444093 00000020:00080000:0.0:1788201115.482326:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444093 00000020:00000080:3.0:1788201115.482494:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0053a4800/4292087e-fa00-4621-b681-837afc99ae35 for lustre-MDT0001 00000020:00000080:3.0:1788201115.482552:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc003b68000 for lustre-MDT0001 00000001:00100000:2.0:1788201115.484079:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000001:00100000:2.0:1788201115.484089:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4292087e-fa00-4621-b681-837afc99ae35 00000020:00000080:2.0:1788201115.484092:0:9526:0:(genops.c:885:class_export_put()) final put ffff8dc0078de800/4292087e-fa00-4621-b681-837afc99ae35 00000020:00000080:3.0:1788201115.485166:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0078de800/4292087e-fa00-4621-b681-837afc99ae35 for lustre-OST0001 00000020:00000080:3.0:1788201115.485221:0:41592:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc0053a7000 for lustre-OST0001 00000100:00100000:0.0:1788201115.983505:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201115.983530:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13336bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715170432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201115.983604:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201115.983656:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715170432 00000100:00100000:0.0:1788201115.983664:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715170432 00000100:00100000:0.0:1788201115.983710:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3973 00000100:00100000:0.0:1788201115.983719:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715170432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201115.983764:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:0.0:1788201115.983810:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715170432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201115.983818:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3973 00000100:00100000:0.0:1788201115.983864:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13336bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715170432:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201115.990765:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201115.990790:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715170560:0@lo:400:kworker.0 00000100:00100000:2.0:1788201115.990860:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201115.992260:0:91104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715170560 00000100:00100000:2.0:1788201115.992272:0:91104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715170560 00000100:00100000:2.0:1788201115.992329:0:91104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788201115.992339:0:91104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc008e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715170560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201115.992497:0:91104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc008e86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715170560:12345-0@lo:400:kworker.0 Request processed in 159us (1636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201115.992505:0:91104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788201115.992561:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715170560:0@lo:400:kworker.0 00000100:00100000:2.0:1788201115.992628:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715170688:0@lo:400:kworker.0 00000100:00100000:2.0:1788201115.992660:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201115.992694:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715170688 00000100:00100000:2.0:1788201115.992699:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715170688 00000100:00100000:2.0:1788201115.992739:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1357 00000100:00100000:2.0:1788201115.992746:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715170688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201115.992788:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715170688:12345-0@lo:400:kworker.0 Request processed in 42us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201115.992794:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1357 00000100:00080000:2.0:1788201115.992809:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201115.992834:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715170688:0@lo:400:kworker.0 00000100:00100000:2.0:1788201115.992860:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201115.992866:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715170816:0@lo:400:kworker.0 00000100:00100000:2.0:1788201115.992887:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201115.992924:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715170816 00000100:00100000:2.0:1788201115.992928:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715170816 00000100:00100000:2.0:1788201115.994580:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1358 00000100:00100000:2.0:1788201115.994595:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715170816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201115.994686:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715170816:12345-0@lo:400:kworker.0 Request processed in 95us (1796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201115.994693:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1358 00000100:00080000:2.0:1788201115.994724:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201115.994757:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715170816:0@lo:400:kworker.0 00000100:00100000:2.0:1788201115.994811:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715170944:0@lo:400:kworker.0 00000100:00100000:2.0:1788201115.994844:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201115.994880:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715170944 00000100:00100000:2.0:1788201115.994886:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715170944 00000100:00100000:2.0:1788201115.997298:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1359 00000100:00100000:2.0:1788201115.997309:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715170944:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788201115.997528:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201115.997575:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715170944:12345-0@lo:400:kworker.0 Request processed in 268us (2730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201115.997583:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1359 00000100:00100000:2.0:1788201115.997719:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715171200:0@lo:400:kworker.0 00000100:00100000:2.0:1788201115.997758:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201115.997807:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201115.997813:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715171328:0@lo:400:kworker.0 00000100:00100000:2.0:1788201115.997836:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201115.997888:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715171712:0@lo:400:kworker.0 00000100:00100000:2.0:1788201115.997928:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201115.998178:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201115.998185:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715171840:0@lo:400:kworker.0 00000100:00100000:2.0:1788201115.998210:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201116.000139:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715171328 00000100:00100000:0.0:1788201116.000155:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715171328 00000100:00100000:0.0:1788201116.000211:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715171712 00000100:00100000:0.0:1788201116.000214:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715171712 00000100:00100000:0.0:1788201116.000234:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715171840 00000100:00100000:0.0:1788201116.000237:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715171840 00000100:00100000:0.0:1788201116.000258:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2796 00000100:00100000:0.0:1788201116.000267:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715171328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201116.000353:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715171328:12345-0@lo:400:kworker.0 Request processed in 87us (2515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201116.000360:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2796 00000100:00100000:0.0:1788201116.000389:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2797 00000100:00100000:0.0:1788201116.000395:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140e9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715171712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201116.000426:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140e9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715171712:12345-0@lo:400:kworker.0 Request processed in 31us (2497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201116.000432:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2797 00000100:00100000:0.0:1788201116.000631:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2798 00000100:00100000:0.0:1788201116.000638:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715171840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201116.000669:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715171840:12345-0@lo:400:kworker.0 Request processed in 31us (2458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201116.000674:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2798 00000100:00100000:0.0:1788201116.000707:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715171200 00000100:00100000:0.0:1788201116.000711:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715171200 00000100:00100000:0.0:1788201116.000737:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3974 00000100:00100000:0.0:1788201116.000744:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715171200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201116.000777:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715171200:12345-0@lo:400:kworker.0 Request processed in 33us (3018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201116.000783:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3974 00000100:00100000:0.0:1788201116.000832:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715171840:0@lo:400:kworker.0 00000100:00100000:0.0:1788201116.000844:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715171712:0@lo:400:kworker.0 00000100:00100000:0.0:1788201116.000855:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715171328:0@lo:400:kworker.0 00000100:00100000:0.0:1788201116.000865:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715171200:0@lo:400:kworker.0 00000100:00080000:0.0:1788201116.000899:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201116.000903:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201116.000917:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715171072:0@lo:400:kworker.0 00000100:00100000:0.0:1788201116.000952:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201116.000977:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715171584:0@lo:400:kworker.0 00000100:00100000:0.0:1788201116.001009:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201116.001060:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788201116.001068:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715171456:0@lo:400:kworker.0 00000100:00100000:0.0:1788201116.001092:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201116.001116:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715171968:0@lo:400:kworker.0 00000100:00100000:0.0:1788201116.001136:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201116.001163:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715171072 00000100:00100000:0.0:1788201116.001166:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715171072 00000100:00100000:0.0:1788201116.001198:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715171584 00000100:00100000:0.0:1788201116.001209:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715171584 00000100:00100000:0.0:1788201116.001230:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715171968 00000100:00100000:0.0:1788201116.001233:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715171968 00000100:00100000:0.0:1788201116.001248:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:0.0:1788201116.001254:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715171072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201116.001290:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715171072:12345-0@lo:400:kworker.0 Request processed in 36us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201116.001296:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00100000:0.0:1788201116.001308:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1361 00000100:00100000:0.0:1788201116.001314:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715171584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201116.001340:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715171584:12345-0@lo:400:kworker.0 Request processed in 27us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201116.001346:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1361 00000100:00100000:0.0:1788201116.001356:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1362 00000100:00100000:0.0:1788201116.001362:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715171968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201116.001388:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715171968:12345-0@lo:400:kworker.0 Request processed in 26us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201116.001393:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1362 00000100:00080000:0.0:1788201116.001414:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201116.001431:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715171968:0@lo:400:kworker.0 00000100:00100000:0.0:1788201116.001441:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715171072:0@lo:400:kworker.0 00000100:00100000:0.0:1788201116.001449:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715171584:0@lo:400:kworker.0 00000100:00100000:0.0:1788201116.001499:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715171456 00000100:00100000:0.0:1788201116.001503:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715171456 00000100:00100000:0.0:1788201116.001531:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2799 00000100:00100000:0.0:1788201116.001537:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715171456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201116.001580:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715171456:12345-0@lo:400:kworker.0 Request processed in 42us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201116.001586:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2799 00000100:00080000:0.0:1788201116.001603:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201116.001617:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715171456:0@lo:400:kworker.0 00000100:00100000:1.0:1788201116.010493:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715170944:0@lo:400:kworker.0 00010000:00010000:2.0:1788201116.433199:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201116.496350:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715172096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201116.496413:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201116.496462:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715172096 00000100:00100000:3.0:1788201116.496470:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715172096 00000100:00100000:3.0:1788201116.496512:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3975 00000100:00100000:3.0:1788201116.496521:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715172096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201116.496551:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444962304 avail 1298722816 00000100:00100000:3.0:1788201116.496589:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715172096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201116.496596:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3975 00000100:00100000:3.0:1788201116.496637:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715172096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201116.496718:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201116.496727:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715172224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201116.496757:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201116.496783:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715172224 00000100:00100000:2.0:1788201116.496787:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715172224 00000100:00100000:2.0:1788201116.496814:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2266 00000100:00100000:2.0:1788201116.496820:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715172224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201116.496840:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201116.496873:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715172224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201116.496879:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2266 00000100:00100000:2.0:1788201116.496905:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715172224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201116.498305:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715172352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201116.498352:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201116.498424:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715172352 00000100:00100000:2.0:1788201116.498431:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715172352 00000100:00100000:2.0:1788201116.498474:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2267 00000100:00100000:2.0:1788201116.498483:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715172352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201116.498506:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788201116.498544:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715172352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201116.498550:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2267 00000100:00100000:1.0:1788201116.498612:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715172352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201116.629949:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201116.630010:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201116.630070:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201116.630090:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201116.630114:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201116.630140:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695397248 00000100:00100000:0.0:1788201116.630150:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695397248 00000100:00100000:0.0:1788201116.630212:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695397376 00000100:00100000:0.0:1788201116.630216:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695397376 00000100:00100000:0.0:1788201116.630242:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1363 00000100:00100000:0.0:1788201116.630252:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695397248:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201116.630333:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695397248:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 81us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201116.630340:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1363 00000100:00100000:0.0:1788201116.630358:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1364 00000100:00100000:0.0:1788201116.630365:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2402:x1875060695397376:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201116.630392:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2402:x1875060695397376:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 28us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201116.630399:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1364 00000100:00080000:0.0:1788201116.630416:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201116.630420:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201116.630882:0:91102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695397120 00000100:00100000:3.0:1788201116.630889:0:91102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695397120 00000100:00100000:3.0:1788201116.630929:0:91102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 101 00000100:00100000:3.0:1788201116.630937:0:91102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1076f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695397120:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201116.630992:0:91102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1076f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695397120:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 47us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201116.630999:0:91102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 101 00000100:00100000:3.0:1788201116.631049:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695397504 00000100:00100000:3.0:1788201116.631059:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695397504 00000100:00100000:3.0:1788201116.631093:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695397632 00000100:00100000:3.0:1788201116.631096:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695397632 00000100:00100000:3.0:1788201116.631117:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2800 00000100:00100000:3.0:1788201116.631123:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695397504:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201116.631150:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695397504:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201116.631157:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2800 00000100:00100000:3.0:1788201116.631168:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2801 00000100:00100000:3.0:1788201116.631174:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695397632:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201116.631198:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695397632:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 24us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201116.631203:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2801 00000100:00080000:3.0:1788201116.631223:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201116.631226:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201117.007186:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201117.007208:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715172480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201117.007269:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201117.007316:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715172480 00000100:00100000:0.0:1788201117.007324:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715172480 00000100:00100000:0.0:1788201117.007377:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2268 00000100:00100000:0.0:1788201117.007386:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715172480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201117.007407:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201117.007449:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715172480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201117.007470:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2268 00000100:00080000:0.0:1788201117.007492:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201117.007523:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715172480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201117.007724:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201117.007735:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715172608:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201117.007769:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201117.008543:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715172608 00000100:00100000:1.0:1788201117.008550:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715172608 00000100:00100000:1.0:1788201117.008605:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2269 00000100:00100000:1.0:1788201117.008614:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715172608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201117.008629:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788201117.008673:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715172608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201117.008680:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2269 00000100:00100000:2.0:1788201117.008753:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715172608:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788201117.008809:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:2.0:1788201117.183700:0:92118:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788201117.184380:0:92118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc400/0x96d0c9b8c9a1b6e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b6ef expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201117.184406:0:92118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc400/0x96d0c9b8c9a1b6e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b6ef expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201117.184414:0:92118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc400/0x96d0c9b8c9a1b6e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1b6ef expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201117.184422:0:92118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc400/0x96d0c9b8c9a1b6e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1b6ef expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201117.184481:0:92118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788201117.184488:0:92118:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788201117.184516:0:92118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201117.184521:0:92118:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788201117.184528:0:92118:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788201117.184557:0:92118:0:(import.c:65:import_set_state_nolock()) ffff8dc106074000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788201117.184635:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715172736:0@lo:39:umount.0 00000100:00100000:0.0:1788201117.184716:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201117.184839:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715172736 00000100:00100000:1.0:1788201117.184853:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715172736 00000100:00100000:1.0:1788201117.184911:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:1.0:1788201117.184922:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875060715172736:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788201117.184949:0:66312:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b800 00000100:00080000:1.0:1788201117.184956:0:66312:0:(import.c:65:import_set_state_nolock()) ffff8dc137d34800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788201117.185393:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788201117.185495:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3654:x1875060715172736:12345-0@lo:39:umount.0 Request processed in 574us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201117.185503:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000020:00000080:1.0:1788201117.185514:0:66312:0:(genops.c:885:class_export_put()) final put ffff8dc137d36800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788201117.185539:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d36800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788201117.185584:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc137d34800 for lustre-MDT0000 00010000:00010000:0.0:1788201117.185662:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201117.185691:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc106074000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788201117.185841:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715172736:0@lo:39:umount.0 00000100:00080000:2.0:1788201117.185896:0:92118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201117.185899:0:92118:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788201117.185903:0:92118:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788201117.186944:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc400/0x96d0c9b8c9a1b6e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1b6ef expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201117.186957:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdc400 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:3.0:1788201117.186960:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc400/0x96d0c9b8c9a1b6e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1b6ef expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201117.186970:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc400/0x96d0c9b8c9a1b6e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1b6ef expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201117.186986:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc400/0x96d0c9b8c9a1b6e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1b6ef expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201117.187009:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788201117.187011:0:6521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788201117.187128:0:6521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788201117.187168:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc400/0x96d0c9b8c9a1b6e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b6ef expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201117.187175:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788201117.187238:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715172864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201117.187306:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201117.187370:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc400/0x96d0c9b8c9a1b6e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b6ef expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201117.187378:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc400/0x96d0c9b8c9a1b6e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b6ef expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201117.187393:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201117.187395:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201117.187396:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201117.188666:0:92118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd200/0x96d0c9b8c9a1b616 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b61d expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201117.188680:0:92118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd200/0x96d0c9b8c9a1b616 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b61d expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201117.188686:0:92118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd200/0x96d0c9b8c9a1b616 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1b61d expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201117.188693:0:92118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd200/0x96d0c9b8c9a1b616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1b61d expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201117.188798:0:92118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201117.188806:0:92118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007a2de00/0x96d0c9b8c9a1b727 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b72e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201117.188813:0:92118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007a2de00/0x96d0c9b8c9a1b727 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b72e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201117.188818:0:92118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007a2de00/0x96d0c9b8c9a1b727 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1b72e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201117.188823:0:92118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc007a2de00/0x96d0c9b8c9a1b727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1b72e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201117.188925:0:92118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788201117.188933:0:92118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782c600/0x96d0c9b8c9a1b6da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b6e1 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201117.188940:0:92118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782c600/0x96d0c9b8c9a1b6da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b6e1 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201117.188946:0:92118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782c600/0x96d0c9b8c9a1b6da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1b6e1 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201117.188952:0:92118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc00782c600/0x96d0c9b8c9a1b6da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1b6e1 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201117.189068:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715172864 00000100:00100000:1.0:1788201117.189077:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715172864 00000100:00100000:1.0:1788201117.189132:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:1.0:1788201117.189143:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715172864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201117.189158:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201117.189174:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007a2d400/0x96d0c9b8c9a1b6ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b6e8 expref: 24 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201117.189188:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201117.189243:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+23:3655:x1875060715172864:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (1937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201117.189251:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00010000:00010000:0.0:1788201117.189405:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201117.189412:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd200/0x96d0c9b8c9a1b616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1b61d expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.189420:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdd200 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201117.189431:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd200/0x96d0c9b8c9a1b616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1b61d expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.189440:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd200/0x96d0c9b8c9a1b616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1b61d expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201117.189448:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd200/0x96d0c9b8c9a1b616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1b61d expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201117.189454:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201117.189456:0:6520:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788201117.189478:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd200/0x96d0c9b8c9a1b616 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b61d expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.189484:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201117.189500:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd200/0x96d0c9b8c9a1b616 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b61d expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.189506:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd200/0x96d0c9b8c9a1b616 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b61d expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.189516:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201117.189519:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc007a2de00/0x96d0c9b8c9a1b727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1b72e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.189525:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007a2de00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201117.189528:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc007a2de00/0x96d0c9b8c9a1b727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1b72e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.189534:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007a2de00/0x96d0c9b8c9a1b727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1b72e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201117.189552:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007a2de00/0x96d0c9b8c9a1b727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1b72e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201117.189558:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201117.189560:0:6520:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788201117.189562:0:6520:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788201117.189576:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc007a2de00/0x96d0c9b8c9a1b727 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b72e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.189582:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201117.189596:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc007a2de00/0x96d0c9b8c9a1b727 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b72e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.189603:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007a2de00/0x96d0c9b8c9a1b727 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b72e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.189612:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201117.189615:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc00782c600/0x96d0c9b8c9a1b6da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1b6e1 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.189620:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c600 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201117.189623:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782c600/0x96d0c9b8c9a1b6da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1b6e1 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.189629:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc00782c600/0x96d0c9b8c9a1b6da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1b6e1 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201117.189635:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782c600/0x96d0c9b8c9a1b6da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1b6e1 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201117.189650:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788201117.189652:0:6520:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788201117.189667:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc00782c600/0x96d0c9b8c9a1b6da lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b6e1 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.189672:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201117.189678:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc00782c600/0x96d0c9b8c9a1b6da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b6e1 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.189685:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201117.189687:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201117.189689:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201117.189720:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715173120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201117.189770:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201117.189795:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201117.189801:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715173248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201117.189830:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201117.189859:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715173120 00000100:00100000:0.0:1788201117.189863:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715173120 00000100:00100000:0.0:1788201117.189888:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715173248 00000100:00100000:0.0:1788201117.189891:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715173248 00000100:00100000:0.0:1788201117.189911:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1788201117.189918:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715173120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201117.189926:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201117.189935:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc12f339400/0x96d0c9b8c9a1b72e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b727 expref: 24 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.189945:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201117.189998:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+23:3657:x1875060715173120:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201117.190005:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1788201117.190041:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:0.0:1788201117.190048:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10a10cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+22:3657:x1875060715173248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201117.190056:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201117.190065:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782dc00/0x96d0c9b8c9a1b6e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b6da expref: 22 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.190073:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201117.190093:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10a10cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+21:3657:x1875060715173248:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201117.190099:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:0.0:1788201117.190160:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715173248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201117.190168:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715173120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201117.190195:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715172864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201117.190204:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201117.190210:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715172992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201117.190230:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201117.190255:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715172992 00000100:00100000:0.0:1788201117.190259:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715172992 00000100:00100000:0.0:1788201117.190295:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:0.0:1788201117.190301:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c9b18af6-fecc-4172-82c2-66531890fe11+21:3655:x1875060715172992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201117.190308:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201117.190317:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782d800/0x96d0c9b8c9a1b61d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b616 expref: 21 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.190334:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201117.190358:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c9b18af6-fecc-4172-82c2-66531890fe11+20:3655:x1875060715172992:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201117.190364:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:0.0:1788201117.190385:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715172992:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201117.191640:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201117.191905:0:92118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201117.191913:0:92118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc00782c600/0x96d0c9b8c9a1b6da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b6e1 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201117.191938:0:92118:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788201117.191949:0:92118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1b5fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1b601 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201117.191957:0:92118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1b5fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1b601 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201117.191965:0:92118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1b5fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1b601 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201117.191971:0:92118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1b5fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1b601 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.192040:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201117.192046:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1b5fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1b601 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.192053:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782da00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201117.192057:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1b5fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1b601 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.192064:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1b5fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1b601 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201117.192070:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1b5fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1b601 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201117.192076:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201117.192078:0:13349:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:0.0:1788201117.192103:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1b5fa lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b601 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.192109:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201117.192131:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1b5fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b601 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.192150:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201117.192152:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201117.192154:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201117.192198:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201117.192216:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715173376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201117.192268:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201117.192452:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715173376 00000100:00100000:0.0:1788201117.192459:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715173376 00000100:00100000:0.0:1788201117.192505:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1788201117.192514:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+20:3656:x1875060715173376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201117.192524:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201117.192539:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782d200/0x96d0c9b8c9a1b601 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b5fa expref: 20 pid: 91104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.192551:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201117.192650:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+19:3656:x1875060715173376:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201117.192656:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00010000:00010000:2.0:1788201117.192861:0:92118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201117.192867:0:92118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc00782da00/0x96d0c9b8c9a1b5fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1b601 expref: -99 pid: 91096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201117.192876:0:92118:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:2.0:1788201117.192881:0:92118:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788201117.192883:0:92118:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788201117.192918:0:92118:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788201117.192922:0:92118:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1788201117.192927:0:92118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1788201117.192932:0:92118:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:3.0:1788201117.194421:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715173376:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201117.195458:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:2.0:1788201117.196268:0:92118:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:0.0:1788201117.197421:0:92118:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:0.0:1788201117.197432:0:92118:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc005a49000 6e293f14-c501-4bc5-9dd4-a18ef02756b4 192.168.201.20@tcp 6 (0 0 2) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201117.197440:0:92118:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc137d35000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201117.197444:0:92118:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc137d37800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201117.197449:0:92118:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc105588000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201117.197453:0:92118:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc001db5000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 115964116996 stale:0 00000020:00080000:0.0:1788201117.197458:0:92118:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff8dc004fd19b8) has exports, disconnecting them 00000020:00080000:0.0:1788201117.197464:0:92118:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.201.20@tcp (ffff8dc005a49000), last request at 1788201116 00000020:00000080:0.0:1788201117.197471:0:92118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bb48 00000020:00010000:0.0:1788201117.197495:0:92118:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc005a49000: total 0 00000100:00080000:0.0:1788201117.197501:0:92118:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f2800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788201117.197558:0:92118:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.201.20@tcp (ffff8dc005a49000): rc 0 00000020:00080000:0.0:1788201117.197563:0:92118:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc137d35000), last request at 1788201085 00000020:00000080:0.0:1788201117.197567:0:92118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b7f9 00000100:00080000:0.0:1788201117.197571:0:92118:0:(import.c:65:import_set_state_nolock()) ffff8dc137d36000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1788201117.197596:0:6520:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc005a49000: total 0 00010000:00010000:2.0:1788201117.197638:0:6520:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc005a49000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788201117.197677:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1bb6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867c3 expref: 3 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788201117.197877:0:92118:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc137d35000): rc 0 00000020:00000080:0.0:1788201117.197880:0:92118:0:(genops.c:885:class_export_put()) final put ffff8dc137d35000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788201117.197898:0:92118:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc137d37800), last request at 1788201115 00000020:00000080:0.0:1788201117.197902:0:92118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b7f2 00000100:00080000:0.0:1788201117.197906:0:92118:0:(import.c:65:import_set_state_nolock()) ffff8dc137d32800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788201117.197938:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d35000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788201117.197995:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc137d36000 for lustre-MDT0000 00010000:00010000:2.0:1788201117.198108:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1bb87 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867ca expref: 2 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201117.198124:0:6520:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc005a49000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788201117.201429:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788201117.201861:0:92118:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc137d37800): rc 0 00000020:00000080:0.0:1788201117.201867:0:92118:0:(genops.c:885:class_export_put()) final put ffff8dc137d37800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788201117.201881:0:92118:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc105588000), last request at 1788201115 00000020:00000080:0.0:1788201117.201889:0:92118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b7eb 00000100:00080000:0.0:1788201117.201910:0:92118:0:(import.c:65:import_set_state_nolock()) ffff8dc137d37000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788201117.204133:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201117.204154:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d37800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788201117.204241:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc137d32800 for lustre-MDT0000 00000020:00080000:0.0:1788201117.207117:0:92118:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc105588000): rc 0 00000020:00000080:0.0:1788201117.207125:0:92118:0:(genops.c:885:class_export_put()) final put ffff8dc105588000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788201117.207143:0:92118:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc001db5000), last request at 1788201079 00000020:00000080:0.0:1788201117.207153:0:92118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b65c 00000100:00080000:0.0:1788201117.207169:0:92118:0:(import.c:65:import_set_state_nolock()) ffff8dc106072800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788201117.208856:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc105588000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788201117.208923:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc137d37000 for lustre-MDT0000 00010000:00010000:1.0:1788201117.210174:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788201117.214899:0:92118:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc001db5000): rc 0 00000020:00000080:0.0:1788201117.214907:0:92118:0:(genops.c:885:class_export_put()) final put ffff8dc001db5000/lustre-MDT0001-mdtlov_UUID 00000004:00000080:0.0:1788201117.214931:0:92118:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa0dd4149bae0 00000020:00000080:1.0:1788201117.215150:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc001db5000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788201117.215201:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc106072800 for lustre-MDT0000 00000100:00080000:0.0:1788201117.215254:0:92118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788201117.215259:0:92118:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788201117.218138:0:92118:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788201117.218175:0:92118:0:(import.c:65:import_set_state_nolock()) ffff8dc110734800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788201117.218243:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715173504:0@lo:39:umount.0 00000100:00100000:1.0:1788201117.218329:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201117.219394:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201117.221076:0:92118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788201117.221100:0:92118:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969454 gen 3 00000004:00080000:0.0:1788201117.221117:0:92118:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788201117.221172:0:92118:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788201117.221195:0:92118:0:(import.c:65:import_set_state_nolock()) ffff8dc13339f800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788201117.222548:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715173632:0@lo:9:umount.0 00000100:00100000:1.0:1788201117.222625:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201117.222693:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715173504 00000100:00100000:1.0:1788201117.222700:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715173504 00000100:00100000:3.0:1788201117.222856:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715173632 00000100:00100000:3.0:1788201117.222861:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715173632 00000100:00100000:3.0:1788201117.222914:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5900 00000100:00100000:3.0:1788201117.222938:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715173632:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788201117.222970:0:26208:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b6a9 00000100:00080000:3.0:1788201117.222988:0:26208:0:(import.c:65:import_set_state_nolock()) ffff8dc119917000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201117.223052:0:26208:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969454 00000100:00100000:3.0:1788201117.223196:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+2:3654:x1875060715173632:12345-0@lo:9:umount.0 Request processed in 260us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201117.223204:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5900 00000100:00080000:3.0:1788201117.223226:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788201117.223240:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201117.223267:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13339f800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788201117.223278:0:3654:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788201117.223361:0:3654:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201117.223366:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715173632:0@lo:9:umount.0 00000100:00100000:1.0:1788201117.223453:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3976 00000100:00100000:1.0:1788201117.223462:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715173504:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788201117.223482:0:23728:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b69b 00000100:00080000:1.0:1788201117.223487:0:23728:0:(import.c:65:import_set_state_nolock()) ffff8dc13aa9c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788201117.223503:0:23728:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411444 00000100:00100000:1.0:1788201117.223594:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3654:x1875060715173504:12345-0@lo:39:umount.0 Request processed in 133us (5265us total) trans 77309411445 rc 0/0 00000100:00100000:1.0:1788201117.223600:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3976 00010000:00010000:1.0:1788201117.223618:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201117.223897:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc110734800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788201117.223903:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715173504:0@lo:39:umount.0 00000100:00080000:0.0:1788201117.230451:0:92118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788201117.231104:0:92118:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969453 gen 3 00000004:00080000:0.0:1788201117.231128:0:92118:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788201117.231194:0:92118:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788201117.231232:0:92118:0:(import.c:65:import_set_state_nolock()) ffff8dc103486000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788201117.231306:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715173760:0@lo:9:umount.0 00000100:00100000:1.0:1788201117.231380:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788201117.232125:0:6520:0:(genops.c:885:class_export_put()) final put ffff8dc005a49000/6e293f14-c501-4bc5-9dd4-a18ef02756b4 00010000:00010000:2.0:1788201117.232147:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201117.232149:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201117.232153:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788201117.233444:0:92118:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8dc004fd19b8) has no exports 00000020:00000080:3.0:1788201117.233588:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005a49000/6e293f14-c501-4bc5-9dd4-a18ef02756b4 for lustre-MDT0000 00000020:00000080:3.0:1788201117.233641:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1257f2800 for lustre-MDT0000 00000100:00100000:3.0:1788201117.234084:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715173760 00000100:00100000:3.0:1788201117.234094:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715173760 00000100:00100000:3.0:1788201117.234164:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5901 00000100:00100000:3.0:1788201117.234174:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715173760:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788201117.234201:0:8491:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b6d3 00000100:00080000:3.0:1788201117.234209:0:8491:0:(import.c:65:import_set_state_nolock()) ffff8dc106308000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201117.234252:0:8491:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969453 00000100:00080000:0.0:1788201117.234852:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:0.0:1788201117.235660:0:92118:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8dc004fd19b8) has no exports 00000100:00100000:3.0:1788201117.242032:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3654:x1875060715173760:12345-0@lo:9:umount.0 Request processed in 7837us (10629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201117.242048:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5901 00010000:00010000:3.0:1788201117.242104:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201117.248956:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc103486000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788201117.248988:0:3654:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788201117.248990:0:3654:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201117.248998:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715173760:0@lo:9:umount.0 00000020:00000080:0.0:1788201117.304463:0:92118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b671 00000020:00000080:0.0:1788201117.304480:0:92118:0:(genops.c:885:class_export_put()) final put ffff8dc0039c3800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788201117.304503:0:92118:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788201117.304569:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0039c3800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788201117.304900:0:92118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201117.304913:0:92118:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788201117.304917:0:92118:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8dc13f874d28) has no exports 00000020:00000080:2.0:1788201117.305333:0:92118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b66a 00000020:00000080:2.0:1788201117.305340:0:92118:0:(genops.c:885:class_export_put()) final put ffff8dc1090d7000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788201117.305514:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1090d7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788201117.305591:0:92118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201117.305604:0:92118:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788201117.305608:0:92118:0:(genops.c:885:class_export_put()) final put ffff8dc0039c6000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788201117.305611:0:92118:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0039c6000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788201117.305619:0:92118:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1788201117.305884:0:92118:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc12fb656c0 - data ffff8dc0022a4d80/ffff8dc005898400 00000020:01000000:2.0:1788201117.306320:0:92118:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc007fd00c0 - data ffff8dc00217d1b0/ffff8dc12f2a4000 00000100:00080000:2.0:1788201117.367259:0:92118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788201117.367270:0:92118:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788201117.367458:0:92118:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8dc120093100 x1875060715173504/t77309411445(77309411445) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201127 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201117.367488:0:92118:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788201117.369462:0:92118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788201117.369471:0:92118:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969454 gen 4 00000004:00080000:2.0:1788201117.369500:0:92118:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201117.369502:0:92118:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788201117.370356:0:91114:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788201117.370361:0:91114:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6c:0x0] index 1 count 1 00000040:00080000:0.0:1788201117.370376:0:91114:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 27 count 2 00000100:00080000:2.0:1788201117.370906:0:92118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788201117.370910:0:92118:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969453 gen 4 00000004:00080000:2.0:1788201117.370930:0:92118:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201117.370933:0:92118:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788201117.371517:0:91116:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788201117.371522:0:91116:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6e:0x0] index 1 count 1 00000040:00080000:1.0:1788201117.371542:0:91116:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 27 count 2 00000020:00000080:2.0:1788201117.372915:0:92118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b62b 00000020:00000080:2.0:1788201117.372928:0:92118:0:(genops.c:885:class_export_put()) final put ffff8dc005a4f800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788201117.373842:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005a4f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788201117.374392:0:92118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b640 00000020:00000080:2.0:1788201117.374401:0:92118:0:(genops.c:885:class_export_put()) final put ffff8dc11d43a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788201117.374449:0:92118:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788201117.374455:0:92118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201117.374467:0:92118:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788201117.374471:0:92118:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8dc004fd4d28) has no exports 00000004:01000000:2.0:1788201117.374633:0:92118:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788201117.374642:0:92118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b6be 00000020:00000080:2.0:1788201117.374647:0:92118:0:(genops.c:885:class_export_put()) final put ffff8dc005d76000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201117.374896:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d43a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788201117.375075:0:92118:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788201117.375080:0:92118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201117.375089:0:92118:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788201117.375092:0:92118:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8dc13f8719b8) has no exports 00000020:00000080:2.0:1788201117.375098:0:92118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b6b7 00000020:00000080:2.0:1788201117.375102:0:92118:0:(genops.c:885:class_export_put()) final put ffff8dc005d74800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788201117.375692:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005d76000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788201117.376006:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005d74800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788201117.376584:0:92118:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788201117.376589:0:92118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788201117.376593:0:92118:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969453 gen 5 00000004:00080000:2.0:1788201117.376600:0:92118:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201117.376603:0:92118:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788201117.376652:0:92118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201117.376664:0:92118:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201117.376672:0:92118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b6a2 00000020:00000080:2.0:1788201117.376680:0:92118:0:(genops.c:885:class_export_put()) final put ffff8dc12e640000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788201117.376684:0:92118:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788201117.376701:0:92118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201117.376833:0:92118:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788201117.376838:0:92118:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8dc13f870000) has no exports 00000020:00000080:2.0:1788201117.376844:0:92118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b694 00000020:00000080:2.0:1788201117.376849:0:92118:0:(genops.c:885:class_export_put()) final put ffff8dc005a4c800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788201117.377262:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc103486000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788201117.377270:0:86307:0:(genops.c:885:class_export_put()) final put ffff8dc12e642000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788201117.377272:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12e642000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788201117.377277:0:86307:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201117.377421:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12e640000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788201117.377426:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005a4c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788201117.377580:0:92118:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788201117.377584:0:92118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788201117.377587:0:92118:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969454 gen 5 00000004:00080000:2.0:1788201117.377591:0:92118:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201117.377593:0:92118:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788201117.377660:0:92118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201117.377668:0:92118:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1788201117.377680:0:92118:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788201117.377686:0:92118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b686 00000020:00000080:2.0:1788201117.377692:0:92118:0:(genops.c:885:class_export_put()) final put ffff8dc1259e4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788201117.378315:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc13339f800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788201117.378323:0:86307:0:(genops.c:885:class_export_put()) final put ffff8dc1259e4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788201117.378325:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1259e4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788201117.378331:0:86307:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788201117.378511:0:92118:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1788201117.378516:0:92118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201117.378523:0:92118:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788201117.378526:0:92118:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8dc139bbb370) has no exports 00000020:00000080:2.0:1788201117.378531:0:92118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b67f 00000020:00000080:2.0:1788201117.378535:0:92118:0:(genops.c:885:class_export_put()) final put ffff8dc005a49800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788201117.379682:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1259e4800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788201117.379693:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005a49800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788201117.401477:0:92118:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788201117.401487:0:92118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788201117.401491:0:92118:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788201117.401500:0:92118:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788201117.401595:0:92118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201117.401614:0:92118:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201117.401644:0:92118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201117.401649:0:92118:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201117.401655:0:92118:0:(genops.c:885:class_export_put()) final put ffff8dc005a4b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201117.401659:0:92118:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005a4b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788201117.401670:0:92118:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201117.401838:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc110734800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788201117.401846:0:86307:0:(genops.c:885:class_export_put()) final put ffff8dc005d72000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788201117.401848:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005d72000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788201117.401855:0:86307:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201117.402156:0:92118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b647 00000020:00000080:2.0:1788201117.402242:0:92118:0:(genops.c:885:class_export_put()) final put ffff8dc11d439800/lustre-MDD0000_UUID 00000020:01000000:2.0:1788201117.402354:0:92118:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788201117.402360:0:92118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201117.402368:0:92118:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788201117.402372:0:92118:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8dc004fd3370) has no exports 00000020:00000080:2.0:1788201117.402401:0:92118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201117.402406:0:92118:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788201117.402412:0:92118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b64e 00000020:00000080:2.0:1788201117.402417:0:92118:0:(genops.c:885:class_export_put()) final put ffff8dc11d438800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788201117.402718:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d439800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788201117.402724:0:86307:0:(genops.c:885:class_export_put()) final put ffff8dc13f86d800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788201117.402725:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13f86d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788201117.402729:0:86307:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:2.0:1788201117.402954:0:92118:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc0084be800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788201117.402958:0:92118:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc0084be800 3 00000020:01000004:2.0:1788201117.402962:0:92118:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dc0084be800 from lustre-MDT0000 00000020:00000080:2.0:1788201117.403000:0:92118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201117.403005:0:92118:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788201117.403009:0:92118:0:(genops.c:885:class_export_put()) final put ffff8dc005a4a000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788201117.403011:0:92118:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005a4a000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788201117.403128:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d438800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788201117.403245:0:92118:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788201117.403365:0:92118:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788201117.403369:0:92118:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788201117.403373:0:92118:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788201117.403376:0:92118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201117.403379:0:92118:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788201117.403388:0:92118:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8dc103480000 93ba7067-43b5-4e46-8db7-27c040fa03d9 192.168.201.20@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788201117.403394:0:92118:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8dc0034f7800 c9b18af6-fecc-4172-82c2-66531890fe11 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788201117.403399:0:92118:0:(genops.c:1553:class_disconnect_exports()) OBD device 3 (ffff8dc12f0c0000) has exports, disconnecting them 00000020:00080000:2.0:1788201117.403403:0:92118:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.201.20@tcp (ffff8dc103480000), last request at 1788201110 00000020:00000080:2.0:1788201117.403418:0:92118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bb25 00000020:00010000:2.0:1788201117.403422:0:92118:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc103480000: total 0 00000100:00080000:2.0:1788201117.403426:0:92118:0:(import.c:65:import_set_state_nolock()) ffff8dc103483800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788201117.403449:0:92118:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.201.20@tcp (ffff8dc103480000): rc 0 00000020:00080000:2.0:1788201117.403463:0:92118:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8dc0034f7800), last request at 1788201079 00000020:00000080:2.0:1788201117.403472:0:92118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b5ec 00000020:00010000:2.0:1788201117.403475:0:92118:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc0034f7800: total 0 00000100:00080000:2.0:1788201117.403478:0:92118:0:(import.c:65:import_set_state_nolock()) ffff8dc0038aa800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788201117.403541:0:92118:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc0034f7800): rc 0 00000020:00080000:2.0:1788201117.403545:0:92118:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8dc12f0c0000) has no exports 00000100:00100000:2.0:1788201117.403606:0:91104:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8dc11cd83800:91104] 2 exiting: rc = 0 00000100:00100000:2.0:1788201117.403701:0:91107:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff8dc11cc53800:91107] 3 exiting: rc = 0 00000020:00010000:0.0:1788201117.403887:0:6521:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc103480000: total 0 00010000:00010000:0.0:1788201117.403927:0:6521:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc103480000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1788201117.403966:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ece00/0x96d0c9b8c9a1bb2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786753 expref: 5 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.403994:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1bb41 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786792 expref: 4 pid: 91104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.404005:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1bb33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78675a expref: 3 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.404055:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1bb3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78678b expref: 2 pid: 91104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.404065:0:6521:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc103480000, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1788201117.404085:0:6521:0:(genops.c:885:class_export_put()) final put ffff8dc103480000/93ba7067-43b5-4e46-8db7-27c040fa03d9 00000020:00010000:0.0:1788201117.404098:0:6521:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc0034f7800: total 1 00010000:00010000:0.0:1788201117.404116:0:6521:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc0034f7800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788201117.404131:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc12f338c00/0x96d0c9b8c9a1b782 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b77b expref: 14 pid: 91103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.404142:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007a2cc00/0x96d0c9b8c9a1b790 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b789 expref: 13 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.404152:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782c800/0x96d0c9b8c9a1b7ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b7a5 expref: 12 pid: 91104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.404161:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc004fdc000/0x96d0c9b8c9a1b73c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b735 expref: 11 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.404185:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782c200/0x96d0c9b8c9a1b79e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b797 expref: 10 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.404194:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007a2ce00/0x96d0c9b8c9a1b7ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b7b3 expref: 9 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.404203:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc004fddc00/0x96d0c9b8c9a1b74a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b743 expref: 8 pid: 91104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.404214:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782ca00/0x96d0c9b8c9a1b7c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b7c1 expref: 7 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.404232:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc004fdde00/0x96d0c9b8c9a1b758 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b751 expref: 6 pid: 91104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.404241:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007a2da00/0x96d0c9b8c9a1b7d6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b7cf expref: 5 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.404252:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc004fdda00/0x96d0c9b8c9a1b766 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b75f expref: 4 pid: 91107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.404261:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782d600/0x96d0c9b8c9a1b7e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b7dd expref: 3 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.404271:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc004fdd400/0x96d0c9b8c9a1b774 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1b76d expref: 2 pid: 91102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201117.404420:0:6521:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc0034f7800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788201117.404435:0:6521:0:(genops.c:885:class_export_put()) final put ffff8dc0034f7800/c9b18af6-fecc-4172-82c2-66531890fe11 00010000:00010000:0.0:1788201117.404442:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201117.404444:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201117.404446:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201117.404478:0:91103:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8dc11cd83c00:91103] 1 exiting: rc = 0 00000020:00000080:2.0:1788201117.405011:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc103480000/93ba7067-43b5-4e46-8db7-27c040fa03d9 for MGS 00000020:00000080:2.0:1788201117.405067:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0034f7800/c9b18af6-fecc-4172-82c2-66531890fe11 for MGS 00000020:00000080:2.0:1788201117.405082:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc103483800 for MGS 00000020:00000080:2.0:1788201117.405085:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc0038aa800 for MGS 00000100:00100000:2.0:1788201117.406483:0:91102:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8dc13a305e00:91102] 0 exiting: rc = 1 00000100:00100000:2.0:1788201117.406597:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406607:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406613:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406619:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406627:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406632:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406640:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406646:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406657:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406662:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406668:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406673:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406678:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406683:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406688:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406693:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406698:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406703:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406708:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406743:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406755:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406761:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406766:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406771:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406776:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406782:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406786:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406792:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406797:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406803:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406808:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406813:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406822:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406827:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406832:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406837:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406843:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406848:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406854:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406859:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406864:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406870:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406875:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406881:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406887:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406892:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406897:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406903:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406909:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406914:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406920:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406925:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406932:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406937:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406950:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406955:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406960:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406965:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406981:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406987:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406992:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.406998:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.407003:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201117.407009:0:92118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1788201117.409858:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788201117.411543:0:92118:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc12b66b420 - data ffff8dc11dbf0288/ffff8dc1201f6800 00000020:01000000:2.0:1788201117.411674:0:92118:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc003bd78a0 - data ffff8dc11d809af8/ffff8dc139bc8800 00000020:00000080:2.0:1788201117.412388:0:92118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b5de 00000020:00000080:2.0:1788201117.412398:0:92118:0:(genops.c:885:class_export_put()) final put ffff8dc001e2e000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788201117.412414:0:92118:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc0084be800 from MGS, refs=2 00000020:01000004:2.0:1788201117.412418:0:92118:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc0084be800 2 00000020:01000004:2.0:1788201117.412420:0:92118:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dc0084be800 from MGS 00000020:00000080:2.0:1788201117.412442:0:92118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201117.412449:0:92118:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788201117.412451:0:92118:0:(genops.c:885:class_export_put()) final put ffff8dc1257f5000/MGS 00000020:00000080:2.0:1788201117.412453:0:92118:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1257f5000/MGS for MGS 00000020:01000000:2.0:1788201117.412461:0:92118:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788201117.412533:0:92118:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788201117.412537:0:92118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201117.412547:0:92118:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788201117.412555:0:92118:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8dc103487800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788201117.412560:0:92118:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8dc139bb8000) has exports, disconnecting them 00000020:00080000:2.0:1788201117.412565:0:92118:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8dc103487800), last request at 1788201080 00000020:00000080:2.0:1788201117.412568:0:92118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b6fd 00000020:00080000:2.0:1788201117.412579:0:92118:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc103487800): rc 0 00000020:00000080:2.0:1788201117.412583:0:92118:0:(genops.c:885:class_export_put()) final put ffff8dc103487800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788201117.413095:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc001e2e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788201117.413105:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc103487800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788201117.422123:0:92118:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788201117.422133:0:92118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201117.422137:0:92118:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788201117.422145:0:92118:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788201117.422377:0:92118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201117.422402:0:92118:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788201117.422409:0:92118:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc0084be800 1 00000020:00000080:0.0:1788201117.422415:0:92118:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1b5d0 00000020:00000080:0.0:1788201117.422423:0:92118:0:(genops.c:885:class_export_put()) final put ffff8dc1257f7800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788201117.422428:0:92118:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788201117.422432:0:92118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201117.422436:0:92118:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788201117.422439:0:92118:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8dc139bb99b8) has no exports 00000020:00000080:1.0:1788201117.422806:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc106074000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788201117.422813:0:57134:0:(genops.c:885:class_export_put()) final put ffff8dc106073800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788201117.422816:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc106073800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788201117.422828:0:57134:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788201117.422900:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1257f7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788201117.455593:0:92118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201117.455606:0:92118:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788201117.455612:0:92118:0:(genops.c:885:class_export_put()) final put ffff8dc005d76800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788201117.455617:0:92118:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005d76800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788201117.455628:0:92118:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788201117.455863:0:92118:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dc0084b9800 00000020:02000400:1.0:1788201117.455925:0:92118:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788201117.457259:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201118.481741:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201119.505203:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201120.528278:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201121.103571:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715174272:0@lo:400:kworker.0 00000100:00100000:1.0:1788201121.103661:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201121.103705:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715174784:0@lo:400:kworker.0 00000100:00100000:1.0:1788201121.103733:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201121.103761:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788201121.103767:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715173888:0@lo:400:kworker.0 00000400:00000100:1.0:1788201121.103787:0:3655:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715173888 offset 0 length 224: 4 00000100:00100000:1.0:1788201121.103809:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715174400:0@lo:400:kworker.0 00000100:00100000:1.0:1788201121.103830:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201121.103848:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715174912:0@lo:400:kworker.0 00000100:00100000:1.0:1788201121.103868:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201121.103919:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715174784 00000100:00100000:1.0:1788201121.103926:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715174784 00000100:00100000:1.0:1788201121.103994:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2802 00000100:00100000:1.0:1788201121.104005:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715174784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201121.104094:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715174784:12345-0@lo:400:kworker.0 Request processed in 91us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201121.104101:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2802 00000100:00100000:1.0:1788201121.104126:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715174272 00000100:00100000:1.0:1788201121.104130:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715174272 00000100:00100000:1.0:1788201121.104150:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715174400 00000100:00100000:1.0:1788201121.104153:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715174400 00000100:00100000:1.0:1788201121.104168:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715174912 00000100:00100000:1.0:1788201121.104170:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715174912 00000100:00100000:1.0:1788201121.104180:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1365 00000100:00100000:1.0:1788201121.104185:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715174400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201121.104212:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715174400:12345-0@lo:400:kworker.0 Request processed in 27us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201121.104218:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1365 00000100:00100000:1.0:1788201121.104228:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:1.0:1788201121.104232:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3655:x1875060715174272:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788201121.104238:0:66314:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788201121.104258:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3655:x1875060715174272:12345-0@lo:400:kworker.0 Request processed in 25us (598us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788201121.104263:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00100000:1.0:1788201121.104272:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:1.0:1788201121.104275:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120022680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3655:x1875060715174912:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788201121.104279:0:66314:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788201121.104296:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120022680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3655:x1875060715174912:12345-0@lo:400:kworker.0 Request processed in 19us (428us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788201121.104301:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:1.0:1788201121.104345:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715174400:0@lo:400:kworker.0 00000100:00080000:1.0:1788201121.104364:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788201121.104381:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788201121.104385:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788201121.104390:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201121.104393:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3936 00000100:00080000:1.0:1788201121.104398:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201121.104419:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc120021500 x1875060715175040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201121.104435:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715174912:0@lo:400:kworker.0 00000100:00080000:1.0:1788201121.104445:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788201121.104448:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788201121.104451:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788201121.104453:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201121.104456:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3936 00000100:00080000:1.0:1788201121.104460:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201121.104469:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc120022d80 x1875060715175168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201121.104479:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715174272:0@lo:400:kworker.0 00000100:00100000:1.0:1788201121.104490:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715174784:0@lo:400:kworker.0 00000100:00100000:1.0:1788201121.104517:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120021500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715175040:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788201121.104540:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201121.104561:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120022d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715175168:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788201121.104580:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201121.104603:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715175040 00000100:00100000:1.0:1788201121.104607:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715175040 00000100:00100000:1.0:1788201121.104623:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715175168 00000100:00100000:1.0:1788201121.104625:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715175168 00000100:00100000:1.0:1788201121.104637:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:1.0:1788201121.104641:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715175040:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1788201121.104659:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201121.104690:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715175040:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 47us (149us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201121.104696:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:1.0:1788201121.104708:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:1.0:1788201121.104712:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715175168:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1788201121.104721:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201121.104744:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715175168:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 31us (163us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201121.104750:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00080000:1.0:1788201121.104775:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201121.104780:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201121.104783:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120021500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715175040:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1788201121.104790:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201121.104792:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201121.104794:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120022d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715175168:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788201121.105097:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715174016:0@lo:400:kworker.0 00000100:00100000:0.0:1788201121.105130:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201121.105159:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715174528:0@lo:400:kworker.0 00000100:00100000:0.0:1788201121.105183:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201121.105204:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788201121.105210:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715174144:0@lo:400:kworker.0 00000100:00100000:0.0:1788201121.105232:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201121.105250:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715174656:0@lo:400:kworker.0 00000100:00100000:0.0:1788201121.105272:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788201121.105298:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201121.105303:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201121.105312:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715174016 00000100:00100000:0.0:1788201121.105316:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715174016 00000100:00100000:0.0:1788201121.105337:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715174144 00000100:00100000:0.0:1788201121.105340:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715174144 00000100:00100000:0.0:1788201121.105365:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1366 00000100:00100000:0.0:1788201121.105385:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715174144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201121.105422:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715174144:12345-0@lo:400:kworker.0 Request processed in 40us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201121.105429:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1366 00000100:00100000:0.0:1788201121.105454:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1335 00000100:00100000:0.0:1788201121.105458:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1875060715174016:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788201121.105463:0:66313:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788201121.105488:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1875060715174016:12345-0@lo:400:kworker.0 Request processed in 27us (357us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788201121.105493:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1335 00000100:00080000:0.0:1788201121.105509:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201121.105542:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715174144:0@lo:400:kworker.0 00000100:00080000:0.0:1788201121.105553:0:3657:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788201121.105557:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788201121.105560:0:3657:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788201121.105564:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201121.105567:0:3657:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3936 00000100:00080000:0.0:1788201121.105573:0:3657:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201121.105591:0:3657:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc120090000 x1875060715175296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201121.105608:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715174016:0@lo:400:kworker.0 00000100:00100000:0.0:1788201121.105627:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715175296:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788201121.105651:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201121.105675:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715175296 00000100:00100000:0.0:1788201121.105678:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715175296 00000100:00100000:0.0:1788201121.105695:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:0.0:1788201121.105700:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715175296:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1788201121.105712:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201121.105747:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715175296:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 46us (95us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201121.105753:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00080000:0.0:1788201121.105776:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201121.105780:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201121.105784:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715175296:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788201121.106084:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715174528 00000100:00100000:3.0:1788201121.106091:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715174528 00000100:00100000:3.0:1788201121.106127:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3977 00000100:00100000:3.0:1788201121.106132:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1875060715174528:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788201121.106138:0:8457:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788201121.106176:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1875060715174528:12345-0@lo:400:kworker.0 Request processed in 43us (991us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788201121.106181:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3977 00000100:00080000:3.0:1788201121.106206:0:3657:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788201121.106210:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788201121.106213:0:3657:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788201121.106218:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201121.106221:0:3657:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3936 00000100:00080000:3.0:1788201121.106225:0:3657:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201121.106240:0:3657:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc137cee680 x1875060715175424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201121.106254:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715174528:0@lo:400:kworker.0 00000100:00100000:3.0:1788201121.106269:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715175424:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788201121.106293:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201121.106316:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715175424 00000100:00100000:3.0:1788201121.106319:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715175424 00000100:00100000:3.0:1788201121.106336:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3978 00000100:00100000:3.0:1788201121.106340:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715175424:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788201121.106357:0:23728:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201121.106395:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715175424:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 53us (101us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201121.106401:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3978 00000100:00080000:3.0:1788201121.106424:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201121.106428:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201121.106431:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715175424:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788201121.106570:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715174656 00000100:00100000:2.0:1788201121.106575:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715174656 00000100:00100000:2.0:1788201121.106618:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2803 00000100:00100000:2.0:1788201121.106625:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715174656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201121.106660:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715174656:12345-0@lo:400:kworker.0 Request processed in 37us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201121.106665:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2803 00000100:00080000:3.0:1788201121.106882:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201121.106928:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715174656:0@lo:400:kworker.0 00010000:00010000:2.0:1788201121.551331:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788201121.620222:0:75739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788201121.620237:0:75739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411445 is committed 00000020:00000080:2.0:1788201121.620242:0:75739:0:(genops.c:885:class_export_put()) final put ffff8dc13aa9b800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:2.0:1788201121.620267:0:75739:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444094 batchid updated 00000020:00080000:1.0:1788201121.620347:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444094 00000004:00080000:1.0:1788201121.620419:0:75759:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc1257069c0 with version 17 00000020:00080000:1.0:1788201121.620437:0:75759:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444094 cancel update log [0x2000090a1:0x1:0x0].5: rc = 0 00000020:00080000:1.0:1788201121.620528:0:75759:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444094 cancel update log [0x2400088d0:0x1:0x0].6: rc = 0 00000020:00080000:1.0:1788201121.620537:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444094 00000004:00080000:3.0:1788201121.620605:0:75745:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc007566d80 version 17 rpc_version 17 00000020:00100000:3.0:1788201121.620639:0:75745:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788201121.620651:0:75745:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc137cee680 x1875060715175680/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201121.620684:0:75745:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8dc137cee680 x1875060715175680/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201121.620693:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040f00 going to sleep for 0 seconds 00000020:00000080:0.0:1788201121.620950:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13aa9b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788201121.621008:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc13aa9c000 for lustre-MDT0001 00000400:00000100:3.0:1788201121.747990:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695397760 offset 0 length 224: 4 00000100:00100000:3.0:1788201121.748068:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201121.748101:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201121.748130:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201121.748150:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201121.748180:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695398272 00000100:00100000:3.0:1788201121.748188:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695398272 00000100:00100000:3.0:1788201121.748239:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695398144 00000100:00100000:3.0:1788201121.748241:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695398144 00000100:00100000:3.0:1788201121.748259:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2804 00000100:00100000:3.0:1788201121.748280:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695398272:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201121.748344:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695398272:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 65us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201121.748350:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2804 00000100:00100000:3.0:1788201121.748365:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2805 00000100:00100000:3.0:1788201121.748371:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695398144:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201121.748388:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695398144:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 18us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201121.748394:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2805 00000100:00100000:1.0:1788201121.748511:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695398016 00000100:00100000:1.0:1788201121.748517:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695398016 00000100:00100000:1.0:1788201121.748549:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695397888 00000100:00100000:1.0:1788201121.748551:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695397888 00000100:00100000:1.0:1788201121.748570:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1367 00000100:00100000:1.0:1788201121.748589:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695398016:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201121.748621:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695398016:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 44us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201121.748627:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1367 00000100:00100000:1.0:1788201121.748643:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1337 00000100:00100000:1.0:1788201121.748648:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1875060695397888:12345-192.168.201.20@tcp:400:kworker.0 00000020:00080000:1.0:1788201121.748654:0:66314:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.20@tcp 00000100:00100000:1.0:1788201121.748674:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1875060695397888:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (543us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788201121.748680:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1337 00000100:00080000:1.0:1788201121.748729:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201121.748734:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201121.748736:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201121.750068:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201121.750154:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695398400 00000100:00100000:1.0:1788201121.750162:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695398400 00000100:00100000:1.0:1788201121.750207:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1338 00000100:00100000:1.0:1788201121.750214:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695398400:12345-192.168.201.20@tcp:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1788201121.750244:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201121.750303:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695398400:12345-192.168.201.20@tcp:38:ptlrpcd_00_01.0 Request processed in 88us (240us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201121.750311:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1338 00000100:00100000:3.0:1788201122.127357:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715175808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201122.127432:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201122.127953:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715175808 00000100:00100000:2.0:1788201122.127962:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715175808 00000100:00100000:2.0:1788201122.128010:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2270 00000100:00100000:2.0:1788201122.128036:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715175808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201122.128066:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201122.128115:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715175808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201122.128122:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2270 00000100:00100000:3.0:1788201122.128243:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715175808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201122.128260:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201122.128265:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715175936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201122.128292:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201122.128457:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715175936 00000100:00100000:2.0:1788201122.128462:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715175936 00000100:00100000:2.0:1788201122.130396:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2271 00000100:00100000:2.0:1788201122.130417:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715175936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201122.130449:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788201122.130546:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715175936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (2252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201122.130571:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2271 00000100:00100000:1.0:1788201122.130714:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715175936:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788201122.575299:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201122.639422:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040f00 going to sleep for 0 seconds 00000001:00100000:1.0:1788201122.643711:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788201122.643720:0:8442:0:(genops.c:885:class_export_put()) final put ffff8dc119913800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201122.643846:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc119913800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788201122.643931:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc119917000 for lustre-OST0000 00010000:00010000:0.0:1788201123.599615:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201123.665676:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040f00 going to sleep for 0 seconds 00000001:00100000:3.0:1788201123.674809:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201123.674819:0:9526:0:(genops.c:885:class_export_put()) final put ffff8dc10630b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201123.674985:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc10630b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788201123.675057:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc106308000 for lustre-OST0001 00010000:00010000:1.0:1788201124.623323:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201124.687743:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040f00 going to sleep for 0 seconds 00010000:00010000:2.0:1788201125.647278:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201125.711179:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040f00 going to sleep for 0 seconds 00000100:00080000:2.0:1788201126.223246:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201126.223254:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201126.223257:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201126.223266:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3972 00000100:00080000:2.0:1788201126.223273:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788201126.223279:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201126.223306:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d59880 x1875060715176192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201126.223345:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201126.223348:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201126.223350:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201126.223353:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3972 00000100:00080000:2.0:1788201126.223356:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788201126.223359:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201126.223372:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d59f80 x1875060715176448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201126.223390:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715176320:0@lo:400:kworker.0 00000100:00080000:2.0:1788201126.223403:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201126.223408:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201126.223411:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201126.223414:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3972 00000100:00080000:2.0:1788201126.223433:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788201126.223438:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201126.223455:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d5b800 x1875060715176704/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201126.223469:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788201126.223484:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201126.223488:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201126.223490:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201126.223494:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3972 00000100:00080000:2.0:1788201126.223497:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788201126.223501:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201126.223512:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d5a300 x1875060715177088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201126.223525:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788201126.223534:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715176064:0@lo:400:kworker.0 00000100:00100000:2.0:1788201126.223542:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715176832:0@lo:400:kworker.0 00000400:00000100:3.0:1788201126.223559:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715176064 offset 0 length 224: 4 00000100:00100000:3.0:1788201126.223585:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715176960:0@lo:400:kworker.0 00000100:00100000:2.0:1788201126.223592:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201126.223619:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201126.223623:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201126.223632:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715176576:0@lo:400:kworker.0 00000100:00100000:3.0:1788201126.223655:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715176320 00000100:00100000:3.0:1788201126.223663:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715176320 00000100:00100000:2.0:1788201126.223665:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201126.223715:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715176832 00000100:00100000:2.0:1788201126.223720:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715176832 00000100:00100000:3.0:1788201126.223730:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715176576 00000100:00100000:3.0:1788201126.223735:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715176576 00000100:00100000:2.0:1788201126.223759:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715176960 00000100:00100000:2.0:1788201126.223765:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715176960 00000100:00100000:3.0:1788201126.223765:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1368 00000100:00100000:3.0:1788201126.223776:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715176320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201126.223798:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2806 00000100:00100000:2.0:1788201126.223808:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715176832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201126.223865:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715176832:12345-0@lo:400:kworker.0 Request processed in 59us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201126.223872:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715176320:12345-0@lo:400:kworker.0 Request processed in 95us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201126.223879:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2806 00000100:00100000:3.0:1788201126.223883:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1368 00000100:00100000:3.0:1788201126.223902:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1369 00000100:00100000:2.0:1788201126.223909:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2807 00000100:00100000:3.0:1788201126.223912:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715176576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201126.223922:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715176960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201126.223944:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715176576:12345-0@lo:400:kworker.0 Request processed in 35us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201126.223951:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1369 00000100:00080000:3.0:1788201126.223970:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201126.223974:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201126.223977:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201126.223982:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715176960:12345-0@lo:400:kworker.0 Request processed in 62us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201126.223990:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2807 00000100:00100000:3.0:1788201126.224007:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715176960:0@lo:400:kworker.0 00000100:00100000:2.0:1788201126.224059:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715176576:0@lo:400:kworker.0 00000100:00100000:3.0:1788201126.224066:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715176320:0@lo:400:kworker.0 00000100:00100000:2.0:1788201126.224077:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715176832:0@lo:400:kworker.0 00000100:00100000:0.0:1788201126.224273:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715176192:0@lo:38:kworker.0 00000100:00100000:0.0:1788201126.224307:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201126.224338:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715176448:0@lo:38:kworker.0 00000100:00100000:0.0:1788201126.224360:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201126.224383:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715176704:0@lo:38:kworker.0 00000100:00100000:0.0:1788201126.224410:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201126.224429:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715177088:0@lo:38:kworker.0 00000100:00100000:3.0:1788201126.224452:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715176192 00000100:00100000:0.0:1788201126.224453:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201126.224459:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715176192 00000100:00100000:3.0:1788201126.224490:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715176448 00000100:00100000:0.0:1788201126.224492:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715177088 00000100:00100000:3.0:1788201126.224494:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715176448 00000100:00100000:0.0:1788201126.224499:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715177088 00000100:00100000:3.0:1788201126.224508:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:3.0:1788201126.224514:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715176192:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788201126.224528:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00010000:00020000:3.0:1788201126.224534:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201126.224536:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715176448:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201126.224551:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201126.224578:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715176192:12345-0@lo:38:kworker.0 Request processed in 62us (269us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201126.224584:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00100000:3.0:1788201126.224597:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:3.0:1788201126.224602:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715177088:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788201126.224606:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715176448:12345-0@lo:38:kworker.0 Request processed in 68us (243us total) trans 0 rc -19/-19 00010000:00020000:3.0:1788201126.224614:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201126.224626:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:3.0:1788201126.224644:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715177088:12345-0@lo:38:kworker.0 Request processed in 39us (190us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201126.224650:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00100000:0.0:1788201126.224662:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715176704 00000100:00100000:0.0:1788201126.224668:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715176704 00000100:00080000:3.0:1788201126.224682:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201126.224694:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201126.224699:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3979 00000100:00100000:3.0:1788201126.224702:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715176192:0@lo:38:kworker.0 00000100:00100000:0.0:1788201126.224709:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715176704:12345-0@lo:38:kworker.0 00000100:00080000:3.0:1788201126.224718:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00010000:00020000:0.0:1788201126.224723:0:8457:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1788201126.224724:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201126.224730:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715176448:0@lo:38:kworker.0 00000100:00080000:3.0:1788201126.224740:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201126.224744:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201126.224752:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715177088:0@lo:38:kworker.0 00000100:00100000:0.0:1788201126.224765:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715176704:12345-0@lo:38:kworker.0 Request processed in 56us (352us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201126.224773:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3979 00000100:00080000:3.0:1788201126.224777:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201126.224783:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201126.224793:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715176704:0@lo:38:kworker.0 00010000:00010000:1.0:1788201126.672069:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201126.735149:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040f00 going to sleep for 0 seconds 00000100:00100000:3.0:1788201126.873700:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000400:00000100:3.0:1788201126.873747:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695398528 offset 0 length 224: 4 00000100:00100000:3.0:1788201126.873769:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201126.873803:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201126.873842:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201126.873874:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695398912 00000100:00100000:3.0:1788201126.873884:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695398912 00000100:00100000:3.0:1788201126.873957:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695399040 00000100:00100000:3.0:1788201126.873961:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695399040 00000100:00100000:3.0:1788201126.873985:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2808 00000100:00100000:3.0:1788201126.873994:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695398912:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201126.874098:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695398912:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 104us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201126.874105:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2808 00000100:00100000:3.0:1788201126.874122:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2809 00000100:00100000:3.0:1788201126.874303:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695399040:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201126.874333:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695399040:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 34us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201126.874339:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2809 00000100:00080000:3.0:1788201126.874357:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201126.874361:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201126.874729:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695398656 00000100:00100000:0.0:1788201126.874735:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695398656 00000100:00100000:0.0:1788201126.874763:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695398784 00000100:00100000:0.0:1788201126.874766:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695398784 00000100:00100000:0.0:1788201126.874793:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1370 00000100:00100000:0.0:1788201126.874800:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695398784:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201126.874839:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695398784:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 40us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201126.874846:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1370 00000100:00100000:0.0:1788201126.874858:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1342 00000100:00100000:0.0:1788201126.874863:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695398656:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:0.0:1788201126.874884:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201126.874903:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695398656:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 39us (1215us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201126.874908:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1342 00000100:00080000:3.0:1788201126.877408:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201127.247325:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715177216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201127.247393:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201127.247475:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715177216 00000100:00100000:3.0:1788201127.247482:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715177216 00000100:00100000:3.0:1788201127.247527:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2272 00000100:00100000:3.0:1788201127.247535:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715177216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201127.247563:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788201127.247604:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715177216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201127.247611:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2272 00000100:00100000:3.0:1788201127.247653:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715177216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201127.247922:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715177344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201127.247955:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201127.247985:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715177344 00000100:00100000:0.0:1788201127.247988:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715177344 00000100:00100000:0.0:1788201127.248010:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2273 00000100:00100000:0.0:1788201127.248045:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715177344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201127.248061:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201127.248090:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715177344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201127.248096:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2273 00000100:00100000:0.0:1788201127.248239:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715177344:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788201127.695745:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201127.759320:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040f00 going to sleep for 0 seconds 00010000:00010000:1.0:1788201128.721156:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201128.783511:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040f00 going to sleep for 0 seconds 00010000:00010000:2.0:1788201129.745492:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201129.807719:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040f00 going to sleep for 0 seconds 00000100:00100000:3.0:1788201130.473009:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000400:00000100:3.0:1788201130.473049:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695399168 offset 0 length 224: 4 00000100:00100000:3.0:1788201130.474165:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201130.474238:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201130.474266:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201130.474300:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695399296 00000100:00100000:3.0:1788201130.474310:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695399296 00000100:00100000:3.0:1788201130.474346:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695399424 00000100:00100000:3.0:1788201130.474348:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695399424 00000100:00100000:3.0:1788201130.474385:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1371 00000100:00100000:3.0:1788201130.474396:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2399:x1875060695399424:12345-192.168.201.20@tcp:38:kworker.0 00010000:02000400:3.0:1788201130.474427:0:66757:0:(ldlm_lib.c:962:target_handle_reconnect()) lustre-MDT0001: Client 6e293f14-c501-4bc5-9dd4-a18ef02756b4 (at 192.168.201.20@tcp) reconnecting 00010000:00080000:3.0:1788201130.503432:0:66757:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp t0 exp ffff8dc12e647000 cur 3981 last 1788201130 00000004:00100000:3.0:1788201130.503468:0:66757:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli 192.168.201.20@tcp supports cksum type f7, return f7 00000100:00080000:3.0:1788201130.503496:0:66757:0:(import.c:65:import_set_state_nolock()) ffff8dc12e644000 : changing import state from FULL to RECOVER 00000100:00080000:3.0:1788201130.503504:0:66757:0:(import.c:65:import_set_state_nolock()) ffff8dc12e644000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201130.503584:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2399:x1875060695399424:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 29189us (30515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201130.503607:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1371 00000100:00100000:3.0:1788201130.503646:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1343 00000100:00100000:3.0:1788201130.503653:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695399296:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:3.0:1788201130.503673:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201130.503696:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695399296:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 43us (30698us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201130.503702:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1343 00000100:00100000:3.0:1788201130.503732:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695399552 00000100:00100000:3.0:1788201130.503739:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695399552 00000100:00100000:3.0:1788201130.503789:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695399680 00000100:00100000:3.0:1788201130.503792:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695399680 00000100:00100000:3.0:1788201130.503811:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2810 00000100:00100000:3.0:1788201130.503817:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695399552:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201130.503842:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695399552:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (29609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201130.503847:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2810 00000100:00100000:3.0:1788201130.503857:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2811 00000100:00100000:3.0:1788201130.503862:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695399680:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201130.503878:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695399680:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 16us (29612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201130.503883:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2811 00000100:00080000:3.0:1788201130.503903:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201130.503907:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201130.503909:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201130.519112:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201130.519192:0:66322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695396992 00000100:00100000:3.0:1788201130.519203:0:66322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695396992 00000100:00100000:3.0:1788201130.519259:0:66322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:3.0:1788201130.519273:0:66322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:71108:x1875060695396992:12345-192.168.201.20@tcp:700:cp.0 00000100:00080000:3.0:1788201130.519357:0:66322:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8dc005d50a80 x1875060715177472/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201130.519370:0:66322:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0050406c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788201130.776154:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201130.845585:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040f00 going to sleep for 0 seconds 00000100:00080000:1.0:1788201131.349261:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201131.349268:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201131.349272:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201131.349280:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3977 00000100:00080000:1.0:1788201131.349286:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201131.349384:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201131.349408:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc120021500 x1875060715177728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201131.349439:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201131.349442:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201131.349444:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201131.349448:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3977 00000100:00080000:1.0:1788201131.349450:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201131.349454:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201131.349475:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc120020a80 x1875060715177984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201131.349491:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201131.349494:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201131.349496:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201131.349499:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3977 00000100:00080000:1.0:1788201131.349502:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201131.349506:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201131.349518:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc120020380 x1875060715178240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201131.349534:0:86307:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201131.349537:0:86307:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201131.349538:0:86307:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201131.349542:0:86307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3977 00000100:00080000:1.0:1788201131.349544:0:86307:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201131.349547:0:86307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201131.349557:0:86307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc120020700 x1875060715178624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201131.349585:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120022d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715177600:0@lo:400:kworker.0 00000400:00000100:1.0:1788201131.349636:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715177600 offset 0 length 224: 4 00000100:00100000:1.0:1788201131.349674:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120023480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715178496:0@lo:400:kworker.0 00000100:00100000:1.0:1788201131.349706:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201131.349743:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201131.349748:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715178368:0@lo:400:kworker.0 00000100:00100000:1.0:1788201131.349778:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201131.349808:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120021500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715177728:0@lo:38:kworker.0 00000100:00100000:1.0:1788201131.349834:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201131.349851:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715177984:0@lo:38:kworker.0 00000100:00100000:1.0:1788201131.349870:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201131.349886:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120020380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715178240:0@lo:38:kworker.0 00000100:00100000:1.0:1788201131.350149:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201131.350170:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120020700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715178624:0@lo:38:kworker.0 00000100:00100000:1.0:1788201131.350192:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201131.350289:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120020000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715177856:0@lo:400:kworker.0 00000100:00100000:1.0:1788201131.350387:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201131.350409:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201131.350415:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120022a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715178112:0@lo:400:kworker.0 00000100:00100000:1.0:1788201131.350436:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201131.350470:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715178496 00000100:00100000:1.0:1788201131.350477:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715178496 00000100:00100000:1.0:1788201131.350529:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715178368 00000100:00100000:1.0:1788201131.350532:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715178368 00000100:00100000:1.0:1788201131.350556:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2812 00000100:00100000:1.0:1788201131.350565:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715178496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201131.350616:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715178496:12345-0@lo:400:kworker.0 Request processed in 52us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201131.350623:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2812 00000100:00100000:1.0:1788201131.350640:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2813 00000100:00100000:1.0:1788201131.350647:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120022300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715178368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201131.350686:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120022300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715178368:12345-0@lo:400:kworker.0 Request processed in 39us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201131.350692:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2813 00000100:00100000:1.0:1788201131.350712:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715177728 00000100:00100000:1.0:1788201131.350715:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715177728 00000100:00100000:0.0:1788201131.350739:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715177984 00000100:00100000:0.0:1788201131.350743:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715177984 00000100:00100000:0.0:1788201131.350761:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715178624 00000100:00100000:0.0:1788201131.350763:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715178624 00000100:00100000:0.0:1788201131.350771:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715177856 00000100:00100000:0.0:1788201131.350773:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715177856 00000100:00100000:0.0:1788201131.350788:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715178112 00000100:00100000:0.0:1788201131.350791:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715178112 00000100:00100000:0.0:1788201131.350803:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:0.0:1788201131.350809:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715177856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201131.350848:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715177856:12345-0@lo:400:kworker.0 Request processed in 40us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201131.350854:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00100000:0.0:1788201131.351576:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1373 00000100:00100000:0.0:1788201131.351591:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715178112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201131.351628:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715178112:12345-0@lo:400:kworker.0 Request processed in 39us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201131.351634:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1373 00000100:00100000:0.0:1788201131.351647:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:0.0:1788201131.351651:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120021f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715177728:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201131.351668:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201131.351699:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120021f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715177728:12345-0@lo:38:kworker.0 Request processed in 47us (1863us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201131.351704:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:0.0:1788201131.351715:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:0.0:1788201131.351718:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715177984:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201131.351739:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201131.351763:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715177984:12345-0@lo:38:kworker.0 Request processed in 43us (1893us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201131.351770:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00100000:0.0:1788201131.351781:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:0.0:1788201131.351785:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715178624:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201131.351793:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201131.351815:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715178624:12345-0@lo:38:kworker.0 Request processed in 28us (1621us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201131.351820:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00100000:0.0:1788201131.351842:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715178240 00000100:00100000:0.0:1788201131.351847:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715178240 00000100:00100000:0.0:1788201131.352579:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3980 00000100:00100000:0.0:1788201131.352592:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120021c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715178240:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201131.352604:0:8458:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201131.352635:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120021c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715178240:12345-0@lo:38:kworker.0 Request processed in 43us (2486us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201131.352641:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3980 00000100:00100000:0.0:1788201131.352691:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120022a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715178112:0@lo:400:kworker.0 00000100:00100000:0.0:1788201131.352703:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120020000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715177856:0@lo:400:kworker.0 00000100:00080000:0.0:1788201131.352746:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201131.352751:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201131.352755:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120021500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715177728:0@lo:38:kworker.0 00000100:00080000:0.0:1788201131.352764:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201131.352767:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201131.352771:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715177984:0@lo:38:kworker.0 00000100:00080000:0.0:1788201131.352778:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201131.352782:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201131.352784:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120020380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715178240:0@lo:38:kworker.0 00000100:00080000:0.0:1788201131.352792:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201131.352795:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201131.352798:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120020700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715178624:0@lo:38:kworker.0 00000100:00080000:0.0:1788201131.352849:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201131.352854:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201131.352856:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201131.352891:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715178368:0@lo:400:kworker.0 00000100:00100000:0.0:1788201131.352915:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120023480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715178496:0@lo:400:kworker.0 00000100:00100000:3.0:1788201131.535667:0:66322:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0050406c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788201131.791176:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201131.856274:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040f00 going to sleep for 0 seconds 00000100:00100000:1.0:1788201132.367666:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201132.367691:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715178752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201132.367776:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201132.367827:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715178752 00000100:00100000:1.0:1788201132.367836:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715178752 00000100:00100000:1.0:1788201132.367894:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2274 00000100:00100000:1.0:1788201132.367905:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715178752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201132.367942:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788201132.367998:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715178752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201132.368006:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2274 00000100:00100000:1.0:1788201132.368083:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715178752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201132.368848:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201132.368858:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715178880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201132.368895:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201132.368924:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715178880 00000100:00100000:1.0:1788201132.368929:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715178880 00000100:00100000:1.0:1788201132.368955:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2275 00000100:00100000:1.0:1788201132.368963:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715178880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201132.368981:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201132.369037:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715178880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201132.369055:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2275 00000100:00100000:1.0:1788201132.369087:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715178880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201132.562826:0:66322:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0050406c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788201132.815303:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201132.879241:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040f00 going to sleep for 0 seconds 00000100:00100000:1.0:1788201133.587159:0:66322:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0050406c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788201133.843894:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201133.903333:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040f00 going to sleep for 0 seconds 00000100:00100000:1.0:1788201134.607079:0:66322:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0050406c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788201134.866274:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201134.927560:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040f00 going to sleep for 0 seconds 00000400:00000100:2.0:1788201135.573007:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695399936 offset 0 length 224: 4 00000100:00100000:2.0:1788201135.573085:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201135.573166:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695400192 00000100:00100000:3.0:1788201135.573177:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695400192 00000100:00100000:3.0:1788201135.573259:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1374 00000100:00100000:3.0:1788201135.573270:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2402:x1875060695400192:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201135.573347:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2402:x1875060695400192:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 78us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201135.573356:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1374 00000100:00080000:2.0:1788201135.573639:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201135.575460:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201135.575506:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201135.575533:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201135.575560:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695400320 00000100:00100000:3.0:1788201135.575569:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695400320 00000100:00100000:3.0:1788201135.575621:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695400448 00000100:00100000:3.0:1788201135.575624:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695400448 00000100:00100000:3.0:1788201135.575648:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5902 00000100:00100000:3.0:1788201135.575669:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2399:x1875060695400320:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:3.0:1788201135.575697:0:26202:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bb56 00000100:00080000:3.0:1788201135.575717:0:26202:0:(import.c:65:import_set_state_nolock()) ffff8dc0059d6000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201135.575767:0:26202:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969454 00000100:00100000:3.0:1788201135.575915:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+2:2399:x1875060695400320:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 257us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201135.575923:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5902 00000100:00100000:3.0:1788201135.575941:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5903 00000100:00100000:3.0:1788201135.575948:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2399:x1875060695400448:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:3.0:1788201135.575960:0:26202:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bb5d 00000100:00080000:3.0:1788201135.575965:0:26202:0:(import.c:65:import_set_state_nolock()) ffff8dc1031fb000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201135.575996:0:26202:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969453 00000100:00100000:3.0:1788201135.576097:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+2:2399:x1875060695400448:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 149us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201135.576105:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5903 00010000:00010000:3.0:1788201135.576134:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201135.576141:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201135.576144:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201135.576310:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695400064 00000100:00100000:2.0:1788201135.576315:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695400064 00000100:00100000:2.0:1788201135.576350:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1347 00000100:00100000:2.0:1788201135.576357:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695400064:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:2.0:1788201135.576377:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201135.576409:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695400064:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 51us (957us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201135.576415:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1347 00010000:00010000:1.0:1788201135.577949:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201135.634231:0:66322:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0050406c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788201135.894254:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201135.958196:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040f00 going to sleep for 0 seconds 00000100:00080000:1.0:1788201136.464658:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201136.464674:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201136.464678:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201136.464686:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3982 00000100:00080000:1.0:1788201136.464691:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788201136.464698:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201136.464719:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc007c37100 x1875060715179136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201136.464755:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201136.464758:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201136.464760:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201136.464763:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3982 00000100:00080000:1.0:1788201136.464766:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788201136.464769:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201136.464778:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc007c34a80 x1875060715179392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201136.464812:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201136.464815:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201136.464816:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201136.464820:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3982 00000100:00080000:1.0:1788201136.464822:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788201136.464825:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201136.464835:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc007c36680 x1875060715179648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201136.464852:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201136.464855:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201136.464856:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201136.464859:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3982 00000100:00080000:1.0:1788201136.464862:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788201136.464865:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201136.464872:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc007c37480 x1875060715180032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201136.464898:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715179264:0@lo:400:kworker.0 00000100:00100000:1.0:1788201136.464955:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201136.464984:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788201136.464989:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715179008:0@lo:400:kworker.0 00000400:00000100:1.0:1788201136.465006:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715179008 offset 0 length 224: 4 00000100:00100000:1.0:1788201136.465045:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715179904:0@lo:400:kworker.0 00000100:00100000:1.0:1788201136.465068:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201136.465098:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715179136:0@lo:38:kworker.0 00000100:00100000:1.0:1788201136.465118:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201136.465132:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715179392:0@lo:38:kworker.0 00000100:00100000:1.0:1788201136.465146:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201136.465157:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715179648:0@lo:38:kworker.0 00000100:00100000:1.0:1788201136.465175:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201136.465195:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715180032:0@lo:38:kworker.0 00000100:00100000:1.0:1788201136.465212:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201136.465234:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715179776:0@lo:400:kworker.0 00000100:00100000:1.0:1788201136.465254:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201136.465269:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201136.465273:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715179520:0@lo:400:kworker.0 00000100:00100000:1.0:1788201136.465289:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201136.465312:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715179264 00000100:00100000:1.0:1788201136.465318:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715179264 00000100:00100000:1.0:1788201136.465356:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715179136 00000100:00100000:1.0:1788201136.465358:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715179136 00000100:00100000:1.0:1788201136.465365:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715179392 00000100:00100000:1.0:1788201136.465367:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715179392 00000100:00100000:1.0:1788201136.465373:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715180032 00000100:00100000:1.0:1788201136.465375:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715180032 00000100:00100000:1.0:1788201136.465381:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715179520 00000100:00100000:1.0:1788201136.465383:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715179520 00000100:00100000:1.0:1788201136.465397:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1375 00000100:00100000:1.0:1788201136.465815:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715179264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201136.465913:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715179264:12345-0@lo:400:kworker.0 Request processed in 508us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201136.465921:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1375 00000100:00100000:1.0:1788201136.465950:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1376 00000100:00100000:1.0:1788201136.465956:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715179520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201136.465991:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715179520:12345-0@lo:400:kworker.0 Request processed in 35us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201136.465996:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1376 00000100:00100000:1.0:1788201136.466009:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:1.0:1788201136.466012:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715179136:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201136.466045:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201136.466075:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715179136:12345-0@lo:38:kworker.0 Request processed in 61us (956us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201136.466081:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:1.0:1788201136.466093:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:1.0:1788201136.466096:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715179392:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201136.466106:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201136.466130:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715179392:12345-0@lo:38:kworker.0 Request processed in 32us (983us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201136.466136:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:1.0:1788201136.466146:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:1.0:1788201136.466150:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715180032:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201136.466159:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201136.466180:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715180032:12345-0@lo:38:kworker.0 Request processed in 29us (967us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201136.466185:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00100000:1.0:1788201136.466202:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715179904 00000100:00100000:1.0:1788201136.466206:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715179904 00000100:00100000:1.0:1788201136.466240:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715179776 00000100:00100000:1.0:1788201136.466243:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715179776 00000100:00100000:1.0:1788201136.466260:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2814 00000100:00100000:1.0:1788201136.466265:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715179904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201136.466294:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715179904:12345-0@lo:400:kworker.0 Request processed in 29us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201136.466300:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2814 00000100:00100000:1.0:1788201136.466310:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2815 00000100:00100000:1.0:1788201136.466315:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715179776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201136.466337:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715179776:12345-0@lo:400:kworker.0 Request processed in 22us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201136.466343:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2815 00000100:00080000:1.0:1788201136.466372:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201136.466375:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201136.466377:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201136.467974:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715179520:0@lo:400:kworker.0 00000100:00100000:1.0:1788201136.467997:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715179776:0@lo:400:kworker.0 00000100:00080000:1.0:1788201136.468060:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201136.468065:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201136.468069:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715179136:0@lo:38:kworker.0 00000100:00080000:1.0:1788201136.468077:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201136.468080:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201136.468082:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715179392:0@lo:38:kworker.0 00000100:00080000:1.0:1788201136.468090:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201136.468093:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201136.468106:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715180032:0@lo:38:kworker.0 00000100:00100000:1.0:1788201136.468206:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715179648 00000100:00100000:1.0:1788201136.468212:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715179648 00000100:00100000:1.0:1788201136.468244:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3981 00000100:00100000:1.0:1788201136.468251:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715179648:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201136.468266:0:23728:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201136.468318:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715179648:12345-0@lo:38:kworker.0 Request processed in 66us (3141us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201136.468324:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3981 00000100:00080000:1.0:1788201136.468348:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201136.468352:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201136.468355:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715179648:0@lo:38:kworker.0 00000100:00100000:2.0:1788201136.476695:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715179264:0@lo:400:kworker.0 00000100:00100000:2.0:1788201136.476730:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715179904:0@lo:400:kworker.0 00000100:00100000:3.0:1788201136.655138:0:66322:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0050406c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788201136.913973:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201136.975104:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040f00 going to sleep for 0 seconds 00000100:00100000:3.0:1788201136.975208:0:66321:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 2 min 2 max 256 00000100:00100000:3.0:1788201136.975219:0:66321:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0002' 00000100:00100000:3.0:1788201137.112850:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000400:00000100:3.0:1788201137.112886:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695400576 offset 0 length 520: 4 00000100:00100000:3.0:1788201137.112911:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201137.112996:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695400832 00000100:00100000:1.0:1788201137.113006:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695400832 00000100:00100000:1.0:1788201137.113104:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695400704 00000100:00100000:1.0:1788201137.113108:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695400704 00000100:00100000:1.0:1788201137.113128:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1377 00000100:00100000:1.0:1788201137.113139:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2400:x1875060695400832:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201137.113212:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2400:x1875060695400832:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 75us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201137.113217:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1377 00000100:00100000:1.0:1788201137.113233:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1351 00000100:00100000:1.0:1788201137.113236:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2399:x1875060695400704:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:1.0:1788201137.113253:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201137.113270:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2399:x1875060695400704:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 33us (360us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201137.113285:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1351 00000100:00080000:3.0:1788201137.114773:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:01000004:3.0:1788201137.329005:0:92543:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788201137.329011:0:92543:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788201137.329012:0:92543:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788201137.329149:0:92543:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dc11d63c000 00000020:01000004:3.0:1788201137.329165:0:92543:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788201137.329188:0:92543:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788201137.329204:0:92543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8dc12f0c0000) 00000020:00000080:3.0:1788201137.329221:0:92543:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788201137.374279:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788201137.378871:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788201137.379912:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788201137.380372:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788201137.380760:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788201137.380994:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788201137.381266:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788201137.381539:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788201137.381858:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788201137.382123:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788201137.382349:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788201137.382705:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788201137.383050:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788201137.383341:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788201137.387375:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788201137.388743:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788201137.389108:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788201137.389336:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788201137.389733:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788201137.389923:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788201137.390237:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788201137.390474:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788201137.390774:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788201137.391012:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788201137.391484:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788201137.391831:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788201137.392153:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788201137.392351:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788201137.392729:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788201137.393011:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788201137.393291:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788201137.393519:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788201137.393802:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788201137.394082:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788201137.394298:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788201137.394633:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788201137.394856:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788201137.395346:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788201137.395701:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788201137.395988:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788201137.396238:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788201137.396438:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788201137.396820:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788201137.397097:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788201137.397661:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788201137.397899:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788201137.398214:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788201137.399254:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788201137.399748:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788201137.400005:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788201137.400647:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788201137.400882:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788201137.401169:0:92543:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1788201137.401698:0:92543:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788201137.401893:0:92543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788201137.401900:0:92543:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788201137.401910:0:92543:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1bbe9 00000020:01000004:3.0:1788201137.401916:0:92543:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788201137.401927:0:92543:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788201137.402271:0:92543:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dc11d63c000 from MGS 00000020:01000004:3.0:1788201137.402275:0:92543:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788201137.402285:0:92543:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8dc12f0c19b8) 00000020:00000080:3.0:1788201137.402297:0:92543:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:3.0:1788201137.402350:0:92543:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc11d63c000 from MGS, refs=2 00080000:01000000:3.0:1788201137.402354:0:92543:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788201137.402359:0:92543:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1bbf7 00010000:00010000:3.0:1788201137.402492:0:92543:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1788201137.411143:0:92543:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788201137.412157:0:92547:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788201137.412197:0:92543:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788201137.412228:0:92543:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788201137.417973:0:92543:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788201137.418230:0:92543:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201137.418399:0:92543:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788201137.418405:0:92543:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788201137.427219:0:92543:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788201137.427232:0:92543:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788201137.427852:0:92543:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788201137.427859:0:92543:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788201137.428518:0:92543:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788201137.428543:0:92543:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1788201137.428544:0:92543:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.120@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1788201137.428548:0:92543:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.120@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:3.0:1788201137.428619:0:92543:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788201137.428639:0:92543:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788201137.428642:0:92543:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.120@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788201137.428644:0:92543:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788201137.428654:0:92543:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc005d5b480 x1875060715173888/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201137 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201137.428712:0:92543:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc005d5aa00 x1875060715176064/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201142 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201137.428733:0:92543:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc120022d80 x1875060715177600/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201147 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201137.428760:0:92543:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc007c35180 x1875060715179008/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201152 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788201137.428768:0:92543:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788201137.428771:0:92543:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788201137.428772:0:92543:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788201137.428775:0:92543:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1788201137.428856:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715176064:0@lo:400:kworker.0 00000100:00100000:3.0:1788201137.429075:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715179008:0@lo:400:kworker.0 00000100:00100000:3.0:1788201137.429088:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120022d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715177600:0@lo:400:kworker.0 00000100:00100000:1.0:1788201137.430211:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715173888:0@lo:400:kworker.0 10000000:01000000:0.0:1788201137.430285:0:92543:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1788201137.430303:0:92543:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc004fdcc00/0x96d0c9b8c9a1b7cf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1b7d6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201137.430314:0:92543:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc004fdcc00/0x96d0c9b8c9a1b7cf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1b7d6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201137.430321:0:92543:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788201137.430342:0:92543:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201137.430352:0:92543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc004fdcc00/0x96d0c9b8c9a1b7cf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1b7d6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.430370:0:92543:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007a2c200/0x96d0c9b8c9a1b735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1b73c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201137.430376:0:92543:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007a2c200/0x96d0c9b8c9a1b735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1b73c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201137.430391:0:92543:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201137.430396:0:92543:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201137.430399:0:92543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007a2c200/0x96d0c9b8c9a1b735 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1b73c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.430409:0:92543:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc200/0x96d0c9b8c9a1b751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1b758 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201137.430427:0:92543:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc200/0x96d0c9b8c9a1b751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1b758 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201137.430433:0:92543:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201137.430436:0:92543:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201137.430440:0:92543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc200/0x96d0c9b8c9a1b751 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1b758 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.430457:0:92543:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d200/0x96d0c9b8c9a1b77b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1b782 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201137.430463:0:92543:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d200/0x96d0c9b8c9a1b77b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1b782 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201137.430468:0:92543:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201137.430471:0:92543:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201137.430474:0:92543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007a2d200/0x96d0c9b8c9a1b77b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1b782 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.430483:0:92543:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007a2ca00/0x96d0c9b8c9a1b789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1b790 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201137.430489:0:92543:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007a2ca00/0x96d0c9b8c9a1b789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1b790 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201137.430493:0:92543:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201137.430496:0:92543:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201137.430499:0:92543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007a2ca00/0x96d0c9b8c9a1b789 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1b790 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.430516:0:92543:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd800/0x96d0c9b8c9a1b7a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1b7ac expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201137.430522:0:92543:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd800/0x96d0c9b8c9a1b7a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1b7ac expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201137.430526:0:92543:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201137.430529:0:92543:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201137.430533:0:92543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd800/0x96d0c9b8c9a1b7a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1b7ac expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.430540:0:92543:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc800/0x96d0c9b8c9a1b7b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1b7ba expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201137.430752:0:92543:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc800/0x96d0c9b8c9a1b7b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1b7ba expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201137.430760:0:92543:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201137.430773:0:92543:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201137.430778:0:92543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc004fdc800/0x96d0c9b8c9a1b7b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1b7ba expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.430788:0:92543:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc100030c00/0x96d0c9b8c9a1b7dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1b7e4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201137.430795:0:92543:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc100030c00/0x96d0c9b8c9a1b7dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1b7e4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201137.430800:0:92543:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201137.430809:0:92543:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201137.430813:0:92543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc100030c00/0x96d0c9b8c9a1b7dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1b7e4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.430824:0:92543:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd000/0x96d0c9b8c9a1b743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1b74a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201137.430830:0:92543:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd000/0x96d0c9b8c9a1b743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1b74a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201137.430835:0:92543:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201137.430837:0:92543:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201137.430840:0:92543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc004fdd000/0x96d0c9b8c9a1b743 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1b74a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.430851:0:92543:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1b75f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1b766 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201137.430857:0:92543:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1b75f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1b766 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201137.430861:0:92543:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201137.430864:0:92543:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201137.430867:0:92543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc00782ce00/0x96d0c9b8c9a1b75f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1b766 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.430877:0:92543:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc12f338400/0x96d0c9b8c9a1b76d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1b774 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201137.430883:0:92543:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc12f338400/0x96d0c9b8c9a1b76d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1b774 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201137.430898:0:92543:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788201137.430901:0:92543:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201137.430906:0:92543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc12f338400/0x96d0c9b8c9a1b76d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1b774 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.430915:0:92543:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc004fdce00/0x96d0c9b8c9a1b797 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1b79e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201137.430921:0:92543:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc004fdce00/0x96d0c9b8c9a1b797 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1b79e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201137.430926:0:92543:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788201137.431172:0:92543:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201137.431178:0:92543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc004fdce00/0x96d0c9b8c9a1b797 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1b79e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.431187:0:92543:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007a2c800/0x96d0c9b8c9a1b7c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1b7c8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201137.431193:0:92543:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007a2c800/0x96d0c9b8c9a1b7c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1b7c8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201137.431197:0:92543:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788201137.431201:0:92543:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201137.431204:0:92543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007a2c800/0x96d0c9b8c9a1b7c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1b7c8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788201137.431221:0:92543:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8dc104280800 already not connected (conn 73, was 0): DISCONN 00000100:00080000:0.0:1788201137.431227:0:92543:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201137.431240:0:92543:0:(import.c:510:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 3931 00000100:00080000:0.0:1788201137.431248:0:92543:0:(import.c:624:import_select_connection()) MGC192.168.201.120@tcp: import ffff8dc104280800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201137.431282:0:92543:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efe3b80 x1875060715180160/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201137.431344:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715180160:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788201137.431443:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788201137.431707:0:92543:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:0.0:1788201137.432208:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715180160 00000100:00100000:0.0:1788201137.432218:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715180160 00000100:00100000:0.0:1788201137.432285:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201137.432294:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3654:x1875060715180160:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788201137.432322:0:92549:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c9b18af6-fecc-4172-82c2-66531890fe11@0@lo t0 exp 0000000000000000 cur 3988 last 0 00000020:00000080:0.0:1788201137.432350:0:92549:0:(genops.c:1385:class_connect()) connect: client c9b18af6-fecc-4172-82c2-66531890fe11, cookie 0x96d0c9b8c9a1bbfe 00000100:00080000:0.0:1788201137.432677:0:92549:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201137.432842:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+5:3654:x1875060715180160:12345-0@lo:250:mount.lustre.0 Request processed in 547us (1398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201137.432851:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201137.432917:0:3654:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.120@tcp: committing for last_committed 0 gen 28 00000100:00080000:3.0:1788201137.432925:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.120@tcp: connect to target with instance 0 00000100:00080000:3.0:1788201137.432940:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788201137.432944:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788201137.432947:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788201137.432950:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788201137.432972:0:3654:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788201137.432980:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715180160:0@lo:250:mount.lustre.0 00000020:01000000:3.0:1788201137.433064:0:86307:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.201.120@tcp 10000000:01000000:3.0:1788201137.433085:0:86307:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1788201137.433088:0:86307:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788201137.433091:0:86307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201137.433092:0:86307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201137.433094:0:86307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201137.433095:0:86307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201137.433096:0:86307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201137.433098:0:86307:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201137.433099:0:86307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201137.433100:0:86307:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788201137.433129:0:86307:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1788201137.433135:0:86307:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1788201137.433136:0:86307:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788201137.433138:0:86307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788201137.433139:0:86307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201137.433140:0:86307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201137.433141:0:86307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201137.433142:0:86307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201137.433143:0:86307:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201137.433144:0:86307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201137.433145:0:86307:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788201137.433160:0:86307:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1788201137.433164:0:86307:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1788201137.433166:0:86307:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788201137.433167:0:86307:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788201137.433168:0:86307:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201137.433169:0:86307:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201137.433170:0:86307:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201137.433171:0:86307:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201137.433172:0:86307:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201137.433174:0:86307:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201137.433175:0:86307:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788201137.433184:0:86307:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1788201137.433211:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715180544:0@lo:253:kworker.0 00000100:00100000:3.0:1788201137.433246:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201137.433302:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201137.433311:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715180288:0@lo:253:kworker.0 00000100:00100000:2.0:1788201137.433346:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201137.433869:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201137.433882:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715180416:0@lo:253:kworker.0 00000100:00100000:3.0:1788201137.433907:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201137.434214:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715180544 00000100:00100000:1.0:1788201137.434221:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715180544 00000100:00100000:1.0:1788201137.434258:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715180288 00000100:00100000:1.0:1788201137.434260:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715180288 00000100:00100000:1.0:1788201137.434271:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201137.434279:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+6:3656:x1875060715180544:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788201137.434307:0:92550:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1788201137.434350:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201137.434357:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+6:3657:x1875060715180288:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788201137.434369:0:92551:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 10000000:01000000:3.0:1788201137.434906:0:92552:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00080000:2.0:1788201137.435466:0:92543:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1788201137.435478:0:92543:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788201137.435512:0:92543:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788201137.435517:0:92543:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788201137.435724:0:92543:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788201137.435866:0:92543:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.120@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788201137.435871:0:92543:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788201137.435873:0:92543:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201137.435874:0:92543:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201137.435876:0:92543:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201137.435877:0:92543:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201137.435878:0:92543:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201137.435879:0:92543:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201137.435881:0:92543:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201137.435883:0:92543:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201137.435885:0:92543:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788201137.435887:0:92543:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788201137.435889:0:92543:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788201137.435891:0:92543:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201137.435892:0:92543:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201137.435893:0:92543:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201137.435894:0:92543:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201137.435895:0:92543:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201137.435896:0:92543:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201137.435897:0:92543:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201137.435898:0:92543:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201137.435900:0:92543:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788201137.435925:0:92543:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788201137.436044:0:92543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715180672:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788201137.436107:0:92543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201137.436132:0:92543:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1259aef00 going to sleep for 11 seconds 20000000:01000000:1.0:1788201137.436269:0:92550:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 119 00000100:00100000:0.0:1788201137.437780:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715180416 00000100:00100000:0.0:1788201137.437793:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715180416 00000100:00100000:0.0:1788201137.437837:0:92549:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1788201137.437845:0:92549:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:3.0:1788201137.438295:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715180672 00000100:00100000:3.0:1788201137.438301:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715180672 00000100:00100000:0.0:1788201137.438427:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788201137.438437:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+8:3656:x1875060715180416:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788201137.438480:0:92554:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788201137.439848:0:92553:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788201137.439854:0:92553:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788201137.439858:0:92553:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788201137.439861:0:92553:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788201137.440252:0:92553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788201137.440653:0:92550:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788201137.440712:0:92551:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788201137.443461:0:92551:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788201137.443475:0:92551:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788201137.443761:0:92552:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788201137.443767:0:92552:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788201137.443795:0:92552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc0078fc600/0x96d0c9b8c9a1bc05 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.443811:0:92552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fc600/0x96d0c9b8c9a1bc05 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788201137.443820:0:92552:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000054460s 00010000:00010000:3.0:1788201137.443825:0:92552:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc0078fc600/0x96d0c9b8c9a1bc05 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.443832:0:92552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc0078fc600/0x96d0c9b8c9a1bc05 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.443840:0:92552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc0078fc600/0x96d0c9b8c9a1bc05 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.443847:0:92552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc0078fc600/0x96d0c9b8c9a1bc05 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.443852:0:92552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fc600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201137.443857:0:92552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc0078fc600/0x96d0c9b8c9a1bc05 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.443864:0:92552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc0078fc600/0x96d0c9b8c9a1bc05 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.443890:0:92552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc0078fc600/0x96d0c9b8c9a1bc05 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.443898:0:92552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc0078fc600/0x96d0c9b8c9a1bc05 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.443904:0:92552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fc600/0x96d0c9b8c9a1bc05 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201137.444355:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:3657:x1875060715180288:12345-0@lo:253:kworker.0 Request processed in 9994us (11003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201137.444370:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201137.444417:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201137.444426:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+7:92543:x1875060715180672:12345-0@lo:253:mount.lustre.0 00000020:01000004:3.0:1788201137.444543:0:3657:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788201137.444556:0:3657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201137.444557:0:3657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201137.444559:0:3657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201137.444560:0:3657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201137.444561:0:3657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201137.444563:0:3657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201137.444565:0:3657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201137.444566:0:3657:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788201137.444570:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715180288:0@lo:253:kworker.0 20000000:01000000:2.0:1788201137.444820:0:92551:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788201137.444823:0:92551:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788201137.444826:0:92551:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1788201137.444831:0:92551:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788201137.445139:0:92554:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788201137.445473:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+7:92543:x1875060715180672:12345-0@lo:253:mount.lustre.0 Request processed in 1048us (9366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201137.445484:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201137.445732:0:92543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715180672:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788201137.445761:0:92543:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788201137.445763:0:92543:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201137.445765:0:92543:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201137.445766:0:92543:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201137.445767:0:92543:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201137.445768:0:92543:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201137.445769:0:92543:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201137.445770:0:92543:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201137.445771:0:92543:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201137.445772:0:92543:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201137.445774:0:92543:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788201137.445793:0:92543:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dc11d63c000 from lustre-MDT0000 10000000:01000000:2.0:1788201137.445822:0:92543:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788201137.445825:0:92543:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788201137.445834:0:92543:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dc11d63c000 10000000:01000000:2.0:1788201137.445839:0:92543:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788201137.445844:0:92543:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8dc11d63c000 10000000:01000000:2.0:1788201137.445847:0:92543:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788201137.445861:0:92543:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dc11d63c000 from 1 10000000:01000000:2.0:1788201137.445865:0:92543:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788201137.445903:0:92543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc005da6600/0x96d0c9b8c9a1bc0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.445913:0:92543:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc005da6600/0x96d0c9b8c9a1bc0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.445922:0:92543:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc005da6600/0x96d0c9b8c9a1bc0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201137.446189:0:92543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715180800:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201137.446234:0:92543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201137.446267:0:92543:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccf900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201137.446391:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715180800 00000100:00100000:3.0:1788201137.446398:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715180800 00000100:00100000:3.0:1788201137.446438:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788201137.446454:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+7:92543:x1875060715180800:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201137.446467:0:92549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201137.446481:0:92549:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fc400/0x96d0c9b8c9a1bc13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1bc0c expref: -99 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.447194:0:92549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fc400/0x96d0c9b8c9a1bc13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bc0c expref: 8 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.447206:0:92549:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fc400/0x96d0c9b8c9a1bc13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bc0c expref: 8 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.447216:0:92549:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fc400, rc 0) 00000100:00100000:3.0:1788201137.447264:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+8:92543:x1875060715180800:12345-0@lo:101:mount.lustre.0 Request processed in 818us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201137.447271:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201137.448341:0:92543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715180800:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201137.448365:0:92543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc005da6600/0x96d0c9b8c9a1bc0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bc13 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.448375:0:92543:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc005da6600/0x96d0c9b8c9a1bc0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1bc13 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201137.448400:0:92543:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788201137.448419:0:92543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc005da6600/0x96d0c9b8c9a1bc0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bc13 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.448427:0:92543:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc005da6600/0x96d0c9b8c9a1bc0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bc13 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201137.448435:0:92543:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788201137.448457:0:92543:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788201137.448462:0:92543:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8dc11d63c000 10000000:01000000:2.0:1788201137.448465:0:92543:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788201137.448469:0:92543:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788201137.448472:0:92543:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788201137.448504:0:92543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc005da6c00/0x96d0c9b8c9a1bc1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.448513:0:92543:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc005da6c00/0x96d0c9b8c9a1bc1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.448522:0:92543:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc005da6c00/0x96d0c9b8c9a1bc1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201137.448539:0:92543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715180928:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201137.448803:0:92543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201137.448840:0:92543:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccf900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201137.448860:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715180928 00000100:00100000:2.0:1788201137.448865:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715180928 00000100:00100000:2.0:1788201137.448899:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201137.448907:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:92543:x1875060715180928:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201137.448918:0:92551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201137.451121:0:92551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc005da7800/0x96d0c9b8c9a1bc21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1bc1a expref: -99 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.451159:0:92551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc005da7800/0x96d0c9b8c9a1bc21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bc1a expref: 9 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.451172:0:92551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc005da7800/0x96d0c9b8c9a1bc21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bc1a expref: 9 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.451198:0:92551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc005da7800, rc 0) 00000100:00100000:2.0:1788201137.451319:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+9:92543:x1875060715180928:12345-0@lo:101:mount.lustre.0 Request processed in 2410us (2514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201137.451328:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 20000000:01000000:2.0:1788201137.453784:0:92554:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788201137.453805:0:92554:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788201137.454166:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+8:3656:x1875060715180416:12345-0@lo:253:kworker.0 Request processed in 15726us (20253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201137.454177:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:2.0:1788201137.454227:0:3656:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788201137.454229:0:3656:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788201137.454230:0:3656:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201137.454232:0:3656:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201137.454233:0:3656:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201137.454234:0:3656:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201137.454235:0:3656:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201137.454238:0:3656:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201137.454239:0:3656:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788201137.454242:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715180416:0@lo:253:kworker.0 20000000:01000000:0.0:1788201137.454320:0:92552:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788201137.454325:0:92552:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788201137.454348:0:92552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc00782ce00/0x96d0c9b8c9a1bc28 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.454364:0:92552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782ce00/0x96d0c9b8c9a1bc28 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788201137.454395:0:92552:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000071451s 00010000:00010000:0.0:1788201137.454400:0:92552:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc00782ce00/0x96d0c9b8c9a1bc28 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.454408:0:92552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc00782ce00/0x96d0c9b8c9a1bc28 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.454415:0:92552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc00782ce00/0x96d0c9b8c9a1bc28 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.454423:0:92552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc00782ce00/0x96d0c9b8c9a1bc28 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.454429:0:92552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782ce00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201137.454433:0:92552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc00782ce00/0x96d0c9b8c9a1bc28 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.454440:0:92552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc00782ce00/0x96d0c9b8c9a1bc28 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.454452:0:92552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc00782ce00/0x96d0c9b8c9a1bc28 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.454459:0:92552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc00782ce00/0x96d0c9b8c9a1bc28 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.454465:0:92552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782ce00/0x96d0c9b8c9a1bc28 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788201137.454560:0:92550:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788201137.455192:0:92543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715180928:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201137.455211:0:92543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc005da6c00/0x96d0c9b8c9a1bc1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bc21 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.455220:0:92543:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc005da6c00/0x96d0c9b8c9a1bc1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1bc21 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201137.455302:0:92543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715181056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201137.455344:0:92543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201137.455414:0:92543:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a49b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201137.456356:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715181056 00000100:00100000:0.0:1788201137.456377:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715181056 00000100:00100000:0.0:1788201137.456718:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201137.456729:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+8:92543:x1875060715181056:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201137.456976:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+9:92543:x1875060715181056:12345-0@lo:501:mount.lustre.0 Request processed in 249us (1630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201137.456984:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788201137.457270:0:92543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715181056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201137.457314:0:92543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715181184:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201137.457372:0:92543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201137.457501:0:92543:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a49b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201137.458575:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715181184 00000100:00100000:0.0:1788201137.458584:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715181184 00000100:00100000:0.0:1788201137.458894:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788201137.458904:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+9:92543:x1875060715181184:12345-0@lo:503:mount.lustre.0 20000000:01000000:1.0:1788201137.460362:0:92550:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788201137.460380:0:92550:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788201137.460542:0:92552:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788201137.460557:0:92552:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788201137.460580:0:92552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1bc2f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.460598:0:92552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1bc2f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788201137.460607:0:92552:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000071451s 00010000:00010000:0.0:1788201137.460612:0:92552:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1bc2f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.460618:0:92552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1bc2f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.460636:0:92552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1bc2f lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.460650:0:92552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1bc2f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.460670:0:92552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201137.460675:0:92552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1bc2f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.460684:0:92552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1bc2f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.460699:0:92552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1bc2f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.460707:0:92552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1bc2f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.460714:0:92552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1bc2f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201137.461269:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+9:3656:x1875060715180544:12345-0@lo:253:kworker.0 Request processed in 26986us (28018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201137.461280:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:3.0:1788201137.461395:0:3656:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788201137.461405:0:3656:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788201137.461407:0:3656:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201137.461408:0:3656:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201137.461410:0:3656:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201137.461412:0:3656:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201137.461413:0:3656:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201137.461415:0:3656:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201137.461416:0:3656:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788201137.461420:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715180544:0@lo:253:kworker.0 00000100:00100000:0.0:1788201137.461872:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+8:92543:x1875060715181184:12345-0@lo:503:mount.lustre.0 Request processed in 2968us (4498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201137.461880:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201137.462101:0:92543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715181184:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201137.462521:0:92555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:92555:1875060715181312:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201137.462641:0:92555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201137.462736:0:92555:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103892000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201137.462827:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715181312 00000100:00100000:3.0:1788201137.462833:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715181312 00000100:00100000:3.0:1788201137.462898:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201137.462907:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:92555:x1875060715181312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201137.464438:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:92555:x1875060715181312:12345-0@lo:502:llog_process_th.0 Request processed in 1525us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201137.464458:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788201137.464549:0:92555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:92555:1875060715181312:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201137.464599:0:92555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201137.464610:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201137.464613:0:92555:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788201137.464635:0:92555:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788201137.464639:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201137.464662:0:92555:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8dc004fd19b8) 00000020:00000080:0.0:1788201137.464687:0:92555:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:0.0:1788201137.464694:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788201137.464807:0:92555:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788201137.464817:0:92555:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1bc3d 00000020:00000080:0.0:1788201137.465076:0:92555:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788201137.465081:0:92555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201137.465085:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201137.465087:0:92555:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788201137.465090:0:92555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201137.465094:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201137.465095:0:92555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788201137.465099:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201137.465106:0:92555:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8dc004fd3370) 00000020:00000080:0.0:1788201137.465118:0:92555:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:0.0:1788201137.465122:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788201137.465124:0:92555:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788201137.465127:0:92555:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788201137.465132:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788201137.465179:0:92555:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc11d63c000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788201137.465191:0:92555:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8dc004fd4d28) 00000020:00000080:0.0:1788201137.465200:0:92555:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:0.0:1788201137.465251:0:92555:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788201137.465257:0:92555:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1bc52 00000020:00000080:0.0:1788201137.465348:0:92555:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788201137.465354:0:92555:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788201137.465358:0:92555:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x96d0c9b8c9a1bc59 00080000:01000000:0.0:1788201137.465362:0:92555:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788201137.465366:0:92555:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1bc60 00000100:00100000:1.0:1788201137.487229:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715181440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201137.487305:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201137.487373:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715181440 00000100:00100000:1.0:1788201137.487381:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715181440 00000100:00100000:1.0:1788201137.487443:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2276 00000100:00100000:1.0:1788201137.487464:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ac46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715181440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201137.487499:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201137.487768:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ac46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715181440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201137.487778:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2276 00000100:00100000:2.0:1788201137.492172:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715181568:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201137.492241:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201137.492331:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715181440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201137.492829:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715181568 00000100:00100000:1.0:1788201137.492836:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715181568 00000100:00100000:1.0:1788201137.492896:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2277 00000100:00100000:1.0:1788201137.492907:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715181568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201137.492948:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788201137.492998:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715181568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201137.493005:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2277 00000100:00100000:1.0:1788201137.493062:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715181568:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788201137.579221:0:92555:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1788201137.579849:0:92555:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 115964116996 lx: 0 gen 22 00000001:00080000:2.0:1788201137.579898:0:92555:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 6e293f14-c501-4bc5-9dd4-a18ef02756b4 idx: 2 lr: 0 srv lr: 115964116996 lx: 0 gen 24 00000001:00000004:2.0:1788201137.579923:0:92555:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 115964116996 00000001:00080000:2.0:1788201137.581184:0:92555:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1788201137.581257:0:92555:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc006ccf780: xid 1875060715167488, transno 115964116996, client gen 22, slot idx 0 00000020:00000080:2.0:1788201137.582836:0:92555:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8dc13f874d28) 00000020:00000080:2.0:1788201137.582863:0:92555:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1788201137.583609:0:92555:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788201137.583630:0:92555:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1bc7c 00000020:00000080:1.0:1788201137.595242:0:92555:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788201137.600996:0:92555:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x96d0c9b8c9a1bc83 00000020:00000080:1.0:1788201137.601343:0:92555:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788201137.601354:0:92555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201137.601359:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201137.601361:0:92555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788201137.601364:0:92555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788201137.601367:0:92555:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1788201137.601369:0:92555:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201137.601370:0:92555:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201137.601372:0:92555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788201137.601374:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201137.601380:0:92555:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788201137.601393:0:92555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201137.601399:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201137.601400:0:92555:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788201137.601405:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788201137.601452:0:92555:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788201137.601466:0:92555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201137.601469:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201137.601470:0:92555:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788201137.601473:0:92555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201137.601476:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201137.601477:0:92555:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788201137.601480:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788201137.601486:0:92555:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:00000080:1.0:1788201137.601514:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201137.601530:0:92555:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8dc139bb99b8) 00000020:00000080:1.0:1788201137.601557:0:92555:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1788201137.601564:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788201137.601630:0:92555:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788201137.601637:0:92555:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788201137.601710:0:92555:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1bc91 00010000:00080000:1.0:1788201137.601745:0:92555:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc13f869000@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:1.0:1788201137.605269:0:92555:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1788201137.606833:0:92555:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201137.606847:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788201137.606887:0:92555:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788201137.606913:0:92555:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1bc98 00000100:00080000:3.0:1788201137.606923:0:92555:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201137.606928:0:92555:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8dc13f869000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201137.606977:0:92555:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc1331dfb80 x1875060715181696/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201137.607007:0:92555:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788201137.607109:0:92555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201137.607113:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201137.607115:0:92555:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788201137.607118:0:92555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788201137.607127:0:92555:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1788201137.607129:0:92555:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201137.607131:0:92555:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201137.607132:0:92555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788201137.607135:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201137.607137:0:92555:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788201137.607139:0:92555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788201137.607144:0:92555:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788201137.607147:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201137.607148:0:92555:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788201137.607151:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788201137.607155:0:92555:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:3.0:1788201137.607178:0:92555:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788201137.607181:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201137.607193:0:92555:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8dc1060e3370) 00000020:00000080:3.0:1788201137.607209:0:92555:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1788201137.607214:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788201137.607276:0:92555:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788201137.607283:0:92555:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788201137.607291:0:92555:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1bca6 00010000:00080000:3.0:1788201137.607319:0:92555:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc1259e4000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:3.0:1788201137.607745:0:92555:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00080000:0.0:1788201137.608324:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201137.608329:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201137.608333:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201137.608339:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3987 00000100:00080000:0.0:1788201137.608343:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201137.608349:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201137.608371:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efe2d80 x1875060715181952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201137.608399:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201137.608402:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201137.608404:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201137.608407:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3987 00000100:00080000:0.0:1788201137.608409:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201137.608412:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201137.608421:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efe0e00 x1875060715182208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201137.608454:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201137.608458:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201137.608460:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201137.608463:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3987 00000100:00080000:0.0:1788201137.608465:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201137.608468:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201137.608479:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efe3b80 x1875060715182464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201137.608498:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201137.608500:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201137.608501:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201137.608505:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3987 00000100:00080000:0.0:1788201137.608507:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201137.608510:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201137.608528:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d5b100 x1875060715182848/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201137.608811:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715181824:0@lo:400:kworker.0 00000100:00100000:3.0:1788201137.608878:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201137.608920:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715182720:0@lo:400:kworker.0 00000100:00100000:3.0:1788201137.609051:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201137.609075:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201137.609082:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715182080:0@lo:400:kworker.0 00000100:00100000:3.0:1788201137.609107:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201137.609146:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715182720 00000100:00100000:3.0:1788201137.609161:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715182720 00000100:00100000:3.0:1788201137.609208:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2816 00000100:00100000:3.0:1788201137.609217:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715182720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201137.609268:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715182720:12345-0@lo:400:kworker.0 Request processed in 53us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201137.609275:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2816 00000100:00100000:3.0:1788201137.609319:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715182720:0@lo:400:kworker.0 00000100:00100000:2.0:1788201137.609453:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715181696:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788201137.609488:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201137.609513:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715181952:0@lo:38:kworker.0 00000100:00100000:2.0:1788201137.609533:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201137.609562:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715182208:0@lo:38:kworker.0 00000100:00100000:2.0:1788201137.609581:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201137.609595:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715182464:0@lo:38:kworker.0 00000100:00100000:2.0:1788201137.609614:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201137.609654:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715182848:0@lo:38:kworker.0 00000100:00100000:2.0:1788201137.609676:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201137.609709:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715182336:0@lo:400:kworker.0 00000100:00100000:2.0:1788201137.609732:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201137.609749:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201137.609755:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715182592:0@lo:400:kworker.0 00000100:00100000:2.0:1788201137.609776:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201137.609802:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715181696 00000100:00100000:2.0:1788201137.609805:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715181696 00000100:00100000:2.0:1788201137.609822:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715182464 00000100:00100000:2.0:1788201137.609824:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715182464 00000100:00100000:2.0:1788201137.609839:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3982 00000100:00100000:2.0:1788201137.609845:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715181696:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788201137.609878:0:8457:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3989 last 0 00000020:00000080:2.0:1788201137.609912:0:8457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1bcad 00000004:00100000:2.0:1788201137.609941:0:8457:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201137.610057:0:8457:0:(import.c:65:import_set_state_nolock()) ffff8dc005fac000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201137.610095:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715181696:12345-0@lo:38:llog_process_th.0 Request processed in 249us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201137.610102:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3982 00000100:00100000:2.0:1788201137.610115:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3983 00000100:00100000:2.0:1788201137.610119:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715182464:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788201137.610147:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715182464:12345-0@lo:38:kworker.0 Request processed in 26us (532us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788201137.610152:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3983 00000100:00100000:2.0:1788201137.610169:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715182080 00000100:00100000:2.0:1788201137.610172:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715182080 00000100:00100000:2.0:1788201137.610189:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715181952 00000100:00100000:2.0:1788201137.610192:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715181952 00000100:00100000:2.0:1788201137.610199:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715182208 00000100:00100000:2.0:1788201137.610201:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715182208 00000100:00100000:2.0:1788201137.610208:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715182848 00000100:00100000:2.0:1788201137.610210:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715182848 00000100:00100000:2.0:1788201137.610216:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715182336 00000100:00100000:2.0:1788201137.610218:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715182336 00000100:00100000:2.0:1788201137.610230:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1378 00000100:00100000:2.0:1788201137.610236:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715182080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201137.610269:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715182080:12345-0@lo:400:kworker.0 Request processed in 34us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201137.610276:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1378 00000100:00100000:2.0:1788201137.610287:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1379 00000100:00100000:2.0:1788201137.610300:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715182336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201137.610329:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715182336:12345-0@lo:400:kworker.0 Request processed in 30us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201137.610335:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1379 00000100:00100000:2.0:1788201137.610347:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:2.0:1788201137.610351:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715181952:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788201137.610378:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715181952:12345-0@lo:38:kworker.0 Request processed in 26us (844us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788201137.610385:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00100000:2.0:1788201137.610394:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1353 00000100:00100000:2.0:1788201137.610398:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715182208:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788201137.610422:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715182208:12345-0@lo:38:kworker.0 Request processed in 22us (840us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788201137.610428:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1353 00000100:00100000:2.0:1788201137.610437:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:2.0:1788201137.610440:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715182848:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788201137.610464:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715182848:12345-0@lo:38:kworker.0 Request processed in 22us (787us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788201137.610470:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00100000:2.0:1788201137.610488:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715182592 00000100:00100000:2.0:1788201137.610491:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715182592 00000100:00100000:2.0:1788201137.610509:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2817 00000100:00100000:2.0:1788201137.610514:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715182592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201137.610542:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715182592:12345-0@lo:400:kworker.0 Request processed in 28us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201137.610548:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2817 00000100:00100000:2.0:1788201137.610580:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788201137.610588:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:2.0:1788201137.610596:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788201137.610601:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788201137.610603:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f869000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788201137.610611:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715181696:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788201137.610637:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201137.610641:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788201137.610645:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715181952:0@lo:38:kworker.0 00000100:00080000:2.0:1788201137.610657:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201137.610660:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788201137.610662:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715182208:0@lo:38:kworker.0 00000100:00080000:2.0:1788201137.610669:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201137.610672:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788201137.610674:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715182464:0@lo:38:kworker.0 00000100:00080000:2.0:1788201137.610683:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201137.610685:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788201137.610687:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715182848:0@lo:38:kworker.0 00000100:00100000:2.0:1788201137.610719:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715182592:0@lo:400:kworker.0 00000100:00100000:2.0:1788201137.610729:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715182336:0@lo:400:kworker.0 00000100:00100000:3.0:1788201137.611158:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715182976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201137.611195:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201137.611223:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715182976 00000100:00100000:3.0:1788201137.611227:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715182976 00000100:00100000:3.0:1788201137.611250:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3984 00000100:00100000:3.0:1788201137.611256:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715182976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788201137.611278:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:3.0:1788201137.611306:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715182976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201137.611312:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3984 00000100:00100000:3.0:1788201137.611338:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715182976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201137.611360:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715182080:0@lo:400:kworker.0 00000100:00100000:0.0:1788201137.612269:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715181824 00000100:00100000:0.0:1788201137.612276:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715181824 00000100:00100000:0.0:1788201137.612306:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788201137.612313:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+8:3655:x1875060715181824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201137.612371:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+8:3655:x1875060715181824:12345-0@lo:400:kworker.0 Request processed in 58us (3492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201137.612377:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000040:01000000:0.0:1788201137.612712:0:92555:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788201137.613085:0:92555:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1788201137.616277:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715181824:0@lo:400:kworker.0 00000040:00080000:0.0:1788201137.618957:0:92555:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201137.619464:0:92555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].28, 64 off9984 00000040:00080000:1.0:1788201137.628890:0:92555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].1, 64 off8256 00000040:00080000:2.0:1788201137.630640:0:92562:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:2.0:1788201137.630654:0:92562:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788201137.646953:0:92555:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201137.646966:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788201137.647010:0:92555:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788201137.647247:0:92555:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1bcb4 00000100:00080000:0.0:1788201137.647260:0:92555:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788201137.647266:0:92555:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dc1259e4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201137.647301:0:92555:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d5b480 x1875060715183104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201137.647330:0:92555:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788201137.647455:0:92555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201137.647459:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201137.647461:0:92555:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788201137.647464:0:92555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788201137.647467:0:92555:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1788201137.647469:0:92555:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788201137.647470:0:92555:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788201137.647491:0:92555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788201137.647493:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201137.647495:0:92555:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788201137.647497:0:92555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788201137.647501:0:92555:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788201137.647504:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201137.647506:0:92555:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788201137.647508:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788201137.647512:0:92555:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:0.0:1788201137.647536:0:92555:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788201137.647538:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201137.647556:0:92555:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8dc004fd0000) 00000020:00000080:0.0:1788201137.647571:0:92555:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1788201137.647575:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788201137.647647:0:92555:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788201137.647655:0:92555:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788201137.647662:0:92555:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1bcc2 00010000:00080000:0.0:1788201137.647699:0:92555:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc11d438800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:0.0:1788201137.647880:0:92555:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:0.0:1788201137.647962:0:92555:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788201137.647978:0:92555:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1788201137.648407:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715183104:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788201137.648475:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201137.649140:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715183104 00000100:00100000:2.0:1788201137.649150:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715183104 00000100:00100000:2.0:1788201137.649190:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5904 00000100:00100000:2.0:1788201137.649198:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3654:x1875060715183104:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1788201137.649227:0:26201:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3989 last 0 00000020:00000080:2.0:1788201137.649254:0:26201:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1bcc9 00002000:00100000:2.0:1788201137.649269:0:26201:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8dc005fab800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788201137.649273:0:26201:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788201137.649275:0:26201:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788201137.649335:0:26201:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788201137.649357:0:26201:0:(import.c:65:import_set_state_nolock()) ffff8dc005faf000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201137.649428:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715183104:12345-0@lo:8:llog_process_th.0 Request processed in 229us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201137.649435:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5904 00000100:00100000:1.0:1788201137.649659:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788201137.649669:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788201137.649676:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788201137.649682:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788201137.649684:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1259e4000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788201137.651488:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000040:00080000:2.0:1788201137.652194:0:92555:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201137.652405:0:92555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].28, 64 off9984 00000040:00080000:2.0:1788201137.652706:0:92555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x72:0x0].1, 64 off8256 00000004:00080000:1.0:1788201137.653039:0:3654:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788201137.653053:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715183104:0@lo:8:llog_process_th.0 00000004:00080000:2.0:1788201137.653175:0:92562:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788201137.653216:0:92562:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3989125199764ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788201137.653222:0:92562:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788201137.654662:0:92544:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:1.0:1788201137.655157:0:92564:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:1.0:1788201137.655163:0:92564:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1788201137.655668:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715183232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201137.655752:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201137.655861:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715183232 00000100:00100000:1.0:1788201137.655870:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715183232 00000100:00100000:1.0:1788201137.655942:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2278 00000100:00100000:1.0:1788201137.655953:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715183232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201137.655981:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788201137.656041:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715183232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201137.656047:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2278 00000100:00100000:0.0:1788201137.656206:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715183232:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788201137.656262:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1788201137.658993:0:92555:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201137.659007:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788201137.659075:0:92555:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788201137.659101:0:92555:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1bcd0 00000100:00080000:2.0:1788201137.659113:0:92555:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201137.659118:0:92555:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dc11d438800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201137.659154:0:92555:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc00a9b4000 x1875060715183360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201137.659209:0:92555:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788201137.659263:0:92555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201137.659266:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201137.659268:0:92555:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788201137.659271:0:92555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201137.659275:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201137.659277:0:92555:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788201137.659280:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788201137.659282:0:92555:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788201137.659284:0:92555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201137.659287:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201137.659288:0:92555:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788201137.659290:0:92555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201137.659292:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201137.659294:0:92555:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788201137.659298:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788201137.659330:0:92555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:92555:1875060715183488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201137.659419:0:92555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201137.659467:0:92555:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140c24b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201137.659492:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715183488 00000100:00100000:2.0:1788201137.659498:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715183488 00000100:00100000:2.0:1788201137.659537:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201137.659613:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+8:92555:x1875060715183488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201137.659741:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+8:92555:x1875060715183488:12345-0@lo:502:llog_process_th.0 Request processed in 130us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201137.659749:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201137.659796:0:92555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:92555:1875060715183488:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201137.659818:0:92555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201137.659826:0:92555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201137.659828:0:92555:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788201137.659832:0:92555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:3.0:1788201137.660173:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715183360:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788201137.660213:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788201137.660269:0:92543:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788201137.660289:0:92543:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788201137.660312:0:92543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc005da6c00/0x96d0c9b8c9a1bc1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bc21 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.660322:0:92543:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc005da6c00/0x96d0c9b8c9a1bc1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bc21 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201137.660330:0:92543:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc11d63c000 from 1 10000000:01000000:3.0:1788201137.660333:0:92543:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788201137.660362:0:92543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc600/0x96d0c9b8c9a1bcd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.660369:0:92543:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc600/0x96d0c9b8c9a1bcd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.660388:0:92543:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc600/0x96d0c9b8c9a1bcd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201137.660402:0:92543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715183616:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201137.660428:0:92543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201137.660453:0:92543:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc00747c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201137.660474:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715183616 00000100:00100000:3.0:1788201137.660478:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715183616 00000100:00100000:3.0:1788201137.660506:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788201137.660512:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+8:92543:x1875060715183616:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201137.660523:0:92549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201137.660535:0:92549:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fca00/0x96d0c9b8c9a1bcde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1bcd7 expref: -99 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.660569:0:92549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fca00/0x96d0c9b8c9a1bcde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bcd7 expref: 9 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.660591:0:92549:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fca00/0x96d0c9b8c9a1bcde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bcd7 expref: 9 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.660599:0:92549:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fca00, rc 0) 00000100:00100000:3.0:1788201137.660637:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+9:92543:x1875060715183616:12345-0@lo:101:mount.lustre.0 Request processed in 125us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201137.660643:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788201137.660680:0:92543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715183616:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201137.660693:0:92543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc600/0x96d0c9b8c9a1bcd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bcde expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.660702:0:92543:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc600/0x96d0c9b8c9a1bcd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1bcde expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201137.661265:0:92543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715183744:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788201137.661301:0:92543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201137.661313:0:92543:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc00747c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201137.661792:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715183360 00000100:00100000:2.0:1788201137.661800:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715183360 00000100:00100000:2.0:1788201137.661836:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5905 00000100:00100000:2.0:1788201137.661842:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3654:x1875060715183360:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1788201137.661869:0:23974:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3989 last 0 00000020:00000080:2.0:1788201137.661892:0:23974:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1bce5 00002000:00100000:2.0:1788201137.661907:0:23974:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8dc1201c8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788201137.661911:0:23974:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788201137.661914:0:23974:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788201137.661989:0:23974:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788201137.662044:0:23974:0:(import.c:65:import_set_state_nolock()) ffff8dc1201c9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201137.662093:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715183360:12345-0@lo:8:llog_process_th.0 Request processed in 249us (1879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201137.662099:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5905 00000100:00100000:2.0:1788201137.662118:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715183744 00000100:00100000:2.0:1788201137.662122:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715183744 00000100:00100000:2.0:1788201137.662142:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788201137.662148:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+9:92543:x1875060715183744:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788201137.662161:0:92554:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788201137.662183:0:92554:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788201137.662186:0:92554:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788201137.662190:0:92554:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788201137.662192:0:92554:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 122 00000100:00100000:2.0:1788201137.662258:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+9:92543:x1875060715183744:12345-0@lo:256:mount.lustre.0 Request processed in 110us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201137.662271:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788201137.662499:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201137.662508:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788201137.662515:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788201137.662521:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788201137.662523:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11d438800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788201137.662675:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715183872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201137.662712:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201137.662740:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715183872 00000100:00100000:0.0:1788201137.662743:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715183872 00000100:00100000:0.0:1788201137.662775:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2279 00000100:00100000:0.0:1788201137.662787:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715183872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201137.662801:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201137.662828:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715183872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201137.662834:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2279 00000100:00100000:0.0:1788201137.662864:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715183872:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1788201137.663013:0:3654:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788201137.663042:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715183360:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788201137.663060:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201137.663082:0:92543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715183744:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788201137.665144:0:92543:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788201137.665187:0:92543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc600/0x96d0c9b8c9a1bcd7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bcde expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.665199:0:92543:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc600/0x96d0c9b8c9a1bcd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bcde expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201137.665209:0:92543:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc11d63c000 from 1 10000000:01000000:3.0:1788201137.665212:0:92543:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201137.665251:0:92543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd600/0x96d0c9b8c9a1bcec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.665259:0:92543:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd600/0x96d0c9b8c9a1bcec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.665270:0:92543:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd600/0x96d0c9b8c9a1bcec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201137.665293:0:92543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715184000:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201137.665357:0:92543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788201137.665519:0:92564:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788201137.665616:0:92564:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3989137598865ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788201137.665652:0:92564:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788201137.665864:0:92543:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc00747c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201137.665887:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715184000 00000100:00100000:3.0:1788201137.665896:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715184000 00000100:00100000:3.0:1788201137.666037:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788201137.666047:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+9:92543:x1875060715184000:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201137.666059:0:92549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201137.666072:0:92549:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fc200/0x96d0c9b8c9a1bcf3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1bcec expref: -99 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.666115:0:92549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fc200/0x96d0c9b8c9a1bcf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bcec expref: 10 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.666126:0:92549:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fc200/0x96d0c9b8c9a1bcf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bcec expref: 10 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.666135:0:92549:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fc200, rc 0) 00000100:00100000:3.0:1788201137.666223:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+10:92543:x1875060715184000:12345-0@lo:101:mount.lustre.0 Request processed in 177us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201137.666229:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1788201137.667921:0:92544:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788201137.668128:0:92543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715184000:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201137.668152:0:92543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd600/0x96d0c9b8c9a1bcec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bcf3 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.668164:0:92543:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd600/0x96d0c9b8c9a1bcec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1bcf3 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201137.668241:0:92543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715184128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201137.668290:0:92543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201137.668356:0:92543:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fb11000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201137.668439:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715184128 00000100:00100000:2.0:1788201137.668495:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715184128 00000100:00100000:2.0:1788201137.668636:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788201137.668646:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+10:92543:x1875060715184128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201137.668784:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+10:92543:x1875060715184128:12345-0@lo:501:mount.lustre.0 Request processed in 139us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201137.668790:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201137.668851:0:92543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715184128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201137.668876:0:92543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715184256:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201137.668913:0:92543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201137.669165:0:92543:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fb11000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201137.669223:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715184256 00000100:00100000:3.0:1788201137.669227:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715184256 00000100:00100000:3.0:1788201137.669261:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788201137.669268:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:92543:x1875060715184256:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201137.669349:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:92543:x1875060715184256:12345-0@lo:503:mount.lustre.0 Request processed in 81us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201137.669356:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788201137.669406:0:92543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715184256:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201137.670174:0:92566:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:92566:1875060715184384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201137.670230:0:92566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201137.670302:0:92566:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fb11300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201137.670341:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715184384 00000100:00100000:3.0:1788201137.670346:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715184384 00000100:00100000:3.0:1788201137.670479:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788201137.670488:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:92566:x1875060715184384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201137.671100:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:92566:x1875060715184384:12345-0@lo:502:llog_process_th.0 Request processed in 612us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201137.671108:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788201137.671219:0:92566:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:92566:1875060715184384:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201137.671246:0:92566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201137.671254:0:92566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201137.671256:0:92566:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788201137.671264:0:92566:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc11d63c000 00000020:00000080:1.0:1788201137.671267:0:92566:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788201137.671275:0:92566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201137.671277:0:92566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201137.671278:0:92566:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788201137.671280:0:92566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201137.671282:0:92566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201137.671283:0:92566:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788201137.671286:0:92566:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc11d63c000 00000020:00000080:1.0:1788201137.671287:0:92566:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788201137.671353:0:92566:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:92566:1875060715184512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201137.671398:0:92566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201137.671722:0:92566:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0010eba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201137.671804:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715184512 00000100:00100000:0.0:1788201137.671810:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715184512 00000100:00100000:0.0:1788201137.671855:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788201137.671863:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:92566:x1875060715184512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201137.671963:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:92566:x1875060715184512:12345-0@lo:502:llog_process_th.0 Request processed in 101us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201137.671969:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788201137.674531:0:92566:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:92566:1875060715184512:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201137.674702:0:92566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201137.674711:0:92566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201137.674713:0:92566:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788201137.674718:0:92566:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788201137.675001:0:92543:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1788201137.675041:0:92543:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201137.675055:0:92543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd600/0x96d0c9b8c9a1bcec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bcf3 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.675067:0:92543:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd600/0x96d0c9b8c9a1bcec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bcf3 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201137.675123:0:92543:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788201137.675126:0:92543:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dc11d63c000 10000000:01000000:3.0:1788201137.675129:0:92543:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dc11d63c000 10000000:01000000:3.0:1788201137.675133:0:92543:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201137.675138:0:92543:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc11d63c000 from 1 10000000:01000000:3.0:1788201137.675140:0:92543:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201137.675169:0:92543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fde00/0x96d0c9b8c9a1bcfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.675177:0:92543:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0078fde00/0x96d0c9b8c9a1bcfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.675187:0:92543:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0078fde00/0x96d0c9b8c9a1bcfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201137.675205:0:92543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715184640:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201137.675256:0:92543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201137.675288:0:92543:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1060ca000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201137.675304:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715184640 00000100:00100000:3.0:1788201137.675309:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715184640 00000100:00100000:3.0:1788201137.675340:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788201137.675347:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:92543:x1875060715184640:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201137.675367:0:92550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201137.675750:0:92550:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1bd01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1bcfa expref: -99 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.675776:0:92550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1bd01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bcfa expref: 11 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.675785:0:92550:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1bd01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bcfa expref: 11 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.675794:0:92550:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fda00, rc 0) 00000100:00100000:3.0:1788201137.675839:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:92543:x1875060715184640:12345-0@lo:101:mount.lustre.0 Request processed in 491us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201137.675845:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788201137.676205:0:92543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715184640:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201137.676219:0:92543:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0078fde00/0x96d0c9b8c9a1bcfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd01 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201137.676229:0:92543:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fde00/0x96d0c9b8c9a1bcfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1bd01 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201137.676279:0:92543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715184768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201137.676308:0:92543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201137.678600:0:92543:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ce6780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201137.681236:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715184768 00000100:00100000:1.0:1788201137.681250:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715184768 00000100:00100000:2.0:1788201137.681826:0:66322:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0050406c0 going to sleep for 0 seconds 00000100:00100000:0.0:1788201137.689112:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788201137.689127:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:92543:x1875060715184768:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201137.689299:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:92543:x1875060715184768:12345-0@lo:501:mount.lustre.0 Request processed in 175us (12989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201137.689306:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788201137.689364:0:92543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715184768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201137.689539:0:92543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715184896:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201137.689664:0:92543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201137.695290:0:92543:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ce6780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201137.695457:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715184896 00000100:00100000:1.0:1788201137.695467:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715184896 00000100:00100000:1.0:1788201137.695526:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788201137.695536:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:92543:x1875060715184896:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201137.695700:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:92543:x1875060715184896:12345-0@lo:503:mount.lustre.0 Request processed in 165us (6036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201137.695707:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788201137.695978:0:92543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715184896:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201137.696747:0:92569:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:92569:1875060715185024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201137.696803:0:92569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201137.696869:0:92569:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ce6780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201137.696906:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715185024 00000100:00100000:1.0:1788201137.696911:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715185024 00000100:00100000:1.0:1788201137.696976:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788201137.696984:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:92569:x1875060715185024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201137.697114:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:92569:x1875060715185024:12345-0@lo:502:llog_process_th.0 Request processed in 131us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201137.697123:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788201137.697200:0:92569:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:92569:1875060715185024:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788201137.697252:0:92569:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788201137.697266:0:92569:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8dc0040419b8) 00000020:00000080:0.0:1788201137.697292:0:92569:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788201137.697370:0:92569:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc11d63c000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788201137.697374:0:92569:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc11d63c000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788201137.697376:0:92569:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc11d63c000 4 00010000:00080000:0.0:1788201137.697749:0:92569:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc001db1800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:0.0:1788201137.699808:0:92569:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1788201137.700056:0:92569:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788201137.700103:0:92569:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788201137.700118:0:92569:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x96d0c9b8c9a1bd0f 00000100:00080000:0.0:1788201137.700129:0:92569:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788201137.700135:0:92569:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dc001db1800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201137.700170:0:92569:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d58e00 x1875060715185152/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201137.700192:0:92569:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788201137.700338:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715185152:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201137.700418:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201137.702685:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715185152 00000100:00100000:0.0:1788201137.702696:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715185152 00000100:00100000:0.0:1788201137.702737:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:0.0:1788201137.702745:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715185152:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788201137.702831:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715185152:12345-0@lo:38:llog_process_th.0 Request processed in 85us (2412us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788201137.702838:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:0.0:1788201137.702957:0:92569:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:92569:1875060715185280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201137.703003:0:92569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201137.703060:0:92569:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10bf780c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201137.703345:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201137.703355:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201137.703359:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788201137.703363:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715185152:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788201137.704647:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715185280 00000100:00100000:1.0:1788201137.704656:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715185280 00000100:00100000:1.0:1788201137.704706:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788201137.704715:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:92569:x1875060715185280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201137.704870:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:92569:x1875060715185280:12345-0@lo:502:llog_process_th.0 Request processed in 156us (1867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201137.704883:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788201137.705352:0:92569:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:92569:1875060715185280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201137.705422:0:92569:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:92569:1875060715185408:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201137.705909:0:92569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201137.709174:0:92569:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ce6000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201137.711152:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715185408 00000100:00100000:2.0:1788201137.711165:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715185408 00000100:00100000:2.0:1788201137.711273:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788201137.711285:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+11:92569:x1875060715185408:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201137.711725:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+11:92569:x1875060715185408:12345-0@lo:502:llog_process_th.0 Request processed in 442us (5815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201137.711733:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788201137.711834:0:92569:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:92569:1875060715185408:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788201137.711872:0:92569:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788201137.712149:0:92543:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788201137.712176:0:92543:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201137.712202:0:92543:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fde00/0x96d0c9b8c9a1bcfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd01 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.712214:0:92543:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0078fde00/0x96d0c9b8c9a1bcfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd01 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788201137.712287:0:92543:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788201137.712289:0:92543:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201137.712291:0:92543:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201137.712292:0:92543:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201137.712293:0:92543:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201137.712295:0:92543:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201137.712296:0:92543:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201137.712298:0:92543:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201137.712300:0:92543:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201137.712302:0:92543:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788201137.712306:0:92543:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788201137.712308:0:92543:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788201137.712310:0:92543:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201137.712311:0:92543:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201137.712312:0:92543:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201137.712313:0:92543:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201137.712314:0:92543:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201137.712315:0:92543:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201137.712316:0:92543:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201137.712317:0:92543:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201137.712318:0:92543:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788201137.712341:0:92543:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788201137.712360:0:92543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715185536:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788201137.712416:0:92543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201137.712650:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715185536 00000100:00100000:0.0:1788201137.712656:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715185536 00000100:00100000:0.0:1788201137.712692:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788201137.712700:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:92543:x1875060715185536:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788201137.712724:0:92549:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788201137.712738:0:92549:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788201137.712879:0:92543:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f2e7c00 going to sleep for 11 seconds 20000000:01000000:0.0:1788201137.716479:0:92549:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788201137.716498:0:92549:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788201137.716586:0:92552:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788201137.716591:0:92552:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788201137.716613:0:92552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1bd16 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.716641:0:92552:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc0078fca00/0x96d0c9b8c9a1bcde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bcd7 expref: 11 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.716650:0:92552:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1bd16 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.716703:0:92552:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc0078fca00/0x96d0c9b8c9a1bcde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1bcd7 expref: 11 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.716717:0:92552:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc0078fca00/0x96d0c9b8c9a1bcde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bcd7 expref: 11 pid: 92549 timeout: 4089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201137.716732:0:92552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bfb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92552:1875060715185664:0@lo:104: 00000100:00100000:3.0:1788201137.716793:0:92552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201137.716837:0:92552:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f2e7780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201137.716896:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715185664 00000100:00100000:1.0:1788201137.716904:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715185664 00000100:00100000:1.0:1788201137.716948:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788201137.716958:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+3:92552:x1875060715185664:12345-0@lo:104: 00010000:00010000:1.0:1788201137.716970:0:19665:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc600/0x96d0c9b8c9a1bcd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1bcde expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201137.717058:0:19665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201137.717064:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+3:92552:x1875060715185664:12345-0@lo:104: Request processed in 108us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201137.717071:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00010000:00010000:2.0:1788201137.717178:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201137.717185:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc600/0x96d0c9b8c9a1bcd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1bcde expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.717193:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fc600 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788201137.717197:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc600/0x96d0c9b8c9a1bcd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1bcde expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.717216:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc600/0x96d0c9b8c9a1bcd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1bcde expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201137.717224:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc600/0x96d0c9b8c9a1bcd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1bcde expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201137.717230:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201137.717255:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc600/0x96d0c9b8c9a1bcd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bcde expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.717261:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201137.717284:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc600/0x96d0c9b8c9a1bcd7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bcde expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.717291:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc600/0x96d0c9b8c9a1bcd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bcde expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.717305:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201137.717307:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201137.717309:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201137.717378:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715185792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201137.717405:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201137.717499:0:92552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bfb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92552:1875060715185664:0@lo:104: 00010000:00010000:0.0:1788201137.717518:0:92552:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1bd16 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201137.717645:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715185792 00000100:00100000:2.0:1788201137.717650:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715185792 00010000:00010000:2.0:1788201137.717670:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc0078fca00/0x96d0c9b8c9a1bcde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bcd7 expref: 12 pid: 92549 timeout: 4089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201137.717697:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2559 00000100:00100000:2.0:1788201137.717704:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9b18af6-fecc-4172-82c2-66531890fe11+12:3655:x1875060715185792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201137.717714:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201137.717719:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc0078fca00/0x96d0c9b8c9a1bcde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bcd7 expref: 12 pid: 92549 timeout: 4089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.717735:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc0078fca00/0x96d0c9b8c9a1bcde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bcd7 expref: 12 pid: 92549 timeout: 4089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.717857:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fca00/0x96d0c9b8c9a1bcde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bcd7 expref: 12 pid: 92549 timeout: 4089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.717870:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1bd16 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.717878:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1bd16 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788201137.717892:0:6517:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001301809s 00010000:00010000:2.0:1788201137.717897:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1bd16 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.717904:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1bd16 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.717911:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1bd16 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.717917:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1bd16 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.717923:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fc800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201137.717926:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1bd16 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.717933:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1bd16 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201137.718337:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:92543:x1875060715185536:12345-0@lo:253:mount.lustre.0 Request processed in 5637us (5920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201137.718347:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201137.718495:0:92543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:92543:1875060715185536:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788201137.718507:0:92543:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788201137.718511:0:92543:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788201137.718513:0:92543:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788201137.718515:0:92543:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201137.718516:0:92543:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201137.718518:0:92543:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201137.718519:0:92543:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201137.718521:0:92543:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201137.718522:0:92543:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788201137.718524:0:92543:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201137.718525:0:92543:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788201137.718538:0:92543:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788201137.719980:0:92552:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1bd16 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201137.719992:0:92552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1bd16 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.721644:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1bd16 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.721660:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1bd16 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201137.721680:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201137.721901:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9b18af6-fecc-4172-82c2-66531890fe11+10:3655:x1875060715185792:12345-0@lo:103:ldlm_bl.0 Request processed in 4193us (4490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201137.721912:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2559 00000100:00100000:3.0:1788201137.721994:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715185792:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788201137.725799:0:92543:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411350 00000040:01000000:1.0:1788201137.726215:0:92543:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788201137.726280:0:92574:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411350 00000020:00080000:2.0:1788201137.726285:0:92574:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411350 00000040:01000000:2.0:1788201137.726764:0:92575:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788201137.726901:0:92543:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1788201137.727239:0:92575:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201137.728881:0:92576:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92576:1875060715185920:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788201137.728969:0:92576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201137.729008:0:92576:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102a8a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788201137.729493:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715185920 00000100:00100000:3.0:1788201137.729501:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715185920 00000100:00100000:3.0:1788201137.729717:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3985 00000100:00100000:3.0:1788201137.729728:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92576:x1875060715185920:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788201137.729816:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92576:x1875060715185920:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 91us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201137.729823:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3985 00000100:00100000:1.0:1788201137.730247:0:92576:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92576:1875060715185920:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788201137.730292:0:92576:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788201137.730322:0:92576:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92576:1875060715186048:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788201137.730355:0:92576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201137.730395:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715186048 00000100:00100000:1.0:1788201137.730399:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715186048 00000100:00100000:1.0:1788201137.730421:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3986 00000100:00100000:1.0:1788201137.730427:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92576:x1875060715186048:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788201137.730522:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92576:x1875060715186048:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 94us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201137.730528:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3986 00000100:00100000:1.0:1788201137.730625:0:92576:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102a8a240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201137.730639:0:92576:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92576:1875060715186048:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788201137.730686:0:92576:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92576:1875060715186176:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788201137.730705:0:92576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201137.730725:0:92576:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102a8a240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201137.732036:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715186176 00000100:00100000:3.0:1788201137.732062:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715186176 00000100:00100000:3.0:1788201137.732101:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3987 00000100:00100000:3.0:1788201137.732108:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92576:x1875060715186176:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788201137.732192:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92576:x1875060715186176:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 83us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201137.732198:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3987 00000100:00100000:1.0:1788201137.732589:0:92576:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92576:1875060715186176:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788201137.732654:0:92576:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788201137.735776:0:92543:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788201137.735853:0:92543:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788201137.736321:0:92543:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788201137.736329:0:92543:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788201137.736362:0:92543:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201137.740921:0:92575:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788201137.741012:0:92575:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1788201137.741653:0:92576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788201137.741706:0:92576:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788201137.741710:0:92576:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1788201137.741931:0:92543:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788201137.742860:0:92543:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788201137.742897:0:92543:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788201137.743011:0:92543:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788201137.743881:0:92543:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4f:0x0] (8/32) registered 00010000:00080000:3.0:1788201137.746522:0:92543:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 115964116996 00010000:00080000:3.0:1788201137.747365:0:92577:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 92577 00010000:02000000:3.0:1788201137.747375:0:92577:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:01000004:1.0:1788201137.747504:0:92543:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788201137.747519:0:92543:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788201137.747535:0:92543:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788201137.747560:0:92543:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788201137.750339:0:92543:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788201137.753078:0:92543:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:0.0:1788201137.766570:0:92577:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1788201137.766577:0:92577:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:1.0:1788201137.946465:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201137.999117:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040f00 going to sleep for 0 seconds 10000000:01000000:1.0:1788201138.515066:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788201138.515073:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc11d63c000 from 123 10000000:01000000:1.0:1788201138.515077:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788201138.515128:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed800/0x96d0c9b8c9a1bd1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.515141:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed800/0x96d0c9b8c9a1bd1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.515153:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed800/0x96d0c9b8c9a1bd1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201138.515178:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715186304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201138.515245:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201138.515288:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102a8a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201138.515348:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715186304 00000100:00100000:2.0:1788201138.515356:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715186304 00000100:00100000:2.0:1788201138.515410:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788201138.515420:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:6529:x1875060715186304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201138.515443:0:92550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201138.515457:0:92550:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc005da7e00/0x96d0c9b8c9a1bd24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1bd1d expref: -99 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.515479:0:92550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc005da7e00/0x96d0c9b8c9a1bd24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd1d expref: 11 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.515490:0:92550:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc005da7e00/0x96d0c9b8c9a1bd24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd1d expref: 11 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.515505:0:92550:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc005da7e00, rc 0) 00000100:00100000:2.0:1788201138.515555:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715186304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201138.515562:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788201138.516042:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715186304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201138.516058:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed800/0x96d0c9b8c9a1bd1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd24 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.516068:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed800/0x96d0c9b8c9a1bd1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1bd24 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201138.516122:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715186432:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788201138.516158:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201138.516178:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102a8a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201138.516237:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715186432 00000100:00100000:2.0:1788201138.516242:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715186432 00000100:00100000:2.0:1788201138.516277:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788201138.516284:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715186432:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201138.516299:0:92554:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788201138.516316:0:92554:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201138.516320:0:92554:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 123 00000100:00100000:2.0:1788201138.516393:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715186432:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201138.516400:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788201138.516523:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715186432:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788201138.516583:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788201138.516594:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed800/0x96d0c9b8c9a1bd1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd24 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.516612:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed800/0x96d0c9b8c9a1bd1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd24 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201138.516622:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788201138.516624:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc0053a4000 from 52 10000000:01000000:1.0:1788201138.516627:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788201138.516646:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1bd2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.516653:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1bd2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.516661:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1bd2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201138.516674:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715186560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201138.516700:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201138.516720:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102a8a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201138.516732:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715186560 00000100:00100000:1.0:1788201138.516735:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715186560 00000100:00100000:1.0:1788201138.516757:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788201138.516763:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715186560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201138.516770:0:92550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201138.516781:0:92550:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1bd32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1bd2b expref: -99 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.516797:0:92550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1bd32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd2b expref: 12 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.516813:0:92550:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1bd32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd2b expref: 12 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.516821:0:92550:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ed600, rc 0) 00000100:00100000:1.0:1788201138.516849:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715186560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201138.516856:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788201138.516888:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715186560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201138.516900:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1bd2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd32 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.516907:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1bd2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1bd32 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201138.516974:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715186688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201138.516999:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201138.517011:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102a8a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201138.517522:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715186688 00000100:00100000:2.0:1788201138.517537:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715186688 00000100:00100000:2.0:1788201138.517570:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788201138.517578:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715186688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201138.517700:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715186688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201138.517707:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788201138.517833:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715186688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201138.517865:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715186816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201138.517907:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201138.517946:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102a8a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201138.518083:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715186816 00000100:00100000:2.0:1788201138.518087:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715186816 00000100:00100000:2.0:1788201138.518116:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788201138.518123:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715186816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201138.518192:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715186816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201138.518204:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788201138.518276:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715186816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201138.520841:0:92606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1788201138.526615:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1788201138.526657:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201138.526676:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1bd2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd32 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.526688:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1bd2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd32 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201138.526698:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788201138.526700:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc0053a4000 from 120 10000000:01000000:1.0:1788201138.526703:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788201138.526740:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ece00/0x96d0c9b8c9a1bd39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.526748:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ece00/0x96d0c9b8c9a1bd39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.526759:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ece00/0x96d0c9b8c9a1bd39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201138.526784:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715186944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201138.526849:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201138.526946:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102a8a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201138.531341:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715186944 00000100:00100000:2.0:1788201138.531356:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715186944 00000100:00100000:2.0:1788201138.531424:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788201138.531445:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715186944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201138.531464:0:92554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201138.531485:0:92554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc005da6000/0x96d0c9b8c9a1bd40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1bd39 expref: -99 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.531516:0:92554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc005da6000/0x96d0c9b8c9a1bd40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd39 expref: 13 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.531528:0:92554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc005da6000/0x96d0c9b8c9a1bd40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd39 expref: 13 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.531687:0:92554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc005da6000, rc 0) 00000100:00100000:2.0:1788201138.531778:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715186944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 335us (4927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201138.531785:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788201138.531873:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715186944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201138.531893:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ece00/0x96d0c9b8c9a1bd39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd40 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.531903:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ece00/0x96d0c9b8c9a1bd39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1bd40 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201138.531979:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715187072:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788201138.532056:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201138.532088:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102a8a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201138.532197:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715187072 00000100:00100000:2.0:1788201138.532202:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715187072 00000100:00100000:2.0:1788201138.532237:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788201138.532245:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715187072:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201138.532261:0:92550:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788201138.532278:0:92550:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201138.532281:0:92550:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1788201138.532284:0:92550:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1788201138.532286:0:92550:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1788201138.532292:0:92550:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 123 00000100:00100000:2.0:1788201138.532361:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715187072:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201138.532368:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788201138.532444:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715187072:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788201138.532514:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788201138.532521:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ece00/0x96d0c9b8c9a1bd39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd40 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.532658:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ece00/0x96d0c9b8c9a1bd39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd40 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201138.532667:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788201138.532670:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1788201138.532672:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788201138.532695:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064eda00/0x96d0c9b8c9a1bd47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.532702:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064eda00/0x96d0c9b8c9a1bd47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.532710:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064eda00/0x96d0c9b8c9a1bd47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201138.532723:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715187200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201138.532748:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201138.532774:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102a8a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201138.532819:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715187200 00000100:00100000:2.0:1788201138.532823:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715187200 00000100:00100000:2.0:1788201138.532854:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788201138.532865:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715187200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201138.532874:0:92549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201138.532885:0:92549:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc005da6a00/0x96d0c9b8c9a1bd4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1bd47 expref: -99 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.532901:0:92549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc005da6a00/0x96d0c9b8c9a1bd4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd47 expref: 14 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.532921:0:92549:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc005da6a00/0x96d0c9b8c9a1bd4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd47 expref: 14 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.532929:0:92549:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc005da6a00, rc 0) 00000100:00100000:2.0:1788201138.532958:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715187200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201138.532962:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788201138.533137:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715187200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201138.533149:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064eda00/0x96d0c9b8c9a1bd47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd4e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.533167:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064eda00/0x96d0c9b8c9a1bd47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1bd4e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201138.533220:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715187328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201138.533245:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201138.533266:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102a8a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201138.533305:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715187328 00000100:00100000:2.0:1788201138.533309:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715187328 00000100:00100000:2.0:1788201138.533337:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788201138.533343:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715187328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201138.535142:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715187328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1793us (1891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201138.535165:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788201138.535740:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715187328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201138.535792:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715187456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201138.535841:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201138.535876:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102a8a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201138.537087:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715187456 00000100:00100000:2.0:1788201138.537097:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715187456 00000100:00100000:2.0:1788201138.537137:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788201138.537145:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715187456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201138.538597:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715187456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1215us (2519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201138.538620:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788201138.538710:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715187456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201138.540516:0:92608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1788201138.540818:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1788201138.540844:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788201138.540855:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064eda00/0x96d0c9b8c9a1bd47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd4e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.540866:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064eda00/0x96d0c9b8c9a1bd47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd4e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201138.540875:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1788201138.540878:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dc0053a4000 from 1 10000000:01000000:1.0:1788201138.540880:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788201138.540991:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1bd55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.540999:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1bd55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.541333:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1bd55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201138.541357:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715187584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201138.541423:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201138.541660:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102a8a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201138.541739:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715187584 00000100:00100000:2.0:1788201138.541747:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715187584 00000100:00100000:2.0:1788201138.541825:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788201138.541836:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715187584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201138.541849:0:92551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201138.541863:0:92551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc005da7200/0x96d0c9b8c9a1bd5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1bd55 expref: -99 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.541885:0:92551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc005da7200/0x96d0c9b8c9a1bd5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd55 expref: 15 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.541895:0:92551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc005da7200/0x96d0c9b8c9a1bd5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd55 expref: 15 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.541903:0:92551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc005da7200, rc 0) 00000100:00100000:2.0:1788201138.541960:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715187584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201138.541967:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788201138.542056:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715187584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201138.542070:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1bd55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd5c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201138.542078:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1bd55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1bd5c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201138.542095:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788201138.542100:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1bd55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd5c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201138.542116:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1bd55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd5c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201138.542123:0:6529:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788201138.542125:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc0053a4000 from 7 10000000:01000000:3.0:1788201138.542127:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201138.542146:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1bd63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201138.542152:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1bd63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201138.542159:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1bd63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201138.542171:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715187712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201138.542198:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201138.542464:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004f93840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201138.542681:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715187712 00000100:00100000:1.0:1788201138.542687:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715187712 00000100:00100000:1.0:1788201138.542725:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788201138.542732:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715187712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201138.542741:0:92550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201138.542750:0:92550:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064ed200/0x96d0c9b8c9a1bd6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1bd63 expref: -99 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.542768:0:92550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ed200/0x96d0c9b8c9a1bd6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd63 expref: 16 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.542777:0:92550:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064ed200/0x96d0c9b8c9a1bd6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd63 expref: 16 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.542784:0:92550:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ed200, rc 0) 00000100:00100000:1.0:1788201138.542822:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715187712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201138.542828:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788201138.542898:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715187712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201138.542919:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1bd63 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd6a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201138.542927:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1bd63 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1bd6a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201138.542981:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715187840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201138.543006:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201138.543049:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc00747c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201138.543146:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715187840 00000100:00100000:1.0:1788201138.543150:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715187840 00000100:00100000:1.0:1788201138.543177:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788201138.543183:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715187840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201138.543289:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715187840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201138.543296:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788201138.543321:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715187840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201138.543347:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715187968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201138.543391:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201138.543404:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102a8af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201138.543413:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715187968 00000100:00100000:1.0:1788201138.543416:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715187968 00000100:00100000:1.0:1788201138.543430:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788201138.543434:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715187968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201138.543517:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715187968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201138.543524:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788201138.543744:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715187968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201138.544790:0:92609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788201138.545096:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788201138.545122:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201138.545131:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1bd63 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd6a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201138.545142:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1bd63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd6a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201138.545152:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788201138.545154:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc001db6000 from 52 10000000:01000000:3.0:1788201138.545157:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201138.545194:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1bd71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201138.545202:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1bd71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201138.545211:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1bd71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201138.545227:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715188096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201138.545266:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201138.545299:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004f939c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201138.545336:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715188096 00000100:00100000:1.0:1788201138.545341:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715188096 00000100:00100000:1.0:1788201138.545501:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788201138.545510:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715188096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201138.545519:0:92550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201138.545531:0:92550:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064ed400/0x96d0c9b8c9a1bd78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1bd71 expref: -99 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.545550:0:92550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ed400/0x96d0c9b8c9a1bd78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd71 expref: 17 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.545576:0:92550:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064ed400/0x96d0c9b8c9a1bd78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd71 expref: 17 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.545585:0:92550:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ed400, rc 0) 00000100:00100000:1.0:1788201138.545633:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715188096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201138.545639:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788201138.545754:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715188096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201138.545768:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1bd71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd78 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201138.545776:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1bd71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1bd78 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201138.545824:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715188224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201138.545850:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201138.546847:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc00747c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201138.546894:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715188224 00000100:00100000:3.0:1788201138.546900:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715188224 00000100:00100000:3.0:1788201138.547002:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788201138.547009:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715188224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201138.547149:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715188224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201138.547156:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788201138.547345:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715188224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201138.547508:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715188352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201138.547634:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201138.547688:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc00747c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201138.547738:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715188352 00000100:00100000:3.0:1788201138.547742:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715188352 00000100:00100000:3.0:1788201138.547792:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788201138.547799:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715188352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201138.547904:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715188352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201138.547976:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788201138.548167:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715188352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201138.549691:0:92610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788201138.549833:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788201138.549865:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788201138.549875:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1bd71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd78 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.549886:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1bd71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd78 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201138.549896:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788201138.549898:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1788201138.549901:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788201138.549997:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc005da7000/0x96d0c9b8c9a1bd7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.550006:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc005da7000/0x96d0c9b8c9a1bd7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.550044:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc005da7000/0x96d0c9b8c9a1bd7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201138.550065:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715188480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201138.550112:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201138.550147:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201138.550251:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715188480 00000100:00100000:3.0:1788201138.550257:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715188480 00000100:00100000:3.0:1788201138.550304:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788201138.550312:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715188480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201138.550324:0:92551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201138.550335:0:92551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fd400/0x96d0c9b8c9a1bd86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1bd7f expref: -99 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201138.550357:0:92551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fd400/0x96d0c9b8c9a1bd86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd7f expref: 18 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201138.550505:0:92551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fd400/0x96d0c9b8c9a1bd86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd7f expref: 18 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201138.550515:0:92551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fd400, rc 0) 00000100:00100000:3.0:1788201138.550623:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715188480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 311us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201138.550629:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788201138.550716:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715188480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201138.550730:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc005da7000/0x96d0c9b8c9a1bd7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd86 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.550738:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc005da7000/0x96d0c9b8c9a1bd7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1bd86 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201138.550791:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715188608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201138.550825:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201138.550852:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201138.550894:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715188608 00000100:00100000:0.0:1788201138.550899:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715188608 00000100:00100000:0.0:1788201138.551000:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788201138.551010:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715188608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201138.551163:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715188608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201138.551170:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788201138.551276:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715188608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201138.551303:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715188736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201138.551354:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201138.551505:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201138.551783:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715188736 00000100:00100000:0.0:1788201138.551788:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715188736 00000100:00100000:0.0:1788201138.551860:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788201138.551869:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715188736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201138.552803:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715188736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 931us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201138.552813:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788201138.552886:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715188736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201138.554054:0:92611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1788201138.554116:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1788201138.554133:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788201138.554142:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc005da7000/0x96d0c9b8c9a1bd7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd86 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.554153:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc005da7000/0x96d0c9b8c9a1bd7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd86 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201138.554162:0:6529:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788201138.554164:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc001db6000 from 7 10000000:01000000:2.0:1788201138.554166:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201138.554193:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc005da7600/0x96d0c9b8c9a1bd8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.554201:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc005da7600/0x96d0c9b8c9a1bd8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.554211:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc005da7600/0x96d0c9b8c9a1bd8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201138.554242:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715188864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201138.554283:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201138.554825:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201138.554973:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715188864 00000100:00100000:3.0:1788201138.554980:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715188864 00000100:00100000:2.0:1788201138.555130:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788201138.555138:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715188864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201138.555150:0:92551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201138.555162:0:92551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc005da6200/0x96d0c9b8c9a1bd94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1bd8d expref: -99 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.555182:0:92551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc005da6200/0x96d0c9b8c9a1bd94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd8d expref: 19 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.555191:0:92551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc005da6200/0x96d0c9b8c9a1bd94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd8d expref: 19 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.555199:0:92551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc005da6200, rc 0) 00000100:00100000:2.0:1788201138.555234:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715188864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201138.555240:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788201138.555278:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715188864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201138.555292:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc005da7600/0x96d0c9b8c9a1bd8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd94 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.555301:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc005da7600/0x96d0c9b8c9a1bd8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1bd94 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201138.555377:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715188992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201138.555406:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201138.555426:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73300 going to sleep for 11 seconds 00000100:00100000:2.0:1788201138.555617:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715188992 00000100:00100000:2.0:1788201138.555621:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715188992 00000100:00100000:2.0:1788201138.555639:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788201138.555645:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715188992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201138.555738:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715188992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201138.555744:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788201138.555769:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715188992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201138.555790:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715189120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201138.555822:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201138.555833:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73300 going to sleep for 11 seconds 00000100:00100000:2.0:1788201138.555842:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715189120 00000100:00100000:2.0:1788201138.555844:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715189120 00000100:00100000:2.0:1788201138.555858:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788201138.555863:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715189120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201138.555999:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715189120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201138.556006:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788201138.556065:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715189120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201138.556880:0:92612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788201138.557669:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788201138.557688:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201138.557698:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc005da7600/0x96d0c9b8c9a1bd8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd94 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201138.557709:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc005da7600/0x96d0c9b8c9a1bd8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd94 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201138.557719:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788201138.557721:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc13aa9f000 from 52 10000000:01000000:3.0:1788201138.557724:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201138.557756:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1bd9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201138.557770:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1bd9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201138.557780:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1bd9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201138.557800:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715189248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201138.557844:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201138.557905:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1218a23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201138.557996:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715189248 00000100:00100000:2.0:1788201138.558002:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715189248 00000100:00100000:2.0:1788201138.558190:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788201138.558199:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715189248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201138.558210:0:92551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201138.558221:0:92551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc005da7400/0x96d0c9b8c9a1bda2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1bd9b expref: -99 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.558241:0:92551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc005da7400/0x96d0c9b8c9a1bda2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd9b expref: 20 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.558250:0:92551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc005da7400/0x96d0c9b8c9a1bda2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd9b expref: 20 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.558258:0:92551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc005da7400, rc 0) 00000100:00100000:2.0:1788201138.558300:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715189248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201138.558306:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788201138.558372:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715189248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201138.558386:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1bd9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bda2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201138.558394:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1bd9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1bda2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201138.558450:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715189376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201138.558476:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201138.558730:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005d039c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201138.558804:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715189376 00000100:00100000:3.0:1788201138.558808:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715189376 00000100:00100000:3.0:1788201138.558878:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788201138.558886:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715189376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201138.559001:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715189376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201138.559007:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201138.559177:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715189376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201138.559201:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715189504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201138.559233:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201138.559250:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005d039c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201138.559259:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715189504 00000100:00100000:0.0:1788201138.559262:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715189504 00000100:00100000:0.0:1788201138.559278:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788201138.559283:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715189504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201138.559349:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715189504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201138.559356:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788201138.559504:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715189504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201138.560722:0:92613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788201138.560886:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788201138.560904:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788201138.560979:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1bd9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bda2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.560990:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1bd9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bda2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201138.561000:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788201138.561002:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1788201138.561005:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788201138.561156:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc005da6e00/0x96d0c9b8c9a1bda9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.561173:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc005da6e00/0x96d0c9b8c9a1bda9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.561183:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc005da6e00/0x96d0c9b8c9a1bda9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201138.561202:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715189632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201138.561247:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201138.561311:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f982180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201138.561343:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715189632 00000100:00100000:0.0:1788201138.561348:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715189632 00000100:00100000:0.0:1788201138.561597:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788201138.561618:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715189632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201138.561629:0:92550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201138.561642:0:92550:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782ce00/0x96d0c9b8c9a1bdb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1bda9 expref: -99 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201138.561663:0:92550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782ce00/0x96d0c9b8c9a1bdb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bda9 expref: 21 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201138.561674:0:92550:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782ce00/0x96d0c9b8c9a1bdb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bda9 expref: 21 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201138.561695:0:92550:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782ce00, rc 0) 00000100:00100000:0.0:1788201138.561742:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715189632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201138.561748:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788201138.561809:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715189632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201138.561822:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc005da6e00/0x96d0c9b8c9a1bda9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bdb0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.561832:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc005da6e00/0x96d0c9b8c9a1bda9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1bdb0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201138.561882:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715189760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201138.561907:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201138.562165:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f982180 going to sleep for 11 seconds 00000100:00100000:1.0:1788201138.562234:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715189760 00000100:00100000:1.0:1788201138.562240:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715189760 00000100:00100000:1.0:1788201138.562273:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788201138.562281:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715189760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201138.562417:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715189760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201138.562424:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788201138.562683:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715189760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201138.562711:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715189888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201138.562752:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201138.562776:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f982180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201138.562790:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715189888 00000100:00100000:2.0:1788201138.562793:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715189888 00000100:00100000:2.0:1788201138.562820:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788201138.562827:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715189888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201138.563709:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715189888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 880us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201138.563718:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788201138.563764:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715189888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201138.565319:0:92614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1788201138.566302:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1788201138.566330:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788201138.566342:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc005da6e00/0x96d0c9b8c9a1bda9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bdb0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.566354:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc005da6e00/0x96d0c9b8c9a1bda9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bdb0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201138.566415:0:6529:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788201138.566418:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc13aa9f000 from 7 10000000:01000000:2.0:1788201138.566421:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201138.566513:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc005da6800/0x96d0c9b8c9a1bdb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.566522:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc005da6800/0x96d0c9b8c9a1bdb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.566594:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc005da6800/0x96d0c9b8c9a1bdb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201138.566627:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715190016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201138.566685:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201138.566778:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f982180 going to sleep for 11 seconds 00000100:00100000:3.0:1788201138.566839:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715190016 00000100:00100000:3.0:1788201138.566846:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715190016 00000100:00100000:3.0:1788201138.566975:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788201138.566985:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715190016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201138.566996:0:92551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201138.567008:0:92551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1bdbe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1bdb7 expref: -99 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201138.567058:0:92551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1bdbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bdb7 expref: 22 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201138.567080:0:92551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1bdbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bdb7 expref: 22 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201138.567089:0:92551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fcc00, rc 0) 00000100:00100000:3.0:1788201138.567126:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715190016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201138.567133:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788201138.567240:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715190016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201138.567253:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc005da6800/0x96d0c9b8c9a1bdb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bdbe expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201138.567262:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc005da6800/0x96d0c9b8c9a1bdb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1bdbe expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201138.567308:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715190144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201138.567330:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201138.567652:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f982180 going to sleep for 11 seconds 00000100:00100000:1.0:1788201138.567722:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715190144 00000100:00100000:1.0:1788201138.567728:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715190144 00000100:00100000:1.0:1788201138.567765:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201138.567772:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715190144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201138.567876:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715190144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201138.567882:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788201138.568030:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715190144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201138.568058:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715190272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201138.568095:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201138.568110:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f982180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201138.568121:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715190272 00000100:00100000:2.0:1788201138.568125:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715190272 00000100:00100000:2.0:1788201138.568142:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788201138.568147:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715190272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201138.568212:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715190272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201138.568219:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788201138.568251:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715190272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201138.569203:0:92615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788201138.569437:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788201138.569455:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201138.569464:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc005da6800/0x96d0c9b8c9a1bdb7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bdbe expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.569489:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc005da6800/0x96d0c9b8c9a1bdb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bdbe expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201138.569499:0:6529:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788201138.569501:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8dc12563cd28 from 1 10000000:01000000:1.0:1788201138.569504:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788201138.569661:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec000/0x96d0c9b8c9a1bdc5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.569670:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec000/0x96d0c9b8c9a1bdc5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.569680:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec000/0x96d0c9b8c9a1bdc5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201138.569700:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715190400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201138.569744:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201138.569771:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201138.569827:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715190400 00000100:00100000:3.0:1788201138.569833:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715190400 00000100:00100000:3.0:1788201138.569881:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788201138.569890:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12eddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715190400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201138.569901:0:92551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201138.570031:0:92551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1bdcc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1bdc5 expref: -99 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201138.570053:0:92551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1bdcc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bdc5 expref: 23 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201138.570064:0:92551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1bdcc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bdc5 expref: 23 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201138.570073:0:92551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fc800, rc 0) 00000100:00100000:3.0:1788201138.570107:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12eddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715190400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 218us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201138.570114:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788201138.570199:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715190400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201138.570212:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec000/0x96d0c9b8c9a1bdc5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bdcc expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.570221:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec000/0x96d0c9b8c9a1bdc5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1bdcc expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201138.570238:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788201138.570242:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec000/0x96d0c9b8c9a1bdc5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bdcc expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.570260:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec000/0x96d0c9b8c9a1bdc5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bdcc expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201138.570267:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788201138.570269:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dc12563cd28 from 1 10000000:01000000:1.0:1788201138.570271:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788201138.570284:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1bdd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.570291:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1bdd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.570299:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1bdd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201138.570309:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715190528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201138.570330:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201138.570342:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201138.570504:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715190528 00000100:00100000:3.0:1788201138.570508:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715190528 00000100:00100000:3.0:1788201138.570686:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788201138.570694:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12eddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715190528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201138.570701:0:92554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201138.570710:0:92554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fca00/0x96d0c9b8c9a1bdda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1bdd3 expref: -99 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201138.570725:0:92554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fca00/0x96d0c9b8c9a1bdda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bdd3 expref: 24 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201138.570734:0:92554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fca00/0x96d0c9b8c9a1bdda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bdd3 expref: 24 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201138.570741:0:92554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fca00, rc 0) 00000100:00100000:3.0:1788201138.570773:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12eddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715190528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201138.570779:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788201138.570886:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715190528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201138.570897:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1bdd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bdda expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.570905:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1bdd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1bdda expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201138.571041:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715190656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201138.571067:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201138.571094:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201138.571104:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715190656 00000100:00100000:1.0:1788201138.571107:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715190656 00000100:00100000:1.0:1788201138.571124:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788201138.571129:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12eddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715190656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201138.571190:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12eddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715190656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 60us (122us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201138.571196:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788201138.571220:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715190656:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788201138.571245:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788201138.571250:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1bdd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bdda expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201138.571258:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1bdd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bdda expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201138.705630:0:66322:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0050406c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788201138.963158:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201139.023102:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040f00 going to sleep for 0 seconds 00000100:00100000:0.0:1788201139.730985:0:66322:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0050406c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788201139.983700:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201140.047177:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040f00 going to sleep for 0 seconds 00000100:00100000:2.0:1788201140.751215:0:66322:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0050406c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788201141.007726:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201141.075115:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040f00 going to sleep for 0 seconds 00000100:00100000:0.0:1788201141.139666:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201141.139897:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695401088 00000100:00100000:3.0:1788201141.139907:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695401088 00000100:00100000:3.0:1788201141.139970:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1380 00000100:00100000:3.0:1788201141.139981:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2403:x1875060695401088:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201141.140080:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2403:x1875060695401088:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 100us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201141.140088:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1380 00000100:00080000:3.0:1788201141.140114:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201141.140194:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201141.140824:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695400960 00000100:00100000:0.0:1788201141.140831:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695400960 00000100:00100000:0.0:1788201141.140856:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1356 00000100:00100000:0.0:1788201141.140862:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695400960:12345-192.168.201.20@tcp:38:kworker.0 00010000:00080000:0.0:1788201141.140895:0:66313:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '6e293f14-c501-4bc5-9dd4-a18ef02756b4' at ffff8dc12b6be800, cookie 0x96d0c9b8c9a1bc6e 00010000:00080000:0.0:1788201141.140901:0:66313:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp recovering/t0 exp ffff8dc12b6be800 cur 3992 last 1788201137 00010000:02000400:0.0:1788201141.140908:0:66313:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1788201141.140915:0:66313:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1788201141.140941:0:66313:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788201141.141095:0:66313:0:(import.c:65:import_set_state_nolock()) ffff8dc137d36000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201141.141139:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695400960:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 275us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201141.141146:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1356 00000100:00100000:3.0:1788201141.144613:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201141.144754:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695401216 00000100:00100000:0.0:1788201141.144764:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695401216 00000100:00100000:0.0:1788201141.144823:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1357 00000100:00100000:0.0:1788201141.144834:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695401216:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1788201141.144882:0:66314:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc1333bfb80 x1875060695401216/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:262/0 lens 328/0 e 0 to 0 dl 1788201152 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201141.144907:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695401216:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 75us (303us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201141.144914:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1357 00010000:00080000:1.0:1788201141.145050:0:92577:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000001:00100000:3.0:1788201141.591701:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788201141.591714:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:3.0:1788201141.591724:0:8442:0:(genops.c:885:class_export_put()) final put ffff8dc0059d5800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:3.0:1788201141.591764:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0059d5800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 for lustre-OST0000 00000020:00000080:3.0:1788201141.591810:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc0059d6000 for lustre-OST0000 00000001:00100000:1.0:1788201141.592594:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788201141.592602:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:1.0:1788201141.592604:0:9526:0:(genops.c:885:class_export_put()) final put ffff8dc137d34000/6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:3.0:1788201141.593307:0:86307:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d34000/6e293f14-c501-4bc5-9dd4-a18ef02756b4 for lustre-OST0001 00000020:00000080:3.0:1788201141.593346:0:86307:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1031fb000 for lustre-OST0001 00000100:00100000:2.0:1788201141.775297:0:66322:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0050406c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788201142.040951:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201142.095110:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040f00 going to sleep for 0 seconds 00000100:00100000:1.0:1788201142.166116:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201142.166607:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695401344 00000100:00100000:1.0:1788201142.166618:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695401344 00000100:00100000:1.0:1788201142.166669:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1381 00000100:00100000:1.0:1788201142.166685:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2403:x1875060695401344:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201142.166755:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2403:x1875060695401344:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 72us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201142.166777:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1381 00000001:02000400:3.0:1788201142.385102:0:92827:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788201142.616369:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201142.616396:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715190784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201142.616478:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201142.616527:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715190784 00000100:00100000:1.0:1788201142.619169:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715190784 00000100:00100000:1.0:1788201142.619258:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2280 00000100:00100000:1.0:1788201142.619268:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715190784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201142.619299:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201142.619373:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715190784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (2895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201142.619381:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2280 00000100:00100000:1.0:1788201142.619439:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715190784:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788201142.619555:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201142.626307:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715190912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201142.626369:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201142.626493:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715190912 00000100:00100000:2.0:1788201142.626501:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715190912 00000100:00100000:2.0:1788201142.626577:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2281 00000100:00100000:2.0:1788201142.626588:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715190912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201142.626618:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788201142.626672:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715190912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201142.626679:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2281 00000100:00100000:2.0:1788201142.626724:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715190912:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788201142.627217:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201142.799114:0:66322:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0050406c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788201143.062368:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201143.119112:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040f00 going to sleep for 0 seconds 00000100:00100000:3.0:1788201143.119466:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201143.119487:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715191040:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201143.119568:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201143.119658:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715191040 00000100:00100000:2.0:1788201143.119667:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715191040 00000100:00100000:2.0:1788201143.119719:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3988 00000100:00100000:2.0:1788201143.119728:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715191040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201143.119760:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:2.0:1788201143.119803:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715191040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201143.119810:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3988 00000100:00100000:3.0:1788201143.119884:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715191040:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788201143.126261:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201143.126268:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201143.126272:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201143.126283:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201143.126319:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc00a9b4380 x1875060715191296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201143.126342:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201143.126346:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201143.126348:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201143.126353:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201143.126363:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc00a9b7b80 x1875060715191552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201143.126391:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201143.126394:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201143.126395:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201143.126400:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201143.126412:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc00a9b7480 x1875060715191808/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201143.126422:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201143.126424:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201143.126426:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201143.126431:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201143.126440:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc00a9b6680 x1875060715191936/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201143.126462:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788201143.126465:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201143.126466:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc001db1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201143.126470:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dc001db1800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201143.126485:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efe0700 x1875060715192320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201143.126585:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715191168:0@lo:400:kworker.0 00000100:00100000:0.0:1788201143.126652:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201143.126688:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715192192:0@lo:400:kworker.0 00000100:00100000:0.0:1788201143.126711:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201143.126736:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201143.126740:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715191424:0@lo:400:kworker.0 00000100:00100000:0.0:1788201143.126766:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201143.126828:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715191168 00000100:00100000:2.0:1788201143.126836:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715191168 00000100:00100000:2.0:1788201143.126887:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788201143.126897:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12eddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715191168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201143.126948:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12eddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715191168:12345-0@lo:400:kworker.0 Request processed in 52us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201143.126955:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788201143.126995:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715191168:0@lo:400:kworker.0 00000100:00100000:3.0:1788201143.127121:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715191296:0@lo:38:kworker.0 00000100:00100000:3.0:1788201143.127149:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201143.127171:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715191552:0@lo:38:kworker.0 00000100:00100000:3.0:1788201143.127189:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201143.127208:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715191808:0@lo:38:kworker.0 00000100:00100000:3.0:1788201143.127226:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201143.127240:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715191936:0@lo:38:kworker.0 00000100:00100000:3.0:1788201143.127255:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201143.127266:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715192320:0@lo:38:kworker.0 00000100:00100000:3.0:1788201143.127280:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201143.127304:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715191424 00000100:00100000:3.0:1788201143.127307:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715191424 00000100:00100000:3.0:1788201143.127336:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715191296 00000100:00100000:3.0:1788201143.127339:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715191296 00000100:00100000:3.0:1788201143.127357:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715191552 00000100:00100000:3.0:1788201143.127360:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715191552 00000100:00100000:3.0:1788201143.127367:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715191936 00000100:00100000:3.0:1788201143.127369:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715191936 00000100:00100000:3.0:1788201143.127376:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715192320 00000100:00100000:3.0:1788201143.127379:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715192320 00000100:00100000:3.0:1788201143.127388:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1382 00000100:00100000:3.0:1788201143.127395:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715191424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201143.127433:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715191424:12345-0@lo:400:kworker.0 Request processed in 40us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201143.127440:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1382 00000100:00100000:3.0:1788201143.127455:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1358 00000100:00100000:3.0:1788201143.127459:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715191296:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788201143.127481:0:66312:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3994 last 0 00000020:00000080:3.0:1788201143.127515:0:66312:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x96d0c9b8c9a1bde1 00000004:00100000:3.0:1788201143.127542:0:66312:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201143.127675:0:66312:0:(import.c:65:import_set_state_nolock()) ffff8dc0039c3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201143.127712:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875060715191296:12345-0@lo:38:kworker.0 Request processed in 251us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201143.127718:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1358 00000100:00100000:3.0:1788201143.127732:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1359 00000100:00100000:3.0:1788201143.127736:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715191552:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788201143.127750:0:66312:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3994 last 0 00000020:00000080:3.0:1788201143.127772:0:66312:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x96d0c9b8c9a1bde8 00000004:00100000:3.0:1788201143.127778:0:66312:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201143.127795:0:66312:0:(import.c:65:import_set_state_nolock()) ffff8dc139bc3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201143.127822:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875060715191552:12345-0@lo:38:kworker.0 Request processed in 84us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201143.127834:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1359 00000100:00100000:3.0:1788201143.127848:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:3.0:1788201143.127851:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715191936:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788201143.127865:0:66312:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3994 last 0 00000020:00000080:3.0:1788201143.127887:0:66312:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x96d0c9b8c9a1bdef 00000004:00100000:3.0:1788201143.127893:0:66312:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201143.127907:0:66312:0:(import.c:65:import_set_state_nolock()) ffff8dc105588000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201143.127935:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875060715191936:12345-0@lo:38:kworker.0 Request processed in 81us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201143.127941:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00100000:3.0:1788201143.127953:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1361 00000100:00100000:3.0:1788201143.127957:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715192320:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788201143.127969:0:66312:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3994 last 0 00000020:00000080:3.0:1788201143.127989:0:66312:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x96d0c9b8c9a1bdf6 00000004:00100000:3.0:1788201143.127995:0:66312:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201143.128007:0:66312:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201143.128059:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875060715192320:12345-0@lo:38:kworker.0 Request processed in 99us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201143.128065:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1361 00000100:00100000:3.0:1788201143.128084:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715191808 00000100:00100000:3.0:1788201143.128087:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715191808 00000100:00100000:3.0:1788201143.128105:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3989 00000100:00100000:3.0:1788201143.128109:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715191808:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788201143.128123:0:8457:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8dc12b6bd000, cookie 0x96d0c9b8c9a1bc67 00010000:00080000:3.0:1788201143.128127:0:8457:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t81604378640 exp ffff8dc12b6bd000 cur 3994 last 1788201137 00000004:00100000:3.0:1788201143.128141:0:8457:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201143.128154:0:8457:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201143.128186:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715191808:12345-0@lo:38:kworker.0 Request processed in 76us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201143.128192:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3989 00000100:00080000:3.0:1788201143.128213:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788201143.128232:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc00a9b4380 x1875060715191296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201143.128244:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 28 00000100:00080000:3.0:1788201143.128993:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8dc00a9b4380 x1875060715191296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201168 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201143.129003:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788201143.129007:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788201143.129010:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788201143.129044:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715191296:0@lo:38:kworker.0 00010000:00080000:3.0:1788201143.129063:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc00a9b7b80 x1875060715191552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201143.129072:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 28 00000100:00080000:3.0:1788201143.129828:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8dc00a9b7b80 x1875060715191552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201168 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201143.129838:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788201143.129842:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788201143.129845:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788201143.129850:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715191552:0@lo:38:kworker.0 00000100:00080000:3.0:1788201143.129888:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 28 00000100:00080000:3.0:1788201143.129896:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1788201143.129900:0:3654:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1788201143.129902:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116996 gen 3 00000100:00080000:3.0:1788201143.129906:0:3654:0:(recover.c:53:ptlrpc_replay_next()) import ffff8dc109813800 from lustre-MDT0000_UUID committed 115964116996 last 0 00000100:00080000:3.0:1788201143.129909:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00010000:00080000:3.0:1788201143.129950:0:92577:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788201143.129954:0:92577:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 115964116997 00000020:00080000:3.0:1788201143.129960:0:92577:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201143.129963:0:92577:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964116997 00000020:00080000:3.0:1788201143.129966:0:92577:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201143.129968:0:92577:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964116997 00000100:00100000:3.0:1788201143.130108:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715191680:0@lo:400:kworker.0 00000100:00100000:3.0:1788201143.130161:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201143.130195:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201143.130202:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715192064:0@lo:400:kworker.0 00000100:00100000:3.0:1788201143.130229:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201143.130254:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715191680 00000100:00100000:3.0:1788201143.130259:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715191680 00000100:00100000:3.0:1788201143.130310:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1383 00000100:00100000:3.0:1788201143.130318:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715191680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201143.130364:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715191680:12345-0@lo:400:kworker.0 Request processed in 46us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201143.130371:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1383 00000100:00080000:3.0:1788201143.130389:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201143.130409:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715191680:0@lo:400:kworker.0 00000100:00100000:3.0:1788201143.130454:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715191424:0@lo:400:kworker.0 00000100:00100000:3.0:1788201143.130486:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715191808:0@lo:38:kworker.0 00010000:00080000:3.0:1788201143.130499:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc00a9b6680 x1875060715191936/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201143.130508:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 28 00000100:00100000:0.0:1788201143.130907:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715192192 00000100:00100000:0.0:1788201143.130912:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715192192 00000100:00100000:0.0:1788201143.130949:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715192064 00000100:00100000:0.0:1788201143.130952:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715192064 00000100:00100000:0.0:1788201143.130974:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2818 00000100:00100000:0.0:1788201143.130981:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715192192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201143.131040:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715192192:12345-0@lo:400:kworker.0 Request processed in 59us (4327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201143.131046:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2818 00000100:00100000:0.0:1788201143.131060:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2819 00000100:00100000:0.0:1788201143.131074:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715192064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201143.131123:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715192064:12345-0@lo:400:kworker.0 Request processed in 50us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201143.131130:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2819 00000100:00100000:0.0:1788201143.131163:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715192192:0@lo:400:kworker.0 00000100:00100000:0.0:1788201143.131190:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715192064:0@lo:400:kworker.0 00000100:00080000:2.0:1788201143.131281:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201143.131284:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788201143.135336:0:92859:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:0.0:1788201143.135345:0:92859:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:0.0:1788201143.135351:0:92859:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1788201143.135770:0:92859:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:3.0:1788201143.147600:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8dc00a9b6680 x1875060715191936/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201168 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201143.147614:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788201143.147620:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788201143.147624:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1788201143.147630:0:3654:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009d15822d): req@ffff8dc005d50a80 x1875060715177472/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201143.147660:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715191936:0@lo:38:kworker.0 00010000:00080000:3.0:1788201143.147696:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc12efe0700 x1875060715192320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201143.147712:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 28 00000100:00080000:3.0:1788201143.147721:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788201143.147726:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788201143.147728:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788201143.147732:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715192320:0@lo:38:kworker.0 00000100:00100000:3.0:1788201143.147773:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120023480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715192448:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1788201143.147833:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201143.147888:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715192448 00000100:00100000:3.0:1788201143.147895:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715192448 00000100:00100000:3.0:1788201143.147935:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3990 00000100:00100000:3.0:1788201143.147943:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715192448:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1788201143.147961:0:23728:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc00515f100 x1875060715192448/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:264/0 lens 224/0 e 0 to 0 dl 1788201154 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201143.147975:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715192448:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 33us (142us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201143.147981:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3990 00000020:00080000:3.0:1788201143.147998:0:92577:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201143.148002:0:92577:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 115964116997 00010000:00080000:3.0:1788201143.148005:0:92577:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1788201143.148008:0:92577:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201143.148046:0:92577:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788201143.148048:0:92577:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1788201143.148056:0:92577:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc1333bfb80 x1875060695401216/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:262/0 lens 328/0 e 0 to 0 dl 1788201152 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788201143.148071:0:92577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1788201143.148295:0:66322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201143.148323:0:66322:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0050406c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201143.148377:0:66319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715177472 00000100:00100000:0.0:1788201143.148381:0:66319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715177472 00000100:00100000:0.0:1788201143.148420:0:66319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201143.148428:0:66319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:66322:x1875060715177472:12345-0@lo:700:mdt_seqm_0001.0 00010000:00080000:0.0:1788201143.148438:0:66319:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8dc0058a9500 x1875060715177472/t0(0) o700->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:264/0 lens 264/0 e 0 to 0 dl 1788201154 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'mdt_seqm_0001.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788201143.150857:0:92577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1bdfd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7867c3 expref: -99 pid: 92577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.150895:0:92577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1bdfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867c3 expref: 7 pid: 92577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.150914:0:92577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1bdfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867c3 expref: 7 pid: 92577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.150923:0:92577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fd000, rc 0) 00010000:00080000:3.0:1788201143.151000:0:92577:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00010000:00080000:3.0:1788201143.151026:0:92577:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 40000000:02000000:1.0:1788201143.152441:0:66319:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000300000400-0x0000000340000400]:1:mdt 00000100:00100000:0.0:1788201143.160876:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201143.165424:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695401472 00000100:00100000:3.0:1788201143.165439:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695401472 00000100:00100000:3.0:1788201143.165518:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1384 00000100:00100000:3.0:1788201143.165541:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120023800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2399:x1875060695401472:12345-192.168.201.20@tcp:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1788201143.165562:0:66313:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc120023800 x1875060695401472/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:264/0 lens 224/0 e 0 to 0 dl 1788201154 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201143.165587:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120023800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2399:x1875060695401472:12345-192.168.201.20@tcp:400:ptlrpcd_rcv.0 Request processed in 51us (4722us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201143.165594:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1384 00010000:00080000:0.0:1788201143.165644:0:92577:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1788201143.165773:0:92577:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 120259084288 00000100:00100000:0.0:1788201143.170194:0:66319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:66322:x1875060715177472:12345-0@lo:700:mdt_seqm_0001.0 Request processed in 21759us (21890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201143.170209:0:66319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201143.170341:0:66322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-lwp-MDT0001_UUID:66322:1875060715177472:0@lo:700:mdt_seqm_0001.0 40000000:02000000:1.0:1788201143.170357:0:66322:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000300000400-0x0000000340000400]:1:mdt] 00000001:00100000:3.0:1788201143.182606:0:92544:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000001:00100000:3.0:1788201143.182613:0:92544:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1788201143.182651:0:92577:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1788201143.182692:0:92577:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1788201143.182707:0:92577:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8dc00515f100 x1875060715192448/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:264/0 lens 224/0 e 0 to 0 dl 1788201154 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788201143.182826:0:92577:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.201.20@tcp: req@ffff8dc120023800 x1875060695401472/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:264/0 lens 224/0 e 0 to 0 dl 1788201154 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1788201143.182884:0:92577:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:02, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:2.0:1788201143.187426:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1788201143.187442:0:3654:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8dc120023480 x1875060715192448/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201159 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201143.187453:0:3654:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8dc120023480 x1875060715192448/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201159 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201143.187460:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788201143.187480:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1788201143.187486:0:3654:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009b7c8587): req@ffff8dc137cee680 x1875060715175680/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201143.187503:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120023480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715192448:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1788201143.195229:0:75745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201143.195271:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201143.195293:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715175680 00000100:00100000:1.0:1788201143.195311:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715175680 00000100:00100000:1.0:1788201143.195362:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3991 00000100:00100000:1.0:1788201143.195372:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:75745:x1875060715175680:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788201143.198013:0:66322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:71108:x1875060695396992:12345-192.168.201.20@tcp:700:cp.0 Request processed in 12678733us (12678901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201143.198048:0:66322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:0.0:1788201143.199219:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201143.199239:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715192576:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201143.199291:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201143.199486:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715192576 00000100:00100000:2.0:1788201143.199495:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715192576 00000100:00100000:2.0:1788201143.199554:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3992 00000100:00100000:2.0:1788201143.199563:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120020700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715192576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201143.199606:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444962304 avail 1298722816 00000100:00100000:2.0:1788201143.199656:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120020700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715192576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201143.199663:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3992 00000100:00100000:0.0:1788201143.199789:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715192576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201143.201790:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75745:x1875060715175680:12345-0@lo:1000:osp_up0-1.0 Request processed in 6413us (6563us total) trans 120259084289 rc 0/0 00000100:00100000:1.0:1788201143.201802:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3991 00000100:00100000:0.0:1788201143.201877:0:75745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715175680:0@lo:1000:osp_up0-1.0 00000001:00100000:2.0:1788201143.203320:0:75739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788201143.207821:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201143.212825:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695401728 00000100:00100000:2.0:1788201143.212843:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695401728 00000100:00100000:2.0:1788201143.212930:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1362 00000100:00100000:2.0:1788201143.212939:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120020380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:71108:x1875060695401728:12345-192.168.201.20@tcp:101:cp.0 00010000:00010000:2.0:1788201143.212958:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201143.212978:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1be04 lrc: 2/0,0 mode: --/CW res: [0x2400061c1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7867ed expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.213089:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007ade600/0x96d0c9b8c9a1be0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.213098:0:66757:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007ade600/0x96d0c9b8c9a1be0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.213107:0:66757:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007ade600/0x96d0c9b8c9a1be0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201143.213131:0:66757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66757:1875060715192704:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1788201143.213199:0:66757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201143.213229:0:66757:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc139bdf0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201143.215341:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715192704 00000100:00100000:1.0:1788201143.215353:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715192704 00000100:00100000:1.0:1788201143.215406:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3993 00000100:00100000:1.0:1788201143.215415:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66757:x1875060715192704:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1788201143.215438:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201143.215456:0:8458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1be12 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1be0b expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.215480:0:8458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1be12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1be0b expref: 8 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.215495:0:8458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1be12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1be0b expref: 8 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.215503:0:8458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103141d00) 00010000:00010000:1.0:1788201143.215506:0:8458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788201143.215510:0:8458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064edc00, rc 0) 00000100:00100000:1.0:1788201143.215709:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66757:x1875060715192704:12345-0@lo:101:mdt00_003.0 Request processed in 294us (2510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201143.215716:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3993 00000100:00100000:1.0:1788201143.215762:0:66757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66757:1875060715192704:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1788201143.215793:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007ade600/0x96d0c9b8c9a1be0b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1be12 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.215805:0:66757:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007ade600/0x96d0c9b8c9a1be0b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1be12 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201143.215825:0:66757:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1788201143.215832:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007ade600/0x96d0c9b8c9a1be0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1be12 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.215840:0:66757:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007ade600/0x96d0c9b8c9a1be0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1be12 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.215895:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1be19 lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.215904:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1be19 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.215912:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1be19 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.215923:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1be20 lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.215930:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1be20 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.215936:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1be20 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201143.216439:0:66757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66757:1875060715192832:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788201143.216476:0:66757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201143.216498:0:66757:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f4e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201143.216519:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715192832 00000100:00100000:1.0:1788201143.216535:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715192832 00000100:00100000:1.0:1788201143.216656:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3994 00000100:00100000:1.0:1788201143.216663:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66757:x1875060715192832:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788201143.216727:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66757:x1875060715192832:12345-0@lo:1000:mdt00_003.0 Request processed in 65us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201143.216734:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3994 00000100:00100000:1.0:1788201143.216759:0:66757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66757:1875060715192832:0@lo:1000:mdt00_003.0 00000100:00080000:0.0:1788201143.218040:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788201143.220113:0:66757:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x472:0x0], count =400 00000004:00080000:0.0:1788201143.220128:0:66757:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x472:0x0]+400 in llog 00000004:00080000:0.0:1788201143.220152:0:66757:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x602:0x0], index 0: 0 00010000:00010000:0.0:1788201143.220387:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1be27 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201143.220404:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1be27 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201143.220417:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1be27 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201143.220453:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1be19 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201143.220460:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1be19 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201143.220467:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1be19 lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201143.220474:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1be19 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201143.220496:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064eca00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201143.220501:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1be19 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201143.220508:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1be19 lrc: 5/0,0 mode: CW/CW res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201143.220531:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xf:0x0].0x0 (ffff8dc12196ed00) 00010000:00010000:0.0:1788201143.220535:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201143.220539:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1be19 lrc: 3/0,0 mode: --/CW res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201143.220546:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1be19 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201143.220561:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000715423b0 reply state 0000000016045380 transno 77309411446 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1be20 lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201143.220572:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1be20 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201143.220578:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xf:0x0].0xb1bed465 (ffff8dc005f4b400) 00010000:00010000:0.0:1788201143.220580:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201143.220584:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201143.220620:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1be04 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867ed expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201143.220636:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1be27 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867ed expref: 9 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201143.220655:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff8dc0048beb00) 00010000:00010000:0.0:1788201143.220657:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201143.220660:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782c200, rc 0) 00000100:00100000:0.0:1788201143.220726:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120020380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:71108:x1875060695401728:12345-192.168.201.20@tcp:101:cp.0 Request processed in 7787us (14652us total) trans 77309411446 rc 0/0 00000100:00100000:0.0:1788201143.220735:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1362 00000004:00000080:0.0:1788201143.249519:0:92577:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa0dd48453e10 00100000:10000000:0.0:1788201143.249545:0:92577:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000100:00100000:1.0:1788201143.255969:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201143.259075:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695401856 00000100:00100000:3.0:1788201143.259092:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695401856 00000100:00100000:3.0:1788201143.259154:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5906 00000100:00100000:3.0:1788201143.259164:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2399:x1875060695401856:12345-192.168.201.20@tcp:8:cp.0 00010000:00080000:3.0:1788201143.259199:0:26211:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp t0 exp 0000000000000000 cur 3994 last 0 00000020:00000080:3.0:1788201143.259245:0:26211:0:(genops.c:1385:class_connect()) connect: client 6e293f14-c501-4bc5-9dd4-a18ef02756b4, cookie 0x96d0c9b8c9a1be35 00002000:00100000:3.0:1788201143.259257:0:26211:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6e293f14-c501-4bc5-9dd4-a18ef02756b4/ffff8dc1257f0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788201143.259267:0:26211:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788201143.259358:0:26211:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788201143.259390:0:26211:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201143.259464:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695401856:12345-192.168.201.20@tcp:8:cp.0 Request processed in 300us (3503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201143.259472:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5906 00000100:00100000:2.0:1788201143.263541:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201143.263611:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695401984 00000100:00100000:3.0:1788201143.263623:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695401984 00000100:00080000:2.0:1788201143.263699:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201143.263701:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5907 00000100:00100000:3.0:1788201143.263712:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:0:x1875060695401984:12345-192.168.201.20@tcp:101:cp.0 00010000:00010000:3.0:1788201143.263730:0:26204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201143.263752:0:26204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1be3c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7867f4 expref: -99 pid: 26204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201143.263781:0:26204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x602:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.263801:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x602:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.263806:0:26204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x602:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.263815:0:26204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1be3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867f4 expref: 7 pid: 26204 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.263845:0:26204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1be3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867f4 expref: 7 pid: 26204 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.263859:0:26204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fdc00, rc 0) 00000100:00100000:3.0:1788201143.263936:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:0:x1875060695401984:12345-192.168.201.20@tcp:101:cp.0 Request processed in 226us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201143.263943:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5907 00000004:00080000:1.0:1788201143.275512:0:92563:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x322:0x0] 00000100:00100000:1.0:1788201143.275591:0:92563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058ab100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92563:1875060715192960:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788201143.275594:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000004:00080000:1.0:1788201143.275643:0:92565:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x323:0x0] 00000100:00100000:1.0:1788201143.275661:0:92565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92565:1875060715193088:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788201143.275689:0:92565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201143.285604:0:92565:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f4ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201143.290026:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695402112 00000100:00100000:3.0:1788201143.290040:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695402112 00000100:00100000:3.0:1788201143.290093:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715193088 00000100:00100000:3.0:1788201143.290096:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715193088 00000100:00100000:3.0:1788201143.290122:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5908 00000100:00100000:3.0:1788201143.290132:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120020a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:71108:x1875060695402112:12345-192.168.201.20@tcp:101:cp.0 00010000:00010000:3.0:1788201143.290150:0:26214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201143.290168:0:26214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1be43 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7867fb expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.290197:0:26214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1be3c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867f4 expref: 8 pid: 26204 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.290207:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x602:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.290211:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x602:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.290217:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1be43 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867fb expref: 8 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.290250:0:26214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1be3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867f4 expref: 8 pid: 26204 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.290264:0:26214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1be3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867f4 expref: 8 pid: 26204 timeout: 4094 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201143.290307:0:26214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00515e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:26214:1875060715193216:192.168.201.20@tcp:104: 00000100:00100000:3.0:1788201143.290386:0:26214:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f2e7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201143.290410:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5909 00000100:00100000:3.0:1788201143.290418:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:92565:x1875060715193088:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788201143.290441:0:26205:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 865 -> diff = -62 00002000:02000040:3.0:1788201143.290447:0:26205:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:804 to 0x2c0000401:865) 00000100:00100000:1.0:1788201143.301733:0:92563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201143.301795:0:92563:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f4e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201143.301875:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715192960 00000100:00100000:2.0:1788201143.301891:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715192960 00000100:00100000:2.0:1788201143.301945:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5910 00000100:00100000:2.0:1788201143.301954:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:92563:x1875060715192960:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788201143.301985:0:26208:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 865 -> diff = -63 00002000:02000040:2.0:1788201143.301990:0:26208:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:803 to 0x280000401:865) 00002000:00010000:3.0:1788201143.311957:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x361:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.311971:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dedf1ff/0x96d0c9b8c9a1be4a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.311988:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x361:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.311993:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x361:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.311999:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dedf1ff/0x96d0c9b8c9a1be4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.312024:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dedf1ff/0x96d0c9b8c9a1be4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.312035:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dedf1ff/0x96d0c9b8c9a1be4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.312043:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dedf1ff/0x96d0c9b8c9a1be4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.312074:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201143.312180:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x360:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.312185:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1be51 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.312193:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x360:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.312196:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x360:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.312200:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1be51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.312208:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1be51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.312215:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1be51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.312223:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1be51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.312235:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788201143.312263:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.312267:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000515efff9/0x96d0c9b8c9a1be58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.312274:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35f:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.312669:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.312676:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000515efff9/0x96d0c9b8c9a1be58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.312687:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000515efff9/0x96d0c9b8c9a1be58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.312695:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000515efff9/0x96d0c9b8c9a1be58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.312702:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000515efff9/0x96d0c9b8c9a1be58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.312717:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788201143.312759:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.312764:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014ef0705/0x96d0c9b8c9a1be5f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.312771:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35e:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.312774:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.312777:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014ef0705/0x96d0c9b8c9a1be5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.312787:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014ef0705/0x96d0c9b8c9a1be5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.312794:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014ef0705/0x96d0c9b8c9a1be5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.312806:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014ef0705/0x96d0c9b8c9a1be5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.312819:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788201143.312864:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.312869:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da34fe63/0x96d0c9b8c9a1be66 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.312876:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35d:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.312878:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.312883:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da34fe63/0x96d0c9b8c9a1be66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.312891:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da34fe63/0x96d0c9b8c9a1be66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.312898:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da34fe63/0x96d0c9b8c9a1be66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.312906:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da34fe63/0x96d0c9b8c9a1be66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.312913:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788201143.312939:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.312944:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffeeb63e/0x96d0c9b8c9a1be6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.312955:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35c:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.312958:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.312963:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffeeb63e/0x96d0c9b8c9a1be6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.312971:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffeeb63e/0x96d0c9b8c9a1be6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.314616:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffeeb63e/0x96d0c9b8c9a1be6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.314627:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffeeb63e/0x96d0c9b8c9a1be6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.314641:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788201143.314725:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.314730:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d8d2611/0x96d0c9b8c9a1be74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.314741:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35b:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.314745:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.314750:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d8d2611/0x96d0c9b8c9a1be74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.314761:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d8d2611/0x96d0c9b8c9a1be74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.314783:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d8d2611/0x96d0c9b8c9a1be74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.314789:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d8d2611/0x96d0c9b8c9a1be74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.314797:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1788201143.321492:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.321508:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084b651b2/0x96d0c9b8c9a1be7b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.321536:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35a:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.321541:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.321547:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084b651b2/0x96d0c9b8c9a1be7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.321562:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084b651b2/0x96d0c9b8c9a1be7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.321572:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084b651b2/0x96d0c9b8c9a1be7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.321579:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084b651b2/0x96d0c9b8c9a1be7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.321604:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1788201143.321703:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x359:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.321708:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e697d1a0/0x96d0c9b8c9a1be82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.321716:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x359:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.321718:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x359:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.321722:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e697d1a0/0x96d0c9b8c9a1be82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.321730:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e697d1a0/0x96d0c9b8c9a1be82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.321736:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e697d1a0/0x96d0c9b8c9a1be82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.321743:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e697d1a0/0x96d0c9b8c9a1be82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.321752:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:3.0:1788201143.321781:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x358:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.321786:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074aae315/0x96d0c9b8c9a1be89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.321793:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x358:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.321800:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x358:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.321804:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074aae315/0x96d0c9b8c9a1be89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.321813:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074aae315/0x96d0c9b8c9a1be89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.321820:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074aae315/0x96d0c9b8c9a1be89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.321827:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074aae315/0x96d0c9b8c9a1be89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.321836:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:3.0:1788201143.321872:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x357:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.321877:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000870a30c3/0x96d0c9b8c9a1be90 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.321885:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x357:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.321888:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x357:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.321892:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000870a30c3/0x96d0c9b8c9a1be90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.321900:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000870a30c3/0x96d0c9b8c9a1be90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.321907:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000870a30c3/0x96d0c9b8c9a1be90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.321921:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000870a30c3/0x96d0c9b8c9a1be90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.321930:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:3.0:1788201143.321967:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x356:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.321971:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe3208bc/0x96d0c9b8c9a1be97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.321978:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x356:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.321981:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x356:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.321984:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe3208bc/0x96d0c9b8c9a1be97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.321992:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe3208bc/0x96d0c9b8c9a1be97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.321999:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe3208bc/0x96d0c9b8c9a1be97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322006:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe3208bc/0x96d0c9b8c9a1be97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322030:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:3.0:1788201143.322067:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x355:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.322071:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdc72081/0x96d0c9b8c9a1be9e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322084:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x355:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.322087:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x355:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.322090:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdc72081/0x96d0c9b8c9a1be9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322100:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdc72081/0x96d0c9b8c9a1be9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322107:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdc72081/0x96d0c9b8c9a1be9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322114:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdc72081/0x96d0c9b8c9a1be9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322122:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:3.0:1788201143.322157:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x354:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.322161:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081855616/0x96d0c9b8c9a1bea5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322168:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x354:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.322171:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x354:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.322174:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081855616/0x96d0c9b8c9a1bea5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322183:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081855616/0x96d0c9b8c9a1bea5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322215:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081855616/0x96d0c9b8c9a1bea5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322224:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081855616/0x96d0c9b8c9a1bea5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322233:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:3.0:1788201143.322271:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x353:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.322276:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4377764/0x96d0c9b8c9a1beac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322284:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x353:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.322287:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x353:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.322290:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4377764/0x96d0c9b8c9a1beac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322298:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4377764/0x96d0c9b8c9a1beac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322306:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4377764/0x96d0c9b8c9a1beac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322314:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4377764/0x96d0c9b8c9a1beac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322332:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:3.0:1788201143.322365:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x352:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.322370:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1beb3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322378:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x352:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.322381:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x352:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.322385:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1beb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322393:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1beb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322400:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1beb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322407:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1beb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322415:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:3.0:1788201143.322453:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x351:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.322458:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070573b83/0x96d0c9b8c9a1beba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322465:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x351:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.322474:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x351:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.322478:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070573b83/0x96d0c9b8c9a1beba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322487:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070573b83/0x96d0c9b8c9a1beba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322495:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070573b83/0x96d0c9b8c9a1beba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322502:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070573b83/0x96d0c9b8c9a1beba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.322510:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:3.0:1788201143.323333:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x350:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.323342:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073a58293/0x96d0c9b8c9a1bec1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.323352:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x350:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.323356:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x350:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.323361:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073a58293/0x96d0c9b8c9a1bec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.323370:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073a58293/0x96d0c9b8c9a1bec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.323378:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073a58293/0x96d0c9b8c9a1bec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.323392:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073a58293/0x96d0c9b8c9a1bec1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.323401:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:3.0:1788201143.323443:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.323447:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4dbdf92/0x96d0c9b8c9a1bec8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.323455:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34f:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.323460:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.323464:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4dbdf92/0x96d0c9b8c9a1bec8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.323472:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4dbdf92/0x96d0c9b8c9a1bec8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.323478:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4dbdf92/0x96d0c9b8c9a1bec8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.323485:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4dbdf92/0x96d0c9b8c9a1bec8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.323493:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00002000:00010000:3.0:1788201143.324997:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.325007:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b318c7cf/0x96d0c9b8c9a1becf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325042:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34e:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.325045:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.325051:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b318c7cf/0x96d0c9b8c9a1becf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325062:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b318c7cf/0x96d0c9b8c9a1becf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325070:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b318c7cf/0x96d0c9b8c9a1becf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325077:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b318c7cf/0x96d0c9b8c9a1becf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325087:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/20 locks to regular blp list, 20 blwis in pool 00002000:00010000:3.0:1788201143.325151:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.325157:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081f2be41/0x96d0c9b8c9a1bed6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325165:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34d:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.325167:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.325171:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081f2be41/0x96d0c9b8c9a1bed6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325180:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081f2be41/0x96d0c9b8c9a1bed6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325212:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081f2be41/0x96d0c9b8c9a1bed6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325218:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081f2be41/0x96d0c9b8c9a1bed6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325227:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/21 locks to regular blp list, 21 blwis in pool 00002000:00010000:3.0:1788201143.325264:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.325269:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aafb265c/0x96d0c9b8c9a1bedd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325276:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34c:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.325279:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.325293:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aafb265c/0x96d0c9b8c9a1bedd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325303:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aafb265c/0x96d0c9b8c9a1bedd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325310:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aafb265c/0x96d0c9b8c9a1bedd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325316:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aafb265c/0x96d0c9b8c9a1bedd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325335:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/22 locks to regular blp list, 22 blwis in pool 00002000:00010000:3.0:1788201143.325375:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.325379:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de3ebfb5/0x96d0c9b8c9a1bee4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325387:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34b:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.325390:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.325394:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de3ebfb5/0x96d0c9b8c9a1bee4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325402:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de3ebfb5/0x96d0c9b8c9a1bee4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325409:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de3ebfb5/0x96d0c9b8c9a1bee4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325415:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de3ebfb5/0x96d0c9b8c9a1bee4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325423:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/23 locks to regular blp list, 23 blwis in pool 00002000:00010000:3.0:1788201143.325456:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.325461:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008cd7a6f/0x96d0c9b8c9a1beeb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325468:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34a:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.325476:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.325480:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008cd7a6f/0x96d0c9b8c9a1beeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325489:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008cd7a6f/0x96d0c9b8c9a1beeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325496:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008cd7a6f/0x96d0c9b8c9a1beeb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325503:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008cd7a6f/0x96d0c9b8c9a1beeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325510:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/24 locks to regular blp list, 24 blwis in pool 00002000:00010000:3.0:1788201143.325559:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x349:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.325564:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003efe90ca/0x96d0c9b8c9a1bef2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325571:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x349:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.325575:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x349:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.325578:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003efe90ca/0x96d0c9b8c9a1bef2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325587:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003efe90ca/0x96d0c9b8c9a1bef2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325595:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003efe90ca/0x96d0c9b8c9a1bef2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325607:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003efe90ca/0x96d0c9b8c9a1bef2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325617:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/25 locks to regular blp list, 25 blwis in pool 00002000:00010000:3.0:1788201143.325648:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x348:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.325653:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093363796/0x96d0c9b8c9a1bef9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325660:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x348:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.325663:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x348:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.325667:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093363796/0x96d0c9b8c9a1bef9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325675:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093363796/0x96d0c9b8c9a1bef9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325682:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093363796/0x96d0c9b8c9a1bef9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325689:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093363796/0x96d0c9b8c9a1bef9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325696:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/26 locks to regular blp list, 26 blwis in pool 00002000:00010000:3.0:1788201143.325725:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x347:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.325730:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b4a355e/0x96d0c9b8c9a1bf00 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325744:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x347:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.325747:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x347:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.325751:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b4a355e/0x96d0c9b8c9a1bf00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325760:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b4a355e/0x96d0c9b8c9a1bf00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325767:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b4a355e/0x96d0c9b8c9a1bf00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325775:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b4a355e/0x96d0c9b8c9a1bf00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325783:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/27 locks to regular blp list, 27 blwis in pool 00002000:00010000:3.0:1788201143.325821:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x346:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.325825:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e5843d8/0x96d0c9b8c9a1bf07 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325833:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x346:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.325836:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x346:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.325840:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e5843d8/0x96d0c9b8c9a1bf07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325848:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e5843d8/0x96d0c9b8c9a1bf07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325867:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e5843d8/0x96d0c9b8c9a1bf07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325874:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e5843d8/0x96d0c9b8c9a1bf07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325882:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/28 locks to regular blp list, 28 blwis in pool 00002000:00010000:3.0:1788201143.325920:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x345:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.325925:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec72f47e/0x96d0c9b8c9a1bf0e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325932:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x345:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.325935:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x345:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.325939:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec72f47e/0x96d0c9b8c9a1bf0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325948:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec72f47e/0x96d0c9b8c9a1bf0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325955:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec72f47e/0x96d0c9b8c9a1bf0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325962:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec72f47e/0x96d0c9b8c9a1bf0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.325981:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/29 locks to regular blp list, 29 blwis in pool 00002000:00010000:3.0:1788201143.326041:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x344:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.326046:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc7b5a1b/0x96d0c9b8c9a1bf15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.326053:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x344:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.326055:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x344:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.326058:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc7b5a1b/0x96d0c9b8c9a1bf15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.326066:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc7b5a1b/0x96d0c9b8c9a1bf15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.326073:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc7b5a1b/0x96d0c9b8c9a1bf15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.326079:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc7b5a1b/0x96d0c9b8c9a1bf15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.326087:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/30 locks to regular blp list, 30 blwis in pool 00002000:00010000:3.0:1788201143.326122:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x343:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.326126:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b9c1e9e/0x96d0c9b8c9a1bf1c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.326134:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x343:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.326154:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x343:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.326158:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b9c1e9e/0x96d0c9b8c9a1bf1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.326167:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b9c1e9e/0x96d0c9b8c9a1bf1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.326174:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b9c1e9e/0x96d0c9b8c9a1bf1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.326181:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b9c1e9e/0x96d0c9b8c9a1bf1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.326190:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/31 locks to regular blp list, 31 blwis in pool 00000100:00100000:1.0:1788201143.327627:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00010000:00010000:1.0:1788201143.327657:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 30 total in blp. (30 blwis in pool) 00010000:00010000:1.0:1788201143.327666:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dedf1ff/0x96d0c9b8c9a1be4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.327690:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc005da7c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.327696:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dedf1ff/0x96d0c9b8c9a1be4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.327706:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dedf1ff/0x96d0c9b8c9a1be4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.327724:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dedf1ff/0x96d0c9b8c9a1be4a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.327732:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dedf1ff/0x96d0c9b8c9a1be4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328150:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 29 total in blp. (29 blwis in pool) 00010000:00010000:1.0:1788201143.328155:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1be51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328161:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f338400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.328164:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1be51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328172:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1be51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328183:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1be51 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328197:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006d2ead3/0x96d0c9b8c9a1be51 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328211:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 28 total in blp. (28 blwis in pool) 00010000:00010000:1.0:1788201143.328214:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000515efff9/0x96d0c9b8c9a1be58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328219:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f338c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.328222:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000515efff9/0x96d0c9b8c9a1be58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328229:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000515efff9/0x96d0c9b8c9a1be58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328237:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000515efff9/0x96d0c9b8c9a1be58 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328243:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000515efff9/0x96d0c9b8c9a1be58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328252:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 27 total in blp. (27 blwis in pool) 00010000:00010000:1.0:1788201143.328255:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014ef0705/0x96d0c9b8c9a1be5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328261:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.328270:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014ef0705/0x96d0c9b8c9a1be5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328276:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014ef0705/0x96d0c9b8c9a1be5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328285:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014ef0705/0x96d0c9b8c9a1be5f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328292:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014ef0705/0x96d0c9b8c9a1be5f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328304:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 26 total in blp. (26 blwis in pool) 00010000:00010000:1.0:1788201143.328308:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da34fe63/0x96d0c9b8c9a1be66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328313:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f338000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.328316:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da34fe63/0x96d0c9b8c9a1be66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328323:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da34fe63/0x96d0c9b8c9a1be66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328331:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da34fe63/0x96d0c9b8c9a1be66 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328337:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da34fe63/0x96d0c9b8c9a1be66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328356:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 25 total in blp. (25 blwis in pool) 00010000:00010000:1.0:1788201143.328360:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffeeb63e/0x96d0c9b8c9a1be6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328365:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.328368:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffeeb63e/0x96d0c9b8c9a1be6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328486:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffeeb63e/0x96d0c9b8c9a1be6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328498:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffeeb63e/0x96d0c9b8c9a1be6d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328505:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffeeb63e/0x96d0c9b8c9a1be6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328530:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 24 total in blp. (24 blwis in pool) 00010000:00010000:1.0:1788201143.328534:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d8d2611/0x96d0c9b8c9a1be74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328803:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f338600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.328807:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d8d2611/0x96d0c9b8c9a1be74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328894:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d8d2611/0x96d0c9b8c9a1be74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328908:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d8d2611/0x96d0c9b8c9a1be74 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328915:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d8d2611/0x96d0c9b8c9a1be74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328929:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 23 total in blp. (23 blwis in pool) 00010000:00010000:1.0:1788201143.328933:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084b651b2/0x96d0c9b8c9a1be7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328938:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f338e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.328942:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084b651b2/0x96d0c9b8c9a1be7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328949:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084b651b2/0x96d0c9b8c9a1be7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328957:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084b651b2/0x96d0c9b8c9a1be7b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328964:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084b651b2/0x96d0c9b8c9a1be7b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328989:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 22 total in blp. (22 blwis in pool) 00010000:00010000:1.0:1788201143.328992:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e697d1a0/0x96d0c9b8c9a1be82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.328997:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.329000:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e697d1a0/0x96d0c9b8c9a1be82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.329006:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e697d1a0/0x96d0c9b8c9a1be82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.329041:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e697d1a0/0x96d0c9b8c9a1be82 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.329049:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e697d1a0/0x96d0c9b8c9a1be82 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.329061:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 21 total in blp. (21 blwis in pool) 00010000:00010000:1.0:1788201143.329066:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074aae315/0x96d0c9b8c9a1be89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.329073:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f338800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.329076:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074aae315/0x96d0c9b8c9a1be89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.330432:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074aae315/0x96d0c9b8c9a1be89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.330450:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074aae315/0x96d0c9b8c9a1be89 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.330457:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074aae315/0x96d0c9b8c9a1be89 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.330477:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 20 total in blp. (20 blwis in pool) 00010000:00010000:1.0:1788201143.330481:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000870a30c3/0x96d0c9b8c9a1be90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.330487:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f338a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.330491:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000870a30c3/0x96d0c9b8c9a1be90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.330498:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000870a30c3/0x96d0c9b8c9a1be90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.330509:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000870a30c3/0x96d0c9b8c9a1be90 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.330516:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000870a30c3/0x96d0c9b8c9a1be90 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.331478:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 19 total in blp. (19 blwis in pool) 00010000:00010000:1.0:1788201143.331483:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe3208bc/0x96d0c9b8c9a1be97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.331489:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.331493:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe3208bc/0x96d0c9b8c9a1be97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.331500:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe3208bc/0x96d0c9b8c9a1be97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.331511:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe3208bc/0x96d0c9b8c9a1be97 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.331512:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:1.0:1788201143.331518:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe3208bc/0x96d0c9b8c9a1be97 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.332462:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:1.0:1788201143.332468:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081855616/0x96d0c9b8c9a1bea5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.332478:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.332482:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081855616/0x96d0c9b8c9a1bea5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.332504:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081855616/0x96d0c9b8c9a1bea5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.332516:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081855616/0x96d0c9b8c9a1bea5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.332534:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081855616/0x96d0c9b8c9a1bea5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.332555:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:1.0:1788201143.332559:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4377764/0x96d0c9b8c9a1beac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.332566:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.332570:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4377764/0x96d0c9b8c9a1beac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.332577:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4377764/0x96d0c9b8c9a1beac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.332586:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4377764/0x96d0c9b8c9a1beac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.332594:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4377764/0x96d0c9b8c9a1beac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.332615:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:1.0:1788201143.332619:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1beb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.332625:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.332629:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1beb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.332636:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1beb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.332645:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1beb3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.332652:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5bcf5f2/0x96d0c9b8c9a1beb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.332661:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:1.0:1788201143.332665:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070573b83/0x96d0c9b8c9a1beba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.332671:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdce00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.332674:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070573b83/0x96d0c9b8c9a1beba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.332691:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070573b83/0x96d0c9b8c9a1beba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.332700:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070573b83/0x96d0c9b8c9a1beba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.332707:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070573b83/0x96d0c9b8c9a1beba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.332718:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:1.0:1788201143.332721:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073a58293/0x96d0c9b8c9a1bec1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.332727:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdd000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.332731:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073a58293/0x96d0c9b8c9a1bec1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333630:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073a58293/0x96d0c9b8c9a1bec1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333653:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073a58293/0x96d0c9b8c9a1bec1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333660:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073a58293/0x96d0c9b8c9a1bec1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333695:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:1.0:1788201143.333699:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4dbdf92/0x96d0c9b8c9a1bec8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333706:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdc800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.333710:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4dbdf92/0x96d0c9b8c9a1bec8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333718:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4dbdf92/0x96d0c9b8c9a1bec8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333728:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4dbdf92/0x96d0c9b8c9a1bec8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333734:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4dbdf92/0x96d0c9b8c9a1bec8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333759:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:1.0:1788201143.333763:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b318c7cf/0x96d0c9b8c9a1becf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333773:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdd800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.333777:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b318c7cf/0x96d0c9b8c9a1becf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333799:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b318c7cf/0x96d0c9b8c9a1becf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333810:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b318c7cf/0x96d0c9b8c9a1becf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333817:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b318c7cf/0x96d0c9b8c9a1becf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333829:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:1.0:1788201143.333833:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081f2be41/0x96d0c9b8c9a1bed6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333839:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdc200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.333842:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081f2be41/0x96d0c9b8c9a1bed6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333850:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081f2be41/0x96d0c9b8c9a1bed6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333858:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081f2be41/0x96d0c9b8c9a1bed6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333864:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081f2be41/0x96d0c9b8c9a1bed6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333885:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:1.0:1788201143.333888:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aafb265c/0x96d0c9b8c9a1bedd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333893:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdcc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.333896:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aafb265c/0x96d0c9b8c9a1bedd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333903:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aafb265c/0x96d0c9b8c9a1bedd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333911:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aafb265c/0x96d0c9b8c9a1bedd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333916:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aafb265c/0x96d0c9b8c9a1bedd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333925:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1788201143.333928:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de3ebfb5/0x96d0c9b8c9a1bee4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333933:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdd400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.333936:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de3ebfb5/0x96d0c9b8c9a1bee4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333951:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de3ebfb5/0x96d0c9b8c9a1bee4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333959:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de3ebfb5/0x96d0c9b8c9a1bee4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333966:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de3ebfb5/0x96d0c9b8c9a1bee4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333977:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788201143.333981:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008cd7a6f/0x96d0c9b8c9a1beeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333987:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdda00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.333990:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008cd7a6f/0x96d0c9b8c9a1beeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.333997:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008cd7a6f/0x96d0c9b8c9a1beeb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.334006:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008cd7a6f/0x96d0c9b8c9a1beeb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.334029:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008cd7a6f/0x96d0c9b8c9a1beeb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.334053:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788201143.334057:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003efe90ca/0x96d0c9b8c9a1bef2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.334062:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdde00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.334065:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003efe90ca/0x96d0c9b8c9a1bef2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.334072:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003efe90ca/0x96d0c9b8c9a1bef2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336475:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdc72081/0x96d0c9b8c9a1be9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336496:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12f339800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201143.336502:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdc72081/0x96d0c9b8c9a1be9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336513:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdc72081/0x96d0c9b8c9a1be9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336542:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdc72081/0x96d0c9b8c9a1be9e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336563:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdc72081/0x96d0c9b8c9a1be9e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336592:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788201143.336597:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093363796/0x96d0c9b8c9a1bef9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336603:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fddc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.336605:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003efe90ca/0x96d0c9b8c9a1bef2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336607:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093363796/0x96d0c9b8c9a1bef9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.336615:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003efe90ca/0x96d0c9b8c9a1bef2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336616:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093363796/0x96d0c9b8c9a1bef9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336627:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093363796/0x96d0c9b8c9a1bef9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.336632:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788201143.336634:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093363796/0x96d0c9b8c9a1bef9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.336636:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b4a355e/0x96d0c9b8c9a1bf00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.336643:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdc000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201143.336645:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788201143.336646:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b4a355e/0x96d0c9b8c9a1bf00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336648:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e5843d8/0x96d0c9b8c9a1bf07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336654:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdd200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201143.336662:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e5843d8/0x96d0c9b8c9a1bf07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.336665:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b4a355e/0x96d0c9b8c9a1bf00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336671:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e5843d8/0x96d0c9b8c9a1bf07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.336676:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b4a355e/0x96d0c9b8c9a1bf00 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336679:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e5843d8/0x96d0c9b8c9a1bf07 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.336683:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b4a355e/0x96d0c9b8c9a1bf00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336686:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e5843d8/0x96d0c9b8c9a1bf07 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.336696:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788201143.336697:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201143.336699:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec72f47e/0x96d0c9b8c9a1bf0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336701:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc7b5a1b/0x96d0c9b8c9a1bf15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.336705:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdc400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201143.336708:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdd600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.336709:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec72f47e/0x96d0c9b8c9a1bf0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336711:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc7b5a1b/0x96d0c9b8c9a1bf15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.336717:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec72f47e/0x96d0c9b8c9a1bf0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336718:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc7b5a1b/0x96d0c9b8c9a1bf15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.336726:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec72f47e/0x96d0c9b8c9a1bf0e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336727:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc7b5a1b/0x96d0c9b8c9a1bf15 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.336735:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec72f47e/0x96d0c9b8c9a1bf0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336735:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc7b5a1b/0x96d0c9b8c9a1bf15 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336750:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201143.336754:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b9c1e9e/0x96d0c9b8c9a1bf1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336760:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdc600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201143.336764:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b9c1e9e/0x96d0c9b8c9a1bf1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336771:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b9c1e9e/0x96d0c9b8c9a1bf1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336781:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b9c1e9e/0x96d0c9b8c9a1bf1c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336788:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b9c1e9e/0x96d0c9b8c9a1bf1c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336798:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.336800:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.336802:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.336817:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201143.336883:0:26214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00515e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:26214:1875060715193216:192.168.201.20@tcp:104: 00010000:00010000:3.0:1788201143.336910:0:26214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1be43 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867fb expref: 8 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.336937:0:26214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fc600, rc 0) 00000100:00100000:3.0:1788201143.336998:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120020a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:71108:x1875060695402112:12345-192.168.201.20@tcp:101:cp.0 Request processed in 46867us (61406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201143.337006:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5908 00002000:00010000:3.0:1788201143.338544:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x342:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.338554:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cd1f907/0x96d0c9b8c9a1bf23 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.338568:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x342:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.338574:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x342:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.338580:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cd1f907/0x96d0c9b8c9a1bf23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.338593:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cd1f907/0x96d0c9b8c9a1bf23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.338602:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cd1f907/0x96d0c9b8c9a1bf23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.338609:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cd1f907/0x96d0c9b8c9a1bf23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.338629:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201143.338699:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201143.338703:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cd1f907/0x96d0c9b8c9a1bf23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.338711:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075ee400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.338715:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cd1f907/0x96d0c9b8c9a1bf23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.338724:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cd1f907/0x96d0c9b8c9a1bf23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.338860:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cd1f907/0x96d0c9b8c9a1bf23 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.338869:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cd1f907/0x96d0c9b8c9a1bf23 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.338883:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201143.338885:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201143.338886:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201143.338895:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201143.339248:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695402240 00000100:00100000:1.0:1788201143.339258:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695402240 00010000:00010000:1.0:1788201143.339290:0:26213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1be3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867f4 expref: 8 pid: 26204 timeout: 4094 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201143.339338:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2560 00000100:00100000:1.0:1788201143.339348:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2401:x1875060695402240:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201143.339362:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00080000:3.0:1788201143.341119:0:26205:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:803 00000100:00100000:3.0:1788201143.341212:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:92565:x1875060715193088:12345-0@lo:5:osp-pre-1-0.0 Request processed in 50791us (65519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201143.341231:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5909 00010000:00010000:3.0:1788201143.341267:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201143.343189:0:26213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1be3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867f4 expref: 8 pid: 26204 timeout: 4094 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.343215:0:26213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1be3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867f4 expref: 8 pid: 26204 timeout: 4094 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.343242:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ec825a2/0x96d0c9b8c9a1be3c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867f4 expref: 8 pid: 26204 timeout: 4094 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.343260:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x602:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201143.343265:0:26213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x602:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201143.343273:0:26213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1be43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867fb expref: 7 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.343283:0:26213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1be43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867fb expref: 7 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.343333:0:26213:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1be43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867fb expref: 7 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201143.343348:0:26213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140d90700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:26213:1875060715193344:192.168.201.20@tcp:105: 00000100:00100000:1.0:1788201143.343471:0:26213:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f4e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201143.343534:0:92565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92565:1875060715193088:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788201143.343665:0:92565:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x361:0x0] from OST, last_created [0x2c0000401:0x361:0x0]last_used is [0x2c0000401:0x323:0x0] 00000100:00100000:1.0:1788201143.343724:0:92565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92565:1875060715193600:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788201143.343766:0:92565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201143.343790:0:92565:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f4ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201143.343805:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715193472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201143.343830:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201143.343871:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715193600 00000100:00100000:1.0:1788201143.343878:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715193600 00000100:00100000:1.0:1788201143.343917:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5911 00000100:00100000:1.0:1788201143.343926:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:92565:x1875060715193600:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788201143.343970:0:26200:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 866 00000100:00100000:3.0:1788201143.347158:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201143.347197:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695402496 00000100:00100000:3.0:1788201143.347217:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695402496 00000100:00100000:3.0:1788201143.347259:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 232 00000100:00100000:3.0:1788201143.347267:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:71108:x1875060695402496:12345-192.168.201.20@tcp:35:cp.0 00000100:00100000:1.0:1788201143.349688:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:92565:x1875060715193600:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5755us (5913us total) trans 4294969454 rc 0/0 00000100:00100000:1.0:1788201143.349700:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5911 00000001:00080000:3.0:1788201143.349730:0:66315:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 77309411447 00000100:00100000:1.0:1788201143.349792:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715193472 00000100:00100000:1.0:1788201143.349800:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715193472 00000100:00100000:3.0:1788201143.349838:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:71108:x1875060695402496:12345-192.168.201.20@tcp:35:cp.0 Request processed in 2557us (2673us total) trans 77309411448 rc 0/0 00000100:00100000:1.0:1788201143.349840:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2282 00000100:00100000:3.0:1788201143.349847:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 232 00000100:00100000:1.0:1788201143.349848:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715193472:12345-0@lo:13:osp-pre-1-0.0 00000020:00080000:3.0:1788201143.349851:0:66315:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00002000:00000024:1.0:1788201143.349865:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201143.349900:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715193472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (6070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201143.349906:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2282 00000100:00100000:1.0:1788201143.349950:0:92565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92565:1875060715193600:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788201143.349983:0:92565:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x361:0x0]-[0x2c0000401:0x381:0x0] 00000100:00100000:1.0:1788201143.350035:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715193472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201143.350076:0:26213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140d90700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:26213:1875060715193344:192.168.201.20@tcp:105: 00010000:00010000:1.0:1788201143.350718:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201143.350758:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695402240:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 11412us (23136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201143.350767:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2560 00002000:00010000:3.0:1788201143.365110:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x361:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.365125:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000229b8961/0x96d0c9b8c9a1bf2a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365142:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x361:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.365147:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x361:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.365152:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000229b8961/0x96d0c9b8c9a1bf2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365166:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000229b8961/0x96d0c9b8c9a1bf2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365176:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000229b8961/0x96d0c9b8c9a1bf2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365204:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000229b8961/0x96d0c9b8c9a1bf2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365229:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201143.365354:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x360:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.365359:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc91a631/0x96d0c9b8c9a1bf31 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365367:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x360:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.365370:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x360:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.365374:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc91a631/0x96d0c9b8c9a1bf31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365383:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc91a631/0x96d0c9b8c9a1bf31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365391:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc91a631/0x96d0c9b8c9a1bf31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365398:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc91a631/0x96d0c9b8c9a1bf31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365413:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788201143.365450:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.365455:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063bd24ac/0x96d0c9b8c9a1bf38 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365469:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35f:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.365472:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.365476:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063bd24ac/0x96d0c9b8c9a1bf38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365485:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063bd24ac/0x96d0c9b8c9a1bf38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365492:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063bd24ac/0x96d0c9b8c9a1bf38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365500:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063bd24ac/0x96d0c9b8c9a1bf38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365513:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788201143.365566:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.365571:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3b8d3e/0x96d0c9b8c9a1bf3f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365578:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35e:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.365581:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.365585:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b3b8d3e/0x96d0c9b8c9a1bf3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365593:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b3b8d3e/0x96d0c9b8c9a1bf3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365612:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3b8d3e/0x96d0c9b8c9a1bf3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365618:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b3b8d3e/0x96d0c9b8c9a1bf3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365633:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788201143.365644:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788201143.365649:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000229b8961/0x96d0c9b8c9a1bf2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365657:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075efe00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201143.365661:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000229b8961/0x96d0c9b8c9a1bf2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365669:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000229b8961/0x96d0c9b8c9a1bf2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365686:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000229b8961/0x96d0c9b8c9a1bf2a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365693:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000229b8961/0x96d0c9b8c9a1bf2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365713:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788201143.365723:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc91a631/0x96d0c9b8c9a1bf31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365729:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075ef400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201143.365732:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc91a631/0x96d0c9b8c9a1bf31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365738:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc91a631/0x96d0c9b8c9a1bf31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365749:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc91a631/0x96d0c9b8c9a1bf31 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365755:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc91a631/0x96d0c9b8c9a1bf31 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365766:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201143.365769:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063bd24ac/0x96d0c9b8c9a1bf38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365774:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075efa00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201143.365777:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063bd24ac/0x96d0c9b8c9a1bf38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365783:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063bd24ac/0x96d0c9b8c9a1bf38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365802:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063bd24ac/0x96d0c9b8c9a1bf38 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365809:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063bd24ac/0x96d0c9b8c9a1bf38 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365821:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201143.365824:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b3b8d3e/0x96d0c9b8c9a1bf3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365829:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075efc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201143.365832:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3b8d3e/0x96d0c9b8c9a1bf3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365840:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3b8d3e/0x96d0c9b8c9a1bf3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365849:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b3b8d3e/0x96d0c9b8c9a1bf3f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365856:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b3b8d3e/0x96d0c9b8c9a1bf3f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365865:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.365867:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.365874:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201143.365917:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.365923:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e91f28e3/0x96d0c9b8c9a1bf46 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365931:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35d:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.365934:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.365938:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e91f28e3/0x96d0c9b8c9a1bf46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365946:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e91f28e3/0x96d0c9b8c9a1bf46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365953:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e91f28e3/0x96d0c9b8c9a1bf46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365960:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e91f28e3/0x96d0c9b8c9a1bf46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365972:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201143.365977:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201143.365980:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e91f28e3/0x96d0c9b8c9a1bf46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.365987:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075ef800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201143.365990:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e91f28e3/0x96d0c9b8c9a1bf46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366008:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e91f28e3/0x96d0c9b8c9a1bf46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366041:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e91f28e3/0x96d0c9b8c9a1bf46 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366049:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e91f28e3/0x96d0c9b8c9a1bf46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366061:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.366063:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.366064:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201143.366103:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.366108:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068ebde1a/0x96d0c9b8c9a1bf4d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366116:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35c:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.366119:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.366123:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068ebde1a/0x96d0c9b8c9a1bf4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366131:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068ebde1a/0x96d0c9b8c9a1bf4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366140:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068ebde1a/0x96d0c9b8c9a1bf4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366152:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068ebde1a/0x96d0c9b8c9a1bf4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366164:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201143.366171:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201143.366174:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068ebde1a/0x96d0c9b8c9a1bf4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366180:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075ee200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201143.366183:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068ebde1a/0x96d0c9b8c9a1bf4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366190:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068ebde1a/0x96d0c9b8c9a1bf4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366202:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068ebde1a/0x96d0c9b8c9a1bf4d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366208:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068ebde1a/0x96d0c9b8c9a1bf4d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366221:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.366223:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.366224:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201143.366265:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.366275:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9f8f773/0x96d0c9b8c9a1bf54 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366283:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35b:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.366286:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.366290:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9f8f773/0x96d0c9b8c9a1bf54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366299:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9f8f773/0x96d0c9b8c9a1bf54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366306:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9f8f773/0x96d0c9b8c9a1bf54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366313:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9f8f773/0x96d0c9b8c9a1bf54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366324:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201143.366331:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201143.366333:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9f8f773/0x96d0c9b8c9a1bf54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366339:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075ef000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201143.366342:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9f8f773/0x96d0c9b8c9a1bf54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366348:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9f8f773/0x96d0c9b8c9a1bf54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366363:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9f8f773/0x96d0c9b8c9a1bf54 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366369:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9f8f773/0x96d0c9b8c9a1bf54 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366382:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.366383:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.366385:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201143.366428:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.366433:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a2b4130/0x96d0c9b8c9a1bf5b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366441:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35a:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.366445:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.366449:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a2b4130/0x96d0c9b8c9a1bf5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366457:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a2b4130/0x96d0c9b8c9a1bf5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366465:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a2b4130/0x96d0c9b8c9a1bf5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366471:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a2b4130/0x96d0c9b8c9a1bf5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366492:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201143.366498:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201143.366501:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a2b4130/0x96d0c9b8c9a1bf5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366507:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075ee600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201143.366510:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a2b4130/0x96d0c9b8c9a1bf5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366516:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a2b4130/0x96d0c9b8c9a1bf5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366538:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a2b4130/0x96d0c9b8c9a1bf5b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366546:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a2b4130/0x96d0c9b8c9a1bf5b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366558:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.366560:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.366561:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201143.366601:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x359:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.366607:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d770280/0x96d0c9b8c9a1bf62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366614:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x359:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.366622:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x359:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.366627:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d770280/0x96d0c9b8c9a1bf62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366635:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d770280/0x96d0c9b8c9a1bf62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366643:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d770280/0x96d0c9b8c9a1bf62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366650:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d770280/0x96d0c9b8c9a1bf62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366663:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201143.366669:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201143.366673:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d770280/0x96d0c9b8c9a1bf62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366679:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075ee000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201143.366682:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d770280/0x96d0c9b8c9a1bf62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366690:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d770280/0x96d0c9b8c9a1bf62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366700:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d770280/0x96d0c9b8c9a1bf62 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366717:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d770280/0x96d0c9b8c9a1bf62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366730:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.366732:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.366734:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201143.366773:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x358:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.366778:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a1bf69 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366786:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x358:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.366789:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x358:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.366793:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a1bf69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366801:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a1bf69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366807:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a1bf69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366814:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a1bf69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366825:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201143.366837:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201143.366840:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a1bf69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366847:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075ef600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201143.366850:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a1bf69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366857:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a1bf69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366868:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a1bf69 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366875:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a1bf69 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366888:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.366890:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.366892:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201143.366931:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x357:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.366936:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1bf70 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366943:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x357:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.366945:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x357:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.366949:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1bf70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366966:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1bf70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366973:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1bf70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366979:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1bf70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.366989:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201143.366994:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201143.366997:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1bf70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367003:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075eee00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201143.367006:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1bf70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367013:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1bf70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367041:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1bf70 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367047:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1bf70 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367064:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.367066:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.367067:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201143.367109:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x356:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.367114:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1bf77 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367121:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x356:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.367125:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x356:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.367128:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1bf77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367137:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1bf77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367145:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1bf77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367152:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1bf77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367163:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201143.367169:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201143.367172:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1bf77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367188:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075ee800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201143.367192:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1bf77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367199:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1bf77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367209:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1bf77 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367216:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1bf77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367227:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.367229:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.367230:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201143.367268:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x355:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.367273:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1bf7e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367280:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x355:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.367283:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x355:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.367287:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1bf7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367296:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1bf7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367309:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1bf7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367316:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1bf7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367327:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201143.367332:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201143.367335:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1bf7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367341:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075eea00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201143.367343:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1bf7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367350:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1bf7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367359:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1bf7e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367365:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1bf7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367375:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.367381:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.367383:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201143.367423:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x354:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.367428:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e751138/0x96d0c9b8c9a1bf85 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367436:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x354:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.367439:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x354:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.367443:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e751138/0x96d0c9b8c9a1bf85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367451:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e751138/0x96d0c9b8c9a1bf85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367458:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e751138/0x96d0c9b8c9a1bf85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367465:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e751138/0x96d0c9b8c9a1bf85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367476:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201143.367482:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201143.367486:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.367486:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e751138/0x96d0c9b8c9a1bf85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.367492:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.367493:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075ef200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201143.367496:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e751138/0x96d0c9b8c9a1bf85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.367497:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.367512:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e751138/0x96d0c9b8c9a1bf85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367538:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e751138/0x96d0c9b8c9a1bf85 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367547:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e751138/0x96d0c9b8c9a1bf85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367559:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.367561:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.367562:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201143.367603:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x353:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.367608:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095712262/0x96d0c9b8c9a1bf8c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367615:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x353:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.367618:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x353:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.367622:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095712262/0x96d0c9b8c9a1bf8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367630:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095712262/0x96d0c9b8c9a1bf8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367637:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095712262/0x96d0c9b8c9a1bf8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367650:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095712262/0x96d0c9b8c9a1bf8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367672:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201143.367710:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x352:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.367715:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0453d66/0x96d0c9b8c9a1bf93 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367722:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x352:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.367725:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x352:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.367729:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0453d66/0x96d0c9b8c9a1bf93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367738:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0453d66/0x96d0c9b8c9a1bf93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367746:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0453d66/0x96d0c9b8c9a1bf93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367753:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0453d66/0x96d0c9b8c9a1bf93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367764:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788201143.367800:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x351:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.367805:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e7699c6/0x96d0c9b8c9a1bf9a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.367816:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201143.367819:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x351:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:1.0:1788201143.367821:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095712262/0x96d0c9b8c9a1bf8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367821:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x351:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.367826:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e7699c6/0x96d0c9b8c9a1bf9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.367829:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075eec00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.367832:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095712262/0x96d0c9b8c9a1bf8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367835:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e7699c6/0x96d0c9b8c9a1bf9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.367841:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095712262/0x96d0c9b8c9a1bf8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367843:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e7699c6/0x96d0c9b8c9a1bf9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367850:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e7699c6/0x96d0c9b8c9a1bf9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.367853:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095712262/0x96d0c9b8c9a1bf8c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.367860:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095712262/0x96d0c9b8c9a1bf8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367863:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788201143.367886:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201143.367889:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0453d66/0x96d0c9b8c9a1bf93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.367895:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc004fdca00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.367898:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0453d66/0x96d0c9b8c9a1bf93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201143.367898:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x350:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.367902:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094a83153/0x96d0c9b8c9a1bfa1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367910:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x350:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.367913:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x350:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.367917:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094a83153/0x96d0c9b8c9a1bfa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.367919:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0453d66/0x96d0c9b8c9a1bf93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367926:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094a83153/0x96d0c9b8c9a1bfa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.367930:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0453d66/0x96d0c9b8c9a1bf93 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.367936:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0453d66/0x96d0c9b8c9a1bf93 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367945:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094a83153/0x96d0c9b8c9a1bfa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.367949:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201143.367952:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094a83153/0x96d0c9b8c9a1bfa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.367953:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e7699c6/0x96d0c9b8c9a1bf9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.367960:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.367963:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e7699c6/0x96d0c9b8c9a1bf9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367964:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201143.367971:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201143.367974:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094a83153/0x96d0c9b8c9a1bfa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.367980:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e7699c6/0x96d0c9b8c9a1bf9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367981:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201143.367985:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094a83153/0x96d0c9b8c9a1bfa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.367991:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e7699c6/0x96d0c9b8c9a1bf9a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.367992:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094a83153/0x96d0c9b8c9a1bfa1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.367998:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e7699c6/0x96d0c9b8c9a1bf9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.368003:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094a83153/0x96d0c9b8c9a1bfa1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.368009:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.368009:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094a83153/0x96d0c9b8c9a1bfa1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.368010:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201143.368012:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201143.368030:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201143.368033:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.368038:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.368044:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.368046:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201143.368089:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.368094:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1bfa8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.368101:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34f:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.368104:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201143.368107:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1bfa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.368115:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1bfa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.368122:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1bfa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.368128:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1bfa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.368148:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201143.368182:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201143.368187:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e9efc76/0x96d0c9b8c9a1bfaf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.368195:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34e:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:3.0:1788201143.368198:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201143.368199:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201143.368201:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e9efc76/0x96d0c9b8c9a1bfaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.368203:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1bfa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.368209:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.368212:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1bfa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.368221:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1bfa8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.368231:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1bfa8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.368244:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1bfa8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.368256:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201143.368257:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201143.368258:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.375199:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e9efc76/0x96d0c9b8c9a1bfaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.377531:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e9efc76/0x96d0c9b8c9a1bfaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.377543:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e9efc76/0x96d0c9b8c9a1bfaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.378138:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201143.378218:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201143.378227:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e9efc76/0x96d0c9b8c9a1bfaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.378238:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.378244:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e9efc76/0x96d0c9b8c9a1bfaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.378252:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e9efc76/0x96d0c9b8c9a1bfaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.378274:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e9efc76/0x96d0c9b8c9a1bfaf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.378281:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e9efc76/0x96d0c9b8c9a1bfaf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.378305:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201143.378307:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201143.378324:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201143.378680:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201143.378688:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1bfb6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.378701:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34d:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:2.0:1788201143.378705:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201143.378711:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1bfb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.378722:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1bfb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.378731:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1bfb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.378739:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1bfb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.378759:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201143.378801:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201143.378806:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1bfbd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.378835:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34c:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:2.0:1788201143.378838:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201143.378842:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1bfbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.378851:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1bfbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.378860:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1bfbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.378866:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1bfbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.378874:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201143.378881:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201143.379504:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201143.379509:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1bfc4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.379529:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34b:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:2.0:1788201143.379532:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201143.379537:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1bfc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.379545:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1bfc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.379564:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1bfc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.379570:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1bfc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.385606:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1bfb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.385626:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.385631:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1bfb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.385643:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1bfb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.385664:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1bfb6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.385672:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1bfb6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.385690:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201143.385694:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1bfbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.385700:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adee00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.385704:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1bfbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.385711:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1bfbd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.385732:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1bfbd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.385739:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1bfbd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.385750:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201143.385753:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1bfc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.385759:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfe00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.385762:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1bfc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.385770:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1bfc4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.385777:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1bfc4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.385783:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201143.385785:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201143.385788:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.389507:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201143.393543:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201143.393560:0:26208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1bfc4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201143.393695:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201143.393702:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1bfcb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.393714:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34a:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:2.0:1788201143.393718:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201143.393724:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1bfcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.393737:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1bfcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.393747:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1bfcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.393767:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1bfcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.394479:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201143.394546:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x349:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201143.394552:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1bfd2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.394563:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x349:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:2.0:1788201143.394567:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x349:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201143.394571:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1bfd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.394581:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1bfd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.394587:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1bfd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.394593:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1bfd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201143.397179:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201143.397195:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1bfcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201143.397209:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adea00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201143.397214:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1bfcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201143.397225:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1bfcb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201143.397247:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1bfcb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201143.397255:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1bfcb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.398358:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201143.398368:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1bfd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.398447:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201143.398451:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1bfd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.398461:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1bfd2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.398688:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1bfd2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201143.398701:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201143.398702:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201143.398704:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201143.399406:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201143.399407:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201143.399410:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201143.401871:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201143.401886:0:26208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1bfd2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201143.402063:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x348:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201143.402069:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1bfd9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.402082:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x348:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:2.0:1788201143.402087:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x348:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201143.402093:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1bfd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.402106:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1bfd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.402115:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1bfd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.402122:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1bfd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.402139:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201143.402179:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x347:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201143.402184:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1bfe0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.402192:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x347:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:2.0:1788201143.402195:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x347:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201143.402204:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1bfe0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.402214:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1bfe0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.402221:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1bfe0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.402228:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1bfe0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.402240:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788201143.402273:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x346:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201143.402277:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1bfe7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.402427:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201143.402435:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1bfd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.402443:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201143.402449:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1bfd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.402458:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1bfd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.402476:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1bfd9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.402484:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1bfd9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.402506:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201143.402509:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1bfe0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.402515:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201143.402528:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1bfe0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.402537:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1bfe0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.402547:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1bfe0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.402554:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1bfe0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201143.402564:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.402566:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201143.402567:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201143.403290:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x346:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:2.0:1788201143.403294:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x346:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201143.403299:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1bfe7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403311:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1bfe7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403319:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1bfe7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403338:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1bfe7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403364:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201143.403427:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x345:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201143.403433:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1bfee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403441:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x345:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:2.0:1788201143.403444:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x345:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201143.403447:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1bfee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403456:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1bfee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403463:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1bfee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403470:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1bfee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403486:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788201143.403495:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201143.403499:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1bfe7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403511:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201143.403515:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1bfe7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403532:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1bfe7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403544:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1bfe7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403552:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1bfe7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403567:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201143.403570:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1bfee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403576:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201143.403579:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1bfee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403587:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1bfee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403596:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1bfee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403609:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1bfee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403621:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201143.403623:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201143.403625:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201143.403663:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x344:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201143.403668:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1bff5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403676:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x344:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:2.0:1788201143.403679:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x344:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201143.403683:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1bff5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403692:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1bff5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403699:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1bff5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403706:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1bff5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403717:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201143.403727:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201143.403730:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1bff5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403737:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201143.403740:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1bff5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403747:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1bff5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403758:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1bff5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403764:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1bff5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403776:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201143.403778:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201143.403780:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201143.403818:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x343:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201143.403824:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1bffc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403843:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x343:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:2.0:1788201143.403846:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x343:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201143.403850:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1bffc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403869:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1bffc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403877:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1bffc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403884:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1bffc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403895:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201143.403900:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201143.403903:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1bffc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403909:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201143.403912:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1bffc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403919:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1bffc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403928:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1bffc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403935:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1bffc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.403953:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201143.403955:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201143.403957:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201143.403996:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x342:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201143.404001:0:26208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1c003 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.404008:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x342:0x0].0x0 since=3994s v=(0 0) 00010000:00010000:2.0:1788201143.404011:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x342:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201143.404045:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1c003 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.404055:0:26208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1c003 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.404062:0:26208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1c003 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.404069:0:26208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1c003 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.404080:0:26208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201143.404087:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201143.404090:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1c003 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.404107:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201143.404110:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1c003 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.404118:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1c003 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.404128:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1c003 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.404135:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1c003 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201143.404147:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201143.404148:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201143.404150:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788201143.404393:0:26208:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:802 00000100:00100000:2.0:1788201143.404482:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:92563:x1875060715192960:12345-0@lo:5:osp-pre-0-0.0 Request processed in 102524us (102752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201143.404492:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5910 00010000:00010000:3.0:1788201143.404700:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201143.410991:0:92563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058ab100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92563:1875060715192960:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788201143.411011:0:92563:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x361:0x0] from OST, last_created [0x280000401:0x361:0x0]last_used is [0x280000401:0x322:0x0] 00000100:00100000:1.0:1788201143.411125:0:92563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0073ba300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92563:1875060715193856:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788201143.411178:0:92563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201143.411204:0:92563:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f1f0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201143.411228:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715193856 00000100:00100000:1.0:1788201143.411234:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715193856 00000100:00100000:1.0:1788201143.411273:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5912 00000100:00100000:1.0:1788201143.411280:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:92563:x1875060715193856:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788201143.411320:0:8491:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 866 00000100:00100000:2.0:1788201143.411363:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0073b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715193728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201143.411401:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201143.418043:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:92563:x1875060715193856:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6753us (6855us total) trans 4294969455 rc 0/0 00000100:00100000:1.0:1788201143.418065:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5912 00000100:00100000:1.0:1788201143.418118:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715193728 00000100:00100000:1.0:1788201143.418126:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715193728 00000100:00100000:1.0:1788201143.418170:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2283 00000100:00100000:1.0:1788201143.418179:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715193728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201143.418203:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788201143.418248:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715193728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (6846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201143.418255:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2283 00010000:00010000:1.0:1788201143.418290:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201143.418296:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201143.418331:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0073b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715193728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201143.423095:0:92563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0073ba300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92563:1875060715193856:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788201143.423117:0:92563:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x361:0x0]-[0x280000401:0x381:0x0] 00000020:00000004:3.0:1788201143.597403:0:92881:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788201143.597760:0:92881:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788201144.079313:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788201144.545698:0:92931:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788201144.545966:0:92931:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788201144.751355:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201144.751518:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695402624 00000100:00100000:2.0:1788201144.751543:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695402624 00000100:00100000:2.0:1788201144.751605:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1363 00000100:00100000:2.0:1788201144.751615:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:71373:x1875060695402624:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:2.0:1788201144.751633:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201144.751655:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1c00a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786802 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201144.766728:0:66314:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 15025us 00010000:00010000:0.0:1788201144.806703:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1c011 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.806726:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1c011 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.806741:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1c011 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.806755:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c018 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.806762:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c018 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.806769:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c018 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201144.806909:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120021500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:66314:1875060715193984:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201144.806979:0:66314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201144.807012:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004e40f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201144.807103:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715193984 00000100:00100000:1.0:1788201144.807110:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715193984 00000100:00100000:1.0:1788201144.807155:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3995 00000100:00100000:1.0:1788201144.807164:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120020000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66314:x1875060715193984:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788201144.807241:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120020000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66314:x1875060715193984:12345-0@lo:1000:mdt00_002.0 Request processed in 78us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201144.807249:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3995 00000100:00100000:0.0:1788201144.807378:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120021500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:66314:1875060715193984:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788201144.807431:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c01f lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.807441:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c01f lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.807449:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c01f lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201144.807482:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c01f lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.807506:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1c011 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.807513:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1c011 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.807519:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1c011 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.807526:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1c011 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.807531:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201144.807535:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1c011 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.807542:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1c011 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.807553:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103141d00) 00010000:00010000:0.0:1788201144.807556:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201144.807565:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1c011 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.807572:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1c011 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.807584:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c018 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.807590:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c018 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.807596:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c018 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.807601:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782ca00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201144.807603:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c018 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.807609:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c018 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.807615:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff8dc0048be100) 00010000:00010000:0.0:1788201144.807617:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201144.807620:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c018 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.807625:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c018 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.807656:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1c00a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786802 expref: 9 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.807678:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c01f lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786802 expref: 8 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.807686:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc0048be700) 00010000:00010000:0.0:1788201144.807688:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201144.807690:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782d600, rc 0) 00000100:00100000:0.0:1788201144.807771:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:71373:x1875060695402624:12345-192.168.201.20@tcp:101:rm.0 Request processed in 56158us (56428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201144.807778:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1363 00000100:00100000:3.0:1788201144.810242:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201144.810510:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695402752 00000100:00100000:0.0:1788201144.810520:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695402752 00000100:00100000:0.0:1788201144.810581:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1364 00000100:00100000:0.0:1788201144.810591:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:71373:x1875060695402752:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1788201144.810613:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201144.810634:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1c026 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786809 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.810696:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c02d lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.810709:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c02d lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.810721:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c02d lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201144.810773:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xe:0x0]: returning size 4096 00000004:00200000:0.0:1788201144.810788:0:66313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1788201144.810826:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1c026 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786809 expref: 14 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.810848:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c02d lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786809 expref: 13 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.810858:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc12196ee00) 00010000:00010000:0.0:1788201144.810861:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788201144.810864:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782d400, rc 0) 00000100:00100000:0.0:1788201144.810919:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:71373:x1875060695402752:12345-192.168.201.20@tcp:101:rm.0 Request processed in 329us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201144.810926:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1364 00000100:00100000:1.0:1788201144.814384:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201144.814529:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695403008 00000100:00100000:0.0:1788201144.814540:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695403008 00000100:00100000:0.0:1788201144.814599:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1365 00000100:00100000:0.0:1788201144.814610:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:71373:x1875060695403008:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1788201144.814630:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201144.814655:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1c034 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786810 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201144.814756:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xe:0x0]: returning size 4096 00010000:00010000:0.0:1788201144.814877:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1c034 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786810 expref: 15 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.814890:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0048be900) 00010000:00010000:0.0:1788201144.814894:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201144.814912:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1c034 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786810 expref: 15 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.814932:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782c000, rc 0) 00000100:00100000:0.0:1788201144.814993:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:71373:x1875060695403008:12345-192.168.201.20@tcp:101:rm.0 Request processed in 384us (617us total) trans 77309411449 rc 301/301 00000100:00100000:0.0:1788201144.815000:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1365 00000100:00100000:3.0:1788201144.819847:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201144.820094:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695403136 00000100:00100000:1.0:1788201144.820105:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695403136 00000100:00100000:1.0:1788201144.820179:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 233 00000100:00100000:1.0:1788201144.820190:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107db7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:71373:x1875060695403136:12345-192.168.201.20@tcp:37:rm.0 00000100:00100000:1.0:1788201144.823934:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107db7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:71373:x1875060695403136:12345-192.168.201.20@tcp:37:rm.0 Request processed in 3736us (4086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201144.823947:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 233 00000100:00100000:2.0:1788201144.828149:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201144.828186:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695403392 00000100:00100000:3.0:1788201144.828196:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695403392 00000100:00100000:3.0:1788201144.828249:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 234 00000100:00100000:3.0:1788201144.828268:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:71373:x1875060695403392:12345-192.168.201.20@tcp:35:rm.0 00000100:00100000:3.0:1788201144.828507:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:71373:x1875060695403392:12345-192.168.201.20@tcp:35:rm.0 Request processed in 248us (367us total) trans 77309411450 rc 0/0 00000100:00100000:3.0:1788201144.828515:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 234 00000100:00100000:3.0:1788201144.831710:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201144.831805:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695403648 00000100:00100000:0.0:1788201144.831814:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695403648 00000100:00100000:0.0:1788201144.831865:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1366 00000100:00100000:0.0:1788201144.831874:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:71373:x1875060695403648:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1788201144.831895:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201144.831916:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1c042 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786817 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.832010:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c049 lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.832069:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c049 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.832080:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c049 lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201144.832092:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xe:0x0]: returning size 4096 00010000:00010000:0.0:1788201144.832190:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1c042 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786817 expref: 18 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.832214:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c049 lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786817 expref: 17 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.832235:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc12196ee00) 00010000:00010000:0.0:1788201144.832238:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788201144.832242:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782ca00, rc 0) 00000100:00100000:0.0:1788201144.832299:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+17:71373:x1875060695403648:12345-192.168.201.20@tcp:101:rm.0 Request processed in 426us (597us total) trans 77309411451 rc 0/0 00000100:00100000:0.0:1788201144.832306:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1366 00000100:00100000:0.0:1788201144.837465:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201144.837557:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695403776 00000100:00100000:1.0:1788201144.837568:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695403776 00000100:00100000:1.0:1788201144.837629:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1367 00000100:00100000:1.0:1788201144.837640:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120021500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+17:71373:x1875060695403776:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:1.0:1788201144.837667:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201144.837690:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1c057 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78681e expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201144.837756:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1c05e lrc: 3/1,0 mode: --/PR res: [0x2400061c1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201144.837770:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1c05e lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201144.837782:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1c05e lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201144.837842:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xf:0x0]: returning size 4096 00000004:00200000:1.0:1788201144.837847:0:69485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201144.837866:0:69485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1c05e lrc: 3/1,0 mode: PR/PR res: [0x2400061c1:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201144.837894:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1c057 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78681e expref: 19 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201144.837915:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1c05e lrc: 3/0,0 mode: PR/PR res: [0x2400061c1:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78681e expref: 18 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201144.837926:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xf:0x0].0x0 (ffff8dc12196ed00) 00010000:00010000:1.0:1788201144.837929:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201144.837945:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ec600, rc 0) 00000100:00100000:1.0:1788201144.838043:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120021500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+18:71373:x1875060695403776:12345-192.168.201.20@tcp:101:rm.0 Request processed in 376us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201144.838051:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1367 00000100:00100000:1.0:1788201144.841969:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201144.842088:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695404032 00000100:00100000:0.0:1788201144.842099:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695404032 00000100:00100000:0.0:1788201144.842166:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1368 00000100:00100000:0.0:1788201144.842178:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+18:71373:x1875060695404032:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1788201144.842200:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201144.842237:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1c065 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786825 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201144.842555:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xf:0x0]: returning size 4096 00010000:00010000:0.0:1788201144.842646:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1c065 lrc: 1/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786825 expref: 20 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.842660:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc12196ee00) 00010000:00010000:0.0:1788201144.842663:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201144.842668:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782cc00/0x96d0c9b8c9a1c065 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786825 expref: 20 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.842682:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782cc00, rc 0) 00000100:00100000:0.0:1788201144.842737:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+19:71373:x1875060695404032:12345-192.168.201.20@tcp:101:rm.0 Request processed in 562us (778us total) trans 77309411452 rc 301/301 00000100:00100000:0.0:1788201144.842758:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1368 00000100:00100000:2.0:1788201144.850669:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201144.850763:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695404160 00000100:00100000:1.0:1788201144.850772:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695404160 00000100:00100000:1.0:1788201144.850831:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 235 00000100:00100000:1.0:1788201144.850841:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+19:71373:x1875060695404160:12345-192.168.201.20@tcp:37:rm.0 00000100:00100000:1.0:1788201144.855923:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+19:71373:x1875060695404160:12345-192.168.201.20@tcp:37:rm.0 Request processed in 5074us (5253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201144.855937:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 235 00000100:00100000:2.0:1788201144.870155:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201144.870904:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695404416 00000100:00100000:1.0:1788201144.870917:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695404416 00000100:00100000:1.0:1788201144.870983:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 236 00000100:00100000:1.0:1788201144.870994:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+19:71373:x1875060695404416:12345-192.168.201.20@tcp:35:rm.0 00000100:00100000:1.0:1788201144.871603:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:71373:x1875060695404416:12345-192.168.201.20@tcp:35:rm.0 Request processed in 609us (1458us total) trans 77309411453 rc 0/0 00000100:00100000:1.0:1788201144.871612:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 236 00000100:00100000:2.0:1788201144.890475:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201144.890574:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695404672 00000100:00100000:3.0:1788201144.890585:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695404672 00000100:00100000:3.0:1788201144.890646:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1369 00000100:00100000:3.0:1788201144.890657:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:71373:x1875060695404672:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:3.0:1788201144.890682:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201144.890704:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1c073 lrc: 2/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78682c expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.890827:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c07a lrc: 3/1,0 mode: --/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.890841:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c07a lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.890853:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c07a lrc: 3/1,0 mode: CR/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201144.890863:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xf:0x0]: returning size 4096 00010000:00010000:3.0:1788201144.890967:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1c073 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78682c expref: 23 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.891005:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c07a lrc: 3/0,0 mode: CR/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78682c expref: 22 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.891064:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xf:0x0].0x0 (ffff8dc12196ed00) 00010000:00010000:3.0:1788201144.891067:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788201144.891071:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3400, rc 0) 00000100:00100000:3.0:1788201144.891132:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:71373:x1875060695404672:12345-192.168.201.20@tcp:101:rm.0 Request processed in 476us (667us total) trans 77309411454 rc 0/0 00000100:00100000:3.0:1788201144.891140:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1369 00000100:00100000:1.0:1788201144.895867:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201144.895967:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695404800 00000100:00100000:3.0:1788201144.895976:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695404800 00000100:00100000:3.0:1788201144.896071:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1370 00000100:00100000:3.0:1788201144.896081:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:71373:x1875060695404800:12345-192.168.201.20@tcp:41:rm.0 00000004:00000024:3.0:1788201144.896129:0:66312:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 7846010880 avail 7382966272 00000100:00100000:3.0:1788201144.896191:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:71373:x1875060695404800:12345-192.168.201.20@tcp:41:rm.0 Request processed in 111us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201144.896198:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1370 00000100:00100000:2.0:1788201144.899758:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201144.899871:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695405056 00000100:00100000:0.0:1788201144.899880:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695405056 00000100:00100000:0.0:1788201144.899940:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1371 00000100:00100000:0.0:1788201144.899950:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:71373:x1875060695405056:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:0.0:1788201144.900005:0:66757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788201144.900066:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1be27 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867ed expref: 22 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900088:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff8dc0048beb00) 00010000:00010000:0.0:1788201144.900104:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1c05e lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78681e expref: 21 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900116:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xf:0x0].0x0 (ffff8dc12196ed00) 00010000:00010000:0.0:1788201144.900120:0:66757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201144.900139:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c088 lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900152:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c088 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900162:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c088 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900172:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c600/0x96d0c9b8c9a1c08f lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900180:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c600/0x96d0c9b8c9a1c08f lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900201:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c600/0x96d0c9b8c9a1c08f lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900312:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c096 lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900331:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c096 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900339:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c096 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201144.900566:0:66757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x48:0x0].2, 64 off8320 00000004:00080000:0.0:1788201144.900576:0:66757:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3996372559313ns, next at 3997372557081ns, rc = 0 00010000:00010000:0.0:1788201144.900622:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c09d lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900631:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c09d lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900640:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c09d lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900647:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c09d lrc: 4/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900654:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c09d lrc: 4/0,1 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900661:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c09d lrc: 3/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900691:0:66757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201144.900709:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c096 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900715:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c096 lrc: 2/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900722:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c096 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900728:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782de00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201144.900732:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c096 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900740:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c096 lrc: 4/0,0 mode: EX/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900749:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff8dc0048be900) 00010000:00010000:0.0:1788201144.900752:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201144.900756:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c096 lrc: 2/0,0 mode: --/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900762:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c096 lrc: 0/0,0 mode: --/EX res: [0x2400088d5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900781:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c088 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900788:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c088 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900793:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c088 lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900805:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c088 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900811:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782da00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201144.900814:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c088 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900821:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c088 lrc: 5/0,0 mode: CW/CW res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900829:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xf:0x0].0x0 (ffff8dc12196ed00) 00010000:00010000:0.0:1788201144.900832:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201144.900835:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c088 lrc: 3/0,0 mode: --/CW res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900841:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c088 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201144.900852:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000088ee8dc6 reply state 00000000babe3225 transno 77309411455 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c600/0x96d0c9b8c9a1c08f lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900863:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c600/0x96d0c9b8c9a1c08f lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.900870:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xf:0x0].0xb1bed465 (ffff8dc005f4b400) 00010000:00010000:0.0:1788201144.900872:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201144.900875:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201144.900953:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:71373:x1875060695405056:12345-192.168.201.20@tcp:36:rm.0 Request processed in 1002us (1203us total) trans 77309411455 rc 0/0 00000100:00100000:0.0:1788201144.900961:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1371 00010000:00010000:1.0:1788201144.901130:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201144.901138:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c09d lrc: 2/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201144.901144:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201144.901148:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c09d lrc: 2/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201144.901166:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c09d lrc: 3/0,0 mode: PW/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201144.901176:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x1:0x0].0x0 (ffff8dc0048be900) 00010000:00010000:1.0:1788201144.901178:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201144.901181:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c09d lrc: 1/0,0 mode: --/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201144.901187:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c09d lrc: 0/0,0 mode: --/PW res: [0x2400088d5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201144.901200:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201144.901202:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201144.901204:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201144.905667:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201144.905740:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695405312 00000100:00100000:1.0:1788201144.905751:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695405312 00000100:00100000:1.0:1788201144.905814:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 237 00000100:00100000:1.0:1788201144.905824:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120022a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:71373:x1875060695405312:12345-192.168.201.20@tcp:35:rm.0 00000100:00100000:1.0:1788201144.906073:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120022a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+23:71373:x1875060695405312:12345-192.168.201.20@tcp:35:rm.0 Request processed in 250us (416us total) trans 77309411456 rc 0/0 00000100:00100000:1.0:1788201144.906081:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 237 00000100:00100000:2.0:1788201144.913467:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201144.913561:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695405568 00000100:00100000:0.0:1788201144.913571:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695405568 00000100:00100000:0.0:1788201144.913633:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1372 00000100:00100000:0.0:1788201144.913644:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+23:71373:x1875060695405568:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:0.0:1788201144.913707:0:69485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788201144.913734:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c07a lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78682c expref: 23 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.913758:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da6400/0x96d0c9b8c9a1bbb1 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xf:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867d8 expref: 22 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.913769:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xf:0x0].0x0 (ffff8dc12196ed00) 00010000:00010000:0.0:1788201144.913783:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c02d lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786809 expref: 21 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.913792:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc12196ee00) 00010000:00010000:0.0:1788201144.913795:0:69485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201144.913825:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c0a4 lrc: 3/0,1 mode: --/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.913838:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c0a4 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.913848:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c0a4 lrc: 3/0,1 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.913860:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c0ab lrc: 3/0,1 mode: --/PW res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.913884:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c0ab lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.913891:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c0ab lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.913976:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c0b2 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.913984:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c0b2 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.913990:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c0b2 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201144.914764:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xf:0x0]: returning size 4096 00010000:00010000:0.0:1788201144.914779:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c0b2 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.914788:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c0b2 lrc: 2/0,0 mode: EX/EX res: [0x2400061c1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.914845:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c0b2 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.914852:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201144.914857:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c0b2 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.914865:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c0b2 lrc: 4/0,0 mode: EX/EX res: [0x2400061c1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.914885:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xf:0x0].0x0 (ffff8dc0048be100) 00010000:00010000:0.0:1788201144.914888:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201144.914892:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c0b2 lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.914898:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c0b2 lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.914920:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c0a4 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.914927:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c0a4 lrc: 4/0,1 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.914932:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c0a4 lrc: 3/0,0 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.914937:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c0a4 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.914941:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782da00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201144.914944:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c0a4 lrc: 4/0,0 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.914950:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c0a4 lrc: 5/0,0 mode: CW/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.914957:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc12196ee00) 00010000:00010000:0.0:1788201144.914959:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201144.914962:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c0a4 lrc: 3/0,0 mode: --/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.914975:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c0a4 lrc: 0/0,0 mode: --/CW res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201144.914984:0:69485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb136e36 reply state 00000000a0ce5cc0 transno 77309411457 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c0ab lrc: 3/0,1 mode: PW/PW res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.914995:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c0ab lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.915001:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0xf7117594 (ffff8dc0048beb00) 00010000:00010000:0.0:1788201144.915003:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201144.915006:0:69485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201144.915825:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:71373:x1875060695405568:12345-192.168.201.20@tcp:36:rm.0 Request processed in 2178us (2361us total) trans 77309411457 rc 0/0 00000100:00100000:0.0:1788201144.915835:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1372 00000100:00100000:2.0:1788201144.921508:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201144.921557:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201144.921640:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695405952 00000100:00100000:1.0:1788201144.921650:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695405952 00000100:00100000:1.0:1788201144.921710:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 238 00000100:00100000:1.0:1788201144.921722:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:71373:x1875060695405952:12345-192.168.201.20@tcp:35:rm.0 00000100:00100000:1.0:1788201144.921969:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+23:71373:x1875060695405952:12345-192.168.201.20@tcp:35:rm.0 Request processed in 249us (484us total) trans 77309411458 rc 0/0 00000100:00100000:1.0:1788201144.921994:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 238 00000100:00100000:0.0:1788201144.922159:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695405696 00000100:00100000:0.0:1788201144.922164:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695405696 00000100:00100000:0.0:1788201144.922197:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 704 00000100:00100000:0.0:1788201144.922218:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2401:x1875060695405696:12345-192.168.201.20@tcp:103:rm.0 00010000:00010000:0.0:1788201144.922231:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201144.922266:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c01f lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786802 expref: 8 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.922284:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc0048be700) 00010000:00010000:0.0:1788201144.922294:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201144.922315:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695405696:12345-192.168.201.20@tcp:103:rm.0 Request processed in 111us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201144.922514:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 704 00000100:00100000:2.0:1788201144.931006:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201144.931120:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695406208 00000100:00100000:0.0:1788201144.931129:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695406208 00000100:00100000:0.0:1788201144.931176:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1373 00000100:00100000:0.0:1788201144.931185:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+23:71373:x1875060695406208:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:0.0:1788201144.931261:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788201144.931287:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c049 lrc: 0/0,0 mode: --/CR res: [0x2400061c1:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786817 expref: 23 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.931308:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc005da7a00/0x96d0c9b8c9a1bb95 lrc: 0/0,0 mode: --/PR res: [0x2400061c1:0xe:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867d1 expref: 22 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.931551:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc12196ee00) 00010000:00010000:0.0:1788201144.931562:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201144.931605:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c0b9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.931613:0:66314:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c0b9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.931624:0:66314:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c0b9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201144.931644:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120023480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715194112:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1788201144.931696:0:66314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201144.931735:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004e40600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201144.931797:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715194112 00000100:00100000:2.0:1788201144.931802:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715194112 00000100:00100000:2.0:1788201144.931841:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3996 00000100:00100000:2.0:1788201144.931849:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66314:x1875060715194112:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1788201144.931859:0:83817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201144.931872:0:83817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adec00/0x96d0c9b8c9a1c0c0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c0b9 expref: -99 pid: 83817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.931891:0:83817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1bdfd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867c3 expref: 6 pid: 92577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.931917:0:83817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adec00/0x96d0c9b8c9a1c0c0 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c0b9 expref: 9 pid: 83817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.931941:0:83817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1bdfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867c3 expref: 6 pid: 92577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.931953:0:83817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1bdfd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867c3 expref: 6 pid: 92577 timeout: 4096 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201144.931964:0:83817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:83817:1875060715194240:192.168.201.20@tcp:104: 00000100:00100000:2.0:1788201144.932056:0:83817:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc139bdfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201144.936887:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201144.936993:0:83817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:83817:1875060715194240:192.168.201.20@tcp:104: 00010000:00010000:2.0:1788201144.937061:0:83817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adec00/0x96d0c9b8c9a1c0c0 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c0b9 expref: 9 pid: 83817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.937076:0:83817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103141d00) 00010000:00010000:2.0:1788201144.937079:0:83817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201144.937083:0:83817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adec00/0x96d0c9b8c9a1c0c0 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c0b9 expref: 9 pid: 83817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.937094:0:83817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007adec00, rc 0) 00000100:00100000:2.0:1788201144.937151:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66314:x1875060715194112:12345-0@lo:101:mdt00_002.0 Request processed in 5303us (5455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201144.937160:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3996 00000100:00100000:1.0:1788201144.937291:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120023480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715194112:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1788201144.937310:0:66314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c0b9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c0c0 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201144.937596:0:66314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c0b9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c0c0 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201144.937808:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695406336 00000100:00100000:0.0:1788201144.937817:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695406336 00010000:00010000:0.0:1788201144.937857:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1bdfd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867c3 expref: 7 pid: 92577 timeout: 4096 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201144.937895:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2561 00000100:00100000:0.0:1788201144.937905:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695406336:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201144.937924:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201144.937931:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1bdfd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867c3 expref: 7 pid: 92577 timeout: 4096 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.937945:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1bdfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867c3 expref: 7 pid: 92577 timeout: 4096 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.937966:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1bdfd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867c3 expref: 7 pid: 92577 timeout: 4096 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.937981:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103141d00) 00010000:00010000:0.0:1788201144.937987:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adec00/0x96d0c9b8c9a1c0c0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c0b9 expref: 8 pid: 83817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.937998:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adec00/0x96d0c9b8c9a1c0c0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c0b9 expref: 8 pid: 83817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.938007:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adec00/0x96d0c9b8c9a1c0c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c0b9 expref: 8 pid: 83817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201144.938064:0:6518:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adec00/0x96d0c9b8c9a1c0c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c0b9 expref: 8 pid: 83817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201144.938088:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004c1c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6518:1875060715194368:0@lo:105: 00000100:00100000:0.0:1788201144.938128:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201144.938168:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004e40c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201144.938556:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715194368 00000100:00100000:3.0:1788201144.938561:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715194368 00000100:00100000:3.0:1788201144.938595:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788201144.938602:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6518:x1875060715194368:12345-0@lo:105: 00010000:00010000:3.0:1788201144.938612:0:19665:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c0b9 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c0c0 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.938632:0:19665:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c0b9 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c0c0 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.938641:0:19665:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c0b9 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c0c0 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.938649:0:19665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c0b9 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x96d0c9b8c9a1c0c0 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.938656:0:19665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c0b9 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x96d0c9b8c9a1c0c0 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.938665:0:19665:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c0b9 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x96d0c9b8c9a1c0c0 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.938686:0:19665:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8dc00782d600) 00000100:00100000:3.0:1788201144.938724:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6518:x1875060715194368:12345-0@lo:105: Request processed in 123us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201144.938730:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00010000:00010000:1.0:1788201144.938823:0:66314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c0b9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c0c0 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201144.938833:0:66314:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c0b9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c0c0 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201144.938854:0:66314:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1788201144.938886:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064ec800/0x96d0c9b8c9a1c0c7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201144.938893:0:66314:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064ec800/0x96d0c9b8c9a1c0c7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201144.938903:0:66314:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064ec800/0x96d0c9b8c9a1c0c7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201144.938917:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120023480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715194496:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1788201144.938944:0:66314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201144.938969:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1060ca000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201144.939046:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715194496 00000100:00100000:2.0:1788201144.939056:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715194496 00000100:00100000:2.0:1788201144.939085:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3997 00000100:00100000:2.0:1788201144.939092:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66314:x1875060715194496:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1788201144.939106:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201144.939118:0:8458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1c0ce lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c0c7 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.939135:0:8458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1c0ce lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c0c7 expref: 10 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.939148:0:8458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1c0ce lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c0c7 expref: 10 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.939156:0:8458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff8dc12196e500) 00010000:00010000:2.0:1788201144.939158:0:8458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201144.939161:0:8458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007adfa00, rc 0) 00000100:00100000:2.0:1788201144.939188:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66314:x1875060715194496:12345-0@lo:101:mdt00_002.0 Request processed in 96us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201144.939193:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3997 00000100:00100000:1.0:1788201144.939573:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120023480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715194496:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1788201144.939593:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064ec800/0x96d0c9b8c9a1c0c7 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c0ce expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201144.939602:0:66314:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064ec800/0x96d0c9b8c9a1c0c7 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c0ce expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201144.939617:0:66314:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1788201144.939649:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140d90380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715194624:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788201144.939680:0:66314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201144.939708:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1060ca180 going to sleep for 11 seconds 00000100:00100000:3.0:1788201144.939780:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715194624 00000100:00100000:3.0:1788201144.939785:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715194624 00000100:00100000:3.0:1788201144.939830:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3998 00000100:00100000:3.0:1788201144.939837:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120023480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66314:x1875060715194624:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788201144.939899:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120023480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66314:x1875060715194624:12345-0@lo:1000:mdt00_002.0 Request processed in 62us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201144.939905:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3998 00000100:00100000:1.0:1788201144.940054:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140d90380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715194624:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788201144.940095:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc140d90380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715194752:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788201144.940119:0:66314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201144.940133:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc104e143c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201144.940187:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715194752 00000100:00100000:3.0:1788201144.940192:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715194752 00000100:00100000:3.0:1788201144.940573:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3999 00000100:00100000:3.0:1788201144.940581:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66314:x1875060715194752:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788201144.940661:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66314:x1875060715194752:12345-0@lo:1000:mdt00_002.0 Request processed in 81us (540us total) trans 0 rc 1/1 00000100:00100000:3.0:1788201144.940668:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3999 00000100:00100000:0.0:1788201144.940842:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004c1c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6518:1875060715194368:0@lo:105: 00010000:00010000:0.0:1788201144.940858:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201144.940909:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695406336:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 3003us (4029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201144.940917:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2561 00000100:00100000:1.0:1788201144.941597:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc140d90380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715194752:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788201144.941647:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064eca00/0x96d0c9b8c9a1c0d5 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201144.941656:0:66314:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064eca00/0x96d0c9b8c9a1c0d5 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201144.941665:0:66314:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064eca00/0x96d0c9b8c9a1c0d5 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201144.941677:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00388ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715194880:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1788201144.941704:0:66314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201144.941728:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc104e14e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201144.941777:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715194880 00000100:00100000:2.0:1788201144.941782:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715194880 00000100:00100000:2.0:1788201144.941820:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4000 00000100:00100000:2.0:1788201144.941827:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66314:x1875060715194880:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1788201144.941837:0:83817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201144.941851:0:83817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1c0dc lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c0d5 expref: -99 pid: 83817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.941870:0:83817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1c0dc lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c0d5 expref: 11 pid: 83817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.941890:0:83817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1c0dc lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c0d5 expref: 11 pid: 83817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.941899:0:83817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc12196e800) 00010000:00010000:2.0:1788201144.941901:0:83817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201144.941904:0:83817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007adfe00, rc 0) 00000100:00100000:2.0:1788201144.941939:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66314:x1875060715194880:12345-0@lo:101:mdt00_002.0 Request processed in 112us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201144.941944:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4000 00000100:00100000:1.0:1788201144.942046:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00388ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715194880:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1788201144.942063:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064eca00/0x96d0c9b8c9a1c0d5 lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c0dc expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201144.942074:0:66314:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064eca00/0x96d0c9b8c9a1c0d5 lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c0dc expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201144.942095:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1c0e3 lrc: 3/0,1 mode: --/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201144.942103:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1c0e3 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201144.942111:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1c0e3 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201144.942755:0:66314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x1:0x0].7, 432 off42304 00000040:00080000:1.0:1788201144.942795:0:66314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x1:0x0].6, 512 off41016 00000004:00080000:1.0:1788201144.942859:0:66314:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc104e14e40 with version 18 00000004:00080000:2.0:1788201144.942959:0:75745:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc007566d80 version 18 rpc_version 18 00000020:00100000:2.0:1788201144.942980:0:75745:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788201144.942987:0:75745:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc00a9b5880 x1875060715195136/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1760/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201144.943003:0:75745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715195136:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788201144.943065:0:75745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201144.943090:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc139bdfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201144.943169:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715195136 00000100:00100000:3.0:1788201144.943175:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715195136 00000100:00100000:3.0:1788201144.943215:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4001 00000100:00100000:3.0:1788201144.943222:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:75745:x1875060715195136:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788201144.953237:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:75745:x1875060715195136:12345-0@lo:1000:osp_up0-1.0 Request processed in 10006us (10163us total) trans 120259084290 rc 0/0 00000100:00100000:0.0:1788201144.953552:0:75745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b5880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715195136:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788201144.953601:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4001 00000004:00200000:3.0:1788201144.954922:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400061c1:0xe:0x0]: returning size 4096 00010000:00010000:3.0:1788201144.954948:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1c0e3 lrc: 3/0,1 mode: EX/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.954959:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1c0e3 lrc: 2/0,0 mode: EX/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.954968:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1c0e3 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.954974:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201144.954978:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1c0e3 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.954986:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1c0e3 lrc: 4/0,0 mode: EX/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.955002:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc005f4ba00) 00010000:00010000:3.0:1788201144.955006:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201144.955064:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1c0e3 lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.955072:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1c0e3 lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.955096:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064eca00/0x96d0c9b8c9a1c0d5 lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c0dc expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.955104:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064eca00/0x96d0c9b8c9a1c0d5 lrc: 4/0,1 mode: EX/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1c0dc expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.955112:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064eca00/0x96d0c9b8c9a1c0d5 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1c0dc expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.955136:0:66314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1788201144.955149:0:66314:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1788201144.955155:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c0b9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c0c0 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.955162:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c0b9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1c0c0 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.955169:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c0b9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1c0c0 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.955186:0:66314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1788201144.955190:0:66314:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1788201144.955195:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064ec800/0x96d0c9b8c9a1c0c7 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c0ce expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.955223:0:66314:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064ec800/0x96d0c9b8c9a1c0c7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c0ce expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201144.955471:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:71373:x1875060695406208:12345-192.168.201.20@tcp:36:rm.0 Request processed in 24283us (24469us total) trans 77309411459 rc 0/0 00000100:00100000:3.0:1788201144.955480:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1373 00010000:00010000:2.0:1788201144.955943:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201144.955950:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064eca00/0x96d0c9b8c9a1c0d5 lrc: 2/0,0 mode: EX/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1c0dc expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.955958:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064eca00 already unused, calling callback (ffffffffc189cee0) 00010000:00010000:2.0:1788201144.955963:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064eca00/0x96d0c9b8c9a1c0d5 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1c0dc expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201144.955984:0:6520:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064eca00/0x96d0c9b8c9a1c0d5 lrc: 3/0,0 mode: EX/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1c0dc expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.956040:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064eca00/0x96d0c9b8c9a1c0d5 lrc: 2/0,0 mode: --/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c0dc expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.956047:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201144.956069:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064eca00/0x96d0c9b8c9a1c0d5 lrc: 1/0,0 mode: --/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c0dc expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.956077:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064eca00/0x96d0c9b8c9a1c0d5 lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c0dc expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.956093:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201144.956097:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c0b9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1c0c0 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.956103:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d600 already unused, calling callback (ffffffffc189cee0) 00010000:00010000:2.0:1788201144.956107:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c0b9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1c0c0 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201144.956114:0:6520:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c0b9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1c0c0 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.956130:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c0b9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c0c0 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.956136:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201144.956148:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c0b9 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c0c0 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.956155:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c0b9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c0c0 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.956165:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201144.956166:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201144.956168:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201144.956230:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201144.956617:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715195392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201144.956676:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201144.956742:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201144.956749:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715195264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201144.956771:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201144.972753:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715195392 00000100:00100000:2.0:1788201144.972770:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715195392 00000100:00100000:2.0:1788201144.972866:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715195264 00000100:00100000:2.0:1788201144.972870:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715195264 00000100:00100000:2.0:1788201144.972893:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:2.0:1788201144.972903:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10a10e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+13:3656:x1875060715195392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201144.972920:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201144.972942:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adec00/0x96d0c9b8c9a1c0c0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c0b9 expref: 13 pid: 83817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201144.972963:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103141d00) 00010000:00010000:2.0:1788201144.972967:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201144.973057:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10a10e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+12:3656:x1875060715195392:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (16381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201144.973064:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:3.0:1788201144.973072:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:3.0:1788201144.973082:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+11:3656:x1875060715195264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201144.973089:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201144.973101:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1c0dc lrc: 0/0,0 mode: --/EX res: [0x2400061c1:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c0d5 expref: 11 pid: 83817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201144.973113:0:26213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0x0 (ffff8dc12196e800) 00010000:00010000:3.0:1788201144.973120:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201144.973141:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715195392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201144.973143:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+10:3656:x1875060715195264:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (16372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201144.973149:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:2.0:1788201144.973163:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715195264:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201145.104477:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201146.131143:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201146.202699:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201146.202752:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201146.202794:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201146.202914:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695406464 00000100:00100000:0.0:1788201146.202925:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695406464 00000100:00100000:0.0:1788201146.202995:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695406592 00000100:00100000:0.0:1788201146.202998:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695406592 00000100:00100000:0.0:1788201146.203050:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1385 00000100:00100000:0.0:1788201146.203063:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695406464:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201146.203136:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695406464:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 76us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201146.203145:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1385 00000100:00100000:0.0:1788201146.203161:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1386 00000100:00100000:0.0:1788201146.203168:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:2402:x1875060695406592:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201146.203196:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:2402:x1875060695406592:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 29us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201146.203202:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1386 00000100:00100000:1.0:1788201146.203622:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695406720 00000100:00100000:1.0:1788201146.203627:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695406720 00000100:00080000:3.0:1788201146.203646:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201146.203651:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201146.203653:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201146.203667:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2820 00000100:00100000:1.0:1788201146.203675:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2402:x1875060695406720:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201146.203718:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2402:x1875060695406720:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 44us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201146.203726:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2820 00010000:00010000:2.0:1788201147.151742:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201147.356917:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201147.356965:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201147.357002:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201147.357088:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201147.357194:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695406976 00000100:00100000:0.0:1788201147.357225:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695406976 00000100:00100000:0.0:1788201147.357279:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695407104 00000100:00100000:0.0:1788201147.357283:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695407104 00000100:00100000:0.0:1788201147.357306:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1387 00000100:00100000:0.0:1788201147.357316:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695406976:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201147.357386:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695406976:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 71us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201147.357393:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1387 00000100:00100000:0.0:1788201147.357411:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1388 00000100:00100000:0.0:1788201147.357417:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:2400:x1875060695407104:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201147.357439:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:2400:x1875060695407104:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 22us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201147.357446:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1388 00000100:00100000:0.0:1788201147.357496:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695407232 00000100:00100000:0.0:1788201147.357500:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695407232 00000100:00100000:0.0:1788201147.357524:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2821 00000100:00100000:0.0:1788201147.357530:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695407232:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201147.357553:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695407232:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201147.357559:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2821 00000100:00100000:2.0:1788201147.358055:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695406848 00000100:00100000:2.0:1788201147.358061:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695406848 00000100:00100000:2.0:1788201147.358096:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 62 00000100:00100000:2.0:1788201147.358102:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12eddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0+-99:2399:x1875060695406848:12345-192.168.201.20@tcp:250:kworker.0 00010000:00080000:2.0:1788201147.358126:0:92554:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 93ba7067-43b5-4e46-8db7-27c040fa03d9@192.168.201.20@tcp t0 exp 0000000000000000 cur 3998 last 0 00000020:00000080:2.0:1788201147.358154:0:92554:0:(genops.c:1385:class_connect()) connect: client 93ba7067-43b5-4e46-8db7-27c040fa03d9, cookie 0x96d0c9b8c9a1c0ea 00000100:00080000:2.0:1788201147.358299:0:92554:0:(import.c:65:import_set_state_nolock()) ffff8dc1090d6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201147.358353:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12eddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+5:2399:x1875060695406848:12345-192.168.201.20@tcp:250:kworker.0 Request processed in 249us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201147.358361:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 62 00000004:00080000:2.0:1788201147.727531:0:75748:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3999199511495ns, next at 4000199508965ns, rc = 0 00000100:00100000:3.0:1788201147.727594:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201147.727615:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715195520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201147.727680:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201147.727849:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715195520 00000100:00100000:2.0:1788201147.727857:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715195520 00000100:00100000:2.0:1788201147.727918:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2284 00000100:00100000:2.0:1788201147.727928:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715195520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201147.727955:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788201147.728003:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715195520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201147.728011:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2284 00000100:00100000:2.0:1788201147.728070:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715195520:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788201147.728129:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201147.728351:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201147.728362:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715195648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201147.728405:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201147.728643:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715195648 00000100:00100000:3.0:1788201147.728649:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715195648 00000100:00100000:3.0:1788201147.728697:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2285 00000100:00100000:3.0:1788201147.728704:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715195648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201147.728719:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201147.728750:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715195648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201147.728756:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2285 00000100:00080000:0.0:1788201147.728808:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201147.729054:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715195648:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788201148.179012:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201148.240301:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201148.240323:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715195776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201148.240404:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201148.240464:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715195776 00000100:00100000:0.0:1788201148.240481:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715195776 00000100:00100000:0.0:1788201148.240529:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4002 00000100:00100000:0.0:1788201148.240537:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3656:x1875060715195776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201148.240573:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444962304 avail 1298722816 00000100:00100000:0.0:1788201148.240619:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3656:x1875060715195776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201148.240626:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4002 00000100:00100000:0.0:1788201148.240675:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715195776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201148.242360:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201148.242381:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715195904:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201148.242449:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201148.242505:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715195904 00000100:00100000:1.0:1788201148.242511:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715195904 00000100:00100000:1.0:1788201148.242550:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4003 00000100:00100000:1.0:1788201148.242558:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715195904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201148.242584:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445400576 avail 1299161088 00000100:00100000:1.0:1788201148.242624:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715195904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201148.242631:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4003 00000100:00100000:1.0:1788201148.242673:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715195904:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201148.245688:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715196160:0@lo:400:kworker.0 00000100:00100000:2.0:1788201148.245746:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201148.245773:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715196672:0@lo:400:kworker.0 00000100:00100000:2.0:1788201148.245790:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201148.245810:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788201148.245823:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715196032:0@lo:400:kworker.0 00000100:00100000:2.0:1788201148.245846:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201148.245867:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715196544:0@lo:400:kworker.0 00000100:00100000:2.0:1788201148.245883:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201148.245896:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715197056:0@lo:400:kworker.0 00000100:00100000:2.0:1788201148.245929:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201148.245953:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715196160 00000100:00100000:2.0:1788201148.245960:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715196160 00000100:00100000:2.0:1788201148.246002:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715196672 00000100:00100000:2.0:1788201148.246004:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715196672 00000100:00100000:2.0:1788201148.246031:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715196544 00000100:00100000:2.0:1788201148.246034:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715196544 00000100:00100000:2.0:1788201148.246045:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715197056 00000100:00100000:2.0:1788201148.246046:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715197056 00000100:00100000:2.0:1788201148.246059:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1389 00000100:00100000:2.0:1788201148.246066:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715196160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201148.246108:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715196160:12345-0@lo:400:kworker.0 Request processed in 42us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201148.246114:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1389 00000100:00100000:2.0:1788201148.246128:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1390 00000100:00100000:2.0:1788201148.246133:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715196672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201148.246152:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715196672:12345-0@lo:400:kworker.0 Request processed in 19us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201148.246158:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1390 00000100:00100000:2.0:1788201148.246165:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1391 00000100:00100000:2.0:1788201148.246170:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715196544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201148.246189:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715196544:12345-0@lo:400:kworker.0 Request processed in 19us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201148.246343:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1392 00000100:00100000:1.0:1788201148.246353:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715197056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201148.246383:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715197056:12345-0@lo:400:kworker.0 Request processed in 33us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201148.246388:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1392 00000100:00100000:1.0:1788201148.246406:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715196288:0@lo:400:kworker.0 00000100:00100000:1.0:1788201148.246427:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201148.246457:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715196800:0@lo:400:kworker.0 00000100:00100000:1.0:1788201148.246481:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201148.246501:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201148.246514:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715196416:0@lo:400:kworker.0 00000100:00100000:1.0:1788201148.246537:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201148.246549:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715196928:0@lo:400:kworker.0 00000100:00100000:1.0:1788201148.246566:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201148.246593:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715196800 00000100:00100000:1.0:1788201148.246596:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715196800 00000100:00100000:1.0:1788201148.246623:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715196928 00000100:00100000:1.0:1788201148.246626:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715196928 00000100:00100000:1.0:1788201148.246647:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2822 00000100:00100000:1.0:1788201148.246652:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715196800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201148.246685:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715196800:12345-0@lo:400:kworker.0 Request processed in 33us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201148.246691:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2822 00000100:00100000:1.0:1788201148.246706:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2823 00000100:00100000:1.0:1788201148.246712:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00586c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715196928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201148.246743:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00586c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715196928:12345-0@lo:400:kworker.0 Request processed in 31us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201148.246748:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2823 00000100:00100000:1.0:1788201148.246771:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715196288 00000100:00100000:1.0:1788201148.246775:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715196288 00000100:00100000:1.0:1788201148.246791:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715196416 00000100:00100000:1.0:1788201148.246793:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715196416 00000100:00100000:1.0:1788201148.246804:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1393 00000100:00100000:1.0:1788201148.246808:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715196288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201148.246834:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715196288:12345-0@lo:400:kworker.0 Request processed in 25us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201148.246840:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1393 00000100:00100000:1.0:1788201148.246859:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1394 00000100:00100000:1.0:1788201148.246865:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00586f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715196416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201148.246893:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00586f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715196416:12345-0@lo:400:kworker.0 Request processed in 28us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201148.246899:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1394 00000100:00100000:1.0:1788201148.246935:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715196416:0@lo:400:kworker.0 00000100:00100000:1.0:1788201148.246945:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715196928:0@lo:400:kworker.0 00000100:00100000:1.0:1788201148.246953:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715196288:0@lo:400:kworker.0 00000100:00100000:1.0:1788201148.246961:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715196800:0@lo:400:kworker.0 00000100:00100000:3.0:1788201148.248188:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715196032 00000001:00080000:0.0:1788201148.248507:0:92544:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084290 is committed 00000100:00100000:3.0:1788201148.248549:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715196032 00000100:00100000:3.0:1788201148.248600:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788201148.248609:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00436d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715196032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201148.248677:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00436d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715196032:12345-0@lo:400:kworker.0 Request processed in 69us (2828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201148.248683:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1788201148.248735:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201148.248740:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201148.248753:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201148.248756:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201148.248790:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715196032:0@lo:400:kworker.0 00000100:00100000:3.0:1788201148.248805:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715196544:0@lo:400:kworker.0 00000100:00100000:3.0:1788201148.248819:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715197056:0@lo:400:kworker.0 00000100:00100000:3.0:1788201148.248829:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715196160:0@lo:400:kworker.0 00000100:00100000:3.0:1788201148.248840:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715196672:0@lo:400:kworker.0 00000100:00100000:2.0:1788201148.250562:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1391 00000004:00080000:1.0:1788201148.251774:0:75739:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3 committed 00010000:00010000:1.0:1788201148.253514:0:75739:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064ec800/0x96d0c9b8c9a1c0c7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1c0ce expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201148.253533:0:75739:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064ec800/0x96d0c9b8c9a1c0c7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1c0ce expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201148.253576:0:75739:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064ec800/0x96d0c9b8c9a1c0c7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c0ce expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201148.253583:0:75739:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201148.253612:0:75739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064ec800/0x96d0c9b8c9a1c0c7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c0ce expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201148.253630:0:75739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411459 is committed 00000004:00080000:1.0:1788201148.253644:0:75739:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00010000:00010000:0.0:1788201148.253722:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1be20 lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201148.253731:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1be20 lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201148.253739:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1be20 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201148.253745:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201148.253749:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1be20 lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201148.253757:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1be20 lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201148.253771:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xf:0x0].0xb1bed465 (ffff8dc005f4b400) 00010000:00010000:0.0:1788201148.253774:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201148.253778:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1be20 lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201148.253796:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1be20 lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201148.253813:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c600/0x96d0c9b8c9a1c08f lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201148.253818:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c600/0x96d0c9b8c9a1c08f lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201148.253824:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c600/0x96d0c9b8c9a1c08f lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201148.253829:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201148.253832:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c600/0x96d0c9b8c9a1c08f lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201148.253838:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c600/0x96d0c9b8c9a1c08f lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201148.253847:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xf:0x0].0xb1bed465 (ffff8dc005f4b400) 00010000:00010000:0.0:1788201148.253849:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201148.253852:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c600/0x96d0c9b8c9a1c08f lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201148.253858:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c600/0x96d0c9b8c9a1c08f lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xf:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201148.253874:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c0ab lrc: 3/0,1 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201148.253880:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c0ab lrc: 2/0,0 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201148.253892:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c0ab lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201148.253897:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782de00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201148.253900:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c0ab lrc: 3/0,0 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201148.253906:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c0ab lrc: 4/0,0 mode: TXN/TXN res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201148.253915:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400061c1:0xe:0x0].0xf7117594 (ffff8dc0048beb00) 00010000:00010000:0.0:1788201148.253917:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201148.253920:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c0ab lrc: 2/0,0 mode: --/TXN res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201148.253926:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c0ab lrc: 0/0,0 mode: --/TXN res: [0x2400061c1:0xe:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201148.254543:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00586d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715197184:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1788201148.254612:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201148.254845:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201148.254855:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715197312:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1788201148.254886:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201148.254923:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715197312 00000100:00100000:2.0:1788201148.254930:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715197312 00000100:00100000:2.0:1788201148.254972:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5913 00000100:00100000:2.0:1788201148.254982:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715197312:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1788201148.255007:0:26210:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1538 count 1 00010000:00010000:2.0:1788201148.255048:0:26210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1c0f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201148.255068:0:26210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1be43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867fb expref: 6 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201148.255077:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x602:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1788201148.255082:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x602:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201148.255086:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1c0f1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201148.255113:0:26210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1be43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867fb expref: 6 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201148.255126:0:26210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1be43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867fb expref: 6 pid: 26214 timeout: 4099 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201148.255151:0:26210:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:26210:1875060715197440:192.168.201.20@tcp:104: 00000100:00100000:2.0:1788201148.255234:0:26210:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13aa35a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201148.256823:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715197184 00000100:00100000:3.0:1788201148.256834:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715197184 00000100:00100000:3.0:1788201148.256882:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:3.0:1788201148.256891:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3658:x1875060715197184:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1788201148.256903:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201148.256922:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1c0ce lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c0c7 expref: 8 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201148.256935:0:26207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff8dc12196e500) 00010000:00010000:3.0:1788201148.256945:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201148.256996:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715197184:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 106us (2383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201148.257003:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:0.0:1788201148.257530:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00586d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715197184:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1788201148.278920:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201148.281490:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695407360 00000100:00100000:1.0:1788201148.281515:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695407360 00010000:00010000:1.0:1788201148.281581:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1be43 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867fb expref: 7 pid: 26214 timeout: 4099 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201148.281626:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2562 00000100:00100000:1.0:1788201148.281636:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695407360:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201148.281651:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201148.281657:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1be43 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867fb expref: 7 pid: 26214 timeout: 4099 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201148.281672:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1be43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867fb expref: 7 pid: 26214 timeout: 4099 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201148.281701:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x602:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201148.281707:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x602:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201148.281713:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1c0f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201148.281722:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1c0f1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201148.281748:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201148.281809:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695407360:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 174us (2900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201148.281816:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2562 00000100:00080000:1.0:1788201148.281841:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788201148.293383:0:26210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050da27a0/0x96d0c9b8c9a1be43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7867fb expref: 6 pid: 26214 timeout: 4099 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201148.293409:0:26210:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:26210:1875060715197440:192.168.201.20@tcp:104: 00010000:00010000:2.0:1788201148.293444:0:26210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1c0f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201148.293455:0:26210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1c0f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201148.293462:0:26210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1c0f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201148.293471:0:26210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1c0f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201148.293478:0:26210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1c0f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201148.293503:0:26210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201148.293708:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715197312:12345-0@lo:6:osp-syn-0-1.0 Request processed in 38726us (38819us total) trans 4294969456 rc 0/0 00000100:00100000:2.0:1788201148.293731:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5913 00000004:00080000:2.0:1788201148.293783:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dc0039d3800/2, rc 0, transno 4294969456 00000100:00100000:2.0:1788201148.293790:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715197312:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1788201148.295044:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201148.295058:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1c0f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201148.295083:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201148.295087:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1c0f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201148.295097:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1c0f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201148.295116:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1c0f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201148.295123:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1c0f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201148.295147:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201148.295149:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201148.295151:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788201148.307999:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969456 is committed 00000001:00080000:1.0:1788201148.308080:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969455 is committed 00000001:00100000:1.0:1788201148.308115:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000100:00100000:1.0:1788201148.752713:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201148.752750:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00586c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715197568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201148.752818:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201148.752881:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715197568 00000100:00100000:1.0:1788201148.752888:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715197568 00000100:00100000:1.0:1788201148.752935:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2286 00000100:00100000:1.0:1788201148.752943:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00586d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715197568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201148.752965:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201148.753008:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00586d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715197568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201148.753035:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2286 00000100:00100000:1.0:1788201148.753083:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00586c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715197568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201148.753592:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715197696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201148.753628:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201148.753738:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715197696 00000100:00100000:2.0:1788201148.753743:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715197696 00000100:00100000:2.0:1788201148.753878:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2287 00000100:00100000:2.0:1788201148.753886:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715197696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201148.753898:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788201148.753940:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715197696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201148.753946:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2287 00000100:00100000:0.0:1788201148.753991:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969455 gen 2 00000100:00100000:0.0:1788201148.754007:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715197696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201149.149241:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201149.149492:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695407488 00000100:00100000:2.0:1788201149.149502:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695407488 00000100:00100000:2.0:1788201149.149556:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 64 00000100:00100000:2.0:1788201149.149566:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+5:71021:x1875060695407488:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201149.149583:0:92554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201149.149599:0:92554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007adea00/0x96d0c9b8c9a1c0f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786833 expref: -99 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201149.149625:0:92554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007adea00/0x96d0c9b8c9a1c0f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786833 expref: 6 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201149.149636:0:92554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007adea00/0x96d0c9b8c9a1c0f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786833 expref: 6 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201149.149661:0:92554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007adea00, rc 0) 00000100:00100000:2.0:1788201149.149720:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+6:71021:x1875060695407488:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 157us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201149.149728:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 64 00000100:00100000:1.0:1788201149.166464:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201149.166559:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695407616 00000100:00100000:0.0:1788201149.166570:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695407616 00000100:00100000:0.0:1788201149.166631:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 65 00000100:00100000:0.0:1788201149.166643:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+6:71021:x1875060695407616:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788201149.166677:0:92551:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1788201149.166693:0:92551:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788201149.166697:0:92551:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1788201149.166700:0:92551:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1788201149.166703:0:92551:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1788201149.166706:0:92551:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 123 00000100:00100000:0.0:1788201149.186705:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+6:71021:x1875060695407616:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 Request processed in 20055us (20240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201149.186719:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 65 00010000:00010000:0.0:1788201149.202572:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201149.209665:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201149.212477:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695407744 00000100:00100000:3.0:1788201149.212493:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695407744 00000100:00100000:3.0:1788201149.212548:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 66 00000100:00100000:3.0:1788201149.212558:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+6:71021:x1875060695407744:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201149.212576:0:92554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201149.212595:0:92554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1c0ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78683a expref: -99 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201149.212625:0:92554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1c0ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78683a expref: 7 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201149.212653:0:92554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1c0ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78683a expref: 7 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201149.212662:0:92554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3000, rc 0) 00000100:00100000:3.0:1788201149.214412:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+7:71021:x1875060695407744:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 167us (3070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201149.214435:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 66 00000100:00100000:2.0:1788201149.240036:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201149.240075:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695407872 00000100:00100000:2.0:1788201149.240085:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695407872 00000100:00100000:2.0:1788201149.240139:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 67 00000100:00100000:2.0:1788201149.240152:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+7:71021:x1875060695407872:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201149.240329:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71021:x1875060695407872:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 178us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201149.240337:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 67 00000100:00100000:0.0:1788201149.252165:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201149.252308:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695408000 00000100:00100000:2.0:1788201149.252318:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695408000 00000100:00100000:2.0:1788201149.252379:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 68 00000100:00100000:2.0:1788201149.252391:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71021:x1875060695408000:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201149.252544:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71021:x1875060695408000:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 154us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201149.252552:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 68 00000100:00100000:3.0:1788201149.263573:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201149.263611:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695408128 00000100:00100000:3.0:1788201149.263621:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695408128 00000100:00100000:3.0:1788201149.263669:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 69 00000100:00100000:3.0:1788201149.263679:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71021:x1875060695408128:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201149.263696:0:92549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201149.263714:0:92549:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc125ae2200/0x96d0c9b8c9a1c106 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786841 expref: -99 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201149.263757:0:92549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc125ae2200/0x96d0c9b8c9a1c106 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786841 expref: 9 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201149.263770:0:92549:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc125ae2200/0x96d0c9b8c9a1c106 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786841 expref: 9 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201149.263780:0:92549:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2200, rc 0) 00000100:00100000:3.0:1788201149.263834:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695408128:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 157us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201149.263842:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 69 00000001:00080000:1.0:1788201149.276652:0:9526:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969454 is committed 00000100:00100000:1.0:1788201149.288193:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201149.288293:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695408256 00000100:00100000:3.0:1788201149.288303:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695408256 00000100:00100000:3.0:1788201149.288356:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 70 00000100:00100000:3.0:1788201149.288366:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695408256:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201149.288541:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695408256:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 175us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201149.288550:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 70 00000100:00100000:3.0:1788201149.303140:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201149.304643:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695408384 00000100:00100000:2.0:1788201149.304656:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695408384 00000100:00100000:2.0:1788201149.304713:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 71 00000100:00100000:2.0:1788201149.304723:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695408384:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201149.305216:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695408384:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 492us (2084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201149.305225:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 71 00000100:00100000:3.0:1788201149.311535:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201149.311659:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695408512 00000100:00100000:2.0:1788201149.311670:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695408512 00000100:00100000:2.0:1788201149.311724:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 72 00000100:00100000:2.0:1788201149.311734:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695408512:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201149.311752:0:92554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201149.311771:0:92554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007adf600/0x96d0c9b8c9a1c10d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786848 expref: -99 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201149.311798:0:92554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007adf600/0x96d0c9b8c9a1c10d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786848 expref: 10 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201149.311809:0:92554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007adf600/0x96d0c9b8c9a1c10d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786848 expref: 10 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201149.311818:0:92554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007adf600, rc 0) 00000100:00100000:2.0:1788201149.311882:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695408512:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 148us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201149.311890:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 72 00000100:00100000:3.0:1788201149.333804:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201149.333926:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695408640 00000100:00100000:2.0:1788201149.333937:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695408640 00000100:00100000:2.0:1788201149.334001:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 73 00000100:00100000:2.0:1788201149.334053:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695408640:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201149.334195:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695408640:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 184us (400us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201149.334218:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 73 00010000:00010000:2.0:1788201150.224669:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201151.251126:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201152.272765:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201152.468897:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201152.468942:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201152.468971:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201152.469009:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201152.469123:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695409024 00000100:00100000:1.0:1788201152.469133:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695409024 00000100:00100000:1.0:1788201152.469198:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695408896 00000100:00100000:1.0:1788201152.469211:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695408896 00000100:00100000:1.0:1788201152.469237:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1395 00000100:00100000:1.0:1788201152.469247:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695409024:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201152.469319:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695409024:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 74us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201152.469327:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1395 00000100:00100000:1.0:1788201152.469371:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1396 00000100:00100000:1.0:1788201152.469378:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695408896:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201152.469404:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695408896:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 28us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201152.469410:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1396 00000100:00100000:1.0:1788201152.469435:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695409152 00000100:00100000:1.0:1788201152.469438:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695409152 00000100:00100000:1.0:1788201152.469463:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2824 00000100:00100000:1.0:1788201152.469470:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695409152:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201152.469493:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695409152:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 24us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201152.469498:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2824 00000100:00080000:3.0:1788201152.469790:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201152.469794:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201152.469796:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201152.470054:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695408768 00000100:00100000:2.0:1788201152.470059:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695408768 00000100:00100000:2.0:1788201152.470102:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 74 00000100:00100000:2.0:1788201152.470109:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695408768:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201152.470297:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695408768:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 187us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201152.470304:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 74 00000100:00100000:0.0:1788201152.848947:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715197824:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201152.849059:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201152.849237:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715197824 00000100:00100000:3.0:1788201152.849247:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715197824 00000100:00100000:3.0:1788201152.849310:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2288 00000100:00100000:3.0:1788201152.849319:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715197824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201152.849349:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788201152.849406:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715197824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201152.849413:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2288 00000100:00080000:0.0:1788201152.849694:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201152.849722:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294969456 gen 2 00000004:00080000:0.0:1788201152.849728:0:3658:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dc0039d3800, transno 4294969456 00000100:00100000:0.0:1788201152.849755:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715197824:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201152.850483:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201152.850496:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715197952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201152.850547:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201152.850816:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715197952 00000100:00100000:0.0:1788201152.850823:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715197952 00000100:00100000:0.0:1788201152.850886:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2289 00000100:00100000:0.0:1788201152.850896:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715197952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201152.850925:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201152.850978:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715197952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201152.850986:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2289 00000100:00100000:0.0:1788201152.851051:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715197952:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788201152.851231:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788201153.295174:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201153.362553:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00586c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715198080:0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.362625:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201153.362688:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125808700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715198592:0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.362716:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201153.362737:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715199104:0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.362761:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201153.362786:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788201153.362793:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715198464:0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.362814:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201153.362830:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715198976:0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.362853:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201153.362871:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715199488:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201153.362892:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201153.362919:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125809880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715198208:0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.362943:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201153.362961:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715198720:0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.362980:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201153.362994:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715199232:0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.363012:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201153.363049:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788201153.363055:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12580b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715198336:0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.363074:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201153.363090:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715198848:0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.363125:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201153.363143:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715199360:0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.363168:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201153.363195:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715198592 00000100:00100000:0.0:1788201153.363203:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715198592 00000100:00100000:0.0:1788201153.363252:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715198464 00000100:00100000:0.0:1788201153.363255:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715198464 00000100:00100000:0.0:1788201153.363269:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715198208 00000100:00100000:0.0:1788201153.363272:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715198208 00000100:00100000:0.0:1788201153.363284:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715198336 00000100:00100000:0.0:1788201153.363286:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715198336 00000100:00100000:0.0:1788201153.363296:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715198848 00000100:00100000:0.0:1788201153.363298:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715198848 00000100:00100000:0.0:1788201153.363307:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715199360 00000100:00100000:0.0:1788201153.363310:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715199360 00000100:00100000:0.0:1788201153.363323:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1397 00000100:00100000:0.0:1788201153.363332:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715198592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.363399:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715198592:12345-0@lo:400:kworker.0 Request processed in 68us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201153.363407:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1397 00000100:00100000:0.0:1788201153.363424:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00000100:00100000:0.0:1788201153.363430:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715198464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.363460:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715198464:12345-0@lo:400:kworker.0 Request processed in 31us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201153.363466:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00000100:00100000:0.0:1788201153.363477:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:0.0:1788201153.363483:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715198208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.363513:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715198208:12345-0@lo:400:kworker.0 Request processed in 30us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201153.363525:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00100000:0.0:1788201153.363537:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:0.0:1788201153.363542:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715198336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.363571:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715198336:12345-0@lo:400:kworker.0 Request processed in 29us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201153.363577:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:0.0:1788201153.363587:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:0.0:1788201153.363594:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715198848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.363621:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715198848:12345-0@lo:400:kworker.0 Request processed in 29us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201153.363627:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00100000:0.0:1788201153.363642:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1402 00000100:00100000:0.0:1788201153.363648:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715199360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.363673:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715199360:12345-0@lo:400:kworker.0 Request processed in 26us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201153.363678:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1402 00000100:00100000:0.0:1788201153.363696:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715199104 00000100:00100000:0.0:1788201153.363699:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715199104 00000100:00100000:0.0:1788201153.363724:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715199232 00000100:00100000:0.0:1788201153.363727:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715199232 00000100:00100000:0.0:1788201153.363744:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2825 00000100:00100000:0.0:1788201153.363749:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715199104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.363779:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715199104:12345-0@lo:400:kworker.0 Request processed in 31us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201153.363784:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2825 00000100:00100000:0.0:1788201153.363801:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2826 00000100:00100000:0.0:1788201153.363806:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715199232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.363832:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715199232:12345-0@lo:400:kworker.0 Request processed in 26us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201153.363837:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2826 00000100:00100000:0.0:1788201153.363855:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715198976 00000100:00100000:0.0:1788201153.363858:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715198976 00000100:00100000:0.0:1788201153.363878:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715199488 00000100:00100000:0.0:1788201153.363881:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715199488 00000100:00100000:0.0:1788201153.363890:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715198720 00000100:00100000:0.0:1788201153.363891:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715198720 00000100:00100000:0.0:1788201153.363901:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4004 00000100:00100000:0.0:1788201153.363907:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715198976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.363939:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715198976:12345-0@lo:400:kworker.0 Request processed in 32us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201153.363944:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4004 00000100:00100000:0.0:1788201153.363955:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4005 00000100:00100000:0.0:1788201153.363961:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715199488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201153.363982:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445400576 avail 1299161088 00000100:00100000:0.0:1788201153.364011:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715199488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201153.364040:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4005 00000100:00100000:0.0:1788201153.364050:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4006 00000100:00100000:0.0:1788201153.364056:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715198720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.364083:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715198720:12345-0@lo:400:kworker.0 Request processed in 27us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201153.364088:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4006 00000100:00080000:0.0:1788201153.364127:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201153.364131:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201153.364134:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201153.364136:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201153.364164:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715198464:0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.364176:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715198976:0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.364188:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715199488:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201153.364197:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125808700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715198592:0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.364206:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715199104:0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.364246:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12580b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715198336:0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.364256:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715198848:0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.364264:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715199360:0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.364272:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125809880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715198208:0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.364279:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084290 gen 3 00000004:00080000:0.0:1788201153.364285:0:3657:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084289 committed transno 120259084290 00000004:00080000:0.0:1788201153.364300:0:3657:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084290 committed transno 120259084290 00000020:00080000:0.0:1788201153.364306:0:3657:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8dc104e143c0 refcount 2 committed 0 result 0 batchid 73014444095 00000020:00080000:0.0:1788201153.364310:0:3657:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc1074dc400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8dc104e14e40 00000020:00080000:0.0:1788201153.364313:0:3657:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000090a1:0x1:0x0].6 00000020:00080000:0.0:1788201153.364316:0:3657:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc12f2fd800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dc11cf03e00 00000020:00080000:0.0:1788201153.364319:0:3657:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2400088d0:0x1:0x0].7 00000100:00100000:0.0:1788201153.364336:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715198720:0@lo:400:kworker.0 00000100:00100000:0.0:1788201153.364368:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969454 gen 2 00000100:00100000:0.0:1788201153.364379:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715199232:0@lo:400:kworker.0 00000020:00080000:0.0:1788201153.364411:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444095 committed batchid 73014444094 00000020:00080000:0.0:1788201153.364466:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444094 00000100:00100000:1.0:1788201153.364631:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715198080 00000100:00100000:1.0:1788201153.364636:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715198080 00000100:00100000:1.0:1788201153.364815:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788201153.364823:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715198080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201153.364861:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715198080:12345-0@lo:400:kworker.0 Request processed in 40us (2237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201153.364867:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788201153.365860:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00586c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715198080:0@lo:400:kworker.0 00000100:00100000:2.0:1788201153.366298:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201153.366311:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715199616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201153.366368:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201153.366581:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715199616 00000100:00100000:0.0:1788201153.366587:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715199616 00000100:00100000:0.0:1788201153.366632:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4007 00000100:00100000:0.0:1788201153.366640:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715199616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201153.366743:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444962304 avail 1298722816 00000100:00100000:0.0:1788201153.366865:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715199616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 225us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201153.366872:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4007 00000100:00100000:2.0:1788201153.369322:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715199616:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1788201153.534532:0:93129:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 134: replay creation of a file created in a pool ========================================================== 14:32:32 (1788201152) 00000100:00100000:2.0:1788201153.871292:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201153.871317:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715199744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201153.871407:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201153.871531:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715199744 00000100:00100000:3.0:1788201153.871539:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715199744 00000100:00100000:3.0:1788201153.871594:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2290 00000100:00100000:3.0:1788201153.871603:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715199744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201153.871625:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201153.871682:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715199744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201153.871691:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2290 00000100:00100000:1.0:1788201153.871950:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715199744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201153.872250:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715199872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201153.872281:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201153.872362:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715199872 00000100:00100000:3.0:1788201153.872367:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715199872 00000100:00100000:3.0:1788201153.872400:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2291 00000100:00100000:3.0:1788201153.872407:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715199872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201153.872430:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788201153.872480:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715199872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201153.872486:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2291 00000100:00100000:1.0:1788201153.872560:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715199872:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788201154.320237:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201154.689926:0:93177:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffe508b1820 20000000:00000080:1.0:1788201154.689945:0:93177:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff8dc003a4b000 uarg=0000000000000000 00000040:00100000:1.0:1788201154.692353:0:93177:0:(llog.c:1072:llog_reverse_process()) index 51 : idx 49 00000040:00100000:1.0:1788201154.692366:0:93177:0:(llog.c:1072:llog_reverse_process()) index 47 : idx 1 00000040:00080000:1.0:1788201154.692573:0:93177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].52, 224 off17176 20000000:01000000:1.0:1788201154.692597:0:93177:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:1.0:1788201154.692617:0:93177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].53, 112 off17288 00000040:00080000:1.0:1788201154.692712:0:93177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].54, 224 off17512 00000040:00080000:1.0:1788201154.692791:0:93177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 224 off16208 20000000:01000000:1.0:1788201154.692800:0:93177:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:1.0:1788201154.692814:0:93177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 120 off16328 00000040:00080000:1.0:1788201154.693317:0:93177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].49, 224 off16608 00000040:00080000:1.0:1788201154.694302:0:93177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].46, 224 off16240 20000000:01000000:1.0:1788201154.694338:0:93177:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:1.0:1788201154.694366:0:93177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].47, 120 off16360 00000040:00080000:1.0:1788201154.694486:0:93177:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].49, 224 off16608 10000000:01000000:1.0:1788201154.694516:0:93177:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788201154.694538:0:93177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc1064eca00/0x96d0c9b8c9a1c114 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.694559:0:93177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc005da7800/0x96d0c9b8c9a1bc21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bc1a expref: 23 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.694567:0:93177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1bd01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bcfa expref: 23 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.694575:0:93177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1bd32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd2b expref: 23 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.694582:0:93177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc005da6a00/0x96d0c9b8c9a1bd4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd47 expref: 23 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.694594:0:93177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc1064ed400/0x96d0c9b8c9a1bd78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd71 expref: 23 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.694602:0:93177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc0078fd400/0x96d0c9b8c9a1bd86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd7f expref: 23 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.694614:0:93177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc005da7400/0x96d0c9b8c9a1bda2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd9b expref: 23 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.694620:0:93177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc00782ce00/0x96d0c9b8c9a1bdb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bda9 expref: 23 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.694627:0:93177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc0078fca00/0x96d0c9b8c9a1bdda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bdd3 expref: 23 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.694645:0:93177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1c0ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78683a expref: 9 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.694652:0:93177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc007adf600/0x96d0c9b8c9a1c10d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786848 expref: 9 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.694658:0:93177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dc1064eca00/0x96d0c9b8c9a1c114 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.694701:0:93177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc007adf600/0x96d0c9b8c9a1c10d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786848 expref: 9 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.694716:0:93177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc007adf600/0x96d0c9b8c9a1c10d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786848 expref: 9 pid: 92554 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201154.694731:0:93177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93177:1875060715200000:192.168.201.20@tcp:104: 00010000:00010000:1.0:1788201154.694833:0:93177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1c0ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78683a expref: 9 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.694842:0:93177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1c0ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78683a expref: 9 pid: 92554 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201154.694857:0:93177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93177:1875060715200128:192.168.201.20@tcp:104: 00010000:00010000:1.0:1788201154.694894:0:93177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc0078fca00/0x96d0c9b8c9a1bdda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1bdd3 expref: 23 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.694903:0:93177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc0078fca00/0x96d0c9b8c9a1bdda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bdd3 expref: 23 pid: 92554 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201154.694912:0:93177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93177:1875060715200256:0@lo:104: 00000100:00100000:1.0:1788201154.694953:0:93177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201154.695042:0:93177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc00782ce00/0x96d0c9b8c9a1bdb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1bda9 expref: 23 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.695052:0:93177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc00782ce00/0x96d0c9b8c9a1bdb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bda9 expref: 23 pid: 92550 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201154.695060:0:93177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93177:1875060715200384:0@lo:104: 00000100:00100000:1.0:1788201154.695084:0:93177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201154.695112:0:93177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc005da7400/0x96d0c9b8c9a1bda2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd9b expref: 23 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.695119:0:93177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc005da7400/0x96d0c9b8c9a1bda2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd9b expref: 23 pid: 92551 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201154.695127:0:93177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93177:1875060715200512:0@lo:104: 00000100:00100000:2.0:1788201154.695332:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715200256 00000100:00100000:2.0:1788201154.695340:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715200256 00000100:00100000:2.0:1788201154.695390:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715200384 00000100:00100000:2.0:1788201154.695393:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715200384 00000100:00100000:2.0:1788201154.695410:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788201154.695418:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+4:93177:x1875060715200256:12345-0@lo:104: 00010000:00010000:2.0:1788201154.695441:0:19665:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1bdd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1bdda expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.695491:0:19665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201154.695498:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+4:93177:x1875060715200256:12345-0@lo:104: Request processed in 80us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201154.695504:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788201154.695538:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788201154.695545:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+3:93177:x1875060715200384:12345-0@lo:104: 00010000:00010000:2.0:1788201154.695553:0:19665:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc005da6e00/0x96d0c9b8c9a1bda9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1bdb0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.695588:0:19665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788201154.695593:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+3:93177:x1875060715200384:12345-0@lo:104: Request processed in 49us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201154.695599:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00010000:00010000:2.0:1788201154.695623:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201154.695640:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1bdd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1bdda expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.695648:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ede00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788201154.695651:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1bdd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1bdda expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.695659:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1bdd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1bdda expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201154.695667:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1bdd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1bdda expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201154.695678:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201154.695709:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1bdd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bdda expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.695715:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201154.695735:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1bdd3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bdda expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.695742:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1bdd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bdda expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.695756:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201154.695760:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc005da6e00/0x96d0c9b8c9a1bda9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1bdb0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.695765:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc005da6e00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788201154.695769:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc005da6e00/0x96d0c9b8c9a1bda9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1bdb0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.695776:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc005da6e00/0x96d0c9b8c9a1bda9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1bdb0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201154.695782:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc005da6e00/0x96d0c9b8c9a1bda9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1bdb0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201154.695787:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201154.695800:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc005da6e00/0x96d0c9b8c9a1bda9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bdb0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.695806:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201154.695819:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc005da6e00/0x96d0c9b8c9a1bda9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bdb0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.695825:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc005da6e00/0x96d0c9b8c9a1bda9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bdb0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.695835:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201154.695836:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201154.695838:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201154.695845:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201154.695864:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715200640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201154.695894:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201154.695920:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201154.695926:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715200768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201154.695947:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201154.695977:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715200640 00000100:00100000:2.0:1788201154.695981:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715200640 00010000:00010000:2.0:1788201154.695998:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc0078fca00/0x96d0c9b8c9a1bdda lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bdd3 expref: 24 pid: 92554 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201154.696042:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715200768 00000100:00100000:2.0:1788201154.696045:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715200768 00010000:00010000:2.0:1788201154.696056:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc00782ce00/0x96d0c9b8c9a1bdb0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bda9 expref: 25 pid: 92550 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201154.696073:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563 00000100:00100000:2.0:1788201154.696078:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+25:3655:x1875060715200640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201154.696087:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201154.696092:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc0078fca00/0x96d0c9b8c9a1bdda lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bdd3 expref: 25 pid: 92554 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.696112:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc0078fca00/0x96d0c9b8c9a1bdda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bdd3 expref: 25 pid: 92554 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.696127:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201154.696789:0:93177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201154.697140:0:93177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc0078fd400/0x96d0c9b8c9a1bd86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd7f expref: 25 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.697308:0:93177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc0078fd400/0x96d0c9b8c9a1bd86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd7f expref: 25 pid: 92551 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201154.697319:0:93177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93177:1875060715200896:0@lo:104: 00010000:00010000:1.0:1788201154.697369:0:93177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc1064ed400/0x96d0c9b8c9a1bd78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd71 expref: 25 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.697377:0:93177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc1064ed400/0x96d0c9b8c9a1bd78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd71 expref: 25 pid: 92550 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201154.697385:0:93177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93177:1875060715201024:0@lo:104: 00010000:00010000:1.0:1788201154.697411:0:93177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc005da6a00/0x96d0c9b8c9a1bd4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd47 expref: 25 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.697419:0:93177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc005da6a00/0x96d0c9b8c9a1bd4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd47 expref: 25 pid: 92549 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201154.697426:0:93177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93177:1875060715201152:0@lo:104: 00010000:00010000:1.0:1788201154.697449:0:93177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1bd32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd2b expref: 25 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.697456:0:93177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1bd32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd2b expref: 25 pid: 92550 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201154.697464:0:93177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93177:1875060715201280:0@lo:104: 00010000:00010000:1.0:1788201154.697490:0:93177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1bd01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1bcfa expref: 25 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.697581:0:93177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1bd01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bcfa expref: 25 pid: 92550 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201154.697589:0:93177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93177:1875060715201408:0@lo:104: 00010000:00010000:1.0:1788201154.697620:0:93177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc005da7800/0x96d0c9b8c9a1bc21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1bc1a expref: 25 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201154.697627:0:93177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc005da7800/0x96d0c9b8c9a1bc21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bc1a expref: 25 pid: 92551 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201154.697710:0:93177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93177:1875060715201536:0@lo:104: 00000100:00100000:1.0:1788201154.697731:0:93177:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846e40 going to sleep for 11 seconds 00010000:00010000:1.0:1788201154.697768:0:93177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fca00/0x96d0c9b8c9a1bdda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bdd3 expref: 25 pid: 92554 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201154.697781:0:93177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93177:1875060715200256:0@lo:104: 00000100:00100000:1.0:1788201154.697792:0:93177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93177:1875060715200384:0@lo:104: 00000100:00100000:2.0:1788201154.697863:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715200640:12345-0@lo:103:ldlm_bl.0 Request processed in 1783us (1967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201154.697872:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563 00000100:00100000:2.0:1788201154.697896:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2564 00000100:00100000:2.0:1788201154.697906:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+23:3655:x1875060715200768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201154.697915:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201154.697922:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc00782ce00/0x96d0c9b8c9a1bdb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bda9 expref: 23 pid: 92550 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.697931:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc00782ce00/0x96d0c9b8c9a1bdb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bda9 expref: 23 pid: 92550 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.697944:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782ce00/0x96d0c9b8c9a1bdb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bda9 expref: 23 pid: 92550 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.697956:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201154.698070:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+22:3655:x1875060715200768:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (2121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201154.698076:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2564 00000100:00100000:2.0:1788201154.698119:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715200768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201154.698128:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715200640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201154.698227:0:19665:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788201154.698253:0:19665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201154.698345:0:19665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201154.703059:0:19665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201154.705303:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715200512 00000100:00100000:0.0:1788201154.705330:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715200512 00000100:00100000:0.0:1788201154.705393:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715200896 00000100:00100000:0.0:1788201154.705398:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715200896 00000100:00100000:0.0:1788201154.705410:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715201024 00000100:00100000:0.0:1788201154.705413:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715201024 00000100:00100000:0.0:1788201154.705435:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788201154.705445:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002ae5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9b18af6-fecc-4172-82c2-66531890fe11+5:93177:x1875060715200512:12345-0@lo:104: 00010000:00010000:0.0:1788201154.705463:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1bd9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1bda2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.706066:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201154.706074:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002ae5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9b18af6-fecc-4172-82c2-66531890fe11+5:93177:x1875060715200512:12345-0@lo:104: Request processed in 630us (10923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201154.706099:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788201154.706143:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715201152 00000100:00100000:0.0:1788201154.706147:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715201152 00000100:00100000:0.0:1788201154.706239:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788201154.706246:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9b18af6-fecc-4172-82c2-66531890fe11+5:93177:x1875060715200896:12345-0@lo:104: 00010000:00010000:0.0:1788201154.706255:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc005da7000/0x96d0c9b8c9a1bd7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1bd86 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.706298:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788201154.706304:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9b18af6-fecc-4172-82c2-66531890fe11+5:93177:x1875060715200896:12345-0@lo:104: Request processed in 59us (8050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201154.706310:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788201154.706338:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788201154.706345:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9b18af6-fecc-4172-82c2-66531890fe11+4:93177:x1875060715201024:12345-0@lo:104: 00010000:00010000:0.0:1788201154.706354:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1bd71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1bd78 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.706392:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788201154.706397:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9b18af6-fecc-4172-82c2-66531890fe11+4:93177:x1875060715201024:12345-0@lo:104: Request processed in 53us (8053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201154.706403:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788201154.706416:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788201154.706422:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9b18af6-fecc-4172-82c2-66531890fe11+3:93177:x1875060715201152:12345-0@lo:104: 00010000:00010000:0.0:1788201154.706430:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc1064eda00/0x96d0c9b8c9a1bd47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1bd4e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.706460:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788201154.706471:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9b18af6-fecc-4172-82c2-66531890fe11+3:93177:x1875060715201152:12345-0@lo:104: Request processed in 50us (3421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201154.706477:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00010000:00010000:0.0:1788201154.706496:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788201154.706823:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1bd9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1bda2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.706832:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd800 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201154.706836:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1bd9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1bda2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.706846:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1bd9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1bda2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201154.706853:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1bd9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1bda2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201154.706860:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201154.706899:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1bd9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bda2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.706905:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201154.706926:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1bd9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bda2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.706933:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1bd9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bda2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.706948:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201154.706952:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc005da7000/0x96d0c9b8c9a1bd7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1bd86 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.706967:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc005da7000 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201154.707283:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc005da7000/0x96d0c9b8c9a1bd7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1bd86 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.707293:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc005da7000/0x96d0c9b8c9a1bd7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1bd86 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201154.707299:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc005da7000/0x96d0c9b8c9a1bd7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1bd86 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201154.707305:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201154.707335:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc005da7000/0x96d0c9b8c9a1bd7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bd86 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.707342:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201154.707349:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc005da7000/0x96d0c9b8c9a1bd7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bd86 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.707355:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc005da7000/0x96d0c9b8c9a1bd7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bd86 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.707365:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201154.707368:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1bd71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1bd78 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.707373:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fce00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201154.707376:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1bd71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1bd78 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.707394:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1bd71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1bd78 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201154.707401:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1bd71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1bd78 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201154.707407:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201154.707422:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1bd71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bd78 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.707428:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201154.707445:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1bd71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bd78 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.707452:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1bd71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bd78 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.707462:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201154.707465:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc1064eda00/0x96d0c9b8c9a1bd47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1bd4e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.707471:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064eda00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201154.707474:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064eda00/0x96d0c9b8c9a1bd47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1bd4e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.707481:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064eda00/0x96d0c9b8c9a1bd47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1bd4e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201154.707488:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064eda00/0x96d0c9b8c9a1bd47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1bd4e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201154.707617:0:19665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201154.707670:0:19665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201154.707684:0:19665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201154.707694:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715201280 00000100:00100000:2.0:1788201154.707700:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715201280 00000100:00100000:2.0:1788201154.707734:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715201408 00000100:00100000:2.0:1788201154.707737:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715201408 00000100:00100000:2.0:1788201154.707747:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715201536 00000100:00100000:2.0:1788201154.707749:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715201536 00000100:00100000:2.0:1788201154.707760:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788201154.707767:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+5:93177:x1875060715201280:12345-0@lo:104: 00010000:00010000:2.0:1788201154.707777:0:19665:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1bd2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1bd32 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.707819:0:19665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201154.707824:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+5:93177:x1875060715201280:12345-0@lo:104: Request processed in 58us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201154.707830:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788201154.707845:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788201154.707851:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+4:93177:x1875060715201408:12345-0@lo:104: 00010000:00010000:2.0:1788201154.707858:0:19665:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc0078fde00/0x96d0c9b8c9a1bcfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1bd01 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.707888:0:19665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788201154.707893:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+4:93177:x1875060715201408:12345-0@lo:104: Request processed in 43us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201154.707898:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788201154.707919:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788201154.707925:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+3:93177:x1875060715201536:12345-0@lo:104: 00010000:00010000:2.0:1788201154.707932:0:19665:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc005da6c00/0x96d0c9b8c9a1bc1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1bc21 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.707960:0:19665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788201154.707965:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+3:93177:x1875060715201536:12345-0@lo:104: Request processed in 41us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201154.707970:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00010000:00010000:2.0:1788201154.708007:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788201154.708013:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1bd2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1bd32 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.708036:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec400 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788201154.708039:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1bd2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1bd32 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.708047:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1bd2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1bd32 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201154.708053:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1bd2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1bd32 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201154.708059:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201154.708074:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1bd2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bd32 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.708079:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201154.708085:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1bd2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bd32 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.708102:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1bd2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bd32 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.708113:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201154.708116:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc0078fde00/0x96d0c9b8c9a1bcfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1bd01 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.708122:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fde00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788201154.708125:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fde00/0x96d0c9b8c9a1bcfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1bd01 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.708131:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0078fde00/0x96d0c9b8c9a1bcfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1bd01 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201154.708136:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fde00/0x96d0c9b8c9a1bcfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1bd01 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201154.708141:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201154.708393:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201154.708413:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc1064eda00/0x96d0c9b8c9a1bd47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bd4e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.708419:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201154.708425:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc1064eda00/0x96d0c9b8c9a1bd47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bd4e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.708430:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064eda00/0x96d0c9b8c9a1bd47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bd4e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.708442:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201154.708445:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc005da6c00/0x96d0c9b8c9a1bc1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1bc21 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.708449:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc005da6c00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201154.708452:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc005da6c00/0x96d0c9b8c9a1bc1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1bc21 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.708458:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc005da6c00/0x96d0c9b8c9a1bc1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1bc21 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201154.708463:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc005da6c00/0x96d0c9b8c9a1bc1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1bc21 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201154.708468:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201154.708481:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc005da6c00/0x96d0c9b8c9a1bc1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bc21 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.708487:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201154.708590:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc0078fde00/0x96d0c9b8c9a1bcfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bd01 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.708597:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201154.708602:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fde00/0x96d0c9b8c9a1bcfa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bd01 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.708608:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0078fde00/0x96d0c9b8c9a1bcfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bd01 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.708618:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201154.708679:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201154.708683:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201154.708717:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715202048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201154.708759:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201154.708802:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788201154.708810:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715201920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201154.708833:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201154.708849:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715202432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201154.708868:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201154.708895:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715202048 00000100:00100000:2.0:1788201154.708899:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715202048 00010000:00010000:2.0:1788201154.708918:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1bd32 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd2b expref: 22 pid: 92550 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201154.708939:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715201920 00000100:00100000:2.0:1788201154.708941:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715201920 00010000:00010000:2.0:1788201154.708951:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc1064ed400/0x96d0c9b8c9a1bd78 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd71 expref: 23 pid: 92550 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201154.708964:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715202432 00000100:00100000:2.0:1788201154.708967:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715202432 00010000:00010000:0.0:1788201154.709103:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc005da6c00/0x96d0c9b8c9a1bc1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bc21 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.709112:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc005da6c00/0x96d0c9b8c9a1bc1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1bc21 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201154.709127:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201154.709128:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201154.709131:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201154.709143:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715201664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201154.709235:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201154.709261:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00586c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715202176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201154.709280:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201154.709298:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788201154.709305:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715201792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201154.709334:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201154.709345:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715202304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201154.709364:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201154.709911:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1bd01 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bcfa expref: 24 pid: 92550 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201154.709928:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715201664 00000100:00100000:2.0:1788201154.709932:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715201664 00010000:00010000:2.0:1788201154.709943:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc005da7400/0x96d0c9b8c9a1bda2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd9b expref: 25 pid: 92551 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201154.709952:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715202176 00000100:00100000:2.0:1788201154.709964:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715202176 00010000:00010000:2.0:1788201154.710234:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc005da6a00/0x96d0c9b8c9a1bd4e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd47 expref: 26 pid: 92549 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201154.710248:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715201792 00000100:00100000:2.0:1788201154.710251:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715201792 00010000:00010000:2.0:1788201154.710263:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc0078fd400/0x96d0c9b8c9a1bd86 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd7f expref: 27 pid: 92551 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201154.710273:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715202304 00000100:00100000:2.0:1788201154.710275:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715202304 00010000:00010000:2.0:1788201154.710284:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc005da7800/0x96d0c9b8c9a1bc21 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bc1a expref: 28 pid: 92551 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201154.710297:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2565 00000100:00100000:2.0:1788201154.710305:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+28:3656:x1875060715202048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201154.710317:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201154.710335:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1bd32 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd2b expref: 28 pid: 92550 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.710346:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1bd32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd2b expref: 28 pid: 92550 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.710364:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201154.710413:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+28:3656:x1875060715202048:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201154.710419:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2565 00000100:00100000:2.0:1788201154.710437:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566 00000100:00100000:2.0:1788201154.710443:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10a10d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+27:3656:x1875060715201920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201154.710451:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201154.710463:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc1064ed400/0x96d0c9b8c9a1bd78 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd71 expref: 27 pid: 92550 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.710471:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc1064ed400/0x96d0c9b8c9a1bd78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd71 expref: 27 pid: 92550 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.710481:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201154.710698:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715202048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201154.712141:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10a10d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+27:3656:x1875060715201920:12345-0@lo:103:ldlm_bl.0 Request processed in 1693us (3302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201154.712216:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566 00000100:00100000:2.0:1788201154.712278:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567 00000100:00100000:2.0:1788201154.712290:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+26:3656:x1875060715202432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201154.712303:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201154.712311:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1bd01 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bcfa expref: 26 pid: 92550 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.712333:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1bd01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bcfa expref: 26 pid: 92550 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.712349:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201154.712385:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+26:3656:x1875060715202432:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (3515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201154.712391:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567 00000100:00100000:2.0:1788201154.712406:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2568 00000100:00100000:2.0:1788201154.712412:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+25:3657:x1875060715201664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201154.712420:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201154.712425:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc005da7400/0x96d0c9b8c9a1bda2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd9b expref: 25 pid: 92551 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.712446:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc005da7400/0x96d0c9b8c9a1bda2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd9b expref: 25 pid: 92551 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.712456:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201154.712490:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+25:3657:x1875060715201664:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (3254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201154.712496:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2568 00010000:00010000:3.0:1788201154.712759:0:93177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc005da7400/0x96d0c9b8c9a1bda2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd9b expref: 25 pid: 92551 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201154.712775:0:93177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93177:1875060715200512:0@lo:104: 00000100:00100000:3.0:1788201154.712839:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201154.712859:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201154.712878:0:93177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93177:1875060715200896:0@lo:104: 00010000:00010000:3.0:1788201154.712899:0:93177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ed400/0x96d0c9b8c9a1bd78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd71 expref: 24 pid: 92550 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201154.712908:0:93177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93177:1875060715201024:0@lo:104: 00000100:00100000:3.0:1788201154.712917:0:93177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93177:1875060715201152:0@lo:104: 00010000:00010000:3.0:1788201154.712925:0:93177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1bd32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd2b expref: 23 pid: 92550 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201154.712933:0:93177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93177:1875060715201280:0@lo:104: 00010000:00010000:3.0:1788201154.712942:0:93177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1bd01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bcfa expref: 22 pid: 92550 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201154.712950:0:93177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93177:1875060715201408:0@lo:104: 00000100:00100000:3.0:1788201154.712957:0:93177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93177:1875060715201536:0@lo:104: 00000100:00100000:3.0:1788201154.712966:0:93177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93177:1875060715200000:192.168.201.20@tcp:104: 00000100:00100000:0.0:1788201154.713069:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715201920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201154.713079:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715202432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201154.713256:0:93177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93177:1875060715200128:192.168.201.20@tcp:104: 00010000:00010000:3.0:1788201154.713288:0:93177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dc1064eca00/0x96d0c9b8c9a1c114 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201154.713367:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695409280 00000100:00100000:2.0:1788201154.713373:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695409280 00010000:00010000:2.0:1788201154.713393:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc007adf600/0x96d0c9b8c9a1c10d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786848 expref: 10 pid: 92554 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201154.713406:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695409408 00000100:00100000:2.0:1788201154.713408:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695409408 00010000:00010000:2.0:1788201154.713417:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1c0ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78683a expref: 11 pid: 92554 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201154.713428:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2569 00000100:00100000:2.0:1788201154.713433:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133f4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+20:3657:x1875060715202176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201154.713441:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201154.713445:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc005da6a00/0x96d0c9b8c9a1bd4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd47 expref: 20 pid: 92549 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.713453:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc005da6a00/0x96d0c9b8c9a1bd4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd47 expref: 20 pid: 92549 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.713463:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc005da6a00/0x96d0c9b8c9a1bd4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd47 expref: 20 pid: 92549 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.713484:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201154.713580:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133f4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+19:3657:x1875060715202176:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (4297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201154.713587:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2569 00000100:00100000:2.0:1788201154.713601:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2570 00000100:00100000:2.0:1788201154.713608:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133f4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+18:3657:x1875060715201792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201154.713618:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201154.713622:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc0078fd400/0x96d0c9b8c9a1bd86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd7f expref: 18 pid: 92551 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.713695:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc0078fd400/0x96d0c9b8c9a1bd86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd7f expref: 18 pid: 92551 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.713706:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fd400/0x96d0c9b8c9a1bd86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bd7f expref: 18 pid: 92551 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.713714:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201154.713738:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133f4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+17:3657:x1875060715201792:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (4415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201154.713743:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2570 00000100:00100000:2.0:1788201154.713756:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2571 00000100:00100000:2.0:1788201154.713762:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+16:3657:x1875060715202304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201154.713769:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201154.713774:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc005da7800/0x96d0c9b8c9a1bc21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bc1a expref: 16 pid: 92551 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.713781:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc005da7800/0x96d0c9b8c9a1bc21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bc1a expref: 16 pid: 92551 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.713797:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc005da7800/0x96d0c9b8c9a1bc21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1bc1a expref: 16 pid: 92551 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.713805:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201154.713827:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+15:3657:x1875060715202304:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (4463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201154.713832:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2571 00000100:00100000:2.0:1788201154.713845:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2572 00000100:00100000:2.0:1788201154.713852:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ba7067-43b5-4e46-8db7-27c040fa03d9+11:2400:x1875060695409280:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201154.713862:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201154.713866:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc007adf600/0x96d0c9b8c9a1c10d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786848 expref: 11 pid: 92554 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.713875:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc007adf600/0x96d0c9b8c9a1c10d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786848 expref: 11 pid: 92554 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.713885:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007adf600/0x96d0c9b8c9a1c10d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786848 expref: 11 pid: 92554 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.713894:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201154.714088:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201154.714124:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201154.714337:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695409280:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 122us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201154.714344:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2572 00000100:00100000:2.0:1788201154.714359:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2573 00000100:00100000:2.0:1788201154.714368:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10a10e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:2400:x1875060695409408:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201154.714375:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201154.714385:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1c0ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78683a expref: 9 pid: 92554 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.714394:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1c0ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78683a expref: 9 pid: 92554 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.714403:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1c0ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78683a expref: 9 pid: 92554 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.714413:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dc1064eca00/0x96d0c9b8c9a1c114 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.714421:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064eca00/0x96d0c9b8c9a1c114 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.714435:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc1064eca00/0x96d0c9b8c9a1c114 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.714442:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc1064eca00/0x96d0c9b8c9a1c114 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.714448:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc1064eca00/0x96d0c9b8c9a1c114 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.714454:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc1064eca00/0x96d0c9b8c9a1c114 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.714459:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064eca00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201154.714463:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc1064eca00/0x96d0c9b8c9a1c114 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.714470:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc1064eca00/0x96d0c9b8c9a1c114 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201154.715790:0:93177:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dc1064eca00/0x96d0c9b8c9a1c114 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201154.715805:0:93177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc1064eca00/0x96d0c9b8c9a1c114 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.716590:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc1064eca00/0x96d0c9b8c9a1c114 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.716603:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064eca00/0x96d0c9b8c9a1c114 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201154.716622:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201154.717404:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10a10e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:2400:x1875060695409408:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 2600us (4105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201154.717419:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2573 00000100:00100000:2.0:1788201154.717836:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715201792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201154.717851:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715202304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201154.717859:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715201664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201154.717867:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00586c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715202176:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201155.346067:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788201156.047143:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788201156.047153:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc11d63c000 from 52 10000000:01000000:0.0:1788201156.047160:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201156.047231:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c11b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201156.047244:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c11b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201156.047256:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c11b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201156.047283:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715202560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201156.047383:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201156.047442:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004f93d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201156.047533:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715202560 00000100:00100000:2.0:1788201156.047541:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715202560 00000100:00100000:2.0:1788201156.047600:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788201156.047610:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715202560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201156.047620:0:92554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201156.047632:0:92554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007adf600/0x96d0c9b8c9a1c122 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c11b expref: -99 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201156.047655:0:92554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007adf600/0x96d0c9b8c9a1c122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c11b expref: 16 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201156.047678:0:92554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007adf600/0x96d0c9b8c9a1c122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c11b expref: 16 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201156.047687:0:92554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007adf600, rc 0) 00000100:00100000:2.0:1788201156.047744:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715202560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201156.047751:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788201156.048011:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715202560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201156.048061:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c11b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c122 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201156.048077:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c11b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c122 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201156.048142:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715202688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201156.048173:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201156.048292:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc101254480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201156.054251:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715202688 00000100:00100000:1.0:1788201156.054269:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715202688 00000100:00100000:1.0:1788201156.054366:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788201156.054378:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715202688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201156.054582:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715202688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 206us (6407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201156.054590:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788201156.054833:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715202688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201156.054898:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715202816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201156.054956:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201156.054999:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc101254480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201156.055136:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715202816 00000100:00100000:2.0:1788201156.055142:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715202816 00000100:00100000:2.0:1788201156.055181:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788201156.055189:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715202816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201156.055279:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715202816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201156.055304:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788201156.056406:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715202816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201156.059204:0:93178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93178:1875060715202944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201156.059304:0:93178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201156.059391:0:93178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc101254600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201156.066144:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715202944 00000100:00100000:1.0:1788201156.066163:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715202944 00000100:00100000:1.0:1788201156.066244:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788201156.066255:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+16:93178:x1875060715202944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201156.066465:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+16:93178:x1875060715202944:12345-0@lo:502:llog_process_th.0 Request processed in 212us (7180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201156.066474:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788201156.067064:0:93178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93178:1875060715202944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201156.067139:0:93178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93178:1875060715203072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201156.067190:0:93178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201156.067231:0:93178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc101254600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201156.067412:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715203072 00000100:00100000:2.0:1788201156.067419:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715203072 00000100:00100000:2.0:1788201156.067459:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788201156.067467:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+16:93178:x1875060715203072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201156.067564:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+16:93178:x1875060715203072:12345-0@lo:502:llog_process_th.0 Request processed in 97us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201156.067571:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788201156.067806:0:93178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93178:1875060715203072:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788201156.067829:0:93178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:0.0:1788201156.068108:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:0.0:1788201156.068134:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201156.068146:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c11b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c122 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201156.068156:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c11b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c122 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201156.068166:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788201156.068169:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 46 10000000:01000000:0.0:1788201156.068172:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788201156.068197:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782d800/0x96d0c9b8c9a1c129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201156.068205:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc00782d800/0x96d0c9b8c9a1c129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201156.068214:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc00782d800/0x96d0c9b8c9a1c129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201156.068239:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715203200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201156.068272:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201156.068326:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004f933c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201156.068491:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715203200 00000100:00100000:2.0:1788201156.068498:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715203200 00000100:00100000:2.0:1788201156.068534:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788201156.068542:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715203200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201156.068552:0:92551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201156.068569:0:92551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1c130 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c129 expref: -99 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201156.068591:0:92551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1c130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c129 expref: 17 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201156.068602:0:92551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1c130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c129 expref: 17 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201156.068610:0:92551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007adf200, rc 0) 00000100:00100000:2.0:1788201156.068652:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715203200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201156.068659:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788201156.068760:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715203200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201156.068772:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc00782d800/0x96d0c9b8c9a1c129 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c130 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201156.068786:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc00782d800/0x96d0c9b8c9a1c129 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c130 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201156.068838:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715203328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201156.068937:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201156.068961:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc101254600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201156.069080:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715203328 00000100:00100000:2.0:1788201156.069084:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715203328 00000100:00100000:2.0:1788201156.069146:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788201156.069154:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715203328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201156.069265:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715203328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201156.069272:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788201156.069342:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715203328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201156.069370:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715203456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201156.069404:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201156.082372:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc101254600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201156.091272:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715203456 00000100:00100000:0.0:1788201156.091304:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715203456 00000100:00100000:0.0:1788201156.091391:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788201156.091402:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715203456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201156.091583:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715203456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (22176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201156.091590:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788201156.091715:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715203456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201156.093112:0:93179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93179:1875060715203584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201156.093181:0:93179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201156.093225:0:93179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004e40d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201156.093328:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715203584 00000100:00100000:0.0:1788201156.093336:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715203584 00000100:00100000:0.0:1788201156.093378:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788201156.093386:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:93179:x1875060715203584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201156.093500:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:93179:x1875060715203584:12345-0@lo:502:llog_process_th.0 Request processed in 114us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201156.093506:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788201156.093617:0:93179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93179:1875060715203584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201156.093645:0:93179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201156.093655:0:93179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201156.093658:0:93179:0:(obd_config.c:1563:class_process_config()) marker 43 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:2.0:1788201156.093663:0:93179:0:(obd_config.c:1472:class_process_config()) processing cmd: ce020 00020000:01000000:2.0:1788201156.093726:0:93179:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00080000:10000000:2.0:1788201156.094402:0:93179:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00080000:10000000:2.0:1788201156.102991:0:93179:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00080000:10000000:2.0:1788201156.107901:0:93179:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x53:0x0] (8/32) registered 00000100:00100000:2.0:1788201156.110930:0:93179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93179:1875060715203712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201156.111092:0:93179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201156.111175:0:93179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006e9a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201156.111809:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715203712 00000100:00100000:3.0:1788201156.111819:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715203712 00000100:00100000:0.0:1788201156.113208:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788201156.113220:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+17:93179:x1875060715203712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201156.113560:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+17:93179:x1875060715203712:12345-0@lo:502:llog_process_th.0 Request processed in 340us (2467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201156.113568:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788201156.116891:0:93179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93179:1875060715203712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201156.117010:0:93179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93179:1875060715203840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201156.117159:0:93179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201156.117245:0:93179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1030cb000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201156.120674:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715203840 00000100:00100000:0.0:1788201156.120689:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715203840 00000100:00100000:0.0:1788201156.120755:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788201156.120779:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:93179:x1875060715203840:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201156.120988:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:93179:x1875060715203840:12345-0@lo:502:llog_process_th.0 Request processed in 209us (3829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201156.120996:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788201156.122393:0:93179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93179:1875060715203840:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201156.130973:0:93179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201156.130990:0:93179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201156.130993:0:93179:0:(obd_config.c:1563:class_process_config()) marker 43 (0x2) lustre-MDT0000-m new lustre.pool_134 00000040:00080000:3.0:1788201156.131001:0:93179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 50 count 49 00000020:01000000:0.0:1788201156.131404:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 46-49 (rc=0) 10000000:01000000:0.0:1788201156.131430:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788201156.131442:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782d800/0x96d0c9b8c9a1c129 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c130 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201156.131454:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc00782d800/0x96d0c9b8c9a1c129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c130 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201156.131466:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788201156.131468:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc0053a4000 from 52 10000000:01000000:0.0:1788201156.131471:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201156.131508:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782d200/0x96d0c9b8c9a1c137 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201156.131516:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc00782d200/0x96d0c9b8c9a1c137 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201156.131527:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc00782d200/0x96d0c9b8c9a1c137 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201156.131553:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715203968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201156.131622:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201156.131730:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1254466c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201156.135738:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715203968 00000100:00100000:2.0:1788201156.135755:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715203968 00000100:00100000:2.0:1788201156.135823:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788201156.135833:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715203968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201156.135851:0:92554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201156.135881:0:92554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007ade200/0x96d0c9b8c9a1c13e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c137 expref: -99 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201156.135912:0:92554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007ade200/0x96d0c9b8c9a1c13e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c137 expref: 18 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201156.135923:0:92554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007ade200/0x96d0c9b8c9a1c13e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c137 expref: 18 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201156.135932:0:92554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ade200, rc 0) 00000100:00100000:2.0:1788201156.136045:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715203968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (4421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201156.136052:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788201156.136318:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715203968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201156.136347:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc00782d200/0x96d0c9b8c9a1c137 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c13e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201156.136356:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc00782d200/0x96d0c9b8c9a1c137 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c13e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201156.136432:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715204096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201156.136466:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201156.136506:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1254466c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201156.136609:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715204096 00000100:00100000:3.0:1788201156.136615:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715204096 00000100:00100000:3.0:1788201156.136652:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788201156.136660:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715204096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201156.136794:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715204096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201156.136801:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788201156.136891:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715204096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201156.136919:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715204224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201156.136960:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201156.136984:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201156.137148:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715204224 00000100:00100000:2.0:1788201156.137154:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715204224 00000100:00100000:2.0:1788201156.137194:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788201156.137201:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715204224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201156.137455:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715204224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201156.137794:0:93180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93180:1875060715204352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201156.144096:0:93180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201156.144292:0:93180:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201156.144449:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715204352 00000100:00100000:0.0:1788201156.144461:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715204352 00000100:00100000:0.0:1788201156.144528:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788201156.144538:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:93180:x1875060715204352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201156.144715:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:93180:x1875060715204352:12345-0@lo:502:llog_process_th.0 Request processed in 178us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201156.144723:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788201156.145081:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715204224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 7878us (8118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201156.145090:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788201156.145527:0:93180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93180:1875060715204352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201156.145594:0:93180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93180:1875060715204480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201156.145633:0:93180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201156.145652:0:93180:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201156.145706:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715204480 00000100:00100000:0.0:1788201156.145711:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715204480 00000100:00100000:0.0:1788201156.145746:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788201156.145753:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:93180:x1875060715204480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201156.145835:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:93180:x1875060715204480:12345-0@lo:502:llog_process_th.0 Request processed in 81us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201156.145842:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788201156.145989:0:93180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93180:1875060715204480:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788201156.146009:0:93180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1788201156.146246:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1788201156.146271:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201156.146281:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782d200/0x96d0c9b8c9a1c137 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c13e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201156.146310:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc00782d200/0x96d0c9b8c9a1c137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c13e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201156.146320:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788201156.146322:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1788201156.146325:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788201156.146348:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c145 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201156.146356:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c145 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201156.146365:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c145 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201156.146377:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715204608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201156.146402:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201156.146419:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc101254840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201156.146506:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715204608 00000100:00100000:2.0:1788201156.146511:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715204608 00000100:00100000:2.0:1788201156.146543:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788201156.146549:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715204608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201156.146558:0:92554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201156.146570:0:92554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007adec00/0x96d0c9b8c9a1c14c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c145 expref: -99 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201156.146590:0:92554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007adec00/0x96d0c9b8c9a1c14c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c145 expref: 19 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201156.146599:0:92554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007adec00/0x96d0c9b8c9a1c14c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c145 expref: 19 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201156.146608:0:92554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007adec00, rc 0) 00000100:00100000:2.0:1788201156.146634:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715204608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201156.146640:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788201156.146710:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715204608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201156.146722:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c145 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c14c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201156.146730:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c145 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c14c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201156.146776:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715204736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201156.146802:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201156.146822:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc101254840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201156.146984:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715204736 00000100:00100000:0.0:1788201156.146988:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715204736 00000100:00100000:0.0:1788201156.147034:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788201156.147041:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715204736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201156.147417:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715204736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 375us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201156.147425:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788201156.156080:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715204736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201156.156173:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715204864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201156.156269:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201156.156329:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc101254840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201156.156553:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715204864 00000100:00100000:2.0:1788201156.156561:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715204864 00000100:00100000:2.0:1788201156.156616:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788201156.156627:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715204864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201156.156750:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715204864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201156.156758:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788201156.157055:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715204864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201156.158117:0:93181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93181:1875060715204992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201156.158183:0:93181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201156.158221:0:93181:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201156.158424:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715204992 00000100:00100000:2.0:1788201156.158430:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715204992 00000100:00100000:2.0:1788201156.158471:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788201156.158480:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:93181:x1875060715204992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201156.160452:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:93181:x1875060715204992:12345-0@lo:502:llog_process_th.0 Request processed in 1964us (2260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201156.160464:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788201156.170621:0:93181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93181:1875060715204992:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201156.170782:0:93181:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201156.170798:0:93181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201156.170801:0:93181:0:(obd_config.c:1563:class_process_config()) marker 44 (0x1) lustre-MDT0001-m new lustre.pool_134 00000020:00000080:2.0:1788201156.170809:0:93181:0:(obd_config.c:1472:class_process_config()) processing cmd: ce020 00020000:01000000:2.0:1788201156.170877:0:93181:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:2.0:1788201156.170918:0:93181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93181:1875060715205120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201156.170998:0:93181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201156.171070:0:93181:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0010eb540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201156.171252:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715205120 00000100:00100000:3.0:1788201156.171260:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715205120 00000100:00100000:3.0:1788201156.171321:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788201156.171331:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:93181:x1875060715205120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201156.171467:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:93181:x1875060715205120:12345-0@lo:502:llog_process_th.0 Request processed in 137us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201156.171475:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788201156.171563:0:93181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93181:1875060715205120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201156.171603:0:93181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93181:1875060715205248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201156.171637:0:93181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201156.171649:0:93181:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201156.173584:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715205248 00000100:00100000:2.0:1788201156.173596:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715205248 00000100:00100000:2.0:1788201156.173660:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788201156.173670:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+19:93181:x1875060715205248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201156.173838:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+19:93181:x1875060715205248:12345-0@lo:502:llog_process_th.0 Request processed in 168us (2200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201156.173853:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788201156.173955:0:93181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93181:1875060715205248:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201156.173992:0:93181:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201156.173999:0:93181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201156.174002:0:93181:0:(obd_config.c:1563:class_process_config()) marker 44 (0x2) lustre-MDT0001-m new lustre.pool_134 00000040:00080000:1.0:1788201156.174006:0:93181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 50 count 49 00000020:01000000:2.0:1788201156.174354:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-49 (rc=0) 10000000:01000000:2.0:1788201156.174382:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788201156.174394:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c145 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c14c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201156.174404:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c14c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201156.174415:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788201156.174417:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc001db6000 from 52 10000000:01000000:2.0:1788201156.174420:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788201156.174447:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adfe00/0x96d0c9b8c9a1c153 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201156.174455:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007adfe00/0x96d0c9b8c9a1c153 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201156.174464:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007adfe00/0x96d0c9b8c9a1c153 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201156.174494:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715205376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201156.174540:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201156.174577:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0010eba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201156.174633:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715205376 00000100:00100000:0.0:1788201156.174638:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715205376 00000100:00100000:0.0:1788201156.174681:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788201156.174689:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715205376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201156.174698:0:92551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201156.174711:0:92551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782c000/0x96d0c9b8c9a1c15a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c153 expref: -99 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201156.174732:0:92551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782c000/0x96d0c9b8c9a1c15a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c153 expref: 20 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201156.174742:0:92551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782c000/0x96d0c9b8c9a1c15a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c153 expref: 20 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201156.174760:0:92551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782c000, rc 0) 00000100:00100000:0.0:1788201156.174807:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715205376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201156.174813:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788201156.174889:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715205376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201156.174902:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007adfe00/0x96d0c9b8c9a1c153 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c15a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201156.174911:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007adfe00/0x96d0c9b8c9a1c153 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c15a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201156.174962:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715205504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201156.174991:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201156.175048:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201156.175142:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715205504 00000100:00100000:3.0:1788201156.175147:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715205504 00000100:00100000:3.0:1788201156.175182:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788201156.175190:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715205504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201156.175311:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715205504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201156.175317:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788201156.175462:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715205504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201156.175500:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715205632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201156.175551:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201156.175582:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201156.175643:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715205632 00000100:00100000:0.0:1788201156.175647:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715205632 00000100:00100000:0.0:1788201156.175676:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788201156.175682:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715205632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201156.175758:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715205632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201156.175771:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788201156.175845:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715205632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201156.177332:0:93182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93182:1875060715205760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201156.177399:0:93182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201156.177431:0:93182:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201156.177489:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715205760 00000100:00100000:0.0:1788201156.177496:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715205760 00000100:00100000:0.0:1788201156.177538:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788201156.177546:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:93182:x1875060715205760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201156.177657:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:93182:x1875060715205760:12345-0@lo:502:llog_process_th.0 Request processed in 111us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201156.177663:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788201156.177752:0:93182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93182:1875060715205760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201156.177800:0:93182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93182:1875060715205888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201156.177834:0:93182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201156.177865:0:93182:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0010eba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201156.177920:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715205888 00000100:00100000:3.0:1788201156.177925:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715205888 00000100:00100000:3.0:1788201156.177958:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788201156.177965:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+20:93182:x1875060715205888:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201156.178081:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+20:93182:x1875060715205888:12345-0@lo:502:llog_process_th.0 Request processed in 116us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201156.178087:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788201156.178222:0:93182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93182:1875060715205888:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788201156.178243:0:93182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1788201156.178531:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1788201156.178556:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201156.178566:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adfe00/0x96d0c9b8c9a1c153 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c15a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201156.178575:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007adfe00/0x96d0c9b8c9a1c153 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c15a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201156.178586:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788201156.178589:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1788201156.178591:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788201156.178613:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201156.178620:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201156.178629:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201156.178642:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715206016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201156.178670:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201156.178699:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc11d0f1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201156.178756:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715206016 00000100:00100000:0.0:1788201156.178764:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715206016 00000100:00100000:0.0:1788201156.178800:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788201156.178806:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715206016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201156.178819:0:92549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201156.178832:0:92549:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782cc00/0x96d0c9b8c9a1c168 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c161 expref: -99 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201156.178853:0:92549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782cc00/0x96d0c9b8c9a1c168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c161 expref: 21 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201156.178861:0:92549:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782cc00/0x96d0c9b8c9a1c168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c161 expref: 21 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201156.178869:0:92549:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782cc00, rc 0) 00000100:00100000:0.0:1788201156.178906:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715206016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201156.178919:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788201156.178991:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715206016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201156.179005:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c168 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201156.179044:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c168 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201156.179094:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715206144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201156.179120:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201156.179148:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc104ea0480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201156.179273:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715206144 00000100:00100000:1.0:1788201156.179279:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715206144 00000100:00100000:1.0:1788201156.179316:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788201156.179323:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715206144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201156.179423:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715206144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201156.179429:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788201156.180267:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715206144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201156.180320:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715206272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201156.180368:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201156.180397:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc11d0f1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201156.180448:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715206272 00000100:00100000:0.0:1788201156.180457:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715206272 00000100:00100000:0.0:1788201156.180486:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788201156.180494:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715206272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201156.180588:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715206272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201156.180595:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788201156.180783:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715206272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788201156.197358:0:93183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1788201156.206496:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1788201156.206544:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788201156.206559:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c161 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c168 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201156.206573:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c168 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201156.206609:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788201156.206612:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc13aa9f000 from 52 10000000:01000000:2.0:1788201156.206616:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788201156.206659:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adf000/0x96d0c9b8c9a1c16f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201156.206667:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007adf000/0x96d0c9b8c9a1c16f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201156.206697:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007adf000/0x96d0c9b8c9a1c16f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201156.206723:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715206400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201156.206796:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201156.206891:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc104ea0300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201156.216392:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715206400 00000100:00100000:3.0:1788201156.216411:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715206400 00000100:00100000:3.0:1788201156.216494:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788201156.216507:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715206400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201156.216524:0:92554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201156.216545:0:92554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc125ae3800/0x96d0c9b8c9a1c176 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c16f expref: -99 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201156.216577:0:92554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc125ae3800/0x96d0c9b8c9a1c176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c16f expref: 22 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201156.216589:0:92554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc125ae3800/0x96d0c9b8c9a1c176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c16f expref: 22 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201156.216598:0:92554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3800, rc 0) 00000100:00100000:3.0:1788201156.216737:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715206400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 233us (9939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201156.216744:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788201156.224574:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715206400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201156.224610:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007adf000/0x96d0c9b8c9a1c16f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c176 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201156.224625:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007adf000/0x96d0c9b8c9a1c16f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c176 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201156.235134:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715206528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201156.235207:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201156.235254:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc104ea0300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201156.235460:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715206528 00000100:00100000:0.0:1788201156.235469:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715206528 00000100:00100000:0.0:1788201156.235528:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788201156.235538:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715206528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201156.235682:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715206528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201156.235691:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788201156.235736:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715206528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201156.235767:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715206656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201156.235815:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201156.235830:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13aa35180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201156.236450:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715206656 00000100:00100000:2.0:1788201156.236456:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715206656 00000100:00100000:2.0:1788201156.236495:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788201156.236502:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715206656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201156.236599:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715206656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201156.236606:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788201156.236695:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715206656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201156.237221:0:93184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93184:1875060715206784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201156.237265:0:93184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201156.237313:0:93184:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13aa35c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201156.237532:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715206784 00000100:00100000:3.0:1788201156.237537:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715206784 00000100:00100000:3.0:1788201156.237576:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788201156.237584:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:93184:x1875060715206784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201156.237693:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:93184:x1875060715206784:12345-0@lo:502:llog_process_th.0 Request processed in 109us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201156.237706:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788201156.238651:0:93184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93184:1875060715206784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201156.238706:0:93184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93184:1875060715206912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201156.238745:0:93184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201156.238781:0:93184:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13aa35c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201156.238927:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715206912 00000100:00100000:1.0:1788201156.238934:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715206912 00000100:00100000:1.0:1788201156.238972:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788201156.238980:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:93184:x1875060715206912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201156.239096:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:93184:x1875060715206912:12345-0@lo:502:llog_process_th.0 Request processed in 116us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201156.239103:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788201156.239324:0:93184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93184:1875060715206912:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788201156.239346:0:93184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:1.0:1788201156.239690:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:1.0:1788201156.239712:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201156.239722:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adf000/0x96d0c9b8c9a1c16f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c176 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201156.239732:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007adf000/0x96d0c9b8c9a1c16f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c176 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201156.239742:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788201156.239744:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1788201156.239747:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788201156.239772:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1c17d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201156.239785:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1c17d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201156.239794:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1c17d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201156.239807:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715207040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201156.239837:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201156.239866:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201156.239916:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715207040 00000100:00100000:3.0:1788201156.239922:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715207040 00000100:00100000:3.0:1788201156.239954:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788201156.239962:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715207040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201156.239971:0:92549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201156.239984:0:92549:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc125ae2800/0x96d0c9b8c9a1c184 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c17d expref: -99 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201156.240004:0:92549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc125ae2800/0x96d0c9b8c9a1c184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c17d expref: 23 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201156.240047:0:92549:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc125ae2800/0x96d0c9b8c9a1c184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c17d expref: 23 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201156.240056:0:92549:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2800, rc 0) 00000100:00100000:3.0:1788201156.240099:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715207040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201156.240105:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788201156.240411:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715207040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201156.240425:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1c17d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c184 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201156.240434:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1c17d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c184 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201156.240482:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715207168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201156.240508:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201156.240536:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201156.240585:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715207168 00000100:00100000:0.0:1788201156.240589:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715207168 00000100:00100000:0.0:1788201156.240622:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788201156.240629:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715207168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201156.240735:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715207168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201156.240741:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788201156.241082:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715207168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201156.241109:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715207296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201156.241162:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201156.241188:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201156.241966:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715207296 00000100:00100000:3.0:1788201156.241973:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715207296 00000100:00100000:3.0:1788201156.242011:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788201156.242040:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715207296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201156.242158:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715207296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201156.242166:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788201156.242389:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715207296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201156.245164:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201156.245499:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695409536 00000100:00100000:3.0:1788201156.245521:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695409536 00000100:00100000:3.0:1788201156.245576:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 114 00000100:00100000:3.0:1788201156.245586:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71021:x1875060695409536:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201156.245604:0:92550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201156.245624:0:92550:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c18b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78684f expref: -99 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201156.245653:0:92550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c18b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78684f expref: 9 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201156.245664:0:92550:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c18b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78684f expref: 9 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201156.245674:0:92550:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2600, rc 0) 00000100:00100000:3.0:1788201156.245736:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695409536:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 151us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201156.245744:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 114 00000040:00080000:2.0:1788201156.246523:0:93185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1788201156.247264:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1788201156.247320:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788201156.247330:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1c17d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c184 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201156.247340:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1c17d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c184 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201156.247350:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788201156.247352:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dc12563cd28 from 1 10000000:01000000:1.0:1788201156.247355:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788201156.247386:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1c192 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201156.247393:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1c192 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201156.247403:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1c192 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201156.247425:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715207424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201156.247483:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201156.247526:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201156.247605:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715207424 00000100:00100000:0.0:1788201156.247612:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715207424 00000100:00100000:0.0:1788201156.247662:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788201156.247671:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715207424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201156.247682:0:92554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201156.247696:0:92554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782c800/0x96d0c9b8c9a1c199 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c192 expref: -99 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201156.247720:0:92554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782c800/0x96d0c9b8c9a1c199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c192 expref: 24 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201156.247730:0:92554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782c800/0x96d0c9b8c9a1c199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c192 expref: 24 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201156.247738:0:92554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782c800, rc 0) 00000100:00100000:0.0:1788201156.247775:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715207424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201156.247790:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788201156.248013:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715207424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201156.248050:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1c192 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c199 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201156.248058:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1c192 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c199 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201156.248106:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715207552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201156.248146:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201156.248162:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201156.248355:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715207552 00000100:00100000:0.0:1788201156.248360:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715207552 00000100:00100000:0.0:1788201156.248389:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788201156.248395:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715207552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201156.248466:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715207552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (319us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201156.248473:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788201156.249334:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715207552:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788201156.249370:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788201156.249379:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1c192 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c199 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201156.249387:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1c192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c199 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201156.249526:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201156.249681:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695409664 00000100:00100000:1.0:1788201156.249687:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695409664 00000100:00100000:1.0:1788201156.249728:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 117 00000100:00100000:1.0:1788201156.249736:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695409664:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201156.249856:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695409664:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 119us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201156.249863:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 117 00000100:00100000:0.0:1788201156.260494:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201156.260713:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695409792 00000100:00100000:3.0:1788201156.260725:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695409792 00000100:00100000:3.0:1788201156.260772:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 118 00000100:00100000:3.0:1788201156.260780:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695409792:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201156.260906:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695409792:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 126us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201156.260914:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 118 00000100:00100000:3.0:1788201156.270331:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201156.270467:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695409920 00000100:00100000:1.0:1788201156.270479:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695409920 00000100:00100000:1.0:1788201156.270541:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 119 00000100:00100000:1.0:1788201156.270552:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71969:x1875060695409920:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788201156.270717:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71969:x1875060695409920:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 166us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201156.270725:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 119 00000100:00100000:2.0:1788201156.273552:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201156.273635:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695410048 00000100:00100000:3.0:1788201156.273644:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695410048 00000100:00100000:3.0:1788201156.273702:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 120 00000100:00100000:3.0:1788201156.273711:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71969:x1875060695410048:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788201156.273832:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71969:x1875060695410048:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 121us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201156.273839:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 120 00000100:00100000:2.0:1788201156.282741:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201156.282907:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695410176 00000100:00100000:1.0:1788201156.282917:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695410176 00000100:00100000:1.0:1788201156.282988:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 121 00000100:00100000:1.0:1788201156.282998:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc139e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695410176:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201156.283061:0:92549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201156.283084:0:92549:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064ec400/0x96d0c9b8c9a1c1a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786856 expref: -99 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201156.283112:0:92549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ec400/0x96d0c9b8c9a1c1a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786856 expref: 10 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201156.283123:0:92549:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064ec400/0x96d0c9b8c9a1c1a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786856 expref: 10 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201156.283142:0:92549:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ec400, rc 0) 00000100:00100000:1.0:1788201156.283196:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc139e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695410176:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 199us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201156.283204:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 121 00000100:00100000:0.0:1788201156.293419:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201156.294274:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695410304 00000100:00100000:1.0:1788201156.294285:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695410304 00000100:00100000:1.0:1788201156.294359:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 122 00000100:00100000:1.0:1788201156.294369:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12eddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695410304:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201156.294496:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12eddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695410304:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 127us (1087us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201156.294504:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 122 00010000:00010000:0.0:1788201156.367190:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201157.392570:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201157.594454:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201157.594498:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201157.594525:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201157.594544:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201157.594568:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695410816 00000100:00100000:2.0:1788201157.594576:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695410816 00000100:00100000:2.0:1788201157.594629:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2827 00000100:00100000:2.0:1788201157.594639:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695410816:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201157.594702:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695410816:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 66us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201157.594709:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2827 00000100:00100000:1.0:1788201157.594765:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695410560 00000100:00100000:1.0:1788201157.594770:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695410560 00000100:00100000:1.0:1788201157.594806:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1403 00000100:00100000:1.0:1788201157.594813:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695410560:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201157.594845:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695410560:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 33us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201157.594852:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1403 00000100:00100000:1.0:1788201157.594864:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695410688 00000100:00100000:1.0:1788201157.594867:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695410688 00000100:00100000:1.0:1788201157.594886:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1404 00000100:00100000:1.0:1788201157.594891:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695410688:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201157.594909:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695410688:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 18us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201157.594915:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1404 00000100:00100000:1.0:1788201157.594930:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695410432 00000100:00100000:1.0:1788201157.594932:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695410432 00000100:00100000:1.0:1788201157.594952:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 123 00000100:00100000:1.0:1788201157.594957:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12eddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695410432:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201157.594989:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12eddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695410432:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 32us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201157.594995:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 123 00000100:00080000:1.0:1788201157.595162:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201157.595166:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201157.595168:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201157.968788:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715207808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201157.968858:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201157.971044:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715207808 00000100:00100000:2.0:1788201157.971056:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715207808 00000100:00100000:2.0:1788201157.971117:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2292 00000100:00100000:2.0:1788201157.971127:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715207808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201157.971155:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201157.972809:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715207808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1680us (3947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201157.972821:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2292 00000100:00080000:2.0:1788201157.972853:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201157.973111:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715207680:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201157.973159:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201157.974915:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715207680 00000100:00100000:2.0:1788201157.974928:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715207680 00000100:00100000:2.0:1788201157.974988:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2293 00000100:00100000:2.0:1788201157.974998:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715207680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201157.975052:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788201157.975119:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715207680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (1960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201157.975136:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2293 00000100:00080000:2.0:1788201157.975156:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201157.975191:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715207680:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201157.976275:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715207808:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788201158.417181:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201158.482483:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715207936:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201158.482588:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201158.482671:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715207936 00000100:00100000:0.0:1788201158.482681:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715207936 00000100:00100000:0.0:1788201158.482739:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4008 00000100:00100000:0.0:1788201158.482748:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715207936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201158.482792:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444900864 avail 1298661376 00000100:00100000:0.0:1788201158.482844:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715207936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201158.482851:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4008 00000100:00100000:0.0:1788201158.482903:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715207936:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201158.484867:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715208064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201158.484953:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201158.485450:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715208448:0@lo:400:kworker.0 00000100:00100000:1.0:1788201158.485469:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715208192:0@lo:400:kworker.0 00000100:00100000:0.0:1788201158.485498:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201158.485523:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201158.485538:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715208960:0@lo:400:kworker.0 00000100:00100000:1.0:1788201158.485563:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715208704:0@lo:400:kworker.0 00000100:00100000:0.0:1788201158.485574:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201158.485599:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201158.485609:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788201158.485618:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715208320:0@lo:400:kworker.0 00000100:00100000:1.0:1788201158.485625:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715209216:0@lo:400:kworker.0 00000100:00100000:0.0:1788201158.485650:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201158.485668:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201158.485676:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715208832:0@lo:400:kworker.0 00000100:00100000:0.0:1788201158.485704:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201158.485741:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715208448 00000100:00100000:0.0:1788201158.485750:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715208448 00000100:00100000:0.0:1788201158.485811:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715208704 00000100:00100000:0.0:1788201158.485815:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715208704 00000100:00100000:0.0:1788201158.485830:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715208320 00000100:00100000:0.0:1788201158.485833:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715208320 00000100:00100000:0.0:1788201158.485850:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715209216 00000100:00100000:0.0:1788201158.485852:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715209216 00000100:00100000:1.0:1788201158.485865:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788201158.485868:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715208832 00000100:00100000:0.0:1788201158.485872:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715208832 00000100:00100000:1.0:1788201158.485876:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715208576:0@lo:400:kworker.0 00000100:00100000:0.0:1788201158.485890:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:0.0:1788201158.485902:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715208448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201158.485913:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201158.485928:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715209088:0@lo:400:kworker.0 00000100:00100000:1.0:1788201158.485964:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201158.485974:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715208448:12345-0@lo:400:kworker.0 Request processed in 74us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201158.485982:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00100000:0.0:1788201158.486006:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715208576 00000100:00100000:1.0:1788201158.486006:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715208192 00000100:00100000:1.0:1788201158.486012:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715208192 00000100:00100000:0.0:1788201158.486036:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715208576 00000100:00100000:0.0:1788201158.486057:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:0.0:1788201158.486063:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715208704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201158.486099:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715208704:12345-0@lo:400:kworker.0 Request processed in 36us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201158.486105:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000100:00100000:0.0:1788201158.486124:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:0.0:1788201158.486129:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715208320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201158.486159:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715208320:12345-0@lo:400:kworker.0 Request processed in 30us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201158.486165:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00100000:0.0:1788201158.486178:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:0.0:1788201158.486184:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715209216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201158.486379:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715209216:12345-0@lo:400:kworker.0 Request processed in 193us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201158.486386:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00000100:00100000:0.0:1788201158.486400:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:0.0:1788201158.486406:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715208832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201158.486436:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715208832:12345-0@lo:400:kworker.0 Request processed in 29us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201158.486442:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00100000:0.0:1788201158.486453:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:0.0:1788201158.486461:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715208576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201158.486486:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788201158.486495:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715208576:12345-0@lo:400:kworker.0 Request processed in 35us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201158.486499:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12eddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715208192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201158.486508:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00080000:0.0:1788201158.486537:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201158.486542:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201158.486546:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12eddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715208192:12345-0@lo:400:kworker.0 Request processed in 50us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201158.486555:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788201158.486580:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715208320:0@lo:400:kworker.0 00000100:00100000:0.0:1788201158.486596:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715208832:0@lo:400:kworker.0 00000100:00100000:1.0:1788201158.486600:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715208960 00000100:00100000:1.0:1788201158.486606:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715208960 00000100:00100000:0.0:1788201158.486607:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715208448:0@lo:400:kworker.0 00000100:00100000:1.0:1788201158.486652:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715209088 00000100:00100000:1.0:1788201158.486656:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715209088 00000100:00100000:1.0:1788201158.486683:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2828 00000100:00100000:1.0:1788201158.486690:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715208960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201158.486694:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2829 00000100:00100000:0.0:1788201158.486704:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715209088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201158.486740:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715209088:12345-0@lo:400:kworker.0 Request processed in 38us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201158.486745:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2829 00000100:00080000:0.0:1788201158.486795:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201158.486797:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201158.486813:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715208576:0@lo:400:kworker.0 00000100:00100000:0.0:1788201158.486824:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715209088:0@lo:400:kworker.0 00000100:00100000:0.0:1788201158.486833:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715208192:0@lo:400:kworker.0 00000100:00100000:0.0:1788201158.486842:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715208704:0@lo:400:kworker.0 00000100:00100000:0.0:1788201158.486851:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715209216:0@lo:400:kworker.0 00000100:00100000:1.0:1788201158.489396:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715208960:12345-0@lo:400:kworker.0 Request processed in 2694us (3811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201158.489416:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2828 00000100:00100000:0.0:1788201158.489980:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715208960:0@lo:400:kworker.0 00000100:00100000:3.0:1788201158.490441:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715208064 00000100:00100000:3.0:1788201158.490453:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715208064 00000100:00100000:3.0:1788201158.490508:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4009 00000100:00100000:3.0:1788201158.490519:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715208064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788201158.490565:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445400576 avail 1299161088 00000100:00100000:3.0:1788201158.490661:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715208064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (5708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201158.490667:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4009 00000100:00100000:2.0:1788201158.490798:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715208064:0@lo:41:osp-pre-1-0.0 00000020:00080000:2.0:1788201158.490990:0:75739:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444095 batchid updated 00000020:00080000:1.0:1788201158.493848:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444095 00000004:00080000:1.0:1788201158.493960:0:75759:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc005846f00 with version 19 00000020:00080000:1.0:1788201158.493988:0:75759:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444095 cancel update log [0x2000090a1:0x1:0x0].6: rc = 0 00000004:00080000:0.0:1788201158.494059:0:75745:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc007566d80 version 19 rpc_version 19 00000020:00100000:0.0:1788201158.494107:0:75745:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788201158.494121:0:75745:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc10604ad80 x1875060715209472/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201158.494150:0:75745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604ad80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715209472:0@lo:1000:osp_up0-1.0 00000020:00080000:1.0:1788201158.494171:0:75759:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444095 cancel update log [0x2400088d0:0x1:0x0].7: rc = 0 00000020:00080000:1.0:1788201158.494186:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444095 00000100:00100000:0.0:1788201158.494269:0:75745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201158.494318:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10304fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201158.494656:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715209472 00000100:00100000:2.0:1788201158.494666:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715209472 00000100:00100000:2.0:1788201158.494753:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4010 00000100:00100000:2.0:1788201158.494767:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75745:x1875060715209472:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788201158.494961:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75745:x1875060715209472:12345-0@lo:1000:osp_up0-1.0 Request processed in 197us (704us total) trans 120259084291 rc 0/0 00000100:00100000:2.0:1788201158.494971:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4010 00000100:00100000:3.0:1788201158.495375:0:75745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604ad80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715209472:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788201158.994831:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201158.994866:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715209600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201158.994968:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201158.995058:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715209600 00000100:00100000:2.0:1788201158.995068:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715209600 00000100:00100000:2.0:1788201158.995130:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2294 00000100:00100000:2.0:1788201158.995139:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715209600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201158.995168:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201158.995221:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715209600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201158.995229:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2294 00000100:00100000:2.0:1788201158.995299:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715209600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201159.001039:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201159.001074:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715209728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201159.001172:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201159.001352:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715209728 00000100:00100000:0.0:1788201159.001364:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715209728 00000100:00100000:0.0:1788201159.001434:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2295 00000100:00100000:0.0:1788201159.001445:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715209728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201159.001632:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788201159.001706:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715209728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 262us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201159.001715:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2295 00000100:00100000:0.0:1788201159.001780:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715209728:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1788201159.017288:0:93283:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fff2e4b9890 20000000:00000080:1.0:1788201159.017314:0:93283:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff8dc003a4a000 uarg=0000000000000000 00000040:00100000:1.0:1788201159.018442:0:93283:0:(llog.c:1072:llog_reverse_process()) index 54 : idx 49 20000000:01000000:1.0:1788201159.018453:0:93283:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 53 cmd:0xce020 lustre.pool_134 00000040:00080000:1.0:1788201159.018697:0:93283:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].55, 224 off17736 20000000:01000000:1.0:1788201159.018723:0:93283:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1788201159.018744:0:93283:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].56, 136 off17872 00000040:00080000:1.0:1788201159.018761:0:93283:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].57, 224 off18096 00000040:00080000:1.0:1788201159.018838:0:93283:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].50, 224 off16832 20000000:01000000:1.0:1788201159.018846:0:93283:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1788201159.018860:0:93283:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].51, 144 off16976 00000040:00080000:1.0:1788201159.018874:0:93283:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].52, 224 off17200 00000040:00080000:1.0:1788201159.018938:0:93283:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].50, 224 off16832 20000000:01000000:1.0:1788201159.018947:0:93283:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1788201159.018959:0:93283:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].51, 144 off16976 00000040:00080000:1.0:1788201159.018973:0:93283:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].52, 224 off17200 10000000:01000000:1.0:1788201159.018984:0:93283:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788201159.019210:0:93283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1c1a7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201159.019236:0:93283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc007adf600/0x96d0c9b8c9a1c122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c11b expref: 23 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201159.019255:0:93283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1c130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c129 expref: 23 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201159.019283:0:93283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc007ade200/0x96d0c9b8c9a1c13e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c137 expref: 23 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201159.019290:0:93283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc007adec00/0x96d0c9b8c9a1c14c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c145 expref: 23 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201159.019297:0:93283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc00782c000/0x96d0c9b8c9a1c15a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c153 expref: 23 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201159.019304:0:93283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc00782cc00/0x96d0c9b8c9a1c168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c161 expref: 23 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201159.019311:0:93283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc125ae3800/0x96d0c9b8c9a1c176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c16f expref: 23 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201159.019318:0:93283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc125ae2800/0x96d0c9b8c9a1c184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c17d expref: 23 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201159.019330:0:93283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c18b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78684f expref: 9 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201159.019337:0:93283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc00782c800/0x96d0c9b8c9a1c199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c192 expref: 23 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201159.019344:0:93283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc1064ec400/0x96d0c9b8c9a1c1a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786856 expref: 9 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201159.019352:0:93283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1c1a7 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201159.019417:0:93283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc1064ec400/0x96d0c9b8c9a1c1a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786856 expref: 9 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201159.019436:0:93283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc1064ec400/0x96d0c9b8c9a1c1a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786856 expref: 9 pid: 92549 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201159.019454:0:93283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93283:1875060715209856:192.168.201.20@tcp:104: 00010000:00010000:1.0:1788201159.019774:0:93283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc00782c800/0x96d0c9b8c9a1c199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c192 expref: 23 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201159.019783:0:93283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc00782c800/0x96d0c9b8c9a1c199 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c192 expref: 23 pid: 92554 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201159.019794:0:93283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118143b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93283:1875060715209984:0@lo:104: 00000100:00100000:1.0:1788201159.019850:0:93283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201159.019908:0:93283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c18b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78684f expref: 9 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201159.019917:0:93283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c18b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78684f expref: 9 pid: 92550 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201159.019925:0:93283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93283:1875060715210112:192.168.201.20@tcp:104: 00010000:00010000:1.0:1788201159.019956:0:93283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc125ae2800/0x96d0c9b8c9a1c184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c17d expref: 23 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201159.019964:0:93283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc125ae2800/0x96d0c9b8c9a1c184 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c17d expref: 23 pid: 92549 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201159.019986:0:93283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93283:1875060715210240:0@lo:104: 00010000:00010000:1.0:1788201159.020107:0:93283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc125ae3800/0x96d0c9b8c9a1c176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c16f expref: 23 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201159.020115:0:93283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc125ae3800/0x96d0c9b8c9a1c176 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c16f expref: 23 pid: 92554 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201159.020123:0:93283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93283:1875060715210368:0@lo:104: 00010000:00010000:1.0:1788201159.020153:0:93283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc00782cc00/0x96d0c9b8c9a1c168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c161 expref: 23 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201159.020161:0:93283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc00782cc00/0x96d0c9b8c9a1c168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c161 expref: 23 pid: 92549 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201159.020168:0:93283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93283:1875060715210496:0@lo:104: 00010000:00010000:1.0:1788201159.020192:0:93283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc00782c000/0x96d0c9b8c9a1c15a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c153 expref: 23 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201159.020200:0:93283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc00782c000/0x96d0c9b8c9a1c15a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c153 expref: 23 pid: 92551 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201159.020208:0:93283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93283:1875060715210624:0@lo:104: 00010000:00010000:1.0:1788201159.020230:0:93283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc007adec00/0x96d0c9b8c9a1c14c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c145 expref: 23 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201159.020239:0:93283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc007adec00/0x96d0c9b8c9a1c14c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c145 expref: 23 pid: 92554 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201159.020271:0:93283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93283:1875060715210752:0@lo:104: 00010000:00010000:1.0:1788201159.020299:0:93283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc007ade200/0x96d0c9b8c9a1c13e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c137 expref: 23 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201159.020307:0:93283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc007ade200/0x96d0c9b8c9a1c13e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c137 expref: 23 pid: 92554 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201159.020316:0:93283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93283:1875060715210880:0@lo:104: 00010000:00010000:1.0:1788201159.020339:0:93283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1c130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c129 expref: 23 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201159.020348:0:93283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1c130 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c129 expref: 23 pid: 92551 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201159.020356:0:93283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93283:1875060715211008:0@lo:104: 00010000:00010000:1.0:1788201159.020379:0:93283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc007adf600/0x96d0c9b8c9a1c122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c11b expref: 23 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201159.020386:0:93283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc007adf600/0x96d0c9b8c9a1c122 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c11b expref: 23 pid: 92554 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201159.020393:0:93283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93283:1875060715211136:0@lo:104: 00000100:00100000:1.0:1788201159.020410:0:93283:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005d03e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201159.020587:0:19665:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788201159.020615:0:19665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201159.020648:0:19665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201159.020671:0:19665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201159.020679:0:19665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201159.020687:0:19665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201159.020708:0:19665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201159.020716:0:19665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201159.020726:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715209984 00000100:00100000:3.0:1788201159.020735:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715209984 00000100:00100000:3.0:1788201159.020789:0:19665:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/3 left), rc = 0 00000100:00100000:3.0:1788201159.020803:0:19665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201159.020810:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715210240 00000100:00100000:3.0:1788201159.020813:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715210240 00000100:00100000:3.0:1788201159.020827:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715210368 00000100:00100000:3.0:1788201159.020829:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715210368 00000100:00100000:3.0:1788201159.020837:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715210496 00000100:00100000:3.0:1788201159.020839:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715210496 00000100:00100000:3.0:1788201159.020847:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715210624 00000100:00100000:3.0:1788201159.020850:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715210624 00000100:00100000:3.0:1788201159.020857:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715210752 00000100:00100000:3.0:1788201159.020859:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715210752 00000100:00100000:3.0:1788201159.020866:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715210880 00000100:00100000:3.0:1788201159.020868:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715210880 00000100:00100000:3.0:1788201159.020876:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715211008 00000100:00100000:3.0:1788201159.020878:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715211008 00000100:00100000:3.0:1788201159.020886:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715211136 00000100:00100000:3.0:1788201159.020888:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715211136 00000100:00100000:3.0:1788201159.020902:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1788201159.020912:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10bec5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+11:93283:x1875060715209984:12345-0@lo:104: 00010000:00010000:3.0:1788201159.020927:0:19665:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1c192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c199 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201159.020994:0:19665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201159.021000:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10bec5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+11:93283:x1875060715209984:12345-0@lo:104: Request processed in 90us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201159.021038:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1788201159.021086:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788201159.021099:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+10:93283:x1875060715210240:12345-0@lo:104: 00010000:00010000:3.0:1788201159.021107:0:19665:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1c17d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c184 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201159.021139:0:19665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788201159.021144:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+10:93283:x1875060715210240:12345-0@lo:104: Request processed in 46us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201159.021149:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788201159.021161:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1788201159.021166:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+9:93283:x1875060715210368:12345-0@lo:104: 00010000:00010000:3.0:1788201159.021174:0:19665:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc007adf000/0x96d0c9b8c9a1c16f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c176 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201159.021203:0:19665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788201159.021208:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+9:93283:x1875060715210368:12345-0@lo:104: Request processed in 42us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201159.021213:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1788201159.021224:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788201159.021230:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+8:93283:x1875060715210496:12345-0@lo:104: 00010000:00010000:3.0:1788201159.021237:0:19665:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c168 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201159.021280:0:19665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788201159.021286:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+8:93283:x1875060715210496:12345-0@lo:104: Request processed in 56us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201159.021291:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788201159.021303:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788201159.021316:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+7:93283:x1875060715210624:12345-0@lo:104: 00010000:00010000:3.0:1788201159.021323:0:19665:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc007adfe00/0x96d0c9b8c9a1c153 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c15a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201159.021353:0:19665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788201159.021358:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+7:93283:x1875060715210624:12345-0@lo:104: Request processed in 44us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201159.021364:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788201159.021377:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788201159.021382:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+6:93283:x1875060715210752:12345-0@lo:104: 00010000:00010000:3.0:1788201159.021389:0:19665:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c14c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201159.021415:0:19665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1788201159.021419:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+6:93283:x1875060715210752:12345-0@lo:104: Request processed in 38us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201159.021425:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788201159.021437:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1788201159.021443:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+5:93283:x1875060715210880:12345-0@lo:104: 00010000:00010000:3.0:1788201159.021449:0:19665:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc00782d200/0x96d0c9b8c9a1c137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c13e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201159.021475:0:19665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1788201159.021479:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+5:93283:x1875060715210880:12345-0@lo:104: Request processed in 38us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201159.021485:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1788201159.021495:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1788201159.021508:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a940c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+4:93283:x1875060715211008:12345-0@lo:104: 00010000:00010000:3.0:1788201159.021515:0:19665:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc00782d800/0x96d0c9b8c9a1c129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c130 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201159.021543:0:19665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:3.0:1788201159.021548:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a940c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+4:93283:x1875060715211008:12345-0@lo:104: Request processed in 42us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201159.021554:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1788201159.021582:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1788201159.021588:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+3:93283:x1875060715211136:12345-0@lo:104: 00010000:00010000:3.0:1788201159.021595:0:19665:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c11b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c122 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201159.021620:0:19665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:3.0:1788201159.021624:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+3:93283:x1875060715211136:12345-0@lo:104: Request processed in 37us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201159.021630:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00010000:00010000:0.0:1788201159.021846:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788201159.021855:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1c192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c199 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.021863:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed400 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201159.021868:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1c192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1c199 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.021878:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1c192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c199 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201159.021886:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1c192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c199 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201159.021893:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201159.021938:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1c192 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c199 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.021945:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201159.021969:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1c192 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c199 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.021976:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1c192 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c199 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022037:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788201159.022041:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1c17d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c184 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022046:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064eca00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201159.022049:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1c17d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1c184 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022055:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1c17d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c184 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201159.022062:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1c17d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c184 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201159.022067:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201159.022082:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1c17d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c184 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022087:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201159.022093:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1c17d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c184 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022099:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1c17d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c184 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022109:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788201159.022111:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc007adf000/0x96d0c9b8c9a1c16f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c176 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022126:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf000 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201159.022129:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc007adf000/0x96d0c9b8c9a1c16f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1c176 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022135:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007adf000/0x96d0c9b8c9a1c16f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c176 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201159.022142:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007adf000/0x96d0c9b8c9a1c16f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c176 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201159.022146:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201159.022159:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc007adf000/0x96d0c9b8c9a1c16f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c176 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022164:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201159.022181:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc007adf000/0x96d0c9b8c9a1c16f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c176 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022188:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007adf000/0x96d0c9b8c9a1c16f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c176 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022197:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788201159.022200:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c168 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022206:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2a00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201159.022209:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1c168 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022226:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c168 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201159.022233:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c168 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201159.022238:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201159.022264:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c161 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c168 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022270:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201159.022277:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c161 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c168 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022284:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c161 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c168 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022294:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788201159.022297:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc007adfe00/0x96d0c9b8c9a1c153 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c15a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022302:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfe00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201159.022305:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc007adfe00/0x96d0c9b8c9a1c153 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1c15a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022311:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007adfe00/0x96d0c9b8c9a1c153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c15a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201159.022318:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007adfe00/0x96d0c9b8c9a1c153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c15a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201159.022330:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201159.022346:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc007adfe00/0x96d0c9b8c9a1c153 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c15a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022352:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201159.022357:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc007adfe00/0x96d0c9b8c9a1c153 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c15a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022364:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007adfe00/0x96d0c9b8c9a1c153 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c15a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022374:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788201159.022377:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c14c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022383:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3a00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201159.022386:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1c14c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022393:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c14c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201159.022400:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c14c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201159.022406:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201159.022419:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c145 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c14c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022430:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201159.022443:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c145 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c14c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022450:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c145 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c14c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022459:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201159.022463:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc00782d200/0x96d0c9b8c9a1c137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c13e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022469:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d200 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201159.022472:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782d200/0x96d0c9b8c9a1c137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1c13e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022480:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc00782d200/0x96d0c9b8c9a1c137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c13e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201159.022486:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782d200/0x96d0c9b8c9a1c137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c13e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201159.022492:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201159.022506:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc00782d200/0x96d0c9b8c9a1c137 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c13e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022512:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201159.022516:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc00782d200/0x96d0c9b8c9a1c137 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c13e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022522:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc00782d200/0x96d0c9b8c9a1c137 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c13e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022530:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201159.022655:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc00782d800/0x96d0c9b8c9a1c129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c130 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022662:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d800 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201159.022665:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782d800/0x96d0c9b8c9a1c129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1c130 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022671:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc00782d800/0x96d0c9b8c9a1c129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c130 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201159.022678:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782d800/0x96d0c9b8c9a1c129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c130 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201159.022683:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201159.022699:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc00782d800/0x96d0c9b8c9a1c129 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c130 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022706:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201159.022710:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc00782d800/0x96d0c9b8c9a1c129 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c130 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022717:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc00782d800/0x96d0c9b8c9a1c129 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c130 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022726:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201159.022729:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c11b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c122 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022735:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782dc00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201159.022737:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c11b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1c122 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022756:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c11b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c122 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201159.022762:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c11b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c122 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201159.022767:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201159.022781:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c11b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c122 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022787:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201159.022792:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c11b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c122 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022798:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c11b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c122 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.022815:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201159.022816:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201159.022818:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201159.022831:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201159.022850:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715211392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201159.022917:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201159.022968:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715211904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201159.022991:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201159.023116:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788201159.023124:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715211264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201159.023150:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201159.023178:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715211776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201159.023200:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201159.023217:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715212288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201159.023237:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201159.023289:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715211648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201159.023313:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201159.023333:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715212160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201159.023356:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201159.023375:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788201159.023381:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715211520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201159.023402:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201159.023412:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715212032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201159.023430:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201159.023456:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715211392 00000100:00100000:0.0:1788201159.023464:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715211392 00010000:00010000:0.0:1788201159.023501:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc125ae2800/0x96d0c9b8c9a1c184 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c17d expref: 24 pid: 92549 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201159.023523:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715211904 00000100:00100000:0.0:1788201159.023526:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715211904 00000100:00100000:1.0:1788201159.023710:0:93283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118143b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93283:1875060715209984:0@lo:104: 00000100:00100000:1.0:1788201159.023724:0:93283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93283:1875060715210240:0@lo:104: 00000100:00100000:1.0:1788201159.023734:0:93283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93283:1875060715210368:0@lo:104: 00000100:00100000:1.0:1788201159.023755:0:93283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93283:1875060715210496:0@lo:104: 00000100:00100000:1.0:1788201159.023765:0:93283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93283:1875060715210624:0@lo:104: 00000100:00100000:1.0:1788201159.023773:0:93283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93283:1875060715210752:0@lo:104: 00000100:00100000:1.0:1788201159.023781:0:93283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93283:1875060715210880:0@lo:104: 00000100:00100000:1.0:1788201159.023790:0:93283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93283:1875060715211008:0@lo:104: 00000100:00100000:1.0:1788201159.023798:0:93283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93283:1875060715211136:0@lo:104: 00010000:00010000:0.0:1788201159.025206:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc007adec00/0x96d0c9b8c9a1c14c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c145 expref: 25 pid: 92554 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201159.025262:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715211264 00000100:00100000:0.0:1788201159.025271:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715211264 00010000:00010000:0.0:1788201159.025309:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc00782c800/0x96d0c9b8c9a1c199 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c192 expref: 26 pid: 92554 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201159.025341:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715211776 00000100:00100000:0.0:1788201159.025346:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715211776 00010000:00010000:0.0:1788201159.025359:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc00782c000/0x96d0c9b8c9a1c15a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c153 expref: 27 pid: 92551 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201159.025369:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715212288 00000100:00100000:0.0:1788201159.025372:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715212288 00010000:00010000:0.0:1788201159.025382:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc007adf600/0x96d0c9b8c9a1c122 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c11b expref: 28 pid: 92554 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201159.025391:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715211648 00000100:00100000:0.0:1788201159.025394:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715211648 00010000:00010000:0.0:1788201159.025404:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc00782cc00/0x96d0c9b8c9a1c168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c161 expref: 29 pid: 92549 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201159.025415:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715212160 00000100:00100000:0.0:1788201159.025417:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715212160 00010000:00010000:0.0:1788201159.025430:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1c130 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c129 expref: 30 pid: 92551 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201159.025440:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715211520 00000100:00100000:0.0:1788201159.025443:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715211520 00010000:00010000:0.0:1788201159.025454:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc125ae3800/0x96d0c9b8c9a1c176 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c16f expref: 31 pid: 92554 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201159.025464:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715212032 00000100:00100000:0.0:1788201159.025467:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715212032 00010000:00010000:0.0:1788201159.025478:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc007ade200/0x96d0c9b8c9a1c13e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c137 expref: 32 pid: 92554 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201159.025493:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2574 00000100:00100000:0.0:1788201159.025510:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+32:3656:x1875060715211392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201159.025528:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201159.025755:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc125ae2800/0x96d0c9b8c9a1c184 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c17d expref: 32 pid: 92549 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.025772:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc125ae2800/0x96d0c9b8c9a1c184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c17d expref: 32 pid: 92549 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.025794:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae2800/0x96d0c9b8c9a1c184 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c17d expref: 32 pid: 92549 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.025814:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201159.025956:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+31:3656:x1875060715211392:12345-0@lo:103:ldlm_bl.0 Request processed in 447us (3038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201159.025965:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2574 00000100:00100000:0.0:1788201159.025989:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2575 00000100:00100000:0.0:1788201159.025998:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+30:3656:x1875060715211904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201159.026047:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201159.026052:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc007adec00/0x96d0c9b8c9a1c14c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c145 expref: 30 pid: 92554 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.026061:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc007adec00/0x96d0c9b8c9a1c14c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c145 expref: 30 pid: 92554 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.026072:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007adec00/0x96d0c9b8c9a1c14c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c145 expref: 30 pid: 92554 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.026081:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201159.026107:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+29:3656:x1875060715211904:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (3115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201159.026123:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2575 00000100:00100000:0.0:1788201159.026139:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2576 00000100:00100000:0.0:1788201159.026144:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+28:3656:x1875060715211264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201159.026153:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201159.026158:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc00782c800/0x96d0c9b8c9a1c199 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c192 expref: 28 pid: 92554 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.026166:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc00782c800/0x96d0c9b8c9a1c199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c192 expref: 28 pid: 92554 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.026177:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782c800/0x96d0c9b8c9a1c199 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c192 expref: 28 pid: 92554 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.026186:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201159.026212:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+27:3656:x1875060715211264:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (3061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201159.026219:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2576 00000100:00100000:0.0:1788201159.026231:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2577 00000100:00100000:0.0:1788201159.026237:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+26:3656:x1875060715211776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201159.026245:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201159.026259:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc00782c000/0x96d0c9b8c9a1c15a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c153 expref: 26 pid: 92551 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.026267:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc00782c000/0x96d0c9b8c9a1c15a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c153 expref: 26 pid: 92551 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.026277:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782c000/0x96d0c9b8c9a1c15a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c153 expref: 26 pid: 92551 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.026298:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201159.026324:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+25:3656:x1875060715211776:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (3123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201159.026330:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2577 00000100:00100000:0.0:1788201159.026345:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578 00000100:00100000:0.0:1788201159.026350:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715212288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201159.026358:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201159.026362:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc007adf600/0x96d0c9b8c9a1c122 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c11b expref: 24 pid: 92554 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.026371:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc007adf600/0x96d0c9b8c9a1c122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c11b expref: 24 pid: 92554 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.026381:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007adf600/0x96d0c9b8c9a1c122 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c11b expref: 24 pid: 92554 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.026390:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201159.026414:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+23:3656:x1875060715212288:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (3176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201159.026420:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578 00000100:00100000:0.0:1788201159.026431:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579 00000100:00100000:0.0:1788201159.026437:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+22:3658:x1875060715211648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201159.026444:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201159.026448:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc00782cc00/0x96d0c9b8c9a1c168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c161 expref: 22 pid: 92549 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.026456:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc00782cc00/0x96d0c9b8c9a1c168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c161 expref: 22 pid: 92549 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.026473:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782cc00/0x96d0c9b8c9a1c168 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c161 expref: 22 pid: 92549 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.026495:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201159.026667:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+21:3658:x1875060715211648:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (3221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201159.026677:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579 00000100:00100000:0.0:1788201159.026693:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580 00000100:00100000:0.0:1788201159.026700:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10a10f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+20:3658:x1875060715212160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201159.026708:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201159.026712:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1c130 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c129 expref: 20 pid: 92551 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.026721:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1c130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c129 expref: 20 pid: 92551 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.026731:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1c130 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c129 expref: 20 pid: 92551 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.026741:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201159.026764:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10a10f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+19:3658:x1875060715212160:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (3407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201159.026770:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580 00000100:00100000:0.0:1788201159.026814:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2581 00000100:00100000:0.0:1788201159.026820:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+18:3658:x1875060715211520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201159.026826:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201159.026831:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc125ae3800/0x96d0c9b8c9a1c176 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c16f expref: 18 pid: 92554 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.026846:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc125ae3800/0x96d0c9b8c9a1c176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c16f expref: 18 pid: 92554 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.026857:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae3800/0x96d0c9b8c9a1c176 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c16f expref: 18 pid: 92554 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.026865:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201159.026890:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+17:3658:x1875060715211520:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (3486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201159.026896:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2581 00000100:00100000:0.0:1788201159.026911:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582 00000100:00100000:0.0:1788201159.026918:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+16:3658:x1875060715212032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201159.026926:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201159.026930:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc007ade200/0x96d0c9b8c9a1c13e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c137 expref: 16 pid: 92554 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.026937:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc007ade200/0x96d0c9b8c9a1c13e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c137 expref: 16 pid: 92554 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.026947:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007ade200/0x96d0c9b8c9a1c13e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c137 expref: 16 pid: 92554 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.026955:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201159.026977:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+15:3658:x1875060715212032:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (3547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201159.026982:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582 00010000:00010000:2.0:1788201159.027216:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201159.027224:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201159.027609:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715211520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201159.027622:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715212032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201159.027631:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715211648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201159.027639:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715212160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201159.032287:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715211392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201159.032311:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715211904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201159.032346:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715211264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201159.032356:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715211776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201159.032366:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715212288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201159.032885:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201159.032980:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695410944 00000100:00100000:0.0:1788201159.032991:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695410944 00010000:00010000:0.0:1788201159.033113:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c18b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78684f expref: 10 pid: 92550 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201159.033157:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2583 00000100:00100000:0.0:1788201159.033168:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695410944:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201159.033186:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201159.033194:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c18b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78684f expref: 10 pid: 92550 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.033216:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c18b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78684f expref: 10 pid: 92550 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.033243:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201159.033325:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695410944:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 158us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201159.033334:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2583 00010000:00010000:1.0:1788201159.035508:0:93283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c18b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78684f expref: 9 pid: 92550 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201159.035531:0:93283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93283:1875060715210112:192.168.201.20@tcp:104: 00000100:00100000:2.0:1788201159.039176:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201159.039400:0:93283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93283:1875060715209856:192.168.201.20@tcp:104: 00010000:00010000:1.0:1788201159.039471:0:93283:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1c1a7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201159.039927:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695411072 00000100:00100000:0.0:1788201159.039939:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695411072 00010000:00010000:0.0:1788201159.039995:0:26213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc1064ec400/0x96d0c9b8c9a1c1a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786856 expref: 9 pid: 92549 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201159.040084:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2584 00000100:00100000:0.0:1788201159.040098:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:2401:x1875060695411072:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201159.040129:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201159.040137:0:26213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc1064ec400/0x96d0c9b8c9a1c1a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786856 expref: 9 pid: 92549 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.040154:0:26213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc1064ec400/0x96d0c9b8c9a1c1a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786856 expref: 9 pid: 92549 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.040202:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ec400/0x96d0c9b8c9a1c1a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786856 expref: 9 pid: 92549 timeout: 4110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.040225:0:26213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1c1a7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.040235:0:26213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1c1a7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.040267:0:26213:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1c1a7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.040275:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1c1a7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.040283:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1c1a7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.040290:0:26213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1c1a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.040297:0:26213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201159.040349:0:26213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1c1a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.040359:0:26213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1c1a7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.040377:0:26213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1c1a7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.040401:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201159.040480:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:2401:x1875060695411072:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 385us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201159.040489:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2584 00010000:00010000:1.0:1788201159.040893:0:93283:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1c1a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201159.040903:0:93283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1c1a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201159.040919:0:93283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1c1a7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201159.439408:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788201160.271681:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788201160.271693:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc11d63c000 from 55 10000000:01000000:3.0:1788201160.271700:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201160.271769:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1c1ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201160.271802:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1c1ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201160.271816:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1c1ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201160.271850:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715212416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201160.271946:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201160.272874:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc139bfe780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201160.272979:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715212416 00000100:00100000:1.0:1788201160.273098:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715212416 00000100:00100000:1.0:1788201160.273238:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788201160.273252:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12eddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715212416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201160.273274:0:92549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201160.273299:0:92549:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1c1b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c1ae expref: -99 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201160.273354:0:92549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1c1b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c1ae expref: 16 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201160.273369:0:92549:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1c1b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c1ae expref: 16 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201160.273381:0:92549:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ec200, rc 0) 00000100:00100000:1.0:1788201160.273467:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12eddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715212416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 218us (1521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201160.273475:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788201160.273617:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715212416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201160.273639:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1c1ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c1b5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201160.273649:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1c1ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c1b5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201160.273744:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715212544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201160.273787:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201160.290740:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc139bfe780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201160.297264:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715212544 00000100:00100000:0.0:1788201160.297290:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715212544 00000100:00100000:0.0:1788201160.297463:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788201160.297477:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12eddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715212544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201160.298060:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12eddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715212544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 584us (24269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201160.298071:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788201160.298173:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715212544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201160.298258:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715212672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201160.298342:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201160.298731:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715212672 00000100:00100000:1.0:1788201160.298738:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715212672 00000100:00100000:1.0:1788201160.298777:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788201160.298785:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00436d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715212672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201160.298890:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00436d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715212672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201160.298906:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788201160.298942:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc139bdf840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201160.298957:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715212672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201160.300195:0:93284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93284:1875060715212800:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201160.300284:0:93284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201160.300446:0:93284:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc139bdf180 going to sleep for 11 seconds 00000100:00100000:3.0:1788201160.300515:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715212800 00000100:00100000:3.0:1788201160.300524:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715212800 00000100:00100000:3.0:1788201160.300815:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788201160.300826:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+16:93284:x1875060715212800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201160.300981:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+16:93284:x1875060715212800:12345-0@lo:502:llog_process_th.0 Request processed in 156us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201160.300997:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788201160.301147:0:93284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93284:1875060715212800:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201160.301238:0:93284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93284:1875060715212928:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201160.301279:0:93284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201160.302072:0:93284:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc139bdf180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201160.302239:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715212928 00000100:00100000:2.0:1788201160.302248:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715212928 00000100:00100000:2.0:1788201160.302299:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788201160.302309:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+16:93284:x1875060715212928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201160.302958:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+16:93284:x1875060715212928:12345-0@lo:502:llog_process_th.0 Request processed in 646us (1675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201160.302968:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788201160.303282:0:93284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93284:1875060715212928:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788201160.303422:0:93284:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:2.0:1788201160.303905:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:2.0:1788201160.303936:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788201160.303950:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1c1ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c1b5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201160.303964:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1c1ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c1b5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201160.303977:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788201160.303980:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 50 10000000:01000000:2.0:1788201160.304161:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788201160.304210:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c1bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201160.304219:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c1bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201160.304240:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c1bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201160.304283:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715213056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201160.305158:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201160.305214:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038e0600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201160.305337:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715213056 00000100:00100000:3.0:1788201160.305477:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715213056 00000100:00100000:3.0:1788201160.305670:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788201160.305679:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715213056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201160.305694:0:92551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201160.305712:0:92551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc125ae2000/0x96d0c9b8c9a1c1c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c1bc expref: -99 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201160.305740:0:92551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc125ae2000/0x96d0c9b8c9a1c1c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c1bc expref: 17 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201160.305748:0:92551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc125ae2000/0x96d0c9b8c9a1c1c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c1bc expref: 17 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201160.305757:0:92551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2000, rc 0) 00000100:00100000:3.0:1788201160.305812:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715213056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201160.305819:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788201160.308201:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715213056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201160.308250:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c1bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c1c3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201160.308266:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c1bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c1c3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201160.308540:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715213184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201160.308700:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201160.308762:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038e0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201160.309038:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715213184 00000100:00100000:1.0:1788201160.309048:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715213184 00000100:00100000:0.0:1788201160.309257:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788201160.309271:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715213184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201160.309459:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715213184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 191us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201160.309466:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788201160.309833:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715213184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201160.309890:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715213312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201160.309967:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201160.310012:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005d03540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201160.310196:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715213312 00000100:00100000:3.0:1788201160.310205:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715213312 00000100:00100000:3.0:1788201160.310268:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788201160.310279:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715213312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201160.310420:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715213312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201160.310428:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788201160.310936:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715213312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201160.311882:0:93285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93285:1875060715213440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201160.311958:0:93285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201160.312000:0:93285:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f60180 going to sleep for 11 seconds 00000100:00100000:3.0:1788201160.312168:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715213440 00000100:00100000:3.0:1788201160.312176:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715213440 00000100:00100000:3.0:1788201160.312240:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788201160.312251:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+17:93285:x1875060715213440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201160.312600:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+17:93285:x1875060715213440:12345-0@lo:502:llog_process_th.0 Request processed in 350us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201160.312733:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788201160.312920:0:93285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93285:1875060715213440:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201160.312976:0:93285:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201160.313158:0:93285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201160.313162:0:93285:0:(obd_config.c:1563:class_process_config()) marker 46 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:1.0:1788201160.313171:0:93285:0:(obd_config.c:1472:class_process_config()) processing cmd: ce021 00020000:01000000:1.0:1788201160.313197:0:93285:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:2.0:1788201160.315844:0:93285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93285:1875060715213568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201160.315967:0:93285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201160.316084:0:93285:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038e0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201160.316196:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715213568 00000100:00100000:0.0:1788201160.316205:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715213568 00000100:00100000:0.0:1788201160.316278:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788201160.316291:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+17:93285:x1875060715213568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201160.316478:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+17:93285:x1875060715213568:12345-0@lo:502:llog_process_th.0 Request processed in 189us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201160.316488:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000020:01000004:1.0:1788201160.316935:0:93286:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc11d63c000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788201160.316942:0:93286:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc11d63c000 4 00000100:00100000:3.0:1788201160.318161:0:93285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93285:1875060715213568:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201160.318251:0:93285:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201160.318265:0:93285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201160.318267:0:93285:0:(obd_config.c:1563:class_process_config()) marker 46 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:3.0:1788201160.318274:0:93285:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:2.0:1788201160.319283:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 50-52 (rc=0) 10000000:01000000:2.0:1788201160.319337:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788201160.319361:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c1bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c1c3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201160.319376:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c1bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c1c3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201160.319389:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788201160.319392:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc0053a4000 from 55 10000000:01000000:2.0:1788201160.319414:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788201160.319463:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c1ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201160.319471:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c1ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201160.319482:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c1ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201160.319512:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715213696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201160.319856:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201160.319929:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038e0000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201160.320064:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715213696 00000100:00100000:0.0:1788201160.320075:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715213696 00000100:00100000:0.0:1788201160.320138:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788201160.320149:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715213696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201160.320164:0:92549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201160.320180:0:92549:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782cc00/0x96d0c9b8c9a1c1d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c1ca expref: -99 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201160.320209:0:92549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782cc00/0x96d0c9b8c9a1c1d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c1ca expref: 18 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201160.320220:0:92549:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782cc00/0x96d0c9b8c9a1c1d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c1ca expref: 18 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201160.320260:0:92549:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782cc00, rc 0) 00000100:00100000:0.0:1788201160.320309:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715213696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201160.320317:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788201160.321857:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715213696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201160.321891:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c1ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c1d1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201160.321904:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c1ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c1d1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201160.322077:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715213824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201160.322146:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201160.322194:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038e0000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201160.323063:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715213824 00000100:00100000:0.0:1788201160.323075:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715213824 00000100:00100000:0.0:1788201160.323149:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788201160.323161:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715213824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201160.324799:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715213824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1626us (2639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201160.324816:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788201160.326351:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715213824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201160.326510:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715213952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201160.326645:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201160.326694:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0058466c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201160.327452:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715213952 00000100:00100000:2.0:1788201160.327465:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715213952 00000100:00100000:2.0:1788201160.327553:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788201160.327575:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715213952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201160.327964:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715213952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 392us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201160.327981:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788201160.328138:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715213952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201160.328675:0:93287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93287:1875060715214080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201160.328737:0:93287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201160.328788:0:93287:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201160.328888:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715214080 00000100:00100000:1.0:1788201160.328895:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715214080 00000100:00100000:2.0:1788201160.332975:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788201160.333045:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+18:93287:x1875060715214080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201160.333355:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+18:93287:x1875060715214080:12345-0@lo:502:llog_process_th.0 Request processed in 344us (4607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201160.333365:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788201160.333501:0:93287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93287:1875060715214080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201160.333635:0:93287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93287:1875060715214208:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201160.333688:0:93287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201160.337075:0:93287:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc139bfe780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201160.337851:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715214208 00000100:00100000:0.0:1788201160.337869:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715214208 00000100:00100000:0.0:1788201160.337965:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788201160.337977:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+18:93287:x1875060715214208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201160.338378:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+18:93287:x1875060715214208:12345-0@lo:502:llog_process_th.0 Request processed in 403us (4690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201160.338399:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788201160.339079:0:93287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93287:1875060715214208:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788201160.339157:0:93287:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:0.0:1788201160.339520:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:0.0:1788201160.339740:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201160.339754:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c1ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c1d1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201160.339767:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c1ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c1d1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201160.339780:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788201160.339783:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 50 10000000:01000000:0.0:1788201160.339786:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788201160.339832:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782c000/0x96d0c9b8c9a1c1d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201160.339841:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc00782c000/0x96d0c9b8c9a1c1d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201160.339852:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc00782c000/0x96d0c9b8c9a1c1d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201160.339881:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715214336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201160.339952:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201160.340899:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715214336 00000100:00100000:3.0:1788201160.340932:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715214336 00000100:00100000:0.0:1788201160.341135:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0058463c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201160.341968:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788201160.342001:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715214336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201160.342039:0:92554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201160.342065:0:92554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc125ae3e00/0x96d0c9b8c9a1c1df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c1d8 expref: -99 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201160.342103:0:92554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc125ae3e00/0x96d0c9b8c9a1c1df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c1d8 expref: 19 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201160.342117:0:92554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc125ae3e00/0x96d0c9b8c9a1c1df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c1d8 expref: 19 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201160.342147:0:92554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3e00, rc 0) 00000100:00100000:3.0:1788201160.342252:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715214336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 270us (2299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201160.342259:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788201160.342855:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715214336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201160.342880:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc00782c000/0x96d0c9b8c9a1c1d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c1df expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201160.342906:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc00782c000/0x96d0c9b8c9a1c1d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c1df expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201160.343056:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715214464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201160.343110:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201160.343156:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0058463c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201160.343310:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715214464 00000100:00100000:2.0:1788201160.343329:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715214464 00000100:00100000:2.0:1788201160.343382:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788201160.343392:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715214464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201160.343866:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715214464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 473us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201160.343875:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788201160.344251:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715214464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201160.344302:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715214592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201160.344443:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201160.344480:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0058463c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201160.344547:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715214592 00000100:00100000:2.0:1788201160.344554:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715214592 00000100:00100000:2.0:1788201160.344825:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788201160.344835:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715214592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201160.344966:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715214592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201160.344974:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788201160.345102:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715214592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201160.346133:0:93288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93288:1875060715214720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201160.346218:0:93288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201160.346273:0:93288:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201160.346499:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715214720 00000100:00100000:3.0:1788201160.346508:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715214720 00000100:00100000:3.0:1788201160.346585:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788201160.346596:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+19:93288:x1875060715214720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201160.347301:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+19:93288:x1875060715214720:12345-0@lo:502:llog_process_th.0 Request processed in 703us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201160.347312:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788201160.347578:0:93288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93288:1875060715214720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201160.347767:0:93288:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201160.347784:0:93288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201160.347786:0:93288:0:(obd_config.c:1563:class_process_config()) marker 47 (0x1) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:0.0:1788201160.347793:0:93288:0:(obd_config.c:1472:class_process_config()) processing cmd: ce021 00020000:01000000:0.0:1788201160.347814:0:93288:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:0.0:1788201160.347851:0:93288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93288:1875060715214848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201160.347904:0:93288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201160.347947:0:93288:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10304fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201160.348097:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715214848 00000100:00100000:3.0:1788201160.348104:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715214848 00000100:00100000:3.0:1788201160.348142:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788201160.348151:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+19:93288:x1875060715214848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201160.348257:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+19:93288:x1875060715214848:12345-0@lo:502:llog_process_th.0 Request processed in 106us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201160.348264:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788201160.348537:0:93288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93288:1875060715214848:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201160.348732:0:93288:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201160.348739:0:93288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201160.348742:0:93288:0:(obd_config.c:1563:class_process_config()) marker 47 (0x2) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1788201160.348746:0:93288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000020:01000000:3.0:1788201160.349134:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 50-52 (rc=0) 10000000:01000000:3.0:1788201160.349163:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788201160.349177:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782c000/0x96d0c9b8c9a1c1d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c1df expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201160.349191:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc00782c000/0x96d0c9b8c9a1c1d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c1df expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201160.349217:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788201160.349220:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc001db6000 from 55 10000000:01000000:3.0:1788201160.349232:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201160.349268:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2c00/0x96d0c9b8c9a1c1e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201160.349276:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2c00/0x96d0c9b8c9a1c1e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201160.349286:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2c00/0x96d0c9b8c9a1c1e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201160.349308:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715214976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201160.349469:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201160.349509:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125446480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201160.349763:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715214976 00000100:00100000:0.0:1788201160.349772:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715214976 00000100:00100000:0.0:1788201160.349827:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788201160.349838:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715214976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201160.349850:0:92554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201160.349867:0:92554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782c800/0x96d0c9b8c9a1c1ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c1e6 expref: -99 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201160.349895:0:92554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782c800/0x96d0c9b8c9a1c1ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c1e6 expref: 20 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201160.349907:0:92554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782c800/0x96d0c9b8c9a1c1ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c1e6 expref: 20 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201160.349918:0:92554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782c800, rc 0) 00000100:00100000:0.0:1788201160.349976:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715214976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201160.350107:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715214976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201160.350125:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2c00/0x96d0c9b8c9a1c1e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c1ed expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201160.350135:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2c00/0x96d0c9b8c9a1c1e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c1ed expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201160.350221:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715215104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201160.350268:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201160.350294:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038e0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201160.350309:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715215104 00000100:00100000:2.0:1788201160.350313:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715215104 00000100:00100000:0.0:1788201160.350455:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788201160.350771:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788201160.350779:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715215104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201160.350928:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715215104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201160.350935:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788201160.351219:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715215104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201160.351279:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715215232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201160.351482:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201160.351559:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125446b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201160.351916:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715215232 00000100:00100000:0.0:1788201160.351922:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715215232 00000100:00100000:0.0:1788201160.351973:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788201160.352175:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715215232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201160.352889:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715215232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 904us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201160.352911:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788201160.355218:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715215232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201160.356209:0:93289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93289:1875060715215360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201160.357242:0:93289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201160.361751:0:93289:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f60f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201160.364817:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715215360 00000100:00100000:0.0:1788201160.364841:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715215360 00000100:00100000:0.0:1788201160.364930:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788201160.364945:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+20:93289:x1875060715215360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201160.365252:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+20:93289:x1875060715215360:12345-0@lo:502:llog_process_th.0 Request processed in 309us (8014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201160.365261:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788201160.365419:0:93289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93289:1875060715215360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201160.365529:0:93289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93289:1875060715215488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201160.365586:0:93289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201160.365638:0:93289:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125446b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201160.365746:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715215488 00000100:00100000:0.0:1788201160.365751:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715215488 00000100:00100000:0.0:1788201160.365793:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788201160.365802:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:93289:x1875060715215488:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201160.365887:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:93289:x1875060715215488:12345-0@lo:502:llog_process_th.0 Request processed in 86us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201160.365895:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788201160.366747:0:93289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93289:1875060715215488:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788201160.366812:0:93289:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:2.0:1788201160.367254:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:2.0:1788201160.367286:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788201160.367303:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2c00/0x96d0c9b8c9a1c1e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c1ed expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201160.367316:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2c00/0x96d0c9b8c9a1c1e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c1ed expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201160.367338:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788201160.367342:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1788201160.367345:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788201160.367387:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ade800/0x96d0c9b8c9a1c1f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201160.367396:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007ade800/0x96d0c9b8c9a1c1f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201160.367419:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007ade800/0x96d0c9b8c9a1c1f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201160.367443:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715215616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201160.367508:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201160.367731:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715215616 00000100:00100000:0.0:1788201160.367740:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715215616 00000100:00100000:0.0:1788201160.367802:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788201160.367813:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715215616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201160.367826:0:92554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201160.367841:0:92554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782dc00/0x96d0c9b8c9a1c1fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c1f4 expref: -99 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201160.367870:0:92554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782dc00/0x96d0c9b8c9a1c1fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c1f4 expref: 21 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201160.367882:0:92554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782dc00/0x96d0c9b8c9a1c1fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c1f4 expref: 21 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201160.367900:0:92554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782dc00, rc 0) 00000100:00100000:2.0:1788201160.372981:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038e0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201160.373260:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715215616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201160.373297:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007ade800/0x96d0c9b8c9a1c1f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c1fb expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201160.373313:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007ade800/0x96d0c9b8c9a1c1f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c1fb expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201160.373515:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715215616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2504us (2806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201160.373528:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788201160.373973:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715215744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201160.378961:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201160.379144:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715215744 00000100:00100000:1.0:1788201160.379182:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715215744 00000100:00100000:1.0:1788201160.379264:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788201160.379277:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715215744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201160.379508:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715215744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 233us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201160.379516:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788201160.379978:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038e0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201160.380012:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715215744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201160.380102:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715215872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201160.380173:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201160.380190:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038e0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201160.380348:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715215872 00000100:00100000:1.0:1788201160.380355:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715215872 00000100:00100000:1.0:1788201160.380436:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788201160.380445:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715215872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201160.380581:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715215872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201160.380589:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788201160.380747:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715215872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201160.389206:0:93290:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1788201160.389755:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1788201160.389788:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788201160.389803:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ade800/0x96d0c9b8c9a1c1f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c1fb expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201160.389817:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007ade800/0x96d0c9b8c9a1c1f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c1fb expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201160.389829:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788201160.389832:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc13aa9f000 from 55 10000000:01000000:3.0:1788201160.389847:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201160.389900:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2e00/0x96d0c9b8c9a1c202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201160.389908:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2e00/0x96d0c9b8c9a1c202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201160.389921:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2e00/0x96d0c9b8c9a1c202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201160.389954:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715216000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201160.390076:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201160.391113:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125446b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201160.395216:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715216000 00000100:00100000:0.0:1788201160.395596:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715216000 00000100:00100000:3.0:1788201160.398167:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788201160.398186:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715216000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201160.398210:0:92549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201160.398250:0:92549:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c209 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c202 expref: -99 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201160.398333:0:92549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c202 expref: 22 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201160.398346:0:92549:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c202 expref: 22 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201160.398358:0:92549:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2600, rc 0) 00000100:00100000:3.0:1788201160.398468:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715216000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 286us (8392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201160.398476:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788201160.398553:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715216000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201160.398577:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2e00/0x96d0c9b8c9a1c202 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c209 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201160.398588:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2e00/0x96d0c9b8c9a1c202 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c209 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201160.399112:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715216128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201160.399179:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201160.399216:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715216128 00000100:00100000:3.0:1788201160.399236:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715216128 00000100:00100000:3.0:1788201160.399280:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788201160.399288:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715216128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201160.399533:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715216128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201160.399540:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788201160.399601:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125446b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201160.399693:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715216128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201160.399725:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715216256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201160.399770:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201160.399792:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715216256 00000100:00100000:3.0:1788201160.399796:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715216256 00000100:00100000:3.0:1788201160.399819:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788201160.399825:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715216256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201160.400006:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715216256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201160.400013:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788201160.400082:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125446b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201160.400094:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715216256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201160.401198:0:93291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93291:1875060715216384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201160.401302:0:93291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201160.401357:0:93291:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13ab409c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201160.401782:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715216384 00000100:00100000:3.0:1788201160.401790:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715216384 00000100:00100000:3.0:1788201160.401853:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788201160.401863:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:93291:x1875060715216384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201160.402058:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:93291:x1875060715216384:12345-0@lo:502:llog_process_th.0 Request processed in 196us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201160.402067:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788201160.402599:0:93291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93291:1875060715216384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201160.402805:0:93291:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93291:1875060715216512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201160.402862:0:93291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201160.402906:0:93291:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13ab409c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201160.404795:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715216512 00000100:00100000:3.0:1788201160.404814:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715216512 00000100:00100000:3.0:1788201160.404886:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788201160.404898:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:93291:x1875060715216512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201160.405129:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:93291:x1875060715216512:12345-0@lo:502:llog_process_th.0 Request processed in 233us (2266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201160.405146:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788201160.405566:0:93291:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:93291:1875060715216512:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788201160.405649:0:93291:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:1.0:1788201160.405962:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:1.0:1788201160.405991:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201160.406006:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2e00/0x96d0c9b8c9a1c202 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c209 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201160.406056:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2e00/0x96d0c9b8c9a1c202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c209 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201160.406069:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788201160.406072:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1788201160.406076:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788201160.406121:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec600/0x96d0c9b8c9a1c210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201160.406130:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec600/0x96d0c9b8c9a1c210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201160.406155:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec600/0x96d0c9b8c9a1c210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201160.406182:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715216640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201160.406256:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201160.406309:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f60240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201160.406446:0:92554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715216640 00000100:00100000:0.0:1788201160.406453:0:92554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715216640 00000100:00100000:0.0:1788201160.406507:0:92554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788201160.406517:0:92554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715216640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201160.406531:0:92554:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201160.406546:0:92554:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782d800/0x96d0c9b8c9a1c217 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c210 expref: -99 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201160.406576:0:92554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782d800/0x96d0c9b8c9a1c217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c210 expref: 23 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201160.406598:0:92554:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782d800/0x96d0c9b8c9a1c217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c210 expref: 23 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201160.406725:0:92554:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782d800, rc 0) 00000100:00100000:0.0:1788201160.406785:0:92554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715216640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 269us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201160.406792:0:92554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788201160.406875:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715216640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201160.406892:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec600/0x96d0c9b8c9a1c210 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c217 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201160.406902:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec600/0x96d0c9b8c9a1c210 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c217 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201160.406973:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715216768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201160.407001:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201160.407057:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f60240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201160.407286:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715216768 00000100:00100000:0.0:1788201160.407292:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715216768 00000100:00100000:0.0:1788201160.407328:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788201160.407336:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715216768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201160.407493:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715216768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 156us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201160.407500:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788201160.407744:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715216768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201160.407788:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715216896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201160.407846:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201160.407881:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125446480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201160.407941:0:92551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715216896 00000100:00100000:2.0:1788201160.407947:0:92551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715216896 00000100:00100000:3.0:1788201160.408117:0:92551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788201160.408125:0:92551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715216896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201160.408243:0:92551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715216896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201160.408250:0:92551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788201160.408594:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715216896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201160.409948:0:93292:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1788201160.411772:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1788201160.411814:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788201160.411830:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec600/0x96d0c9b8c9a1c210 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c217 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201160.411844:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec600/0x96d0c9b8c9a1c210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c217 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201160.411857:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788201160.411860:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dc12563cd28 from 1 10000000:01000000:2.0:1788201160.411863:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788201160.411919:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c21e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201160.411929:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c21e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201160.411942:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c21e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201160.411972:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715217024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201160.412084:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201160.412127:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038e0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201160.412201:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715217024 00000100:00100000:1.0:1788201160.412211:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715217024 00000100:00100000:1.0:1788201160.412288:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788201160.412298:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715217024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201160.412314:0:92549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201160.412331:0:92549:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064ec400/0x96d0c9b8c9a1c225 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c21e expref: -99 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201160.412360:0:92549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ec400/0x96d0c9b8c9a1c225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c21e expref: 24 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201160.412395:0:92549:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064ec400/0x96d0c9b8c9a1c225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c21e expref: 24 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201160.412405:0:92549:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ec400, rc 0) 00000100:00100000:1.0:1788201160.412457:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715217024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201160.412464:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788201160.414784:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715217024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201160.414819:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c21e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c225 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201160.414834:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c21e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c225 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201160.414971:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715217152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201160.415081:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201160.415141:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038e0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201160.415707:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715217152 00000100:00100000:1.0:1788201160.415717:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715217152 00000100:00100000:1.0:1788201160.415781:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788201160.415792:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715217152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201160.415918:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715217152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (836us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201160.415926:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788201160.416838:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715217152:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788201160.416896:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788201160.416907:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c21e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c225 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201160.416919:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c21e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c225 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201160.463443:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201160.986359:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201160.997472:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695411200 00000100:00100000:2.0:1788201160.997502:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695411200 00000100:00100000:2.0:1788201160.997690:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 163 00000100:00100000:2.0:1788201160.997705:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71021:x1875060695411200:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201160.997733:0:92549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201160.997763:0:92549:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1c22c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78685d expref: -99 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201160.997807:0:92549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1c22c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78685d expref: 9 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201160.997820:0:92549:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1c22c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78685d expref: 9 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201160.998645:0:92549:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007adf200, rc 0) 00000100:00100000:2.0:1788201160.998848:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695411200:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 1134us (13133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201160.998858:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 163 00000100:00100000:2.0:1788201161.014501:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201161.014685:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695411328 00000100:00100000:1.0:1788201161.014700:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695411328 00000100:00100000:1.0:1788201161.014777:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 164 00000100:00100000:1.0:1788201161.014790:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695411328:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201161.015069:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695411328:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 280us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201161.015079:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 164 00000100:00100000:0.0:1788201161.021154:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201161.022889:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695411456 00000100:00100000:2.0:1788201161.022915:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695411456 00000100:00100000:2.0:1788201161.023073:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 165 00000100:00100000:2.0:1788201161.023086:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695411456:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201161.023314:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695411456:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 229us (2176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201161.023322:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 165 00000100:00100000:3.0:1788201161.031240:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201161.034431:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695411584 00000100:00100000:1.0:1788201161.034456:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695411584 00000100:00100000:1.0:1788201161.034566:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 166 00000100:00100000:1.0:1788201161.034579:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:72012:x1875060695411584:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788201161.034859:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:72012:x1875060695411584:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 282us (3645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201161.034869:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 166 00000100:00100000:0.0:1788201161.039464:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201161.039734:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695411712 00000100:00100000:2.0:1788201161.039748:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695411712 00000100:00100000:2.0:1788201161.039825:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 167 00000100:00100000:2.0:1788201161.039836:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:72012:x1875060695411712:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788201161.040301:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:72012:x1875060695411712:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 464us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201161.040311:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 167 00000100:00100000:2.0:1788201161.061658:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201161.062647:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695411840 00000100:00100000:0.0:1788201161.062663:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695411840 00000100:00100000:0.0:1788201161.062735:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 168 00000100:00100000:0.0:1788201161.062748:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695411840:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201161.062768:0:92550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201161.062791:0:92550:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782c600/0x96d0c9b8c9a1c233 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786864 expref: -99 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201161.062841:0:92550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782c600/0x96d0c9b8c9a1c233 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786864 expref: 10 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201161.062853:0:92550:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782c600/0x96d0c9b8c9a1c233 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786864 expref: 10 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201161.062864:0:92550:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782c600, rc 0) 00000100:00100000:0.0:1788201161.062992:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695411840:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 246us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201161.063000:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 168 00000100:00100000:2.0:1788201161.088184:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201161.088251:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695411968 00000100:00100000:2.0:1788201161.088264:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695411968 00000100:00100000:2.0:1788201161.088337:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 169 00000100:00100000:2.0:1788201161.088350:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695411968:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201161.088505:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695411968:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 156us (337us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201161.088524:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 169 00010000:00010000:2.0:1788201161.487429:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201162.103294:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201162.103336:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695412096 00000100:00100000:2.0:1788201162.103346:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695412096 00000100:00100000:2.0:1788201162.103406:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1374 00000100:00100000:2.0:1788201162.103423:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:72032:x1875060695412096:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:2.0:1788201162.103443:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201162.103464:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adf000/0x96d0c9b8c9a1c23a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78686b expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.103534:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade400/0x96d0c9b8c9a1c241 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.103546:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade400/0x96d0c9b8c9a1c241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.103557:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade400/0x96d0c9b8c9a1c241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201162.103602:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788201162.103605:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201162.103639:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade400/0x96d0c9b8c9a1c241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.103660:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adf000/0x96d0c9b8c9a1c23a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78686b expref: 8 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.103678:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade400/0x96d0c9b8c9a1c241 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78686b expref: 7 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.103699:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103141d00) 00010000:00010000:2.0:1788201162.103701:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201162.103704:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ade400, rc 0) 00000100:00100000:2.0:1788201162.103755:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:72032:x1875060695412096:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 340us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201162.103762:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1374 00000100:00080000:2.0:1788201162.103784:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201162.110483:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201162.110586:0:92515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695412224 00000100:00100000:3.0:1788201162.110595:0:92515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695412224 00000100:00100000:3.0:1788201162.110645:0:92515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:3.0:1788201162.110655:0:92515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:72032:x1875060695412224:12345-192.168.201.20@tcp:700:mkdir.0 00000100:00100000:3.0:1788201162.110733:0:92515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:72032:x1875060695412224:12345-192.168.201.20@tcp:700:mkdir.0 Request processed in 79us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201162.110741:0:92515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:1.0:1788201162.116653:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201162.123312:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695412480 00000100:00100000:0.0:1788201162.123329:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695412480 00000100:00100000:0.0:1788201162.123403:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1375 00000100:00100000:0.0:1788201162.123414:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:72032:x1875060695412480:12345-192.168.201.20@tcp:36:mkdir.0 00010000:00010000:0.0:1788201162.123472:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201162.125580:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade400/0x96d0c9b8c9a1c241 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78686b expref: 7 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.125606:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103141d00) 00010000:00010000:0.0:1788201162.125611:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201162.125685:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c248 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.125698:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c248 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.125710:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c248 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.125739:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c24f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.125747:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c24f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.125754:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c24f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.129325:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c256 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.129347:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c256 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.129360:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c256 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201162.129378:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee5c45ac reply state 000000009be5c6d8 transno 120259084292 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c256 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.129389:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c256 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.129396:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8dc0048bee00) 00010000:00010000:0.0:1788201162.129399:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201162.129402:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788201162.129408:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788201162.129417:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c248 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.129424:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c248 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.129438:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c248 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.129445:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c248 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.129452:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782da00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201162.129456:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c248 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.129464:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c248 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.129475:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103141d00) 00010000:00010000:0.0:1788201162.129477:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201162.129480:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c248 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.129487:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c248 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201162.130054:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee5c45ac reply state 000000009be5c6d8 transno 120259084292 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c24f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.130070:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c24f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.130077:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff8dc0048bef00) 00010000:00010000:0.0:1788201162.130080:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201162.130082:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788201162.130289:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:72032:x1875060695412480:12345-192.168.201.20@tcp:36:mkdir.0 Request processed in 6872us (13638us total) trans 120259084292 rc 0/0 00000100:00100000:0.0:1788201162.130305:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1375 00000100:00100000:1.0:1788201162.141457:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201162.145245:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695412608 00000100:00100000:0.0:1788201162.145262:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695412608 00000100:00100000:1.0:1788201162.148684:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1376 00000100:00100000:1.0:1788201162.148697:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:72032:x1875060695412608:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:1.0:1788201162.148719:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201162.148740:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1c25d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786872 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.148808:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1c264 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.148821:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1c264 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.148832:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1c264 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201162.148878:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788201162.148882:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201162.148905:0:66312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1c264 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.148929:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1c25d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786872 expref: 10 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.148945:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1c264 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786872 expref: 9 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.148972:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103141d00) 00010000:00010000:1.0:1788201162.148975:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201162.148978:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ed600, rc 0) 00000100:00100000:1.0:1788201162.149063:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:72032:x1875060695412608:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 367us (7615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201162.149070:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1376 00000100:00100000:3.0:1788201162.154449:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201162.154543:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695412864 00000100:00100000:0.0:1788201162.154554:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695412864 00000100:00100000:0.0:1788201162.154616:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1377 00000100:00100000:0.0:1788201162.154626:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:72032:x1875060695412864:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:0.0:1788201162.154646:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201162.154665:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c26b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786879 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.154739:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c272 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.154752:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c272 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.154762:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c272 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.154774:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c279 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.154781:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.154787:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201162.154882:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788201162.154977:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c272 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.154985:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c272 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.154991:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c272 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.154998:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c272 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.155004:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782ca00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201162.155008:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c272 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.155041:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c272 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.155055:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103141d00) 00010000:00010000:0.0:1788201162.155058:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201162.155062:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c272 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.155068:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c272 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.155081:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.155087:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c279 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.155093:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c279 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.155105:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201162.155108:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c279 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.155114:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c279 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.155124:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff8dc0048bef00) 00010000:00010000:0.0:1788201162.155126:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201162.155129:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c279 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.155135:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c279 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.155181:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c26b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786879 expref: 11 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.155200:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103141d00) 00010000:00010000:0.0:1788201162.155203:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201162.155207:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1c26b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786879 expref: 11 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.155218:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782da00, rc 0) 00000100:00100000:0.0:1788201162.155274:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:72032:x1875060695412864:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 649us (833us total) trans 120259084293 rc 301/301 00000100:00100000:0.0:1788201162.155282:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1377 00000100:00100000:0.0:1788201162.161853:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201162.162888:0:66323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695412992 00000100:00100000:3.0:1788201162.162899:0:66323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695412992 00000100:00100000:3.0:1788201162.162978:0:66323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:3.0:1788201162.162989:0:66323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:72032:x1875060695412992:12345-192.168.201.20@tcp:900:mkdir.0 00000100:00100000:3.0:1788201162.163100:0:66323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:72032:x1875060695412992:12345-192.168.201.20@tcp:900:mkdir.0 Request processed in 113us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201162.163108:0:66323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00080000:1.0:1788201162.165070:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201162.174388:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201162.174459:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695413248 00000100:00100000:1.0:1788201162.174471:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695413248 00000100:00100000:1.0:1788201162.174637:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 239 00000100:00100000:1.0:1788201162.174649:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107db6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:72032:x1875060695413248:12345-192.168.201.20@tcp:35:mkdir.0 00000100:00100000:1.0:1788201162.174889:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107db6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:72032:x1875060695413248:12345-192.168.201.20@tcp:35:mkdir.0 Request processed in 242us (510us total) trans 120259084294 rc 0/0 00000100:00100000:1.0:1788201162.174898:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 239 00000100:00100000:3.0:1788201162.180246:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201162.180334:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695413504 00000100:00100000:0.0:1788201162.180344:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695413504 00000100:00100000:0.0:1788201162.180411:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1378 00000100:00100000:0.0:1788201162.180421:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:72032:x1875060695413504:12345-192.168.201.20@tcp:36:mkdir.0 00000100:00100000:0.0:1788201162.180562:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715217280:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201162.180615:0:66314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201162.180642:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038e0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201162.180692:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715217280 00000100:00100000:3.0:1788201162.180697:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715217280 00000100:00100000:3.0:1788201162.180734:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4011 00000100:00100000:3.0:1788201162.180742:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66314:x1875060715217280:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788201162.180818:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66314:x1875060715217280:12345-0@lo:1000:mdt00_002.0 Request processed in 77us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201162.180825:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4011 00000100:00100000:3.0:1788201162.180866:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715217280:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788201162.180924:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715217408:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788201162.180950:0:66314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201162.180989:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc104ea0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201162.181910:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715217408 00000100:00100000:0.0:1788201162.181917:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715217408 00000100:00100000:0.0:1788201162.181964:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4012 00000100:00100000:0.0:1788201162.181973:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66314:x1875060715217408:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201162.182076:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66314:x1875060715217408:12345-0@lo:1000:mdt00_002.0 Request processed in 104us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201162.182083:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4012 00000100:00100000:3.0:1788201162.182289:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715217408:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788201162.182338:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715217536:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788201162.182367:0:66314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201162.182394:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038e0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201162.183058:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715217536 00000100:00100000:0.0:1788201162.183065:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715217536 00000100:00100000:0.0:1788201162.183099:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4013 00000100:00100000:0.0:1788201162.183107:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66314:x1875060715217536:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201162.183210:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66314:x1875060715217536:12345-0@lo:1000:mdt00_002.0 Request processed in 87us (826us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201162.183217:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4013 00000100:00100000:3.0:1788201162.184089:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715217536:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788201162.184150:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2800/0x96d0c9b8c9a1c287 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.184160:0:66314:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2800/0x96d0c9b8c9a1c287 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.184215:0:66314:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2800/0x96d0c9b8c9a1c287 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201162.184232:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715217664:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1788201162.184267:0:66314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201162.184289:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc104ea0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201162.189009:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715217664 00000100:00100000:0.0:1788201162.189050:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715217664 00000100:00100000:0.0:1788201162.189123:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4014 00000100:00100000:0.0:1788201162.189134:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66314:x1875060715217664:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1788201162.189154:0:8457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201162.189216:0:8457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c28e lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c287 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.189242:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c256 lrc: 2/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.189252:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c28e lrc: 4/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c287 expref: 9 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.189270:0:8457:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c256 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:0.0:1788201162.189300:0:8457:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:0.0:1788201162.189344:0:8457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c28e lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c287 expref: 9 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.189353:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8dc0048bee00) 00010000:00010000:0.0:1788201162.189356:0:8457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201162.189360:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c28e lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c287 expref: 9 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.189367:0:8457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782d600, rc 0) 00000100:00100000:0.0:1788201162.189446:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66314:x1875060715217664:12345-0@lo:101:mdt00_002.0 Request processed in 313us (5176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201162.189452:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4014 00000100:00100000:3.0:1788201162.189559:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715217664:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1788201162.189577:0:66314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2800/0x96d0c9b8c9a1c287 lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c28e expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.189585:0:66314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2800/0x96d0c9b8c9a1c287 lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c28e expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788201162.196847:0:92544:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084294 is committed 00000001:00080000:0.0:1788201162.196876:0:92544:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084291 is committed 00010000:00010000:1.0:1788201162.196931:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c24f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.196942:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c24f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.196950:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c24f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.196965:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201162.196969:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c24f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.196996:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c24f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.197275:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff8dc0048bef00) 00010000:00010000:1.0:1788201162.197279:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201162.197285:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c24f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.197291:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c24f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.197312:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c256 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.197317:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c256 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.197323:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c256 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.197328:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782ce00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201162.197330:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c256 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.197335:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c256 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.197342:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8dc0048bee00) 00010000:00010000:1.0:1788201162.197345:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201162.197351:0:3642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c28e lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c287 expref: 7 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.197369:0:3642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c28e lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c287 expref: 7 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.197378:0:3642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c28e lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c287 expref: 7 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.197502:0:3642:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c28e lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c287 expref: 7 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201162.197529:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3642:1875060715217792:0@lo:105: 00000100:00100000:0.0:1788201162.197602:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201162.197852:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715217792 00000100:00100000:3.0:1788201162.197862:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715217792 00000100:00100000:3.0:1788201162.197950:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1788201162.197969:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:3642:x1875060715217792:12345-0@lo:105: 00010000:00010000:3.0:1788201162.197981:0:19665:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2800/0x96d0c9b8c9a1c287 lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c28e expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.197990:0:19665:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2800/0x96d0c9b8c9a1c287 lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c28e expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.197998:0:19665:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2800/0x96d0c9b8c9a1c287 lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c28e expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.198006:0:19665:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2800/0x96d0c9b8c9a1c287 lrc: 5/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x96d0c9b8c9a1c28e expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.198049:0:19665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2800/0x96d0c9b8c9a1c287 lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x96d0c9b8c9a1c28e expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.198058:0:19665:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2800/0x96d0c9b8c9a1c287 lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x96d0c9b8c9a1c28e expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.198079:0:19665:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8dc125ae2800) 00000100:00100000:3.0:1788201162.198119:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:3642:x1875060715217792:12345-0@lo:105: Request processed in 153us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201162.198126:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00010000:00010000:2.0:1788201162.198211:0:66314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2800/0x96d0c9b8c9a1c287 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c28e expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.198219:0:66314:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2800/0x96d0c9b8c9a1c287 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c28e expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201162.198242:0:66314:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:2.0:1788201162.198279:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007adf000/0x96d0c9b8c9a1c295 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.198285:0:66314:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007adf000/0x96d0c9b8c9a1c295 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.198294:0:66314:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007adf000/0x96d0c9b8c9a1c295 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201162.198309:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715217920:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1788201162.198340:0:66314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201162.198363:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13aa35180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201162.198379:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715217920 00000100:00100000:2.0:1788201162.198383:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715217920 00000100:00100000:2.0:1788201162.198419:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4015 00000100:00100000:2.0:1788201162.198426:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66314:x1875060715217920:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1788201162.198440:0:23728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201162.198454:0:23728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adf400/0x96d0c9b8c9a1c29c lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c295 expref: -99 pid: 23728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.198472:0:23728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adf400/0x96d0c9b8c9a1c29c lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c295 expref: 9 pid: 23728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.198484:0:23728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adf400/0x96d0c9b8c9a1c29c lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c295 expref: 9 pid: 23728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.198492:0:23728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff8dc12196eb00) 00010000:00010000:2.0:1788201162.198495:0:23728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201162.198497:0:23728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007adf400, rc 0) 00000100:00100000:2.0:1788201162.198528:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66314:x1875060715217920:12345-0@lo:101:mdt00_002.0 Request processed in 103us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201162.198535:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4015 00000100:00100000:2.0:1788201162.198565:0:66314:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084291 gen 3 00000004:00080000:2.0:1788201162.198571:0:66314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084291 committed transno 120259084291 00000100:00100000:2.0:1788201162.198588:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715217920:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1788201162.198600:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007adf000/0x96d0c9b8c9a1c295 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c29c expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.198609:0:66314:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007adf000/0x96d0c9b8c9a1c295 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c29c expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201162.198619:0:66314:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00000100:00100000:2.0:1788201162.198670:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715218048:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788201162.198701:0:66314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201162.198719:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201162.198778:0:3642:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f982900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201162.198793:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3642:1875060715217792:0@lo:105: 00010000:00010000:0.0:1788201162.198810:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c256 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.198816:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c256 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201162.198842:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715218048 00000100:00100000:0.0:1788201162.198845:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715218048 00000100:00100000:0.0:1788201162.198875:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4016 00000100:00100000:0.0:1788201162.198882:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13c272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66314:x1875060715218048:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201162.198946:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13c272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66314:x1875060715218048:12345-0@lo:1000:mdt00_002.0 Request processed in 63us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201162.198952:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4016 00000100:00100000:0.0:1788201162.199175:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715218048:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201162.199225:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715218176:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201162.199251:0:66314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201162.199266:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f982180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201162.199278:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715218176 00000100:00100000:0.0:1788201162.199281:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715218176 00000100:00100000:0.0:1788201162.199303:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4017 00000100:00100000:0.0:1788201162.199309:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66314:x1875060715218176:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201162.199391:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66314:x1875060715218176:12345-0@lo:1000:mdt00_002.0 Request processed in 81us (138us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201162.199396:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4017 00000100:00100000:0.0:1788201162.199421:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715218176:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201162.199486:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715218304:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201162.199507:0:66314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201162.199521:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f982900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201162.199531:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715218304 00000100:00100000:0.0:1788201162.199535:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715218304 00000100:00100000:0.0:1788201162.199555:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4018 00000100:00100000:0.0:1788201162.199561:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66314:x1875060715218304:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201162.199612:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66314:x1875060715218304:12345-0@lo:1000:mdt00_002.0 Request processed in 51us (103us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201162.199618:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4018 00000100:00100000:0.0:1788201162.199641:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715218304:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201162.199681:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715218432:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201162.199703:0:66314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201162.199716:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006e9a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201162.199726:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715218432 00000100:00100000:0.0:1788201162.199729:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715218432 00000100:00100000:0.0:1788201162.199747:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4019 00000100:00100000:0.0:1788201162.199753:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66314:x1875060715218432:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201162.199799:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66314:x1875060715218432:12345-0@lo:1000:mdt00_002.0 Request processed in 46us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201162.199806:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4019 00000100:00100000:0.0:1788201162.199840:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715218432:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201162.199875:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715218560:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201162.199898:0:66314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201162.199911:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f982180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201162.199923:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715218560 00000100:00100000:0.0:1788201162.199926:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715218560 00000100:00100000:0.0:1788201162.199947:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4020 00000100:00100000:0.0:1788201162.199952:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66314:x1875060715218560:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201162.200006:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66314:x1875060715218560:12345-0@lo:1000:mdt00_002.0 Request processed in 53us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201162.200012:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4020 00000100:00100000:0.0:1788201162.200059:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715218560:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201162.200093:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715218688:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201162.200115:0:66314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201162.200128:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f982900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201162.200138:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715218688 00000100:00100000:0.0:1788201162.200142:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715218688 00000100:00100000:0.0:1788201162.200162:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4021 00000100:00100000:0.0:1788201162.200166:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66314:x1875060715218688:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201162.200229:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66314:x1875060715218688:12345-0@lo:1000:mdt00_002.0 Request processed in 61us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201162.200235:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4021 00000100:00100000:0.0:1788201162.200259:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66314:1875060715218688:0@lo:1000:mdt00_002.0 00000040:00080000:0.0:1788201162.200699:0:66314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x1:0x0].8, 968 off43272 00000040:00080000:0.0:1788201162.200752:0:66314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x1:0x0].7, 1120 off42136 00000004:00080000:0.0:1788201162.200766:0:66314:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc13aa35180 with version 20 00000004:00080000:0.0:1788201162.200783:0:75745:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc007566d80 version 20 rpc_version 20 00000020:00100000:0.0:1788201162.200802:0:75745:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788201162.200810:0:75745:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc005abdf80 x1875060715218944/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2392/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201162.200826:0:75745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdf80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715218944:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788201162.200855:0:75745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201162.200872:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0034c7480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201162.200886:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715218944 00000100:00100000:0.0:1788201162.200890:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715218944 00000100:00100000:0.0:1788201162.200913:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4022 00000100:00100000:0.0:1788201162.200919:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75745:x1875060715218944:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788201162.201234:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:75745:x1875060715218944:12345-0@lo:1000:osp_up0-1.0 Request processed in 314us (377us total) trans 120259084295 rc 0/0 00000100:00100000:0.0:1788201162.201241:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4022 00000100:00100000:0.0:1788201162.201282:0:75745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdf80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715218944:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1788201162.201338:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c2a3 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.201354:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c2a3 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.201366:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c2a3 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201162.201383:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5490506 reply state 00000000d840917d transno 77309411460 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c2a3 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.201393:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c2a3 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.201407:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8dc0048bea00) 00010000:00010000:0.0:1788201162.201409:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201162.201413:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788201162.201419:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00080000:0.0:1788201162.201427:0:66314:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:0.0:1788201162.201434:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2800/0x96d0c9b8c9a1c287 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c28e expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.201442:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2800/0x96d0c9b8c9a1c287 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1c28e expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.201449:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2800/0x96d0c9b8c9a1c287 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1c28e expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.201463:0:66314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788201162.201467:0:66314:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:0.0:1788201162.201471:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007adf000/0x96d0c9b8c9a1c295 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c29c expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.201477:0:66314:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007adf000/0x96d0c9b8c9a1c295 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c29c expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201162.201549:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:72032:x1875060695413504:12345-192.168.201.20@tcp:36:mkdir.0 Request processed in 21128us (21312us total) trans 77309411460 rc 0/0 00000100:00100000:0.0:1788201162.201556:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1378 00010000:00010000:2.0:1788201162.201747:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201162.201755:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2800/0x96d0c9b8c9a1c287 lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1c28e expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.201762:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2800 already unused, calling callback (ffffffffc189cee0) 00010000:00010000:2.0:1788201162.201768:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2800/0x96d0c9b8c9a1c287 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1c28e expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201162.201776:0:13349:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2800/0x96d0c9b8c9a1c287 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1c28e expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.201800:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2800/0x96d0c9b8c9a1c287 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c28e expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.201805:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201162.201832:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2800/0x96d0c9b8c9a1c287 lrc: 1/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c28e expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.201840:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2800/0x96d0c9b8c9a1c287 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c28e expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.201858:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201162.201860:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201162.201862:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201162.201870:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201162.201880:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715219072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201162.201920:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201162.205858:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715219072 00000100:00100000:0.0:1788201162.205879:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715219072 00000100:00100000:0.0:1788201162.205979:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1788201162.206004:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3655:x1875060715219072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201162.206043:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201162.206069:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c28e lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c287 expref: 10 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.206091:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8dc0048bee00) 00010000:00010000:0.0:1788201162.206102:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201162.206211:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3655:x1875060715219072:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (4281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201162.206219:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1788201162.206269:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715219072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201162.208211:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201162.208405:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695413760 00000100:00100000:1.0:1788201162.208414:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695413760 00000100:00100000:1.0:1788201162.208466:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1379 00000100:00100000:1.0:1788201162.208476:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:72032:x1875060695413760:12345-192.168.201.20@tcp:36:mkdir.0 00010000:00010000:1.0:1788201162.208532:0:66757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201162.208554:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1c264 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786872 expref: 7 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.208572:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103141d00) 00010000:00010000:1.0:1788201162.208575:0:66757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201162.208715:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:72032:x1875060695413760:12345-192.168.201.20@tcp:36:mkdir.0 Request processed in 238us (526us total) trans 0 rc -17/-17 00000100:00100000:1.0:1788201162.208721:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1379 00000100:00100000:0.0:1788201162.216695:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201162.216794:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695413888 00000100:00100000:3.0:1788201162.216805:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695413888 00000100:00100000:3.0:1788201162.216909:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1380 00000100:00100000:3.0:1788201162.216920:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:72032:x1875060695413888:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:3.0:1788201162.216942:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201162.216963:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1c2aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786880 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.217066:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c2b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.217080:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c2b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.217092:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c2b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201162.217141:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788201162.217158:0:69485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201162.217209:0:69485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c2b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.217235:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1c2aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786880 expref: 8 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.217251:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c2b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786880 expref: 7 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.217260:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103141d00) 00010000:00010000:3.0:1788201162.217264:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201162.217267:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3a00, rc 0) 00000100:00100000:3.0:1788201162.217327:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:72032:x1875060695413888:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 410us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201162.217334:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1380 00000100:00100000:1.0:1788201162.226589:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201162.226716:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695414016 00000100:00100000:0.0:1788201162.226727:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695414016 00000100:00100000:0.0:1788201162.226830:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1381 00000100:00100000:0.0:1788201162.226841:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:72032:x1875060695414016:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:0.0:1788201162.226863:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201162.226884:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c2b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786887 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.226951:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c2bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.226963:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c2bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.226974:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c2bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.227000:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1c2c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.227007:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1c2c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.227054:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1c2c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.227133:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c2cd lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.227141:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c2cd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.227149:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c2cd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201162.227218:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201162.227222:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201162.227242:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c2cd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.227255:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c2bf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.227262:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c2bf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.227268:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c2bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.227284:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c2bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.227290:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782de00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201162.227294:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c2bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.227302:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c2bf lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.227314:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103141d00) 00010000:00010000:0.0:1788201162.227318:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201162.227322:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c2bf lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.227328:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c2bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.227354:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1c2c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.227361:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1c2c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.227367:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1c2c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.227372:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201162.227374:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1c2c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.227391:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1c2c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.227400:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff8dc0048bee00) 00010000:00010000:0.0:1788201162.227402:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201162.227406:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1c2c6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.227412:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1c2c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.227442:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c2b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786887 expref: 9 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.227456:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c2cd lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786887 expref: 8 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.227464:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8dc0048be800) 00010000:00010000:0.0:1788201162.227466:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201162.227469:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782c400, rc 0) 00000100:00100000:0.0:1788201162.227533:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:72032:x1875060695414016:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 693us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201162.227540:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1381 00000100:00100000:0.0:1788201162.230428:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201162.230510:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695414272 00000100:00100000:2.0:1788201162.230520:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695414272 00000100:00100000:2.0:1788201162.230627:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1382 00000100:00100000:2.0:1788201162.230638:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:72032:x1875060695414272:12345-192.168.201.20@tcp:36:mkdir.0 00000100:00100000:2.0:1788201162.230744:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715219200:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788201162.230795:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201162.230826:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201162.230876:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715219200 00000100:00100000:0.0:1788201162.230881:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715219200 00000100:00100000:0.0:1788201162.230924:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4023 00000100:00100000:0.0:1788201162.230932:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715219200:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201162.231050:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715219200:12345-0@lo:1000:mdt00_001.0 Request processed in 118us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201162.231057:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4023 00000100:00100000:3.0:1788201162.231180:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715219200:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788201162.231236:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715219328:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788201162.231264:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201162.231287:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc104ea0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201162.231341:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715219328 00000100:00100000:2.0:1788201162.231346:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715219328 00000100:00100000:2.0:1788201162.231396:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4024 00000100:00100000:2.0:1788201162.231403:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715219328:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788201162.231486:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715219328:12345-0@lo:1000:mdt00_001.0 Request processed in 83us (220us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201162.231493:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4024 00000100:00100000:0.0:1788201162.231954:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715219328:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788201162.232005:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c2d4 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.232042:0:66313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c2d4 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.232053:0:66313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c2d4 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201162.232067:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715219456:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1788201162.232095:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201162.232111:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f4e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788201162.232162:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715219456 00000100:00100000:2.0:1788201162.232166:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715219456 00000100:00100000:2.0:1788201162.232207:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4025 00000100:00100000:2.0:1788201162.232215:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715219456:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1788201162.232225:0:23728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201162.232240:0:23728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adee00/0x96d0c9b8c9a1c2db lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c2d4 expref: -99 pid: 23728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.232262:0:23728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c2cd lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786887 expref: 7 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.232271:0:23728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adee00/0x96d0c9b8c9a1c2db lrc: 4/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c2d4 expref: 10 pid: 23728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.232306:0:23728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c2cd lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786887 expref: 7 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.232319:0:23728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c2cd lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786887 expref: 7 pid: 66314 timeout: 4113 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201162.232331:0:23728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23728:1875060715219584:192.168.201.20@tcp:104: 00000100:00100000:2.0:1788201162.232397:0:23728:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10556a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201162.235371:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201162.235482:0:23728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:23728:1875060715219584:192.168.201.20@tcp:104: 00010000:00010000:0.0:1788201162.235516:0:23728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adee00/0x96d0c9b8c9a1c2db lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c2d4 expref: 10 pid: 23728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.235527:0:23728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8dc0048be800) 00010000:00010000:0.0:1788201162.235529:0:23728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201162.235533:0:23728:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adee00/0x96d0c9b8c9a1c2db lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c2d4 expref: 10 pid: 23728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.235542:0:23728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007adee00, rc 0) 00000100:00100000:0.0:1788201162.235649:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66313:x1875060715219456:12345-0@lo:101:mdt00_001.0 Request processed in 3434us (3552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201162.235676:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4025 00000100:00100000:1.0:1788201162.235773:0:9535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695414400 00000100:00100000:1.0:1788201162.235780:0:9535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695414400 00010000:00010000:1.0:1788201162.235808:0:9535:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c2cd lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786887 expref: 8 pid: 66314 timeout: 4113 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201162.235843:0:9535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2585 00000100:00100000:1.0:1788201162.235860:0:9535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2400:x1875060695414400:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201162.235875:0:9535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201162.235882:0:9535:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c2cd lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786887 expref: 8 pid: 66314 timeout: 4113 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.235894:0:9535:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c2cd lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786887 expref: 8 pid: 66314 timeout: 4113 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.235915:0:9535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c2cd lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786887 expref: 8 pid: 66314 timeout: 4113 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.235929:0:9535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8dc0048be800) 00010000:00010000:1.0:1788201162.235934:0:9535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adee00/0x96d0c9b8c9a1c2db lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c2d4 expref: 9 pid: 23728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.235944:0:9535:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adee00/0x96d0c9b8c9a1c2db lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c2d4 expref: 9 pid: 23728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.235952:0:9535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adee00/0x96d0c9b8c9a1c2db lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c2d4 expref: 9 pid: 23728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.235995:0:9535:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adee00/0x96d0c9b8c9a1c2db lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c2d4 expref: 9 pid: 23728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201162.236006:0:9535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9535:1875060715219712:0@lo:105: 00000100:00100000:1.0:1788201162.236085:0:9535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201162.236116:0:9535:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc104e14cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201162.236137:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715219712 00000100:00100000:1.0:1788201162.236141:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715219712 00000100:00100000:1.0:1788201162.236182:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788201162.236189:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:9535:x1875060715219712:12345-0@lo:105: 00010000:00010000:1.0:1788201162.236208:0:6516:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c2d4 lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c2db expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.236216:0:6516:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c2d4 lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c2db expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.236224:0:6516:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c2d4 lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c2db expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.236232:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c2d4 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x96d0c9b8c9a1c2db expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.236239:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c2d4 lrc: 5/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x96d0c9b8c9a1c2db expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.236247:0:6516:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c2d4 lrc: 5/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x96d0c9b8c9a1c2db expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.236261:0:6516:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8dc00782d600) 00000100:00100000:1.0:1788201162.236291:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:9535:x1875060715219712:12345-0@lo:105: Request processed in 103us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201162.236297:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788201162.236330:0:9535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:9535:1875060715219712:0@lo:105: 00010000:00010000:1.0:1788201162.236340:0:9535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201162.236384:0:9535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2400:x1875060695414400:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 526us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201162.236390:0:9535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2585 00000100:00100000:3.0:1788201162.236870:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715219456:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1788201162.236886:0:66313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c2d4 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c2db expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201162.236907:0:66313:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:3.0:1788201162.236940:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3800/0x96d0c9b8c9a1c2e2 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.237035:0:66313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3800/0x96d0c9b8c9a1c2e2 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.237046:0:66313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3800/0x96d0c9b8c9a1c2e2 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201162.237062:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715219840:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1788201162.237095:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201162.237170:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201162.237303:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715219840 00000100:00100000:2.0:1788201162.237308:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715219840 00000100:00100000:2.0:1788201162.237381:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4026 00000100:00100000:2.0:1788201162.237389:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66313:x1875060715219840:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1788201162.237405:0:8458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201162.237421:0:8458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adf800/0x96d0c9b8c9a1c2e9 lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c2e2 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.237442:0:8458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adf800/0x96d0c9b8c9a1c2e9 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c2e2 expref: 11 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.237454:0:8458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adf800/0x96d0c9b8c9a1c2e9 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c2e2 expref: 11 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.237461:0:8458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff8dc12196e200) 00010000:00010000:2.0:1788201162.237464:0:8458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201162.237474:0:8458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007adf800, rc 0) 00000100:00100000:2.0:1788201162.237518:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66313:x1875060715219840:12345-0@lo:101:mdt00_001.0 Request processed in 130us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201162.237524:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4026 00000100:00100000:0.0:1788201162.237587:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715219840:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1788201162.237599:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3800/0x96d0c9b8c9a1c2e2 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c2e9 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.237607:0:66313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3800/0x96d0c9b8c9a1c2e2 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c2e9 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201162.237620:0:66313:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00000100:00100000:0.0:1788201162.237651:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715219968:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201162.237681:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201162.237760:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f4ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201162.237827:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715219968 00000100:00100000:3.0:1788201162.237832:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715219968 00000100:00100000:3.0:1788201162.237867:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4027 00000100:00100000:3.0:1788201162.237874:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66313:x1875060715219968:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788201162.237932:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66313:x1875060715219968:12345-0@lo:1000:mdt00_001.0 Request processed in 59us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201162.237939:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4027 00000100:00100000:0.0:1788201162.238043:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715219968:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201162.238083:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715220096:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201162.238106:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201162.238118:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f4ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201162.238130:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715220096 00000100:00100000:0.0:1788201162.238134:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715220096 00000100:00100000:0.0:1788201162.238153:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4028 00000100:00100000:0.0:1788201162.238158:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66313:x1875060715220096:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201162.238250:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66313:x1875060715220096:12345-0@lo:1000:mdt00_001.0 Request processed in 91us (142us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201162.238267:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4028 00000100:00100000:0.0:1788201162.238294:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715220096:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201162.238360:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715220224:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201162.238391:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201162.238406:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f4ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201162.238418:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715220224 00000100:00100000:0.0:1788201162.238421:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715220224 00000100:00100000:0.0:1788201162.238438:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4029 00000100:00100000:0.0:1788201162.238443:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66313:x1875060715220224:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201162.238494:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66313:x1875060715220224:12345-0@lo:1000:mdt00_001.0 Request processed in 50us (102us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201162.238500:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4029 00000100:00100000:0.0:1788201162.238524:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715220224:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201162.238570:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00388ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715220352:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201162.238592:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201162.238606:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f4ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201162.238618:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715220352 00000100:00100000:0.0:1788201162.238621:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715220352 00000100:00100000:0.0:1788201162.238638:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4030 00000100:00100000:0.0:1788201162.238643:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66313:x1875060715220352:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201162.238693:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66313:x1875060715220352:12345-0@lo:1000:mdt00_001.0 Request processed in 49us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201162.238700:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4030 00000100:00100000:0.0:1788201162.238724:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00388ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715220352:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201162.238762:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00388ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715220480:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201162.238786:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201162.238800:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f4ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201162.238810:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715220480 00000100:00100000:0.0:1788201162.238823:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715220480 00000100:00100000:0.0:1788201162.238843:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4031 00000100:00100000:0.0:1788201162.238848:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66313:x1875060715220480:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201162.238900:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66313:x1875060715220480:12345-0@lo:1000:mdt00_001.0 Request processed in 52us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201162.238906:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4031 00000100:00100000:0.0:1788201162.238928:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00388ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715220480:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201162.238962:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00388ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715220608:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201162.238983:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201162.238997:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f4ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201162.239008:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715220608 00000100:00100000:0.0:1788201162.239011:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715220608 00000100:00100000:0.0:1788201162.239050:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4032 00000100:00100000:0.0:1788201162.239055:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66313:x1875060715220608:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201162.239101:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66313:x1875060715220608:12345-0@lo:1000:mdt00_001.0 Request processed in 44us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201162.239106:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4032 00000100:00100000:0.0:1788201162.239130:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00388ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715220608:0@lo:1000:mdt00_001.0 00000040:00080000:0.0:1788201162.239569:0:66313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x1:0x0].9, 968 off44240 00000040:00080000:0.0:1788201162.239624:0:66313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x1:0x0].8, 1120 off43256 00000004:00080000:0.0:1788201162.239630:0:66313:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc005f4e540 with version 21 00000004:00080000:0.0:1788201162.239645:0:75745:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc007566d80 version 21 rpc_version 21 00000020:00100000:0.0:1788201162.239673:0:75745:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788201162.239680:0:75745:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc0039d1880 x1875060715220864/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2136/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201162.239695:0:75745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715220864:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788201162.239731:0:75745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201162.239746:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc104ea0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201162.239757:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715220864 00000100:00100000:0.0:1788201162.239761:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715220864 00000100:00100000:0.0:1788201162.239779:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4033 00000100:00100000:0.0:1788201162.239784:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:75745:x1875060715220864:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788201162.240060:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:75745:x1875060715220864:12345-0@lo:1000:osp_up0-1.0 Request processed in 274us (327us total) trans 120259084296 rc 0/0 00000100:00100000:0.0:1788201162.240066:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4033 00000100:00100000:0.0:1788201162.240106:0:75745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0039d1880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715220864:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1788201162.240156:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c2f0 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.240170:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c2f0 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.240180:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c2f0 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201162.240209:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e34735eb reply state 000000009f5520e8 transno 77309411461 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c2f0 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.240221:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c2f0 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.240228:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8dc0048bee00) 00010000:00010000:0.0:1788201162.240231:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201162.240235:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788201162.240240:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00080000:0.0:1788201162.240248:0:66313:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:0.0:1788201162.240262:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c2d4 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c2db expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.240271:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c2d4 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1c2db expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.240279:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c2d4 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1c2db expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.240295:0:66313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788201162.240300:0:66313:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x1:0x0] 00010000:00010000:0.0:1788201162.240305:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3800/0x96d0c9b8c9a1c2e2 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c2e9 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.240312:0:66313:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3800/0x96d0c9b8c9a1c2e2 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c2e9 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201162.240384:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:72032:x1875060695414272:12345-192.168.201.20@tcp:36:mkdir.0 Request processed in 9747us (9964us total) trans 77309411461 rc 0/0 00000100:00100000:0.0:1788201162.240392:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1382 00010000:00010000:0.0:1788201162.240416:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201162.240422:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c2d4 lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1c2db expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.240430:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d600 already unused, calling callback (ffffffffc189cee0) 00010000:00010000:0.0:1788201162.240435:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c2d4 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1c2db expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201162.240444:0:6521:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c2d4 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1c2db expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.240475:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c2d4 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c2db expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.240482:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201162.240498:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c2d4 lrc: 1/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c2db expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.240506:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc00782d600/0x96d0c9b8c9a1c2d4 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c2db expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.240523:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201162.240524:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201162.240526:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201162.240536:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715220992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201162.240567:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201162.240602:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715220992 00000100:00100000:0.0:1788201162.240607:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715220992 00000100:00100000:0.0:1788201162.240639:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:0.0:1788201162.240645:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10a10d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+12:3657:x1875060715220992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201162.240655:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201162.240669:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adee00/0x96d0c9b8c9a1c2db lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c2d4 expref: 12 pid: 23728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.240678:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8dc0048be800) 00010000:00010000:0.0:1788201162.240684:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201162.240710:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10a10d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+11:3657:x1875060715220992:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201162.240727:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:0.0:1788201162.240776:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715220992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201162.269485:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201162.269587:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695414528 00000100:00100000:3.0:1788201162.269598:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695414528 00000100:00100000:3.0:1788201162.269711:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1383 00000100:00100000:3.0:1788201162.269721:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:72033:x1875060695414528:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1788201162.269742:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201162.269762:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c2f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78688e expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.269822:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1c2fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.269835:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1c2fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.269859:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1c2fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.269875:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c305 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.269883:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c305 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.269889:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c305 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.269984:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3600/0x96d0c9b8c9a1c30c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.269993:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3600/0x96d0c9b8c9a1c30c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.270000:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3600/0x96d0c9b8c9a1c30c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201162.270083:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788201162.270088:0:69485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201162.270124:0:69485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3600/0x96d0c9b8c9a1c30c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.270139:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1c2fe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.270146:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1c2fe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.270172:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1c2fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.270180:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1c2fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.270185:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201162.270197:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1c2fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.270205:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1c2fe lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.270216:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103141d00) 00010000:00010000:3.0:1788201162.270219:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201162.270223:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1c2fe lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.270230:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1c2fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.270243:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c305 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.270249:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c305 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.270254:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c305 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.270258:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201162.270268:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c305 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.270273:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c305 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.270281:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff8dc107112b00) 00010000:00010000:3.0:1788201162.270283:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201162.270285:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c305 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.270291:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c305 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.270320:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c2f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78688e expref: 9 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.270333:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3600/0x96d0c9b8c9a1c30c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78688e expref: 8 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.270341:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8dc107112c00) 00010000:00010000:3.0:1788201162.270343:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788201162.270345:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3600, rc 0) 00000100:00100000:3.0:1788201162.270405:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:72033:x1875060695414528:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 685us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201162.270412:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1383 00000100:00100000:0.0:1788201162.277410:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201162.277540:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695414656 00000100:00100000:2.0:1788201162.277550:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695414656 00000100:00100000:2.0:1788201162.277654:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1384 00000100:00100000:2.0:1788201162.277665:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:72033:x1875060695414656:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1788201162.277685:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201162.277706:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade400/0x96d0c9b8c9a1c313 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786895 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.277766:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1c31a lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.277779:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1c31a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.277789:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1c31a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.277800:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1c321 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.277820:0:66314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adf400/0x96d0c9b8c9a1c29c lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c295 expref: 10 pid: 23728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.277828:0:66314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1c321 lrc: 4/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.277875:0:66314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adf400/0x96d0c9b8c9a1c29c lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c295 expref: 10 pid: 23728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201162.277890:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66314:1875060715221120:0@lo:104: 00000100:00100000:2.0:1788201162.277936:0:66314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201162.277982:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10556a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201162.278088:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715221120 00000100:00100000:3.0:1788201162.278093:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715221120 00000100:00100000:3.0:1788201162.278130:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788201162.278137:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:66314:x1875060715221120:12345-0@lo:104: 00010000:00010000:3.0:1788201162.278154:0:19665:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007adf000/0x96d0c9b8c9a1c295 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c29c expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.278226:0:19665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201162.278232:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:66314:x1875060715221120:12345-0@lo:104: Request processed in 96us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201162.278238:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00010000:00010000:3.0:1788201162.278256:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201162.278261:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007adf000/0x96d0c9b8c9a1c295 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c29c expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.278269:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf000 already unused, calling callback (ffffffffc189cee0) 00010000:00010000:3.0:1788201162.278274:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007adf000/0x96d0c9b8c9a1c295 lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c29c expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201162.278283:0:24979:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007adf000/0x96d0c9b8c9a1c295 lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c29c expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.278307:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007adf000/0x96d0c9b8c9a1c295 lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c29c expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.278313:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201162.278332:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007adf000/0x96d0c9b8c9a1c295 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c29c expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.278339:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007adf000/0x96d0c9b8c9a1c295 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c29c expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.278357:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201162.278365:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201162.278366:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201162.278380:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715221248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201162.278411:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201162.278699:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715221248 00000100:00100000:0.0:1788201162.278704:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715221248 00010000:00010000:0.0:1788201162.278726:0:26213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adf400/0x96d0c9b8c9a1c29c lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c295 expref: 11 pid: 23728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201162.278759:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2586 00000100:00100000:0.0:1788201162.278766:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+11:3658:x1875060715221248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201162.278776:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788201162.278911:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66314:1875060715221120:0@lo:104: 00010000:00010000:0.0:1788201162.278930:0:66314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1c321 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788201162.280715:0:92544:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084296 is committed 00010000:00010000:3.0:1788201162.280899:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adf400/0x96d0c9b8c9a1c29c lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c295 expref: 9 pid: 23728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.280918:0:26213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff8dc12196eb00) 00010000:00010000:3.0:1788201162.280923:0:26213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1c321 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.280933:0:26213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1c321 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.280939:0:26213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1c321 lrc: 4/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201162.281089:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201162.281173:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3658:x1875060715221248:12345-0@lo:103:ldlm_bl.0 Request processed in 2396us (2749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201162.281182:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2586 00000100:00100000:1.0:1788201162.281340:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715221248:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201162.281391:0:66314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1c321 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.281399:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1c321 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201162.281592:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:66314:1875060715221376:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201162.281640:0:66314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201162.281722:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc104ea0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201162.281767:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715221376 00000100:00100000:2.0:1788201162.281773:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715221376 00000100:00100000:2.0:1788201162.282481:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4034 00000100:00100000:2.0:1788201162.282493:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133f4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66314:x1875060715221376:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788201162.282636:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133f4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66314:x1875060715221376:12345-0@lo:1000:mdt00_002.0 Request processed in 145us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201162.282643:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4034 00000100:00100000:0.0:1788201162.282784:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:66314:1875060715221376:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788201162.282838:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c328 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.282867:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c328 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.282879:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c328 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201162.282907:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c328 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.282920:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1c31a lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.282927:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1c31a lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.282933:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1c31a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.282940:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1c31a lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.282945:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201162.282949:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1c31a lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.282968:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1c31a lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.282980:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8dc107112c00) 00010000:00010000:0.0:1788201162.282983:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201162.282987:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1c31a lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.283001:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1c31a lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.283044:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1c321 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.283050:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1c321 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.283055:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1c321 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.283060:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfe00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201162.283062:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1c321 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.283067:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1c321 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.283074:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff8dc12196eb00) 00010000:00010000:0.0:1788201162.283077:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201162.283080:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1c321 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.283085:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1c321 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.283122:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade400/0x96d0c9b8c9a1c313 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786895 expref: 10 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.283147:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c328 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786895 expref: 9 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.283154:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8dc10bed3400) 00010000:00010000:0.0:1788201162.283156:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201162.283158:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782de00, rc 0) 00000100:00100000:0.0:1788201162.283355:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:72033:x1875060695414656:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 5691us (5952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201162.283363:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1384 00000100:00100000:0.0:1788201162.286695:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201162.286827:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695414784 00000100:00100000:2.0:1788201162.286836:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695414784 00000100:00100000:2.0:1788201162.286901:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1385 00000100:00100000:2.0:1788201162.286911:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:72033:x1875060695414784:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1788201162.286939:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201162.286971:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adec00/0x96d0c9b8c9a1c32f lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78689c expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.287071:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf600/0x96d0c9b8c9a1c336 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.287085:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf600/0x96d0c9b8c9a1c336 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.287115:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf600/0x96d0c9b8c9a1c336 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201162.287352:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00200000:2.0:1788201162.287357:0:66313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1788201162.287397:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adec00/0x96d0c9b8c9a1c32f lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78689c expref: 11 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.287413:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf600/0x96d0c9b8c9a1c336 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78689c expref: 10 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.287422:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8dc0048bea00) 00010000:00010000:2.0:1788201162.287424:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788201162.287428:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007adf600, rc 0) 00000100:00100000:2.0:1788201162.287491:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:72033:x1875060695414784:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 582us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201162.287919:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1385 00000100:00100000:3.0:1788201162.293140:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201162.293443:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695415040 00000100:00100000:1.0:1788201162.293454:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695415040 00000100:00100000:1.0:1788201162.293526:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1386 00000100:00100000:1.0:1788201162.293536:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:72033:x1875060695415040:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1788201162.293557:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201162.293580:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1c33d lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7868a3 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201162.293696:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788201162.293821:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1c33d lrc: 1/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868a3 expref: 12 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.293840:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8dc005f4b000) 00010000:00010000:1.0:1788201162.293844:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201162.293850:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1c33d lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868a3 expref: 12 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.293870:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ec800, rc 0) 00000100:00100000:1.0:1788201162.294171:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:72033:x1875060695415040:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 624us (1030us total) trans 77309411462 rc 301/301 00000100:00100000:1.0:1788201162.294179:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1386 00000100:00100000:0.0:1788201162.301450:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201162.301809:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695415296 00000100:00100000:2.0:1788201162.301819:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695415296 00000100:00100000:2.0:1788201162.301915:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1387 00000100:00100000:2.0:1788201162.301926:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:72033:x1875060695415296:12345-192.168.201.20@tcp:36:lfs.0 00010000:00010000:2.0:1788201162.301995:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201162.302047:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf600/0x96d0c9b8c9a1c336 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78689c expref: 11 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.302066:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8dc0048bea00) 00010000:00010000:2.0:1788201162.302083:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201162.302105:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adec00/0x96d0c9b8c9a1c34b lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.302117:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adec00/0x96d0c9b8c9a1c34b lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.302127:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adec00/0x96d0c9b8c9a1c34b lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201162.302282:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e8b523ee reply state 00000000c5a68245 transno 77309411463 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adec00/0x96d0c9b8c9a1c34b lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.302295:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adec00/0x96d0c9b8c9a1c34b lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.302301:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8dc0048bea00) 00010000:00010000:2.0:1788201162.302304:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:2.0:1788201162.302307:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788201162.302313:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000100:00100000:2.0:1788201162.302395:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:72033:x1875060695415296:12345-192.168.201.20@tcp:36:lfs.0 Request processed in 471us (1236us total) trans 77309411463 rc 0/0 00000100:00100000:2.0:1788201162.302402:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1387 00000100:00100000:1.0:1788201162.305582:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201162.305696:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695415552 00000100:00100000:3.0:1788201162.305705:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695415552 00000100:00100000:3.0:1788201162.305761:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 240 00000100:00100000:3.0:1788201162.305770:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:72033:x1875060695415552:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:3.0:1788201162.305974:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:72033:x1875060695415552:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 204us (400us total) trans 77309411464 rc 0/0 00000100:00100000:3.0:1788201162.305981:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 240 00000100:00100000:3.0:1788201162.330405:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201162.330665:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695415680 00000100:00100000:1.0:1788201162.330705:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695415680 00000100:00100000:1.0:1788201162.330770:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1388 00000100:00100000:1.0:1788201162.330782:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:72034:x1875060695415680:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1788201162.330809:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201162.330836:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1c352 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7868aa expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.330933:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1c359 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.330964:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1c359 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.330977:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1c359 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.330988:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1c360 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.330999:0:66757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adf800/0x96d0c9b8c9a1c2e9 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c2e2 expref: 7 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.331007:0:66757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1c360 lrc: 4/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.331082:0:66757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adf800/0x96d0c9b8c9a1c2e9 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c2e2 expref: 7 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201162.331097:0:66757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:66757:1875060715221504:0@lo:104: 00000100:00100000:1.0:1788201162.331148:0:66757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201162.331432:0:66757:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc104e14c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201162.332841:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715221504 00000100:00100000:2.0:1788201162.332852:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715221504 00000100:00100000:2.0:1788201162.332941:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788201162.332960:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118142d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:66757:x1875060715221504:12345-0@lo:104: 00010000:00010000:2.0:1788201162.332976:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3800/0x96d0c9b8c9a1c2e2 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c2e9 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201162.333181:0:66757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:66757:1875060715221504:0@lo:104: 00010000:00010000:1.0:1788201162.333219:0:66757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1c360 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201162.333415:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201162.333435:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118142d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:66757:x1875060715221504:12345-0@lo:104: Request processed in 485us (2285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201162.333443:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00010000:00010000:0.0:1788201162.333833:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201162.333841:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3800/0x96d0c9b8c9a1c2e2 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c2e9 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.333848:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3800 already unused, calling callback (ffffffffc189cee0) 00010000:00010000:0.0:1788201162.333854:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3800/0x96d0c9b8c9a1c2e2 lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c2e9 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201162.333863:0:6520:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3800/0x96d0c9b8c9a1c2e2 lrc: 4/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c2e9 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.333896:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3800/0x96d0c9b8c9a1c2e2 lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c2e9 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.333902:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201162.333943:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3800/0x96d0c9b8c9a1c2e2 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c2e9 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201162.334046:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715221632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201162.334089:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201162.334133:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715221632 00000100:00100000:1.0:1788201162.334138:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715221632 00010000:00010000:1.0:1788201162.334157:0:26207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adf800/0x96d0c9b8c9a1c2e9 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c2e2 expref: 8 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201162.334373:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2587 00000100:00100000:1.0:1788201162.334382:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3655:x1875060715221632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201162.334394:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201162.334867:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adf800/0x96d0c9b8c9a1c2e9 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c2e2 expref: 8 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.334883:0:26207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff8dc12196e200) 00010000:00010000:1.0:1788201162.334888:0:26207:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1c360 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.334897:0:26207:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1c360 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.334903:0:26207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1c360 lrc: 4/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.334927:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201162.335127:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3800/0x96d0c9b8c9a1c2e2 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c2e9 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.335145:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201162.335147:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201162.335149:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201162.335454:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715221632:12345-0@lo:103:ldlm_bl.0 Request processed in 1071us (1362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201162.335462:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2587 00010000:00010000:1.0:1788201162.335490:0:66757:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1c360 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.335507:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1c360 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201162.335618:0:66757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:66757:1875060715221760:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788201162.335659:0:66757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201162.335682:0:66757:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc104e14e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201162.335703:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715221760 00000100:00100000:1.0:1788201162.335708:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715221760 00000100:00100000:1.0:1788201162.335741:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4035 00000100:00100000:1.0:1788201162.335748:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66757:x1875060715221760:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788201162.335816:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66757:x1875060715221760:12345-0@lo:1000:mdt00_003.0 Request processed in 68us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201162.335823:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4035 00000100:00100000:1.0:1788201162.335862:0:66757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:66757:1875060715221760:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788201162.335909:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1c367 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.335922:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1c367 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.335930:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1c367 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201162.335966:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1c367 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.335990:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1c359 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.335996:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1c359 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.336002:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1c359 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.336007:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1c359 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.336012:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201162.336039:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1c359 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.336046:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1c359 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.336057:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8dc107112c00) 00010000:00010000:1.0:1788201162.336060:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201162.336064:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1c359 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.336070:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1c359 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.336082:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1c360 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.336088:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1c360 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.336100:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1c360 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.336105:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064eca00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201162.336108:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1c360 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.336114:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1c360 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.336122:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff8dc12196e200) 00010000:00010000:1.0:1788201162.336125:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201162.336128:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1c360 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.336134:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1c360 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.336181:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1c352 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868aa expref: 11 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.336461:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1c367 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868aa expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.336471:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8dc005f4b000) 00010000:00010000:1.0:1788201162.336473:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201162.336476:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ed600, rc 0) 00000100:00100000:1.0:1788201162.336586:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:72034:x1875060695415680:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 5807us (6190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201162.336603:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1388 00000100:00100000:3.0:1788201162.339633:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715221632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201162.339746:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201162.339833:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695415808 00000100:00100000:1.0:1788201162.339841:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695415808 00000100:00100000:1.0:1788201162.339931:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1389 00000100:00100000:1.0:1788201162.339941:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:72034:x1875060695415808:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1788201162.340050:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201162.340075:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1c36e lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7868b1 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.340140:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1c375 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.340153:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1c375 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.340302:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1c375 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201162.340351:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788201162.340354:0:69485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1788201162.340391:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1c36e lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868b1 expref: 15 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.340410:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1c375 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868b1 expref: 14 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.340418:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8dc0048bee00) 00010000:00010000:1.0:1788201162.340421:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788201162.340438:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064eda00, rc 0) 00000100:00100000:1.0:1788201162.340546:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:72034:x1875060695415808:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 605us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201162.340552:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1389 00000100:00100000:2.0:1788201162.345853:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201162.346133:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695416064 00000100:00100000:0.0:1788201162.346143:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695416064 00000100:00100000:1.0:1788201162.346391:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1390 00000100:00100000:1.0:1788201162.346402:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:72034:x1875060695416064:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1788201162.346424:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201162.346450:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1c37c lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7868b8 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201162.346612:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788201162.346706:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1c37c lrc: 1/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868b8 expref: 16 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.346721:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8dc005f4b800) 00010000:00010000:1.0:1788201162.346724:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201162.346729:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1c37c lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868b8 expref: 16 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201162.346745:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fd400, rc 0) 00000100:00100000:1.0:1788201162.346836:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:72034:x1875060695416064:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 436us (994us total) trans 77309411465 rc 301/301 00000100:00100000:1.0:1788201162.346844:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1390 00000100:00100000:3.0:1788201162.349149:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201162.349713:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695416320 00000100:00100000:0.0:1788201162.349722:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695416320 00000100:00100000:0.0:1788201162.349777:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1391 00000100:00100000:0.0:1788201162.349786:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:72034:x1875060695416320:12345-192.168.201.20@tcp:36:lfs.0 00010000:00010000:0.0:1788201162.349833:0:66757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201162.349855:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1c375 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868b1 expref: 15 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.349875:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8dc0048bee00) 00010000:00010000:0.0:1788201162.349879:0:66757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201162.349897:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c38a lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.349909:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c38a lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.349919:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c38a lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201162.350097:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5675a23 reply state 0000000081b7f07c transno 77309411466 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c38a lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.350110:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c38a lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201162.350116:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8dc0048bee00) 00010000:00010000:0.0:1788201162.350119:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:0.0:1788201162.350121:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788201162.350128:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000100:00100000:0.0:1788201162.350470:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:72034:x1875060695416320:12345-192.168.201.20@tcp:36:lfs.0 Request processed in 683us (1327us total) trans 77309411466 rc 0/0 00000100:00100000:0.0:1788201162.350478:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1391 00000100:00100000:0.0:1788201162.352800:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201162.352880:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695416576 00000100:00100000:3.0:1788201162.352890:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695416576 00000100:00100000:3.0:1788201162.352944:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 241 00000100:00100000:3.0:1788201162.352963:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:72034:x1875060695416576:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:3.0:1788201162.353664:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+17:72034:x1875060695416576:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 702us (871us total) trans 77309411467 rc 0/0 00000100:00100000:3.0:1788201162.353850:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 241 00010000:00010000:1.0:1788201162.511269:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201162.707285:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201162.707323:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201162.707414:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695416832 00000100:00100000:3.0:1788201162.707426:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695416832 00000100:00100000:3.0:1788201162.707501:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2830 00000100:00100000:3.0:1788201162.707512:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695416832:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201162.707658:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695416704 00000100:00100000:1.0:1788201162.707663:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695416704 00000100:00100000:1.0:1788201162.707695:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 170 00000100:00100000:1.0:1788201162.707701:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695416704:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201162.707737:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695416704:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 35us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201162.707745:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 170 00000100:00080000:2.0:1788201162.707901:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201162.707954:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695416832:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 81us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201162.707964:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2830 00000100:00100000:1.0:1788201163.087808:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715221888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201163.087899:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201163.088374:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715221888 00000100:00100000:0.0:1788201163.088384:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715221888 00000100:00100000:0.0:1788201163.088466:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2296 00000100:00100000:0.0:1788201163.088478:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715221888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201163.088578:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788201163.088635:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715221888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 159us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201163.088642:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2296 00000100:00100000:0.0:1788201163.088693:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715221888:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788201163.089187:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201163.090930:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201163.090957:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715222016:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201163.091045:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201163.092263:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715222016 00000100:00100000:3.0:1788201163.092274:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715222016 00000100:00100000:3.0:1788201163.092334:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2297 00000100:00100000:3.0:1788201163.092344:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715222016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201163.092372:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201163.092429:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715222016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201163.092435:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2297 00000100:00080000:3.0:1788201163.092455:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201163.092574:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715222016:0@lo:13:osp-pre-1-1.0 00000001:00080000:1.0:1788201163.314696:0:75739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411467 is committed 00010000:00010000:0.0:1788201163.323454:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c2a3 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323473:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c2a3 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323501:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c2a3 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323507:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782ca00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201163.323511:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c2a3 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323519:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c2a3 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323541:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8dc0048bea00) 00010000:00010000:0.0:1788201163.323545:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201163.323549:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c2a3 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323555:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c2a3 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323580:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c2f0 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323586:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c2f0 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323592:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c2f0 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323597:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782ce00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201163.323600:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c2f0 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323616:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c2f0 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323629:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8dc0048bee00) 00010000:00010000:0.0:1788201163.323631:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201163.323634:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c2f0 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323639:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c2f0 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323651:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adec00/0x96d0c9b8c9a1c34b lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323657:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adec00/0x96d0c9b8c9a1c34b lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323663:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adec00/0x96d0c9b8c9a1c34b lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323668:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adec00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201163.323670:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adec00/0x96d0c9b8c9a1c34b lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323675:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adec00/0x96d0c9b8c9a1c34b lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323682:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8dc0048bea00) 00010000:00010000:0.0:1788201163.323684:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788201163.323687:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adec00/0x96d0c9b8c9a1c34b lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323703:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adec00/0x96d0c9b8c9a1c34b lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323721:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c38a lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323728:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c38a lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323733:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c38a lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323738:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201163.323741:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c38a lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323746:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c38a lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323754:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8dc0048bee00) 00010000:00010000:0.0:1788201163.323757:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788201163.323759:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c38a lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.323765:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c38a lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201163.467789:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201163.468071:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695416960 00000100:00100000:1.0:1788201163.468081:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695416960 00000100:00100000:1.0:1788201163.468139:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1392 00000100:00100000:1.0:1788201163.468150:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:72044:x1875060695416960:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:1.0:1788201163.468199:0:69485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444888576 avail 1298649088 00000100:00100000:1.0:1788201163.468265:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:72044:x1875060695416960:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 116us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201163.468273:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1392 00000100:00100000:0.0:1788201163.489784:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201163.499595:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695417088 00000100:00100000:1.0:1788201163.499610:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695417088 00000100:00100000:1.0:1788201163.499675:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1393 00000100:00100000:1.0:1788201163.499686:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:72044:x1875060695417088:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:1.0:1788201163.499730:0:66313:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:1.0:1788201163.499809:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:72044:x1875060695417088:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 124us (10036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201163.499817:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1393 00000100:00100000:2.0:1788201163.505002:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201163.505109:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695417216 00000100:00100000:1.0:1788201163.505119:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695417216 00000100:00100000:1.0:1788201163.505181:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2298 00000100:00100000:1.0:1788201163.505191:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:72044:x1875060695417216:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:1.0:1788201163.505225:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788201163.505298:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:72044:x1875060695417216:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 108us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201163.505305:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2298 00000100:00100000:1.0:1788201163.522432:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201163.522578:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695417344 00000100:00100000:3.0:1788201163.522589:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695417344 00000100:00100000:3.0:1788201163.522639:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5914 00000100:00100000:3.0:1788201163.522648:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2399:x1875060695417344:12345-192.168.201.20@tcp:8:lfs.0 00010000:00080000:3.0:1788201163.522686:0:26211:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp t0 exp 0000000000000000 cur 4014 last 0 00000020:00000080:3.0:1788201163.522717:0:26211:0:(genops.c:1385:class_connect()) connect: client 6e293f14-c501-4bc5-9dd4-a18ef02756b4, cookie 0x96d0c9b8c9a1c391 00002000:00100000:3.0:1788201163.522731:0:26211:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6e293f14-c501-4bc5-9dd4-a18ef02756b4/ffff8dc110779800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788201163.522742:0:26211:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788201163.522822:0:26211:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788201163.522851:0:26211:0:(import.c:65:import_set_state_nolock()) ffff8dc110778000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201163.522922:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695417344:12345-192.168.201.20@tcp:8:lfs.0 Request processed in 273us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201163.522941:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5914 00000100:00100000:2.0:1788201163.524994:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201163.525059:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695417472 00000100:00100000:3.0:1788201163.525068:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695417472 00000100:00100000:3.0:1788201163.525128:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2299 00000100:00100000:3.0:1788201163.525138:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:72044:x1875060695417472:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:3.0:1788201163.525161:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201163.525233:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:72044:x1875060695417472:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 97us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201163.525240:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2299 00000100:00080000:1.0:1788201163.525301:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788201163.536874:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201163.600518:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201163.600811:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715222144:0@lo:400:kworker.0 00000100:00100000:3.0:1788201163.600869:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201163.600902:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715222656:0@lo:400:kworker.0 00000100:00100000:3.0:1788201163.600925:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201163.600943:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715223168:0@lo:400:kworker.0 00000100:00100000:3.0:1788201163.600963:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201163.600978:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715223680:0@lo:400:kworker.0 00000100:00100000:3.0:1788201163.600998:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201163.601051:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788201163.601058:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715222528:0@lo:400:kworker.0 00000100:00100000:3.0:1788201163.601082:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201163.601098:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715223040:0@lo:400:kworker.0 00000100:00100000:3.0:1788201163.601120:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201163.601136:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715223552:0@lo:400:kworker.0 00000100:00100000:3.0:1788201163.601156:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201163.601219:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695417728 00000100:00100000:3.0:1788201163.601227:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695417728 00000100:00100000:3.0:1788201163.601262:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715222656 00000100:00100000:3.0:1788201163.601264:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715222656 00000100:00100000:3.0:1788201163.601287:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715223168 00000100:00100000:3.0:1788201163.601289:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715223168 00000100:00100000:3.0:1788201163.601298:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715223680 00000100:00100000:3.0:1788201163.601300:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715223680 00000100:00100000:3.0:1788201163.601308:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715222528 00000100:00100000:3.0:1788201163.601311:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715222528 00000100:00100000:3.0:1788201163.601325:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:3.0:1788201163.601333:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715222656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201163.601384:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715222656:12345-0@lo:400:kworker.0 Request processed in 51us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201163.601398:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000100:00100000:3.0:1788201163.601416:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:3.0:1788201163.601422:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715223168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201163.601451:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715223168:12345-0@lo:400:kworker.0 Request processed in 29us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201163.601457:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00100000:3.0:1788201163.601468:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:3.0:1788201163.601474:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715223680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201163.601498:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715223680:12345-0@lo:400:kworker.0 Request processed in 24us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201163.601503:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00100000:3.0:1788201163.601514:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:3.0:1788201163.601520:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715222528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201163.601546:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715222528:12345-0@lo:400:kworker.0 Request processed in 26us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201163.601552:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:3.0:1788201163.601565:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1394 00000100:00100000:3.0:1788201163.601572:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:72051:x1875060695417728:12345-192.168.201.20@tcp:36:mcreate.0 00010000:00010000:3.0:1788201163.601616:0:69485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201163.601643:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c2b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786880 expref: 10 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201163.601660:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103141d00) 00010000:00010000:3.0:1788201163.601665:0:69485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201163.601725:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c398 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201163.601740:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c398 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201163.601750:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c398 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201163.601765:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c39f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201163.601773:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c39f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201163.601780:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c39f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201163.602155:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c398 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201163.602165:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c398 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201163.602185:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c398 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201163.602192:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c398 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201163.602198:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201163.602203:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c398 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201163.602221:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c398 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201163.602232:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103141d00) 00010000:00010000:3.0:1788201163.602235:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201163.602239:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c398 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201163.602245:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c398 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201163.602257:0:69485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf11db26 reply state 00000000b05cfd57 transno 120259084297 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c39f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201163.602268:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c39f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201163.602275:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc107112b00) 00010000:00010000:3.0:1788201163.602278:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201163.602280:0:69485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201163.602360:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:72051:x1875060695417728:12345-192.168.201.20@tcp:36:mcreate.0 Request processed in 786us (1849us total) trans 120259084297 rc 0/0 00000100:00100000:3.0:1788201163.602368:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1394 00000100:00100000:3.0:1788201163.602406:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715223040 00000100:00100000:3.0:1788201163.602411:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715223040 00000100:00100000:3.0:1788201163.602437:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715223552 00000100:00100000:3.0:1788201163.602440:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715223552 00000100:00100000:3.0:1788201163.602462:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2831 00000100:00100000:3.0:1788201163.602469:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715223040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201163.602519:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715223040:12345-0@lo:400:kworker.0 Request processed in 50us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201163.602525:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2831 00000100:00100000:3.0:1788201163.602537:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2832 00000100:00100000:3.0:1788201163.602543:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715223552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201163.602570:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715223552:12345-0@lo:400:kworker.0 Request processed in 28us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201163.602576:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2832 00000100:00080000:3.0:1788201163.602595:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201163.602599:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201163.602602:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201163.602632:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715222528:0@lo:400:kworker.0 00000100:00100000:3.0:1788201163.602644:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715223040:0@lo:400:kworker.0 00000100:00100000:3.0:1788201163.602653:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715223552:0@lo:400:kworker.0 00000100:00100000:3.0:1788201163.602663:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715222656:0@lo:400:kworker.0 00000100:00100000:3.0:1788201163.602672:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715223168:0@lo:400:kworker.0 00000100:00100000:3.0:1788201163.602682:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715223680:0@lo:400:kworker.0 00000100:00100000:2.0:1788201163.602921:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715222272:0@lo:400:kworker.0 00000100:00100000:2.0:1788201163.602961:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201163.602985:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715222784:0@lo:400:kworker.0 00000100:00100000:2.0:1788201163.603009:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201163.603054:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715223296:0@lo:400:kworker.0 00000100:00100000:2.0:1788201163.603076:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201163.603095:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788201163.603101:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715222400:0@lo:400:kworker.0 00000100:00100000:2.0:1788201163.603122:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201163.603138:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715222912:0@lo:400:kworker.0 00000100:00100000:2.0:1788201163.603157:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201163.603188:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715223424:0@lo:400:kworker.0 00000100:00100000:2.0:1788201163.603208:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201163.603252:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715222144 00000100:00100000:2.0:1788201163.603257:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715222144 00000100:00100000:2.0:1788201163.603287:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788201163.603294:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715222144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201163.603328:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715222144:12345-0@lo:400:kworker.0 Request processed in 34us (2459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201163.603334:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788201163.603457:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715222912 00000100:00100000:2.0:1788201163.603462:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715222912 00000100:00100000:2.0:1788201163.603483:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715223424 00000100:00100000:2.0:1788201163.603485:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715223424 00000100:00100000:2.0:1788201163.603512:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2833 00000100:00100000:2.0:1788201163.603518:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715222912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201163.603553:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715222912:12345-0@lo:400:kworker.0 Request processed in 35us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201163.603559:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2833 00000100:00100000:2.0:1788201163.603571:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2834 00000100:00100000:2.0:1788201163.603577:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715223424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201163.603605:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715223424:12345-0@lo:400:kworker.0 Request processed in 28us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201163.603610:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2834 00000100:00100000:2.0:1788201163.603628:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715222784 00000100:00100000:2.0:1788201163.603631:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715222784 00000100:00100000:2.0:1788201163.603653:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715223296 00000100:00100000:2.0:1788201163.603656:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715223296 00000100:00100000:2.0:1788201163.603673:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4036 00000100:00100000:2.0:1788201163.603679:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715222784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201163.603712:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715222784:12345-0@lo:400:kworker.0 Request processed in 33us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201163.603724:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4036 00000100:00100000:2.0:1788201163.603736:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4037 00000100:00100000:2.0:1788201163.603742:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00586c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715223296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201163.603774:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00586c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715223296:12345-0@lo:400:kworker.0 Request processed in 32us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201163.603779:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4037 00000100:00100000:2.0:1788201163.603817:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715222912:0@lo:400:kworker.0 00000100:00100000:2.0:1788201163.603826:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715223424:0@lo:400:kworker.0 00000100:00100000:2.0:1788201163.603833:0:3655:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084296 gen 3 00000004:00080000:2.0:1788201163.603838:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084295 committed transno 120259084296 00000020:00080000:2.0:1788201163.603845:0:3655:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8dc006e9a0c0 refcount 2 committed 0 result 0 batchid 73014444096 00000020:00080000:2.0:1788201163.603848:0:3655:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc1409fa200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8dc13aa35180 00000020:00080000:2.0:1788201163.603851:0:3655:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000090a1:0x1:0x0].7 00000020:00080000:2.0:1788201163.603853:0:3655:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc1409fa700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dc13a983a00 00000020:00080000:2.0:1788201163.603856:0:3655:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2400088d0:0x1:0x0].8 00000004:00080000:2.0:1788201163.603878:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084296 committed transno 120259084296 00000020:00080000:2.0:1788201163.603881:0:3655:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8dc005f4ed80 refcount 2 committed 0 result 0 batchid 73014444097 00000020:00080000:2.0:1788201163.603884:0:3655:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc1409fa500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8dc005f4e540 00000020:00080000:2.0:1788201163.603886:0:3655:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000090a1:0x1:0x0].8 00000020:00080000:2.0:1788201163.603887:0:3655:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc1409fa900 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dc13a982800 00000020:00080000:2.0:1788201163.603889:0:3655:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2400088d0:0x1:0x0].9 00000100:00100000:2.0:1788201163.603901:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715222784:0@lo:400:kworker.0 00000100:00100000:2.0:1788201163.603910:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715223296:0@lo:400:kworker.0 00000020:00080000:2.0:1788201163.603942:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444097 committed batchid 73014444095 00000020:00080000:2.0:1788201163.603991:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444095 00000100:00100000:2.0:1788201163.604002:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715222272 00000100:00100000:2.0:1788201163.604006:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715222272 00000100:00100000:2.0:1788201163.604051:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715222400 00000100:00100000:2.0:1788201163.604054:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715222400 00000100:00100000:2.0:1788201163.604071:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:2.0:1788201163.604077:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715222272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201163.604111:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715222272:12345-0@lo:400:kworker.0 Request processed in 35us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201163.604117:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00100000:2.0:1788201163.604128:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:2.0:1788201163.604134:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715222400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201163.604158:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715222400:12345-0@lo:400:kworker.0 Request processed in 24us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201163.604163:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00100000:2.0:1788201163.604199:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715222400:0@lo:400:kworker.0 00000100:00100000:2.0:1788201163.604208:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715222272:0@lo:400:kworker.0 00000100:00080000:2.0:1788201163.604224:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201163.604227:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201163.604230:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201163.608302:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715223808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201163.608372:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201163.608430:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715223808 00000100:00100000:3.0:1788201163.608438:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715223808 00000100:00100000:3.0:1788201163.608547:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4038 00000100:00100000:3.0:1788201163.608556:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715223808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788201163.608600:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:3.0:1788201163.608645:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715223808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201163.608653:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4038 00000100:00100000:3.0:1788201163.608705:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715223808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201163.608808:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715222144:0@lo:400:kworker.0 00000100:00100000:0.0:1788201163.609513:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715223936:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201163.609559:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201163.610283:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715223936 00000100:00100000:0.0:1788201163.610290:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715223936 00000100:00100000:0.0:1788201163.611397:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4039 00000100:00100000:0.0:1788201163.611410:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715223936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201163.611444:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444888576 avail 1298649088 00000100:00100000:0.0:1788201163.611518:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715223936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (1959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201163.611526:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4039 00000100:00100000:2.0:1788201163.611598:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715223936:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201163.627453:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201163.627519:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695417856 00000100:00100000:0.0:1788201163.627529:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695417856 00000100:00100000:0.0:1788201163.627589:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1395 00000100:00100000:0.0:1788201163.627599:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:72054:x1875060695417856:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1788201163.627623:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201163.627647:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c3a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7868bf expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.627710:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c3ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.627724:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c3ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.627737:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c3ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201163.627784:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201163.627788:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201163.627808:0:66312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c3ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.627843:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c3a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868bf expref: 13 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.627861:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c3ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868bf expref: 12 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.627870:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103141d00) 00010000:00010000:0.0:1788201163.627872:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201163.627876:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782ca00, rc 0) 00000100:00100000:0.0:1788201163.627929:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:72054:x1875060695417856:12345-192.168.201.20@tcp:101:rm.0 Request processed in 332us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201163.627936:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1395 00000100:00100000:2.0:1788201163.637563:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201163.637655:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695417984 00000100:00100000:1.0:1788201163.637665:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695417984 00000100:00100000:1.0:1788201163.637718:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1396 00000100:00100000:1.0:1788201163.637727:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:72054:x1875060695417984:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:1.0:1788201163.637746:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201163.637765:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1c3b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7868c6 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.637826:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1c3bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.637840:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1c3bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.637850:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1c3bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.637860:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1c3c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.637867:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1c3c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.637874:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1c3c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.639282:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1c3c9 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.639301:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1c3c9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.639310:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1c3c9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201163.639362:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x3:0x0]: returning size 0 00000004:00200000:1.0:1788201163.639366:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201163.639388:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1c3c9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.639400:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1c3c9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.639410:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1c3bb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.639417:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1c3bb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.639423:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1c3bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.639430:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1c3bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.639436:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fca00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201163.639441:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1c3bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.639458:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1c3bb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.639471:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103141d00) 00010000:00010000:1.0:1788201163.639474:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201163.639478:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1c3bb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.639485:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1c3bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.639498:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1c3c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.639505:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1c3c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.639511:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1c3c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.639517:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fc600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201163.639519:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1c3c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.639525:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1c3c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.639532:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc107112b00) 00010000:00010000:1.0:1788201163.639534:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201163.639537:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1c3c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.639552:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1c3c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.639583:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1c3b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868c6 expref: 14 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.639597:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1c3c9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868c6 expref: 13 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201163.639603:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff8dc005f4b800) 00010000:00010000:1.0:1788201163.639606:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201163.639608:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fd000, rc 0) 00000100:00100000:1.0:1788201163.640160:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:72054:x1875060695417984:12345-192.168.201.20@tcp:101:rm.0 Request processed in 2430us (2601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201163.640179:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1396 00000100:00100000:3.0:1788201163.653366:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201163.653480:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695418240 00000100:00100000:0.0:1788201163.653490:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695418240 00000100:00100000:0.0:1788201163.653548:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1397 00000100:00100000:0.0:1788201163.653559:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:72054:x1875060695418240:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:0.0:1788201163.653612:0:66757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788201163.653640:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd000/0x96d0c9b8c9a1c3c9 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868c6 expref: 13 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.653661:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff8dc005f4b800) 00010000:00010000:0.0:1788201163.653679:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c3ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868bf expref: 12 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.653688:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103141d00) 00010000:00010000:0.0:1788201163.653691:0:66757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201163.653727:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c3d0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.653742:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c3d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.653750:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c3d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.653760:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c3d7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.653767:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c3d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.653773:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c3d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.653855:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1c3de lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.653861:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1c3de lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.653866:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1c3de lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.654071:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c3e5 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.654077:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c3e5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.654082:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c3e5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.654091:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c3e5 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.654095:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c3e5 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.654099:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c3e5 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.654108:0:66757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201163.654121:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1c3de lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.654125:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1c3de lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.654129:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1c3de lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.654132:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201163.654135:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1c3de lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.654140:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1c3de lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.654145:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff8dc103a1ee00) 00010000:00010000:0.0:1788201163.654147:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201163.654149:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1c3de lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.654158:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1c3de lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.654181:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c3d0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.654187:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c3d0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.654193:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c3d0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.654202:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c3d0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.654208:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782ce00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201163.654211:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c3d0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.654217:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c3d0 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.654226:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103141d00) 00010000:00010000:0.0:1788201163.654228:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201163.654231:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c3d0 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.654237:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c3d0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201163.654247:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ad58ccb reply state 00000000d80621f9 transno 120259084298 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c3d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.654264:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c3d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201163.654270:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc107112b00) 00010000:00010000:0.0:1788201163.654273:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201163.654276:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201163.654344:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:72054:x1875060695418240:12345-192.168.201.20@tcp:36:rm.0 Request processed in 786us (986us total) trans 120259084298 rc 0/0 00000100:00100000:0.0:1788201163.654352:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1397 00010000:00010000:3.0:1788201163.654481:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201163.654489:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c3e5 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201163.654495:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201163.654498:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c3e5 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201163.654505:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c3e5 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201163.654515:0:24979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff8dc103a1ee00) 00010000:00010000:3.0:1788201163.654517:0:24979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201163.654519:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c3e5 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201163.654525:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c3e5 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201163.654538:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201163.654540:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201163.654541:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201164.111197:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715224064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201164.111274:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201164.111375:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715224064 00000100:00100000:0.0:1788201164.111383:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715224064 00000100:00100000:0.0:1788201164.111437:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2300 00000100:00100000:0.0:1788201164.111604:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715224064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201164.111626:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788201164.111678:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715224064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201164.111782:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715224192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201164.111804:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201164.111962:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715224192 00000100:00100000:2.0:1788201164.111979:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715224192 00000100:00100000:2.0:1788201164.112031:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2301 00000100:00100000:2.0:1788201164.112040:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715224192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201164.112052:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201164.112087:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715224192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201164.112094:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2301 00000100:00100000:3.0:1788201164.112886:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715224192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201164.113009:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2300 00000100:00100000:0.0:1788201164.113072:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715224064:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788201164.569251:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201165.584175:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201166.607155:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201167.632500:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201167.829573:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201167.829617:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201167.829687:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695418496 00000100:00100000:3.0:1788201167.829699:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695418496 00000100:00100000:3.0:1788201167.829765:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1417 00000100:00100000:3.0:1788201167.829776:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:2403:x1875060695418496:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000080:3.0:1788201167.829809:0:69485:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11cc10e00 x1875060695418496/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:288/0 lens 224/224 e 0 to 0 dl 1788201178 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201167.829876:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:2403:x1875060695418496:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 102us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201167.829883:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1417 00000100:00100000:2.0:1788201167.832381:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201167.832421:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201167.832449:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00080000:3.0:1788201167.835141:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201167.835392:0:92550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695418368 00000100:00100000:1.0:1788201167.836832:0:92550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695418368 00000100:00100000:1.0:1788201167.837139:0:92550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 172 00000100:00100000:1.0:1788201167.837151:0:92550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695418368:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201167.837230:0:92550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695418368:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 81us (4857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201167.837239:0:92550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 172 00000100:00100000:2.0:1788201167.840943:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695418624 00000100:00100000:2.0:1788201167.840959:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695418624 00000100:00100000:2.0:1788201167.841062:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1418 00000100:00100000:2.0:1788201167.841086:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695418624:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201167.841171:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695418624:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 88us (8748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201167.841178:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1418 00000100:00080000:2.0:1788201167.841291:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201167.843594:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695418752 00000100:00100000:0.0:1788201167.843606:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695418752 00000100:00100000:0.0:1788201167.843681:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695418880 00000100:00100000:0.0:1788201167.843685:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695418880 00000100:00100000:0.0:1788201167.843711:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2835 00000100:00100000:0.0:1788201167.843723:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695418752:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201167.843790:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695418752:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 71us (14171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201167.843810:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2835 00000100:00100000:0.0:1788201167.843828:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2836 00000100:00100000:0.0:1788201167.843835:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2403:x1875060695418880:12345-192.168.201.20@tcp:400:kworker.0 00000100:00080000:2.0:1788201167.843950:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201167.843954:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201167.844181:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2403:x1875060695418880:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 345us (11729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201167.844188:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2836 00000100:00100000:2.0:1788201168.207305:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201168.207330:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715224320:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201168.207408:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201168.207588:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715224320 00000100:00100000:0.0:1788201168.207597:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715224320 00000100:00100000:0.0:1788201168.207668:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2302 00000100:00100000:0.0:1788201168.207679:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715224320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201168.207709:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788201168.207762:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715224320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201168.207770:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2302 00000100:00100000:0.0:1788201168.207814:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715224320:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788201168.207959:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201168.211646:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201168.212600:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715224448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201168.212666:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201168.214973:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715224448 00000100:00100000:0.0:1788201168.214988:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715224448 00000100:00100000:0.0:1788201168.215215:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2303 00000100:00100000:0.0:1788201168.215228:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715224448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201168.215263:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201168.215338:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715224448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (2671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201168.215346:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2303 00000100:00100000:1.0:1788201168.216174:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715224448:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788201168.217278:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788201168.656743:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201168.721394:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715224576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201168.721472:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201168.725859:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715224576 00000100:00100000:3.0:1788201168.725874:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715224576 00000100:00100000:3.0:1788201168.725925:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4040 00000100:00100000:3.0:1788201168.725934:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715224576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201168.725968:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444888576 avail 1298649088 00010000:00000080:3.0:1788201168.725985:0:83817:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc00a9b4700 x1875060715224576/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:289/0 lens 224/368 e 0 to 0 dl 1788201179 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201168.726366:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715224576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 432us (4892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201168.726380:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4040 00000100:00100000:3.0:1788201168.726530:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715224704:0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.726569:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201168.726601:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715225216:0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.726626:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201168.726644:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715225728:0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.726665:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201168.726684:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788201168.726690:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715225088:0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.726711:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201168.726727:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715225600:0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.726746:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201168.726761:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715226112:0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.726780:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201168.726801:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715224832:0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.726820:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201168.726832:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715225344:0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.726852:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201168.726868:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715225856:0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.726889:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201168.726907:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788201168.726913:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715224960:0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.726932:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201168.726951:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715225472:0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.726972:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201168.726987:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715225984:0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.727005:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201168.727047:0:92549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715224704 00000100:00100000:3.0:1788201168.727051:0:92549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715224704 00000100:00100000:3.0:1788201168.727092:0:92549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788201168.727100:0:92549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715224704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.727139:0:92549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715224704:12345-0@lo:400:kworker.0 Request processed in 40us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201168.727145:0:92549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788201168.727171:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715225216 00000100:00100000:3.0:1788201168.727174:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715225216 00000100:00100000:3.0:1788201168.736950:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715225088 00000100:00100000:3.0:1788201168.738201:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715225088 00000100:00100000:3.0:1788201168.738263:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715225600 00000100:00100000:3.0:1788201168.738267:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715225600 00000100:00100000:3.0:1788201168.738278:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715226112 00000100:00100000:3.0:1788201168.738281:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715226112 00000100:00100000:3.0:1788201168.738291:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715224832 00000100:00100000:3.0:1788201168.738293:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715224832 00000100:00100000:3.0:1788201168.738304:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715224960 00000100:00100000:3.0:1788201168.738306:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715224960 00000100:00100000:3.0:1788201168.738325:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:3.0:1788201168.738334:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715225216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.738424:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715225216:12345-0@lo:400:kworker.0 Request processed in 91us (11796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201168.738432:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00100000:3.0:1788201168.738450:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:3.0:1788201168.738468:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715225088:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788201168.738483:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12efcaa00 x1875060715225088/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:289/0 lens 224/224 e 0 to 0 dl 1788201179 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201168.738513:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715225088:12345-0@lo:400:kworker.0 Request processed in 47us (11801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201168.738519:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00100000:3.0:1788201168.738533:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:3.0:1788201168.738539:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715225600:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788201168.738550:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12efc8000 x1875060715225600/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:289/0 lens 224/224 e 0 to 0 dl 1788201179 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201168.738578:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715225600:12345-0@lo:400:kworker.0 Request processed in 39us (11831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201168.738584:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:3.0:1788201168.738595:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:3.0:1788201168.738601:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715226112:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788201168.738612:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12efcb480 x1875060715226112/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:289/0 lens 224/224 e 0 to 0 dl 1788201179 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201168.738638:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715226112:12345-0@lo:400:kworker.0 Request processed in 37us (11857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201168.738643:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00100000:3.0:1788201168.738654:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:3.0:1788201168.738660:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715224832:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788201168.738670:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12efc9500 x1875060715224832/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:289/0 lens 224/224 e 0 to 0 dl 1788201179 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201168.738719:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715224832:12345-0@lo:400:kworker.0 Request processed in 58us (11897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201168.738725:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00100000:3.0:1788201168.738738:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:3.0:1788201168.738744:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715224960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.738771:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715224960:12345-0@lo:400:kworker.0 Request processed in 28us (11839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201168.738777:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:3.0:1788201168.738805:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715225728 00000100:00100000:3.0:1788201168.738809:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715225728 00000100:00100000:3.0:1788201168.738842:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4041 00000100:00100000:3.0:1788201168.738848:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715225728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.738881:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715225728:12345-0@lo:400:kworker.0 Request processed in 34us (12216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201168.738886:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4041 00000100:00100000:3.0:1788201168.738921:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715225344 00000100:00100000:3.0:1788201168.738925:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715225344 00000100:00100000:3.0:1788201168.738948:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715225856 00000100:00100000:3.0:1788201168.738952:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715225856 00000100:00100000:3.0:1788201168.738973:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715225472 00000100:00100000:3.0:1788201168.738975:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715225472 00000100:00100000:3.0:1788201168.738988:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715225984 00000100:00100000:3.0:1788201168.738991:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715225984 00000100:00100000:3.0:1788201168.739007:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2837 00000100:00100000:3.0:1788201168.739012:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715225344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.739067:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715225344:12345-0@lo:400:kworker.0 Request processed in 55us (12215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201168.739115:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2837 00000100:00100000:3.0:1788201168.739128:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2838 00000100:00100000:3.0:1788201168.739134:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715225856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.739163:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715225856:12345-0@lo:400:kworker.0 Request processed in 31us (12275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201168.739168:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2838 00000100:00100000:3.0:1788201168.739179:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2839 00000100:00100000:3.0:1788201168.739185:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715225472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.739211:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715225472:12345-0@lo:400:kworker.0 Request processed in 27us (12239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201168.739217:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2839 00000100:00100000:3.0:1788201168.739226:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2840 00000100:00100000:3.0:1788201168.739232:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140e9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715225984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.739258:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140e9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715225984:12345-0@lo:400:kworker.0 Request processed in 26us (12251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201168.739263:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2840 00000100:00100000:3.0:1788201168.739462:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715225088:0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.739473:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715225600:0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.739483:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715226112:0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.739494:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715224704:0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.739503:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715225216:0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.739513:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715225728:0@lo:400:kworker.0 00000100:00080000:3.0:1788201168.739560:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201168.739564:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201168.739566:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201168.739567:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201168.739594:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715224960:0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.739604:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715225472:0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.739613:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715225984:0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.739622:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715224832:0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.739631:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715225344:0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.739640:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715225856:0@lo:400:kworker.0 00000100:00100000:3.0:1788201168.739699:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715224576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201168.742500:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715226240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201168.742570:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201168.742623:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715226240 00000100:00100000:3.0:1788201168.742630:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715226240 00000100:00100000:3.0:1788201168.742671:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4042 00000100:00100000:3.0:1788201168.742680:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715226240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788201168.742712:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:3.0:1788201168.742752:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715226240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201168.742759:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4042 00000100:00100000:3.0:1788201168.742801:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715226240:0@lo:41:osp-pre-1-0.0 00000001:00080000:0.0:1788201169.233095:0:92544:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084298 is committed 00010000:00010000:0.0:1788201169.233196:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c39f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.233209:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c39f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.233217:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c39f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.233223:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201169.233228:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c39f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.233236:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c39f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.233252:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc107112b00) 00010000:00010000:0.0:1788201169.233256:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201169.233261:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c39f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.233267:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c39f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.233286:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c3d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.233292:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c3d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.233298:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c3d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.233313:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201169.233316:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c3d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.233322:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c3d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.233330:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc107112b00) 00010000:00010000:0.0:1788201169.233333:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201169.233336:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c3d7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.233342:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c3d7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201169.233377:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715226368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201169.233438:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201169.233619:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715226496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201169.233648:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201169.233682:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715226368 00000100:00100000:2.0:1788201169.233689:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715226368 00000100:00100000:2.0:1788201169.233732:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715226496 00000100:00100000:2.0:1788201169.233735:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715226496 00000100:00100000:2.0:1788201169.233752:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2304 00000100:00100000:2.0:1788201169.233761:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715226368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201169.233782:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788201169.233821:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715226368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201169.233827:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2304 00000100:00100000:2.0:1788201169.233842:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2305 00000100:00100000:2.0:1788201169.233848:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715226496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201169.233856:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201169.233894:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715226496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201169.233899:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2305 00000100:00100000:2.0:1788201169.235593:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715226368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201169.246129:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715226496:0@lo:13:osp-pre-1-0.0 00000020:00080000:1.0:1788201169.248544:0:75739:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444097 batchid updated 00000001:00100000:0.0:1788201169.248788:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00080000:2.0:1788201169.249157:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444097 00000004:00080000:2.0:1788201169.249240:0:75759:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc005a8f180 with version 22 00000020:00080000:2.0:1788201169.249307:0:75759:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444096 cancel update log [0x2000090a1:0x1:0x0].7: rc = 0 00000020:00080000:2.0:1788201169.249395:0:75759:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444096 cancel update log [0x2400088d0:0x1:0x0].8: rc = 0 00000004:00080000:2.0:1788201169.249444:0:75759:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc005a8f0c0 with version 23 00000004:00080000:0.0:1788201169.250362:0:75745:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc007566d80 version 22 rpc_version 22 00000020:00100000:0.0:1788201169.250399:0:75745:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788201169.250409:0:75745:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc005abc000 x1875060715226752/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201169.250434:0:75745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abc000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715226752:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788201169.250507:0:75745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201169.250545:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fb119c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201169.250568:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715226752 00000100:00100000:0.0:1788201169.250584:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715226752 00000100:00100000:0.0:1788201169.250635:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4043 00000100:00100000:0.0:1788201169.250645:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75745:x1875060715226752:12345-0@lo:1000:osp_up0-1.0 00010000:00000080:0.0:1788201169.250758:0:8457:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11d29f100 x1875060715226752/t120259084299(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:290/0 lens 488/4320 e 0 to 0 dl 1788201180 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201169.250815:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75745:x1875060715226752:12345-0@lo:1000:osp_up0-1.0 Request processed in 171us (307us total) trans 120259084299 rc 0/0 00000100:00100000:0.0:1788201169.250823:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4043 00000100:00100000:3.0:1788201169.251684:0:75745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abc000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715226752:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1788201169.251708:0:75745:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc007566d80 version 23 rpc_version 23 00000020:00080000:2.0:1788201169.251825:0:75759:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444097 cancel update log [0x2000090a1:0x1:0x0].8: rc = 0 00000020:00080000:2.0:1788201169.251894:0:75759:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444097 cancel update log [0x2400088d0:0x1:0x0].9: rc = 0 00000020:00080000:2.0:1788201169.251902:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444097 00000020:00100000:2.0:1788201169.261723:0:75745:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788201169.261742:0:75745:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc00a9b4000 x1875060715227008/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201169.261770:0:75745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b4000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715227008:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788201169.261844:0:75745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201169.261885:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005a8fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201169.261954:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715227008 00000100:00100000:3.0:1788201169.261963:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715227008 00000100:00100000:2.0:1788201169.264793:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4044 00000100:00100000:2.0:1788201169.264807:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75745:x1875060715227008:12345-0@lo:1000:osp_up0-1.0 00010000:00000080:2.0:1788201169.264940:0:83817:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc00a9b4380 x1875060715227008/t120259084300(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:290/0 lens 488/4320 e 0 to 0 dl 1788201180 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201169.265056:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75745:x1875060715227008:12345-0@lo:1000:osp_up0-1.0 Request processed in 252us (3210us total) trans 120259084300 rc 0/0 00000100:00100000:2.0:1788201169.265064:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4044 00000100:00100000:0.0:1788201169.268441:0:75745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b4000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715227008:0@lo:1000:osp_up0-1.0 00000001:02000400:2.0:1788201169.575277:0:93739:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:3.0:1788201169.668858:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201169.668894:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695419008 00000100:00100000:3.0:1788201169.668903:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695419008 00000100:00100000:3.0:1788201169.668977:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1398 00000100:00100000:3.0:1788201169.668989:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:72121:x1875060695419008:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:3.0:1788201169.669008:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201169.669166:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c3ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7868cd expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.669244:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c3f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.669259:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.669273:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201169.669316:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788201169.669320:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201169.669571:0:66312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.669598:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c3ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868cd expref: 11 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.669614:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c3f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868cd expref: 10 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.669633:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103141d00) 00010000:00010000:3.0:1788201169.669635:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201169.669640:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2a00, rc 0) 00010000:00000080:3.0:1788201169.669648:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12efc9180 x1875060695419008/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:290/0 lens 576/688 e 0 to 0 dl 1788201180 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201169.669711:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:72121:x1875060695419008:12345-192.168.201.20@tcp:101:touch.0 Request processed in 725us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201169.669719:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1398 00000100:00080000:3.0:1788201169.669744:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201169.672702:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201169.672773:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695419136 00000100:00100000:3.0:1788201169.672782:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695419136 00000100:00100000:3.0:1788201169.672850:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1399 00000100:00100000:3.0:1788201169.672859:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:72121:x1875060695419136:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:3.0:1788201169.672877:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201169.672897:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1c3fa lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7868d4 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.672956:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c401 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.672979:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c401 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.672991:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c401 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.673004:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1c408 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.673045:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1c408 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.673052:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1c408 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.673123:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c40f lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.673132:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c40f lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.673138:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c40f lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201169.673158:0:66313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c40f lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.673170:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c401 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.673177:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c401 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.673183:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c401 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.673189:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c401 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.673195:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201169.673200:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c401 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.673519:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c401 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.673531:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8dc107112c00) 00010000:00010000:3.0:1788201169.673534:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201169.673538:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c401 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.673545:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c401 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.673558:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1c408 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.673564:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1c408 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.673570:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1c408 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.673575:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201169.673577:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1c408 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.673582:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1c408 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.673588:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff8dc107112a00) 00010000:00010000:3.0:1788201169.673591:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201169.673593:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1c408 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.673609:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1c408 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.673646:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1c3fa lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868d4 expref: 12 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.673659:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c40f lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868d4 expref: 11 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.673666:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8dc10bed3400) 00010000:00010000:3.0:1788201169.673667:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201169.673670:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3400, rc 0) 00010000:00000080:3.0:1788201169.673676:0:66313:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11d29dc00 x1875060695419136/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:290/0 lens 576/584 e 0 to 0 dl 1788201180 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201169.673746:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:72121:x1875060695419136:12345-192.168.201.20@tcp:101:touch.0 Request processed in 888us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201169.673753:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1399 00000100:00100000:0.0:1788201169.676089:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201169.677781:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695419264 00000100:00100000:2.0:1788201169.677796:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695419264 00000100:00100000:2.0:1788201169.677886:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1400 00000100:00100000:2.0:1788201169.677897:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:72121:x1875060695419264:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:2.0:1788201169.677917:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201169.677939:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf400/0x96d0c9b8c9a1c416 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7868db expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201169.678009:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf000/0x96d0c9b8c9a1c41d lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201169.678056:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf000/0x96d0c9b8c9a1c41d lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201169.678078:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf000/0x96d0c9b8c9a1c41d lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201169.678124:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00200000:2.0:1788201169.678128:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1788201169.678182:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf400/0x96d0c9b8c9a1c416 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868db expref: 7 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201169.678200:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf000/0x96d0c9b8c9a1c41d lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868db expref: 6 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201169.678217:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8dc1115dfb00) 00010000:00010000:2.0:1788201169.678220:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1788201169.678224:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007adf000, rc 0) 00000100:00100000:2.0:1788201169.678283:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:72121:x1875060695419264:12345-192.168.201.20@tcp:101:touch.0 Request processed in 387us (2202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201169.678290:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1400 00000100:00080000:0.0:1788201169.678909:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788201169.685226:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201169.687190:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201169.687289:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201169.687361:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695419392 00000100:00100000:0.0:1788201169.687379:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695419392 00000100:00100000:0.0:1788201169.687448:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 710 00000100:00100000:0.0:1788201169.687457:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2402:x1875060695419392:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201169.687472:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201169.687495:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c40f lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868d4 expref: 11 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.687514:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8dc10bed3400) 00010000:00010000:0.0:1788201169.687519:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201169.687569:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2402:x1875060695419392:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 113us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201169.687577:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 710 00000100:00100000:3.0:1788201169.690454:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695419648 00000100:00100000:3.0:1788201169.690469:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695419648 00000100:00100000:3.0:1788201169.690574:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1401 00000100:00100000:3.0:1788201169.690585:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:72121:x1875060695419648:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:3.0:1788201169.690603:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201169.690622:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1c424 lrc: 2/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7868e2 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.690746:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1c42b lrc: 3/0,1 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.690759:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1c42b lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.690771:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1c42b lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.690785:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c432 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.690793:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c432 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.690800:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c432 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201169.691328:0:69485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:69485:1875060715227136:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788201169.691414:0:69485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201169.691449:0:69485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fb119c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201169.691470:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715227136 00000100:00100000:3.0:1788201169.691475:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715227136 00000100:00100000:3.0:1788201169.691508:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4045 00000100:00100000:3.0:1788201169.691516:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:69485:x1875060715227136:12345-0@lo:1000:mdt00_004.0 00010000:00000080:3.0:1788201169.691552:0:8457:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12efcbb80 x1875060715227136/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:290/0 lens 328/4320 e 0 to 0 dl 1788201180 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_004.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201169.691593:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:69485:x1875060715227136:12345-0@lo:1000:mdt00_004.0 Request processed in 78us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201169.691608:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4045 00000100:00100000:3.0:1788201169.691651:0:69485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:69485:1875060715227136:0@lo:1000:mdt00_004.0 00000004:00080000:3.0:1788201169.692138:0:69485:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000400:0x471:0x0], count =401 00000004:00080000:3.0:1788201169.692147:0:69485:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000400:0x471:0x0]+401 in llog 00000004:00080000:3.0:1788201169.692158:0:69485:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x602:0x0], index 1: 0 00010000:00010000:3.0:1788201169.692306:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c439 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.692320:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c439 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.692329:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c439 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.692361:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1c42b lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.692487:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1c42b lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.692494:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1c42b lrc: 3/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.692501:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1c42b lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.692507:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201169.692511:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1c42b lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.692520:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1c42b lrc: 5/0,0 mode: CW/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.692542:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8dc1115dfb00) 00010000:00010000:3.0:1788201169.692545:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201169.692550:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1c42b lrc: 3/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.692556:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1c42b lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201169.692569:0:69485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ac1b21d reply state 0000000025dc7083 transno 77309411468 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c432 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.692579:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c432 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.692585:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x9add8152 (ffff8dc107112a00) 00010000:00010000:3.0:1788201169.692587:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201169.692589:0:69485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788201169.692621:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1c424 lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868e2 expref: 9 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.692634:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c439 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868e2 expref: 8 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.692641:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff8dc107112000) 00010000:00010000:3.0:1788201169.692643:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201169.692646:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3a00, rc 0) 00000100:00100000:3.0:1788201169.692689:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:72121:x1875060695419648:12345-192.168.201.20@tcp:101:touch.0 Request processed in 2107us (5400us total) trans 77309411468 rc 0/0 00000100:00100000:3.0:1788201169.692696:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1401 00000100:00100000:2.0:1788201169.704512:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201169.704638:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695419904 00000100:00100000:3.0:1788201169.704648:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695419904 00000100:00100000:3.0:1788201169.704709:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1402 00000100:00100000:3.0:1788201169.704720:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:72121:x1875060695419904:12345-192.168.201.20@tcp:36:touch.0 00010000:00010000:3.0:1788201169.704778:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201169.704804:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c439 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868e2 expref: 9 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.704834:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff8dc107112000) 00010000:00010000:3.0:1788201169.704846:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201169.704895:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1c447 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.704908:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1c447 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.704918:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1c447 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201169.705224:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000511cad24 reply state 000000000cd2d6aa transno 77309411469 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1c447 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.705237:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1c447 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.705242:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff8dc107112e00) 00010000:00010000:3.0:1788201169.705245:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201169.705248:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201169.705343:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:72121:x1875060695419904:12345-192.168.201.20@tcp:36:touch.0 Request processed in 624us (838us total) trans 77309411469 rc 0/0 00000100:00100000:3.0:1788201169.705364:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1402 00000100:00100000:0.0:1788201169.708417:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201169.708502:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695420032 00000100:00100000:3.0:1788201169.708512:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695420032 00000100:00100000:3.0:1788201169.708567:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1403 00000100:00100000:3.0:1788201169.708578:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:72121:x1875060695420032:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:3.0:1788201169.708602:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201169.708621:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2800/0x96d0c9b8c9a1c44e lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7868e9 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.708674:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2800/0x96d0c9b8c9a1c44e lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868e9 expref: 11 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.708688:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2800/0x96d0c9b8c9a1c44e lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868e9 expref: 11 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.708705:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff8dc107112e00) 00010000:00010000:3.0:1788201169.708708:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201169.708711:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2800, rc 0) 00000100:00100000:3.0:1788201169.708760:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:72121:x1875060695420032:12345-192.168.201.20@tcp:101:touch.0 Request processed in 184us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201169.708767:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1403 00000100:00100000:0.0:1788201169.715224:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201169.719444:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695420160 00000100:00100000:3.0:1788201169.719460:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695420160 00000100:00100000:3.0:1788201169.719531:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5915 00000100:00100000:3.0:1788201169.719543:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695420160:12345-192.168.201.20@tcp:2:touch.0 00000100:00100000:3.0:1788201169.719757:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695420160:12345-192.168.201.20@tcp:2:touch.0 Request processed in 216us (4540us total) trans 4294969455 rc 0/0 00000100:00100000:3.0:1788201169.719771:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5915 00000100:00080000:3.0:1788201169.719796:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201169.755625:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201169.755706:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695420416 00000100:00100000:1.0:1788201169.755717:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695420416 00000100:00100000:1.0:1788201169.755776:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 242 00000100:00100000:1.0:1788201169.755787:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:72121:x1875060695420416:12345-192.168.201.20@tcp:35:touch.0 00000100:00100000:2.0:1788201169.756444:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:72121:x1875060695420416:12345-192.168.201.20@tcp:35:touch.0 Request processed in 657us (825us total) trans 77309411470 rc 0/0 00000100:00100000:2.0:1788201169.756454:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 242 00000100:00100000:3.0:1788201169.769439:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201169.769580:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695420544 00000100:00100000:0.0:1788201169.769591:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695420544 00000100:00100000:0.0:1788201169.769652:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1404 00000100:00100000:0.0:1788201169.769662:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:72122:x1875060695420544:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:0.0:1788201169.769683:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201169.769704:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c455 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7868f0 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.769766:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c45c lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.769779:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c45c lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.769791:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c45c lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.769805:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c463 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.769811:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c463 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.769816:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c463 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.769885:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1c46a lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.769894:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1c46a lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.769914:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1c46a lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201169.769938:0:69485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1c46a lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.769951:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c45c lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.769957:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c45c lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.769974:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c45c lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.769982:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c45c lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.769988:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201169.769992:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c45c lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.770000:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c45c lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.770054:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8dc107112c00) 00010000:00010000:0.0:1788201169.770057:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201169.770071:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c45c lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.770080:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1c45c lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.770099:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c463 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.770105:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c463 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.770110:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c463 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.770116:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782ca00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201169.770118:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c463 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.770124:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c463 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.770131:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff8dc0048be600) 00010000:00010000:0.0:1788201169.770133:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201169.770135:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c463 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.770140:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1c463 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.770170:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c455 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868f0 expref: 12 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.770183:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1c46a lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868f0 expref: 11 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.770201:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8dc005f4b000) 00010000:00010000:0.0:1788201169.770210:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201169.770212:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782d200, rc 0) 00010000:00000080:0.0:1788201169.770221:0:69485:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12efc8a80 x1875060695420544/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:290/0 lens 576/584 e 0 to 0 dl 1788201180 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201169.770279:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:72122:x1875060695420544:12345-192.168.201.20@tcp:101:touch.0 Request processed in 618us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201169.770286:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1404 00000100:00100000:1.0:1788201169.773594:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201169.773672:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201169.773743:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695420672 00000100:00100000:3.0:1788201169.773753:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695420672 00000100:00100000:3.0:1788201169.773813:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1405 00000100:00100000:3.0:1788201169.773834:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:72122:x1875060695420672:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:3.0:1788201169.773858:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201169.773879:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c471 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7868f7 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.773935:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c478 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.773948:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c478 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.773969:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c478 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201169.774148:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788201169.774152:0:66313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1788201169.774193:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c471 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868f7 expref: 14 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.774219:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c478 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868f7 expref: 13 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.774245:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8dc107112000) 00010000:00010000:3.0:1788201169.774248:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1788201169.774251:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3400, rc 0) 00000100:00100000:3.0:1788201169.774308:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:72122:x1875060695420672:12345-192.168.201.20@tcp:101:touch.0 Request processed in 487us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201169.774315:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1405 00000100:00100000:2.0:1788201169.775583:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695420800 00000100:00100000:2.0:1788201169.775594:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695420800 00000100:00100000:3.0:1788201169.775763:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 711 00000100:00100000:3.0:1788201169.775773:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2402:x1875060695420800:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201169.775785:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201169.775805:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d200/0x96d0c9b8c9a1c46a lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868f0 expref: 11 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.775828:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8dc005f4b000) 00010000:00010000:3.0:1788201169.775833:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201169.775917:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2402:x1875060695420800:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 145us (2331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201169.775925:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 711 00000100:00100000:1.0:1788201169.777723:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201169.777811:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695421056 00000100:00100000:0.0:1788201169.777819:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695421056 00000100:00100000:0.0:1788201169.777954:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1406 00000100:00100000:0.0:1788201169.778096:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:72122:x1875060695421056:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:0.0:1788201169.778114:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201169.778133:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c47f lrc: 2/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7868fe expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.778424:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c486 lrc: 3/0,1 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.778437:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c486 lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.778448:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c486 lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.778462:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c48d lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.778484:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c48d lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.778490:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c48d lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201169.779121:0:66314:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x603:0x0], index 1: 0 00010000:00010000:0.0:1788201169.779437:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c494 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.779449:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c494 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.779458:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c494 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.779490:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c486 lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.779498:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c486 lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.779504:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c486 lrc: 3/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.779510:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c486 lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.779517:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782ce00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201169.779522:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c486 lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.779540:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c486 lrc: 5/0,0 mode: CW/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.779552:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8dc107112000) 00010000:00010000:0.0:1788201169.779555:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201169.779560:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c486 lrc: 3/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.779566:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c486 lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201169.779579:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002eb254c3 reply state 0000000055da7a54 transno 77309411471 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c48d lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.779588:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c48d lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.779594:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x9add8152 (ffff8dc0048bef00) 00010000:00010000:0.0:1788201169.779596:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201169.779599:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201169.779626:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1c47f lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868fe expref: 16 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.779638:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c494 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868fe expref: 15 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201169.779645:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff8dc0048be000) 00010000:00010000:0.0:1788201169.779648:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201169.779650:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782c400, rc 0) 00000100:00100000:0.0:1788201169.779749:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:72122:x1875060695421056:12345-192.168.201.20@tcp:101:touch.0 Request processed in 1787us (2032us total) trans 77309411471 rc 0/0 00000100:00100000:0.0:1788201169.779757:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1406 00000100:00100000:1.0:1788201169.782757:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201169.782861:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695421312 00000100:00100000:2.0:1788201169.782870:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695421312 00000100:00100000:2.0:1788201169.782941:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1407 00000100:00100000:2.0:1788201169.782952:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:72122:x1875060695421312:12345-192.168.201.20@tcp:36:touch.0 00010000:00010000:2.0:1788201169.783042:0:66757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201169.783075:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1c494 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868fe expref: 16 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201169.783093:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff8dc0048be000) 00010000:00010000:2.0:1788201169.783102:0:66757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201169.783155:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf400/0x96d0c9b8c9a1c4a2 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201169.783168:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf400/0x96d0c9b8c9a1c4a2 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201169.783177:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf400/0x96d0c9b8c9a1c4a2 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201169.783284:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0395748 reply state 00000000653747ab transno 77309411472 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf400/0x96d0c9b8c9a1c4a2 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201169.783297:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf400/0x96d0c9b8c9a1c4a2 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201169.783304:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff8dc1115df600) 00010000:00010000:2.0:1788201169.783307:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201169.783309:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201169.783393:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+17:72122:x1875060695421312:12345-192.168.201.20@tcp:36:touch.0 Request processed in 442us (644us total) trans 77309411472 rc 0/0 00000100:00100000:2.0:1788201169.783401:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1407 00000100:00100000:1.0:1788201169.786391:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201169.786480:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695421440 00000100:00100000:3.0:1788201169.786490:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695421440 00000100:00100000:3.0:1788201169.786581:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1408 00000100:00100000:3.0:1788201169.786592:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+17:72122:x1875060695421440:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:3.0:1788201169.786613:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201169.786633:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c4a9 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786905 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.786707:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c4a9 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786905 expref: 18 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.786722:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c4a9 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786905 expref: 18 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201169.786740:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff8dc1115df600) 00010000:00010000:3.0:1788201169.786743:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201169.786747:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3a00, rc 0) 00000100:00100000:3.0:1788201169.786847:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+18:72122:x1875060695421440:12345-192.168.201.20@tcp:101:touch.0 Request processed in 256us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201169.786855:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1408 00000100:00100000:0.0:1788201169.791394:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201169.791511:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695421568 00000100:00100000:2.0:1788201169.791535:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695421568 00000100:00100000:2.0:1788201169.791650:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5916 00000100:00100000:2.0:1788201169.791661:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695421568:12345-192.168.201.20@tcp:2:touch.0 00000100:00100000:2.0:1788201169.791873:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695421568:12345-192.168.201.20@tcp:2:touch.0 Request processed in 213us (487us total) trans 4294969456 rc 0/0 00000100:00100000:2.0:1788201169.791881:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5916 00000100:00100000:1.0:1788201169.795163:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201169.795267:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695421824 00000100:00100000:3.0:1788201169.795277:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695421824 00000100:00100000:3.0:1788201169.795387:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 243 00000100:00100000:3.0:1788201169.795398:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+18:72122:x1875060695421824:12345-192.168.201.20@tcp:35:touch.0 00000100:00100000:3.0:1788201169.795686:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+19:72122:x1875060695421824:12345-192.168.201.20@tcp:35:touch.0 Request processed in 289us (530us total) trans 77309411473 rc 0/0 00000100:00100000:3.0:1788201169.795694:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 243 00010000:00010000:0.0:1788201170.704129:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788201171.580206:0:93836:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788201171.580256:0:93836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1c1ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c1b5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.580271:0:93836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1c1ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c1b5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.580295:0:93836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1c1ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1c1b5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.580302:0:93836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1c1ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1c1b5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.580323:0:93836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788201171.580329:0:93836:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788201171.580355:0:93836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201171.580360:0:93836:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788201171.580366:0:93836:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788201171.580390:0:93836:0:(import.c:65:import_set_state_nolock()) ffff8dc001db1800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788201171.580457:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715227264:0@lo:39:umount.0 00000100:00100000:0.0:1788201171.580529:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201171.580627:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201171.580635:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1c1ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1c1b5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201171.580643:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3c00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201171.580646:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1c1ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1c1b5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201171.580727:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1c1ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1c1b5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201171.580736:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1c1ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1c1b5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201171.580742:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201171.580753:0:24979:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788201171.580756:0:24979:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788201171.580787:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1c1ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c1b5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201171.580794:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788201171.580843:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715227392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201171.580883:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201171.580954:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715227264 00000100:00100000:3.0:1788201171.580962:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715227264 00000100:00100000:3.0:1788201171.581010:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:3.0:1788201171.581048:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875060715227264:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788201171.581073:0:66314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bdf6 00000100:00080000:3.0:1788201171.581087:0:66314:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f7800 : changing import state from FULL to CLOSED 00010000:00000080:3.0:1788201171.581111:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11d29d880 x1875060715227264/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:292/0 lens 224/224 e 0 to 0 dl 1788201182 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201171.581154:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3654:x1875060715227264:12345-0@lo:39:umount.0 Request processed in 108us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201171.581161:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000020:00000080:3.0:1788201171.581172:0:66314:0:(genops.c:885:class_export_put()) final put ffff8dc11d63e800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788201171.581214:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788201171.581221:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d63e800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788201171.581267:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1257f7800 for lustre-MDT0000 00010000:00010000:1.0:1788201171.581970:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1c1ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c1b5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201171.581982:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1c1ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c1b5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201171.581993:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201171.581995:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201171.581997:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201171.586009:0:9535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715227392 00000100:00100000:1.0:1788201171.586048:0:9535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715227392 00000100:00100000:1.0:1788201171.586119:0:9535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:1.0:1788201171.586129:0:9535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715227392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201171.586144:0:9535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201171.586166:0:9535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1c1b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c1ae expref: 24 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201171.586181:0:9535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1788201171.588548:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788201171.588567:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715227264:0@lo:39:umount.0 00000100:00080000:3.0:1788201171.589535:0:93836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201171.589541:0:93836:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788201171.589547:0:93836:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1788201171.594517:0:9535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9b18af6-fecc-4172-82c2-66531890fe11+23:3657:x1875060715227392:12345-0@lo:103:ldlm_bl.0 Request processed in 8380us (13623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201171.594532:0:9535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00010000:00010000:3.0:1788201171.594759:0:93836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c1bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c1c3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.594772:0:93836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c1bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c1c3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.594780:0:93836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c1bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1c1c3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.594786:0:93836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c1bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1c1c3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.594815:0:93836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201171.594821:0:93836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed800/0x96d0c9b8c9a1bd1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bd24 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.594828:0:93836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed800/0x96d0c9b8c9a1bd1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1bd24 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.594835:0:93836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed800/0x96d0c9b8c9a1bd1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1bd24 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.594842:0:93836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed800/0x96d0c9b8c9a1bd1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1bd24 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.595438:0:93836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201171.595522:0:93836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd600/0x96d0c9b8c9a1bcec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bcf3 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.595545:0:93836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd600/0x96d0c9b8c9a1bcec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1bcf3 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.595552:0:93836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd600/0x96d0c9b8c9a1bcec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1bcf3 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.595558:0:93836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd600/0x96d0c9b8c9a1bcec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1bcf3 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.595569:0:93836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788201171.595578:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788201171.595584:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c1bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1c1c3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.595590:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfa00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:3.0:1788201171.595595:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c1bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1c1c3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.595603:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c1bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1c1c3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201171.595611:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c1bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1c1c3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201171.595617:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788201171.595619:0:6520:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788201171.596328:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201171.596335:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed800/0x96d0c9b8c9a1bd1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1bd24 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201171.596353:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed800 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201171.596357:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed800/0x96d0c9b8c9a1bd1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1bd24 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201171.596365:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed800/0x96d0c9b8c9a1bd1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1bd24 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201171.596372:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed800/0x96d0c9b8c9a1bd1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1bd24 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201171.596378:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201171.596381:0:13349:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788201171.596383:0:13349:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788201171.596401:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed800/0x96d0c9b8c9a1bd1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1bd24 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201171.596407:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201171.596427:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed800/0x96d0c9b8c9a1bd1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1bd24 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201171.596434:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed800/0x96d0c9b8c9a1bd1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1bd24 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201171.596447:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201171.596451:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd600/0x96d0c9b8c9a1bcec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1bcf3 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201171.596456:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd600 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201171.596459:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd600/0x96d0c9b8c9a1bcec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1bcf3 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201171.596471:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd600/0x96d0c9b8c9a1bcec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1bcf3 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201171.596477:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd600/0x96d0c9b8c9a1bcec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1bcf3 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201171.596483:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788201171.596485:0:13349:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788201171.596487:0:13349:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788201171.596500:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd600/0x96d0c9b8c9a1bcec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1bcf3 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201171.596506:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201171.596523:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd600/0x96d0c9b8c9a1bcec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1bcf3 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201171.596529:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd600/0x96d0c9b8c9a1bcec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1bcf3 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201171.596538:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201171.596539:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201171.596540:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201171.596556:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715227648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201171.596619:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201171.596806:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715227648 00000100:00100000:1.0:1788201171.596814:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715227648 00010000:00010000:3.0:1788201171.597309:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c1bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c1c3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.597585:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201171.597596:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c1bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c1c3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.597604:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c1bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c1c3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.597615:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201171.597617:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201171.597619:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201171.597633:0:93836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc005da6600/0x96d0c9b8c9a1bc0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1bc13 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.597642:0:93836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc005da6600/0x96d0c9b8c9a1bc0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1bc13 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.597649:0:93836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc005da6600/0x96d0c9b8c9a1bc0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1bc13 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201171.597812:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:1.0:1788201171.597828:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120023100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+23:3658:x1875060715227648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201171.597841:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201171.598295:0:93836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc005da6600/0x96d0c9b8c9a1bc0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1bc13 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.598314:0:93836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788201171.598320:0:93836:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1788201171.598415:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc005da7e00/0x96d0c9b8c9a1bd24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd1d expref: 23 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201171.598429:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201171.598478:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120023100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+22:3658:x1875060715227648:12345-0@lo:103:ldlm_bl.0 Request processed in 654us (1858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201171.598485:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00010000:00010000:1.0:1788201171.598515:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201171.598520:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc005da6600/0x96d0c9b8c9a1bc0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1bc13 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201171.598528:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc005da6600 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201171.598531:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc005da6600/0x96d0c9b8c9a1bc0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1bc13 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201171.598539:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc005da6600/0x96d0c9b8c9a1bc0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1bc13 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201171.598545:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc005da6600/0x96d0c9b8c9a1bc0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1bc13 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201171.598551:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201171.598554:0:24979:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788201171.598556:0:24979:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788201171.598574:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc005da6600/0x96d0c9b8c9a1bc0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1bc13 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201171.598580:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201171.598588:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc005da6600/0x96d0c9b8c9a1bc0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1bc13 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201171.598606:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc005da6600/0x96d0c9b8c9a1bc0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1bc13 expref: -99 pid: 92543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201171.598616:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201171.598617:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201171.598619:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201171.598646:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715227648:0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1788201171.598719:0:93836:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788201171.598759:0:93836:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788201171.598763:0:93836:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1788201171.598767:0:93836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1788201171.598773:0:93836:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:0.0:1788201171.598978:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715227392:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201171.599624:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201171.599640:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715227520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201171.602817:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715227776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201171.602897:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201171.603499:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201171.603556:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715227776 00000100:00100000:0.0:1788201171.603564:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715227776 00000100:00100000:0.0:1788201171.603616:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715227520 00000100:00100000:0.0:1788201171.603620:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715227520 00000100:00100000:0.0:1788201171.603645:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:0.0:1788201171.603666:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10a10c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+23:3655:x1875060715227776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201171.603681:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201171.603700:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fc200/0x96d0c9b8c9a1bcf3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bcec expref: 23 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201171.603717:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201171.605087:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:1.0:1788201171.605106:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c9b18af6-fecc-4172-82c2-66531890fe11+22:3656:x1875060715227520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201171.605121:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201171.605137:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae2000/0x96d0c9b8c9a1c1c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c1bc expref: 22 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201171.605151:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201171.605216:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c9b18af6-fecc-4172-82c2-66531890fe11+21:3656:x1875060715227520:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (1718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201171.605223:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:0.0:1788201171.605509:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10a10c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+20:3655:x1875060715227776:12345-0@lo:103:ldlm_bl.0 Request processed in 1843us (2611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201171.605517:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:0.0:1788201171.605605:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715227520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201171.605646:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715227904:0@lo:103:ldlm_bl.0 00000004:00000080:3.0:1788201171.606468:0:93836:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:1.0:1788201171.607541:0:92544:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084300 is committed 00000100:00100000:0.0:1788201171.608136:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788201171.608194:0:93836:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1788201171.608209:0:93836:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc139bc7000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201171.608217:0:93836:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc005a4a000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201171.608222:0:93836:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc1031fb000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201171.608230:0:93836:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc12b6be800 6e293f14-c501-4bc5-9dd4-a18ef02756b4 192.168.201.20@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 120259084298 stale:0 00000020:00080000:3.0:1788201171.608236:0:93836:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc12b6bd000 lustre-MDT0001-mdtlov_UUID 0@lo 6 (0 0 1) 0 0 0 0: 0000000000000000 120259084300 stale:0 00000020:00080000:3.0:1788201171.608241:0:93836:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff8dc004fd3370) has exports, disconnecting them 00000020:00080000:3.0:1788201171.608247:0:93836:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc139bc7000), last request at 1788201143 00000020:00000080:3.0:1788201171.608256:0:93836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bdef 00000100:00080000:3.0:1788201171.608269:0:93836:0:(import.c:65:import_set_state_nolock()) ffff8dc105588000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788201171.608293:0:93836:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc139bc7000): rc 0 00000020:00000080:3.0:1788201171.608295:0:93836:0:(genops.c:885:class_export_put()) final put ffff8dc139bc7000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788201171.608306:0:93836:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc005a4a000), last request at 1788201168 00000020:00000080:3.0:1788201171.608308:0:93836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bde8 00000100:00080000:3.0:1788201171.608312:0:93836:0:(import.c:65:import_set_state_nolock()) ffff8dc139bc3800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788201171.608333:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788201171.608342:0:93836:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc005a4a000): rc 0 00000020:00000080:3.0:1788201171.608344:0:93836:0:(genops.c:885:class_export_put()) final put ffff8dc005a4a000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788201171.608347:0:93836:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc1031fb000), last request at 1788201168 00000020:00000080:3.0:1788201171.608350:0:93836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bde1 00000100:00080000:3.0:1788201171.608355:0:93836:0:(import.c:65:import_set_state_nolock()) ffff8dc0039c3800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788201171.608364:0:93836:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc1031fb000): rc 0 00000020:00000080:3.0:1788201171.608366:0:93836:0:(genops.c:885:class_export_put()) final put ffff8dc1031fb000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788201171.608370:0:93836:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.201.20@tcp (ffff8dc12b6be800), last request at 1788201169 00000020:00000080:3.0:1788201171.608379:0:93836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bc6e 00000020:00010000:3.0:1788201171.608391:0:93836:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc12b6be800: total 3 00000100:00080000:3.0:1788201171.608466:0:93836:0:(import.c:65:import_set_state_nolock()) ffff8dc137d36000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788201171.608517:0:93836:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.201.20@tcp (ffff8dc12b6be800): rc 0 00000020:00080000:3.0:1788201171.608521:0:93836:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc12b6bd000), last request at 1788201137 00000020:00000080:3.0:1788201171.608524:0:93836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bc67 00000020:00010000:3.0:1788201171.608530:0:93836:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc12b6bd000: total 3 00000100:00080000:3.0:1788201171.608533:0:93836:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f5000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1788201171.608541:0:6520:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc12b6be800: total 3 00010000:00010000:3.0:1788201171.608544:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201171.608599:0:6520:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc12b6be800, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1788201171.608646:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3600/0x96d0c9b8c9a1c30c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78688e expref: 5 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.608673:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c3f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868cd expref: 4 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.608689:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1c367 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868aa expref: 3 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.608708:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1c328 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786895 expref: 2 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.608721:0:6520:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc12b6be800, canceled 4 locks, left on hash table 0. 00000100:00100000:0.0:1788201171.608729:0:9535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715227904 00000100:00100000:0.0:1788201171.608741:0:9535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715227904 00000100:00100000:0.0:1788201171.608803:0:9535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:0.0:1788201171.608813:0:9535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9b18af6-fecc-4172-82c2-66531890fe11+20:3657:x1875060715227904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201171.608828:0:9535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201171.608845:0:9535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fc400/0x96d0c9b8c9a1bc13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bc0c expref: 20 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201171.608926:0:9535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201171.608965:0:9535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9b18af6-fecc-4172-82c2-66531890fe11+19:3657:x1875060715227904:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201171.608972:0:9535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000020:00010000:0.0:1788201171.608995:0:6521:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc12b6bd000: total 3 00010000:00010000:0.0:1788201171.609079:0:6521:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc12b6bd000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788201171.609111:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1be12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1be0b expref: 5 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201171.609135:0:6521:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc12b6bd000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788201171.609383:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201171.609393:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc139bc7000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788201171.609438:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005a4a000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788201171.609459:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1031fb000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788201171.609478:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc105588000 for lustre-MDT0000 00000020:00000080:1.0:1788201171.609483:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc139bc3800 for lustre-MDT0000 00000020:00000080:1.0:1788201171.609486:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc0039c3800 for lustre-MDT0000 00010000:00010000:1.0:1788201171.609495:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201171.611815:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715227904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201171.612815:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715227776:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788201171.613073:0:93836:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc12b6bd000): rc 0 00000004:00000080:2.0:1788201171.613083:0:93836:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa0dd417c3ae0 00000100:00080000:2.0:1788201171.613106:0:93836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788201171.613110:0:93836:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788201171.616507:0:93836:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788201171.616542:0:93836:0:(import.c:65:import_set_state_nolock()) ffff8dc13f869000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788201171.618884:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715228032:0@lo:39:umount.0 00000100:00100000:1.0:1788201171.618970:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788201171.620069:0:93836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788201171.620075:0:93836:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969455 gen 3 00000004:00080000:2.0:1788201171.620093:0:93836:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788201171.620153:0:93836:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788201171.620176:0:93836:0:(import.c:65:import_set_state_nolock()) ffff8dc1259e4000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788201171.620190:0:93836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788201171.620192:0:93836:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969454 gen 3 00000004:00080000:2.0:1788201171.620201:0:93836:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788201171.620271:0:93836:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788201171.620283:0:93836:0:(import.c:65:import_set_state_nolock()) ffff8dc11d438800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788201171.620431:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715228160:0@lo:9:umount.0 00000100:00100000:1.0:1788201171.620478:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201171.620503:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715228288:0@lo:9:umount.0 00000100:00100000:1.0:1788201171.620523:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788201171.620940:0:93836:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8dc004fd3370) has no exports 00000100:00100000:2.0:1788201171.621010:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715228032 00000100:00100000:2.0:1788201171.621048:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715228032 00000100:00100000:2.0:1788201171.621096:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4046 00000100:00100000:2.0:1788201171.621105:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120022300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715228032:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788201171.621135:0:23728:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bcad 00000100:00080000:2.0:1788201171.621143:0:23728:0:(import.c:65:import_set_state_nolock()) ffff8dc005fac000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788201171.621163:0:23728:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411473 00010000:00010000:1.0:1788201171.621418:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201171.621883:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120022300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3654:x1875060715228032:12345-0@lo:39:umount.0 Request processed in 777us (2911us total) trans 77309411474 rc 0/0 00000100:00100000:2.0:1788201171.621892:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4046 00000020:00080000:2.0:1788201171.622120:0:93836:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8dc004fd3370) has no exports 00000100:00080000:1.0:1788201171.632364:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f869000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788201171.632384:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715228032:0@lo:39:umount.0 00000100:00100000:1.0:1788201171.633627:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715228160 00000100:00100000:1.0:1788201171.633638:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715228160 00000100:00100000:1.0:1788201171.633730:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715228288 00000100:00100000:1.0:1788201171.633734:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715228288 00000100:00100000:1.0:1788201171.633758:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5917 00000100:00100000:1.0:1788201171.633769:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120020a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715228160:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788201171.633799:0:26214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bcc9 00000100:00080000:1.0:1788201171.633807:0:26214:0:(import.c:65:import_set_state_nolock()) ffff8dc005faf000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788201171.633965:0:26214:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969456 00000100:00100000:1.0:1788201171.634182:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120020a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+2:3654:x1875060715228160:12345-0@lo:9:umount.0 Request processed in 414us (13703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201171.634427:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5917 00000100:00100000:1.0:1788201171.634450:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5918 00000100:00100000:1.0:1788201171.634458:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120021c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715228288:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788201171.634472:0:26214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bce5 00000100:00080000:1.0:1788201171.634477:0:26214:0:(import.c:65:import_set_state_nolock()) ffff8dc1201c9800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788201171.634517:0:26214:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969456 00000100:00100000:1.0:1788201171.634598:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120021c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+2:3654:x1875060715228288:12345-0@lo:9:umount.0 Request processed in 141us (14073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201171.634604:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5918 00010000:00010000:1.0:1788201171.634624:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201171.634631:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201171.634722:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1259e4000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788201171.634737:0:3654:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788201171.634739:0:3654:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201171.634743:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715228160:0@lo:9:umount.0 00000100:00080000:1.0:1788201171.634761:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11d438800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788201171.634771:0:3654:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788201171.634773:0:3654:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201171.634775:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715228288:0@lo:9:umount.0 00000100:00080000:1.0:1788201171.653226:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201171.653242:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1788201171.656906:0:6520:0:(genops.c:885:class_export_put()) final put ffff8dc12b6be800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 00010000:00010000:3.0:1788201171.656953:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201171.656956:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201171.656960:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201171.657237:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12b6be800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 for lustre-MDT0000 00000020:00000080:1.0:1788201171.657323:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc137d36000 for lustre-MDT0000 00000020:00000080:0.0:1788201171.687517:0:6521:0:(genops.c:885:class_export_put()) final put ffff8dc12b6bd000/lustre-MDT0001-mdtlov_UUID 00010000:00010000:1.0:1788201171.687617:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201171.687626:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201171.687630:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788201171.687670:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12b6bd000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788201171.687765:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1257f5000 for lustre-MDT0000 00000020:00000080:2.0:1788201171.713820:0:93836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bc83 00000020:00000080:2.0:1788201171.713837:0:93836:0:(genops.c:885:class_export_put()) final put ffff8dc10bd93000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788201171.713934:0:93836:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788201171.713942:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc10bd93000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788201171.714059:0:93836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201171.714105:0:93836:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788201171.714112:0:93836:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8dc13f874d28) has no exports 00000020:00000080:3.0:1788201171.714962:0:93836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bc7c 00000020:00000080:3.0:1788201171.714975:0:93836:0:(genops.c:885:class_export_put()) final put ffff8dc1031f9000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788201171.715075:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1031f9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788201171.715183:0:93836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201171.715200:0:93836:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788201171.715205:0:93836:0:(genops.c:885:class_export_put()) final put ffff8dc12f19d000/lustre-QMT0000_UUID 00000020:00000080:3.0:1788201171.715208:0:93836:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12f19d000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788201171.715222:0:93836:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1788201171.715455:0:93836:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc007fd0d80 - data ffff8dc1339e1798/ffff8dc125919800 00000020:01000000:3.0:1788201171.715622:0:93836:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc003bd7c00 - data ffff8dc002286d80/ffff8dc125805400 00010000:00010000:1.0:1788201171.728173:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201171.775863:0:93836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788201171.775875:0:93836:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788201171.775895:0:93836:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8dc00a9b7800 x1875060715228032/t77309411474(77309411474) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201181 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201171.775931:0:93836:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788201171.777933:0:93836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788201171.777944:0:93836:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969455 gen 4 00000004:00080000:2.0:1788201171.777972:0:93836:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201171.777975:0:93836:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788201171.778429:0:92562:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788201171.778437:0:92562:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x70:0x0] index 1 count 1 00000040:00080000:0.0:1788201171.778449:0:92562:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 28 count 2 00000100:00080000:2.0:1788201171.779492:0:93836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788201171.779500:0:93836:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969454 gen 4 00000004:00080000:2.0:1788201171.779520:0:93836:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201171.779523:0:93836:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788201171.779769:0:92564:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788201171.779775:0:92564:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x72:0x0] index 1 count 1 00000040:00080000:1.0:1788201171.779786:0:92564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 28 count 2 00000020:00000080:1.0:1788201171.783350:0:93836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bc3d 00000020:00000080:1.0:1788201171.783366:0:93836:0:(genops.c:885:class_export_put()) final put ffff8dc139bc6000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788201171.784461:0:93836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bc52 00000020:00000080:1.0:1788201171.784473:0:93836:0:(genops.c:885:class_export_put()) final put ffff8dc104281000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201171.784895:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc139bc6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788201171.785007:0:93836:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788201171.785211:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc104281000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788201171.785249:0:93836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201171.785264:0:93836:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788201171.785269:0:93836:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8dc004fd19b8) has no exports 00000004:01000000:1.0:1788201171.785527:0:93836:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788201171.785538:0:93836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bcd0 00000020:00000080:1.0:1788201171.785546:0:93836:0:(genops.c:885:class_export_put()) final put ffff8dc1201cd800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788201171.785560:0:93836:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788201171.785565:0:93836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201171.785574:0:93836:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788201171.785576:0:93836:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8dc004fd0000) has no exports 00000020:00000080:1.0:1788201171.785583:0:93836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bcc2 00000020:00000080:1.0:1788201171.785587:0:93836:0:(genops.c:885:class_export_put()) final put ffff8dc11d43a000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788201171.785986:0:93836:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788201171.786005:0:93836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788201171.786011:0:93836:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969454 gen 5 00000020:00000080:2.0:1788201171.786177:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1201cd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788201171.786185:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d43a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000004:00080000:1.0:1788201171.786284:0:93836:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201171.786287:0:93836:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201171.786365:0:93836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201171.786379:0:93836:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201171.786387:0:93836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bcb4 00000020:00000080:1.0:1788201171.786394:0:93836:0:(genops.c:885:class_export_put()) final put ffff8dc1201cb000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201171.786927:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc11d438800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788201171.786938:0:93109:0:(genops.c:885:class_export_put()) final put ffff8dc1201cf000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201171.786941:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1201cf000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788201171.786947:0:93109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788201171.787390:0:93836:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788201171.787398:0:93836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201171.787409:0:93836:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788201171.787414:0:93836:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8dc1060e3370) has no exports 00000020:00000080:1.0:1788201171.787423:0:93836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bca6 00000020:00000080:1.0:1788201171.787429:0:93836:0:(genops.c:885:class_export_put()) final put ffff8dc1259e4800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788201171.791047:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1201cb000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788201171.791087:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1259e4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788201171.791632:0:93836:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788201171.791639:0:93836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788201171.791644:0:93836:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969455 gen 5 00000004:00080000:1.0:1788201171.791652:0:93836:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201171.791681:0:93836:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201171.791754:0:93836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201171.791772:0:93836:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788201171.791793:0:93836:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788201171.791802:0:93836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bc98 00000020:00000080:1.0:1788201171.791814:0:93836:0:(genops.c:885:class_export_put()) final put ffff8dc1201cc000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788201171.791821:0:93836:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788201171.791828:0:93836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201171.791835:0:93836:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788201171.791839:0:93836:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8dc139bb99b8) has no exports 00000020:00000080:1.0:1788201171.791847:0:93836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bc91 00000020:00000080:1.0:1788201171.791852:0:93836:0:(genops.c:885:class_export_put()) final put ffff8dc13f86d800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788201171.792388:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1259e4000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788201171.792400:0:93109:0:(genops.c:885:class_export_put()) final put ffff8dc1201c9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201171.792403:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1201c9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788201171.792411:0:93109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201171.792531:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1201cc000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788201171.792537:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13f86d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788201171.794219:0:93836:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788201171.794229:0:93836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788201171.794234:0:93836:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788201171.794243:0:93836:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788201171.794321:0:93836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201171.794342:0:93836:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201171.794379:0:93836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201171.794383:0:93836:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201171.794390:0:93836:0:(genops.c:885:class_export_put()) final put ffff8dc1401c1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201171.794395:0:93836:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1401c1000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788201171.794404:0:93836:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201171.794529:0:93836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bc59 00000020:00000080:0.0:1788201171.794538:0:93836:0:(genops.c:885:class_export_put()) final put ffff8dc104283800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788201171.794544:0:93836:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788201171.794549:0:93836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201171.794555:0:93836:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788201171.794560:0:93836:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8dc004fd4d28) has no exports 00000020:00000080:0.0:1788201171.794593:0:93836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201171.794597:0:93836:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788201171.794602:0:93836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bc60 00000020:00000080:0.0:1788201171.794606:0:93836:0:(genops.c:885:class_export_put()) final put ffff8dc104280000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788201171.794615:0:93836:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc11d63c000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788201171.794619:0:93836:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc11d63c000 3 00000020:01000004:0.0:1788201171.794623:0:93836:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dc11d63c000 from lustre-MDT0000 00000020:00000080:0.0:1788201171.794645:0:93836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201171.794649:0:93836:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788201171.794652:0:93836:0:(genops.c:885:class_export_put()) final put ffff8dc139bc5000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788201171.794654:0:93836:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc139bc5000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788201171.794663:0:93836:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788201171.794695:0:93836:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788201171.794699:0:93836:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788201171.794702:0:93836:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788201171.794720:0:93836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201171.794724:0:93836:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788201171.794734:0:93836:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8dc1090d2800 93ba7067-43b5-4e46-8db7-27c040fa03d9 192.168.201.20@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201171.794741:0:93836:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8dc1401c5000 c9b18af6-fecc-4172-82c2-66531890fe11 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201171.794745:0:93836:0:(genops.c:1553:class_disconnect_exports()) OBD device 3 (ffff8dc12f0c19b8) has exports, disconnecting them 00000020:00080000:0.0:1788201171.794749:0:93836:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.201.20@tcp (ffff8dc1090d2800), last request at 1788201147 00000020:00000080:0.0:1788201171.794785:0:93836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c0ea 00000020:00010000:0.0:1788201171.794791:0:93836:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc1090d2800: total 2 00000100:00080000:0.0:1788201171.794796:0:93836:0:(import.c:65:import_set_state_nolock()) ffff8dc1090d6000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788201171.794811:0:93836:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.201.20@tcp (ffff8dc1090d2800): rc 0 00000020:00080000:0.0:1788201171.794814:0:93836:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8dc1401c5000), last request at 1788201137 00000020:00000080:0.0:1788201171.794865:0:93836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bbfe 00000020:00010000:0.0:1788201171.794869:0:93836:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc1401c5000: total 2 00000100:00080000:0.0:1788201171.794871:0:93836:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788201171.794890:0:93836:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc1401c5000): rc 0 00000020:00080000:0.0:1788201171.794895:0:93836:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8dc12f0c19b8) has no exports 00000020:00010000:3.0:1788201171.795169:0:6520:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc1090d2800: total 2 00010000:00010000:3.0:1788201171.795230:0:6520:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc1090d2800, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1788201171.795275:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007adea00/0x96d0c9b8c9a1c0f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786833 expref: 5 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.795294:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae2200/0x96d0c9b8c9a1c106 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786841 expref: 4 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.795308:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1c22c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78685d expref: 3 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.795319:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782c600/0x96d0c9b8c9a1c233 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786864 expref: 2 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.795328:0:6520:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc1090d2800, canceled 4 locks, left on hash table 0. 00000020:00000080:3.0:1788201171.795349:0:6520:0:(genops.c:885:class_export_put()) final put ffff8dc1090d2800/93ba7067-43b5-4e46-8db7-27c040fa03d9 00000020:00010000:3.0:1788201171.795355:0:6520:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc1401c5000: total 3 00010000:00010000:3.0:1788201171.795372:0:6520:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc1401c5000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788201171.795388:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ec400/0x96d0c9b8c9a1c225 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c21e expref: 14 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.795409:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc005da7200/0x96d0c9b8c9a1bd5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd55 expref: 13 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.795425:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ed200/0x96d0c9b8c9a1bd6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd63 expref: 12 pid: 92550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.795436:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782cc00/0x96d0c9b8c9a1c1d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c1ca expref: 11 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.795446:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae3e00/0x96d0c9b8c9a1c1df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c1d8 expref: 10 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.795457:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc005da6200/0x96d0c9b8c9a1bd94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd8d expref: 9 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.795469:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782dc00/0x96d0c9b8c9a1c1fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c1f4 expref: 8 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.795480:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782c800/0x96d0c9b8c9a1c1ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c1e6 expref: 7 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.795490:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c209 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c202 expref: 6 pid: 92549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.795501:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc005da6000/0x96d0c9b8c9a1bd40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bd39 expref: 5 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.795514:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1bdbe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bdb7 expref: 4 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.795539:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782d800/0x96d0c9b8c9a1c217 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c210 expref: 3 pid: 92554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.795551:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fc800/0x96d0c9b8c9a1bdcc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1bdc5 expref: 2 pid: 92551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201171.795560:0:6520:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc1401c5000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788201171.795574:0:6520:0:(genops.c:885:class_export_put()) final put ffff8dc1401c5000/c9b18af6-fecc-4172-82c2-66531890fe11 00010000:00010000:3.0:1788201171.795580:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201171.795582:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201171.795584:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201171.795629:0:92549:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8dc0075eb400:92549] 0 exiting: rc = 1 00000100:00100000:3.0:1788201171.795762:0:92551:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8dc10a35c600:92551] 2 exiting: rc = 0 00000020:00000080:2.0:1788201171.796058:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc13f869000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788201171.796199:0:93109:0:(genops.c:885:class_export_put()) final put ffff8dc139bc4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201171.796203:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc139bc4800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1788201171.796213:0:93109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201171.796294:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc104283800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788201171.796299:0:93109:0:(genops.c:885:class_export_put()) final put ffff8dc1401c5800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788201171.796301:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1401c5800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788201171.796305:0:93109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788201171.796331:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc104280000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788201171.796338:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1090d2800/93ba7067-43b5-4e46-8db7-27c040fa03d9 for MGS 00000020:00000080:2.0:1788201171.796372:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1401c5000/c9b18af6-fecc-4172-82c2-66531890fe11 for MGS 00000020:00000080:2.0:1788201171.796396:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1090d6000 for MGS 00000020:00000080:2.0:1788201171.796400:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1401c4800 for MGS 00010000:00010000:2.0:1788201171.797215:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201171.797335:0:92550:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8dc005d12e00:92550] 1 exiting: rc = 0 00000100:00100000:0.0:1788201171.803261:0:92554:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff8dc004fbda00:92554] 3 exiting: rc = 0 00000100:00100000:2.0:1788201171.803476:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803487:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803494:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803501:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803508:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803515:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803520:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803526:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803532:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803540:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803545:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803551:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803556:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803562:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803568:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803575:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803581:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803588:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803594:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803600:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803605:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803611:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803616:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803622:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803630:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803636:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803642:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803647:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803653:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803659:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803665:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803671:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803696:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803702:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803708:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803714:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803720:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803725:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803731:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803737:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803743:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803749:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803754:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803761:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803766:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803773:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803779:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803789:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803794:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803799:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803804:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803810:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803815:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803820:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803825:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803830:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803835:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803840:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803845:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803851:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803856:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803861:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803869:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201171.803874:0:93836:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1788201171.805276:0:93836:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc12b66b7e0 - data ffff8dc11dbf0798/ffff8dc12014ac00 00000020:01000000:2.0:1788201171.805422:0:93836:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc007b82d20 - data ffff8dc11d9096c0/ffff8dc008b23c00 00000020:00000080:2.0:1788201171.805908:0:93836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bbf7 00000020:00000080:2.0:1788201171.805934:0:93836:0:(genops.c:885:class_export_put()) final put ffff8dc005a4f000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788201171.806150:0:93836:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc11d63c000 from MGS, refs=2 00000020:01000004:2.0:1788201171.806155:0:93836:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc11d63c000 2 00000020:01000004:2.0:1788201171.806159:0:93836:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dc11d63c000 from MGS 00000020:00000080:2.0:1788201171.806188:0:93836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201171.806196:0:93836:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788201171.806200:0:93836:0:(genops.c:885:class_export_put()) final put ffff8dc005a4c800/MGS 00000020:00000080:2.0:1788201171.806203:0:93836:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005a4c800/MGS for MGS 00000020:01000000:2.0:1788201171.806211:0:93836:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788201171.806307:0:93836:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788201171.806311:0:93836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201171.806323:0:93836:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788201171.806330:0:93836:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8dc137d32800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788201171.806337:0:93836:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8dc0040419b8) has exports, disconnecting them 00000020:00080000:2.0:1788201171.806344:0:93836:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8dc137d32800), last request at 1788201137 00000020:00000080:2.0:1788201171.806349:0:93836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bd0f 00000020:00080000:2.0:1788201171.806362:0:93836:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc137d32800): rc 0 00000020:00000080:2.0:1788201171.806369:0:93836:0:(genops.c:885:class_export_put()) final put ffff8dc137d32800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788201171.807192:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005a4f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788201171.807983:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d32800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788201171.810143:0:93836:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788201171.810155:0:93836:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201171.810160:0:93836:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788201171.810169:0:93836:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788201171.810208:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc001db1800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788201171.810404:0:93836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201171.810421:0:93836:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788201171.810428:0:93836:0:(genops.c:885:class_export_put()) final put ffff8dc137d33800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788201171.810446:0:93836:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d33800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788201171.810455:0:93836:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788201171.810563:0:93836:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc11d63c000 1 00000020:00000080:0.0:1788201171.810571:0:93836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bbe9 00000020:00000080:0.0:1788201171.810579:0:93836:0:(genops.c:885:class_export_put()) final put ffff8dc005a49800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788201171.810589:0:93836:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788201171.810597:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005a49800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788201171.810607:0:93836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201171.810612:0:93836:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788201171.810617:0:93836:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8dc12f0c0000) has no exports 00000020:00000080:0.0:1788201171.903607:0:93836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201171.903627:0:93836:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788201171.903635:0:93836:0:(genops.c:885:class_export_put()) final put ffff8dc11d63a800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788201171.903641:0:93836:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d63a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788201171.903653:0:93836:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788201171.903819:0:93836:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dc11d63f000 00000020:02000400:0.0:1788201171.903899:0:93836:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788201172.756048:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1788201172.964153:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695421952 offset 0 length 224: 4 00000100:00100000:1.0:1788201172.964206:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201172.964239:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201172.964266:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201172.964393:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695422080 00000100:00100000:0.0:1788201172.964407:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695422080 00000100:00100000:0.0:1788201172.964464:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695422208 00000100:00100000:0.0:1788201172.964467:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695422208 00000100:00100000:0.0:1788201172.964521:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1425 00000100:00100000:0.0:1788201172.964534:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+19:2403:x1875060695422208:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201172.964661:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+19:2403:x1875060695422208:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 128us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201172.964670:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1425 00000100:00100000:0.0:1788201172.964692:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1410 00000100:00100000:0.0:1788201172.964697:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875060695422080:12345-192.168.201.20@tcp:400:kworker.0 00000020:00080000:0.0:1788201172.964704:0:69485:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.20@tcp 00000100:00100000:0.0:1788201172.964766:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2403:x1875060695422080:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 67us (560us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788201172.964773:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1410 00000100:00080000:0.0:1788201172.964945:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201172.965250:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201172.967262:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695422464 00000100:00100000:2.0:1788201172.967510:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695422464 00000100:00100000:0.0:1788201172.968566:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695422336 00000100:00100000:0.0:1788201172.968577:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695422336 00000100:00100000:2.0:1788201172.968669:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2841 00000100:00100000:2.0:1788201172.968686:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120023480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695422464:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201172.968808:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120023480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695422464:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 127us (4539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201172.968816:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2841 00000100:00080000:1.0:1788201172.975258:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201172.975408:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201172.979631:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2842 00000100:00100000:0.0:1788201172.979657:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120022a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695422336:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201172.979966:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120022a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695422336:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 318us (14715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201172.979976:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2842 00000100:00100000:0.0:1788201172.980137:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201172.986292:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695422592 00000100:00100000:2.0:1788201172.986313:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695422592 00000100:00100000:2.0:1788201172.986388:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1411 00000100:00100000:2.0:1788201172.986400:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695422592:12345-192.168.201.20@tcp:38:ptlrpcd_01_01.0 00010000:00020000:2.0:1788201172.986447:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201172.986552:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695422592:12345-192.168.201.20@tcp:38:ptlrpcd_01_01.0 Request processed in 152us (6415us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201172.986560:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1411 00000100:00100000:3.0:1788201173.328446:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201173.328477:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715228416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201173.328593:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201173.329214:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715228416 00000100:00100000:0.0:1788201173.329225:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715228416 00000100:00100000:0.0:1788201173.329288:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2306 00000100:00100000:0.0:1788201173.329296:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715228416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201173.329347:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788201173.329414:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715228416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201173.329422:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2306 00000100:00100000:3.0:1788201173.329602:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201173.329613:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715228544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201173.329643:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201173.329691:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715228416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201173.329747:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715228544 00000100:00100000:2.0:1788201173.329753:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715228544 00000100:00100000:2.0:1788201173.329796:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2307 00000100:00100000:2.0:1788201173.329806:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715228544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201173.329823:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201173.329856:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715228544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201173.329860:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2307 00000100:00100000:2.0:1788201173.329887:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715228544:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788201173.329950:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201173.329956:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788201173.776489:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201173.839807:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715228672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201173.840075:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201173.840213:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715228672 00000100:00100000:2.0:1788201173.840226:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715228672 00000100:00100000:2.0:1788201173.840286:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4047 00000100:00100000:2.0:1788201173.840298:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1875060715228672:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1788201173.840310:0:8457:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788201173.840498:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715229056:0@lo:400:kworker.0 00000100:00100000:1.0:1788201173.840541:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201173.840570:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715229568:0@lo:400:kworker.0 00000100:00100000:2.0:1788201173.840608:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1875060715228672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 310us (533us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788201173.840613:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201173.840624:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4047 00000100:00100000:1.0:1788201173.840647:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201173.840656:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715229184:0@lo:400:kworker.0 00000100:00100000:1.0:1788201173.840679:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201173.840711:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715229696:0@lo:400:kworker.0 00000100:00100000:1.0:1788201173.840757:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201173.840787:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715228928:0@lo:400:kworker.0 00000100:00100000:1.0:1788201173.840813:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201173.840832:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715229440:0@lo:400:kworker.0 00000100:00100000:1.0:1788201173.840854:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201173.840872:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788201173.840877:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715228800:0@lo:400:kworker.0 00000400:00000100:1.0:1788201173.840894:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715228800 offset 0 length 224: 4 00000100:00100000:1.0:1788201173.840916:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715229312:0@lo:400:kworker.0 00000100:00100000:1.0:1788201173.840938:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201173.840965:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715229568 00000100:00100000:1.0:1788201173.840970:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715229568 00000100:00100000:1.0:1788201173.841044:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715229440 00000100:00100000:1.0:1788201173.841047:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715229440 00000100:00100000:1.0:1788201173.841070:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2843 00000100:00100000:1.0:1788201173.841078:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715229568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201173.841127:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715229568:12345-0@lo:400:kworker.0 Request processed in 50us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201173.841133:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2843 00000100:00100000:1.0:1788201173.841151:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2844 00000100:00100000:1.0:1788201173.841157:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715229440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201173.841189:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715229440:12345-0@lo:400:kworker.0 Request processed in 32us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201173.841195:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2844 00000100:00100000:1.0:1788201173.841216:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715229056 00000100:00100000:1.0:1788201173.841227:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715229056 00000100:00100000:1.0:1788201173.841263:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715229184 00000100:00100000:1.0:1788201173.841265:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715229184 00000100:00100000:1.0:1788201173.841275:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715229696 00000100:00100000:1.0:1788201173.841277:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715229696 00000100:00100000:1.0:1788201173.841286:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715228928 00000100:00100000:1.0:1788201173.841288:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715228928 00000100:00100000:1.0:1788201173.841296:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715229312 00000100:00100000:1.0:1788201173.841298:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715229312 00000100:00100000:1.0:1788201173.841315:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:1.0:1788201173.841321:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120023100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715229056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201173.841363:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120023100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715229056:12345-0@lo:400:kworker.0 Request processed in 42us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201173.841369:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00100000:1.0:1788201173.841381:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427 00000100:00100000:1.0:1788201173.841387:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715229312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201173.841412:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715229312:12345-0@lo:400:kworker.0 Request processed in 26us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201173.841419:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1427 00000100:00100000:1.0:1788201173.841431:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:1.0:1788201173.841436:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3655:x1875060715229184:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788201173.841441:0:66312:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788201173.841475:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3655:x1875060715229184:12345-0@lo:400:kworker.0 Request processed in 38us (795us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788201173.841482:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00100000:1.0:1788201173.841496:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:1.0:1788201173.841500:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3655:x1875060715229696:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788201173.841505:0:66312:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:02020000:3.0:1788201173.841532:0:3656:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:1.0:1788201173.841542:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3655:x1875060715229696:12345-0@lo:400:kworker.0 Request processed in 38us (781us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788201173.841553:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00100000:1.0:1788201173.841567:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:1.0:1788201173.841572:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1875060715228928:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788201173.841577:0:66312:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788201173.841597:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1875060715228928:12345-0@lo:400:kworker.0 Request processed in 24us (784us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788201173.841603:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00080000:1.0:1788201173.841641:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201173.841672:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715229312:0@lo:400:kworker.0 00000100:00080000:1.0:1788201173.841684:0:3658:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788201173.841690:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788201173.841695:0:3658:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788201173.841849:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788201173.841855:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788201173.841859:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788201173.841864:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201173.841869:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3994 00000100:00080000:0.0:1788201173.841876:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201173.841917:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13f8d9880 x1875060715229824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201173.841950:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715229184:0@lo:400:kworker.0 00000100:00080000:0.0:1788201173.841964:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788201173.841969:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788201173.841972:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788201173.841975:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201173.841978:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3994 00000100:00080000:0.0:1788201173.841983:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201173.842009:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13f8d9180 x1875060715229952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201173.842040:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715229696:0@lo:400:kworker.0 00000100:00100000:0.0:1788201173.842056:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715229056:0@lo:400:kworker.0 00000100:00100000:0.0:1788201173.842067:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715229568:0@lo:400:kworker.0 00000100:00100000:2.0:1788201173.842170:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715229824:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788201173.842212:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201173.842243:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715229952:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788201173.842266:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201173.842348:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715229824 00000100:00100000:0.0:1788201173.842354:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715229824 00000100:00100000:0.0:1788201173.842388:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715229952 00000100:00100000:0.0:1788201173.842391:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715229952 00000100:00100000:0.0:1788201173.842409:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:0.0:1788201173.842415:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715229824:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1788201173.842436:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201173.842480:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715229824:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 62us (266us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201173.842495:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00100000:0.0:1788201173.842510:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:0.0:1788201173.842514:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715229952:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1788201173.842524:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201173.842552:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715229952:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 36us (284us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201173.842557:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00080000:0.0:1788201173.842585:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201173.842590:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201173.842593:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715229824:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1788201173.842602:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201173.842605:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201173.842608:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715229952:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1788201173.871269:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201173.871282:0:3658:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3994 00000100:00080000:1.0:1788201173.871293:0:3658:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00080000:3.0:1788201173.877606:0:3656:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788201173.877616:0:3656:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788201173.877628:0:3656:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788201173.877636:0:3656:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201173.877641:0:3656:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3994 00000100:00080000:3.0:1788201173.877653:0:3656:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201173.877699:0:3656:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efc8700 x1875060715230080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201173.877800:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715230080:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788201173.877901:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201173.878304:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715230080 00000100:00100000:1.0:1788201173.878424:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715230080 00000100:00100000:1.0:1788201173.878521:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4048 00000100:00100000:1.0:1788201173.878531:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715230080:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1788201173.878559:0:23728:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201173.878614:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715230080:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 83us (713us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201173.878629:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4048 00000100:00080000:1.0:1788201173.878728:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201173.878733:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201173.878737:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715230080:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788201173.879012:0:3658:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13f8d9180 x1875060715230208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201173.879093:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715228928:0@lo:400:kworker.0 00000100:00100000:0.0:1788201173.879148:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715229440:0@lo:400:kworker.0 00000100:00100000:1.0:1788201173.884487:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715230208:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788201173.884594:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201173.885497:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715230208 00000100:00100000:3.0:1788201173.885510:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715230208 00000100:00100000:3.0:1788201173.885570:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:3.0:1788201173.885580:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715230208:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1788201173.885610:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201173.885694:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715230208:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 113us (1099us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201173.885703:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00080000:1.0:1788201173.885875:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201173.885882:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201173.885886:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715230208:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1788201174.799391:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788201175.379798:0:75739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788201175.379813:0:75739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411474 is committed 00000020:00000080:1.0:1788201175.379817:0:75739:0:(genops.c:885:class_export_put()) final put ffff8dc005fae000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788201175.379846:0:75739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411473 is committed 00000020:00000080:3.0:1788201175.379889:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005fae000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788201175.379937:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc005fac000 for lustre-MDT0001 00010000:00010000:2.0:1788201175.380068:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c432 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380089:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c432 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380101:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c432 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380108:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201175.380114:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c432 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380122:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c432 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380144:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x9add8152 (ffff8dc107112a00) 00010000:00010000:2.0:1788201175.380148:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201175.380153:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c432 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380159:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c432 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380197:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1c447 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380203:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1c447 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380209:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1c447 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380232:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201175.380235:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1c447 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380240:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1c447 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380249:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff8dc107112e00) 00010000:00010000:2.0:1788201175.380251:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201175.380254:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1c447 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380259:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1c447 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380287:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c48d lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380294:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c48d lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380299:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c48d lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380304:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201175.380307:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c48d lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380312:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c48d lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380446:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x9add8152 (ffff8dc0048bef00) 00010000:00010000:2.0:1788201175.380450:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201175.380454:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c48d lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380476:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c48d lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380496:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf400/0x96d0c9b8c9a1c4a2 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380502:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf400/0x96d0c9b8c9a1c4a2 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380509:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf400/0x96d0c9b8c9a1c4a2 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380514:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201175.380517:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf400/0x96d0c9b8c9a1c4a2 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380523:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf400/0x96d0c9b8c9a1c4a2 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380530:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff8dc1115df600) 00010000:00010000:2.0:1788201175.380532:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201175.380534:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf400/0x96d0c9b8c9a1c4a2 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201175.380539:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf400/0x96d0c9b8c9a1c4a2 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1788201175.382482:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201175.382491:0:9526:0:(genops.c:885:class_export_put()) final put ffff8dc1201c8000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788201175.382519:0:9526:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969456 is committed 00000020:00000080:1.0:1788201175.383412:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1201c8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788201175.383475:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1201c9800 for lustre-OST0001 00010000:00010000:2.0:1788201175.823392:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201176.847876:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788201177.432176:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201177.432186:0:8442:0:(genops.c:885:class_export_put()) final put ffff8dc005fab800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201177.433871:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005fab800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788201177.434298:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc005faf000 for lustre-OST0000 00010000:00010000:1.0:1788201177.871968:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1788201178.087115:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695422720 offset 0 length 224: 4 00000100:00100000:2.0:1788201178.091001:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201178.091073:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201178.091154:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201178.091290:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695423104 00000100:00100000:3.0:1788201178.091301:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695423104 00000100:00100000:3.0:1788201178.091373:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2845 00000100:00100000:3.0:1788201178.091385:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695423104:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201178.091470:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695423104:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 87us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201178.091478:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2845 00000100:00080000:2.0:1788201178.091604:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201178.092875:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695422976 00000100:00100000:1.0:1788201178.092884:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695422976 00000100:00100000:1.0:1788201178.092960:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695422848 00000100:00100000:1.0:1788201178.092963:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695422848 00000100:00100000:1.0:1788201178.092987:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1428 00000100:00100000:1.0:1788201178.092996:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2403:x1875060695422976:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201178.093089:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2403:x1875060695422976:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 94us (2098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201178.093096:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1428 00000100:00100000:1.0:1788201178.093127:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1418 00000100:00100000:1.0:1788201178.093132:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2399:x1875060695422848:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:1.0:1788201178.093151:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201178.093182:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2399:x1875060695422848:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 49us (2109us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201178.093188:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1418 00000100:00080000:2.0:1788201178.093329:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201178.111360:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201178.111510:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695423232 00000100:00100000:3.0:1788201178.111534:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695423232 00000100:00100000:3.0:1788201178.111615:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2846 00000100:00100000:3.0:1788201178.111625:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695423232:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201178.111712:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695423232:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 89us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201178.111720:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2846 00000100:00080000:2.0:1788201178.112009:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201178.447360:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201178.447382:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715230336:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201178.447454:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201178.447619:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715230336 00000100:00100000:2.0:1788201178.447628:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715230336 00000100:00100000:2.0:1788201178.447711:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2308 00000100:00100000:2.0:1788201178.447722:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715230336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201178.447760:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788201178.447821:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715230336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201178.447829:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2308 00000100:00100000:2.0:1788201178.447874:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715230336:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788201178.448045:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201178.448159:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201178.448170:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715230464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201178.448201:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201178.448269:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715230464 00000100:00100000:3.0:1788201178.448274:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715230464 00000100:00100000:3.0:1788201178.448311:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2309 00000100:00100000:3.0:1788201178.448318:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715230464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201178.448334:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201178.448371:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715230464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201178.448377:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2309 00000100:00100000:3.0:1788201178.448405:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715230464:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788201178.448459:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788201178.900790:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201178.960133:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201178.960140:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201178.960143:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201178.960151:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4025 00000100:00080000:3.0:1788201178.960157:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201178.960162:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201178.960200:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12fb0ed80 x1875060715230720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201178.960236:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201178.960239:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201178.960241:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201178.960244:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4025 00000100:00080000:3.0:1788201178.960246:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201178.960250:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201178.960259:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12fb0c700 x1875060715230976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201178.960287:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201178.960290:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201178.960292:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201178.960295:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4025 00000100:00080000:3.0:1788201178.960297:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201178.960300:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201178.960311:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004eb6680 x1875060715231232/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201178.960330:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201178.960333:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201178.960334:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201178.960337:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4025 00000100:00080000:3.0:1788201178.960340:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201178.960343:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201178.960361:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004eb4e00 x1875060715231616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201178.960389:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715231104:0@lo:400:kworker.0 00000100:00100000:3.0:1788201178.960452:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201178.960491:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201178.960514:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715231360:0@lo:400:kworker.0 00000100:00100000:3.0:1788201178.960542:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201178.960574:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715231104 00000100:00100000:3.0:1788201178.960581:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715231104 00000100:00100000:3.0:1788201178.960632:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:3.0:1788201178.960641:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715231104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201178.960690:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715231104:12345-0@lo:400:kworker.0 Request processed in 50us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201178.960697:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:3.0:1788201178.960721:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715231360 00000100:00100000:3.0:1788201178.960725:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715231360 00000100:00100000:3.0:1788201178.960746:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2847 00000100:00100000:3.0:1788201178.960753:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715231360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201178.960782:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715231360:12345-0@lo:400:kworker.0 Request processed in 30us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201178.960788:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2847 00000100:00100000:3.0:1788201178.960822:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715231360:0@lo:400:kworker.0 00000100:00100000:3.0:1788201178.960834:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715231104:0@lo:400:kworker.0 00000100:00080000:1.0:1788201178.961220:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201178.961246:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715230848:0@lo:400:kworker.0 00000100:00100000:1.0:1788201178.961277:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201178.961308:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788201178.961315:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715230592:0@lo:400:kworker.0 00000400:00000100:1.0:1788201178.961334:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715230592 offset 0 length 224: 4 00000100:00100000:1.0:1788201178.961356:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715231488:0@lo:400:kworker.0 00000100:00100000:1.0:1788201178.961379:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201178.961549:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715230848 00000100:00100000:3.0:1788201178.961555:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715230848 00000100:00080000:1.0:1788201178.961639:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201178.961673:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:3.0:1788201178.961689:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715230848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201178.961736:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715230848:12345-0@lo:400:kworker.0 Request processed in 48us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201178.961741:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00100000:1.0:1788201178.961795:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715230848:0@lo:400:kworker.0 00000100:00100000:2.0:1788201178.961867:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715230720:0@lo:38:kworker.0 00000100:00100000:2.0:1788201178.961911:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201178.966108:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715231488 00000100:00100000:1.0:1788201178.966154:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715231488 00000100:00100000:1.0:1788201178.966218:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2848 00000100:00100000:1.0:1788201178.966228:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715231488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201178.966319:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715231488:12345-0@lo:400:kworker.0 Request processed in 93us (4939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201178.966327:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2848 00000100:00100000:1.0:1788201178.966380:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715231488:0@lo:400:kworker.0 00000100:00100000:2.0:1788201178.967643:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715230976:0@lo:38:kworker.0 00000100:00100000:2.0:1788201178.967700:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201178.974585:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715230720 00000100:00100000:0.0:1788201178.974601:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715230720 00000100:00100000:0.0:1788201178.974665:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:0.0:1788201178.974687:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715230720:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201178.974711:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201178.974787:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715230720:12345-0@lo:38:kworker.0 Request processed in 101us (12887us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201178.974794:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00100000:2.0:1788201178.975290:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715231232:0@lo:38:kworker.0 00000100:00100000:2.0:1788201178.975332:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201178.975355:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715231616:0@lo:38:kworker.0 00000100:00100000:2.0:1788201178.975375:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201178.975423:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715231232 00000100:00100000:3.0:1788201178.975427:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715231232 00000100:00100000:3.0:1788201178.975448:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4049 00000100:00100000:3.0:1788201178.975453:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715231232:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788201178.975465:0:8457:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201178.975491:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715231232:12345-0@lo:38:kworker.0 Request processed in 37us (159us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201178.975511:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4049 00000100:00080000:2.0:1788201178.975846:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201178.975851:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201178.975855:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715230720:0@lo:38:kworker.0 00000100:00080000:2.0:1788201178.975863:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201178.975866:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201178.975869:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715231232:0@lo:38:kworker.0 00000100:00100000:1.0:1788201178.975961:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715230976 00000100:00100000:1.0:1788201178.975966:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715230976 00000100:00100000:1.0:1788201178.975992:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715231616 00000100:00100000:1.0:1788201178.975995:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715231616 00000100:00100000:1.0:1788201178.976009:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:1.0:1788201178.976014:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715230976:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201178.976040:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201178.976080:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715230976:12345-0@lo:38:kworker.0 Request processed in 65us (8380us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201178.976086:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00100000:1.0:1788201178.976098:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:1.0:1788201178.976102:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715231616:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201178.976111:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201178.976141:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715231616:12345-0@lo:38:kworker.0 Request processed in 38us (765us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201178.976146:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00080000:2.0:1788201178.976359:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201178.976364:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201178.976367:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715230976:0@lo:38:kworker.0 00000100:00080000:2.0:1788201178.976374:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201178.976377:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201178.976380:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715231616:0@lo:38:kworker.0 00010000:00010000:2.0:1788201179.920081:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201180.943374:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201181.967265:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201182.991252:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1788201183.189219:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695423360 offset 0 length 224: 4 00000100:00100000:0.0:1788201183.189280:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201183.189325:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201183.189366:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201183.189402:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201183.189482:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695423872 00000100:00100000:3.0:1788201183.189496:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695423872 00000100:00100000:3.0:1788201183.189657:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695423744 00000100:00100000:3.0:1788201183.189662:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695423744 00000100:00100000:3.0:1788201183.189690:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2849 00000100:00100000:3.0:1788201183.189702:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695423872:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201183.189801:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695423872:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 102us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201183.189810:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2849 00000100:00100000:3.0:1788201183.189843:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5919 00000100:00100000:3.0:1788201183.189850:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2399:x1875060695423744:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:3.0:1788201183.189876:0:26205:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1be35 00000100:00080000:3.0:1788201183.189889:0:26205:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f2800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201183.189970:0:26205:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969456 00000100:00100000:3.0:1788201183.190200:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+2:2399:x1875060695423744:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 349us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201183.190208:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5919 00000100:00080000:0.0:1788201183.190306:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201183.190311:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201183.191162:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695423488 00000100:00100000:1.0:1788201183.191176:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695423488 00000100:00100000:1.0:1788201183.191243:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695423616 00000100:00100000:1.0:1788201183.191247:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695423616 00000100:00100000:1.0:1788201183.191305:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1431 00000100:00100000:1.0:1788201183.191316:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2402:x1875060695423616:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201183.191385:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2402:x1875060695423616:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 72us (1981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201183.191392:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1431 00000100:00100000:1.0:1788201183.191413:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1422 00000100:00100000:1.0:1788201183.191418:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695423488:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:1.0:1788201183.191442:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201183.191469:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695423488:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 50us (2190us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201183.191475:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1422 00000100:00080000:0.0:1788201183.191623:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788201183.191974:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201183.567761:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201183.567793:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715231744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201183.567921:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201183.573537:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715231744 00000100:00100000:3.0:1788201183.573558:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715231744 00000100:00100000:3.0:1788201183.573665:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2310 00000100:00100000:3.0:1788201183.573677:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715231744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201183.573720:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788201183.573839:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715231744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 164us (5918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201183.573846:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2310 00000100:00080000:0.0:1788201183.575239:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201183.575742:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715231744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201183.575899:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201183.575916:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1331de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715231872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201183.575996:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201183.577650:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715231872 00000100:00100000:2.0:1788201183.577667:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715231872 00000100:00100000:2.0:1788201183.577766:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2311 00000100:00100000:2.0:1788201183.577776:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715231872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201183.577817:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201183.577920:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715231872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 145us (1924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201183.577949:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2311 00000100:00100000:1.0:1788201183.578138:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1331de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715231872:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788201183.578275:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788201184.018247:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201184.079267:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201184.079276:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201184.079280:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201184.079291:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4030 00000100:00080000:3.0:1788201184.079298:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788201184.079307:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201184.079335:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004eb7800 x1875060715232128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201184.079387:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201184.079391:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201184.079393:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201184.079397:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4030 00000100:00080000:3.0:1788201184.079400:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788201184.079425:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201184.079438:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004eb6680 x1875060715232384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201184.079455:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201184.079458:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201184.079460:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201184.079465:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4030 00000100:00080000:3.0:1788201184.079468:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788201184.079472:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201184.079491:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13ab54e00 x1875060715232640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201184.079502:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201184.079506:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201184.079507:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201184.079511:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4030 00000100:00080000:3.0:1788201184.079514:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788201184.079518:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201184.079529:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13ab54700 x1875060715232768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201184.079575:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715232512:0@lo:400:kworker.0 00000100:00100000:3.0:1788201184.079675:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201184.079734:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201184.079740:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715232256:0@lo:400:kworker.0 00000100:00100000:3.0:1788201184.079766:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201184.080072:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715232128:0@lo:38:kworker.0 00000100:00100000:2.0:1788201184.080110:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201184.080140:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715232384:0@lo:38:kworker.0 00000100:00100000:2.0:1788201184.080162:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201184.080179:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715232640:0@lo:38:kworker.0 00000100:00100000:2.0:1788201184.080208:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201184.080229:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715232768:0@lo:38:kworker.0 00000100:00100000:2.0:1788201184.080253:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201184.080296:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715232640 00000100:00100000:2.0:1788201184.080306:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715232640 00000100:00100000:2.0:1788201184.080353:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4050 00000100:00100000:2.0:1788201184.080362:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715232640:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788201184.080387:0:23728:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201184.080433:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715232640:12345-0@lo:38:kworker.0 Request processed in 70us (223us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201184.080441:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4050 00000100:00100000:2.0:1788201184.080471:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715232512 00000100:00100000:2.0:1788201184.080475:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715232512 00000100:00100000:2.0:1788201184.080520:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715232256 00000100:00100000:2.0:1788201184.080523:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715232256 00000100:00100000:2.0:1788201184.080538:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715232128 00000100:00100000:2.0:1788201184.080540:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715232128 00000100:00100000:2.0:1788201184.080548:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715232384 00000100:00100000:2.0:1788201184.080550:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715232384 00000100:00100000:2.0:1788201184.080557:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715232768 00000100:00100000:2.0:1788201184.080568:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715232768 00000100:00100000:2.0:1788201184.080584:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:2.0:1788201184.080591:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715232512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201184.080642:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715232512:12345-0@lo:400:kworker.0 Request processed in 52us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201184.080648:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00100000:2.0:1788201184.080661:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:2.0:1788201184.080668:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715232256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201184.080696:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715232256:12345-0@lo:400:kworker.0 Request processed in 29us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201184.080702:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:2.0:1788201184.080714:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:2.0:1788201184.080718:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715232128:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788201184.080728:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201184.080752:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715232128:12345-0@lo:38:kworker.0 Request processed in 33us (641us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201184.080759:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00100000:2.0:1788201184.080771:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:2.0:1788201184.080774:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715232384:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788201184.080784:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201184.080806:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715232384:12345-0@lo:38:kworker.0 Request processed in 30us (643us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201184.080822:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:2.0:1788201184.080833:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:2.0:1788201184.080837:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715232768:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788201184.080852:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201184.080872:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715232768:12345-0@lo:38:kworker.0 Request processed in 34us (618us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201184.080877:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00080000:2.0:1788201184.080892:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201184.080932:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715232256:0@lo:400:kworker.0 00000100:00100000:2.0:1788201184.080943:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715232512:0@lo:400:kworker.0 00000100:00080000:2.0:1788201184.080981:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201184.080985:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201184.080989:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715232128:0@lo:38:kworker.0 00000100:00080000:2.0:1788201184.080995:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201184.080998:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201184.081001:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715232384:0@lo:38:kworker.0 00000100:00080000:2.0:1788201184.081008:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201184.081011:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201184.081051:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715232640:0@lo:38:kworker.0 00000100:00080000:2.0:1788201184.081059:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201184.081063:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201184.081065:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715232768:0@lo:38:kworker.0 00000100:00100000:0.0:1788201184.081215:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201184.081229:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715232000:0@lo:400:kworker.0 00000400:00000100:0.0:1788201184.081260:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715232000 offset 0 length 224: 4 00010000:00010000:1.0:1788201185.039925:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201186.063272:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201187.087491:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201188.114221:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201188.312598:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000400:00000100:0.0:1788201188.312626:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695424000 offset 0 length 520: 4 00000100:00100000:0.0:1788201188.312648:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201188.312664:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201188.312734:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695424128 00000100:00100000:2.0:1788201188.312751:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695424128 00000100:00100000:2.0:1788201188.312797:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695424256 00000100:00100000:2.0:1788201188.312805:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695424256 00000100:00100000:2.0:1788201188.312851:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1434 00000100:00100000:2.0:1788201188.312863:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2400:x1875060695424256:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201188.312943:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2400:x1875060695424256:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 84us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201188.312949:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1434 00000100:00100000:2.0:1788201188.312966:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1426 00000100:00100000:2.0:1788201188.312970:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695424128:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:2.0:1788201188.312988:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201188.313007:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695424128:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 36us (358us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201188.313012:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1426 00000100:00080000:2.0:1788201188.313054:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201188.313488:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695424384 00000100:00100000:3.0:1788201188.313493:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695424384 00000100:00100000:3.0:1788201188.313530:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2850 00000100:00100000:3.0:1788201188.313538:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695424384:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201188.313573:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695424384:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 37us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201188.313580:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2850 00000100:00080000:2.0:1788201188.314206:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201188.687399:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201188.687417:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715232896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201188.687484:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201188.687648:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715232896 00000100:00100000:0.0:1788201188.687657:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715232896 00000100:00100000:0.0:1788201188.687722:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2312 00000100:00100000:0.0:1788201188.687741:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715232896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201188.687774:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788201188.687851:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715232896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201188.687857:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2312 00000100:00100000:0.0:1788201188.687910:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715232896:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788201188.687975:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201188.688230:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201188.688241:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715233024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201188.688274:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201188.688355:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715233024 00000100:00100000:2.0:1788201188.688359:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715233024 00000100:00100000:2.0:1788201188.688397:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2313 00000100:00100000:2.0:1788201188.688403:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715233024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201188.688420:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201188.688453:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715233024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201188.688459:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2313 00000100:00080000:1.0:1788201188.688625:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201188.688648:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715233024:0@lo:13:osp-pre-1-1.0 00000001:00100000:0.0:1788201188.698377:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:0.0:1788201188.698388:0:8442:0:(genops.c:885:class_export_put()) final put ffff8dc1257f0800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:2.0:1788201188.698521:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1257f0800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 for lustre-OST0000 00000020:00000080:2.0:1788201188.698568:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1257f2800 for lustre-OST0000 00010000:00010000:2.0:1788201189.137118:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201189.202272:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201189.202280:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201189.202283:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201189.202292:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4035 00000100:00080000:3.0:1788201189.202297:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788201189.202305:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201189.202329:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13ab54e00 x1875060715233280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201189.202354:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201189.202357:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201189.202359:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201189.202362:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4035 00000100:00080000:3.0:1788201189.202365:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788201189.202369:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201189.202379:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc137ceca80 x1875060715233536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201189.202411:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201189.202421:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201189.202423:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201189.202427:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4035 00000100:00080000:3.0:1788201189.202429:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788201189.202433:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201189.202446:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc137ced180 x1875060715233792/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201189.202456:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201189.202458:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201189.202460:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201189.202462:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4035 00000100:00080000:3.0:1788201189.202465:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788201189.202468:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201189.202480:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc137cee680 x1875060715233920/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201189.202506:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715233152:0@lo:400:kworker.0 00000400:00000100:3.0:1788201189.202560:0:3655:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715233152 offset 0 length 224: 4 00000100:00100000:3.0:1788201189.202605:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201189.202611:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715233408:0@lo:400:kworker.0 00000100:00100000:3.0:1788201189.202646:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201189.202675:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715233280:0@lo:38:kworker.0 00000100:00100000:3.0:1788201189.202700:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201189.202718:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715233536:0@lo:38:kworker.0 00000100:00100000:3.0:1788201189.202753:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201189.202779:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715233792:0@lo:38:kworker.0 00000100:00100000:3.0:1788201189.202804:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201189.202821:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715233920:0@lo:38:kworker.0 00000100:00100000:3.0:1788201189.202840:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201189.202872:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715233408 00000100:00100000:3.0:1788201189.202879:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715233408 00000100:00100000:3.0:1788201189.202933:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715233280 00000100:00100000:3.0:1788201189.202937:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715233280 00000100:00100000:3.0:1788201189.202963:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715233536 00000100:00100000:3.0:1788201189.202966:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715233536 00000100:00100000:3.0:1788201189.202974:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715233920 00000100:00100000:3.0:1788201189.202976:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715233920 00000100:00100000:3.0:1788201189.202987:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:3.0:1788201189.202996:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715233408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201189.203081:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715233408:12345-0@lo:400:kworker.0 Request processed in 86us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201189.203088:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00100000:3.0:1788201189.203107:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427 00000100:00100000:3.0:1788201189.203112:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715233280:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788201189.203128:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201189.203160:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715233280:12345-0@lo:38:kworker.0 Request processed in 46us (458us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201189.203166:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1427 00000100:00100000:3.0:1788201189.203179:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:3.0:1788201189.203184:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715233536:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788201189.203193:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201189.203215:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715233536:12345-0@lo:38:kworker.0 Request processed in 31us (462us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201189.203228:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:3.0:1788201189.203239:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:3.0:1788201189.203243:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715233920:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788201189.203252:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201189.203275:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715233920:12345-0@lo:38:kworker.0 Request processed in 30us (434us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201189.203280:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:3.0:1788201189.203303:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715233792 00000100:00100000:3.0:1788201189.203307:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715233792 00000100:00100000:3.0:1788201189.203326:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4051 00000100:00100000:3.0:1788201189.203330:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715233792:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788201189.203339:0:8458:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201189.203364:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715233792:12345-0@lo:38:kworker.0 Request processed in 32us (559us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201189.203369:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4051 00000100:00100000:3.0:1788201189.203423:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715233408:0@lo:400:kworker.0 00000100:00080000:3.0:1788201189.203454:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201189.203458:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201189.203461:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715233280:0@lo:38:kworker.0 00000100:00080000:3.0:1788201189.203469:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201189.203472:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201189.203474:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715233536:0@lo:38:kworker.0 00000100:00080000:3.0:1788201189.203481:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201189.203484:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201189.203494:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715233792:0@lo:38:kworker.0 00000100:00080000:3.0:1788201189.203508:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201189.203510:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201189.203513:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715233920:0@lo:38:kworker.0 00000100:00100000:0.0:1788201189.204617:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201189.204636:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137ceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715233664:0@lo:400:kworker.0 00000100:00100000:0.0:1788201189.204691:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201189.204762:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715233664 00000100:00100000:0.0:1788201189.204768:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715233664 00000100:00100000:0.0:1788201189.204812:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00100000:0.0:1788201189.204820:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715233664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201189.204865:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715233664:12345-0@lo:400:kworker.0 Request processed in 45us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201189.204871:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00100000:0.0:1788201189.204903:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137ceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715233664:0@lo:400:kworker.0 00000100:00080000:0.0:1788201189.207601:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788201190.159281:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1788201190.228862:0:3658:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201173/real 1788201173] req@ffff8dc11d29f800 x1875060715228800/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788201189 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201190.228914:0:3658:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8dc11d29f800 x1875060715228800/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788201189 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201190.228923:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788201190.228927:0:3658:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788201190.255043:0:3658:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.120@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788201190.255048:0:3658:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788201190.255059:0:3658:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc11d29f800 x1875060715228800/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788201189 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201190.255075:0:3658:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc12efc8700 x1875060715230592/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201194 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201190.255096:0:3658:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc004eb5c00 x1875060715232000/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201200 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201190.255108:0:3658:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc13ab54700 x1875060715233152/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201205 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788201190.255122:0:3658:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788201190.255125:0:3658:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788201190.255126:0:3658:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788201190.255128:0:3658:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:3.0:1788201190.255206:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715230592:0@lo:400:kworker.0 00000100:00100000:0.0:1788201190.255791:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715232000:0@lo:400:kworker.0 00000100:00100000:0.0:1788201190.255821:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715228800:0@lo:400:kworker.0 00000100:00080000:0.0:1788201190.255847:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201190.255852:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788201190.255855:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201190.255860:0:93109:0:(import.c:510:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 3988 00000100:00080000:0.0:1788201190.255868:0:93109:0:(import.c:624:import_select_connection()) MGC192.168.201.120@tcp: import ffff8dc104280800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201190.255903:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13f8d8000 x1875060715234048/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201190.255961:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715234048:0@lo:250:kworker.0 00000400:00000100:3.0:1788201190.256006:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715234048 offset 0 length 520: 4 00000100:00080000:0.0:1788201190.256211:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201190.256215:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201190.256217:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201190.256221:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4040 00000100:00080000:0.0:1788201190.256224:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201190.256228:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201190.256246:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13f8d8e00 x1875060715234176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201190.256532:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715233152:0@lo:400:kworker.0 00000100:00100000:3.0:1788201190.259719:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715234176:0@lo:38:kworker.0 00000100:00100000:3.0:1788201190.259798:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201190.260235:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715234176 00000100:00100000:1.0:1788201190.260245:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715234176 00000100:00100000:1.0:1788201190.260291:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:1.0:1788201190.260299:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715234176:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201190.260323:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201190.260376:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715234176:12345-0@lo:38:kworker.0 Request processed in 77us (578us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201190.260390:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00080000:1.0:1788201190.260436:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201190.260441:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201190.260445:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715234176:0@lo:38:kworker.0 00000100:00080000:0.0:1788201190.262772:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201190.262779:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201190.262782:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201190.262790:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4040 00000100:00080000:0.0:1788201190.262794:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201190.262800:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201190.262838:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13f8d9180 x1875060715234432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201190.263246:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715234432:0@lo:38:kworker.0 00000100:00100000:1.0:1788201190.263314:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788201190.263415:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201190.263419:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201190.263422:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201190.263426:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4040 00000100:00080000:0.0:1788201190.263429:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201190.263435:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201190.263461:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11d29f800 x1875060715234688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201190.263611:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201190.263614:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201190.263616:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201190.263620:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4040 00000100:00080000:0.0:1788201190.263623:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201190.263627:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201190.263639:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efe0700 x1875060715235072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201190.263667:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715234432 00000100:00100000:0.0:1788201190.263674:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715234432 00000100:00100000:0.0:1788201190.263719:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00000100:00100000:0.0:1788201190.263726:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715234432:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201190.263745:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201190.263789:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715234432:12345-0@lo:38:kworker.0 Request processed in 61us (474us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201190.263796:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00100000:0.0:1788201190.263824:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715234944:0@lo:400:kworker.0 00000100:00100000:0.0:1788201190.263855:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201190.263879:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201190.263885:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715234304:0@lo:400:kworker.0 00000100:00100000:1.0:1788201190.264245:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715234688:0@lo:38:kworker.0 00000100:00100000:1.0:1788201190.264277:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201190.264298:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715235072:0@lo:38:kworker.0 00000100:00100000:1.0:1788201190.264321:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201190.264353:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201190.264358:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201190.264362:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715234432:0@lo:38:kworker.0 00000100:00100000:1.0:1788201190.264392:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715234688 00000100:00100000:1.0:1788201190.264396:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715234688 00000100:00100000:1.0:1788201190.264423:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4052 00000100:00100000:1.0:1788201190.264429:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715234688:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201190.264441:0:23728:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201190.264483:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715234688:12345-0@lo:38:kworker.0 Request processed in 53us (205us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201190.264490:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4052 00000100:00080000:1.0:1788201190.264520:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201190.264524:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201190.264527:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715234688:0@lo:38:kworker.0 00000100:00100000:3.0:1788201190.264653:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715234816:0@lo:400:kworker.0 00000100:00100000:3.0:1788201190.264685:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201190.264726:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201190.264733:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715234560:0@lo:400:kworker.0 00000100:00100000:3.0:1788201190.264755:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201190.265607:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201190.265645:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715234944 00000100:00100000:0.0:1788201190.265650:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715234944 00000100:00100000:0.0:1788201190.265700:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715234816 00000100:00100000:0.0:1788201190.265714:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715234816 00000100:00100000:0.0:1788201190.265740:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2851 00000100:00100000:0.0:1788201190.265748:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715234944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201190.265795:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715234944:12345-0@lo:400:kworker.0 Request processed in 48us (1939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201190.265802:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2851 00000100:00100000:0.0:1788201190.265816:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2852 00000100:00100000:0.0:1788201190.265822:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715234816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201190.265856:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715234816:12345-0@lo:400:kworker.0 Request processed in 34us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201190.265863:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2852 00000100:00100000:0.0:1788201190.265882:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715235072 00000100:00100000:0.0:1788201190.265886:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715235072 00000100:00100000:0.0:1788201190.265902:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715234560 00000100:00100000:0.0:1788201190.265905:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715234560 00000100:00100000:0.0:1788201190.265922:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715234304 00000100:00100000:0.0:1788201190.265925:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715234304 00000100:00100000:0.0:1788201190.265937:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:0.0:1788201190.265942:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715234560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201190.265974:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715234560:12345-0@lo:400:kworker.0 Request processed in 31us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201190.265980:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:0.0:1788201190.265992:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:0.0:1788201190.265998:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715234304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201190.268824:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:1.0:1788201190.268839:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715235072:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201190.268866:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201190.268953:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715235072:12345-0@lo:38:kworker.0 Request processed in 113us (4629us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201190.268961:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00080000:1.0:1788201190.269030:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201190.269036:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201190.269228:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715234304:12345-0@lo:400:kworker.0 Request processed in 3227us (3621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201190.269248:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00080000:0.0:1788201190.269273:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201190.269279:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201190.269319:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715234560:0@lo:400:kworker.0 00000100:00100000:0.0:1788201190.269334:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715234816:0@lo:400:kworker.0 00000100:00100000:0.0:1788201190.269397:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715234304:0@lo:400:kworker.0 00000100:00100000:0.0:1788201190.269410:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715234944:0@lo:400:kworker.0 00000100:00100000:1.0:1788201190.269569:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715235072:0@lo:38:kworker.0 00010000:00010000:2.0:1788201191.184127:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201192.213641:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201193.235867:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201193.428010:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201193.428077:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201193.428170:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201193.428207:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695424640 00000100:00100000:1.0:1788201193.428220:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695424640 00000100:00100000:1.0:1788201193.428296:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695424512 00000100:00100000:1.0:1788201193.428300:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695424512 00000100:00100000:1.0:1788201193.428326:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1439 00000100:00100000:1.0:1788201193.428339:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2401:x1875060695424640:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201193.428451:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2401:x1875060695424640:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 103us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201193.428460:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1439 00000100:00100000:1.0:1788201193.428484:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1433 00000100:00100000:1.0:1788201193.428488:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695424512:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:1.0:1788201193.428514:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201193.428560:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695424512:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 69us (483us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201193.428567:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1433 00000100:00100000:1.0:1788201193.428591:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695424768 00000100:00100000:1.0:1788201193.428595:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695424768 00000100:00100000:1.0:1788201193.428629:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5920 00000100:00100000:1.0:1788201193.428636:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2399:x1875060695424768:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:1.0:1788201193.428672:0:26202:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c391 00000100:00080000:1.0:1788201193.428683:0:26202:0:(import.c:65:import_set_state_nolock()) ffff8dc110778000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788201193.428741:0:26202:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969456 00000100:00100000:1.0:1788201193.428881:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+2:2399:x1875060695424768:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 243us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201193.428888:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5920 00000100:00080000:1.0:1788201193.428907:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201193.428912:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788201193.428936:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201193.807288:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715235200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201193.807391:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201193.807452:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715235328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201193.807477:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201193.807560:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715235200 00000100:00100000:2.0:1788201193.807570:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715235200 00000100:00100000:2.0:1788201193.807658:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715235328 00000100:00100000:2.0:1788201193.807661:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715235328 00000100:00100000:2.0:1788201193.807691:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2314 00000100:00100000:2.0:1788201193.807703:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715235200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201193.807738:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788201193.807807:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715235200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201193.807815:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2314 00000100:00100000:2.0:1788201193.807834:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2315 00000100:00100000:2.0:1788201193.807841:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715235328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201193.807857:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201193.807885:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715235328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201193.807891:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2315 00000100:00100000:2.0:1788201193.807953:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715235200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201193.807967:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715235328:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788201193.809563:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201193.809575:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788201194.258948:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201195.279492:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201195.345342:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201195.345350:0:57134:0:(pinger.c:247:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201195.345353:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201195.345356:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201195.345361:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201195.345369:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4041 00000100:00080000:0.0:1788201195.345373:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201195.345390:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201195.345426:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc118141f80 x1875060715235456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201195.345478:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201195.345481:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201195.345482:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201195.345485:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4041 00000100:00080000:0.0:1788201195.345487:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201195.345500:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201195.345513:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efe1500 x1875060715235712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201195.345528:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201195.345530:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201195.345532:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201195.345536:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4041 00000100:00080000:0.0:1788201195.345538:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201195.345541:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201195.345554:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc1060ce300 x1875060715235968/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201195.345583:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201195.345586:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201195.345587:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201195.345590:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4041 00000100:00080000:0.0:1788201195.345592:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201195.345596:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201195.345606:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc1060cd500 x1875060715236352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201195.345643:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715235840:0@lo:400:kworker.0 00000100:00100000:1.0:1788201195.345819:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715235456:0@lo:38:kworker.0 00000100:00100000:1.0:1788201195.345887:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201195.345943:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715235712:0@lo:38:kworker.0 00000100:00100000:1.0:1788201195.345968:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201195.345984:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715235968:0@lo:38:kworker.0 00000100:00100000:1.0:1788201195.346006:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201195.346042:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715236352:0@lo:38:kworker.0 00000100:00100000:1.0:1788201195.346062:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201195.346098:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715235456 00000100:00100000:1.0:1788201195.346105:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715235456 00000100:00100000:1.0:1788201195.346132:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715235712 00000100:00100000:1.0:1788201195.346135:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715235712 00000100:00100000:1.0:1788201195.346145:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715236352 00000100:00100000:1.0:1788201195.346147:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715236352 00000100:00100000:1.0:1788201195.346158:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434 00000100:00100000:1.0:1788201195.346166:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715235456:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201195.346186:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201195.346241:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715235456:12345-0@lo:38:kworker.0 Request processed in 74us (354us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201195.346249:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434 00000100:00100000:1.0:1788201195.346268:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:1.0:1788201195.346273:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715235712:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201195.346282:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201195.346305:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715235712:12345-0@lo:38:kworker.0 Request processed in 31us (336us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201195.346311:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00100000:1.0:1788201195.346322:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00100000:1.0:1788201195.346326:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715236352:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201195.346344:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201195.346366:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715236352:12345-0@lo:38:kworker.0 Request processed in 39us (303us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201195.346372:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00080000:1.0:1788201195.346899:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201195.346905:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201195.346909:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715235456:0@lo:38:kworker.0 00000100:00080000:1.0:1788201195.346982:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201195.346986:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201195.346990:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715235712:0@lo:38:kworker.0 00000100:00080000:1.0:1788201195.347001:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201195.347004:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201195.347007:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715236352:0@lo:38:kworker.0 00000100:00100000:0.0:1788201195.347141:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201195.347177:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201195.347184:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715235584:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.347263:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201195.347299:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715236096:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.347326:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201195.347344:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201195.347349:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715236224:0@lo:400:kworker.0 00000100:00100000:0.0:1788201195.347369:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201195.347545:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715235968 00000100:00100000:3.0:1788201195.347551:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715235968 00000100:00100000:3.0:1788201195.347588:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4053 00000100:00100000:3.0:1788201195.347594:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715235968:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788201195.347610:0:8458:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201195.347669:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715235968:12345-0@lo:38:kworker.0 Request processed in 73us (1661us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201195.347675:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4053 00000100:00100000:3.0:1788201195.347696:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715235840 00000100:00100000:3.0:1788201195.347705:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715235840 00000100:00100000:3.0:1788201195.347746:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715235584 00000100:00100000:3.0:1788201195.347750:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715235584 00000100:00100000:3.0:1788201195.347769:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:3.0:1788201195.347776:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715235840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201195.347817:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715235840:12345-0@lo:400:kworker.0 Request processed in 42us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201195.347824:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000100:00100000:3.0:1788201195.347836:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:3.0:1788201195.347841:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715235584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201195.347867:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715235584:12345-0@lo:400:kworker.0 Request processed in 26us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201195.347873:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00100000:3.0:1788201195.347891:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715236096 00000100:00100000:3.0:1788201195.347894:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715236096 00000100:00100000:3.0:1788201195.347920:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715236224 00000100:00100000:3.0:1788201195.348125:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715236224 00000100:00100000:3.0:1788201195.348152:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2853 00000100:00100000:3.0:1788201195.348158:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715236096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201195.348196:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715236096:12345-0@lo:400:kworker.0 Request processed in 37us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201195.348265:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2853 00000100:00100000:3.0:1788201195.348280:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2854 00000100:00100000:3.0:1788201195.348287:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715236224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201195.348316:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715236224:12345-0@lo:400:kworker.0 Request processed in 29us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201195.348322:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2854 00000100:00080000:3.0:1788201195.348347:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201195.348351:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201195.348354:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201195.348453:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715236224:0@lo:400:kworker.0 00000100:00100000:3.0:1788201195.348466:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715236096:0@lo:400:kworker.0 00000100:00100000:3.0:1788201195.348498:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715235584:0@lo:400:kworker.0 00000100:00100000:3.0:1788201195.348508:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715235840:0@lo:400:kworker.0 00000100:00080000:3.0:1788201195.348532:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201195.348537:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201195.348540:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715235968:0@lo:38:kworker.0 00000020:01000004:0.0:1788201195.886825:0:94456:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788201195.886831:0:94456:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788201195.886832:0:94456:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788201195.886959:0:94456:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dc11d438000 00000020:01000004:0.0:1788201195.886972:0:94456:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788201195.886985:0:94456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788201195.887000:0:94456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8dc0040419b8) 00000020:00000080:0.0:1788201195.887059:0:94456:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788201195.989738:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788201195.992090:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788201195.992892:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788201195.993345:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788201195.993644:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788201195.993854:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788201195.994075:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788201195.994363:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788201195.994598:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788201195.994793:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788201195.994979:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788201195.995415:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788201195.995599:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788201195.995787:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788201195.999482:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788201196.000471:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788201196.000669:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788201196.000892:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788201196.001109:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788201196.001376:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788201196.001598:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788201196.001831:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788201196.002532:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788201196.002789:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788201196.002978:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788201196.003342:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788201196.003562:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788201196.003790:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788201196.004004:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788201196.004334:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788201196.004569:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788201196.004826:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788201196.005103:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788201196.005382:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788201196.005613:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788201196.005789:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788201196.005961:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788201196.006308:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788201196.006526:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788201196.006742:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788201196.006950:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788201196.007309:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788201196.007512:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788201196.007703:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788201196.007878:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788201196.008085:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788201196.008350:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788201196.009247:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788201196.009656:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788201196.009861:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788201196.010339:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788201196.010623:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788201196.010839:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1788201196.010895:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00100000:10000000:3.0:1788201196.010927:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00100000:10000000:3.0:1788201196.010969:0:94456:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x53:0x0] (8/32) registered 00080000:01000000:3.0:1788201196.011628:0:94456:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788201196.011836:0:94456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788201196.011845:0:94456:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788201196.011856:0:94456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1c4b7 00000020:01000004:3.0:1788201196.011862:0:94456:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788201196.011875:0:94456:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788201196.011881:0:94456:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dc11d438000 from MGS 00000020:01000004:3.0:1788201196.011884:0:94456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788201196.011894:0:94456:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8dc1060e3370) 00000020:00000080:3.0:1788201196.011904:0:94456:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:3.0:1788201196.011964:0:94456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc11d438000 from MGS, refs=2 00080000:01000000:3.0:1788201196.011969:0:94456:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788201196.011974:0:94456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1c4c5 00010000:00010000:3.0:1788201196.012391:0:94456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1788201196.016594:0:94456:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788201196.017646:0:94460:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788201196.017690:0:94456:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788201196.017722:0:94456:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788201196.018376:0:94456:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788201196.018633:0:94456:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788201196.018779:0:94456:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788201196.018785:0:94456:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788201196.026395:0:94456:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788201196.026408:0:94456:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788201196.026784:0:94456:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788201196.026791:0:94456:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788201196.027231:0:94456:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788201196.027254:0:94456:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1788201196.027256:0:94456:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.120@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1788201196.027259:0:94456:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.120@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1788201196.027265:0:94456:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8dc104280800 already not connected (conn 75, was 0): CONNECTING 00000100:00100000:1.0:1788201196.027270:0:94456:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00010000:00010000:0.0:1788201196.303243:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201197.327268:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201198.351220:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201198.550541:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201198.554788:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201198.554896:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201198.555039:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695425024 00000100:00100000:2.0:1788201198.555051:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695425024 00000100:00100000:2.0:1788201198.555089:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695425152 00000100:00100000:2.0:1788201198.555092:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695425152 00000100:00100000:2.0:1788201198.555135:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1442 00000100:00100000:2.0:1788201198.555145:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2403:x1875060695425152:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201198.555219:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2403:x1875060695425152:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 76us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201198.555228:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1442 00000100:00100000:2.0:1788201198.555246:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1437 00000100:00100000:2.0:1788201198.555251:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695425024:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:2.0:1788201198.555273:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201198.555298:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695425024:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 45us (522us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201198.555321:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1437 00000100:00080000:3.0:1788201198.557588:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201198.559226:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695424896 00000100:00100000:0.0:1788201198.559241:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695424896 00000100:00100000:0.0:1788201198.559303:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:0.0:1788201198.559311:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2399:x1875060695424896:12345-192.168.201.20@tcp:250:kworker.0 00010000:00080000:0.0:1788201198.559337:0:94461:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 93ba7067-43b5-4e46-8db7-27c040fa03d9@192.168.201.20@tcp t0 exp 0000000000000000 cur 4050 last 0 00000020:00000080:0.0:1788201198.559368:0:94461:0:(genops.c:1385:class_connect()) connect: client 93ba7067-43b5-4e46-8db7-27c040fa03d9, cookie 0x96d0c9b8c9a1c4cc 00000100:00080000:0.0:1788201198.559522:0:94461:0:(import.c:65:import_set_state_nolock()) ffff8dc103487000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201198.559609:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+5:2399:x1875060695424896:12345-192.168.201.20@tcp:250:kworker.0 Request processed in 297us (9079us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201198.559616:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:1.0:1788201198.929867:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201198.929890:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715236480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201198.929969:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201198.930073:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715236608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201198.930098:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201198.930360:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715236480 00000100:00100000:2.0:1788201198.930369:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715236480 00000100:00080000:3.0:1788201198.930474:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201198.930509:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715236608 00000100:00100000:0.0:1788201198.930514:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715236608 00000100:00100000:0.0:1788201198.930574:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2316 00000100:00100000:0.0:1788201198.930585:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715236480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201198.930631:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201198.930684:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715236480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201198.930691:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2316 00000100:00100000:0.0:1788201198.930710:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2317 00000100:00100000:0.0:1788201198.930717:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715236608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201198.930731:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788201198.930758:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715236608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201198.930765:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2317 00000100:00100000:0.0:1788201198.930805:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715236608:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201198.930820:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715236480:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788201198.931159:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788201199.375708:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788201199.447813:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:0.0:1788201199.447828:0:9526:0:(genops.c:885:class_export_put()) final put ffff8dc110779800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:2.0:1788201199.450505:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110779800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 for lustre-OST0001 00000020:00000080:2.0:1788201199.451008:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc110778000 for lustre-OST0001 00000100:00100000:3.0:1788201199.895467:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201199.900410:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695425280 00000100:00100000:0.0:1788201199.900425:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695425280 00000100:00100000:0.0:1788201199.900581:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1 00000100:00100000:0.0:1788201199.900592:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+5:71021:x1875060695425280:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201199.900612:0:94464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201199.900636:0:94464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1c4d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78690c expref: -99 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201199.900665:0:94464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1c4d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78690c expref: 6 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201199.900677:0:94464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1c4d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78690c expref: 6 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201199.900702:0:94464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782c400, rc 0) 00000100:00100000:0.0:1788201199.900774:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+6:71021:x1875060695425280:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 183us (5318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201199.900781:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1 00000100:00100000:2.0:1788201199.916896:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201199.918896:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695425408 00000100:00100000:1.0:1788201199.918911:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695425408 00000100:00100000:1.0:1788201199.918978:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:1.0:1788201199.918988:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+6:71021:x1875060695425408:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788201199.919460:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+6:71021:x1875060695425408:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 Request processed in 471us (2580us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201199.919470:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:3.0:1788201199.954865:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201199.955010:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695425536 00000100:00100000:0.0:1788201199.955036:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695425536 00000100:00100000:0.0:1788201199.955091:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:0.0:1788201199.955101:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+6:71021:x1875060695425536:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201199.955118:0:94464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201199.955135:0:94464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782c200/0x96d0c9b8c9a1c4da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786913 expref: -99 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201199.955163:0:94464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782c200/0x96d0c9b8c9a1c4da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786913 expref: 7 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201199.955174:0:94464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782c200/0x96d0c9b8c9a1c4da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786913 expref: 7 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201199.955184:0:94464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782c200, rc 0) 00000100:00100000:0.0:1788201199.955244:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+7:71021:x1875060695425536:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 144us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201199.955251:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:3.0:1788201199.958719:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201199.960634:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695425664 00000100:00100000:1.0:1788201199.960651:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695425664 00000100:00100000:1.0:1788201199.960770:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:1.0:1788201199.960781:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+7:71021:x1875060695425664:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788201199.964595:0:94465:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788201199.964754:0:94463:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 123 20000000:01000000:1.0:1788201199.965958:0:94466:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788201199.965962:0:94466:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1788201199.965965:0:94466:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788201199.965966:0:94466:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788201199.965977:0:94466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 20000000:01000000:2.0:1788201199.966095:0:94463:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788201199.966238:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71021:x1875060695425664:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 5453us (7523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201199.966255:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:2.0:1788201199.972676:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201199.972796:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695425792 00000100:00100000:3.0:1788201199.972808:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695425792 00000100:00100000:3.0:1788201199.972866:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:3.0:1788201199.972887:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71021:x1875060695425792:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201199.973080:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71021:x1875060695425792:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 204us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201199.973089:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:3.0:1788201199.990708:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201199.990871:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695425920 00000100:00100000:2.0:1788201199.990883:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695425920 00000100:00100000:2.0:1788201199.990948:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:2.0:1788201199.990958:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71021:x1875060695425920:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201199.990975:0:94463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201199.990998:0:94463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007adec00/0x96d0c9b8c9a1c4e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78691a expref: -99 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201199.991053:0:94463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007adec00/0x96d0c9b8c9a1c4e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78691a expref: 9 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201199.991065:0:94463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007adec00/0x96d0c9b8c9a1c4e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78691a expref: 9 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201199.991073:0:94463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007adec00, rc 0) 00000100:00100000:2.0:1788201199.991143:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695425920:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 187us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201199.991167:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:2.0:1788201199.996807:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201199.996961:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695426048 00000100:00100000:0.0:1788201199.996970:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695426048 00000100:00100000:0.0:1788201199.997060:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:0.0:1788201199.997071:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695426048:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201199.997267:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695426048:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 196us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201199.997276:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:0.0:1788201199.999939:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201200.000060:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695426176 00000100:00100000:3.0:1788201200.000070:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695426176 00000100:00100000:3.0:1788201200.000117:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:3.0:1788201200.000128:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695426176:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201200.000275:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695426176:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 148us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201200.000283:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:3.0:1788201200.006965:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201200.008226:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695426304 00000100:00100000:2.0:1788201200.008239:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695426304 00000100:00100000:2.0:1788201200.008305:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:2.0:1788201200.008316:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695426304:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201200.008332:0:94463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201200.008350:0:94463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1c4e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786921 expref: -99 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.008381:0:94463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1c4e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786921 expref: 10 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.008393:0:94463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1c4e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786921 expref: 10 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.008402:0:94463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007adf200, rc 0) 00000100:00100000:2.0:1788201200.008469:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695426304:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 155us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.008476:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:2.0:1788201200.010986:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201200.011179:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695426432 00000100:00100000:0.0:1788201200.011188:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695426432 00000100:00100000:0.0:1788201200.011292:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:0.0:1788201200.011314:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695426432:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201200.011429:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695426432:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 126us (451us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201200.011438:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 10 00010000:00010000:0.0:1788201200.399515:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201200.463285:0:3654:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201190/real 1788201190] req@ffff8dc13f8d8000 x1875060715234048/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788201200 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201200.463329:0:3654:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dc13f8d8000 x1875060715234048/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788201200 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201200.463349:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201200.467250:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201200.467259:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201200.467263:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201200.467272:0:57134:0:(import.c:510:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 4041 00000100:00080000:3.0:1788201200.467278:0:57134:0:(import.c:589:import_select_connection()) MGC192.168.201.120@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201200.467286:0:57134:0:(import.c:624:import_select_connection()) MGC192.168.201.120@tcp: import ffff8dc104280800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201200.467389:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc137ceed80 x1875060715236736/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201200.467469:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201200.467475:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201200.467477:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201200.467481:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4046 00000100:00080000:3.0:1788201200.467484:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201200.467504:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201200.467523:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efc8700 x1875060715236864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201200.467640:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715236992:0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.467715:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201200.467812:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715236992 00000100:00100000:2.0:1788201200.467821:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715236992 00000100:00100000:2.0:1788201200.467891:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1443 00000100:00100000:2.0:1788201200.467903:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715236992:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788201200.468002:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788201200.468012:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715234048:0@lo:250:kworker.0 00000100:00020000:0.0:1788201200.468050:0:3654:0:(client.c:1404:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff8dc137ceed80 x1875060715236736/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201200.471805:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201200.471816:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201200.471819:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201200.471827:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4046 00000100:00080000:3.0:1788201200.471842:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201200.471850:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201200.471889:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13ab54e00 x1875060715237120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201200.476113:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715236992:12345-0@lo:400:kworker.0 Request processed in 8202us (8387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.476150:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1443 00000100:00080000:2.0:1788201200.476227:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201200.476262:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715237248:0@lo:400:kworker.0 00000100:00100000:2.0:1788201200.476334:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1788201200.476395:0:94456:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1788201200.476412:0:94456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec000/0x96d0c9b8c9a1bdc5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1bdcc expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201200.476423:0:94456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec000/0x96d0c9b8c9a1bdc5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1bdcc expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201200.476429:0:94456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788201200.476441:0:94456:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201200.476451:0:94456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec000/0x96d0c9b8c9a1bdc5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1bdcc expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.476469:0:94456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c1ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1c1d1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201200.476476:0:94456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c1ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1c1d1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201200.476481:0:94456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201200.476485:0:94456:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201200.476488:0:94456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c1ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1c1d1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.476496:0:94456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc00782c000/0x96d0c9b8c9a1c1d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1c1df expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201200.476513:0:94456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782c000/0x96d0c9b8c9a1c1d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1c1df expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201200.476518:0:94456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201200.476522:0:94456:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201200.476535:0:94456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc00782c000/0x96d0c9b8c9a1c1d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1c1df expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.476545:0:94456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2c00/0x96d0c9b8c9a1c1e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1c1ed expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201200.476551:0:94456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2c00/0x96d0c9b8c9a1c1e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1c1ed expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201200.476557:0:94456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201200.476560:0:94456:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201200.476563:0:94456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2c00/0x96d0c9b8c9a1c1e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1c1ed expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.476572:0:94456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007ade800/0x96d0c9b8c9a1c1f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1c1fb expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201200.476578:0:94456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007ade800/0x96d0c9b8c9a1c1f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1c1fb expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201200.476583:0:94456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201200.476586:0:94456:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201200.476589:0:94456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007ade800/0x96d0c9b8c9a1c1f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1c1fb expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.476609:0:94456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2e00/0x96d0c9b8c9a1c202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1c209 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201200.476615:0:94456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2e00/0x96d0c9b8c9a1c202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1c209 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201200.476620:0:94456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201200.476623:0:94456:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201200.476626:0:94456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2e00/0x96d0c9b8c9a1c202 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1c209 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.476634:0:94456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec600/0x96d0c9b8c9a1c210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1c217 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201200.476639:0:94456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec600/0x96d0c9b8c9a1c210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1c217 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201200.476643:0:94456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201200.476647:0:94456:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201200.476650:0:94456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec600/0x96d0c9b8c9a1c210 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1c217 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.476657:0:94456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c21e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1c225 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201200.476662:0:94456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c21e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1c225 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201200.476667:0:94456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201200.476676:0:94456:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201200.476680:0:94456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c21e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1c225 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.476691:0:94456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064ece00/0x96d0c9b8c9a1bd39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1bd40 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201200.476698:0:94456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ece00/0x96d0c9b8c9a1bd39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1bd40 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201200.476703:0:94456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201200.476706:0:94456:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201200.476709:0:94456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064ece00/0x96d0c9b8c9a1bd39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1bd40 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.476720:0:94456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1bd55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1bd5c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201200.476726:0:94456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1bd55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1bd5c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201200.476731:0:94456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201200.476733:0:94456:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201200.476737:0:94456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed000/0x96d0c9b8c9a1bd55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1bd5c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.476749:0:94456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1bd63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1bd6a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201200.476755:0:94456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1bd63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1bd6a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201200.476770:0:94456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788201200.476774:0:94456:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201200.476778:0:94456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1bd63 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1bd6a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.476787:0:94456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc005da7600/0x96d0c9b8c9a1bd8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1bd94 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201200.476793:0:94456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc005da7600/0x96d0c9b8c9a1bd8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1bd94 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201200.476798:0:94456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788201200.476801:0:94456:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201200.476805:0:94456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc005da7600/0x96d0c9b8c9a1bd8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1bd94 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.476813:0:94456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc005da6800/0x96d0c9b8c9a1bdb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1bdbe expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201200.476819:0:94456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc005da6800/0x96d0c9b8c9a1bdb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1bdbe expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201200.476824:0:94456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788201200.476827:0:94456:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201200.476830:0:94456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc005da6800/0x96d0c9b8c9a1bdb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1bdbe expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788201200.476956:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201200.476961:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201200.476964:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201200.476970:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4046 00000100:00080000:3.0:1788201200.476974:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201200.476979:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201200.477025:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc120093480 x1875060715237376/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201200.477069:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715237504:0@lo:400:kworker.0 00000100:00100000:3.0:1788201200.477107:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788201200.477159:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201200.477163:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201200.477164:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201200.477175:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4046 00000100:00080000:3.0:1788201200.477178:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201200.477182:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201200.477190:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201200.477198:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715237632:0@lo:400:kworker.0 00000100:00100000:3.0:1788201200.477223:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201200.477259:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc120092d80 x1875060715237760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201200.483089:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715236992:0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.483189:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715237248 00000100:00100000:1.0:1788201200.483197:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715237248 00000100:00100000:1.0:1788201200.483276:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444 00000100:00100000:1.0:1788201200.483285:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715237248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.483378:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715237248:12345-0@lo:400:kworker.0 Request processed in 94us (7043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201200.483385:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444 00000100:00100000:1.0:1788201200.483413:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715237504 00000100:00100000:1.0:1788201200.483417:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715237504 00000100:00100000:1.0:1788201200.483443:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715237632 00000100:00100000:1.0:1788201200.483446:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715237632 00000100:00100000:1.0:1788201200.483475:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2855 00000100:00100000:1.0:1788201200.483482:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715237504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.483523:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715237504:12345-0@lo:400:kworker.0 Request processed in 41us (6416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201200.483916:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2855 00000100:00100000:1.0:1788201200.483932:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2856 00000100:00100000:1.0:1788201200.483940:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715237632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201200.483974:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715237632:12345-0@lo:400:kworker.0 Request processed in 36us (6750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201200.483980:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2856 00000100:00100000:1.0:1788201200.484984:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715237248:0@lo:400:kworker.0 00000100:00080000:1.0:1788201200.485149:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201200.485154:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201200.485157:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201200.501549:0:94456:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8dc104280800 already not connected (conn 76, was 0): CONNECTING 00000100:00080000:2.0:1788201200.501561:0:94456:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:2.0:1788201200.501665:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715237632:0@lo:400:kworker.0 00000100:00100000:2.0:1788201200.501681:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715237504:0@lo:400:kworker.0 00000100:00080000:3.0:1788201200.501760:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201200.501766:0:57134:0:(pinger.c:247:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201200.505443:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201200.505746:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:0.0:1788201200.505807:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137ceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:0:1875060715236736:0@lo:250:kworker.0 00000100:00080000:2.0:1788201200.506150:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201200.506156:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788201200.506159:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201200.506164:0:57134:0:(import.c:510:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 4051 00000100:00080000:2.0:1788201200.506169:0:57134:0:(import.c:589:import_select_connection()) MGC192.168.201.120@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788201200.506176:0:57134:0:(import.c:624:import_select_connection()) MGC192.168.201.120@tcp: import ffff8dc104280800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201200.506210:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11cc28700 x1875060715237888/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201200.510614:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715236864:0@lo:38:kworker.0 00000100:00100000:0.0:1788201200.510705:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201200.510761:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715237120:0@lo:38:kworker.0 00000100:00100000:0.0:1788201200.510785:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201200.510812:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715237376:0@lo:38:kworker.0 00000100:00100000:0.0:1788201200.510849:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201200.510886:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715237376 00000100:00100000:0.0:1788201200.510894:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715237376 00000100:00100000:0.0:1788201200.510933:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4054 00000100:00100000:0.0:1788201200.510940:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715237376:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201200.510962:0:23728:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201200.511000:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715237376:12345-0@lo:38:kworker.0 Request processed in 59us (150us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201200.511939:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715236864 00000100:00100000:2.0:1788201200.511948:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715236864 00000100:00100000:2.0:1788201200.511979:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715237120 00000100:00100000:2.0:1788201200.511983:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715237120 00000100:00100000:2.0:1788201200.512034:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:2.0:1788201200.512041:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715236864:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788201200.512057:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201200.512104:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715236864:12345-0@lo:38:kworker.0 Request processed in 63us (1400us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201200.512112:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00100000:2.0:1788201200.512128:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:2.0:1788201200.512132:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715237120:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788201200.512143:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201200.512169:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715237120:12345-0@lo:38:kworker.0 Request processed in 35us (1383us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201200.512193:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00080000:2.0:1788201200.512260:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201200.512266:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201200.512270:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715237376:0@lo:38:kworker.0 00000100:00100000:2.0:1788201200.512278:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715237760:0@lo:38:kworker.0 00000100:00100000:2.0:1788201200.512326:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201200.512349:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715237888:0@lo:250:kworker.0 00000100:00100000:2.0:1788201200.512376:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788201200.512408:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201200.512413:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201200.512416:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715236864:0@lo:38:kworker.0 00000100:00080000:2.0:1788201200.512443:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201200.512447:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201200.512451:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715237120:0@lo:38:kworker.0 00000100:00100000:2.0:1788201200.512473:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715237888 00000100:00100000:2.0:1788201200.512477:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715237888 00000100:00100000:2.0:1788201200.512497:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201200.512501:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3654:x1875060715237888:12345-0@lo:250:kworker.0 00010000:00080000:2.0:1788201200.512518:0:94463:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c9b18af6-fecc-4172-82c2-66531890fe11@0@lo t0 exp 0000000000000000 cur 4051 last 0 00000020:00000080:2.0:1788201200.512556:0:94463:0:(genops.c:1385:class_connect()) connect: client c9b18af6-fecc-4172-82c2-66531890fe11, cookie 0x96d0c9b8c9a1c4ef 00000100:00080000:2.0:1788201200.512700:0:94463:0:(import.c:65:import_set_state_nolock()) ffff8dc110732000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201200.512746:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+5:3654:x1875060715237888:12345-0@lo:250:kworker.0 Request processed in 242us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.512753:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201200.512794:0:3654:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.120@tcp: committing for last_committed 0 gen 29 00000100:00080000:2.0:1788201200.512802:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.120@tcp: connect to target with instance 0 00000100:00080000:2.0:1788201200.512808:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788201200.512813:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788201200.512815:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788201200.512817:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788201200.512848:0:3654:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788201200.513052:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715237760 00000100:00100000:3.0:1788201200.513058:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715237760 00000100:00100000:3.0:1788201200.513084:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:3.0:1788201200.513089:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715237760:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788201200.513102:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201200.513133:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715237760:12345-0@lo:38:kworker.0 Request processed in 43us (807us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201200.513140:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000020:01000000:3.0:1788201200.513190:0:57134:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.201.120@tcp 10000000:01000000:3.0:1788201200.513207:0:57134:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1788201200.513210:0:57134:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788201200.513212:0:57134:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201200.513213:0:57134:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201200.513214:0:57134:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201200.513215:0:57134:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201200.513216:0:57134:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201200.513218:0:57134:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201200.513220:0:57134:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201200.513221:0:57134:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788201200.513265:0:57134:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1788201200.513272:0:57134:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1788201200.513274:0:57134:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788201200.513275:0:57134:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788201200.513276:0:57134:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201200.513277:0:57134:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201200.513279:0:57134:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201200.513280:0:57134:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201200.513281:0:57134:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201200.513282:0:57134:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201200.513283:0:57134:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788201200.513677:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4054 00000100:00100000:3.0:1788201200.516031:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201200.516056:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715238016:0@lo:253:kworker.0 00000100:00100000:3.0:1788201200.516140:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788201200.516238:0:57134:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1788201200.516250:0:57134:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1788201200.516253:0:57134:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788201200.516255:0:57134:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788201200.516257:0:57134:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201200.516258:0:57134:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201200.516259:0:57134:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201200.516260:0:57134:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201200.516261:0:57134:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201200.516263:0:57134:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201200.516264:0:57134:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788201200.516273:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715238144:0@lo:253:kworker.0 00000100:00100000:3.0:1788201200.516439:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788201200.516491:0:57134:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1788201200.516521:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715238272:0@lo:253:kworker.0 00000100:00100000:3.0:1788201200.516561:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201200.516592:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715238016 00000100:00100000:3.0:1788201200.516599:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715238016 00000100:00100000:3.0:1788201200.516634:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715238144 00000100:00100000:3.0:1788201200.516637:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715238144 00000100:00100000:3.0:1788201200.516645:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715238272 00000100:00100000:3.0:1788201200.516658:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715238272 00000100:00100000:3.0:1788201200.516674:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788201200.516682:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+7:3658:x1875060715238016:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1788201200.516709:0:94461:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788201200.516723:0:94461:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788201200.516950:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201200.516959:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+7:3658:x1875060715238144:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788201200.516975:0:94464:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:2.0:1788201200.523150:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715237888:0@lo:250:kworker.0 00000100:00080000:2.0:1788201200.523208:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201200.523214:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201200.523217:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715237760:0@lo:38:kworker.0 20000000:01000000:3.0:1788201200.523337:0:94461:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788201200.523348:0:94461:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788201200.523431:0:94465:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788201200.523437:0:94465:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788201200.523457:0:94465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c4f6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201200.523474:0:94465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1c4d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78690c expref: 9 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201200.523481:0:94465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c4f6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201200.523517:0:94465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1c4d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78690c expref: 9 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201200.523539:0:94465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1c4d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78690c expref: 9 pid: 94464 timeout: 4151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201200.523553:0:94465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715238400:192.168.201.20@tcp:104: 00000100:00100000:3.0:1788201200.523629:0:94465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc108cfccc0 going to sleep for 11 seconds 20000000:01000000:2.0:1788201200.523788:0:94464:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:1.0:1788201200.527359:0:94456:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1788201200.527379:0:94456:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788201200.527447:0:94456:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788201200.527452:0:94456:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788201200.527562:0:94456:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788201200.527599:0:94456:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.120@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788201200.527603:0:94456:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788201200.527605:0:94456:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788201200.527606:0:94456:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201200.527607:0:94456:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201200.527608:0:94456:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201200.527609:0:94456:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201200.527611:0:94456:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201200.527612:0:94456:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788201200.527614:0:94456:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201200.527615:0:94456:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788201200.527618:0:94456:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788201200.527620:0:94456:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788201200.527621:0:94456:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788201200.527622:0:94456:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201200.527623:0:94456:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201200.527624:0:94456:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201200.527625:0:94456:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201200.527626:0:94456:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201200.527626:0:94456:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788201200.527627:0:94456:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201200.527628:0:94456:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788201200.527656:0:94456:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788201200.527675:0:94456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715238528:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788201200.527745:0:94456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201200.527782:0:94456:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005dfd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201200.528037:0:94463:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1788201200.528047:0:94463:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:2.0:1788201200.528140:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+7:3658:x1875060715238016:12345-0@lo:253:kworker.0 Request processed in 11456us (11998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.528149:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788201200.528182:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715238528 00000100:00100000:2.0:1788201200.528189:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715238528 00000100:00100000:2.0:1788201200.528217:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788201200.528225:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+7:3655:x1875060715238272:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788201200.528250:0:94461:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000020:01000004:2.0:1788201200.528298:0:3658:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788201200.528300:0:3658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201200.528301:0:3658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201200.528302:0:3658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201200.528303:0:3658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201200.528304:0:3658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201200.528306:0:3658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201200.528307:0:3658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201200.528308:0:3658:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788201200.528320:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715238016:0@lo:253:kworker.0 00000100:00100000:0.0:1788201200.528818:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201200.528828:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+7:94456:x1875060715238528:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788201200.528869:0:94467:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788201200.528872:0:94467:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788201200.528874:0:94467:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:0.0:1788201200.528880:0:94467:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788201200.532376:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+7:94456:x1875060715238528:12345-0@lo:253:mount.lustre.0 Request processed in 3540us (4621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201200.532406:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 20000000:01000000:1.0:1788201200.532534:0:94464:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788201200.532540:0:94464:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788201200.532661:0:94461:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788201200.533052:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+6:3658:x1875060715238144:12345-0@lo:253:kworker.0 Request processed in 16093us (16611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201200.533061:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000020:01000004:0.0:1788201200.533231:0:3658:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788201200.533234:0:3658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788201200.533235:0:3658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201200.533236:0:3658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201200.533237:0:3658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201200.533239:0:3658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201200.533240:0:3658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201200.533243:0:3658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201200.533244:0:3658:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788201200.533248:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715238144:0@lo:253:kworker.0 00000100:00100000:2.0:1788201200.533383:0:94456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715238528:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788201200.533395:0:94456:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788201200.533397:0:94456:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201200.533399:0:94456:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201200.533400:0:94456:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201200.533401:0:94456:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201200.533402:0:94456:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201200.533403:0:94456:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201200.533404:0:94456:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201200.533405:0:94456:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201200.533406:0:94456:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201200.533408:0:94456:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788201200.533424:0:94456:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dc11d438000 from lustre-MDT0000 10000000:01000000:2.0:1788201200.533454:0:94456:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788201200.533457:0:94456:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788201200.533467:0:94456:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dc11d438000 10000000:01000000:2.0:1788201200.533472:0:94456:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788201200.533477:0:94456:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8dc11d438000 10000000:01000000:2.0:1788201200.533479:0:94456:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788201200.533483:0:94456:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dc11d438000 from 1 10000000:01000000:2.0:1788201200.533486:0:94456:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788201200.533520:0:94456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c4fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.533541:0:94456:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c4fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.533551:0:94456:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c4fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201200.533570:0:94456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715238656:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201200.533617:0:94456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201200.533657:0:94456:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc109023840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201200.533715:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715238656 00000100:00100000:1.0:1788201200.533727:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715238656 00000100:00100000:1.0:1788201200.533768:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201200.533777:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+6:94456:x1875060715238656:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201200.533789:0:94463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201200.533804:0:94463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fd600/0x96d0c9b8c9a1c504 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c4fd expref: -99 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201200.533827:0:94463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fd600/0x96d0c9b8c9a1c504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c4fd expref: 7 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201200.533849:0:94463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fd600/0x96d0c9b8c9a1c504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c4fd expref: 7 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201200.533857:0:94463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fd600, rc 0) 00000100:00100000:1.0:1788201200.533896:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+7:94456:x1875060715238656:12345-0@lo:101:mount.lustre.0 Request processed in 120us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201200.533901:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788201200.534162:0:94456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715238656:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201200.534174:0:94456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c4fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c504 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.534183:0:94456:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c4fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c504 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201200.534197:0:94456:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788201200.534213:0:94456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c4fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c504 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.534220:0:94456:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c4fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c504 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201200.534226:0:94456:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788201200.534230:0:94456:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788201200.534234:0:94456:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8dc11d438000 10000000:01000000:2.0:1788201200.534237:0:94456:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788201200.534239:0:94456:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788201200.534241:0:94456:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788201200.534257:0:94456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ade800/0x96d0c9b8c9a1c50b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.534264:0:94456:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007ade800/0x96d0c9b8c9a1c50b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.534271:0:94456:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007ade800/0x96d0c9b8c9a1c50b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201200.534290:0:94456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715238784:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201200.534317:0:94456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201200.534334:0:94456:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc109023840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201200.534480:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715238784 00000100:00100000:1.0:1788201200.534485:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715238784 00000100:00100000:1.0:1788201200.534518:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788201200.534535:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+7:94456:x1875060715238784:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201200.534544:0:94464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201200.534553:0:94464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fd200/0x96d0c9b8c9a1c512 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c50b expref: -99 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201200.534579:0:94464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fd200/0x96d0c9b8c9a1c512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c50b expref: 8 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201200.534588:0:94464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fd200/0x96d0c9b8c9a1c512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c50b expref: 8 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201200.534601:0:94464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fd200, rc 0) 00000100:00100000:1.0:1788201200.534636:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:94456:x1875060715238784:12345-0@lo:101:mount.lustre.0 Request processed in 111us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201200.534643:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788201200.534730:0:94456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715238784:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201200.534741:0:94456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007ade800/0x96d0c9b8c9a1c50b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c512 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201200.534749:0:94456:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007ade800/0x96d0c9b8c9a1c50b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c512 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201200.534805:0:94456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715238912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201200.534842:0:94456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201200.534862:0:94456:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f63180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201200.534877:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715238912 00000100:00100000:0.0:1788201200.534881:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715238912 00000100:00100000:0.0:1788201200.534903:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788201200.534910:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+8:94456:x1875060715238912:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201200.535208:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+9:94456:x1875060715238912:12345-0@lo:501:mount.lustre.0 Request processed in 297us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201200.535215:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788201200.535257:0:94456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715238912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201200.535284:0:94456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715239040:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201200.535334:0:94456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201200.535356:0:94456:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc00274dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201200.535368:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715239040 00000100:00100000:0.0:1788201200.535372:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715239040 00000100:00100000:0.0:1788201200.535389:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788201200.535395:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+9:94456:x1875060715239040:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201200.535483:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+9:94456:x1875060715239040:12345-0@lo:503:mount.lustre.0 Request processed in 87us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201200.535489:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788201200.535540:0:94456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715239040:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201200.539592:0:94468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:94468:1875060715239168:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201200.539686:0:94468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201200.539723:0:94468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140ffb540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201200.539799:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715239168 00000100:00100000:0.0:1788201200.539807:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715239168 00000100:00100000:0.0:1788201200.539862:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788201200.539872:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+9:94468:x1875060715239168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201200.540772:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+9:94468:x1875060715239168:12345-0@lo:502:llog_process_th.0 Request processed in 892us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201200.540787:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788201200.542788:0:94468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:94468:1875060715239168:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201200.542852:0:94468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201200.542865:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201200.542867:0:94468:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788201200.542872:0:94468:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788201200.542875:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201200.542891:0:94468:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8dc13f874d28) 00000020:00000080:2.0:1788201200.542918:0:94468:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:2.0:1788201200.542925:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788201200.543052:0:94468:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788201200.543059:0:94468:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1c520 00000020:00000080:2.0:1788201200.543404:0:94468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788201200.543410:0:94468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201200.543414:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201200.543415:0:94468:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788201200.543421:0:94468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201200.543424:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201200.543426:0:94468:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788201200.543431:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201200.543439:0:94468:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8dc13f870000) 00000020:00000080:2.0:1788201200.543453:0:94468:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:2.0:1788201200.543457:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788201200.543459:0:94468:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788201200.543462:0:94468:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788201200.543467:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788201200.543511:0:94468:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc11d438000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788201200.543546:0:94468:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8dc13f8719b8) 00000020:00000080:2.0:1788201200.543557:0:94468:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:2.0:1788201200.543616:0:94468:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788201200.543624:0:94468:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1c535 00000020:00000080:2.0:1788201200.543727:0:94468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000100:00100000:3.0:1788201200.544035:0:94465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715238400:192.168.201.20@tcp:104: 00010000:00010000:3.0:1788201200.544059:0:94465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c4f6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:01000000:3.0:1788201200.544108:0:94468:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788201200.544115:0:94468:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x96d0c9b8c9a1c53c 00080000:01000000:3.0:1788201200.544120:0:94468:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788201200.544131:0:94468:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1c543 20000000:01000000:1.0:1788201200.545411:0:94461:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788201200.545418:0:94461:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788201200.545779:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+8:3655:x1875060715238272:12345-0@lo:253:kworker.0 Request processed in 17551us (29213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201200.545791:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:01000004:3.0:1788201200.545956:0:3655:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788201200.545959:0:3655:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788201200.545961:0:3655:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201200.545962:0:3655:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201200.545963:0:3655:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201200.545964:0:3655:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201200.545966:0:3655:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201200.545967:0:3655:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201200.545969:0:3655:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788201200.545972:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715238272:0@lo:253:kworker.0 00000100:00100000:1.0:1788201200.559156:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201200.559490:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695426560 00000100:00100000:3.0:1788201200.559507:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695426560 00010000:00010000:3.0:1788201200.559565:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1c4d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78690c expref: 10 pid: 94464 timeout: 4151 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201200.559614:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2588 00000100:00100000:3.0:1788201200.559626:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133701180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695426560:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201200.559644:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201200.559651:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1c4d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78690c expref: 10 pid: 94464 timeout: 4151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201200.559665:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1c4d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78690c expref: 10 pid: 94464 timeout: 4151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201200.559686:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1c4d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78690c expref: 10 pid: 94464 timeout: 4151 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201200.559725:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c4f6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201200.559734:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c4f6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788201200.559754:0:6518:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.036317302s 00010000:00010000:3.0:1788201200.559759:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c4f6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201200.559767:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c4f6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201200.559774:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c4f6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201200.559781:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c4f6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201200.559786:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201200.559791:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c4f6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201200.559799:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c4f6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201200.559825:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c4f6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201200.559900:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201200.559973:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133701180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:2401:x1875060695426560:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 349us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201200.559981:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2588 00010000:00010000:1.0:1788201200.560079:0:94465:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c4f6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201200.560095:0:94465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c4f6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201200.560103:0:94465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae2600/0x96d0c9b8c9a1c4f6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201200.657305:0:94468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:0.0:1788201200.657447:0:94468:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 115964116996 srv lr: 120259084288 lx: 0 gen 22 00000001:00080000:0.0:1788201200.657504:0:94468:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 6e293f14-c501-4bc5-9dd4-a18ef02756b4 idx: 2 lr: 0 srv lr: 120259084288 lx: 0 gen 24 00000001:00000004:0.0:1788201200.657536:0:94468:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 29, last_transno is 120259084288 00000001:00080000:0.0:1788201200.657638:0:94468:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:0.0:1788201200.657696:0:94468:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc120888c00: xid 1875060715218944, transno 120259084295, client gen 22, slot idx 0 00000001:00080000:0.0:1788201200.658035:0:94468:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc120888600: xid 1875060715220864, transno 120259084296, client gen 22, slot idx 1 00000001:00080000:0.0:1788201200.658043:0:94468:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc1208889c0: xid 1875060695413248, transno 120259084294, client gen 24, slot idx 2 00000001:00080000:0.0:1788201200.658048:0:94468:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc120888cc0: xid 1875060695412864, transno 120259084293, client gen 24, slot idx 3 00000020:00000080:0.0:1788201200.659110:0:94468:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8dc004044d28) 00000020:00000080:0.0:1788201200.659132:0:94468:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:0.0:1788201200.659217:0:94468:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788201200.659224:0:94468:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1c55f 00000020:00000080:1.0:1788201200.675245:0:94468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788201200.680433:0:94468:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x96d0c9b8c9a1c566 00000020:00000080:0.0:1788201200.685936:0:94468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788201200.685952:0:94468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201200.685960:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201200.685962:0:94468:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788201200.685967:0:94468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788201200.685970:0:94468:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1788201200.685971:0:94468:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788201200.685973:0:94468:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788201200.685975:0:94468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788201200.685978:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201200.685979:0:94468:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788201200.685982:0:94468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201200.685987:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201200.685988:0:94468:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788201200.685993:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788201200.686076:0:94468:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788201200.686104:0:94468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201200.686108:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201200.686109:0:94468:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788201200.686112:0:94468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201200.686116:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201200.686117:0:94468:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788201200.686120:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788201200.686125:0:94468:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:00000080:0.0:1788201200.686167:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201200.686182:0:94468:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8dc004040000) 00000020:00000080:0.0:1788201200.686206:0:94468:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1788201200.686213:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788201200.686275:0:94468:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788201200.686281:0:94468:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788201200.686432:0:94468:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1c574 00010000:00080000:0.0:1788201200.686468:0:94468:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc104281000@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:0.0:1788201200.693440:0:94468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1788201200.696812:0:94468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201200.696828:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788201200.696864:0:94468:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788201200.696892:0:94468:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1c57b 00000100:00080000:2.0:1788201200.696902:0:94468:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201200.696908:0:94468:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8dc104281000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201200.696944:0:94468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004eb7800 x1875060715239296/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201200.696976:0:94468:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788201200.697007:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201200.697012:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201200.697040:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201200.697044:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4051 00000100:00080000:2.0:1788201200.697047:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201200.697051:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201200.697065:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004eb7480 x1875060715239424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201200.697097:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201200.697101:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201200.697103:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201200.697106:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4051 00000100:00080000:2.0:1788201200.697108:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201200.697119:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201200.697134:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004eb6680 x1875060715239680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201200.697161:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201200.697164:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201200.697165:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201200.697169:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4051 00000100:00080000:2.0:1788201200.697171:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201200.697174:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201200.697186:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efc8700 x1875060715239936/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201200.697207:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201200.697211:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201200.697212:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201200.697215:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4051 00000100:00080000:2.0:1788201200.697217:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201200.697220:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201200.697231:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc0078e0a80 x1875060715240320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201200.697265:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715239552:0@lo:400:kworker.0 00000100:00100000:2.0:1788201200.697342:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201200.697381:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201200.697387:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715240192:0@lo:400:kworker.0 00000100:00100000:2.0:1788201200.697413:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201200.697461:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715239808:0@lo:400:kworker.0 00000100:00100000:2.0:1788201200.697619:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201200.697642:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201200.697648:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715240064:0@lo:400:kworker.0 00000100:00100000:2.0:1788201200.697671:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201200.697712:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715239552 00000100:00100000:2.0:1788201200.697719:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715239552 00000100:00100000:2.0:1788201200.697758:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715239808 00000100:00100000:2.0:1788201200.697762:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715239808 00000100:00100000:2.0:1788201200.697786:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:2.0:1788201200.697795:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715239552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201200.697844:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715239552:12345-0@lo:400:kworker.0 Request processed in 50us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.697850:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00100000:2.0:1788201200.697866:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:2.0:1788201200.697872:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715239808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201200.697904:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715239808:12345-0@lo:400:kworker.0 Request processed in 32us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.697910:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:2.0:1788201200.697931:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715240192 00000100:00100000:2.0:1788201200.697935:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715240192 00000100:00100000:2.0:1788201200.697957:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715240064 00000100:00100000:2.0:1788201200.697960:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715240064 00000100:00100000:2.0:1788201200.697978:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2857 00000100:00100000:2.0:1788201200.697984:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715240192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201200.698035:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715240192:12345-0@lo:400:kworker.0 Request processed in 30us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.698051:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2857 00000100:00100000:2.0:1788201200.698064:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2858 00000100:00100000:2.0:1788201200.698071:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715240064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201200.698101:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715240064:12345-0@lo:400:kworker.0 Request processed in 32us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.698107:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2858 00000100:00100000:2.0:1788201200.698152:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715240064:0@lo:400:kworker.0 00000100:00100000:2.0:1788201200.698163:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715239808:0@lo:400:kworker.0 00000100:00100000:2.0:1788201200.698197:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715240192:0@lo:400:kworker.0 00000100:00100000:2.0:1788201200.698206:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715239552:0@lo:400:kworker.0 00000020:01000000:2.0:1788201200.698268:0:94468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201200.698273:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201200.698275:0:94468:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788201200.698278:0:94468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788201200.698281:0:94468:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000100:00100000:0.0:1788201200.698388:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715239296:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788201200.698425:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201200.698456:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715239424:0@lo:38:kworker.0 00000100:00100000:0.0:1788201200.698480:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201200.698577:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715239680:0@lo:38:kworker.0 00000100:00100000:0.0:1788201200.698600:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201200.698621:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715239936:0@lo:38:kworker.0 00000100:00100000:0.0:1788201200.698644:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201200.698660:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715240320:0@lo:38:kworker.0 00000100:00100000:0.0:1788201200.698679:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201200.698712:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715239296 00000100:00100000:0.0:1788201200.698716:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715239296 00000100:00100000:0.0:1788201200.698735:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715239936 00000100:00100000:0.0:1788201200.698738:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715239936 00000100:00100000:0.0:1788201200.698752:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4055 00000100:00100000:0.0:1788201200.698758:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715239296:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788201200.698781:0:8458:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4052 last 0 00000020:00000080:0.0:1788201200.698813:0:8458:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1c582 00000004:00100000:0.0:1788201200.698835:0:8458:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788201200.698930:0:8458:0:(import.c:65:import_set_state_nolock()) ffff8dc11d63f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201200.698970:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715239296:12345-0@lo:38:llog_process_th.0 Request processed in 211us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201200.698977:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4055 00000100:00100000:0.0:1788201200.698990:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4056 00000100:00100000:0.0:1788201200.698994:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715239936:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788201200.699044:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715239936:12345-0@lo:38:kworker.0 Request processed in 48us (399us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788201200.699050:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4056 00000100:00100000:0.0:1788201200.699070:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715239424 00000100:00100000:0.0:1788201200.699074:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715239424 00000100:00100000:0.0:1788201200.699090:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715239680 00000100:00100000:0.0:1788201200.699092:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715239680 00000100:00100000:0.0:1788201200.699102:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715240320 00000100:00100000:0.0:1788201200.699105:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715240320 00000100:00100000:0.0:1788201200.699114:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:0.0:1788201200.699119:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715239424:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788201200.699150:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715239424:12345-0@lo:38:kworker.0 Request processed in 30us (669us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788201200.699156:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00100000:0.0:1788201200.699168:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1442 00000100:00100000:0.0:1788201200.699172:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715239680:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788201200.699199:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715239680:12345-0@lo:38:kworker.0 Request processed in 26us (598us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788201200.699205:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1442 00000100:00100000:0.0:1788201200.699216:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1443 00000100:00100000:0.0:1788201200.699220:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715240320:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788201200.699255:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715240320:12345-0@lo:38:kworker.0 Request processed in 34us (575us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788201200.699261:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1443 00000020:01000000:2.0:1788201200.699370:0:94468:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201200.699375:0:94468:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201200.699377:0:94468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788201200.699396:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201200.699398:0:94468:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788201200.699403:0:94468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788201200.699408:0:94468:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788201200.699411:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201200.699413:0:94468:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788201200.699416:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788201200.699420:0:94468:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:2.0:1788201200.699440:0:94468:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788201200.699449:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201200.699463:0:94468:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8dc12f0c0000) 00000020:00000080:2.0:1788201200.699480:0:94468:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1788201200.700393:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788201200.700563:0:94468:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788201200.700571:0:94468:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788201200.700579:0:94468:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1c590 00010000:00080000:2.0:1788201200.700611:0:94468:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc109815000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:2.0:1788201200.700838:0:94468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:0.0:1788201200.701469:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788201200.701479:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:0.0:1788201200.702383:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788201200.702391:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788201200.702395:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc104281000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788201200.702407:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715239296:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788201200.702432:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201200.702436:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788201200.702439:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715239424:0@lo:38:kworker.0 00000100:00080000:0.0:1788201200.702450:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201200.702453:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788201200.702456:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715239680:0@lo:38:kworker.0 00000100:00080000:0.0:1788201200.702469:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201200.702473:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788201200.702476:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715239936:0@lo:38:kworker.0 00000100:00080000:0.0:1788201200.702563:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201200.702568:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788201200.702571:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715240320:0@lo:38:kworker.0 00000100:00100000:3.0:1788201200.702740:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201200.702754:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715240448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201200.702820:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201200.703361:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715240448 00000100:00100000:0.0:1788201200.703369:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715240448 00000100:00100000:0.0:1788201200.703415:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4057 00000100:00100000:0.0:1788201200.703431:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715240448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201200.703463:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000040:01000000:2.0:1788201200.703808:0:94468:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788201200.703831:0:94468:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788201200.704652:0:94468:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 27, last_idx 28 00000100:00100000:0.0:1788201200.704815:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715240448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1383us (1993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201200.704826:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4057 00000040:00080000:2.0:1788201200.707723:0:94468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201200.707760:0:94468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].29, 64 off10048 00000040:00080000:2.0:1788201200.707907:0:94468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].1, 64 off8256 00000100:00100000:3.0:1788201200.712227:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715240448:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788201200.715862:0:94474:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 29 synced_idx: 0 lgh_last_idx: 29 00000040:00080000:1.0:1788201200.715873:0:94474:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788201200.716099:0:94474:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 28, last_idx 29 00000040:00080000:1.0:1788201200.716140:0:94474:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788201200.716279:0:94474:0:(llog.c:805:llog_process_thread()) index: 29, lh_last_idx: 29 synced_idx: 29 lgh_last_idx: 29 00000020:00000080:3.0:1788201200.717013:0:94468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201200.717051:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788201200.717091:0:94468:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788201200.717117:0:94468:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1c597 00000100:00080000:3.0:1788201200.717128:0:94468:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201200.717135:0:94468:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dc109815000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201200.717174:0:94468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc120090e00 x1875060715240576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201200.717196:0:94468:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788201200.717246:0:94468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201200.717251:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201200.717253:0:94468:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788201200.717256:0:94468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788201200.717258:0:94468:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1788201200.717260:0:94468:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201200.717262:0:94468:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201200.717263:0:94468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788201200.717265:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201200.717267:0:94468:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788201200.717269:0:94468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788201200.717273:0:94468:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788201200.717276:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201200.717296:0:94468:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788201200.717302:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788201200.717306:0:94468:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:3.0:1788201200.717329:0:94468:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788201200.717332:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201200.717343:0:94468:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8dc12ef63370) 00000020:00000080:3.0:1788201200.717359:0:94468:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1788201200.717365:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788201200.717429:0:94468:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788201200.717434:0:94468:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788201200.717441:0:94468:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1c5a5 00010000:00080000:3.0:1788201200.717470:0:94468:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc1257f0800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:3.0:1788201200.717675:0:94468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:3.0:1788201200.717742:0:94468:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788201200.717757:0:94468:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1788201200.718145:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715240576:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788201200.718218:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788201200.718426:0:94474:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x74:0x0] at index 29 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1788201200.718815:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715240576 00000100:00100000:3.0:1788201200.718823:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715240576 00000100:00100000:3.0:1788201200.718865:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5921 00000100:00100000:3.0:1788201200.718873:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3654:x1875060715240576:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1788201200.718900:0:8491:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4052 last 0 00000020:00000080:3.0:1788201200.718930:0:8491:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1c5ac 00002000:00100000:3.0:1788201200.718947:0:8491:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8dc0059d2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788201200.718951:0:8491:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788201200.718955:0:8491:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788201200.719041:0:8491:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788201200.719069:0:8491:0:(import.c:65:import_set_state_nolock()) ffff8dc0059d0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201200.719129:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715240576:12345-0@lo:8:llog_process_th.0 Request processed in 255us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201200.719136:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5921 00000100:00100000:2.0:1788201200.719227:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788201200.719237:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788201200.719245:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788201200.719250:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788201200.719253:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788201200.719271:0:3654:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788201200.719278:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715240576:0@lo:8:llog_process_th.0 00000040:00080000:2.0:1788201200.719389:0:94468:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 27, last_idx 28 00000040:00080000:2.0:1788201200.720133:0:94468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201200.720163:0:94468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].29, 64 off10048 00000040:00080000:2.0:1788201200.720278:0:94468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x76:0x0].1, 64 off8256 00000004:00080000:1.0:1788201200.720401:0:94474:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788201200.720444:0:94474:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 4052192427509ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788201200.720451:0:94474:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788201200.720780:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715240704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201200.720851:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788201200.725741:0:94476:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 29 synced_idx: 0 lgh_last_idx: 29 00000040:00080000:3.0:1788201200.725749:0:94476:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1788201200.725946:0:94476:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 28, last_idx 29 00000040:00080000:3.0:1788201200.725969:0:94476:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1788201200.726124:0:94476:0:(llog.c:805:llog_process_thread()) index: 29, lh_last_idx: 29 synced_idx: 29 lgh_last_idx: 29 00000040:00080000:3.0:1788201200.726128:0:94476:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x76:0x0] at index 29 of catalog [0x1:0x5:0x0] 00000004:00080000:0.0:1788201200.727300:0:94457:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788201200.727435:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715240704 00000100:00100000:1.0:1788201200.727445:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715240704 00000100:00100000:1.0:1788201200.727500:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2318 00000100:00100000:1.0:1788201200.727510:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715240704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201200.727556:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788201200.727653:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715240704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (6800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201200.727660:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2318 00000100:00100000:3.0:1788201200.727756:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715240704:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788201200.727834:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1788201200.730846:0:94468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201200.730860:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788201200.730906:0:94468:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788201200.730931:0:94468:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1c5b3 00000100:00080000:3.0:1788201200.730943:0:94468:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201200.730948:0:94468:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dc1257f0800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201200.730980:0:94468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc120091c00 x1875060715240832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201200.731006:0:94468:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788201200.731080:0:94468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201200.731084:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201200.731086:0:94468:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788201200.731089:0:94468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201200.731093:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201200.731094:0:94468:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788201200.731097:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788201200.731099:0:94468:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788201200.731101:0:94468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201200.731104:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201200.731105:0:94468:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788201200.731107:0:94468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201200.731109:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201200.731111:0:94468:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788201200.731121:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788201200.731127:0:94468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201200.731129:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201200.731130:0:94468:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000020:01000000:3.0:1788201200.731132:0:94468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201200.731136:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201200.731137:0:94468:0:(obd_config.c:1563:class_process_config()) marker 43 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:3.0:1788201200.731140:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1788201200.731178:0:94468:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:3.0:1788201200.732806:0:94468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:94468:1875060715240960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201200.732888:0:94468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201200.732935:0:94468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc104e14e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201200.733052:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715240832:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788201200.733090:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201200.733183:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715240960 00000100:00100000:1.0:1788201200.733191:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715240960 00000100:00100000:1.0:1788201200.733238:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788201200.733247:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+8:94468:x1875060715240960:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201200.733477:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+8:94468:x1875060715240960:12345-0@lo:502:llog_process_th.0 Request processed in 229us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201200.733485:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788201200.733582:0:94468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:94468:1875060715240960:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201200.733610:0:94468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201200.733616:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201200.733618:0:94468:0:(obd_config.c:1563:class_process_config()) marker 43 (0x2) lustre-MDT0000-m new lustre.pool_134 00000020:01000000:2.0:1788201200.733622:0:94468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201200.733627:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201200.733628:0:94468:0:(obd_config.c:1563:class_process_config()) marker 46 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:2.0:1788201200.733632:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: ce021 00020000:01000000:2.0:1788201200.733646:0:94468:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:3.0:1788201200.733979:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715240832 00000100:00100000:3.0:1788201200.733984:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715240832 00000100:00100000:3.0:1788201200.734076:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5922 00000100:00100000:3.0:1788201200.734082:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3654:x1875060715240832:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1788201200.734107:0:8449:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4052 last 0 00000020:00000080:3.0:1788201200.734134:0:8449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1c5ba 00002000:00100000:3.0:1788201200.734149:0:8449:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8dc0059d1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788201200.734153:0:8449:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788201200.734156:0:8449:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788201200.734228:0:8449:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788201200.734251:0:8449:0:(import.c:65:import_set_state_nolock()) ffff8dc005d75800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201200.734307:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715240832:12345-0@lo:8:llog_process_th.0 Request processed in 224us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201200.734313:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5922 00000100:00100000:2.0:1788201200.735727:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788201200.735740:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788201200.735749:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788201200.735755:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788201200.735758:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f0800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788201200.735778:0:3654:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788201200.735785:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715240832:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788201200.735879:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715241088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201200.735930:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201200.735982:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715241088 00000100:00100000:2.0:1788201200.735988:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715241088 00000100:00100000:2.0:1788201200.736071:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2319 00000100:00100000:2.0:1788201200.736081:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715241088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201200.736104:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201200.736146:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715241088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.736166:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2319 00000100:00100000:2.0:1788201200.736209:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715241088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201200.736470:0:94468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:94468:1875060715241216:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201200.736516:0:94468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201200.736552:0:94468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1065c7780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201200.736568:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715241216 00000100:00100000:2.0:1788201200.736572:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715241216 00000100:00100000:2.0:1788201200.736601:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788201200.736608:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:94468:x1875060715241216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201200.736724:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:94468:x1875060715241216:12345-0@lo:502:llog_process_th.0 Request processed in 116us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.736731:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788201200.736778:0:94468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:94468:1875060715241216:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201200.736801:0:94468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201200.736807:0:94468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201200.736809:0:94468:0:(obd_config.c:1563:class_process_config()) marker 46 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1788201200.736814:0:94468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:2.0:1788201200.736938:0:94456:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-52 (rc=0) 10000000:01000000:2.0:1788201200.736961:0:94456:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788201200.736978:0:94456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ade800/0x96d0c9b8c9a1c50b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c512 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.736989:0:94456:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007ade800/0x96d0c9b8c9a1c50b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c512 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201200.736997:0:94456:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc11d438000 from 1 10000000:01000000:2.0:1788201200.737006:0:94456:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788201200.737059:0:94456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c5c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.737068:0:94456:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c5c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.737077:0:94456:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c5c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201200.737089:0:94456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715241344:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201200.737116:0:94456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201200.737136:0:94456:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1065c7780 going to sleep for 11 seconds 00000020:01000004:1.0:1788201200.737245:0:94478:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc11d438000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788201200.737250:0:94478:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc11d438000 4 00000100:00080000:1.0:1788201200.738084:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788201200.738145:0:94476:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788201200.738219:0:94476:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 4052210201998ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788201200.738227:0:94476:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788201200.738409:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715241344 00000100:00100000:0.0:1788201200.738416:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715241344 00000100:00100000:0.0:1788201200.738460:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788201200.738469:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+8:94456:x1875060715241344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201200.738480:0:94467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201200.738495:0:94467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782c600/0x96d0c9b8c9a1c5c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c5c1 expref: -99 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201200.738517:0:94467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782c600/0x96d0c9b8c9a1c5c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c5c1 expref: 9 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201200.738536:0:94467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782c600/0x96d0c9b8c9a1c5c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c5c1 expref: 9 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201200.738545:0:94467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782c600, rc 0) 00000100:00100000:0.0:1788201200.738594:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+9:94456:x1875060715241344:12345-0@lo:101:mount.lustre.0 Request processed in 126us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201200.738600:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788201200.740200:0:94456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715241344:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201200.740223:0:94456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c5c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c5c8 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.740234:0:94456:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c5c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c5c8 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201200.740918:0:94456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715241472:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788201200.740981:0:94456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201200.742441:0:94456:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1065c7780 going to sleep for 11 seconds 00000004:00080000:2.0:1788201200.744505:0:94457:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788201200.746225:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715241472 00000100:00100000:3.0:1788201200.746240:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715241472 00000100:00100000:3.0:1788201200.746316:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788201200.746340:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+9:94456:x1875060715241472:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788201200.746367:0:94464:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788201200.746386:0:94464:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788201200.746390:0:94464:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788201200.746393:0:94464:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788201200.746395:0:94464:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 126 00000100:00100000:3.0:1788201200.746532:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+9:94456:x1875060715241472:12345-0@lo:256:mount.lustre.0 Request processed in 185us (5541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201200.746541:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788201200.746729:0:94456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715241472:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788201200.747403:0:94456:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788201200.747429:0:94456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c5c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c5c8 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.747440:0:94456:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c5c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c5c8 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201200.747449:0:94456:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc11d438000 from 1 10000000:01000000:2.0:1788201200.747452:0:94456:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201200.747483:0:94456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adea00/0x96d0c9b8c9a1c5cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.747491:0:94456:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007adea00/0x96d0c9b8c9a1c5cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.747501:0:94456:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007adea00/0x96d0c9b8c9a1c5cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201200.747528:0:94456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715241600:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201200.747570:0:94456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201200.756243:0:94456:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1065c7780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201200.757132:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715241600 00000100:00100000:0.0:1788201200.757144:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715241600 00000100:00100000:0.0:1788201200.758121:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788201200.758137:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+9:94456:x1875060715241600:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201200.758169:0:94467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201200.758190:0:94467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782cc00/0x96d0c9b8c9a1c5d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c5cf expref: -99 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201200.758220:0:94467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782cc00/0x96d0c9b8c9a1c5d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c5cf expref: 10 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201200.758232:0:94467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782cc00/0x96d0c9b8c9a1c5d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c5cf expref: 10 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201200.758242:0:94467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782cc00, rc 0) 00000100:00100000:0.0:1788201200.758392:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+10:94456:x1875060715241600:12345-0@lo:101:mount.lustre.0 Request processed in 260us (10821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201200.758399:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788201200.758515:0:94456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715241600:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201200.758542:0:94456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007adea00/0x96d0c9b8c9a1c5cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c5d6 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201200.758552:0:94456:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007adea00/0x96d0c9b8c9a1c5cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c5d6 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201200.758642:0:94456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715241728:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201200.758678:0:94456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201200.765135:0:94456:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0050f10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201200.765267:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715241728 00000100:00100000:2.0:1788201200.765278:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715241728 00000100:00100000:2.0:1788201200.765354:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788201200.765366:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:94456:x1875060715241728:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201200.765535:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:94456:x1875060715241728:12345-0@lo:501:mount.lustre.0 Request processed in 171us (6855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.765543:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788201200.765620:0:94456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715241728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201200.765673:0:94456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715241856:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201200.765733:0:94456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201200.765749:0:94456:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1065c7780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201200.765763:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715241856 00000100:00100000:2.0:1788201200.765766:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715241856 00000100:00100000:2.0:1788201200.765784:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788201200.765789:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:94456:x1875060715241856:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201200.765863:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:94456:x1875060715241856:12345-0@lo:503:mount.lustre.0 Request processed in 73us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.765870:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788201200.765908:0:94456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715241856:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201200.770361:0:94479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:94479:1875060715241984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201200.770454:0:94479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201200.770503:0:94479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0050f1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201200.770604:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715241984 00000100:00100000:2.0:1788201200.770612:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715241984 00000100:00100000:2.0:1788201200.770664:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788201200.770674:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:94479:x1875060715241984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201200.771193:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:94479:x1875060715241984:12345-0@lo:502:llog_process_th.0 Request processed in 519us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.771202:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788201200.771294:0:94479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:94479:1875060715241984:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201200.771324:0:94479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201200.771335:0:94479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201200.771337:0:94479:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788201200.771345:0:94479:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc11d438000 00000020:00000080:3.0:1788201200.771354:0:94479:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788201200.771365:0:94479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201200.771367:0:94479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201200.771369:0:94479:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788201200.771371:0:94479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201200.771374:0:94479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201200.771375:0:94479:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788201200.771379:0:94479:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc11d438000 00000020:00000080:3.0:1788201200.771381:0:94479:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788201200.771462:0:94479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:94479:1875060715242112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201200.771499:0:94479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201200.771535:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715242112 00000100:00100000:3.0:1788201200.771540:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715242112 00000100:00100000:3.0:1788201200.771563:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788201200.771571:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12e6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+10:94479:x1875060715242112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201200.771646:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12e6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+10:94479:x1875060715242112:12345-0@lo:502:llog_process_th.0 Request processed in 75us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201200.771653:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788201200.771688:0:94479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0050f1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201200.771700:0:94479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:94479:1875060715242112:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201200.771718:0:94479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201200.771722:0:94479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201200.771724:0:94479:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788201200.771727:0:94479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788201200.773609:0:94456:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1788201200.773649:0:94456:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201200.773674:0:94456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adea00/0x96d0c9b8c9a1c5cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c5d6 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.773687:0:94456:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007adea00/0x96d0c9b8c9a1c5cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c5d6 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201200.773753:0:94456:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788201200.773756:0:94456:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dc11d438000 10000000:01000000:2.0:1788201200.773765:0:94456:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dc11d438000 10000000:01000000:2.0:1788201200.773769:0:94456:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788201200.773776:0:94456:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc11d438000 from 1 10000000:01000000:2.0:1788201200.773779:0:94456:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788201200.773813:0:94456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c5dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.773822:0:94456:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c5dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.773832:0:94456:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c5dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201200.773854:0:94456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715242240:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201200.773909:0:94456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201200.773940:0:94456:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103d01780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201200.773963:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715242240 00000100:00100000:2.0:1788201200.773969:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715242240 00000100:00100000:2.0:1788201200.774006:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788201200.774034:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12e6ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+10:94456:x1875060715242240:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201200.774046:0:94461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201200.774059:0:94461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007adf800/0x96d0c9b8c9a1c5e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c5dd expref: -99 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.774085:0:94461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007adf800/0x96d0c9b8c9a1c5e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c5dd expref: 11 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.774096:0:94461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007adf800/0x96d0c9b8c9a1c5e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c5dd expref: 11 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.774116:0:94461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007adf800, rc 0) 00000100:00100000:2.0:1788201200.774151:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12e6ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:94456:x1875060715242240:12345-0@lo:101:mount.lustre.0 Request processed in 137us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.774157:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788201200.774199:0:94456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715242240:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201200.774212:0:94456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c5dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c5e4 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.774221:0:94456:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c5dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c5e4 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201200.774269:0:94456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715242368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201200.774293:0:94456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201200.774307:0:94456:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103d01780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201200.774319:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715242368 00000100:00100000:2.0:1788201200.774323:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715242368 00000100:00100000:2.0:1788201200.774344:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788201200.774350:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134207c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:94456:x1875060715242368:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201200.774455:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134207c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:94456:x1875060715242368:12345-0@lo:501:mount.lustre.0 Request processed in 105us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.774462:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788201200.774496:0:94456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715242368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201200.774532:0:94456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715242496:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201200.774569:0:94456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201200.774590:0:94456:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007365900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201200.774603:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715242496 00000100:00100000:2.0:1788201200.774607:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715242496 00000100:00100000:2.0:1788201200.774627:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788201200.774633:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134204850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:94456:x1875060715242496:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201200.774709:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134204850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:94456:x1875060715242496:12345-0@lo:503:mount.lustre.0 Request processed in 75us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.774716:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788201200.774756:0:94456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715242496:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201200.784379:0:94481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:94481:1875060715242624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201200.784472:0:94481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201200.784513:0:94481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007365900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201200.784544:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715242624 00000100:00100000:2.0:1788201200.784551:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715242624 00000100:00100000:2.0:1788201200.784600:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788201200.784610:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134207450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:94481:x1875060715242624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201200.784732:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134207450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:94481:x1875060715242624:12345-0@lo:502:llog_process_th.0 Request processed in 122us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.784740:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788201200.784799:0:94481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:94481:1875060715242624:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788201200.784857:0:94481:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788201200.784872:0:94481:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8dc12f0c19b8) 00000020:00000080:2.0:1788201200.784897:0:94481:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1788201200.784978:0:94481:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc11d438000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788201200.784983:0:94481:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc11d438000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788201200.784985:0:94481:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc11d438000 4 00010000:00080000:2.0:1788201200.787413:0:94481:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc137d33000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:2.0:1788201200.793129:0:94481:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1788201200.793443:0:94481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788201200.793486:0:94481:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788201200.793500:0:94481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x96d0c9b8c9a1c5f2 00000100:00080000:2.0:1788201200.793510:0:94481:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201200.793516:0:94481:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dc137d33000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201200.793557:0:94481:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc0078e2d80 x1875060715242752/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201200.793626:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715242752:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788201200.793693:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788201200.793747:0:94481:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788201200.793988:0:94481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:94481:1875060715242880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201200.794059:0:94481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201200.794077:0:94481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007365e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201200.795452:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715242752 00000100:00100000:1.0:1788201200.795462:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715242752 00000100:00100000:1.0:1788201200.795540:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444 00000100:00100000:1.0:1788201200.795549:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715242752:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788201200.795626:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715242752:12345-0@lo:38:llog_process_th.0 Request processed in 78us (1932us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788201200.795633:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444 00000100:00100000:1.0:1788201200.795668:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788201200.795675:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc137d33000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201200.795679:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788201200.795682:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715242752:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788201200.796867:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715242880 00000100:00100000:1.0:1788201200.796877:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715242880 00000100:00100000:1.0:1788201200.796925:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788201200.796934:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:94481:x1875060715242880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201200.797095:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:94481:x1875060715242880:12345-0@lo:502:llog_process_th.0 Request processed in 162us (3035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201200.797102:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788201200.801187:0:94481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:94481:1875060715242880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201200.801264:0:94481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:94481:1875060715243008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201200.801424:0:94481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201200.801493:0:94481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007365e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201200.805101:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715243008 00000100:00100000:0.0:1788201200.805114:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715243008 00000100:00100000:1.0:1788201200.805262:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788201200.805273:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:94481:x1875060715243008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201200.805436:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:94481:x1875060715243008:12345-0@lo:502:llog_process_th.0 Request processed in 165us (4012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201200.805444:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788201200.805625:0:94481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:94481:1875060715243008:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788201200.805659:0:94481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:2.0:1788201200.805802:0:94456:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-57 (rc=0) 10000000:01000000:2.0:1788201200.805824:0:94456:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788201200.805845:0:94456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c5dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c5e4 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.805856:0:94456:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c5dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c5e4 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788201200.805905:0:94456:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788201200.805908:0:94456:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201200.805913:0:94456:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201200.805914:0:94456:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201200.805915:0:94456:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201200.805917:0:94456:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201200.805918:0:94456:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201200.805919:0:94456:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201200.805921:0:94456:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201200.805922:0:94456:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788201200.805925:0:94456:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788201200.805928:0:94456:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788201200.805929:0:94456:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201200.805930:0:94456:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201200.805931:0:94456:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201200.805932:0:94456:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201200.805933:0:94456:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201200.805934:0:94456:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201200.805935:0:94456:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201200.805936:0:94456:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201200.805936:0:94456:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788201200.805955:0:94456:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788201200.805971:0:94456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715243136:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788201200.806010:0:94456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201200.806743:0:94456:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007365600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201200.806798:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715243136 00000100:00100000:3.0:1788201200.806803:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715243136 00000100:00100000:3.0:1788201200.806839:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788201200.806847:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134205850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:94456:x1875060715243136:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788201200.806869:0:94463:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788201200.806889:0:94463:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788201200.811590:0:94463:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788201200.811611:0:94463:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788201200.811886:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134205850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:94456:x1875060715243136:12345-0@lo:253:mount.lustre.0 Request processed in 5034us (5870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.811900:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788201200.812000:0:94456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:94456:1875060715243136:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788201200.812039:0:94456:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788201200.812043:0:94456:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788201200.812045:0:94456:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788201200.812047:0:94456:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201200.812049:0:94456:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201200.812050:0:94456:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201200.812052:0:94456:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201200.812053:0:94456:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201200.812055:0:94456:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788201200.812056:0:94456:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201200.812058:0:94456:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788201200.812087:0:94456:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788201200.812884:0:94465:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788201200.812890:0:94465:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788201200.812912:0:94465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c5f9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201200.812927:0:94465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc00782c600/0x96d0c9b8c9a1c5c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c5c1 expref: 10 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201200.812944:0:94465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c5f9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201200.812979:0:94465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc00782c600/0x96d0c9b8c9a1c5c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c5c1 expref: 10 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201200.812994:0:94465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc00782c600/0x96d0c9b8c9a1c5c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c5c1 expref: 10 pid: 94467 timeout: 4152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201200.813008:0:94465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab54700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715243264:0@lo:104: 00000100:00100000:1.0:1788201200.813083:0:94465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201200.813119:0:94465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005c6c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201200.813229:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715243264 00000100:00100000:2.0:1788201200.813237:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715243264 00000100:00100000:2.0:1788201200.813272:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1788201200.813290:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+3:94465:x1875060715243264:12345-0@lo:104: 00010000:00010000:2.0:1788201200.813302:0:19665:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c5c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c5c8 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.813367:0:19665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201200.813373:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+3:94465:x1875060715243264:12345-0@lo:104: Request processed in 94us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.813380:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00010000:00010000:2.0:1788201200.813397:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201200.813402:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c5c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c5c8 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.813409:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfc00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788201200.813413:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c5c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1c5c8 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.813422:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c5c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c5c8 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201200.813430:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c5c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c5c8 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201200.813436:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201200.813460:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c5c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c5c8 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.813466:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201200.813484:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c5c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c5c8 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.813491:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c5c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c5c8 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.813514:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201200.813516:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201200.813518:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201200.813546:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715243392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201200.813574:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201200.813613:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715243392 00000100:00100000:2.0:1788201200.813617:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715243392 00010000:00010000:2.0:1788201200.813632:0:26207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc00782c600/0x96d0c9b8c9a1c5c8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c5c1 expref: 11 pid: 94467 timeout: 4152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201200.813652:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589 00000100:00100000:2.0:1788201200.813658:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+11:3655:x1875060715243392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201200.813667:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201200.813672:0:26207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc00782c600/0x96d0c9b8c9a1c5c8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c5c1 expref: 11 pid: 94467 timeout: 4152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.813682:0:26207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc00782c600/0x96d0c9b8c9a1c5c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c5c1 expref: 11 pid: 94467 timeout: 4152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.813696:0:26207:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c5f9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.813704:0:26207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c5f9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788201200.813715:0:26207:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.036317302s 00010000:00010000:2.0:1788201200.813719:0:26207:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c5f9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.813736:0:26207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c5f9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.813743:0:26207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c5f9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.813748:0:26207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c5f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.813753:0:26207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fcc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201200.813758:0:26207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c5f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.813764:0:26207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c5f9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.813772:0:26207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c5f9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201200.813782:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201200.813810:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+11:3655:x1875060715243392:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201200.813816:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589 00000100:00100000:2.0:1788201200.813846:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715243392:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201200.814360:0:94465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782c600/0x96d0c9b8c9a1c5c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c5c1 expref: 10 pid: 94467 timeout: 4152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201200.814372:0:94465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab54700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715243264:0@lo:104: 00010000:00010000:0.0:1788201200.814387:0:94465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c5f9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201200.814396:0:94465:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c5f9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201200.814403:0:94465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c5f9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201200.814409:0:94465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c5f9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788201200.831124:0:94456:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411350 00000040:01000000:2.0:1788201200.831483:0:94456:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788201200.831663:0:94487:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411350 00000020:00080000:3.0:1788201200.831667:0:94487:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411350 00000040:01000000:3.0:1788201200.831750:0:94488:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1788201200.832175:0:94488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788201200.834142:0:94456:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1788201200.834606:0:94489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc44700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94489:1875060715243520:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788201200.834684:0:94489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201200.834734:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715243520 00000100:00100000:1.0:1788201200.834741:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715243520 00000100:00100000:1.0:1788201200.834784:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4058 00000100:00100000:1.0:1788201200.834794:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94489:x1875060715243520:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788201200.834866:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94489:x1875060715243520:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 72us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201200.834873:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4058 00000100:00100000:1.0:1788201200.834898:0:94489:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc109062780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201200.834921:0:94489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc44700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94489:1875060715243520:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788201200.834952:0:94489:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788201200.834977:0:94489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc44700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94489:1875060715243648:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788201200.835006:0:94489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201200.835066:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715243648 00000100:00100000:1.0:1788201200.835070:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715243648 00000100:00100000:1.0:1788201200.835093:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4059 00000100:00100000:1.0:1788201200.835100:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94489:x1875060715243648:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788201200.835192:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94489:x1875060715243648:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 92us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201200.835199:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4059 00000100:00100000:1.0:1788201200.835218:0:94489:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc109062480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201200.835230:0:94489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc44700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94489:1875060715243648:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788201200.835278:0:94489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc44700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94489:1875060715243776:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788201200.835313:0:94489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201200.835333:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715243776 00000100:00100000:1.0:1788201200.835337:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715243776 00000100:00100000:1.0:1788201200.835359:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4060 00000100:00100000:1.0:1788201200.835365:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94489:x1875060715243776:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788201200.835407:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94489:x1875060715243776:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 42us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201200.835414:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4060 00000100:00100000:1.0:1788201200.835430:0:94489:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc109062480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201200.835443:0:94489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc44700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94489:1875060715243776:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788201200.835479:0:94489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201200.838077:0:94488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788201200.838165:0:94488:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:2.0:1788201200.838622:0:94456:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788201200.838656:0:94456:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788201200.839185:0:94456:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788201200.839199:0:94456:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788201200.839228:0:94456:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201200.840207:0:94456:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788201200.840742:0:94456:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788201200.840774:0:94456:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788201200.840860:0:94456:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788201200.841404:0:94456:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x54:0x0] (8/32) registered 00000040:00080000:1.0:1788201200.844912:0:94489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788201200.845044:0:94489:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788201200.845050:0:94489:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:2.0:1788201200.849831:0:94456:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 120259084296 00010000:00080000:2.0:1788201200.851593:0:94490:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 94490 00010000:02000000:2.0:1788201200.851610:0:94490:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:2.0:1788201200.851615:0:94490:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1788201200.851618:0:94490:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1788201200.851770:0:94456:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788201200.851790:0:94456:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788201200.851811:0:94456:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788201200.851828:0:94456:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788201200.852770:0:94456:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788201200.853034:0:94456:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788201201.433562:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788201201.941880:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788201201.941889:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc11d438000 from 127 10000000:01000000:0.0:1788201201.941896:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788201201.941948:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782ca00/0x96d0c9b8c9a1c600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201201.941959:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc00782ca00/0x96d0c9b8c9a1c600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201201.941971:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc00782ca00/0x96d0c9b8c9a1c600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201201.941997:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715243904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201201.942085:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201201.942147:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006c05240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201201.942232:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715243904 00000100:00100000:1.0:1788201201.942240:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715243904 00000100:00100000:1.0:1788201201.942307:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788201201.942317:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134206450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+10:6529:x1875060715243904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201201.942331:0:94467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201201.942346:0:94467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fc200/0x96d0c9b8c9a1c607 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c600 expref: -99 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201201.942369:0:94467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fc200/0x96d0c9b8c9a1c607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c600 expref: 11 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201201.942379:0:94467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fc200/0x96d0c9b8c9a1c607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c600 expref: 11 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201201.942388:0:94467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fc200, rc 0) 00000100:00100000:1.0:1788201201.942428:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134206450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715243904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201201.942434:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788201201.942542:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715243904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201201.942557:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc00782ca00/0x96d0c9b8c9a1c600 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c607 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201201.942566:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc00782ca00/0x96d0c9b8c9a1c600 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c607 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201201.942615:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715244032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788201201.942644:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201201.944601:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006c05240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201201.949851:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715244032 00000100:00100000:1.0:1788201201.949868:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715244032 00000100:00100000:1.0:1788201201.949993:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788201201.950004:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134207850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715244032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788201201.950046:0:94464:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788201201.950067:0:94464:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788201201.950070:0:94464:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 127 00000100:00100000:1.0:1788201201.950202:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134207850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715244032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 199us (7556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201201.950210:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788201201.957203:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715244032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788201201.957284:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788201201.957296:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782ca00/0x96d0c9b8c9a1c600 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c607 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201201.957306:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc00782ca00/0x96d0c9b8c9a1c600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c607 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201201.957317:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788201201.957320:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc0053a4000 from 58 10000000:01000000:0.0:1788201201.957323:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201201.957359:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782d600/0x96d0c9b8c9a1c60e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201201.957367:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc00782d600/0x96d0c9b8c9a1c60e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201201.957376:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc00782d600/0x96d0c9b8c9a1c60e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201201.957407:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715244160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201201.957468:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201201.957527:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006c05240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201201.957575:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715244160 00000100:00100000:3.0:1788201201.957582:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715244160 00000100:00100000:3.0:1788201201.957636:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201201.957647:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134204c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715244160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201201.957660:0:94467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201201.957672:0:94467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc125ae2200/0x96d0c9b8c9a1c615 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c60e expref: -99 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201201.957695:0:94467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc125ae2200/0x96d0c9b8c9a1c615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c60e expref: 12 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201201.957706:0:94467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc125ae2200/0x96d0c9b8c9a1c615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c60e expref: 12 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201201.957715:0:94467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2200, rc 0) 00000100:00100000:3.0:1788201201.957764:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134204c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715244160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201201.957778:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788201201.957915:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715244160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201201.957927:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc00782d600/0x96d0c9b8c9a1c60e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c615 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201201.957936:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc00782d600/0x96d0c9b8c9a1c60e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c615 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201201.957993:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715244288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201201.958049:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201201.958073:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006c05240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201201.958122:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715244288 00000100:00100000:3.0:1788201201.958127:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715244288 00000100:00100000:3.0:1788201201.958159:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788201201.958166:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715244288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201201.958279:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715244288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201201.958286:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788201201.958352:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715244288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201201.958379:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715244416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201201.958419:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201201.958442:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006c05240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201201.958479:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715244416 00000100:00100000:3.0:1788201201.958483:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715244416 00000100:00100000:3.0:1788201201.958519:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788201201.958525:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715244416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201201.958604:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715244416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201201.958611:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788201201.958682:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715244416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201201.960369:0:94544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:3.0:1788201201.960588:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:3.0:1788201201.960616:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201201.960628:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782d600/0x96d0c9b8c9a1c60e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c615 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201201.960640:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc00782d600/0x96d0c9b8c9a1c60e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c615 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201201.960650:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788201201.960653:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc0053a4000 from 124 10000000:01000000:3.0:1788201201.960656:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788201201.960687:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1c61c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201201.960706:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1c61c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201201.960716:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1c61c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201201.960752:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715244544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201201.960807:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201201.960839:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ce66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201201.960939:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715244544 00000100:00100000:0.0:1788201201.960944:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715244544 00000100:00100000:0.0:1788201201.962855:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788201201.962873:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715244544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201201.962889:0:94467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201201.962913:0:94467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782da00/0x96d0c9b8c9a1c623 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c61c expref: -99 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201201.962937:0:94467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782da00/0x96d0c9b8c9a1c623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c61c expref: 13 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201201.962948:0:94467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782da00/0x96d0c9b8c9a1c623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c61c expref: 13 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201201.962956:0:94467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782da00, rc 0) 00000100:00100000:0.0:1788201201.963034:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715244544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (2227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201201.963041:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788201201.964981:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715244544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201201.965007:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1c61c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c623 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.965039:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1c61c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c623 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201201.965120:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715244672:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788201201.965175:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201201.965834:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102adce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201201.969640:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715244672 00000100:00100000:1.0:1788201201.969656:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715244672 00000100:00100000:1.0:1788201201.969722:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788201201.969750:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715244672:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788201201.969779:0:94463:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788201201.969794:0:94463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788201201.969798:0:94463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1788201201.969801:0:94463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1788201201.969804:0:94463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1788201201.969806:0:94463:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 127 00000100:00100000:1.0:1788201201.969933:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715244672:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 184us (4756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201201.969941:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788201201.971121:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715244672:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788201201.971205:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788201201.971216:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1c61c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c623 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.971227:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1c61c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c623 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201201.971241:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788201201.971244:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:2.0:1788201201.971247:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788201201.971276:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adf600/0x96d0c9b8c9a1c62a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.971283:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007adf600/0x96d0c9b8c9a1c62a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.971292:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007adf600/0x96d0c9b8c9a1c62a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201201.971310:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715244800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201201.971350:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201201.971379:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102adce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201201.971436:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715244800 00000100:00100000:1.0:1788201201.971443:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715244800 00000100:00100000:1.0:1788201201.971486:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788201201.971495:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715244800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201201.971517:0:94464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201201.971530:0:94464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fd800/0x96d0c9b8c9a1c631 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c62a expref: -99 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201201.971553:0:94464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fd800/0x96d0c9b8c9a1c631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c62a expref: 14 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201201.971564:0:94464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fd800/0x96d0c9b8c9a1c631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c62a expref: 14 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201201.971573:0:94464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fd800, rc 0) 00000100:00100000:1.0:1788201201.971607:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715244800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201201.971614:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788201201.976807:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715244800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201201.976837:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007adf600/0x96d0c9b8c9a1c62a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c631 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201201.976851:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007adf600/0x96d0c9b8c9a1c62a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c631 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201201.976965:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715244928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201201.977037:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201201.977077:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102adce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201201.977226:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715244928 00000100:00100000:1.0:1788201201.977240:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715244928 00000100:00100000:1.0:1788201201.977292:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788201201.977302:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715244928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201201.977454:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715244928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201201.977462:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788201201.977682:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715244928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201201.977710:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715245056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201201.977828:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201201.977860:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102adce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201201.977875:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715245056 00000100:00100000:2.0:1788201201.977878:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715245056 00000100:00100000:2.0:1788201201.977912:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788201201.977919:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715245056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201201.978010:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715245056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201201.978043:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788201201.978076:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715245056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201201.979480:0:94545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 52 00000020:01000000:3.0:1788201201.980835:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-52 (rc=0) 10000000:01000000:3.0:1788201201.980861:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788201201.980872:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adf600/0x96d0c9b8c9a1c62a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c631 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201201.980884:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007adf600/0x96d0c9b8c9a1c62a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c631 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201201.980894:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1788201201.980897:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dc0053a4000 from 1 10000000:01000000:3.0:1788201201.980900:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788201201.980933:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201201.980941:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201201.980952:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201201.980990:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715245184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201201.981062:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201201.981102:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ce6240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201201.981203:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715245184 00000100:00100000:0.0:1788201201.981210:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715245184 00000100:00100000:0.0:1788201201.981249:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788201201.981259:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715245184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201201.981271:0:94461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201201.981285:0:94461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782d800/0x96d0c9b8c9a1c63f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c638 expref: -99 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201201.981307:0:94461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782d800/0x96d0c9b8c9a1c63f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c638 expref: 15 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201201.981317:0:94461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782d800/0x96d0c9b8c9a1c63f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c638 expref: 15 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201201.981326:0:94461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782d800, rc 0) 00000100:00100000:0.0:1788201201.981371:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715245184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201201.981387:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788201201.981517:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715245184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201201.981531:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c638 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c63f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201201.981540:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c638 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c63f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201201.981553:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788201201.981557:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c638 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c63f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201201.981563:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c63f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201201.981570:0:6529:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788201201.981571:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc0053a4000 from 7 10000000:01000000:3.0:1788201201.981573:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201201.981586:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3600/0x96d0c9b8c9a1c646 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201201.981593:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3600/0x96d0c9b8c9a1c646 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201201.981600:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3600/0x96d0c9b8c9a1c646 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201201.981624:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715245312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201201.981647:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201201.981677:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ce6240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201201.981738:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715245312 00000100:00100000:1.0:1788201201.981743:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715245312 00000100:00100000:1.0:1788201201.981775:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788201201.981782:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715245312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201201.981789:0:94463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201201.981797:0:94463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fdc00/0x96d0c9b8c9a1c64d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c646 expref: -99 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201201.981809:0:94463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fdc00/0x96d0c9b8c9a1c64d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c646 expref: 16 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201201.981817:0:94463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fdc00/0x96d0c9b8c9a1c64d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c646 expref: 16 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201201.981823:0:94463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fdc00, rc 0) 00000100:00100000:1.0:1788201201.981858:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715245312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201201.981864:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788201201.982578:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715245312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201201.982591:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3600/0x96d0c9b8c9a1c646 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c64d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201201.982600:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3600/0x96d0c9b8c9a1c646 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c64d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201201.982657:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715245440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201201.982689:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201201.982715:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006c05300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201201.984999:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715245440 00000100:00100000:3.0:1788201201.985011:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715245440 00000100:00100000:3.0:1788201201.985085:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788201201.985095:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715245440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201201.985251:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715245440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (2560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201201.985258:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788201201.985967:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715245440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201201.986046:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715245568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201201.986468:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201201.986522:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006c05300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201201.987582:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715245568 00000100:00100000:1.0:1788201201.987592:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715245568 00000100:00100000:1.0:1788201201.987645:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788201201.987655:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715245568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201201.987817:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715245568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201201.987825:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201201.988053:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715245568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201201.989146:0:94547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788201201.989409:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788201201.989436:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201201.989448:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3600/0x96d0c9b8c9a1c646 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c64d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201201.989459:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3600/0x96d0c9b8c9a1c646 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c64d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201201.989470:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788201201.989472:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc001db6000 from 58 10000000:01000000:1.0:1788201201.989476:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788201201.989523:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1c654 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201201.989532:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1c654 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201201.989542:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1c654 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201201.989567:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715245696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201201.989624:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201201.989667:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007110900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201201.989733:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715245696 00000100:00100000:3.0:1788201201.989740:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715245696 00000100:00100000:3.0:1788201201.989786:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788201201.989795:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715245696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201201.989808:0:94461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201201.989820:0:94461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1c65b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c654 expref: -99 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201201.989840:0:94461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1c65b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c654 expref: 17 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201201.989849:0:94461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1c65b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c654 expref: 17 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201201.989857:0:94461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3000, rc 0) 00000100:00100000:3.0:1788201201.989901:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715245696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201201.989920:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788201201.990318:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715245696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201201.990335:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1c654 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c65b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201201.990345:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1c654 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c65b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201201.990404:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715245824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201201.990442:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201201.990470:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006c05240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201201.990613:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715245824 00000100:00100000:3.0:1788201201.990619:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715245824 00000100:00100000:3.0:1788201201.990654:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788201201.990661:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715245824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201201.990794:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715245824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201201.990800:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788201201.990988:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715245824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201201.991052:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715245952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201201.991095:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201201.991119:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006c05240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201201.991943:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715245952 00000100:00100000:3.0:1788201201.991951:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715245952 00000100:00100000:3.0:1788201201.991992:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788201201.992000:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715245952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201201.992132:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715245952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201201.992140:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788201201.992311:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715245952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201201.998695:0:94548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:0.0:1788201201.998922:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:0.0:1788201201.998946:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201201.998958:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1c654 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c65b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201201.998970:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1c654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c65b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201201.998979:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788201201.998982:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1788201201.998985:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788201201.999058:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782c800/0x96d0c9b8c9a1c662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201201.999067:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc00782c800/0x96d0c9b8c9a1c662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201201.999078:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc00782c800/0x96d0c9b8c9a1c662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201201.999103:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715246080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201201.999179:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201202.007125:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006c05240 going to sleep for 10 seconds 00000100:00100000:3.0:1788201202.007298:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715246080 00000100:00100000:3.0:1788201202.007308:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715246080 00000100:00100000:3.0:1788201202.007359:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788201202.007368:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003bfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715246080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201202.007384:0:94467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201202.007400:0:94467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc125ae3200/0x96d0c9b8c9a1c669 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c662 expref: -99 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201202.007425:0:94467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc125ae3200/0x96d0c9b8c9a1c669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c662 expref: 18 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201202.007436:0:94467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc125ae3200/0x96d0c9b8c9a1c669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c662 expref: 18 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201202.007457:0:94467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3200, rc 0) 00000100:00100000:3.0:1788201202.007526:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003bfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715246080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (8347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201202.007533:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788201202.007631:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715246080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201202.007648:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc00782c800/0x96d0c9b8c9a1c662 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c669 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201202.007658:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc00782c800/0x96d0c9b8c9a1c662 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c669 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201202.007748:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715246208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201202.007780:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201202.007800:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006c05240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201202.008108:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715246208 00000100:00100000:3.0:1788201202.008113:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715246208 00000100:00100000:3.0:1788201202.008136:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788201202.008141:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003bfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715246208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201202.008302:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003bfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715246208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201202.008309:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788201202.008330:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715246208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201202.008356:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715246336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201202.008391:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201202.008408:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1065c7780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201202.008419:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715246336 00000100:00100000:3.0:1788201202.008421:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715246336 00000100:00100000:3.0:1788201202.008436:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788201202.008441:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715246336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201202.012819:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715246336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4367us (4417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201202.012844:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788201202.015874:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715246336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201202.018289:0:94551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1788201202.018359:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1788201202.018384:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788201202.018396:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782c800/0x96d0c9b8c9a1c662 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c669 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201202.018408:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc00782c800/0x96d0c9b8c9a1c662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c669 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201202.018418:0:6529:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201202.018420:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc001db6000 from 7 10000000:01000000:0.0:1788201202.018423:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201202.018459:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c670 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201202.018468:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c670 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201202.018493:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c670 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201202.018528:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715246464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201202.018593:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201202.018634:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006c05240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201202.018654:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715246464 00000100:00100000:0.0:1788201202.018661:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715246464 00000100:00100000:0.0:1788201202.018705:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788201202.018714:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715246464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201202.019671:0:94461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201202.019687:0:94461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782c600/0x96d0c9b8c9a1c677 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c670 expref: -99 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201202.019712:0:94461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782c600/0x96d0c9b8c9a1c677 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c670 expref: 19 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201202.019722:0:94461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782c600/0x96d0c9b8c9a1c677 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c670 expref: 19 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201202.021386:0:94461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782c600, rc 0) 00000100:00100000:0.0:1788201202.021469:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715246464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2753us (2873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201202.021477:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788201202.024710:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715246464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201202.024802:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c670 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c677 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201202.024826:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c670 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c677 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201202.024915:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715246592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201202.024972:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201202.025034:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105f1d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201202.025116:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715246592 00000100:00100000:0.0:1788201202.025123:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715246592 00000100:00100000:0.0:1788201202.025176:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788201202.025186:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715246592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201202.025320:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715246592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201202.025328:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788201202.027081:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715246592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201202.027134:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715246720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201202.027196:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201202.027229:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105f1d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201202.027843:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715246720 00000100:00100000:0.0:1788201202.027850:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715246720 00000100:00100000:0.0:1788201202.027896:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788201202.027905:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715246720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201202.028040:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715246720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201202.028047:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788201202.028575:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715246720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201202.031244:0:94553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788201202.036798:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788201202.036842:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201202.036979:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c670 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c677 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201202.036993:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c670 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c677 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201202.037004:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788201202.037006:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc13aa9f000 from 58 10000000:01000000:3.0:1788201202.037009:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201202.037067:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2600/0x96d0c9b8c9a1c67e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201202.037076:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2600/0x96d0c9b8c9a1c67e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201202.037094:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2600/0x96d0c9b8c9a1c67e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201202.037127:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715246848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201202.037201:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201202.037247:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105f1d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201202.037309:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715246848 00000100:00100000:0.0:1788201202.037316:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715246848 00000100:00100000:0.0:1788201202.037368:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788201202.037378:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715246848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201202.037391:0:94463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201202.037402:0:94463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1c685 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c67e expref: -99 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201202.037424:0:94463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1c685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c67e expref: 20 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201202.037434:0:94463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1c685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c67e expref: 20 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201202.037443:0:94463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782c400, rc 0) 00000100:00100000:0.0:1788201202.037492:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715246848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201202.037517:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788201202.039565:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715246848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201202.039590:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2600/0x96d0c9b8c9a1c67e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c685 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201202.039602:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2600/0x96d0c9b8c9a1c67e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c685 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201202.039681:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715246976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201202.039727:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201202.039764:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102adc900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201202.039886:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715246976 00000100:00100000:0.0:1788201202.039893:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715246976 00000100:00100000:0.0:1788201202.039945:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788201202.039955:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715246976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201202.040107:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715246976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201202.040115:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788201202.041627:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715246976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201202.041671:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715247104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201202.041727:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201202.041768:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102adc900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201202.041816:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715247104 00000100:00100000:0.0:1788201202.041822:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715247104 00000100:00100000:0.0:1788201202.041870:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788201202.041879:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715247104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201202.041987:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715247104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201202.041994:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788201202.042049:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715247104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201202.042834:0:94555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:2.0:1788201202.043089:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:2.0:1788201202.043110:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788201202.043119:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2600/0x96d0c9b8c9a1c67e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c685 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201202.043130:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2600/0x96d0c9b8c9a1c67e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c685 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201202.043139:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788201202.043141:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1788201202.043144:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788201202.043168:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c68c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201202.043176:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c68c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201202.043185:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c68c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201202.043200:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715247232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201202.043234:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201202.043268:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102adc900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201202.043386:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715247232 00000100:00100000:3.0:1788201202.043392:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715247232 00000100:00100000:3.0:1788201202.043428:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788201202.043436:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715247232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201202.043445:0:94461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201202.043456:0:94461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc125ae2e00/0x96d0c9b8c9a1c693 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c68c expref: -99 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201202.043476:0:94461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc125ae2e00/0x96d0c9b8c9a1c693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c68c expref: 21 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201202.043486:0:94461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc125ae2e00/0x96d0c9b8c9a1c693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c68c expref: 21 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201202.043494:0:94461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2e00, rc 0) 00000100:00100000:3.0:1788201202.043542:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715247232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201202.043548:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788201202.043622:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715247232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201202.043634:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c68c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c693 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201202.043643:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c68c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c693 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201202.043693:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715247360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201202.043713:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201202.043816:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102adc900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201202.045865:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715247360 00000100:00100000:1.0:1788201202.045876:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715247360 00000100:00100000:1.0:1788201202.045929:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788201202.045937:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715247360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201202.046112:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715247360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (2396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201202.046119:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788201202.046275:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715247360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201202.046316:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715247488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201202.046360:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201202.046393:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105f1d780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201202.046431:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715247488 00000100:00100000:1.0:1788201202.046434:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715247488 00000100:00100000:1.0:1788201202.047629:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788201202.047640:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715247488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201202.048584:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715247488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 944us (2220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201202.048594:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788201202.048685:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715247488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201202.049917:0:94557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1788201202.050071:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1788201202.050112:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788201202.050124:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c68c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c693 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201202.050136:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c68c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c693 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201202.050146:0:6529:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201202.050149:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc13aa9f000 from 7 10000000:01000000:0.0:1788201202.050158:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201202.050189:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782de00/0x96d0c9b8c9a1c69a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201202.050197:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc00782de00/0x96d0c9b8c9a1c69a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201202.050206:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc00782de00/0x96d0c9b8c9a1c69a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201202.050226:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715247616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201202.050270:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201202.050539:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f733c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201202.050573:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715247616 00000100:00100000:3.0:1788201202.050581:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715247616 00000100:00100000:3.0:1788201202.050628:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788201202.050638:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715247616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201202.050650:0:94464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201202.050664:0:94464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc125ae2c00/0x96d0c9b8c9a1c6a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c69a expref: -99 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201202.050688:0:94464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc125ae2c00/0x96d0c9b8c9a1c6a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c69a expref: 22 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201202.050697:0:94464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc125ae2c00/0x96d0c9b8c9a1c6a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c69a expref: 22 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201202.050706:0:94464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2c00, rc 0) 00000100:00100000:3.0:1788201202.050755:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715247616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201202.050762:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788201202.050807:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715247616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201202.050819:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc00782de00/0x96d0c9b8c9a1c69a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c6a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201202.050829:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc00782de00/0x96d0c9b8c9a1c69a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c6a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201202.050884:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715247744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201202.050918:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201202.050932:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10555ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201202.050946:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715247744 00000100:00100000:3.0:1788201202.050949:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715247744 00000100:00100000:3.0:1788201202.050983:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788201202.050989:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715247744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201202.051123:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715247744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201202.051131:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788201202.051163:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715247744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201202.051188:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715247872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201202.051221:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201202.051240:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10555ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201202.051330:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715247872 00000100:00100000:1.0:1788201202.051342:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715247872 00000100:00100000:1.0:1788201202.051405:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788201202.051418:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715247872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201202.053160:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715247872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1732us (1924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201202.053175:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788201202.053197:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715247872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201202.054379:0:94558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788201202.054835:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788201202.054878:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201202.054889:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782de00/0x96d0c9b8c9a1c69a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c6a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201202.054901:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc00782de00/0x96d0c9b8c9a1c69a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c6a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201202.054910:0:6529:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788201202.054913:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8dc12563cd28 from 1 10000000:01000000:3.0:1788201202.054916:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788201202.054952:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3800/0x96d0c9b8c9a1c6a8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201202.054971:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3800/0x96d0c9b8c9a1c6a8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201202.054983:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3800/0x96d0c9b8c9a1c6a8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201202.055007:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715248000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201202.055106:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201202.055146:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10555ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201202.055222:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715248000 00000100:00100000:2.0:1788201202.055230:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715248000 00000100:00100000:2.0:1788201202.055284:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788201202.055294:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715248000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201202.055306:0:94461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201202.055320:0:94461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007adf400/0x96d0c9b8c9a1c6af lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c6a8 expref: -99 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201202.055343:0:94461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007adf400/0x96d0c9b8c9a1c6af lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c6a8 expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201202.055353:0:94461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007adf400/0x96d0c9b8c9a1c6af lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c6a8 expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201202.055362:0:94461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007adf400, rc 0) 00000100:00100000:2.0:1788201202.055409:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715248000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201202.055416:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788201202.056755:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715248000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201202.056958:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3800/0x96d0c9b8c9a1c6a8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c6af expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201202.057088:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3800/0x96d0c9b8c9a1c6a8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c6af expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201202.057123:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788201202.057130:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3800/0x96d0c9b8c9a1c6a8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c6af expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201202.057138:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3800/0x96d0c9b8c9a1c6a8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c6af expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201202.057180:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788201202.057186:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dc12563cd28 from 1 10000000:01000000:0.0:1788201202.057191:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788201202.057225:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782c000/0x96d0c9b8c9a1c6b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201202.057235:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc00782c000/0x96d0c9b8c9a1c6b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201202.057244:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc00782c000/0x96d0c9b8c9a1c6b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201202.057265:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715248128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201202.057314:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201202.057361:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715248128 00000100:00100000:0.0:1788201202.057362:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201202.057373:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715248128 00000100:00100000:1.0:1788201202.057447:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788201202.057462:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715248128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201202.058677:0:94463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201202.058709:0:94463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fce00/0x96d0c9b8c9a1c6bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c6b6 expref: -99 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201202.058746:0:94463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fce00/0x96d0c9b8c9a1c6bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c6b6 expref: 24 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201202.058758:0:94463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fce00/0x96d0c9b8c9a1c6bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c6b6 expref: 24 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201202.058769:0:94463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fce00, rc 0) 00000100:00100000:1.0:1788201202.059467:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715248128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2005us (2148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201202.059486:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715248128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201202.059520:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc00782c000/0x96d0c9b8c9a1c6b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c6bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201202.059543:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc00782c000/0x96d0c9b8c9a1c6b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c6bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201202.059614:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715248256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201202.059659:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201202.059692:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201202.059712:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788201202.059783:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715248256 00000100:00100000:1.0:1788201202.060372:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715248256 00000100:00100000:1.0:1788201202.060446:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788201202.060458:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715248256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201202.060615:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715248256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (955us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201202.060623:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788201202.061209:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715248256:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788201202.061258:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788201202.061267:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782c000/0x96d0c9b8c9a1c6b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c6bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201202.061276:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc00782c000/0x96d0c9b8c9a1c6b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c6bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201202.137431:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201202.137607:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695426688 00000100:00100000:1.0:1788201202.137618:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695426688 00000100:00100000:1.0:1788201202.137677:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 72 00000100:00100000:1.0:1788201202.137689:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695426688:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201202.137707:0:94464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201202.137831:0:94464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fde00/0x96d0c9b8c9a1c6c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786928 expref: -99 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201202.137865:0:94464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fde00/0x96d0c9b8c9a1c6c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786928 expref: 10 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201202.137877:0:94464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fde00/0x96d0c9b8c9a1c6c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786928 expref: 10 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201202.137886:0:94464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fde00, rc 0) 00000100:00100000:1.0:1788201202.137949:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695426688:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 262us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201202.137956:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 72 00000100:00100000:3.0:1788201202.148075:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201202.148160:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695426816 00000100:00100000:0.0:1788201202.148171:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695426816 00000100:00100000:0.0:1788201202.148239:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 73 00000100:00100000:0.0:1788201202.148250:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695426816:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788201202.148278:0:94467:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1788201202.148300:0:94467:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788201202.148304:0:94467:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1788201202.148307:0:94467:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1788201202.148310:0:94467:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1788201202.148313:0:94467:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 127 00000100:00100000:0.0:1788201202.150076:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695426816:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 Request processed in 1819us (2055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201202.150095:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 73 00000100:00100000:1.0:1788201202.155152:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201202.158171:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695426944 00000100:00100000:2.0:1788201202.158189:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695426944 00000100:00100000:2.0:1788201202.159814:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1445 00000100:00100000:2.0:1788201202.159846:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695426944:12345-192.168.201.20@tcp:38:ll_cfg_requeue.0 00010000:00080000:2.0:1788201202.159882:0:66757:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '6e293f14-c501-4bc5-9dd4-a18ef02756b4' at ffff8dc103483800, cookie 0x96d0c9b8c9a1c551 00010000:00080000:2.0:1788201202.159888:0:66757:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp recovering/t120259084297 exp ffff8dc103483800 cur 4053 last 1788201200 00010000:02000400:2.0:1788201202.159897:0:66757:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1788201202.159903:0:66757:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1788201202.159923:0:66757:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788201202.160083:0:66757:0:(import.c:65:import_set_state_nolock()) ffff8dc103ca4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201202.160168:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695426944:12345-192.168.201.20@tcp:38:ll_cfg_requeue.0 Request processed in 323us (5025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201202.160176:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1445 00000100:00100000:3.0:1788201202.169901:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201202.170120:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695417728 00000100:00100000:2.0:1788201202.170131:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695417728 00000100:00100000:2.0:1788201202.170240:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1446 00000100:00100000:2.0:1788201202.170251:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695417728:12345-192.168.201.20@tcp:36:mcreate.0 00010000:00080000:2.0:1788201202.170288:0:66312:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 120259084297, current: 120259084297, replaying 00000100:00100000:2.0:1788201202.170312:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695417728:12345-192.168.201.20@tcp:36:mcreate.0 Request processed in 63us (421us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201202.170319:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1446 00010000:00080000:3.0:1788201202.170362:0:94490:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:1.0:1788201202.450647:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201203.472604:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201203.672899:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201203.672956:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201203.672994:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695427200 00000100:00100000:3.0:1788201203.673007:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695427200 00000100:00100000:3.0:1788201203.673145:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1447 00000100:00100000:3.0:1788201203.673160:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2403:x1875060695427200:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201203.674083:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695427072 00000100:00100000:0.0:1788201203.674094:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695427072 00000100:00100000:3.0:1788201203.676935:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2403:x1875060695427200:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 3759us (4032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201203.676957:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1447 00000100:00080000:3.0:1788201203.677061:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201203.684436:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 74 00000100:00100000:0.0:1788201203.684468:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695427072:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201203.684619:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695427072:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 154us (11650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201203.684629:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 74 00000100:00100000:2.0:1788201204.047582:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715248512:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201204.047651:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201204.047710:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715248512 00000100:00100000:2.0:1788201204.047717:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715248512 00000100:00100000:2.0:1788201204.047778:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2320 00000100:00100000:2.0:1788201204.047788:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715248512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201204.047814:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201204.047862:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715248512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201204.047868:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2320 00000100:00080000:2.0:1788201204.047888:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201204.047922:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715248512:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201204.048216:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201204.048226:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715248384:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201204.048252:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201204.048371:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715248384 00000100:00100000:0.0:1788201204.048376:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715248384 00000100:00100000:0.0:1788201204.048411:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2321 00000100:00100000:0.0:1788201204.048419:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715248384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201204.048435:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788201204.048521:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715248384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201204.048527:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2321 00000100:00080000:2.0:1788201204.048594:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201204.048617:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715248384:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788201204.495270:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201205.519412:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201205.916652:0:94741:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1788201206.096154:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201206.096160:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201206.096170:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201206.096184:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc1401c4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201206.096220:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc120092300 x1875060715248768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201206.096254:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201206.096257:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201206.096258:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201206.096264:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc0034f0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201206.096277:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc137c37100 x1875060715249024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201206.096292:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 1 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201206.096295:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201206.096296:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201206.096301:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201206.096311:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc137c34700 x1875060715249280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201206.096329:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201206.096331:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201206.096333:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201206.096337:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201206.096345:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc137c37b80 x1875060715249664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201206.096372:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201206.096374:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201206.096382:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc137d33000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201206.096387:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dc137d33000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201206.096399:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc0058aa680 x1875060715250176/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201206.096438:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715248768:0@lo:38:kworker.0 00000100:00100000:3.0:1788201206.096510:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201206.096541:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715249024:0@lo:38:kworker.0 00000100:00100000:3.0:1788201206.096565:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201206.096583:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715249280:0@lo:38:kworker.0 00000100:00100000:3.0:1788201206.096607:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201206.096624:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715249664:0@lo:38:kworker.0 00000100:00100000:3.0:1788201206.096645:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201206.096659:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715250176:0@lo:38:kworker.0 00000100:00100000:3.0:1788201206.096684:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201206.096719:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715249152:0@lo:400:kworker.0 00000100:00100000:3.0:1788201206.096743:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201206.096758:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715249920:0@lo:400:kworker.0 00000100:00100000:3.0:1788201206.096779:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201206.096800:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788201206.096805:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715248896:0@lo:400:kworker.0 00000100:00100000:3.0:1788201206.096826:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201206.096836:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715249792:0@lo:400:kworker.0 00000100:00100000:3.0:1788201206.096854:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201206.096885:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715248768 00000100:00100000:3.0:1788201206.096898:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715248768 00000100:00100000:3.0:1788201206.096924:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715249024 00000100:00100000:3.0:1788201206.096927:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715249024 00000100:00100000:3.0:1788201206.096935:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715249664 00000100:00100000:3.0:1788201206.096937:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715249664 00000100:00100000:3.0:1788201206.096944:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715250176 00000100:00100000:3.0:1788201206.096946:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715250176 00000100:00100000:3.0:1788201206.096952:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715249152 00000100:00100000:3.0:1788201206.096954:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715249152 00000100:00100000:3.0:1788201206.096979:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715248896 00000100:00100000:3.0:1788201206.096982:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715248896 00000100:00100000:3.0:1788201206.097000:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000100:00100000:3.0:1788201206.097009:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715249152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201206.097083:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715249152:12345-0@lo:400:kworker.0 Request processed in 76us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201206.097090:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00000100:00100000:3.0:1788201206.097107:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:3.0:1788201206.097113:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715248896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201206.097139:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715248896:12345-0@lo:400:kworker.0 Request processed in 26us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201206.097144:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000100:00100000:3.0:1788201206.097157:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:3.0:1788201206.097161:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715248768:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788201206.097182:0:69485:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 4057 last 0 00000020:00000080:3.0:1788201206.097215:0:69485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x96d0c9b8c9a1c6cb 00000004:00100000:3.0:1788201206.097228:0:69485:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201206.097358:0:69485:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201206.097398:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875060715248768:12345-0@lo:38:kworker.0 Request processed in 236us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201206.097412:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:3.0:1788201206.097425:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000100:00100000:3.0:1788201206.097442:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715249024:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788201206.097456:0:69485:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 4057 last 0 00000020:00000080:3.0:1788201206.097479:0:69485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x96d0c9b8c9a1c6d2 00000004:00100000:3.0:1788201206.097485:0:69485:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201206.097501:0:69485:0:(import.c:65:import_set_state_nolock()) ffff8dc11d63f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201206.097529:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875060715249024:12345-0@lo:38:kworker.0 Request processed in 86us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201206.097535:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00000100:00100000:3.0:1788201206.097548:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:3.0:1788201206.097553:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715249664:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788201206.097565:0:69485:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 4057 last 0 00000020:00000080:3.0:1788201206.097585:0:69485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x96d0c9b8c9a1c6d9 00000004:00100000:3.0:1788201206.097591:0:69485:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201206.097605:0:69485:0:(import.c:65:import_set_state_nolock()) ffff8dc103483000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201206.097633:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875060715249664:12345-0@lo:38:kworker.0 Request processed in 78us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201206.097639:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000100:00100000:3.0:1788201206.097650:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1450 00000100:00100000:3.0:1788201206.097655:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715250176:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788201206.097667:0:69485:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 4057 last 0 00000020:00000080:3.0:1788201206.097687:0:69485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x96d0c9b8c9a1c6e0 00000004:00100000:3.0:1788201206.097693:0:69485:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201206.097713:0:69485:0:(import.c:65:import_set_state_nolock()) ffff8dc137d30800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201206.097741:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875060715250176:12345-0@lo:38:kworker.0 Request processed in 85us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201206.097748:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1450 00000100:00100000:3.0:1788201206.097770:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715249280 00000100:00100000:3.0:1788201206.097774:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715249280 00000100:00100000:3.0:1788201206.097791:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715249792 00000100:00100000:3.0:1788201206.097793:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715249792 00000100:00100000:3.0:1788201206.097813:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4061 00000100:00100000:3.0:1788201206.097817:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715249280:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788201206.097831:0:8458:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8dc103486000, cookie 0x96d0c9b8c9a1c54a 00010000:00080000:3.0:1788201206.097835:0:8458:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t120259084299 exp ffff8dc103486000 cur 4057 last 1788201200 00000004:00100000:3.0:1788201206.097843:0:8458:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201206.097858:0:8458:0:(import.c:65:import_set_state_nolock()) ffff8dc137d36000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201206.097893:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715249280:12345-0@lo:38:kworker.0 Request processed in 74us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201206.097899:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4061 00000100:00100000:3.0:1788201206.097911:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4062 00000100:00100000:3.0:1788201206.097917:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715249792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201206.097947:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715249792:12345-0@lo:400:kworker.0 Request processed in 31us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201206.097953:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4062 00000100:00100000:3.0:1788201206.097979:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715249920 00000100:00100000:3.0:1788201206.097983:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715249920 00000100:00100000:3.0:1788201206.098030:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2859 00000100:00100000:3.0:1788201206.098039:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715249920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201206.098079:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715249920:12345-0@lo:400:kworker.0 Request processed in 42us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201206.098085:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2859 00010000:00080000:3.0:1788201206.098109:0:94490:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788201206.098114:0:94490:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 120259084297 00000020:00080000:3.0:1788201206.098118:0:94490:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201206.098122:0:94490:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 120259084297, next_transno: 120259084297 00010000:00080000:3.0:1788201206.098125:0:94490:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (120259084297) 00000020:00080000:3.0:1788201206.098128:0:94490:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201206.098136:0:94490:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695417728 t120259084297 from 192.168.201.20@tcp req@ffff8dc120091c00 x1875060695417728/t0(120259084297) o36->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:323/0 lens 528/0 e 0 to 0 dl 1788201213 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201206.098216:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715248896:0@lo:400:kworker.0 00000100:00100000:3.0:1788201206.098228:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715249792:0@lo:400:kworker.0 00000100:00100000:3.0:1788201206.098238:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715249152:0@lo:400:kworker.0 00000100:00100000:3.0:1788201206.098247:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715249920:0@lo:400:kworker.0 00010000:00080000:3.0:1788201206.098284:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc120092300 x1875060715248768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201206.098295:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 29 00000100:00100000:2.0:1788201206.099557:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715248640:0@lo:400:kworker.0 00000100:00100000:2.0:1788201206.099610:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201206.099653:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715249536:0@lo:400:kworker.0 00000100:00100000:2.0:1788201206.099679:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201206.099699:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715250304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201206.099724:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201206.099744:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788201206.099750:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715249408:0@lo:400:kworker.0 00000100:00100000:2.0:1788201206.099770:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201206.099787:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715250048:0@lo:400:kworker.0 00000100:00100000:2.0:1788201206.099806:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788201206.099843:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201206.099847:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201206.099861:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715250304 00000100:00100000:2.0:1788201206.099865:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715250304 00000100:00100000:2.0:1788201206.099891:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4063 00000100:00100000:2.0:1788201206.099906:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715250304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201206.099932:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:2.0:1788201206.099971:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715250304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201206.099977:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4063 00000100:00100000:2.0:1788201206.100009:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715250304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201206.102419:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715248640 00000100:00100000:0.0:1788201206.102441:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715248640 00000100:00100000:0.0:1788201206.102488:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788201206.102496:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715248640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201206.102583:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715248640:12345-0@lo:400:kworker.0 Request processed in 88us (2972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201206.102591:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788201206.102646:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715248640:0@lo:400:kworker.0 00000100:00100000:1.0:1788201206.102818:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715249536 00000100:00100000:1.0:1788201206.102823:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715249536 00000100:00100000:1.0:1788201206.102859:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715249408 00000100:00100000:1.0:1788201206.102862:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715249408 00000100:00100000:1.0:1788201206.102880:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715250048 00000100:00100000:1.0:1788201206.102883:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715250048 00000100:00100000:1.0:1788201206.102901:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2860 00000100:00100000:1.0:1788201206.102908:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715249536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201206.102948:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715249536:12345-0@lo:400:kworker.0 Request processed in 41us (3267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201206.102954:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2860 00000100:00100000:1.0:1788201206.102967:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2861 00000100:00100000:1.0:1788201206.102974:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715249408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201206.103001:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715249408:12345-0@lo:400:kworker.0 Request processed in 28us (3230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201206.103006:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2861 00000100:00100000:1.0:1788201206.103039:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2862 00000100:00100000:1.0:1788201206.103046:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715250048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201206.103074:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715250048:12345-0@lo:400:kworker.0 Request processed in 29us (3267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201206.103079:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2862 00000100:00080000:1.0:1788201206.103102:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201206.103105:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201206.103295:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715249408:0@lo:400:kworker.0 00000100:00100000:0.0:1788201206.103312:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715250048:0@lo:400:kworker.0 00000100:00100000:0.0:1788201206.103321:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715249536:0@lo:400:kworker.0 00000100:00080000:3.0:1788201206.104920:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8dc120092300 x1875060715248768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201231 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201206.104933:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788201206.104938:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788201206.104942:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788201206.104955:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715248768:0@lo:38:kworker.0 00000004:00080000:3.0:1788201206.104990:0:94490:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 6814us 00010000:00080000:3.0:1788201206.109335:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc137c37100 x1875060715249024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201206.109357:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 29 00000100:00080000:3.0:1788201206.110126:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8dc137c37100 x1875060715249024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201231 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201206.110136:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788201206.110141:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788201206.110145:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788201206.110150:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715249024:0@lo:38:kworker.0 00000100:00080000:3.0:1788201206.110182:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 29 00000100:00080000:3.0:1788201206.110263:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1788201206.110269:0:3654:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1788201206.110271:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084296 gen 3 00000100:00100000:3.0:1788201206.110277:0:3654:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8dc005abc000 x1875060715226752/t120259084299(120259084299) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788201185 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201206.110285:0:3654:0:(recover.c:53:ptlrpc_replay_next()) import ffff8dc109813800 from lustre-MDT0000_UUID committed 120259084296 last 0 00000100:00080000:3.0:1788201206.110292:0:3654:0:(client.c:3553:ptlrpc_replay_req()) @@@ REPLAY req@ffff8dc005abc000 x1875060715226752/t120259084299(120259084299) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788201185 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201206.110302:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715249280:0@lo:38:kworker.0 00010000:00080000:3.0:1788201206.110319:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc137c37b80 x1875060715249664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201206.110329:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 29 00000100:00080000:3.0:1788201206.111078:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8dc137c37b80 x1875060715249664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201231 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201206.111086:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788201206.111089:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788201206.111092:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788201206.111095:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715249664:0@lo:38:kworker.0 00010000:00080000:3.0:1788201206.111114:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc0058aa680 x1875060715250176/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201206.111124:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 29 00000100:00080000:3.0:1788201206.111129:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788201206.111132:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788201206.111134:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc137d33000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788201206.111138:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715250176:0@lo:38:kworker.0 00000100:00100000:3.0:1788201206.111177:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715226752:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201206.113354:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201206.113414:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715226752 00000100:00100000:3.0:1788201206.113422:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715226752 00000100:00100000:3.0:1788201206.113486:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4064 00000100:00100000:3.0:1788201206.113497:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715226752:12345-0@lo:1000:osp_up0-1.0 00010000:00080000:3.0:1788201206.113518:0:83817:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 120259084297, current: 120259084299, replaying 00000100:00100000:3.0:1788201206.113526:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715226752:12345-0@lo:1000:osp_up0-1.0 Request processed in 32us (179us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201206.113532:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4064 00010000:00010000:3.0:1788201206.127672:0:94490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c6e7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.127707:0:94490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c6e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.127721:0:94490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c6e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.127732:0:94490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1c6ee lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.127740:0:94490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1c6ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.127746:0:94490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1c6ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.128142:0:94490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c6e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.128150:0:94490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c6e7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.128156:0:94490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c6e7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.128162:0:94490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201206.128166:0:94490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c6e7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.128173:0:94490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c6e7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.128187:0:94490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc107112200) 00010000:00010000:3.0:1788201206.129651:0:94490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201206.129659:0:94490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c6e7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.129667:0:94490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1c6e7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201206.129687:0:94490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f884f71 reply state 00000000e9af074e transno 120259084297 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1c6ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.129700:0:94490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1c6ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.129708:0:94490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc107112800) 00010000:00010000:3.0:1788201206.129710:0:94490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201206.129712:0:94490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788201206.129826:0:94490:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:3.0:1788201206.129848:0:94490:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201206.129852:0:94490:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 120259084299, next_transno: 120259084298 00000020:00080000:3.0:1788201206.129857:0:94490:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201206.129859:0:94490:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 120259084299, next_transno: 120259084298 00000001:00080000:3.0:1788201206.134692:0:94457:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084297 is committed 00000100:00100000:3.0:1788201206.140070:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201206.140201:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695418240 00000100:00100000:0.0:1788201206.140212:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695418240 00000100:00100000:0.0:1788201206.140273:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1451 00000100:00100000:0.0:1788201206.140284:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2399:x1875060695418240:12345-192.168.201.20@tcp:36:rm.0 00010000:00080000:0.0:1788201206.140304:0:69485:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 120259084298, current: 120259084298, replaying 00000100:00100000:0.0:1788201206.140319:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2399:x1875060695418240:12345-192.168.201.20@tcp:36:rm.0 Request processed in 38us (261us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201206.140326:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1451 00000020:00080000:0.0:1788201206.140346:0:94490:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201206.140350:0:94490:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 2, req_transno: 120259084298, next_transno: 120259084298 00010000:00080000:0.0:1788201206.140354:0:94490:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (120259084298) 00000020:00080000:0.0:1788201206.140357:0:94490:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201206.140365:0:94490:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695418240 t120259084298 from 192.168.201.20@tcp req@ffff8dc0058a8000 x1875060695418240/t0(120259084298) o36->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:327/0 lens 512/0 e 0 to 0 dl 1788201217 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201206.140459:0:94490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c6f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.140475:0:94490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c6f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.140488:0:94490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c6f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.140513:0:94490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c6fc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.140521:0:94490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c6fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.140527:0:94490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c6fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.140944:0:94490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c703 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.140954:0:94490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c703 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.140961:0:94490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c703 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.141276:0:94490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c703 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.141285:0:94490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c703 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.141291:0:94490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c703 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.141297:0:94490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782ce00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201206.141301:0:94490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c703 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.141307:0:94490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c703 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.141328:0:94490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x3:0x0].0x0 (ffff8dc10bed3900) 00010000:00010000:0.0:1788201206.141331:0:94490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201206.141336:0:94490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c703 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.141342:0:94490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1c703 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.141362:0:94490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c6f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.141369:0:94490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c6f5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.141375:0:94490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c6f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.141380:0:94490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201206.141383:0:94490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c6f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.141388:0:94490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c6f5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.141395:0:94490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc10bed3600) 00010000:00010000:0.0:1788201206.141398:0:94490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201206.141401:0:94490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c6f5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.141406:0:94490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1c6f5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201206.141440:0:94490:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9c7807b reply state 00000000c612f71a transno 120259084298 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c6fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.141451:0:94490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c6fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.141458:0:94490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc107112800) 00010000:00010000:0.0:1788201206.141460:0:94490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201206.141462:0:94490:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788201206.141535:0:94490:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788201206.141553:0:94490:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201206.141556:0:94490:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 120259084299, next_transno: 120259084299 00010000:00080000:0.0:1788201206.141559:0:94490:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (120259084299) 00000020:00080000:0.0:1788201206.141562:0:94490:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201206.141570:0:94490:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060715226752 t120259084299 from 0@lo req@ffff8dc0058aa680 x1875060715226752/t0(120259084299) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:327/0 lens 488/0 e 0 to 0 dl 1788201217 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788201206.141719:0:94490:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788201206.141730:0:94490:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201206.141733:0:94490:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 120259084300 00000100:00080000:3.0:1788201206.141883:0:3654:0:(client.c:3438:ptlrpc_replay_interpret()) @@@ got reply req@ffff8dc005abc000 x1875060715226752/t120259084299(120259084299) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788201222 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201206.141892:0:3654:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1788201206.141894:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084296 gen 3 00000100:00100000:3.0:1788201206.141899:0:3654:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8dc005abc000 x1875060715226752/t120259084299(120259084299) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788201222 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201206.141918:0:3654:0:(recover.c:53:ptlrpc_replay_next()) import ffff8dc109813800 from lustre-MDT0000_UUID committed 120259084296 last 120259084299 00000100:00080000:3.0:1788201206.141926:0:3654:0:(client.c:3553:ptlrpc_replay_req()) @@@ REPLAY req@ffff8dc00a9b4000 x1875060715227008/t120259084300(120259084300) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788201185 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201206.141937:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715226752:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201206.141956:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715227008:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201206.141992:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788201206.142148:0:94490:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201206.142150:0:94490:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 120259084300 00000100:00100000:0.0:1788201206.142635:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715227008 00000100:00100000:0.0:1788201206.142642:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715227008 00000100:00100000:0.0:1788201206.142683:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4065 00000100:00100000:0.0:1788201206.142692:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3654:x1875060715227008:12345-0@lo:1000:osp_up0-1.0 00010000:00080000:0.0:1788201206.142705:0:8458:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 120259084300, current: 120259084300, replaying 00000100:00100000:0.0:1788201206.142715:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3654:x1875060715227008:12345-0@lo:1000:osp_up0-1.0 Request processed in 25us (724us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201206.142725:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4065 00000020:00080000:0.0:1788201206.142735:0:94490:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201206.142747:0:94490:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 120259084300, next_transno: 120259084300 00010000:00080000:0.0:1788201206.142749:0:94490:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (120259084300) 00000020:00080000:0.0:1788201206.142751:0:94490:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201206.142755:0:94490:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060715227008 t120259084300 from 0@lo req@ffff8dc137c37b80 x1875060715227008/t0(120259084300) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:327/0 lens 488/0 e 0 to 0 dl 1788201217 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788201206.142834:0:94490:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788201206.142845:0:94490:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201206.142846:0:94490:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 120259084301 00000020:00080000:0.0:1788201206.142848:0:94490:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201206.142850:0:94490:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 120259084301 00010000:00010000:1.0:1788201206.142974:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1c6ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.142980:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1c6ee lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.142993:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1c6ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.142997:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201206.143000:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1c6ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.143004:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1c6ee lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.143033:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc107112800) 00010000:00010000:1.0:1788201206.143036:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201206.143039:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1c6ee lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.143043:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1c6ee lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788201206.146361:0:3654:0:(client.c:3438:ptlrpc_replay_interpret()) @@@ got reply req@ffff8dc00a9b4000 x1875060715227008/t120259084300(120259084300) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788201222 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201206.146377:0:3654:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1788201206.146380:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084296 gen 3 00000100:00100000:3.0:1788201206.146385:0:3654:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8dc005abc000 x1875060715226752/t120259084299(120259084299) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788201222 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201206.146393:0:3654:0:(recover.c:53:ptlrpc_replay_next()) import ffff8dc109813800 from lustre-MDT0000_UUID committed 120259084296 last 120259084300 00000100:00080000:3.0:1788201206.146398:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1788201206.146592:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715227008:0@lo:1000:osp_up0-1.0 00010000:00080000:0.0:1788201206.151823:0:94755:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:0.0:1788201206.151831:0:94755:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:0.0:1788201206.151837:0:94755:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00010000:00010000:0.0:1788201206.152412:0:94755:0:(ldlm_request.c:2860:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007ade600/0x96d0c9b8c9a1be0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1be12 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201206.152489:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715250432:0@lo:101:ldlm_lock_repla.0 00000100:00100000:3.0:1788201206.152559:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201206.152643:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715250432 00000100:00100000:1.0:1788201206.152650:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715250432 00000100:00100000:1.0:1788201206.152703:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4066 00000100:00100000:1.0:1788201206.152712:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3654:x1875060715250432:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:1.0:1788201206.152748:0:83817:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc137c34700 x1875060715250432/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:327/0 lens 328/0 e 0 to 0 dl 1788201217 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201206.152766:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3654:x1875060715250432:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 55us (207us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201206.152772:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4066 00000020:00080000:1.0:1788201206.152793:0:94490:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788201206.152805:0:94490:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 120259084301 00010000:00080000:0.0:1788201206.154007:0:94755:0:(ldlm_request.c:2910:lock_can_replay()) check lock replay limit, inflights = 1(512) 00000100:00100000:1.0:1788201206.167775:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201206.174865:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695427328 00000100:00100000:3.0:1788201206.174881:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695427328 00000100:00100000:3.0:1788201206.174942:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1450 00000100:00100000:3.0:1788201206.174952:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2399:x1875060695427328:12345-192.168.201.20@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1788201206.174978:0:66314:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc11cc44380 x1875060695427328/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:327/0 lens 224/0 e 0 to 0 dl 1788201217 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201206.175009:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2399:x1875060695427328:12345-192.168.201.20@tcp:400:ldlm_lock_repla.0 Request processed in 59us (7244us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201206.175031:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1450 00000020:00080000:1.0:1788201206.183918:0:94490:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788201206.183926:0:94490:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 120259084301 00010000:00080000:1.0:1788201206.183929:0:94490:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1788201206.183932:0:94490:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788201206.183940:0:94490:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1788201206.183943:0:94490:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1788201206.183957:0:94490:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff8dc137c34700 x1875060715250432/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:327/0 lens 328/0 e 0 to 0 dl 1788201217 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788201206.183985:0:94490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201206.184048:0:94490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1c70a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1be0b expref: -99 pid: 94490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.184075:0:94490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1c70a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1be0b expref: 9 pid: 94490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.184087:0:94490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1c70a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1be0b expref: 9 pid: 94490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.184095:0:94490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fca00, rc 0) 00010000:00080000:1.0:1788201206.184179:0:94490:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788201206.184193:0:94490:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00010000:3.0:1788201206.186120:0:3654:0:(ldlm_request.c:2777:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007ade600/0x96d0c9b8c9a1be0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c70a expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788201206.186137:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1788201206.186167:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715250432:0@lo:101:ldlm_lock_repla.0 00000100:00100000:3.0:1788201206.187623:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715250560:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:3.0:1788201206.187686:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201206.188443:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715250560 00000100:00100000:1.0:1788201206.188452:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715250560 00000100:00100000:1.0:1788201206.188498:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4067 00000100:00100000:1.0:1788201206.188507:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3654:x1875060715250560:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:1.0:1788201206.188526:0:8458:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc137c36d80 x1875060715250560/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:327/0 lens 224/0 e 0 to 0 dl 1788201217 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201206.188558:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3654:x1875060715250560:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 52us (872us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201206.188566:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4067 00010000:00080000:1.0:1788201206.188584:0:94490:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1788201206.188689:0:94490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 29, last_transno is 124554051584 00000001:00100000:3.0:1788201206.196007:0:94457:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788201206.196046:0:94457:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000001:00080000:3.0:1788201206.196053:0:94457:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084300 is committed 00000001:00080000:3.0:1788201206.196075:0:94457:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084298 is committed 00010000:00010000:3.0:1788201206.196110:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c6fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.196123:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c6fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.196130:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c6fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.196136:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201206.196141:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c6fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.196166:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c6fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.196184:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c6fc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.196190:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1c6fc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94490 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201206.211093:0:94490:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1788201206.211143:0:94490:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1788201206.211162:0:94490:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.201.20@tcp: req@ffff8dc11cc44380 x1875060695427328/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:327/0 lens 224/0 e 0 to 0 dl 1788201217 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788201206.211266:0:94490:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8dc137c36d80 x1875060715250560/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:327/0 lens 224/0 e 0 to 0 dl 1788201217 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1788201206.211334:0:94490:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00100000:3.0:1788201206.219932:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084300 gen 3 00000004:00080000:3.0:1788201206.219946:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084299 committed transno 120259084300 00000004:00080000:3.0:1788201206.219967:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 120259084300 committed transno 120259084300 00000100:00080000:3.0:1788201206.219980:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788201206.219992:0:3654:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8dc137c37100 x1875060715250560/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201222 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201206.220002:0:3654:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8dc137c37100 x1875060715250560/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201222 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201206.220009:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788201206.220046:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1788201206.220053:0:3654:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000b29299a6): req@ffff8dc007158700 x1875060715228672/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201189 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201206.220068:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715250560:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:3.0:1788201206.220302:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201206.220520:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715228672 00000100:00100000:3.0:1788201206.220528:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715228672 00000100:00100000:3.0:1788201206.220576:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4068 00000100:00100000:3.0:1788201206.220585:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715228672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201206.220635:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444913152 avail 1298673664 00000100:00100000:3.0:1788201206.220682:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715228672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201206.220690:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4068 00000100:00100000:3.0:1788201206.220811:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715228672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201206.221069:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715250688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201206.221104:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201206.221137:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715250688 00000100:00100000:2.0:1788201206.221141:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715250688 00000100:00100000:2.0:1788201206.221175:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4069 00000100:00100000:2.0:1788201206.221181:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715250688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201206.221194:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444913152 avail 1298673664 00000100:00100000:2.0:1788201206.221230:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715250688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 49us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201206.221236:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4069 00000100:00100000:2.0:1788201206.221266:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715250688:0@lo:41:osp-pre-0-1.0 00000004:00000080:2.0:1788201206.249000:0:94490:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa0dd41df7e10 00100000:10000000:2.0:1788201206.249030:0:94490:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1788201206.250170:0:94475:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x322:0x0] 00000100:00100000:0.0:1788201206.250227:0:94475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c37480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94475:1875060715250816:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788201206.250299:0:94475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201206.250341:0:94475:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f739c0 going to sleep for 11 seconds 00000004:00080000:1.0:1788201206.250449:0:94477:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x323:0x0] 00000100:00100000:1.0:1788201206.250471:0:94477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc47b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94477:1875060715250944:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788201206.250502:0:94477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201206.250525:0:94477:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0039cf480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201206.250726:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715250816 00000100:00100000:0.0:1788201206.250741:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715250816 00000100:00100000:0.0:1788201206.250799:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715250944 00000100:00100000:0.0:1788201206.250802:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715250944 00000100:00100000:0.0:1788201206.250822:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5923 00000100:00100000:0.0:1788201206.250830:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:94475:x1875060715250816:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788201206.250858:0:26214:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 897 -> diff = -95 00002000:02000040:0.0:1788201206.250862:0:26214:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:803 to 0x280000401:897) 00000100:00100000:1.0:1788201206.254743:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5924 00000100:00100000:1.0:1788201206.254772:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:94477:x1875060715250944:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788201206.254807:0:26205:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 897 -> diff = -94 00002000:02000040:1.0:1788201206.254812:0:26205:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:804 to 0x2c0000401:897) 00002000:00010000:0.0:1788201206.271942:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x381:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201206.271959:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1c711 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.271976:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x381:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:0.0:1788201206.271981:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x381:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201206.271987:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1c711 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.272003:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1c711 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.272043:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1c711 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.272051:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1c711 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.272370:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201206.272382:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201206.272387:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1c711 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.272409:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.272413:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1c711 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.272422:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1c711 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.272452:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1c711 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.272460:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1c711 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.272479:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.272480:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.272482:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201206.278818:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x380:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201206.278835:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0a7d527/0x96d0c9b8c9a1c718 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.278855:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x380:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:0.0:1788201206.278860:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x380:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201206.278866:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0a7d527/0x96d0c9b8c9a1c718 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.278881:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0a7d527/0x96d0c9b8c9a1c718 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.278905:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0a7d527/0x96d0c9b8c9a1c718 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.278911:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0a7d527/0x96d0c9b8c9a1c718 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.278935:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201206.278948:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201206.278953:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0a7d527/0x96d0c9b8c9a1c718 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.278961:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.278965:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0a7d527/0x96d0c9b8c9a1c718 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.278974:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0a7d527/0x96d0c9b8c9a1c718 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.278992:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0a7d527/0x96d0c9b8c9a1c718 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.278999:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0a7d527/0x96d0c9b8c9a1c718 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279033:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.279041:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.279043:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201206.279144:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201206.279149:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012faec32/0x96d0c9b8c9a1c71f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279156:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37f:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:0.0:1788201206.279160:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201206.279163:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012faec32/0x96d0c9b8c9a1c71f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279171:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012faec32/0x96d0c9b8c9a1c71f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279178:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012faec32/0x96d0c9b8c9a1c71f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279184:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012faec32/0x96d0c9b8c9a1c71f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279201:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201206.279208:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201206.279212:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012faec32/0x96d0c9b8c9a1c71f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279219:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.279222:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012faec32/0x96d0c9b8c9a1c71f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279240:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012faec32/0x96d0c9b8c9a1c71f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279251:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012faec32/0x96d0c9b8c9a1c71f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279260:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012faec32/0x96d0c9b8c9a1c71f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279273:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.279275:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.279276:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201206.279320:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201206.279325:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000356154cf/0x96d0c9b8c9a1c726 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279333:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37e:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:0.0:1788201206.279336:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201206.279340:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000356154cf/0x96d0c9b8c9a1c726 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279348:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000356154cf/0x96d0c9b8c9a1c726 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279356:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000356154cf/0x96d0c9b8c9a1c726 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279368:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000356154cf/0x96d0c9b8c9a1c726 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279383:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201206.279392:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201206.279397:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000356154cf/0x96d0c9b8c9a1c726 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279404:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.279406:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000356154cf/0x96d0c9b8c9a1c726 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279414:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000356154cf/0x96d0c9b8c9a1c726 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279438:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000356154cf/0x96d0c9b8c9a1c726 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279446:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000356154cf/0x96d0c9b8c9a1c726 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279459:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.279461:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.279462:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201206.279507:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201206.279518:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1c72d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279525:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37d:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:0.0:1788201206.279528:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201206.279531:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1c72d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279539:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1c72d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279547:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1c72d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279552:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1c72d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279565:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201206.279572:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201206.279576:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1c72d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279583:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.279586:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1c72d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279593:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1c72d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279611:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1c72d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279618:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1c72d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279630:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.279631:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.279633:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201206.279682:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201206.279687:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f82a4c78/0x96d0c9b8c9a1c734 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279695:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37c:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:0.0:1788201206.279698:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201206.279702:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f82a4c78/0x96d0c9b8c9a1c734 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279710:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f82a4c78/0x96d0c9b8c9a1c734 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279717:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f82a4c78/0x96d0c9b8c9a1c734 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.279723:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f82a4c78/0x96d0c9b8c9a1c734 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283261:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201206.283283:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201206.283291:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f82a4c78/0x96d0c9b8c9a1c734 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283303:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.283308:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f82a4c78/0x96d0c9b8c9a1c734 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283319:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f82a4c78/0x96d0c9b8c9a1c734 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283341:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f82a4c78/0x96d0c9b8c9a1c734 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283350:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f82a4c78/0x96d0c9b8c9a1c734 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283373:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.283375:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.283377:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201206.283488:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201206.283495:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062e8506/0x96d0c9b8c9a1c73b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283506:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37b:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:0.0:1788201206.283524:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201206.283531:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000062e8506/0x96d0c9b8c9a1c73b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283544:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000062e8506/0x96d0c9b8c9a1c73b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283553:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062e8506/0x96d0c9b8c9a1c73b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283561:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000062e8506/0x96d0c9b8c9a1c73b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283575:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201206.283583:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201206.283587:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000062e8506/0x96d0c9b8c9a1c73b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283593:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.283597:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000062e8506/0x96d0c9b8c9a1c73b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283603:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000062e8506/0x96d0c9b8c9a1c73b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283613:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000062e8506/0x96d0c9b8c9a1c73b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283629:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000062e8506/0x96d0c9b8c9a1c73b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283642:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.283644:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.283645:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201206.283694:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201206.283699:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c665ed3/0x96d0c9b8c9a1c742 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283707:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37a:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:0.0:1788201206.283710:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201206.283714:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c665ed3/0x96d0c9b8c9a1c742 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283722:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c665ed3/0x96d0c9b8c9a1c742 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283741:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c665ed3/0x96d0c9b8c9a1c742 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283749:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c665ed3/0x96d0c9b8c9a1c742 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283763:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201206.283777:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201206.283781:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c665ed3/0x96d0c9b8c9a1c742 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283789:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.283793:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c665ed3/0x96d0c9b8c9a1c742 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283802:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c665ed3/0x96d0c9b8c9a1c742 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283813:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c665ed3/0x96d0c9b8c9a1c742 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283820:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c665ed3/0x96d0c9b8c9a1c742 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283833:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.283835:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.283837:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201206.283878:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x379:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201206.283883:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6986301/0x96d0c9b8c9a1c749 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283891:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x379:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:0.0:1788201206.283894:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x379:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201206.283898:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6986301/0x96d0c9b8c9a1c749 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283919:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6986301/0x96d0c9b8c9a1c749 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283927:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6986301/0x96d0c9b8c9a1c749 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283933:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6986301/0x96d0c9b8c9a1c749 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283946:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201206.283953:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201206.283957:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6986301/0x96d0c9b8c9a1c749 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283964:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.283967:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6986301/0x96d0c9b8c9a1c749 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283975:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6986301/0x96d0c9b8c9a1c749 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283984:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6986301/0x96d0c9b8c9a1c749 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.283991:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6986301/0x96d0c9b8c9a1c749 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284010:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.284012:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.284034:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201206.284078:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x378:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201206.284082:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ca21533/0x96d0c9b8c9a1c750 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284089:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x378:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:0.0:1788201206.284092:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x378:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201206.284097:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ca21533/0x96d0c9b8c9a1c750 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284105:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ca21533/0x96d0c9b8c9a1c750 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284112:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ca21533/0x96d0c9b8c9a1c750 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284118:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ca21533/0x96d0c9b8c9a1c750 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284130:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201206.284136:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201206.284139:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ca21533/0x96d0c9b8c9a1c750 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284157:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.284160:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ca21533/0x96d0c9b8c9a1c750 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284167:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ca21533/0x96d0c9b8c9a1c750 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284177:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ca21533/0x96d0c9b8c9a1c750 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284185:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ca21533/0x96d0c9b8c9a1c750 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284198:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.284199:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.284201:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201206.284243:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x377:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201206.284248:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bccf566/0x96d0c9b8c9a1c757 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284255:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x377:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:0.0:1788201206.284257:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x377:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201206.284261:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bccf566/0x96d0c9b8c9a1c757 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284269:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bccf566/0x96d0c9b8c9a1c757 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284282:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bccf566/0x96d0c9b8c9a1c757 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284289:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009bccf566/0x96d0c9b8c9a1c757 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284300:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201206.284307:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201206.284310:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009bccf566/0x96d0c9b8c9a1c757 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284316:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.284319:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009bccf566/0x96d0c9b8c9a1c757 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284327:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009bccf566/0x96d0c9b8c9a1c757 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284338:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009bccf566/0x96d0c9b8c9a1c757 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284345:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bccf566/0x96d0c9b8c9a1c757 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284358:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.284366:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.284367:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201206.284410:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x376:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201206.284415:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa4cf707/0x96d0c9b8c9a1c75e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284423:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x376:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:0.0:1788201206.284435:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x376:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201206.284439:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa4cf707/0x96d0c9b8c9a1c75e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284448:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa4cf707/0x96d0c9b8c9a1c75e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284455:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa4cf707/0x96d0c9b8c9a1c75e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284461:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa4cf707/0x96d0c9b8c9a1c75e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284474:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201206.284481:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201206.284484:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa4cf707/0x96d0c9b8c9a1c75e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284491:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.284494:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa4cf707/0x96d0c9b8c9a1c75e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284513:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa4cf707/0x96d0c9b8c9a1c75e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284524:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa4cf707/0x96d0c9b8c9a1c75e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284531:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa4cf707/0x96d0c9b8c9a1c75e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284544:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.284545:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.284547:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201206.284593:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x375:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201206.284598:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005be00ded/0x96d0c9b8c9a1c765 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284606:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x375:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:0.0:1788201206.284608:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x375:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201206.284612:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005be00ded/0x96d0c9b8c9a1c765 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284621:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005be00ded/0x96d0c9b8c9a1c765 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284628:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005be00ded/0x96d0c9b8c9a1c765 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284640:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005be00ded/0x96d0c9b8c9a1c765 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284651:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201206.284658:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201206.284662:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005be00ded/0x96d0c9b8c9a1c765 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284667:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.284671:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005be00ded/0x96d0c9b8c9a1c765 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284678:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005be00ded/0x96d0c9b8c9a1c765 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284688:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005be00ded/0x96d0c9b8c9a1c765 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284695:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005be00ded/0x96d0c9b8c9a1c765 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284706:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.284707:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.284709:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201206.284748:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x374:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201206.284760:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1c76c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284768:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x374:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:0.0:1788201206.284771:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x374:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201206.284774:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1c76c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284782:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1c76c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284789:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1c76c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284795:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1c76c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284807:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201206.284813:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201206.284816:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1c76c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284822:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.284824:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1c76c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284831:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1c76c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284846:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1c76c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284853:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1c76c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284865:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.284866:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.284868:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201206.284911:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x373:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201206.284916:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1c773 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284924:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x373:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:0.0:1788201206.284927:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x373:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201206.284931:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1c773 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284940:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1c773 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284947:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1c773 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284953:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1c773 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284974:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201206.284980:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201206.284983:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1c773 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.284990:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.284994:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1c773 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285000:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1c773 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285010:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1c773 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285039:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1c773 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285053:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.285054:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.285056:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201206.285096:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x372:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201206.285101:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1c77a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285108:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x372:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:0.0:1788201206.285117:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x372:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201206.285122:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1c77a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285131:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1c77a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285139:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1c77a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285144:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1c77a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285155:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201206.285162:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201206.285165:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1c77a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285171:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.285174:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1c77a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285180:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1c77a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285190:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1c77a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285207:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1c77a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285222:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.285223:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.285224:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201206.285265:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x371:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201206.285270:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1c781 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285276:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x371:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:0.0:1788201206.285279:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x371:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201206.285283:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1c781 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285291:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1c781 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285299:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1c781 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285306:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1c781 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285318:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201206.285331:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201206.285334:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1c781 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285341:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.285344:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1c781 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285351:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1c781 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285360:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1c781 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285366:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1c781 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285378:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.285380:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.285381:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201206.285421:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x370:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201206.285443:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1c788 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285451:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x370:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:0.0:1788201206.285454:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x370:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201206.285458:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1c788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285479:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1c788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285487:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1c788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285494:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1c788 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285507:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201206.285514:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201206.285517:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1c788 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285523:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.285526:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1c788 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285533:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1c788 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285542:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1c788 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285548:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1c788 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285568:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.285569:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.285571:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201206.285615:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201206.285620:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008581f318/0x96d0c9b8c9a1c78f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285627:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36f:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:0.0:1788201206.285630:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201206.285633:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008581f318/0x96d0c9b8c9a1c78f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285642:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008581f318/0x96d0c9b8c9a1c78f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285649:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008581f318/0x96d0c9b8c9a1c78f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285656:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008581f318/0x96d0c9b8c9a1c78f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285667:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201206.285674:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201206.285676:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008581f318/0x96d0c9b8c9a1c78f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285692:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782ce00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.285696:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008581f318/0x96d0c9b8c9a1c78f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285702:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008581f318/0x96d0c9b8c9a1c78f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285712:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008581f318/0x96d0c9b8c9a1c78f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285718:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008581f318/0x96d0c9b8c9a1c78f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285730:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.285732:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.285733:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201206.285793:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201206.285798:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000306962a9/0x96d0c9b8c9a1c796 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285806:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36e:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:0.0:1788201206.285809:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201206.285812:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000306962a9/0x96d0c9b8c9a1c796 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285820:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000306962a9/0x96d0c9b8c9a1c796 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285833:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000306962a9/0x96d0c9b8c9a1c796 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285839:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000306962a9/0x96d0c9b8c9a1c796 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285851:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201206.285857:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201206.285860:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000306962a9/0x96d0c9b8c9a1c796 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285866:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896a400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.285869:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000306962a9/0x96d0c9b8c9a1c796 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285876:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000306962a9/0x96d0c9b8c9a1c796 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285886:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000306962a9/0x96d0c9b8c9a1c796 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285893:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000306962a9/0x96d0c9b8c9a1c796 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285905:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.285912:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.285914:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201206.285956:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201206.285961:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a2d8d4f/0x96d0c9b8c9a1c79d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285970:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36d:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:0.0:1788201206.285972:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201206.285976:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a2d8d4f/0x96d0c9b8c9a1c79d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285984:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a2d8d4f/0x96d0c9b8c9a1c79d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285991:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a2d8d4f/0x96d0c9b8c9a1c79d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.285998:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a2d8d4f/0x96d0c9b8c9a1c79d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.286010:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201206.286036:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201206.286040:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a2d8d4f/0x96d0c9b8c9a1c79d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.286046:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896be00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.286049:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a2d8d4f/0x96d0c9b8c9a1c79d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.286066:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a2d8d4f/0x96d0c9b8c9a1c79d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.286077:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a2d8d4f/0x96d0c9b8c9a1c79d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.286083:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a2d8d4f/0x96d0c9b8c9a1c79d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.286095:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.286097:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.286099:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201206.286144:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201206.286149:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000362585d6/0x96d0c9b8c9a1c7a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.286156:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36c:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:0.0:1788201206.286159:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201206.286162:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000362585d6/0x96d0c9b8c9a1c7a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.286170:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000362585d6/0x96d0c9b8c9a1c7a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.286176:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000362585d6/0x96d0c9b8c9a1c7a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.286189:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000362585d6/0x96d0c9b8c9a1c7a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.286201:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201206.286208:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201206.286211:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000362585d6/0x96d0c9b8c9a1c7a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.286217:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896ac00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.286220:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000362585d6/0x96d0c9b8c9a1c7a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.286227:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000362585d6/0x96d0c9b8c9a1c7a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.286238:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000362585d6/0x96d0c9b8c9a1c7a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.286244:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000362585d6/0x96d0c9b8c9a1c7a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.286255:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.286257:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.286258:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201206.286298:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201206.286308:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb613a73/0x96d0c9b8c9a1c7ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.286316:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36b:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:0.0:1788201206.286319:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201206.286323:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb613a73/0x96d0c9b8c9a1c7ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.286331:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb613a73/0x96d0c9b8c9a1c7ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.286338:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb613a73/0x96d0c9b8c9a1c7ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.286344:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb613a73/0x96d0c9b8c9a1c7ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.286357:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201206.286364:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201206.286367:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb613a73/0x96d0c9b8c9a1c7ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.286374:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896a600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.286377:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb613a73/0x96d0c9b8c9a1c7ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.286384:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb613a73/0x96d0c9b8c9a1c7ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.286402:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb613a73/0x96d0c9b8c9a1c7ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.286409:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb613a73/0x96d0c9b8c9a1c7ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.286421:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.286422:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201206.289116:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x381:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.289128:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1c7b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.289143:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x381:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.289147:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x381:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.289154:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1c7b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.289169:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1c7b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.289180:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1c7b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.289198:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1c7b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.290891:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201206.290996:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00002000:00010000:3.0:1788201206.291143:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x380:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.291151:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000944e21c3/0x96d0c9b8c9a1c7b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.291173:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x380:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.291177:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x380:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.291183:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000944e21c3/0x96d0c9b8c9a1c7b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293318:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000944e21c3/0x96d0c9b8c9a1c7b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293331:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000944e21c3/0x96d0c9b8c9a1c7b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293338:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000944e21c3/0x96d0c9b8c9a1c7b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293448:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201206.293550:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.293556:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1c7c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293565:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37f:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.293570:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.293575:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1c7c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293583:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1c7c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293604:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1c7c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293611:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1c7c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293624:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788201206.293669:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.293674:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006863e678/0x96d0c9b8c9a1c7c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293682:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37e:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.293685:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.293689:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006863e678/0x96d0c9b8c9a1c7c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293698:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006863e678/0x96d0c9b8c9a1c7c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293705:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006863e678/0x96d0c9b8c9a1c7c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293711:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006863e678/0x96d0c9b8c9a1c7c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293730:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788201206.293781:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.293786:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d4c5081/0x96d0c9b8c9a1c7ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293794:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37d:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.293797:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.293802:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d4c5081/0x96d0c9b8c9a1c7ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293810:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d4c5081/0x96d0c9b8c9a1c7ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293818:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d4c5081/0x96d0c9b8c9a1c7ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293823:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d4c5081/0x96d0c9b8c9a1c7ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293831:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788201206.293869:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.293873:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd596986/0x96d0c9b8c9a1c7d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293882:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37c:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.293891:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.293895:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd596986/0x96d0c9b8c9a1c7d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293903:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd596986/0x96d0c9b8c9a1c7d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293910:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd596986/0x96d0c9b8c9a1c7d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293916:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd596986/0x96d0c9b8c9a1c7d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293925:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788201206.293962:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.293968:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009117cd9/0x96d0c9b8c9a1c7dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293975:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37b:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.293978:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.293981:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009117cd9/0x96d0c9b8c9a1c7dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293989:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009117cd9/0x96d0c9b8c9a1c7dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.293996:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009117cd9/0x96d0c9b8c9a1c7dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.294010:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009117cd9/0x96d0c9b8c9a1c7dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.294039:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788201206.294079:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.294084:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e7cbbed/0x96d0c9b8c9a1c7e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.294091:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37a:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.294094:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.294098:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e7cbbed/0x96d0c9b8c9a1c7e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.294105:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e7cbbed/0x96d0c9b8c9a1c7e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.294112:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e7cbbed/0x96d0c9b8c9a1c7e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.294118:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e7cbbed/0x96d0c9b8c9a1c7e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.294126:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1788201206.294159:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x379:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.294163:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f86fea35/0x96d0c9b8c9a1c7ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.294177:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x379:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.294179:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x379:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.294183:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f86fea35/0x96d0c9b8c9a1c7ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.294806:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f86fea35/0x96d0c9b8c9a1c7ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.294815:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f86fea35/0x96d0c9b8c9a1c7ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.294823:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f86fea35/0x96d0c9b8c9a1c7ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.294834:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1788201206.294883:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x378:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.294888:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efb0ef6b/0x96d0c9b8c9a1c7f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.294895:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x378:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.294899:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x378:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.294903:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efb0ef6b/0x96d0c9b8c9a1c7f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.294912:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efb0ef6b/0x96d0c9b8c9a1c7f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.294932:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efb0ef6b/0x96d0c9b8c9a1c7f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.294938:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efb0ef6b/0x96d0c9b8c9a1c7f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.294947:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:3.0:1788201206.294986:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x377:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.294991:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065642781/0x96d0c9b8c9a1c7f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.294999:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x377:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.295001:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x377:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.295005:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065642781/0x96d0c9b8c9a1c7f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295012:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065642781/0x96d0c9b8c9a1c7f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295037:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065642781/0x96d0c9b8c9a1c7f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295044:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065642781/0x96d0c9b8c9a1c7f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295063:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:3.0:1788201206.295102:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x376:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.295107:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5abe007/0x96d0c9b8c9a1c7ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295114:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x376:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.295117:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x376:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.295120:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5abe007/0x96d0c9b8c9a1c7ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295128:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5abe007/0x96d0c9b8c9a1c7ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295134:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5abe007/0x96d0c9b8c9a1c7ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295140:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5abe007/0x96d0c9b8c9a1c7ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295149:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:3.0:1788201206.295183:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x375:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.295256:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000587aac9c/0x96d0c9b8c9a1c806 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295264:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x375:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.295273:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x375:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.295277:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000587aac9c/0x96d0c9b8c9a1c806 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295286:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000587aac9c/0x96d0c9b8c9a1c806 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295293:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000587aac9c/0x96d0c9b8c9a1c806 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295299:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000587aac9c/0x96d0c9b8c9a1c806 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295309:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:3.0:1788201206.295348:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x374:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.295352:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1c80d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295359:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x374:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.295361:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x374:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.295365:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1c80d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295373:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1c80d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295379:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1c80d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295391:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1c80d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295399:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:3.0:1788201206.295448:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x373:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.295453:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd77ae97/0x96d0c9b8c9a1c814 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295460:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x373:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.295462:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x373:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.295466:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd77ae97/0x96d0c9b8c9a1c814 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295474:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd77ae97/0x96d0c9b8c9a1c814 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295480:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd77ae97/0x96d0c9b8c9a1c814 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295486:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd77ae97/0x96d0c9b8c9a1c814 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295495:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:3.0:1788201206.295532:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x372:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.295537:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1c81b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295549:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x372:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.295551:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x372:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.295555:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1c81b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295563:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1c81b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295570:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1c81b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295577:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1c81b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295585:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:3.0:1788201206.295624:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x371:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.295629:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa42974e/0x96d0c9b8c9a1c822 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295636:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x371:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.295639:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x371:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.295643:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa42974e/0x96d0c9b8c9a1c822 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295652:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa42974e/0x96d0c9b8c9a1c822 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295671:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa42974e/0x96d0c9b8c9a1c822 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295678:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa42974e/0x96d0c9b8c9a1c822 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.295687:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:3.0:1788201206.295724:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x370:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.295728:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006aa81d00/0x96d0c9b8c9a1c829 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.295966:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:1.0:1788201206.295975:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000944e21c3/0x96d0c9b8c9a1c7b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.295995:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201206.296000:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000944e21c3/0x96d0c9b8c9a1c7b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296008:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000944e21c3/0x96d0c9b8c9a1c7b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296046:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000944e21c3/0x96d0c9b8c9a1c7b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296054:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000944e21c3/0x96d0c9b8c9a1c7b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296073:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:1.0:1788201206.296077:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1c7c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296083:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201206.296085:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1c7c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296092:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1c7c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296100:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1c7c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296112:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1c7c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296123:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:1.0:1788201206.296126:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006863e678/0x96d0c9b8c9a1c7c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296132:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201206.296135:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006863e678/0x96d0c9b8c9a1c7c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296142:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006863e678/0x96d0c9b8c9a1c7c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296152:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006863e678/0x96d0c9b8c9a1c7c7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296159:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006863e678/0x96d0c9b8c9a1c7c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296172:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:1.0:1788201206.296176:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d4c5081/0x96d0c9b8c9a1c7ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296181:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201206.296449:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d4c5081/0x96d0c9b8c9a1c7ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296458:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d4c5081/0x96d0c9b8c9a1c7ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296469:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d4c5081/0x96d0c9b8c9a1c7ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296476:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d4c5081/0x96d0c9b8c9a1c7ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296488:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:1.0:1788201206.296492:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd596986/0x96d0c9b8c9a1c7d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296498:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201206.296502:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd596986/0x96d0c9b8c9a1c7d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296508:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd596986/0x96d0c9b8c9a1c7d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296517:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd596986/0x96d0c9b8c9a1c7d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296524:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd596986/0x96d0c9b8c9a1c7d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296541:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:1.0:1788201206.296546:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009117cd9/0x96d0c9b8c9a1c7dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296551:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201206.296554:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009117cd9/0x96d0c9b8c9a1c7dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296562:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009117cd9/0x96d0c9b8c9a1c7dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296572:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009117cd9/0x96d0c9b8c9a1c7dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296578:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009117cd9/0x96d0c9b8c9a1c7dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296588:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:1.0:1788201206.296592:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e7cbbed/0x96d0c9b8c9a1c7e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296597:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201206.296600:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e7cbbed/0x96d0c9b8c9a1c7e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296617:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e7cbbed/0x96d0c9b8c9a1c7e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296627:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e7cbbed/0x96d0c9b8c9a1c7e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296633:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e7cbbed/0x96d0c9b8c9a1c7e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296646:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1788201206.296649:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f86fea35/0x96d0c9b8c9a1c7ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296654:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201206.296657:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f86fea35/0x96d0c9b8c9a1c7ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296664:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f86fea35/0x96d0c9b8c9a1c7ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296672:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f86fea35/0x96d0c9b8c9a1c7ea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296679:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f86fea35/0x96d0c9b8c9a1c7ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296702:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788201206.296705:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efb0ef6b/0x96d0c9b8c9a1c7f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296710:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201206.296714:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efb0ef6b/0x96d0c9b8c9a1c7f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296720:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efb0ef6b/0x96d0c9b8c9a1c7f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.296730:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efb0ef6b/0x96d0c9b8c9a1c7f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.296834:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1c7b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.296843:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.296846:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1c7b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.296853:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1c7b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.296864:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1c7b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.296870:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1c7b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.297091:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efb0ef6b/0x96d0c9b8c9a1c7f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.297118:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788201206.297121:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065642781/0x96d0c9b8c9a1c7f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.297128:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201206.297131:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065642781/0x96d0c9b8c9a1c7f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.297149:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065642781/0x96d0c9b8c9a1c7f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.297161:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065642781/0x96d0c9b8c9a1c7f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.297168:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065642781/0x96d0c9b8c9a1c7f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.297182:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788201206.297286:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x370:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.297290:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x370:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.297298:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006aa81d00/0x96d0c9b8c9a1c829 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.297308:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006aa81d00/0x96d0c9b8c9a1c829 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.297318:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006aa81d00/0x96d0c9b8c9a1c829 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.297326:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006aa81d00/0x96d0c9b8c9a1c829 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.297348:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788201206.297447:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.297453:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1c830 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.297462:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36f:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.297465:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.297469:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1c830 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.297477:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1c830 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.297484:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1c830 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.297489:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1c830 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.297497:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1788201206.297534:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.297538:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097e718a9/0x96d0c9b8c9a1c837 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.297544:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36e:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.297552:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.297556:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097e718a9/0x96d0c9b8c9a1c837 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.297564:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097e718a9/0x96d0c9b8c9a1c837 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.297571:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097e718a9/0x96d0c9b8c9a1c837 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.297577:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097e718a9/0x96d0c9b8c9a1c837 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.297584:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1788201206.297621:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.297626:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000017a6f37/0x96d0c9b8c9a1c83e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.297633:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36d:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.297636:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.297639:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000017a6f37/0x96d0c9b8c9a1c83e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.297646:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000017a6f37/0x96d0c9b8c9a1c83e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.297652:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000017a6f37/0x96d0c9b8c9a1c83e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.297664:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000017a6f37/0x96d0c9b8c9a1c83e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.297673:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:3.0:1788201206.297706:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.297710:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076abd4f8/0x96d0c9b8c9a1c845 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.297718:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36c:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.297721:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.297725:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076abd4f8/0x96d0c9b8c9a1c845 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.297810:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5abe007/0x96d0c9b8c9a1c7ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.297821:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201206.297825:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5abe007/0x96d0c9b8c9a1c7ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.297834:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5abe007/0x96d0c9b8c9a1c7ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.297846:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5abe007/0x96d0c9b8c9a1c7ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.297853:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5abe007/0x96d0c9b8c9a1c7ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.297881:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1788201206.297885:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000587aac9c/0x96d0c9b8c9a1c806 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.297892:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201206.297896:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000587aac9c/0x96d0c9b8c9a1c806 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.297904:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000587aac9c/0x96d0c9b8c9a1c806 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.297914:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000587aac9c/0x96d0c9b8c9a1c806 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.297920:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000587aac9c/0x96d0c9b8c9a1c806 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.297934:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788201206.297938:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1c80d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.297944:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201206.297947:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1c80d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.297965:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1c80d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.297976:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1c80d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.297983:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1c80d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.297996:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788201206.298000:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd77ae97/0x96d0c9b8c9a1c814 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.298005:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201206.298009:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd77ae97/0x96d0c9b8c9a1c814 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.298049:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd77ae97/0x96d0c9b8c9a1c814 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.298059:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd77ae97/0x96d0c9b8c9a1c814 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.298066:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd77ae97/0x96d0c9b8c9a1c814 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.298091:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788201206.298095:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1c81b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.298101:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201206.298104:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1c81b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.298111:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1c81b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.298121:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1c81b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.298128:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1c81b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.298140:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788201206.298143:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa42974e/0x96d0c9b8c9a1c822 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.298149:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201206.298153:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa42974e/0x96d0c9b8c9a1c822 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.298171:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa42974e/0x96d0c9b8c9a1c822 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.298182:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa42974e/0x96d0c9b8c9a1c822 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.299383:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa42974e/0x96d0c9b8c9a1c822 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.299410:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788201206.299414:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006aa81d00/0x96d0c9b8c9a1c829 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.299421:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201206.299433:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006aa81d00/0x96d0c9b8c9a1c829 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.299442:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006aa81d00/0x96d0c9b8c9a1c829 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.299457:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006aa81d00/0x96d0c9b8c9a1c829 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.299464:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006aa81d00/0x96d0c9b8c9a1c829 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.299493:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201206.299497:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1c830 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.299503:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201206.299506:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1c830 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.299513:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1c830 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.299522:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1c830 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.299530:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1c830 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.299542:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201206.299545:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097e718a9/0x96d0c9b8c9a1c837 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.299551:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101672c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201206.299555:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097e718a9/0x96d0c9b8c9a1c837 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.299574:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097e718a9/0x96d0c9b8c9a1c837 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.299584:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097e718a9/0x96d0c9b8c9a1c837 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.299591:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097e718a9/0x96d0c9b8c9a1c837 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.299605:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201206.299609:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000017a6f37/0x96d0c9b8c9a1c83e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.299615:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101673a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201206.299617:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000017a6f37/0x96d0c9b8c9a1c83e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.299624:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000017a6f37/0x96d0c9b8c9a1c83e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.299633:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000017a6f37/0x96d0c9b8c9a1c83e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.299639:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000017a6f37/0x96d0c9b8c9a1c83e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.299661:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201206.299663:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201206.299665:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201206.299839:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076abd4f8/0x96d0c9b8c9a1c845 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.299851:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076abd4f8/0x96d0c9b8c9a1c845 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.299858:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076abd4f8/0x96d0c9b8c9a1c845 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.300092:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.300934:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788201206.300964:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788201206.300976:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.300978:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.300980:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201206.301338:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.301348:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f37d517a/0x96d0c9b8c9a1c84c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301374:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36a:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.301379:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.301386:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f37d517a/0x96d0c9b8c9a1c84c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301398:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f37d517a/0x96d0c9b8c9a1c84c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301407:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f37d517a/0x96d0c9b8c9a1c84c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301415:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f37d517a/0x96d0c9b8c9a1c84c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301447:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201206.301526:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x369:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.301531:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d2f6c7b/0x96d0c9b8c9a1c853 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301538:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x369:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.301541:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x369:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.301545:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d2f6c7b/0x96d0c9b8c9a1c853 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301554:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d2f6c7b/0x96d0c9b8c9a1c853 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301575:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d2f6c7b/0x96d0c9b8c9a1c853 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301581:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d2f6c7b/0x96d0c9b8c9a1c853 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301595:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201206.301604:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201206.301608:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f37d517a/0x96d0c9b8c9a1c84c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301615:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101673c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201206.301619:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f37d517a/0x96d0c9b8c9a1c84c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301626:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f37d517a/0x96d0c9b8c9a1c84c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301644:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f37d517a/0x96d0c9b8c9a1c84c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301652:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f37d517a/0x96d0c9b8c9a1c84c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301666:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201206.301675:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d2f6c7b/0x96d0c9b8c9a1c853 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301681:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101673e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201206.301684:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d2f6c7b/0x96d0c9b8c9a1c853 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301691:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d2f6c7b/0x96d0c9b8c9a1c853 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301700:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d2f6c7b/0x96d0c9b8c9a1c853 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301707:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d2f6c7b/0x96d0c9b8c9a1c853 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301717:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201206.301719:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201206.301720:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201206.301837:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x368:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.301843:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042646aec/0x96d0c9b8c9a1c85a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301852:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x368:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.301855:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x368:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.301859:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042646aec/0x96d0c9b8c9a1c85a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301879:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042646aec/0x96d0c9b8c9a1c85a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301886:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042646aec/0x96d0c9b8c9a1c85a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301893:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042646aec/0x96d0c9b8c9a1c85a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301905:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201206.301943:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x367:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.301948:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae2bee79/0x96d0c9b8c9a1c861 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301955:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x367:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.301958:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x367:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.301961:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae2bee79/0x96d0c9b8c9a1c861 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301969:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae2bee79/0x96d0c9b8c9a1c861 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301976:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae2bee79/0x96d0c9b8c9a1c861 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.301992:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae2bee79/0x96d0c9b8c9a1c861 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302003:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788201206.302065:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x366:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.302070:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff29e9a9/0x96d0c9b8c9a1c868 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302078:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x366:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.302081:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x366:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.302085:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff29e9a9/0x96d0c9b8c9a1c868 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302093:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff29e9a9/0x96d0c9b8c9a1c868 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302100:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff29e9a9/0x96d0c9b8c9a1c868 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302106:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff29e9a9/0x96d0c9b8c9a1c868 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302118:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788201206.302123:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788201206.302126:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042646aec/0x96d0c9b8c9a1c85a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302138:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101672000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201206.302141:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042646aec/0x96d0c9b8c9a1c85a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302147:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042646aec/0x96d0c9b8c9a1c85a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302158:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042646aec/0x96d0c9b8c9a1c85a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302164:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042646aec/0x96d0c9b8c9a1c85a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302178:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201206.302181:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae2bee79/0x96d0c9b8c9a1c861 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302259:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101673200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201206.302262:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae2bee79/0x96d0c9b8c9a1c861 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302270:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae2bee79/0x96d0c9b8c9a1c861 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302280:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae2bee79/0x96d0c9b8c9a1c861 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302293:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae2bee79/0x96d0c9b8c9a1c861 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302306:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201206.302309:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff29e9a9/0x96d0c9b8c9a1c868 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302315:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101673800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201206.302319:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff29e9a9/0x96d0c9b8c9a1c868 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302327:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff29e9a9/0x96d0c9b8c9a1c868 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302336:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff29e9a9/0x96d0c9b8c9a1c868 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302343:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff29e9a9/0x96d0c9b8c9a1c868 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302355:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201206.302357:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201206.302358:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201206.302402:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x365:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.302408:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000263f6817/0x96d0c9b8c9a1c86f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302422:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x365:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.302433:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x365:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.302438:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000263f6817/0x96d0c9b8c9a1c86f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302447:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000263f6817/0x96d0c9b8c9a1c86f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302455:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000263f6817/0x96d0c9b8c9a1c86f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302462:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000263f6817/0x96d0c9b8c9a1c86f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302475:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201206.302482:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201206.302485:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000263f6817/0x96d0c9b8c9a1c86f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302492:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101673600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201206.302495:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000263f6817/0x96d0c9b8c9a1c86f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302503:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000263f6817/0x96d0c9b8c9a1c86f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302525:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000263f6817/0x96d0c9b8c9a1c86f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302532:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000263f6817/0x96d0c9b8c9a1c86f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302545:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201206.302546:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201206.302548:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201206.302592:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x364:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.302598:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d5dc995/0x96d0c9b8c9a1c876 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302605:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x364:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.302608:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x364:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.302612:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d5dc995/0x96d0c9b8c9a1c876 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302620:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d5dc995/0x96d0c9b8c9a1c876 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302627:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d5dc995/0x96d0c9b8c9a1c876 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302633:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d5dc995/0x96d0c9b8c9a1c876 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302656:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201206.302663:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201206.302666:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d5dc995/0x96d0c9b8c9a1c876 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302673:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201206.302676:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d5dc995/0x96d0c9b8c9a1c876 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302683:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d5dc995/0x96d0c9b8c9a1c876 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302694:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d5dc995/0x96d0c9b8c9a1c876 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302700:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d5dc995/0x96d0c9b8c9a1c876 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.302712:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201206.302714:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201206.302715:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.302909:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.302987:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201206.303153:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201206.303279:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x363:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.303285:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc1cd93/0x96d0c9b8c9a1c87d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.303292:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x363:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.303301:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x363:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.303305:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc1cd93/0x96d0c9b8c9a1c87d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.303314:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc1cd93/0x96d0c9b8c9a1c87d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.303320:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cc1cd93/0x96d0c9b8c9a1c87d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.303326:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cc1cd93/0x96d0c9b8c9a1c87d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.303343:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201206.303384:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x362:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201206.303389:0:26214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e365e6f9/0x96d0c9b8c9a1c884 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.303397:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x362:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:3.0:1788201206.303400:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x362:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201206.303403:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e365e6f9/0x96d0c9b8c9a1c884 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.303412:0:26214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e365e6f9/0x96d0c9b8c9a1c884 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.303419:0:26214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e365e6f9/0x96d0c9b8c9a1c884 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.303444:0:26214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e365e6f9/0x96d0c9b8c9a1c884 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201206.303466:0:26214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000001:00100000:0.0:1788201206.303948:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788201206.303963:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201206.303968:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cc1cd93/0x96d0c9b8c9a1c87d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.303977:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.303981:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc1cd93/0x96d0c9b8c9a1c87d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.303988:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cc1cd93/0x96d0c9b8c9a1c87d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.304002:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cc1cd93/0x96d0c9b8c9a1c87d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.304009:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc1cd93/0x96d0c9b8c9a1c87d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.304048:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201206.304058:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e365e6f9/0x96d0c9b8c9a1c884 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.304065:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.304068:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e365e6f9/0x96d0c9b8c9a1c884 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.304075:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e365e6f9/0x96d0c9b8c9a1c884 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.304086:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e365e6f9/0x96d0c9b8c9a1c884 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.304093:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e365e6f9/0x96d0c9b8c9a1c884 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.304106:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.304108:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.304110:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201206.304157:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788201206.304441:0:26214:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:802 00000100:00100000:3.0:1788201206.304576:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:94475:x1875060715250816:12345-0@lo:5:osp-pre-0-0.0 Request processed in 53743us (54274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201206.304587:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5923 00010000:00010000:2.0:1788201206.304862:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201206.304943:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201206.304950:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1c88b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.304960:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36b:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:2.0:1788201206.304964:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201206.304976:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1c88b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.304987:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1c88b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.304995:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1c88b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.305001:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1c88b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201206.305084:0:94475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c37480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94475:1875060715250816:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788201206.305099:0:94475:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x381:0x0] from OST, last_created [0x280000401:0x381:0x0]last_used is [0x280000401:0x322:0x0] 00000100:00100000:0.0:1788201206.305167:0:94475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c37100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94475:1875060715251200:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788201206.305316:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715251072:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788201206.305379:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201206.305386:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076abd4f8/0x96d0c9b8c9a1c845 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.305394:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101672600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201206.305398:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076abd4f8/0x96d0c9b8c9a1c845 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.305406:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076abd4f8/0x96d0c9b8c9a1c845 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.305422:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076abd4f8/0x96d0c9b8c9a1c845 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.305439:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076abd4f8/0x96d0c9b8c9a1c845 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.305507:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201206.305511:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1c88b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.305529:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201206.305533:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1c88b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.305540:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1c88b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.305550:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1c88b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.305560:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201206.305561:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201206.305563:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201206.305669:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201206.305674:0:26205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1c88b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.306851:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201206.307144:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201206.307277:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715251072 00000100:00100000:1.0:1788201206.307286:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715251072 00000100:00100000:1.0:1788201206.307336:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2322 00000100:00100000:1.0:1788201206.307345:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715251072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201206.307374:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788201206.307436:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715251072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201206.307443:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2322 00002000:00010000:2.0:1788201206.307633:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201206.307642:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016617895/0x96d0c9b8c9a1c892 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.307657:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36a:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:2.0:1788201206.307661:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201206.307667:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016617895/0x96d0c9b8c9a1c892 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.307679:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016617895/0x96d0c9b8c9a1c892 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.307700:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016617895/0x96d0c9b8c9a1c892 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.307708:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016617895/0x96d0c9b8c9a1c892 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.307836:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201206.307883:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x369:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201206.307888:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b61951f/0x96d0c9b8c9a1c899 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.307895:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x369:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:2.0:1788201206.307898:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x369:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201206.307901:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b61951f/0x96d0c9b8c9a1c899 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.307910:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b61951f/0x96d0c9b8c9a1c899 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.307917:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b61951f/0x96d0c9b8c9a1c899 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.307924:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b61951f/0x96d0c9b8c9a1c899 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201206.307989:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715251072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201206.310313:0:94475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201206.310360:0:94475:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f739c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201206.310401:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715251200 00000100:00100000:0.0:1788201206.310409:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715251200 00000100:00100000:0.0:1788201206.310476:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5925 00000100:00100000:0.0:1788201206.310487:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:94475:x1875060715251200:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788201206.310531:0:26208:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 898 00000100:00100000:0.0:1788201206.312132:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:94475:x1875060715251200:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1642us (1819us total) trans 4294969457 rc 0/0 00000100:00100000:0.0:1788201206.312143:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5925 00000100:00100000:0.0:1788201206.312211:0:94475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c37100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94475:1875060715251200:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788201206.312226:0:94475:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x381:0x0]-[0x280000401:0x3a1:0x0] 00010000:00010000:1.0:1788201206.313696:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201206.313710:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016617895/0x96d0c9b8c9a1c892 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.313808:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfe00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201206.313813:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016617895/0x96d0c9b8c9a1c892 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.313824:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016617895/0x96d0c9b8c9a1c892 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.313845:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016617895/0x96d0c9b8c9a1c892 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.313851:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016617895/0x96d0c9b8c9a1c892 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.313869:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201206.313872:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b61951f/0x96d0c9b8c9a1c899 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.313878:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201206.313881:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b61951f/0x96d0c9b8c9a1c899 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.313888:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b61951f/0x96d0c9b8c9a1c899 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.313897:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b61951f/0x96d0c9b8c9a1c899 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.313912:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201206.313914:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201206.313915:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201206.316269:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201206.316517:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201206.316528:0:26205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b61951f/0x96d0c9b8c9a1c899 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201206.316656:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x368:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201206.316663:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1c8a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.316674:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x368:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:2.0:1788201206.316678:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x368:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201206.316684:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1c8a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.316696:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1c8a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.316705:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1c8a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.316713:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1c8a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.316816:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201206.316861:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x367:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201206.316865:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1c8a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.316881:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x367:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:2.0:1788201206.316884:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x367:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201206.316888:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1c8a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.316897:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1c8a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.316905:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1c8a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.316911:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1c8a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.316932:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788201206.316974:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x366:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201206.316979:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aebd397/0x96d0c9b8c9a1c8ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.316987:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x366:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:2.0:1788201206.316989:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x366:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201206.316993:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000aebd397/0x96d0c9b8c9a1c8ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317001:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000aebd397/0x96d0c9b8c9a1c8ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317049:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aebd397/0x96d0c9b8c9a1c8ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317056:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000aebd397/0x96d0c9b8c9a1c8ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317073:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788201206.317082:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788201206.317088:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1c8a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317095:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adee00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201206.317099:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1c8a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317107:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1c8a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317123:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1c8a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317129:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1c8a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317142:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201206.317152:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1c8a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317158:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201206.317162:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1c8a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317169:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1c8a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317178:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1c8a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317185:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1c8a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.317291:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201206.317297:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000aebd397/0x96d0c9b8c9a1c8ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.317305:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100031200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201206.317308:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000aebd397/0x96d0c9b8c9a1c8ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.317315:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000aebd397/0x96d0c9b8c9a1c8ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.317327:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000aebd397/0x96d0c9b8c9a1c8ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.317333:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000aebd397/0x96d0c9b8c9a1c8ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.317347:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201206.317349:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201206.317350:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201206.317393:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201206.317395:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201206.317396:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201206.317451:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x365:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201206.317457:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1c8b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317465:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x365:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:2.0:1788201206.317468:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x365:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201206.317472:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1c8b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317493:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1c8b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317501:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1c8b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317507:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1c8b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317529:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201206.317569:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x364:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201206.317574:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8153134/0x96d0c9b8c9a1c8bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317581:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x364:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:2.0:1788201206.317584:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x364:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201206.317587:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8153134/0x96d0c9b8c9a1c8bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317596:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8153134/0x96d0c9b8c9a1c8bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317603:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8153134/0x96d0c9b8c9a1c8bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317619:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8153134/0x96d0c9b8c9a1c8bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317629:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788201206.317668:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x363:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201206.317673:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000201a2490/0x96d0c9b8c9a1c8c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317680:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x363:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:2.0:1788201206.317682:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x363:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201206.317686:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000201a2490/0x96d0c9b8c9a1c8c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317695:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000201a2490/0x96d0c9b8c9a1c8c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317702:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000201a2490/0x96d0c9b8c9a1c8c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317709:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000201a2490/0x96d0c9b8c9a1c8c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.317722:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788201206.317729:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201206.317846:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201206.317852:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8153134/0x96d0c9b8c9a1c8bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.317860:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100031e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.317863:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8153134/0x96d0c9b8c9a1c8bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.317870:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8153134/0x96d0c9b8c9a1c8bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.317882:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8153134/0x96d0c9b8c9a1c8bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.317888:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8153134/0x96d0c9b8c9a1c8bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.317902:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201206.317911:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000201a2490/0x96d0c9b8c9a1c8c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.317918:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201206.317921:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000201a2490/0x96d0c9b8c9a1c8c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.317930:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000201a2490/0x96d0c9b8c9a1c8c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.317941:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000201a2490/0x96d0c9b8c9a1c8c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.317947:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000201a2490/0x96d0c9b8c9a1c8c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201206.317958:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.317960:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201206.317961:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201206.318012:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201206.318045:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201206.318163:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1c8b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.318177:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201206.318180:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1c8b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.318197:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1c8b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.318209:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1c8b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.318216:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1c8b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.318228:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201206.318230:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201206.318231:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201206.318282:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x362:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201206.318288:0:26205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1c8ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.318296:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x362:0x0].0x0 since=4057s v=(0 0) 00010000:00010000:2.0:1788201206.318299:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x362:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201206.318304:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1c8ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.318313:0:26205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1c8ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.318327:0:26205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1c8ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.318334:0:26205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1c8ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201206.318355:0:26205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201206.318883:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201206.318889:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1c8ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.318897:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201206.318900:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1c8ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.318907:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1c8ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.318919:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1c8ca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.318925:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1c8ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201206.318940:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201206.318942:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201206.318943:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788201206.319098:0:26205:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:803 00000100:00100000:2.0:1788201206.319237:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:94477:x1875060715250944:12345-0@lo:5:osp-pre-1-0.0 Request processed in 64475us (68730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201206.319247:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5924 00000100:00100000:1.0:1788201206.319714:0:94477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc47b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94477:1875060715250944:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788201206.319729:0:94477:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x381:0x0] from OST, last_created [0x2c0000401:0x381:0x0]last_used is [0x2c0000401:0x323:0x0] 00000100:00100000:1.0:1788201206.319889:0:94477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc45f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94477:1875060715251456:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788201206.319928:0:94477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201206.319953:0:94477:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0039cf480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201206.319972:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715251456 00000100:00100000:1.0:1788201206.319986:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715251456 00000100:00100000:1.0:1788201206.320069:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5926 00000100:00100000:1.0:1788201206.320078:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:94477:x1875060715251456:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788201206.320116:0:26201:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 898 00000100:00100000:2.0:1788201206.320313:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715251328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201206.320344:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201206.320376:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715251328 00000100:00100000:2.0:1788201206.320380:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715251328 00000100:00100000:2.0:1788201206.320406:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2323 00000100:00100000:2.0:1788201206.320412:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715251328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201206.320438:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 896 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201206.320476:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715251328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201206.320482:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2323 00000100:00100000:2.0:1788201206.320521:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715251328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201206.322633:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:94477:x1875060715251456:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2551us (2700us total) trans 4294969457 rc 0/0 00000100:00100000:1.0:1788201206.322645:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5926 00000100:00100000:2.0:1788201206.322920:0:94477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc45f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94477:1875060715251456:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788201206.322935:0:94477:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x381:0x0]-[0x2c0000401:0x3a1:0x0] 00010000:00010000:3.0:1788201206.550573:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788201206.616625:0:75739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788201206.679667:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201206.679834:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201206.679918:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695427584 00000100:00100000:3.0:1788201206.679928:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695427584 00000100:00100000:3.0:1788201206.679992:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1451 00000100:00100000:3.0:1788201206.680013:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695427584:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201206.680116:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695427584:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 115us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201206.680124:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1451 00000100:00100000:3.0:1788201206.684292:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201206.684495:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695427712 00000100:00100000:0.0:1788201206.684506:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695427712 00000100:00100000:0.0:1788201206.684588:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1452 00000100:00100000:0.0:1788201206.684599:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2400:x1875060695427712:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201206.684673:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2400:x1875060695427712:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 76us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201206.684694:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1452 00000100:00100000:1.0:1788201206.688617:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695427456 00000100:00100000:1.0:1788201206.688633:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695427456 00000100:00100000:1.0:1788201206.688688:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 76 00000100:00100000:1.0:1788201206.688699:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695427456:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201206.688792:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695427456:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 95us (9136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201206.688801:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 76 00000100:00080000:3.0:1788201206.693484:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000004:2.0:1788201206.855935:0:94796:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788201206.856571:0:94796:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788201207.567288:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788201207.759624:0:94846:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788201207.760464:0:94846:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788201208.591381:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201209.167348:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788201209.167403:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715251584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201209.167480:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201209.167526:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715251712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201209.167550:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201209.177144:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715251584 00000100:00100000:3.0:1788201209.177161:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715251584 00000100:00100000:3.0:1788201209.177239:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715251712 00000100:00100000:3.0:1788201209.177244:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715251712 00000100:00100000:3.0:1788201209.177282:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2324 00000100:00100000:3.0:1788201209.177293:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715251584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201209.177368:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788201209.177454:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715251584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 163us (9974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.177459:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2324 00000100:00100000:3.0:1788201209.177474:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2325 00000100:00100000:3.0:1788201209.177479:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715251712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201209.177492:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201209.177521:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715251712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (9970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.177527:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2325 00000100:00080000:1.0:1788201209.178033:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201209.178037:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201209.179298:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715251584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201209.179311:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715251712:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788201209.615394:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201209.911343:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201209.911492:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695427840 00000100:00100000:2.0:1788201209.911503:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695427840 00000100:00100000:2.0:1788201209.911581:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1452 00000100:00100000:2.0:1788201209.911592:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:72447:x1875060695427840:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1788201209.911612:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201209.911634:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1c8d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78692f expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.911712:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1c8d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.911727:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1c8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.911740:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1c8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201209.911807:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788201209.911810:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201209.911848:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1c8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.911874:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1c8d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78692f expref: 8 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.911890:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1c8d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78692f expref: 7 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201209.911899:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:2.0:1788201209.911902:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201209.911905:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc100030400, rc 0) 00000100:00100000:2.0:1788201209.912327:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:72447:x1875060695427840:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 736us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.912336:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1452 00000100:00080000:1.0:1788201209.912422:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201209.922287:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201209.922456:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695427968 00000100:00100000:0.0:1788201209.922467:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695427968 00000100:00100000:0.0:1788201209.922527:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1453 00000100:00100000:0.0:1788201209.922538:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:72447:x1875060695427968:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:0.0:1788201209.922575:0:69485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444913152 avail 1298673664 00000100:00100000:0.0:1788201209.922655:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:72447:x1875060695427968:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 119us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201209.922663:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1453 00000100:00100000:0.0:1788201209.925700:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201209.926054:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695428096 00000100:00100000:3.0:1788201209.926064:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695428096 00000100:00100000:3.0:1788201209.926193:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1454 00000100:00100000:3.0:1788201209.926204:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:72447:x1875060695428096:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:3.0:1788201209.926240:0:66314:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:3.0:1788201209.926314:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:72447:x1875060695428096:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 113us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.926321:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1454 00000100:00080000:1.0:1788201209.926633:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201209.937115:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201209.937230:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695428224 00000100:00100000:1.0:1788201209.937240:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695428224 00000100:00100000:1.0:1788201209.937293:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5927 00000100:00100000:1.0:1788201209.937301:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2399:x1875060695428224:12345-192.168.201.20@tcp:8:lfs.0 00010000:00080000:1.0:1788201209.937334:0:26209:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp t0 exp 0000000000000000 cur 4061 last 0 00000020:00000080:1.0:1788201209.937372:0:26209:0:(genops.c:1385:class_connect()) connect: client 6e293f14-c501-4bc5-9dd4-a18ef02756b4, cookie 0x96d0c9b8c9a1c8df 00002000:00100000:1.0:1788201209.937396:0:26209:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6e293f14-c501-4bc5-9dd4-a18ef02756b4/ffff8dc004016800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8409088 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788201209.937406:0:26209:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788201209.937464:0:26209:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788201209.937492:0:26209:0:(import.c:65:import_set_state_nolock()) ffff8dc004014000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201209.937557:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695428224:12345-192.168.201.20@tcp:8:lfs.0 Request processed in 255us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201209.937566:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5927 00000100:00100000:0.0:1788201209.944571:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201209.944671:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695428352 00000100:00100000:3.0:1788201209.944682:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695428352 00000100:00100000:3.0:1788201209.944774:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2326 00000100:00100000:3.0:1788201209.944785:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:72447:x1875060695428352:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:3.0:1788201209.944810:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788201209.944892:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:72447:x1875060695428352:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 108us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.944899:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2326 00000100:00080000:1.0:1788201209.945428:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201209.949298:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201209.949431:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695428480 00000100:00100000:3.0:1788201209.949440:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695428480 00000100:00100000:3.0:1788201209.949486:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5928 00000100:00100000:3.0:1788201209.949494:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1875060695428480:12345-192.168.201.20@tcp:8:lfs.0 00010000:00080000:3.0:1788201209.949528:0:8449:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp t0 exp 0000000000000000 cur 4061 last 0 00000020:00000080:3.0:1788201209.949557:0:8449:0:(genops.c:1385:class_connect()) connect: client 6e293f14-c501-4bc5-9dd4-a18ef02756b4, cookie 0x96d0c9b8c9a1c8e6 00002000:00100000:3.0:1788201209.949568:0:8449:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6e293f14-c501-4bc5-9dd4-a18ef02756b4/ffff8dc1401c6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788201209.949577:0:8449:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788201209.949639:0:8449:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788201209.949663:0:8449:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201209.949737:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695428480:12345-192.168.201.20@tcp:8:lfs.0 Request processed in 242us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201209.949745:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5928 00000100:00100000:0.0:1788201209.954660:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201209.954847:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695428608 00000100:00100000:2.0:1788201209.954857:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695428608 00000100:00100000:2.0:1788201209.954932:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2327 00000100:00100000:2.0:1788201209.954943:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:72447:x1875060695428608:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:2.0:1788201209.954974:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201209.955070:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:72447:x1875060695428608:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 128us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201209.955092:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2327 00000100:00080000:1.0:1788201209.955225:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788201210.639338:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201211.216732:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715251840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201211.216831:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201211.218588:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715251840 00000100:00100000:2.0:1788201211.218606:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715251840 00000100:00100000:2.0:1788201211.218691:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4070 00000100:00100000:2.0:1788201211.218702:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715251840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201211.218750:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:2.0:1788201211.218842:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715251840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (2012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201211.218850:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4070 00000100:00100000:3.0:1788201211.219294:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715251840:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201211.223791:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715251968:0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.223898:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201211.223955:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715252480:0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.223987:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201211.224053:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715252992:0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.224080:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201211.224122:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788201211.224130:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125808700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715252352:0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.224153:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201211.224172:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004c1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715252864:0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.224198:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201211.224828:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715253376:0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.224868:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201211.224919:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715251968 00000100:00100000:0.0:1788201211.224929:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715251968 00000100:00100000:0.0:1788201211.225007:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788201211.225044:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715251968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.225292:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715251968:12345-0@lo:400:kworker.0 Request processed in 275us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201211.225301:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788201211.225357:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715252480 00000100:00100000:0.0:1788201211.225362:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715252480 00000100:00100000:0.0:1788201211.225490:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715252992 00000100:00100000:0.0:1788201211.225494:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715252992 00000100:00100000:0.0:1788201211.225508:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715252352 00000100:00100000:0.0:1788201211.225510:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715252352 00000100:00100000:0.0:1788201211.225521:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715253376 00000100:00100000:0.0:1788201211.225523:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715253376 00000100:00100000:0.0:1788201211.225537:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00100000:0.0:1788201211.225543:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715252480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.225583:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715252480:12345-0@lo:400:kworker.0 Request processed in 40us (1595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201211.225589:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00100000:0.0:1788201211.225601:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454 00000100:00100000:0.0:1788201211.225607:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715252992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.225637:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715252992:12345-0@lo:400:kworker.0 Request processed in 30us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201211.225642:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454 00000100:00100000:0.0:1788201211.225936:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1455 00000100:00100000:0.0:1788201211.225958:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715252352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.226090:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715252352:12345-0@lo:400:kworker.0 Request processed in 133us (1936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201211.226097:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1455 00000100:00100000:3.0:1788201211.226270:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715252864 00000100:00100000:3.0:1788201211.226276:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715252864 00000100:00100000:3.0:1788201211.226317:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2863 00000100:00100000:3.0:1788201211.226327:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715252864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.226522:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1456 00000100:00100000:0.0:1788201211.226529:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715253376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201211.226723:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715252864:12345-0@lo:400:kworker.0 Request processed in 397us (2522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201211.226739:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2863 00000100:00100000:0.0:1788201211.226828:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715253376:12345-0@lo:400:kworker.0 Request processed in 299us (1959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201211.226835:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1456 00000100:00100000:0.0:1788201211.226901:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125808700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715252352:0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.226917:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004c1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715252864:0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.226930:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715253376:0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.226942:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715251968:0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.226955:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715252480:0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.227200:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715252992:0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.227332:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12580b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715252224:0@lo:400:kworker.0 00000100:00080000:1.0:1788201211.227634:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201211.227641:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201211.227644:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201211.227737:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201211.227854:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715252736:0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.227884:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201211.227910:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715253248:0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.227933:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201211.227958:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788201211.227987:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125809880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715252096:0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.228040:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201211.228116:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715252736 00000100:00100000:1.0:1788201211.228124:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715252736 00000100:00100000:1.0:1788201211.228174:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715253248 00000100:00100000:1.0:1788201211.228178:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715253248 00000100:00100000:1.0:1788201211.228202:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2864 00000100:00100000:1.0:1788201211.228211:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715252736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201211.228273:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715252736:12345-0@lo:400:kworker.0 Request processed in 64us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201211.228280:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2864 00000100:00100000:1.0:1788201211.228299:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2865 00000100:00100000:1.0:1788201211.228305:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125808e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715253248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201211.228334:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125808e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715253248:12345-0@lo:400:kworker.0 Request processed in 30us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201211.228351:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2865 00000100:00080000:1.0:1788201211.228370:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201211.228373:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201211.236048:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004c1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715252608:0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.236143:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201211.236167:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715253120:0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.236196:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201211.236247:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715252736:0@lo:400:kworker.0 00000100:00100000:0.0:1788201211.236263:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715253248:0@lo:400:kworker.0 00000100:00100000:3.0:1788201211.237368:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715252224 00000100:00100000:3.0:1788201211.237380:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715252224 00000100:00100000:3.0:1788201211.237464:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715252096 00000100:00100000:3.0:1788201211.237468:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715252096 00000100:00100000:3.0:1788201211.237500:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1457 00000100:00100000:3.0:1788201211.237512:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715252224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201211.237610:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715252224:12345-0@lo:400:kworker.0 Request processed in 99us (9872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201211.237617:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1457 00000100:00100000:3.0:1788201211.237640:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1458 00000100:00100000:3.0:1788201211.237659:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715252096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201211.237691:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715252096:12345-0@lo:400:kworker.0 Request processed in 34us (9677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201211.237698:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1458 00000100:00100000:3.0:1788201211.237724:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715253120 00000100:00100000:3.0:1788201211.237728:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715253120 00000100:00100000:3.0:1788201211.237759:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2866 00000100:00100000:3.0:1788201211.237766:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715253120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201211.237803:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715253120:12345-0@lo:400:kworker.0 Request processed in 38us (1607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201211.237809:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2866 00000100:00080000:1.0:1788201211.239892:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201211.239902:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201211.239906:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201211.240233:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715252608 00000100:00100000:3.0:1788201211.240247:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715252608 00000100:00100000:3.0:1788201211.240328:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4071 00000100:00100000:3.0:1788201211.240351:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715252608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201211.240493:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715252608:12345-0@lo:400:kworker.0 Request processed in 155us (4349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201211.240501:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4071 00000100:00100000:1.0:1788201211.241478:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125809880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715252096:0@lo:400:kworker.0 00000100:00100000:1.0:1788201211.241497:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004c1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715252608:0@lo:400:kworker.0 00000100:00100000:1.0:1788201211.241520:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715253120:0@lo:400:kworker.0 00000100:00100000:1.0:1788201211.241534:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12580b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715252224:0@lo:400:kworker.0 00010000:00010000:1.0:1788201211.665156:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201211.729396:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715253504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201211.729490:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201211.729561:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715253632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201211.729593:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201211.729631:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715253504 00000100:00100000:2.0:1788201211.729639:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715253504 00000100:00100000:2.0:1788201211.729696:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2328 00000100:00100000:2.0:1788201211.729707:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715253504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201211.729745:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201211.729795:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715253504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201211.729803:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2328 00000100:00100000:2.0:1788201211.729832:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715253632 00000100:00100000:2.0:1788201211.729836:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715253632 00000100:00100000:2.0:1788201211.729864:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4072 00000100:00100000:2.0:1788201211.729871:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715253632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201211.729930:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444913152 avail 1298673664 00000100:00100000:2.0:1788201211.729969:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715253632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201211.729976:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4072 00000100:00100000:2.0:1788201211.730054:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715253632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201211.730096:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715253504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201211.736675:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201211.736700:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715253760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201211.736784:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201211.736848:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715253760 00000100:00100000:1.0:1788201211.736858:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715253760 00000100:00100000:1.0:1788201211.737429:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2329 00000100:00100000:1.0:1788201211.737443:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715253760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201211.737482:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788201211.737546:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715253760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201211.737554:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2329 00000100:00100000:1.0:1788201211.737985:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715253760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201211.865762:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201211.865856:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695428736 00000100:00100000:3.0:1788201211.865869:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695428736 00000100:00100000:3.0:1788201211.865948:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 78 00000100:00100000:3.0:1788201211.865962:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695428736:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201211.869251:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695428736:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 3272us (3484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201211.869269:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 78 00000100:00100000:1.0:1788201211.870765:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201211.871009:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695428864 00000100:00100000:1.0:1788201211.871041:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695428864 00000100:00100000:1.0:1788201211.871130:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1459 00000100:00100000:1.0:1788201211.871143:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2402:x1875060695428864:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201211.871255:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2402:x1875060695428864:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 114us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201211.871263:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1459 00000100:00080000:1.0:1788201211.871292:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201211.871423:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201211.871509:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201211.871548:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201211.871576:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695429120 00000100:00100000:3.0:1788201211.871581:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695429120 00000100:00100000:3.0:1788201211.871619:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695429248 00000100:00100000:3.0:1788201211.871623:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695429248 00000100:00100000:3.0:1788201211.871647:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2867 00000100:00100000:3.0:1788201211.871655:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2403:x1875060695429120:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201211.871698:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2403:x1875060695429120:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 45us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201211.871705:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2867 00000100:00100000:3.0:1788201211.871719:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2868 00000100:00100000:3.0:1788201211.871725:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2403:x1875060695429248:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201211.871751:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2403:x1875060695429248:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201211.871766:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2868 00000100:00100000:2.0:1788201211.871827:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695428992 00000100:00100000:2.0:1788201211.871833:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695428992 00000100:00100000:2.0:1788201211.871895:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1460 00000100:00100000:2.0:1788201211.871904:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2403:x1875060695428992:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201211.871938:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2403:x1875060695428992:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 36us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201211.871945:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1460 00000100:00080000:1.0:1788201211.872381:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201211.872387:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201211.872389:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1788201212.250637:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000001:00080000:0.0:1788201212.250659:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969457 is committed 00000001:00100000:1.0:1788201212.251440:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000001:00080000:1.0:1788201212.251455:0:9526:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969457 is committed 00010000:00010000:3.0:1788201212.688775:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201213.715804:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201214.287989:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201214.288059:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715253888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201214.288168:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201214.290193:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715253888 00000100:00100000:2.0:1788201214.290215:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715253888 00000100:00100000:2.0:1788201214.290324:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2330 00000100:00100000:2.0:1788201214.290341:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715253888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201214.290386:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201214.290497:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715253888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 162us (2329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201214.290504:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2330 00000100:00100000:2.0:1788201214.290587:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715253888:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788201214.290748:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201214.291153:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201214.291172:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715254016:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201214.291230:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201214.291327:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715254016 00000100:00100000:1.0:1788201214.291334:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715254016 00000100:00100000:1.0:1788201214.291382:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2331 00000100:00100000:1.0:1788201214.291389:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715254016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201214.291409:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788201214.291441:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715254016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201214.291445:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2331 00000100:00080000:3.0:1788201214.292146:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201214.292194:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004c1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715254016:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788201214.736828:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201215.763238:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201216.010436:0:95039:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00000100:00100000:3.0:1788201216.336688:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201216.336715:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715254144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201216.336790:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201216.336895:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715254144 00000100:00100000:2.0:1788201216.336916:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715254144 00000100:00100000:2.0:1788201216.336981:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4073 00000100:00100000:2.0:1788201216.336992:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715254144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201216.337052:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:2.0:1788201216.337102:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715254144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201216.337110:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4073 00000100:00100000:3.0:1788201216.337205:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715254144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201216.340982:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715254272:0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.341659:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715254656:0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.341717:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201216.341750:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715255168:0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.341775:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201216.341810:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715255680:0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.341834:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201216.341872:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788201216.341879:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715254784:0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.341902:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201216.341918:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715255296:0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.341938:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201216.341969:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715254656 00000100:00100000:1.0:1788201216.341975:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715254656 00000100:00100000:1.0:1788201216.342067:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715255680 00000100:00100000:1.0:1788201216.342071:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715255680 00000100:00100000:1.0:1788201216.342085:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715254784 00000100:00100000:1.0:1788201216.342088:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715254784 00000100:00100000:1.0:1788201216.342101:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715255296 00000100:00100000:1.0:1788201216.342104:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715255296 00000100:00100000:1.0:1788201216.342118:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461 00000100:00100000:1.0:1788201216.342127:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715254656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.342173:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715254656:12345-0@lo:400:kworker.0 Request processed in 48us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201216.342180:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461 00000100:00100000:1.0:1788201216.342198:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1462 00000100:00100000:1.0:1788201216.342204:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125809880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715255680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.342230:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125809880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715255680:12345-0@lo:400:kworker.0 Request processed in 27us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201216.342236:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1462 00000100:00100000:1.0:1788201216.342248:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1463 00000100:00100000:1.0:1788201216.342288:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715254784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.342328:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715254784:12345-0@lo:400:kworker.0 Request processed in 41us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201216.342334:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1463 00000100:00100000:1.0:1788201216.342346:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1464 00000100:00100000:1.0:1788201216.342352:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715255296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.342376:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715255296:12345-0@lo:400:kworker.0 Request processed in 25us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201216.342382:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1464 00000100:00080000:1.0:1788201216.342404:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201216.342408:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201216.342438:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715254784:0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.342449:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715255296:0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.342458:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715254656:0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.342465:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715255680:0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.342506:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715255168 00000100:00100000:1.0:1788201216.342510:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715255168 00000100:00100000:1.0:1788201216.342546:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2869 00000100:00100000:1.0:1788201216.342553:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12580b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715255168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.342589:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12580b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715255168:12345-0@lo:400:kworker.0 Request processed in 37us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201216.342595:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2869 00000100:00100000:1.0:1788201216.342615:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715254528:0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.342639:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201216.342655:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715255040:0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.342684:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201216.342701:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715255552:0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.342718:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201216.342735:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788201216.342741:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715254400:0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.342760:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201216.342776:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715254912:0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.342801:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201216.342819:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715255424:0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.342840:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201216.342865:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201216.342875:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715255040 00000100:00100000:1.0:1788201216.342878:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715255040 00000100:00100000:1.0:1788201216.342905:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715255552 00000100:00100000:1.0:1788201216.342908:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715255552 00000100:00100000:1.0:1788201216.342927:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715255424 00000100:00100000:1.0:1788201216.342929:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715255424 00000100:00100000:1.0:1788201216.342949:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2870 00000100:00100000:1.0:1788201216.342955:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715255040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.342990:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715255040:12345-0@lo:400:kworker.0 Request processed in 35us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201216.342996:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2870 00000100:00100000:1.0:1788201216.343008:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2871 00000100:00100000:1.0:1788201216.343039:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715255552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.343069:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715255552:12345-0@lo:400:kworker.0 Request processed in 56us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201216.343075:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2871 00000100:00100000:1.0:1788201216.343096:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2872 00000100:00100000:1.0:1788201216.343101:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715255424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.343128:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715255424:12345-0@lo:400:kworker.0 Request processed in 27us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201216.343133:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2872 00000100:00100000:1.0:1788201216.343159:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715255168:0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.343177:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715254528 00000100:00100000:1.0:1788201216.343179:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715254528 00000100:00100000:1.0:1788201216.343199:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715254400 00000100:00100000:1.0:1788201216.343202:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715254400 00000100:00100000:1.0:1788201216.343215:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1465 00000100:00100000:1.0:1788201216.343221:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715254528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.343246:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715254528:12345-0@lo:400:kworker.0 Request processed in 26us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201216.343267:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1465 00000100:00100000:1.0:1788201216.343279:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1466 00000100:00100000:1.0:1788201216.343285:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715254400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.343311:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715254400:12345-0@lo:400:kworker.0 Request processed in 27us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201216.343316:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1466 00000100:00100000:1.0:1788201216.343340:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715254912 00000100:00100000:1.0:1788201216.343344:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715254912 00000100:00100000:1.0:1788201216.343366:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4074 00000100:00100000:1.0:1788201216.343372:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715254912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.343403:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715254912:12345-0@lo:400:kworker.0 Request processed in 31us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201216.343419:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4074 00000100:00080000:1.0:1788201216.343436:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201216.343438:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201216.343440:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201216.343442:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201216.343465:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715254400:0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.343474:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715254912:0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.343480:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969457 gen 2 00000100:00100000:1.0:1788201216.343491:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715255424:0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.343499:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715254528:0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.343507:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715255040:0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.343514:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969457 gen 2 00000100:00100000:1.0:1788201216.343524:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715255552:0@lo:400:kworker.0 00000100:00100000:3.0:1788201216.343846:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201216.345500:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715254272 00000100:00100000:1.0:1788201216.345512:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715254272 00000100:00100000:1.0:1788201216.345837:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788201216.345903:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715254272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201216.345981:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715254272:12345-0@lo:400:kworker.0 Request processed in 81us (2135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201216.345988:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788201216.347539:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715254272:0@lo:400:kworker.0 00010000:00010000:3.0:1788201216.783506:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201216.849135:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201216.849156:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715255808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201216.849640:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201216.849702:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715255808 00000100:00100000:2.0:1788201216.849709:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715255808 00000100:00100000:2.0:1788201216.849752:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2332 00000100:00100000:2.0:1788201216.849759:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715255808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201216.849784:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201216.849821:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715255808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201216.849827:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2332 00000100:00100000:2.0:1788201216.849980:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715255808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201216.850340:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201216.850351:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715255936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201216.850383:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201216.850411:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715255936 00000100:00100000:2.0:1788201216.850414:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715255936 00000100:00100000:2.0:1788201216.850438:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2333 00000100:00100000:2.0:1788201216.850444:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715255936:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201216.850640:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201216.850662:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004c1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715256064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201216.850696:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201216.850811:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715256064 00000100:00100000:0.0:1788201216.850816:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715256064 00000100:00100000:0.0:1788201216.850864:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4075 00000100:00100000:0.0:1788201216.850871:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715256064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201216.850897:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444913152 avail 1298673664 00000100:00100000:0.0:1788201216.850937:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715256064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201216.850943:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4075 00000100:00100000:1.0:1788201216.851380:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004c1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715256064:0@lo:41:osp-pre-0-1.0 00002000:00000024:2.0:1788201216.852526:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788201216.852578:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715255936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2132us (2193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201216.852586:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2333 00000100:00100000:2.0:1788201216.852631:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715255936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201216.982944:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201216.983127:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201216.983249:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201216.983335:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201216.983457:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695429376 00000100:00100000:0.0:1788201216.983466:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695429376 00000100:00100000:2.0:1788201216.983466:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695429888 00000100:00100000:2.0:1788201216.983469:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695429888 00000100:00080000:0.0:1788201216.983515:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201216.983534:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2873 00000100:00100000:2.0:1788201216.983544:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695429888:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201216.983574:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:0.0:1788201216.983581:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695429376:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201216.983611:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695429888:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 69us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201216.983617:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2873 00000100:00100000:0.0:1788201216.983907:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695429376:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 325us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201216.983927:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:0.0:1788201216.984005:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201216.984227:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695429760 00000100:00100000:3.0:1788201216.984232:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695429760 00000100:00100000:3.0:1788201216.984312:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2874 00000100:00100000:3.0:1788201216.984320:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695429760:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201216.984351:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695429760:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 33us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201216.984361:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2874 00000100:00080000:0.0:1788201216.984710:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201216.985407:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695429632 00000100:00100000:1.0:1788201216.985415:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695429632 00000100:00100000:1.0:1788201216.985485:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695429504 00000100:00100000:1.0:1788201216.985489:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695429504 00000100:00100000:1.0:1788201216.985534:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1467 00000100:00100000:1.0:1788201216.985543:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2403:x1875060695429632:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201216.985606:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2403:x1875060695429632:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 63us (2488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201216.985612:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1467 00000100:00080000:0.0:1788201216.985629:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201216.985630:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1468 00000100:00080000:0.0:1788201216.985632:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201216.985637:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695429504:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201216.985664:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695429504:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 28us (2329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201216.985670:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1468 00000001:02000400:2.0:1788201217.538619:0:95088:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:2.0:1788201217.807303:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201218.831570:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201219.410704:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201219.410733:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715256192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201219.410822:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201219.411229:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715256192 00000100:00100000:2.0:1788201219.411238:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715256192 00000100:00100000:2.0:1788201219.411308:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2334 00000100:00100000:2.0:1788201219.411320:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715256192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201219.411347:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201219.411394:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715256192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201219.411400:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2334 00000100:00100000:1.0:1788201219.411475:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715256320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201219.411507:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201219.411550:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715256192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201219.411856:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715256320 00000100:00100000:2.0:1788201219.411862:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715256320 00000100:00100000:2.0:1788201219.411896:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2335 00000100:00100000:2.0:1788201219.411904:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715256320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201219.411935:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788201219.411985:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715256320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201219.411991:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2335 00000100:00080000:3.0:1788201219.412149:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201219.412154:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201219.412284:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715256320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201219.538352:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201219.538463:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695430016 00000100:00100000:1.0:1788201219.538482:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695430016 00000100:00100000:1.0:1788201219.538611:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1455 00000100:00100000:1.0:1788201219.538626:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:72914:x1875060695430016:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:1.0:1788201219.538700:0:69485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444913152 avail 1298673664 00000100:00100000:1.0:1788201219.538808:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:72914:x1875060695430016:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 187us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201219.538816:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1455 00000100:00080000:3.0:1788201219.539700:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201219.548299:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201219.548565:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695430144 00000100:00100000:1.0:1788201219.548580:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695430144 00000100:00100000:1.0:1788201219.548682:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1456 00000100:00100000:1.0:1788201219.548696:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:72914:x1875060695430144:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:1.0:1788201219.548749:0:66313:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:1.0:1788201219.548852:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:72914:x1875060695430144:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 159us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201219.548861:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1456 00000100:00080000:3.0:1788201219.549816:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201219.554663:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201219.555572:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695430272 00000100:00100000:0.0:1788201219.555588:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695430272 00000100:00100000:0.0:1788201219.555736:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2336 00000100:00100000:0.0:1788201219.555748:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:72914:x1875060695430272:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:0.0:1788201219.555782:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788201219.555883:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:72914:x1875060695430272:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 136us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201219.555892:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2336 00000100:00080000:3.0:1788201219.556698:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201219.558697:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201219.558899:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695430400 00000100:00100000:1.0:1788201219.558913:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695430400 00000100:00100000:1.0:1788201219.559097:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2337 00000100:00100000:1.0:1788201219.559110:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:72914:x1875060695430400:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:1.0:1788201219.559143:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201219.559252:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:72914:x1875060695430400:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 143us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201219.559260:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2337 00000100:00080000:3.0:1788201219.567471:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201219.574558:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201219.574727:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695430528 00000100:00100000:2.0:1788201219.574741:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695430528 00000100:00100000:2.0:1788201219.574823:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1457 00000100:00100000:2.0:1788201219.574834:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:71811:x1875060695430528:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:2.0:1788201219.574862:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201219.574891:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1c8ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786936 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.574995:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1c8f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.575052:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1c8f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.575070:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1c8f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.575089:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030e00/0x96d0c9b8c9a1c8fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.575097:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030e00/0x96d0c9b8c9a1c8fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.575104:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030e00/0x96d0c9b8c9a1c8fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.575346:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030c00/0x96d0c9b8c9a1c902 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.575355:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030c00/0x96d0c9b8c9a1c902 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.575362:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030c00/0x96d0c9b8c9a1c902 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201219.575403:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788201219.575408:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201219.575464:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030c00/0x96d0c9b8c9a1c902 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.575480:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1c8f4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.575487:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1c8f4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.575494:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1c8f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.575512:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1c8f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.575520:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201219.575525:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1c8f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.575533:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1c8f4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.575556:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:2.0:1788201219.575559:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201219.575565:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1c8f4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.575571:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1c8f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.575588:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030e00/0x96d0c9b8c9a1c8fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.575593:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030e00/0x96d0c9b8c9a1c8fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.575598:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030e00/0x96d0c9b8c9a1c8fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.575603:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030e00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201219.575606:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030e00/0x96d0c9b8c9a1c8fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.575612:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030e00/0x96d0c9b8c9a1c8fb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.575619:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff8dc12196e200) 00010000:00010000:2.0:1788201219.575621:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201219.575624:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030e00/0x96d0c9b8c9a1c8fb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.575629:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030e00/0x96d0c9b8c9a1c8fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.575678:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1c8ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786936 expref: 9 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.575694:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030c00/0x96d0c9b8c9a1c902 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786936 expref: 8 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.575701:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8dc12196ee00) 00010000:00010000:2.0:1788201219.575703:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201219.575706:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc100030c00, rc 0) 00000100:00100000:2.0:1788201219.576833:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:71811:x1875060695430528:12345-192.168.201.20@tcp:101:bash.0 Request processed in 1992us (2284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201219.576845:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1457 00000100:00100000:2.0:1788201219.582538:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201219.582793:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695430656 00000100:00100000:0.0:1788201219.582806:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695430656 00000100:00100000:0.0:1788201219.582884:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1458 00000100:00100000:0.0:1788201219.582896:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:71811:x1875060695430656:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:0.0:1788201219.582924:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201219.582953:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1c909 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78693d expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.583674:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1c910 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.583719:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1c910 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.583735:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1c910 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.583755:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1c917 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.583762:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1c917 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.583768:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1c917 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201219.583982:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:66314:1875060715256448:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201219.584667:0:66314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201219.584775:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103892840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201219.590456:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715256448 00000100:00100000:1.0:1788201219.590483:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715256448 00000100:00100000:1.0:1788201219.591656:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4076 00000100:00100000:1.0:1788201219.591679:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13c272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66314:x1875060715256448:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788201219.591901:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13c272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66314:x1875060715256448:12345-0@lo:1000:mdt00_002.0 Request processed in 229us (7235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201219.591911:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4076 00000100:00100000:0.0:1788201219.592320:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:66314:1875060715256448:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788201219.592408:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a400/0x96d0c9b8c9a1c91e lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.592430:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a400/0x96d0c9b8c9a1c91e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.592446:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a400/0x96d0c9b8c9a1c91e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201219.592483:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a400/0x96d0c9b8c9a1c91e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.592531:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1c910 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.592539:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1c910 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.592546:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1c910 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.592554:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1c910 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.592562:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896ac00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201219.592567:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1c910 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.592576:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1c910 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.592593:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8dc12196ee00) 00010000:00010000:0.0:1788201219.592596:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201219.592602:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1c910 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.592610:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1c910 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.592628:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1c917 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.592635:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1c917 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.592649:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1c917 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.592655:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896be00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201219.592659:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1c917 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.592666:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1c917 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.592676:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0xb04f75d6 (ffff8dc0048be100) 00010000:00010000:0.0:1788201219.592679:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201219.592683:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1c917 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.592688:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1c917 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.592742:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1c909 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78693d expref: 10 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.592759:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a400/0x96d0c9b8c9a1c91e lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78693d expref: 9 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.592766:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8dc0048bea00) 00010000:00010000:0.0:1788201219.592768:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201219.592771:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896a400, rc 0) 00000100:00100000:0.0:1788201219.592855:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:71811:x1875060695430656:12345-192.168.201.20@tcp:101:bash.0 Request processed in 9960us (10334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201219.592874:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1458 00000100:00100000:0.0:1788201219.611838:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201219.611935:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695430784 00000100:00100000:3.0:1788201219.611948:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695430784 00000100:00100000:3.0:1788201219.612069:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1459 00000100:00100000:3.0:1788201219.612083:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:71811:x1875060695430784:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:3.0:1788201219.612113:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201219.612140:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1c925 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786944 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.612238:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1c92c lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.612255:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1c92c lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.612270:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1c92c lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201219.612333:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x2:0x0]: returning size 4096 00000004:00200000:3.0:1788201219.612337:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1788201219.612406:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1c925 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786944 expref: 11 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.612450:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1c92c lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786944 expref: 10 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.612460:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8dc1115dfb00) 00010000:00010000:3.0:1788201219.612463:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1788201219.612467:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59600, rc 0) 00000100:00100000:3.0:1788201219.612553:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:71811:x1875060695430784:12345-192.168.201.20@tcp:101:bash.0 Request processed in 472us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201219.612562:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1459 00000100:00100000:3.0:1788201219.615185:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201219.615297:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201219.615585:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695431040 00000100:00100000:1.0:1788201219.615599:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695431040 00000100:00100000:1.0:1788201219.615676:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 717 00000100:00100000:1.0:1788201219.615687:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2402:x1875060695431040:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201219.615705:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201219.615738:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1c92c lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786944 expref: 10 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.615761:0:26215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8dc1115dfb00) 00010000:00010000:1.0:1788201219.615767:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201219.615837:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2402:x1875060695431040:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 152us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201219.615845:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 717 00000100:00100000:2.0:1788201219.622089:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695430912 00000100:00100000:2.0:1788201219.622115:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695430912 00000100:00100000:2.0:1788201219.622227:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1460 00000100:00100000:2.0:1788201219.622242:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:71811:x1875060695430912:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:2.0:1788201219.622271:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201219.622299:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100030e00/0x96d0c9b8c9a1c933 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78694b expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622388:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1c93a lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622404:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1c93a lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622444:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1c93a lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622461:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1c941 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622468:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1c941 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622475:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1c941 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622585:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1c948 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622595:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1c948 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622602:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1c948 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201219.622656:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788201219.622661:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201219.622688:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1c948 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622701:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1c948 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622711:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1c93a lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622728:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1c93a lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622735:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1c93a lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622742:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1c93a lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622748:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201219.622753:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1c93a lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622761:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1c93a lrc: 5/0,0 mode: CR/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622776:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8dc1115dfb00) 00010000:00010000:2.0:1788201219.622779:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201219.622784:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1c93a lrc: 3/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622791:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1c93a lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622806:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1c941 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622812:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1c941 lrc: 2/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622818:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1c941 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622828:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201219.622831:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1c941 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622837:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1c941 lrc: 4/0,0 mode: PR/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622844:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x9add8152 (ffff8dc12196e200) 00010000:00010000:2.0:1788201219.622846:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201219.622848:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1c941 lrc: 2/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622854:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1c941 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622888:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100030e00/0x96d0c9b8c9a1c933 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78694b expref: 11 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622901:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1c948 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78694b expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.622908:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff8dc107112e00) 00010000:00010000:2.0:1788201219.622910:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201219.622913:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc100031200, rc 0) 00000100:00100000:2.0:1788201219.623009:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:71811:x1875060695430912:12345-192.168.201.20@tcp:101:bash.0 Request processed in 771us (7842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201219.623057:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1460 00000100:00100000:3.0:1788201219.630363:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201219.630449:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695431168 00000100:00100000:2.0:1788201219.630484:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695431168 00000100:00100000:2.0:1788201219.630560:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5929 00000100:00100000:2.0:1788201219.630574:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695431168:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:2.0:1788201219.630600:0:26203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201219.630623:0:26203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1c94f lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786952 expref: -99 pid: 26203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201219.630655:0:26203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x602:0x0] initial LVB size: 0, mtime: 0x6a95c8d1, atime: 0x6a95c8d1, ctime: 0x6a95c8d1, blocks: 0x0 00010000:00010000:2.0:1788201219.630676:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x602:0x0].0x0 since=4071s v=(0 0) 00010000:00010000:2.0:1788201219.630681:0:26203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x602:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201219.630690:0:26203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1c94f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786952 expref: 6 pid: 26203 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.630706:0:26203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1c94f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786952 expref: 6 pid: 26203 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201219.630719:0:26203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc100031400, rc 0) 00000100:00100000:2.0:1788201219.630791:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2403:x1875060695431168:12345-192.168.201.20@tcp:101:bash.0 Request processed in 221us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201219.630797:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5929 00000100:00100000:3.0:1788201219.633660:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201219.633761:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695431296 00000100:00100000:0.0:1788201219.633772:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695431296 00000100:00100000:0.0:1788201219.633837:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1461 00000100:00100000:0.0:1788201219.633846:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:71811:x1875060695431296:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:0.0:1788201219.633870:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201219.633893:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1c956 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786959 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.633973:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1c95d lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.633986:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1c95d lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.633995:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1c95d lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.634005:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1c964 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.634010:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1c964 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.634044:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1c964 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201219.634169:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:66314:1875060715256576:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201219.634867:0:66314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201219.634933:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103892840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201219.635038:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715256576 00000100:00100000:2.0:1788201219.635047:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715256576 00000100:00100000:2.0:1788201219.635154:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4077 00000100:00100000:2.0:1788201219.635164:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66314:x1875060715256576:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788201219.635313:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66314:x1875060715256576:12345-0@lo:1000:mdt00_002.0 Request processed in 151us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201219.635335:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4077 00000100:00100000:0.0:1788201219.635431:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:66314:1875060715256576:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788201219.635501:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b400/0x96d0c9b8c9a1c96b lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.635519:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b400/0x96d0c9b8c9a1c96b lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.635530:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b400/0x96d0c9b8c9a1c96b lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201219.635556:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b400/0x96d0c9b8c9a1c96b lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.635571:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1c95d lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.635579:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1c95d lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.635586:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1c95d lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.635594:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1c95d lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.635600:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896ac00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201219.635605:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1c95d lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.635613:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1c95d lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.635636:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x0 (ffff8dc12196ee00) 00010000:00010000:0.0:1788201219.635639:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201219.635644:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1c95d lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.635652:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1c95d lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.635669:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1c964 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.635676:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1c964 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.635682:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1c964 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.635687:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896a000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201219.635690:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1c964 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.635695:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1c964 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.635702:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1:0x0].0x8f93a2f9 (ffff8dc0048be100) 00010000:00010000:0.0:1788201219.635704:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201219.635707:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1c964 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.635713:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1c964 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.635766:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1c956 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786959 expref: 11 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.635781:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b400/0x96d0c9b8c9a1c96b lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786959 expref: 10 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201219.635789:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8dc0048bee00) 00010000:00010000:0.0:1788201219.635791:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201219.635793:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896b400, rc 0) 00000100:00100000:0.0:1788201219.639448:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:71811:x1875060695431296:12345-192.168.201.20@tcp:101:bash.0 Request processed in 5582us (5780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201219.639466:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1461 00000100:00100000:0.0:1788201219.646659:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201219.646857:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695431424 00000100:00100000:1.0:1788201219.646875:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695431424 00000100:00100000:1.0:1788201219.646981:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1462 00000100:00100000:1.0:1788201219.646995:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:71811:x1875060695431424:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:1.0:1788201219.647053:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201219.647081:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fda00/0x96d0c9b8c9a1c972 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786960 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.647164:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1c979 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.647332:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1c979 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.647347:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1c979 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201219.647415:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788201219.647419:0:69485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1788201219.647470:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fda00/0x96d0c9b8c9a1c972 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786960 expref: 12 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.647493:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1c979 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786960 expref: 11 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.647570:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8dc107112000) 00010000:00010000:1.0:1788201219.647573:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1788201219.647578:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fd400, rc 0) 00000100:00100000:1.0:1788201219.647663:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:71811:x1875060695431424:12345-192.168.201.20@tcp:101:bash.0 Request processed in 671us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201219.647672:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1462 00000100:00100000:3.0:1788201219.649688:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201219.649810:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695431552 00000100:00100000:1.0:1788201219.649820:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695431552 00000100:00100000:1.0:1788201219.649875:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1463 00000100:00100000:1.0:1788201219.649883:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:71811:x1875060695431552:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:1.0:1788201219.649905:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201219.649928:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1c980 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786967 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650155:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c987 lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650169:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c987 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650179:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c987 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650336:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1c98e lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650345:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1c98e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650351:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1c98e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650439:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1c995 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650445:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1c995 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650450:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1c995 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201219.650500:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x5:0x0]: returning size 0 00000004:00200000:1.0:1788201219.650506:0:66313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201219.650529:0:66313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1c995 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650556:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1c995 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650568:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c987 lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650575:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c987 lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650581:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c987 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650588:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c987 lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650594:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fcc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201219.650599:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c987 lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650608:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c987 lrc: 5/0,0 mode: CR/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650623:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8dc107112000) 00010000:00010000:1.0:1788201219.650625:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201219.650629:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c987 lrc: 3/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650634:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c987 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650648:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1c98e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650657:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1c98e lrc: 2/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650661:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1c98e lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650663:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fc000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201219.650665:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1c98e lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650669:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1c98e lrc: 4/0,0 mode: PR/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650673:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x9add8152 (ffff8dc103b47500) 00010000:00010000:1.0:1788201219.650675:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201219.650677:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1c98e lrc: 2/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650681:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1c98e lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650710:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc400/0x96d0c9b8c9a1c980 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786967 expref: 13 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650719:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1c995 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786967 expref: 12 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.650723:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff8dc1115df600) 00010000:00010000:1.0:1788201219.650725:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201219.650731:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fc600, rc 0) 00000100:00100000:1.0:1788201219.650847:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:71811:x1875060695431552:12345-192.168.201.20@tcp:101:bash.0 Request processed in 963us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201219.650853:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1463 00000100:00100000:3.0:1788201219.652139:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201219.652241:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695431680 00000100:00100000:1.0:1788201219.652252:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695431680 00000100:00100000:1.0:1788201219.652317:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 718 00000100:00100000:1.0:1788201219.652328:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2402:x1875060695431680:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201219.652346:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201219.652372:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1c979 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786960 expref: 12 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201219.652387:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8dc107112000) 00010000:00010000:1.0:1788201219.652391:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201219.652436:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2402:x1875060695431680:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 111us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201219.652441:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 718 00000100:00100000:0.0:1788201219.659010:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201219.662702:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695431808 00000100:00100000:3.0:1788201219.662726:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695431808 00000100:00100000:3.0:1788201219.662883:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5930 00000100:00100000:3.0:1788201219.662896:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695431808:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:3.0:1788201219.662923:0:26210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201219.662964:0:26210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e992bbc1/0x96d0c9b8c9a1c99c lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78696e expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201219.663000:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x603:0x0] initial LVB size: 0, mtime: 0x6a95c8d1, atime: 0x6a95c8d1, ctime: 0x6a95c8d1, blocks: 0x0 00010000:00010000:3.0:1788201219.664890:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x603:0x0].0x0 since=4071s v=(0 0) 00010000:00010000:3.0:1788201219.664923:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x603:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201219.664941:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e992bbc1/0x96d0c9b8c9a1c99c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78696e expref: 7 pid: 26210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.664988:0:26210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e992bbc1/0x96d0c9b8c9a1c99c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78696e expref: 7 pid: 26210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201219.665008:0:26210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59200, rc 0) 00000100:00100000:3.0:1788201219.665384:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695431808:12345-192.168.201.20@tcp:101:bash.0 Request processed in 2487us (6387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201219.665395:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5930 00010000:00010000:1.0:1788201219.855422:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201220.890154:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201221.460154:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715256704:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.460235:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201221.460277:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715257216:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.460304:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201221.460329:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715257728:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.460349:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201221.460366:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715258240:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.460390:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201221.460414:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788201221.460420:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715256832:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.460441:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201221.460457:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715257344:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.460476:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201221.460490:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715257856:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.460508:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201221.460533:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715256960:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.460555:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201221.460571:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13336bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715257472:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.460592:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201221.460608:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715257984:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.460627:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201221.460644:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788201221.460661:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715257088:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.460683:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201221.460693:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715257600:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.460709:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201221.460725:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715258112:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.460742:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201221.460770:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715256704 00000100:00100000:2.0:1788201221.460777:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715256704 00000100:00100000:2.0:1788201221.460822:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788201221.460832:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715256704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.460880:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715256704:12345-0@lo:400:kworker.0 Request processed in 48us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201221.460887:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788201221.460920:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715257216 00000100:00100000:2.0:1788201221.460923:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715257216 00000100:00100000:2.0:1788201221.460953:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715257728 00000100:00100000:2.0:1788201221.460956:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715257728 00000100:00100000:2.0:1788201221.460967:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715258240 00000100:00100000:2.0:1788201221.460969:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715258240 00000100:00100000:2.0:1788201221.460977:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715256832 00000100:00100000:2.0:1788201221.460979:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715256832 00000100:00100000:2.0:1788201221.460990:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715256960 00000100:00100000:2.0:1788201221.460991:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715256960 00000100:00100000:2.0:1788201221.461000:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715257088 00000100:00100000:2.0:1788201221.461002:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715257088 00000100:00100000:2.0:1788201221.461038:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1469 00000100:00100000:2.0:1788201221.461045:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715257216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.461078:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715257216:12345-0@lo:400:kworker.0 Request processed in 34us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201221.461095:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1469 00000100:00100000:2.0:1788201221.461108:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00100000:2.0:1788201221.461113:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715257728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.461142:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715257728:12345-0@lo:400:kworker.0 Request processed in 29us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201221.461148:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00100000:2.0:1788201221.461159:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00100000:2.0:1788201221.461178:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715258240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.461206:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715258240:12345-0@lo:400:kworker.0 Request processed in 28us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201221.461211:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00100000:2.0:1788201221.461223:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1472 00000100:00100000:2.0:1788201221.461229:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715256832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.461254:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715256832:12345-0@lo:400:kworker.0 Request processed in 27us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201221.461260:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1472 00000100:00100000:2.0:1788201221.461270:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1473 00000100:00100000:2.0:1788201221.461276:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715256960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.461304:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715256960:12345-0@lo:400:kworker.0 Request processed in 28us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201221.461310:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1473 00000100:00100000:2.0:1788201221.461318:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1474 00000100:00100000:2.0:1788201221.461324:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715257088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.461344:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715257088:12345-0@lo:400:kworker.0 Request processed in 20us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201221.461354:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1474 00000100:00100000:2.0:1788201221.461381:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715257344 00000100:00100000:2.0:1788201221.461384:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715257344 00000100:00100000:2.0:1788201221.461404:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715257856 00000100:00100000:2.0:1788201221.461406:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715257856 00000100:00100000:2.0:1788201221.461419:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4078 00000100:00100000:2.0:1788201221.461425:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715257344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.461456:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715257344:12345-0@lo:400:kworker.0 Request processed in 31us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201221.461462:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4078 00000100:00100000:2.0:1788201221.461472:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4079 00000100:00100000:2.0:1788201221.461477:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715257856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.461501:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715257856:12345-0@lo:400:kworker.0 Request processed in 24us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201221.461507:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4079 00000100:00100000:2.0:1788201221.461524:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715257472 00000100:00100000:2.0:1788201221.461528:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715257472 00000100:00100000:2.0:1788201221.461553:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715257984 00000100:00100000:2.0:1788201221.461555:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715257984 00000100:00100000:2.0:1788201221.461573:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715257600 00000100:00100000:2.0:1788201221.461575:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715257600 00000100:00100000:2.0:1788201221.461589:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715258112 00000100:00100000:2.0:1788201221.461591:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715258112 00000100:00100000:2.0:1788201221.461608:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2875 00000100:00100000:2.0:1788201221.461614:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715257472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.461647:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715257472:12345-0@lo:400:kworker.0 Request processed in 33us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201221.461653:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2875 00000100:00100000:2.0:1788201221.461671:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2876 00000100:00100000:2.0:1788201221.461677:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715257984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.461704:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715257984:12345-0@lo:400:kworker.0 Request processed in 28us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201221.461709:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2876 00000100:00100000:2.0:1788201221.461720:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2877 00000100:00100000:2.0:1788201221.461725:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715257600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.461749:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715257600:12345-0@lo:400:kworker.0 Request processed in 24us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201221.461754:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2877 00000100:00100000:2.0:1788201221.461763:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2878 00000100:00100000:2.0:1788201221.461769:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715258112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.461791:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715258112:12345-0@lo:400:kworker.0 Request processed in 23us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201221.461795:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2878 00000100:00100000:2.0:1788201221.461843:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715256832:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.461854:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715257344:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.461863:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715257856:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.461870:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715256704:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.461878:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715257216:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.461886:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715257728:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.461893:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715258240:0@lo:400:kworker.0 00000100:00080000:2.0:1788201221.461931:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201221.461935:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201221.461937:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201221.461939:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201221.461955:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715257088:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.461965:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715257600:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.461973:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715258112:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.461980:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715256960:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.461989:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13336bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715257472:0@lo:400:kworker.0 00000100:00100000:2.0:1788201221.461997:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715257984:0@lo:400:kworker.0 00000100:00100000:3.0:1788201221.462323:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715258368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201221.462361:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201221.462395:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715258368 00000100:00100000:3.0:1788201221.462400:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715258368 00000100:00100000:3.0:1788201221.462426:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4080 00000100:00100000:3.0:1788201221.462432:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715258368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788201221.462458:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:3.0:1788201221.462492:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715258368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201221.462498:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4080 00000100:00100000:3.0:1788201221.462531:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715258368:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788201221.903292:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201221.967353:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201221.967377:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715258496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201221.967459:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201221.967582:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715258496 00000100:00100000:0.0:1788201221.967590:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715258496 00000100:00100000:2.0:1788201221.967754:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201221.967764:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715258624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201221.967805:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201221.967835:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715258624 00000100:00100000:2.0:1788201221.967838:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715258624 00000100:00100000:2.0:1788201221.967871:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2338 00000100:00100000:2.0:1788201221.967880:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715258624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201221.967911:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201221.967968:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715258624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201221.967976:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2338 00000100:00100000:2.0:1788201221.968050:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715258624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201221.968144:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4081 00000100:00100000:0.0:1788201221.968165:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715258496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201221.968190:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444913152 avail 1298673664 00000100:00100000:0.0:1788201221.968233:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715258496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201221.968240:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4081 00000100:00100000:2.0:1788201221.968301:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715258496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201221.968910:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201221.968923:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715258752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201221.968962:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201221.968997:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715258752 00000100:00100000:1.0:1788201221.969002:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715258752 00000100:00100000:1.0:1788201221.969060:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2339 00000100:00100000:1.0:1788201221.969068:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715258752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201221.969088:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788201221.969125:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715258752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201221.969160:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2339 00000100:00100000:1.0:1788201221.969197:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715258752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201222.108652:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201222.108702:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201222.108745:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201222.108772:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201222.108825:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201222.108853:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695432192 00000100:00100000:0.0:1788201222.108863:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695432192 00000100:00100000:0.0:1788201222.108932:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695432064 00000100:00100000:0.0:1788201222.108936:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695432064 00000100:00100000:0.0:1788201222.108964:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1475 00000100:00100000:0.0:1788201222.108974:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695432192:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201222.109095:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695432192:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 122us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201222.109102:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1475 00000100:00100000:0.0:1788201222.109120:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1476 00000100:00100000:0.0:1788201222.109127:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2403:x1875060695432064:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201222.109176:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2403:x1875060695432064:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 49us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201222.109182:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1476 00000100:00080000:0.0:1788201222.109200:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201222.109204:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201222.109556:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695431936 00000100:00100000:2.0:1788201222.109562:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695431936 00000100:00100000:2.0:1788201222.109606:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 82 00000100:00100000:2.0:1788201222.109614:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695431936:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201222.109649:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695431936:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 36us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201222.109655:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 82 00000100:00100000:1.0:1788201222.109773:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695432448 00000100:00100000:1.0:1788201222.109778:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695432448 00000100:00100000:1.0:1788201222.109818:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695432320 00000100:00100000:1.0:1788201222.109821:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695432320 00000100:00100000:1.0:1788201222.109844:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2879 00000100:00100000:1.0:1788201222.109851:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695432448:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201222.109886:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695432448:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 36us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201222.109892:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2879 00000100:00100000:1.0:1788201222.109907:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2880 00000100:00100000:1.0:1788201222.109914:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695432320:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201222.109938:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695432320:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201222.109943:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2880 00000100:00080000:2.0:1788201222.110322:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201222.110326:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788201222.927597:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201223.951875:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201224.527708:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715258880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201224.527785:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201224.527836:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715258880 00000100:00100000:0.0:1788201224.527845:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715258880 00000100:00100000:0.0:1788201224.527926:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2340 00000100:00100000:0.0:1788201224.527938:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715258880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201224.527967:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201224.528040:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715258880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201224.528048:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2340 00000100:00100000:1.0:1788201224.528141:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715258880:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788201224.528214:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201224.528228:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715259008:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201224.528262:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201224.528350:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715259008 00000100:00100000:0.0:1788201224.528355:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715259008 00000100:00100000:0.0:1788201224.528412:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2341 00000100:00100000:0.0:1788201224.528420:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715259008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201224.528435:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788201224.528477:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715259008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201224.528484:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2341 00000100:00080000:2.0:1788201224.528568:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201224.528983:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715259008:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788201224.979498:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201226.001298:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201226.575369:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715259136:0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.575457:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201226.575509:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715259648:0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.575536:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201226.575554:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715260160:0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.575577:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201226.575596:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715260672:0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.575617:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201226.575642:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788201226.575647:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715259520:0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.575668:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201226.575699:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715260032:0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.575727:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201226.575742:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715260544:0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.575758:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201226.575780:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715259264:0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.575801:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201226.575817:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715259776:0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.575853:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201226.575870:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13336bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715260288:0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.575890:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201226.575908:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788201226.575913:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715259392:0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.575931:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201226.575941:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715259904:0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.575961:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201226.575976:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715260416:0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.575995:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201226.576054:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715259136 00000100:00100000:2.0:1788201226.576062:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715259136 00000100:00100000:2.0:1788201226.576123:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788201226.576133:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715259136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.576178:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715259136:12345-0@lo:400:kworker.0 Request processed in 47us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201226.576185:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788201226.576218:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715259648 00000100:00100000:2.0:1788201226.576228:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715259648 00000100:00100000:2.0:1788201226.576260:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715260160 00000100:00100000:2.0:1788201226.576262:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715260160 00000100:00100000:2.0:1788201226.576272:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715260672 00000100:00100000:2.0:1788201226.576274:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715260672 00000100:00100000:2.0:1788201226.576283:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715259520 00000100:00100000:2.0:1788201226.576285:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715259520 00000100:00100000:2.0:1788201226.576295:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715259264 00000100:00100000:2.0:1788201226.576297:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715259264 00000100:00100000:2.0:1788201226.576308:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715259392 00000100:00100000:2.0:1788201226.576310:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715259392 00000100:00100000:2.0:1788201226.576322:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00100000:2.0:1788201226.576328:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715259648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.576361:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715259648:12345-0@lo:400:kworker.0 Request processed in 33us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201226.576367:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000100:00100000:2.0:1788201226.576380:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1478 00000100:00100000:2.0:1788201226.576386:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715260160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.576410:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715260160:12345-0@lo:400:kworker.0 Request processed in 24us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201226.576415:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1478 00000100:00100000:2.0:1788201226.576424:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1479 00000100:00100000:2.0:1788201226.576429:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715260672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.576448:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715260672:12345-0@lo:400:kworker.0 Request processed in 19us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201226.576453:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1479 00000100:00100000:2.0:1788201226.576461:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1480 00000100:00100000:2.0:1788201226.576465:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00586c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715259520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.576496:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00586c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715259520:12345-0@lo:400:kworker.0 Request processed in 30us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201226.576501:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1480 00000100:00100000:2.0:1788201226.576510:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1481 00000100:00100000:2.0:1788201226.576515:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715259264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.576538:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715259264:12345-0@lo:400:kworker.0 Request processed in 23us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201226.576543:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1481 00000100:00100000:2.0:1788201226.576551:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1482 00000100:00100000:2.0:1788201226.576556:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715259392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.576576:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715259392:12345-0@lo:400:kworker.0 Request processed in 20us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201226.576581:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1482 00000100:00100000:2.0:1788201226.576606:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715260032 00000100:00100000:2.0:1788201226.576609:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715260032 00000100:00100000:2.0:1788201226.576630:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715260544 00000100:00100000:2.0:1788201226.576633:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715260544 00000100:00100000:2.0:1788201226.576654:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715259904 00000100:00100000:2.0:1788201226.576656:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715259904 00000100:00100000:2.0:1788201226.576669:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715260416 00000100:00100000:2.0:1788201226.576671:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715260416 00000100:00100000:2.0:1788201226.576686:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2881 00000100:00100000:2.0:1788201226.576691:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140e9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715260032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.576715:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140e9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715260032:12345-0@lo:400:kworker.0 Request processed in 25us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201226.576720:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2881 00000100:00100000:2.0:1788201226.576888:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2882 00000100:00100000:2.0:1788201226.576901:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00586c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715260544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.576928:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00586c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715260544:12345-0@lo:400:kworker.0 Request processed in 29us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201226.576933:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2882 00000100:00100000:2.0:1788201226.576943:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2883 00000100:00100000:2.0:1788201226.576948:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715259904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.576970:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715259904:12345-0@lo:400:kworker.0 Request processed in 22us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201226.576975:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2883 00000100:00100000:2.0:1788201226.576985:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2884 00000100:00100000:2.0:1788201226.576991:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715260416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.577011:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715260416:12345-0@lo:400:kworker.0 Request processed in 21us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201226.577038:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2884 00000100:00100000:2.0:1788201226.577058:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715259776 00000100:00100000:2.0:1788201226.577061:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715259776 00000100:00100000:2.0:1788201226.577093:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715260288 00000100:00100000:2.0:1788201226.577095:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715260288 00000100:00100000:2.0:1788201226.577112:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4082 00000100:00100000:2.0:1788201226.577118:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715259776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.577150:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715259776:12345-0@lo:400:kworker.0 Request processed in 32us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201226.577155:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4082 00000100:00100000:2.0:1788201226.577165:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4083 00000100:00100000:2.0:1788201226.577170:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715260288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.577193:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715260288:12345-0@lo:400:kworker.0 Request processed in 23us (1303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201226.577203:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4083 00000100:00080000:2.0:1788201226.577227:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201226.577231:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201226.577233:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201226.577235:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201226.577265:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715259392:0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.577276:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715259904:0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.577285:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715260416:0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.577293:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715259264:0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.577302:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715259776:0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.577311:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13336bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715260288:0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.577346:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715259520:0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.577355:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715260032:0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.577364:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715260544:0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.577371:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715259136:0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.577380:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715259648:0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.577388:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715260160:0@lo:400:kworker.0 00000100:00100000:2.0:1788201226.577397:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715260672:0@lo:400:kworker.0 00000100:00100000:1.0:1788201226.580927:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201226.580951:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715260800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201226.581583:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201226.581788:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715260800 00000100:00100000:2.0:1788201226.581797:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715260800 00000100:00100000:2.0:1788201226.581867:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4084 00000100:00100000:2.0:1788201226.581876:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715260800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201226.581910:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:2.0:1788201226.581973:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715260800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201226.581980:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4084 00000100:00100000:1.0:1788201226.582267:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715260800:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788201227.023445:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201227.087235:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201227.087330:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201227.087350:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715261056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201227.087434:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201227.089365:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715261056 00000100:00100000:1.0:1788201227.089376:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715261056 00000100:00100000:1.0:1788201227.089434:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2342 00000100:00100000:1.0:1788201227.089445:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715261056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201227.089475:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201227.089551:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715261056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (2117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201227.089558:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2342 00000100:00100000:1.0:1788201227.089612:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715261056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201227.091083:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715260928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201227.091143:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201227.091226:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715260928 00000100:00100000:0.0:1788201227.091231:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715260928 00000100:00100000:3.0:1788201227.091351:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201227.091361:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715261184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201227.091392:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201227.091427:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715261184 00000100:00100000:3.0:1788201227.091431:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715261184 00000100:00100000:3.0:1788201227.091469:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4085 00000100:00100000:3.0:1788201227.091478:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715261184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201227.091510:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444913152 avail 1298673664 00000100:00100000:3.0:1788201227.091552:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715261184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201227.091559:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4085 00000100:00100000:3.0:1788201227.091600:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715261184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201227.091962:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2343 00000100:00100000:0.0:1788201227.091971:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715260928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201227.091989:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1788201227.092051:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715260928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201227.092058:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2343 00000100:00100000:0.0:1788201227.092102:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715260928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201227.220926:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201227.221115:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695432576 00000100:00100000:2.0:1788201227.221126:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695432576 00000100:00100000:2.0:1788201227.221227:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 84 00000100:00100000:2.0:1788201227.221238:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695432576:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201227.221327:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695432576:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 90us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201227.221334:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 84 00000100:00100000:1.0:1788201227.222800:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201227.222898:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695432704 00000100:00100000:3.0:1788201227.222907:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695432704 00000100:00100000:3.0:1788201227.222983:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1483 00000100:00100000:3.0:1788201227.222995:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2401:x1875060695432704:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201227.223094:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2401:x1875060695432704:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 101us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201227.223101:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1483 00000100:00080000:1.0:1788201227.223120:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201227.228418:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201227.228470:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201227.228511:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201227.228564:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695432960 00000100:00100000:1.0:1788201227.228575:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695432960 00000100:00100000:1.0:1788201227.228639:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695433088 00000100:00100000:1.0:1788201227.228642:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695433088 00000100:00100000:1.0:1788201227.228661:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2885 00000100:00100000:1.0:1788201227.228673:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695432960:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201227.228761:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695432960:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 90us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201227.228768:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2885 00000100:00100000:1.0:1788201227.228786:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2886 00000100:00100000:1.0:1788201227.228792:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2400:x1875060695433088:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201227.228814:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2400:x1875060695433088:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 24us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201227.228820:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2886 00000100:00080000:3.0:1788201227.229084:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201227.229088:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201227.229141:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695432832 00000100:00100000:0.0:1788201227.229147:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695432832 00000100:00100000:0.0:1788201227.229201:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1484 00000100:00100000:0.0:1788201227.229208:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2400:x1875060695432832:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201227.229244:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2400:x1875060695432832:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 37us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201227.229251:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1484 00000100:00080000:3.0:1788201227.229393:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788201228.051679:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201228.575585:0:95379:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffddffc8a10 20000000:00000080:1.0:1788201228.575604:0:95379:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff8dc125a33000 uarg=0000000000000000 00000040:00100000:1.0:1788201228.576789:0:95379:0:(llog.c:1072:llog_reverse_process()) index 57 : idx 49 20000000:01000000:1.0:1788201228.576799:0:95379:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 56 cmd:0xce021 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:1.0:1788201228.576817:0:95379:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:3.0:1788201228.578758:0:95380:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 55 marker 45 1->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:3.0:1788201228.578844:0:95380:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 57 marker 45 2->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:3.0:1788201228.578855:0:95380:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000040:00080000:1.0:1788201228.580351:0:95379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].58, 224 off18320 20000000:01000000:1.0:1788201228.580373:0:95379:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1788201228.580390:0:95379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].59, 136 off18456 00000040:00080000:1.0:1788201228.580405:0:95379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].60, 224 off18680 20000000:01000000:1.0:1788201228.580418:0:95379:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:3.0:1788201228.580908:0:95381:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 50 marker 46 1->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:3.0:1788201228.580946:0:95381:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 46 2->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:3.0:1788201228.580959:0:95381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000040:00080000:1.0:1788201228.581340:0:95379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].53, 224 off17424 20000000:01000000:1.0:1788201228.581353:0:95379:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1788201228.581370:0:95379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].54, 144 off17568 00000040:00080000:1.0:1788201228.581387:0:95379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].55, 224 off17792 20000000:01000000:1.0:1788201228.581400:0:95379:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:3.0:1788201228.583738:0:95382:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 50 marker 47 1->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:3.0:1788201228.583927:0:95382:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 47 2->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1788201228.586737:0:95382:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000040:00080000:1.0:1788201228.590381:0:95379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].53, 224 off17424 20000000:01000000:1.0:1788201228.590469:0:95379:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1788201228.590489:0:95379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].54, 144 off17568 00000040:00080000:1.0:1788201228.590505:0:95379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].55, 224 off17792 10000000:01000000:1.0:1788201228.590518:0:95379:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788201228.590539:0:95379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1c9a3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.590558:0:95379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc00782c200/0x96d0c9b8c9a1c4da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786913 expref: 9 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.590567:0:95379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1c4e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786921 expref: 9 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.590575:0:95379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc0078fd200/0x96d0c9b8c9a1c512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c50b expref: 23 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.590596:0:95379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc007adf800/0x96d0c9b8c9a1c5e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c5dd expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.590602:0:95379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc125ae2200/0x96d0c9b8c9a1c615 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c60e expref: 23 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.590609:0:95379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc0078fd800/0x96d0c9b8c9a1c631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c62a expref: 23 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.590616:0:95379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1c65b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c654 expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.590623:0:95379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc125ae3200/0x96d0c9b8c9a1c669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c662 expref: 23 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.590630:0:95379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1c685 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c67e expref: 23 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.590637:0:95379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc125ae2e00/0x96d0c9b8c9a1c693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c68c expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.590643:0:95379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc0078fce00/0x96d0c9b8c9a1c6bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c6b6 expref: 23 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.590650:0:95379:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1c9a3 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.590686:0:95379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc0078fce00/0x96d0c9b8c9a1c6bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c6b6 expref: 23 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.590710:0:95379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc0078fce00/0x96d0c9b8c9a1c6bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c6b6 expref: 23 pid: 94463 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201228.590727:0:95379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95379:1875060715261312:0@lo:104: 00000100:00100000:1.0:1788201228.591680:0:95379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201228.591795:0:95379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc125ae2e00/0x96d0c9b8c9a1c693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c68c expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.591864:0:95379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc125ae2e00/0x96d0c9b8c9a1c693 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c68c expref: 23 pid: 94461 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201228.591875:0:95379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95379:1875060715261440:0@lo:104: 00010000:00010000:1.0:1788201228.591910:0:95379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1c685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c67e expref: 23 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.591918:0:95379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1c685 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c67e expref: 23 pid: 94463 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201228.591927:0:95379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95379:1875060715261568:0@lo:104: 00010000:00010000:1.0:1788201228.591955:0:95379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc125ae3200/0x96d0c9b8c9a1c669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c662 expref: 23 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.591963:0:95379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc125ae3200/0x96d0c9b8c9a1c669 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c662 expref: 23 pid: 94467 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201228.591971:0:95379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95379:1875060715261696:0@lo:104: 00010000:00010000:1.0:1788201228.591995:0:95379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1c65b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c654 expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.592129:0:95379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1c65b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c654 expref: 23 pid: 94461 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201228.592139:0:95379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95379:1875060715261824:0@lo:104: 00010000:00010000:1.0:1788201228.592175:0:95379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc0078fd800/0x96d0c9b8c9a1c631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c62a expref: 23 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.592183:0:95379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc0078fd800/0x96d0c9b8c9a1c631 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c62a expref: 23 pid: 94464 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201228.592191:0:95379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a442d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95379:1875060715261952:0@lo:104: 00010000:00010000:1.0:1788201228.592216:0:95379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc125ae2200/0x96d0c9b8c9a1c615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c60e expref: 23 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.592223:0:95379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc125ae2200/0x96d0c9b8c9a1c615 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c60e expref: 23 pid: 94467 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201228.592232:0:95379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133332300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95379:1875060715262080:0@lo:104: 00010000:00010000:1.0:1788201228.592445:0:95379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc007adf800/0x96d0c9b8c9a1c5e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c5dd expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.592453:0:95379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc007adf800/0x96d0c9b8c9a1c5e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c5dd expref: 23 pid: 94461 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201228.592461:0:95379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00388e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95379:1875060715262208:0@lo:104: 00010000:00010000:1.0:1788201228.592485:0:95379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc0078fd200/0x96d0c9b8c9a1c512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c50b expref: 23 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.592503:0:95379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc0078fd200/0x96d0c9b8c9a1c512 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c50b expref: 23 pid: 94464 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201228.592511:0:95379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00388c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95379:1875060715262336:0@lo:104: 00010000:00010000:1.0:1788201228.592537:0:95379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1c4e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786921 expref: 9 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.592545:0:95379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1c4e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786921 expref: 9 pid: 94463 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201228.592554:0:95379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00388ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95379:1875060715262464:192.168.201.20@tcp:104: 00010000:00010000:1.0:1788201228.592616:0:95379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc00782c200/0x96d0c9b8c9a1c4da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786913 expref: 9 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.592624:0:95379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc00782c200/0x96d0c9b8c9a1c4da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786913 expref: 9 pid: 94464 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201228.592632:0:95379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133f4c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95379:1875060715262592:192.168.201.20@tcp:104: 00000100:00100000:1.0:1788201228.592653:0:95379:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140c1a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201228.595294:0:95379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133f4c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95379:1875060715262592:192.168.201.20@tcp:104: 00000100:00100000:3.0:1788201228.597532:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201228.597744:0:95379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00388ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95379:1875060715262464:192.168.201.20@tcp:104: 00000100:00100000:0.0:1788201228.597810:0:9535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695433216 00000100:00100000:0.0:1788201228.597818:0:9535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695433216 00010000:00010000:0.0:1788201228.597859:0:9535:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc00782c200/0x96d0c9b8c9a1c4da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786913 expref: 10 pid: 94464 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201228.597903:0:9535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2590 00000100:00100000:0.0:1788201228.597912:0:9535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10a227850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695433216:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201228.597936:0:9535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201228.597943:0:9535:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc00782c200/0x96d0c9b8c9a1c4da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786913 expref: 10 pid: 94464 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.597953:0:9535:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc00782c200/0x96d0c9b8c9a1c4da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786913 expref: 10 pid: 94464 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.597972:0:9535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782c200/0x96d0c9b8c9a1c4da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786913 expref: 10 pid: 94464 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.597989:0:9535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201228.598071:0:9535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10a227850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:2400:x1875060695433216:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 159us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201228.598078:0:9535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2590 00000100:00100000:2.0:1788201228.599131:0:19665:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788201228.599166:0:19665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201228.599213:0:19665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201228.599236:0:19665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201228.599385:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715261312 00000100:00100000:0.0:1788201228.599393:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715261312 00000100:00100000:0.0:1788201228.599425:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715261440 00000100:00100000:0.0:1788201228.599428:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715261440 00000100:00100000:0.0:1788201228.599438:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715261568 00000100:00100000:0.0:1788201228.599440:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715261568 00000100:00100000:0.0:1788201228.599467:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715261696 00000100:00100000:0.0:1788201228.599470:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715261696 00000100:00100000:0.0:1788201228.599481:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788201228.599488:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a942850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+6:95379:x1875060715261312:12345-0@lo:104: 00010000:00010000:0.0:1788201228.599502:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc00782c000/0x96d0c9b8c9a1c6b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c6bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201228.599552:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1788201228.599562:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13336bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9b18af6-fecc-4172-82c2-66531890fe11+6:95379:x1875060715261440:12345-0@lo:104: 00010000:00010000:3.0:1788201228.599571:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c68c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c693 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201228.602144:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201228.602334:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695433344 00000100:00100000:1.0:1788201228.602355:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695433344 00010000:00010000:1.0:1788201228.602407:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1c4e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786921 expref: 9 pid: 94463 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201228.602443:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2591 00000100:00100000:1.0:1788201228.602466:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:2401:x1875060695433344:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201228.602482:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201228.602488:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1c4e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786921 expref: 9 pid: 94463 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.602500:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1c4e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786921 expref: 9 pid: 94463 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.602518:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1c4e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786921 expref: 9 pid: 94463 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.602534:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201228.602582:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:2401:x1875060695433344:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 118us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201228.602589:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2591 00000100:00100000:2.0:1788201228.602931:0:19665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201228.602950:0:19665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201228.602961:0:19665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201228.602973:0:19665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201228.602984:0:19665:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:2.0:1788201228.602992:0:19665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00000100:00100000:1.0:1788201228.605517:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715261824 00000100:00100000:1.0:1788201228.605532:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715261824 00000100:00100000:1.0:1788201228.605594:0:19665:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/3 left), rc = 0 00000100:00100000:1.0:1788201228.605635:0:19665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201228.605658:0:19665:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:1.0:1788201228.605664:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715261952 00000100:00100000:1.0:1788201228.605667:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715261952 00000100:00100000:1.0:1788201228.605680:0:19665:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:1.0:1788201228.605683:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715262080 00000100:00100000:1.0:1788201228.605685:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715262080 00000100:00100000:1.0:1788201228.605693:0:19665:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:1.0:1788201228.605696:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715262208 00000100:00100000:1.0:1788201228.605698:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715262208 00000100:00100000:1.0:1788201228.605706:0:19665:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:1.0:1788201228.605710:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715262336 00000100:00100000:1.0:1788201228.605711:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715262336 00010000:00010000:0.0:1788201228.606113:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201228.606123:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a942850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+11:95379:x1875060715261312:12345-0@lo:104: Request processed in 6633us (14446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201228.606133:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788201228.606213:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788201228.606224:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133369880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+10:95379:x1875060715261568:12345-0@lo:104: 00010000:00010000:0.0:1788201228.606244:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2600/0x96d0c9b8c9a1c67e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c685 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.606502:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788201228.606510:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133369880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+10:95379:x1875060715261568:12345-0@lo:104: Request processed in 288us (7305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201228.606516:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788201228.606533:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788201228.606540:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+9:95379:x1875060715261696:12345-0@lo:104: 00010000:00010000:0.0:1788201228.606549:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc00782c800/0x96d0c9b8c9a1c662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c669 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.606589:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788201228.606594:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+9:95379:x1875060715261696:12345-0@lo:104: Request processed in 55us (7358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201228.606610:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788201228.606624:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788201228.606630:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+8:95379:x1875060715261824:12345-0@lo:104: 00010000:00010000:0.0:1788201228.606638:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1c654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c65b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.606672:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788201228.606676:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+8:95379:x1875060715261824:12345-0@lo:104: Request processed in 48us (3748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201228.606681:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788201228.606695:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788201228.606700:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+7:95379:x1875060715261952:12345-0@lo:104: 00010000:00010000:0.0:1788201228.606708:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc007adf600/0x96d0c9b8c9a1c62a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c631 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.606733:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788201228.606738:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+7:95379:x1875060715261952:12345-0@lo:104: Request processed in 38us (3787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201228.606743:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788201228.606755:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788201228.606760:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+6:95379:x1875060715262080:12345-0@lo:104: 00010000:00010000:0.0:1788201228.606767:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc00782d600/0x96d0c9b8c9a1c60e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c615 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.606791:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788201228.606795:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+6:95379:x1875060715262080:12345-0@lo:104: Request processed in 35us (3833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201228.606807:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788201228.606820:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788201228.606825:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120064450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+5:95379:x1875060715262208:12345-0@lo:104: 00010000:00010000:0.0:1788201228.606833:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c5dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c5e4 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.606860:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788201228.606864:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120064450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+5:95379:x1875060715262208:12345-0@lo:104: Request processed in 40us (3891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201228.606870:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788201228.606882:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788201228.606888:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118143b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+4:95379:x1875060715262336:12345-0@lo:104: 00010000:00010000:0.0:1788201228.606896:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc007ade800/0x96d0c9b8c9a1c50b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c512 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.606933:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:0.0:1788201228.606938:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118143b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+4:95379:x1875060715262336:12345-0@lo:104: Request processed in 51us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201228.606944:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00010000:00010000:0.0:1788201228.606964:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788201228.606970:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc00782c000/0x96d0c9b8c9a1c6b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c6bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.606977:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c000 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201228.606981:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782c000/0x96d0c9b8c9a1c6b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1c6bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.606999:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc00782c000/0x96d0c9b8c9a1c6b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c6bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201228.607006:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782c000/0x96d0c9b8c9a1c6b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c6bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201228.607011:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201228.607079:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc00782c000/0x96d0c9b8c9a1c6b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c6bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.607086:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201228.607106:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc00782c000/0x96d0c9b8c9a1c6b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c6bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.607112:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc00782c000/0x96d0c9b8c9a1c6b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c6bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201228.607123:0:95379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95379:1875060715261312:0@lo:104: 00010000:00010000:0.0:1788201228.607125:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788201228.607128:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2600/0x96d0c9b8c9a1c67e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c685 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.607133:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2600 already unused, calling callback (ffffffffc1280c20) 00000100:00100000:1.0:1788201228.607133:0:95379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95379:1875060715261568:0@lo:104: 10000000:00010000:0.0:1788201228.607136:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2600/0x96d0c9b8c9a1c67e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1c685 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201228.607140:0:95379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95379:1875060715261696:0@lo:104: 00010000:00010000:0.0:1788201228.607144:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2600/0x96d0c9b8c9a1c67e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c685 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201228.607147:0:95379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95379:1875060715261824:0@lo:104: 10000000:00010000:0.0:1788201228.607151:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2600/0x96d0c9b8c9a1c67e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c685 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201228.607154:0:95379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a442d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95379:1875060715261952:0@lo:104: 00000100:00100000:1.0:1788201228.607161:0:95379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133332300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95379:1875060715262080:0@lo:104: 10000000:01000000:0.0:1788201228.607162:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788201228.607167:0:95379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00388e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95379:1875060715262208:0@lo:104: 00000100:00100000:1.0:1788201228.607173:0:95379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00388c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95379:1875060715262336:0@lo:104: 00010000:00010000:0.0:1788201228.607176:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2600/0x96d0c9b8c9a1c67e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c685 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.607181:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201228.607186:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2600/0x96d0c9b8c9a1c67e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c685 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.607193:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2600/0x96d0c9b8c9a1c67e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c685 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.607202:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788201228.607204:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc00782c800/0x96d0c9b8c9a1c662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c669 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.607210:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c800 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201228.607213:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782c800/0x96d0c9b8c9a1c662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1c669 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.607220:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc00782c800/0x96d0c9b8c9a1c662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c669 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201228.607225:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782c800/0x96d0c9b8c9a1c662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c669 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201228.607231:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201228.607243:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc00782c800/0x96d0c9b8c9a1c662 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c669 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.607249:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201228.607284:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc00782c800/0x96d0c9b8c9a1c662 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c669 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.607291:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc00782c800/0x96d0c9b8c9a1c662 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c669 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201228.607486:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715262976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201228.607527:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201228.607572:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715262976 00000100:00100000:1.0:1788201228.607577:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715262976 00010000:00010000:1.0:1788201228.607601:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc125ae3200/0x96d0c9b8c9a1c669 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c662 expref: 24 pid: 94467 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201228.607624:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2592 00000100:00100000:1.0:1788201228.607630:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715262976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201228.607640:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201228.607645:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc125ae3200/0x96d0c9b8c9a1c669 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c662 expref: 24 pid: 94467 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.607655:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc125ae3200/0x96d0c9b8c9a1c669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c662 expref: 24 pid: 94467 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.607666:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae3200/0x96d0c9b8c9a1c669 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c662 expref: 24 pid: 94467 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.607685:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201228.607723:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+23:3657:x1875060715262976:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201228.607730:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2592 00010000:00010000:0.0:1788201228.607771:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788201228.607775:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1c654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c65b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.607780:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd000 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201228.607783:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1c654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1c65b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.607790:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1c654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c65b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201228.607796:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1c654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c65b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201228.607801:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201228.607817:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1c654 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c65b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.607823:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201228.607830:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1c654 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c65b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.607835:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1c654 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c65b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.607842:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788201228.607851:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc007adf600/0x96d0c9b8c9a1c62a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c631 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.607857:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf600 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201228.607860:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc007adf600/0x96d0c9b8c9a1c62a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1c631 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.607867:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007adf600/0x96d0c9b8c9a1c62a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c631 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201228.607873:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007adf600/0x96d0c9b8c9a1c62a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c631 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201228.607878:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201228.607894:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc007adf600/0x96d0c9b8c9a1c62a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c631 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.607899:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201228.607903:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715262976:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201228.607904:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc007adf600/0x96d0c9b8c9a1c62a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c631 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.607911:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007adf600/0x96d0c9b8c9a1c62a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c631 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201228.607926:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201228.607932:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715263104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201228.607957:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201228.607986:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201228.607990:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc00782d600/0x96d0c9b8c9a1c60e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c615 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.607996:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d600 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201228.607999:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782d600/0x96d0c9b8c9a1c60e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1c615 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.608053:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc00782d600/0x96d0c9b8c9a1c60e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c615 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201228.608060:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782d600/0x96d0c9b8c9a1c60e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c615 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201228.608064:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201228.608080:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc00782d600/0x96d0c9b8c9a1c60e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c615 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.608085:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201228.608091:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc00782d600/0x96d0c9b8c9a1c60e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c615 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.608096:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc00782d600/0x96d0c9b8c9a1c60e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c615 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.608106:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201228.608108:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c5dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c5e4 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.608114:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfa00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201228.608116:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c5dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1c5e4 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.608123:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c5dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c5e4 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201228.608129:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c5dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c5e4 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201228.608143:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201228.608158:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c5dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c5e4 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.608163:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201228.608183:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c5dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c5e4 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.608190:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007adfa00/0x96d0c9b8c9a1c5dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c5e4 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.608199:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201228.608202:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc007ade800/0x96d0c9b8c9a1c50b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c512 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.608207:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade800 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201228.608210:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc007ade800/0x96d0c9b8c9a1c50b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1c512 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.608215:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007ade800/0x96d0c9b8c9a1c50b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c512 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201228.608220:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007ade800/0x96d0c9b8c9a1c50b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c512 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201228.608225:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201228.608236:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc007ade800/0x96d0c9b8c9a1c50b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c512 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.608240:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201228.608253:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc007ade800/0x96d0c9b8c9a1c50b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c512 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.608259:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007ade800/0x96d0c9b8c9a1c50b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c512 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.608267:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201228.608268:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201228.608270:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201228.608277:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201228.608293:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715262720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201228.608365:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715263488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201228.608403:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201228.608416:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715263616:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201228.608998:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201228.609004:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201228.609048:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715262848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201228.612204:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201228.612266:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715263104 00000100:00100000:1.0:1788201228.612277:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715263104 00010000:00010000:1.0:1788201228.612325:0:26207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1c65b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c654 expref: 23 pid: 94461 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201228.612683:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715263488 00000100:00100000:1.0:1788201228.612688:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715263488 00010000:00010000:1.0:1788201228.612703:0:26207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc007adf800/0x96d0c9b8c9a1c5e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c5dd expref: 24 pid: 94461 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201228.612723:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593 00000100:00100000:1.0:1788201228.612732:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715263104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201228.612745:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201228.612751:0:26207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1c65b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c654 expref: 24 pid: 94461 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.612763:0:26207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1c65b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c654 expref: 24 pid: 94461 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.612793:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1c65b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c654 expref: 24 pid: 94461 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.612912:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201228.612987:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+23:3657:x1875060715263104:12345-0@lo:103:ldlm_bl.0 Request processed in 254us (5027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201228.613011:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593 00000100:00100000:1.0:1788201228.613063:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594 00000100:00100000:1.0:1788201228.613070:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+22:3657:x1875060715263488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201228.613078:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201228.613082:0:26207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc007adf800/0x96d0c9b8c9a1c5e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c5dd expref: 22 pid: 94461 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.613091:0:26207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc007adf800/0x96d0c9b8c9a1c5e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c5dd expref: 22 pid: 94461 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.613101:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007adf800/0x96d0c9b8c9a1c5e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c5dd expref: 22 pid: 94461 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.613110:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201228.613133:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+21:3657:x1875060715263488:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (4741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201228.613138:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594 00000100:00100000:1.0:1788201228.613185:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715263488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201228.613194:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715263104:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201228.621167:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201228.621185:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13336bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9b18af6-fecc-4172-82c2-66531890fe11+3:95379:x1875060715261440:12345-0@lo:104: Request processed in 21621us (22014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201228.621191:0:95379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95379:1875060715261440:0@lo:104: 00000100:00100000:3.0:1788201228.621197:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00010000:00010000:1.0:1788201228.621248:0:95379:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1c9a3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.622579:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201228.622590:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c68c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c693 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.622599:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfc00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201228.622602:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c68c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1c693 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.622611:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c68c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c693 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201228.622618:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c68c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c693 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201228.622623:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788201228.622624:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715263360:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201228.622661:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c68c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c693 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201228.622677:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201228.622684:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201228.622697:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c68c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c693 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201228.622701:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1788201228.622704:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007adfc00/0x96d0c9b8c9a1c68c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c693 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201228.622706:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715263744:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201228.622719:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201228.622721:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201228.622723:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201228.622725:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201228.622740:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715262848 00000100:00100000:0.0:1788201228.622747:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715262848 00000100:00100000:2.0:1788201228.622749:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715263360 00000100:00100000:2.0:1788201228.622751:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715263360 00010000:00010000:0.0:1788201228.622773:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1c685 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c67e expref: 22 pid: 94463 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201228.622773:0:26207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc125ae2200/0x96d0c9b8c9a1c615 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c60e expref: 22 pid: 94467 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201228.622799:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715263744 00000100:00100000:0.0:1788201228.622802:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715263744 00010000:00010000:0.0:1788201228.622814:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc125ae2e00/0x96d0c9b8c9a1c693 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c68c expref: 23 pid: 94461 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201228.622834:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595 00000100:00100000:0.0:1788201228.622842:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133701180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+23:3656:x1875060715262848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201228.622854:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201228.622859:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1c685 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c67e expref: 23 pid: 94463 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.622869:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1c685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c67e expref: 23 pid: 94463 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201228.622882:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782c400/0x96d0c9b8c9a1c685 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c67e expref: 23 pid: 94463 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201228.622891:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596 00000100:00100000:1.0:1788201228.622898:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a480000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c9b18af6-fecc-4172-82c2-66531890fe11+22:3656:x1875060715263360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201228.622901:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201228.622904:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201228.622914:0:26213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc125ae2200/0x96d0c9b8c9a1c615 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c60e expref: 22 pid: 94467 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.622922:0:26213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc125ae2200/0x96d0c9b8c9a1c615 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c60e expref: 22 pid: 94467 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.622932:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae2200/0x96d0c9b8c9a1c615 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c60e expref: 22 pid: 94467 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.622940:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201228.622973:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a480000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c9b18af6-fecc-4172-82c2-66531890fe11+21:3656:x1875060715263360:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201228.622980:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596 00000100:00100000:1.0:1788201228.622995:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2597 00000100:00100000:1.0:1788201228.623001:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a480e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c9b18af6-fecc-4172-82c2-66531890fe11+20:3656:x1875060715263744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201228.623009:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201228.623013:0:26213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc125ae2e00/0x96d0c9b8c9a1c693 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c68c expref: 20 pid: 94461 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.623061:0:26213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc125ae2e00/0x96d0c9b8c9a1c693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c68c expref: 20 pid: 94461 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.623070:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae2e00/0x96d0c9b8c9a1c693 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c68c expref: 20 pid: 94461 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.623079:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201228.623099:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a480e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c9b18af6-fecc-4172-82c2-66531890fe11+19:3656:x1875060715263744:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201228.623105:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2597 00000100:00100000:1.0:1788201228.623123:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201228.623152:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715263232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201228.623172:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201228.623196:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201228.623218:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715262720 00000100:00100000:1.0:1788201228.623221:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715262720 00010000:00010000:1.0:1788201228.623234:0:26213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc0078fce00/0x96d0c9b8c9a1c6bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c6b6 expref: 19 pid: 94463 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201228.623245:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715263232 00000100:00100000:1.0:1788201228.623247:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715263232 00010000:00010000:1.0:1788201228.623256:0:26213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc0078fd800/0x96d0c9b8c9a1c631 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c62a expref: 20 pid: 94464 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201228.623265:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715263616 00000100:00100000:1.0:1788201228.623267:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715263616 00010000:00010000:1.0:1788201228.623275:0:26213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc0078fd200/0x96d0c9b8c9a1c512 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c50b expref: 21 pid: 94464 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201228.623285:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598 00000100:00100000:1.0:1788201228.623290:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118142d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c9b18af6-fecc-4172-82c2-66531890fe11+21:3655:x1875060715262720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201228.623296:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201228.623299:0:26213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc0078fce00/0x96d0c9b8c9a1c6bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c6b6 expref: 21 pid: 94463 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.623308:0:26213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc0078fce00/0x96d0c9b8c9a1c6bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c6b6 expref: 21 pid: 94463 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.623317:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fce00/0x96d0c9b8c9a1c6bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c6b6 expref: 21 pid: 94463 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.623325:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201228.623357:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118142d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c9b18af6-fecc-4172-82c2-66531890fe11+20:3655:x1875060715262720:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201228.623364:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598 00000100:00100000:1.0:1788201228.623378:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599 00000100:00100000:1.0:1788201228.623384:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c9b18af6-fecc-4172-82c2-66531890fe11+19:3655:x1875060715263232:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201228.623537:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00000100:00100000:2.0:1788201228.623545:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10a10d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+19:3658:x1875060715263616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201228.623553:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201228.623557:0:26207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc0078fd200/0x96d0c9b8c9a1c512 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c50b expref: 19 pid: 94464 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201228.623565:0:26207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc0078fd200/0x96d0c9b8c9a1c512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c50b expref: 19 pid: 94464 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201228.623575:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fd200/0x96d0c9b8c9a1c512 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c50b expref: 19 pid: 94464 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201228.623593:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201228.623632:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10a10d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+18:3658:x1875060715263616:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201228.623639:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00000100:00100000:2.0:1788201228.623672:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715263744:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201228.623765:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201228.623771:0:26213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc0078fd800/0x96d0c9b8c9a1c631 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c62a expref: 17 pid: 94464 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.623794:0:26213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc0078fd800/0x96d0c9b8c9a1c631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c62a expref: 17 pid: 94464 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.623811:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fd800/0x96d0c9b8c9a1c631 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c62a expref: 17 pid: 94464 timeout: 4180 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.623822:0:26213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1c9a3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.623830:0:26213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1c9a3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.623845:0:26213:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1c9a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.623853:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1c9a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.623859:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1c9a3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.623866:0:26213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1c9a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.623881:0:26213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fda00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201228.623886:0:26213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1c9a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.623893:0:26213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1c9a3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.623908:0:26213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1c9a3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.623919:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201228.629714:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715263360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201228.629714:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715263616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201228.632776:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133701180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+16:3656:x1875060715262848:12345-0@lo:103:ldlm_bl.0 Request processed in 9924us (20569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201228.632791:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595 00000100:00100000:2.0:1788201228.632936:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715262848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201228.632979:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c9b18af6-fecc-4172-82c2-66531890fe11+16:3655:x1875060715263232:12345-0@lo:103:ldlm_bl.0 Request processed in 9393us (9603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201228.632990:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599 00000100:00100000:1.0:1788201228.633137:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715262720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201228.633146:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715263232:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201228.633180:0:95379:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1c9a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.633191:0:95379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1c9a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201228.633198:0:95379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fda00/0x96d0c9b8c9a1c9a3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201229.071237:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201229.648223:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715263872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201229.649187:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201229.652411:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201229.652454:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715264000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201229.652525:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201229.665585:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715263872 00000100:00100000:0.0:1788201229.665602:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715263872 00000100:00100000:0.0:1788201229.665699:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715264000 00000100:00100000:0.0:1788201229.665703:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715264000 00000100:00100000:0.0:1788201229.665722:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2344 00000100:00100000:0.0:1788201229.665735:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715263872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201229.665769:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1788201229.665891:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2345 00000100:00100000:2.0:1788201229.665903:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ac47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715264000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201229.665922:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201229.666002:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ac47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715264000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (13476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201229.666009:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2345 00000100:00080000:3.0:1788201229.666120:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201229.666131:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201229.666178:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715264000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201229.666421:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715263872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 690us (18124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201229.666429:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2344 00000100:00100000:2.0:1788201229.677627:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715263872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201229.977310:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201229.981233:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695433472 00000100:00100000:2.0:1788201229.981251:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695433472 00000100:00100000:2.0:1788201229.981339:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00100000:2.0:1788201229.981350:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71021:x1875060695433472:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201229.981792:0:94467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201229.981824:0:94467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc100031e00/0x96d0c9b8c9a1c9aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786975 expref: -99 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201229.981876:0:94467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc100031e00/0x96d0c9b8c9a1c9aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786975 expref: 9 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201229.981887:0:94467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc100031e00/0x96d0c9b8c9a1c9aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786975 expref: 9 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201229.981898:0:94467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc100031e00, rc 0) 00000100:00100000:2.0:1788201229.981972:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695433472:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 623us (4672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201229.981979:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00100000:2.0:1788201229.986165:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201229.986269:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695433600 00000100:00100000:0.0:1788201229.986280:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695433600 00000100:00100000:0.0:1788201229.986345:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00100000:0.0:1788201229.986356:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695433600:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201229.986610:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695433600:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 255us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201229.986619:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00100000:1.0:1788201229.988862:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201229.989174:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695433728 00000100:00100000:0.0:1788201229.989184:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695433728 00000100:00100000:0.0:1788201229.989246:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 87 00000100:00100000:0.0:1788201229.989256:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695433728:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201229.989471:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695433728:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 216us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201229.989479:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 87 00000100:00100000:3.0:1788201229.999754:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201230.000198:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695433856 00000100:00100000:0.0:1788201230.000210:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695433856 00000100:00100000:0.0:1788201230.000275:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 88 00000100:00100000:0.0:1788201230.000286:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:73397:x1875060695433856:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788201230.000465:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:73397:x1875060695433856:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 179us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201230.000473:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 88 00000100:00100000:3.0:1788201230.002286:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201230.002430:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695433984 00000100:00100000:0.0:1788201230.002439:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695433984 00000100:00100000:0.0:1788201230.002506:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 89 00000100:00100000:0.0:1788201230.002516:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:73397:x1875060695433984:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788201230.002831:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:73397:x1875060695433984:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 315us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201230.002839:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 89 00000100:00100000:1.0:1788201230.009491:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201230.009649:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695434112 00000100:00100000:0.0:1788201230.009661:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695434112 00000100:00100000:0.0:1788201230.009726:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 90 00000100:00100000:0.0:1788201230.009738:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695434112:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201230.009756:0:94464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201230.009774:0:94464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00896ba00/0x96d0c9b8c9a1c9b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78697c expref: -99 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201230.009828:0:94464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00896ba00/0x96d0c9b8c9a1c9b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78697c expref: 10 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201230.009840:0:94464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00896ba00/0x96d0c9b8c9a1c9b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78697c expref: 10 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201230.009850:0:94464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896ba00, rc 0) 00000100:00100000:0.0:1788201230.009912:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695434112:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 176us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201230.009920:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 90 00000100:00100000:3.0:1788201230.017393:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201230.017669:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695434240 00000100:00100000:2.0:1788201230.017682:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695434240 00000100:00100000:2.0:1788201230.017750:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 91 00000100:00100000:2.0:1788201230.017761:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695434240:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201230.017895:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695434240:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 136us (512us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201230.017903:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 91 00010000:00010000:3.0:1788201230.095289:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788201230.479163:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788201230.479171:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc11d438000 from 58 10000000:01000000:0.0:1788201230.479177:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201230.479231:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00896aa00/0x96d0c9b8c9a1c9b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201230.479244:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc00896aa00/0x96d0c9b8c9a1c9b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201230.479257:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc00896aa00/0x96d0c9b8c9a1c9b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201230.479285:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715264128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201230.479354:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201230.479543:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc109832c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201230.479909:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715264128 00000100:00100000:1.0:1788201230.479929:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715264128 00000100:00100000:1.0:1788201230.480143:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788201230.480153:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715264128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201230.480166:0:94464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201230.480180:0:94464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c9bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c9b8 expref: -99 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201230.480205:0:94464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c9bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c9b8 expref: 16 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201230.480216:0:94464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c9bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c9b8 expref: 16 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201230.480226:0:94464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fcc00, rc 0) 00000100:00100000:1.0:1788201230.480321:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715264128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201230.480329:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788201230.480508:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715264128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201230.480524:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc00896aa00/0x96d0c9b8c9a1c9b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c9bf expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201230.480540:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc00896aa00/0x96d0c9b8c9a1c9b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c9bf expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201230.480603:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715264256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201230.480633:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201230.480663:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc109832c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201230.480720:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715264256 00000100:00100000:2.0:1788201230.480724:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715264256 00000100:00100000:2.0:1788201230.480755:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788201230.480774:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12e6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715264256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201230.480900:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12e6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715264256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201230.480907:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788201230.481175:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715264256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201230.481205:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715264384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201230.481242:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201230.481270:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201230.481326:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715264384 00000100:00100000:0.0:1788201230.481330:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715264384 00000100:00100000:0.0:1788201230.481401:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788201230.481408:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12e6ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715264384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201230.481485:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12e6ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715264384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201230.481492:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788201230.481657:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715264384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201230.482636:0:95384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95384:1875060715264512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201230.482689:0:95384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201230.482726:0:95384:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125a96300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201230.483125:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715264512 00000100:00100000:0.0:1788201230.483131:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715264512 00000100:00100000:0.0:1788201230.483171:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788201230.483179:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134207c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+16:95384:x1875060715264512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201230.483276:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134207c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+16:95384:x1875060715264512:12345-0@lo:502:llog_process_th.0 Request processed in 97us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201230.483284:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788201230.483380:0:95384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95384:1875060715264512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201230.483430:0:95384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95384:1875060715264640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201230.483463:0:95384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201230.483489:0:95384:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125a96300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201230.483602:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715264640 00000100:00100000:0.0:1788201230.483608:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715264640 00000100:00100000:0.0:1788201230.483638:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788201230.483645:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134204850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+16:95384:x1875060715264640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201230.483706:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134204850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+16:95384:x1875060715264640:12345-0@lo:502:llog_process_th.0 Request processed in 61us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201230.483718:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788201230.484290:0:95384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95384:1875060715264640:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788201230.484316:0:95384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:0.0:1788201230.484619:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:0.0:1788201230.484640:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201230.484650:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00896aa00/0x96d0c9b8c9a1c9b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c9bf expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201230.484661:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc00896aa00/0x96d0c9b8c9a1c9b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c9bf expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201230.484670:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788201230.484673:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 53 10000000:01000000:0.0:1788201230.484676:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788201230.484701:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00896b000/0x96d0c9b8c9a1c9c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201230.484709:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc00896b000/0x96d0c9b8c9a1c9c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201230.484718:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc00896b000/0x96d0c9b8c9a1c9c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201230.484733:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715264768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201230.484891:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201230.484955:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10554fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201230.485148:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715264768 00000100:00100000:2.0:1788201230.485155:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715264768 00000100:00100000:2.0:1788201230.485194:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788201230.485202:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134207450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715264768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201230.485214:0:94461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201230.485226:0:94461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc100030000/0x96d0c9b8c9a1c9cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c9c6 expref: -99 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201230.485247:0:94461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc100030000/0x96d0c9b8c9a1c9cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c9c6 expref: 17 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201230.485256:0:94461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc100030000/0x96d0c9b8c9a1c9cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c9c6 expref: 17 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201230.485264:0:94461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc100030000, rc 0) 00000100:00100000:2.0:1788201230.485310:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134207450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715264768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201230.485325:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788201230.485406:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715264768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201230.485419:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc00896b000/0x96d0c9b8c9a1c9c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c9cd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201230.485427:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc00896b000/0x96d0c9b8c9a1c9c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c9cd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201230.485476:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715264896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201230.485502:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201230.485529:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201230.485630:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715264896 00000100:00100000:2.0:1788201230.485634:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715264896 00000100:00100000:2.0:1788201230.485662:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788201230.485668:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715264896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201230.485779:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715264896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201230.485786:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788201230.485954:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715264896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201230.485991:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715265024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201230.486071:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201230.486086:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201230.486098:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715265024 00000100:00100000:3.0:1788201230.486102:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715265024 00000100:00100000:3.0:1788201230.486125:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788201230.486131:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715265024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201230.486211:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715265024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201230.486218:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788201230.486259:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715265024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201230.486561:0:95385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95385:1875060715265152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201230.486597:0:95385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201230.486617:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715265152 00000100:00100000:3.0:1788201230.486621:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715265152 00000100:00100000:3.0:1788201230.486643:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788201230.486650:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134205850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+17:95385:x1875060715265152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201230.486725:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134205850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+17:95385:x1875060715265152:12345-0@lo:502:llog_process_th.0 Request processed in 75us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201230.486732:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788201230.487091:0:95385:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201230.487107:0:95385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95385:1875060715265152:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201230.487129:0:95385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201230.487140:0:95385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201230.487142:0:95385:0:(obd_config.c:1563:class_process_config()) marker 47 (0x1) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1788201230.487149:0:95385:0:(obd_config.c:1472:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1788201230.487172:0:95385:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000100:00100000:3.0:1788201230.487349:0:95385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95385:1875060715265280:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788201230.487561:0:95386:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc11d438000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788201230.487566:0:95386:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc11d438000 4 00000100:00100000:3.0:1788201230.487683:0:95385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201230.487797:0:95385:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201230.488093:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715265280 00000100:00100000:2.0:1788201230.488100:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715265280 00000100:00100000:2.0:1788201230.488178:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788201230.488186:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134206450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+17:95385:x1875060715265280:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201230.488291:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134206450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+17:95385:x1875060715265280:12345-0@lo:502:llog_process_th.0 Request processed in 106us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201230.488299:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788201230.488429:0:95385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95385:1875060715265280:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201230.488453:0:95385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201230.488458:0:95385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201230.488460:0:95385:0:(obd_config.c:1563:class_process_config()) marker 47 (0x2) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1788201230.488465:0:95385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000020:01000000:2.0:1788201230.488639:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 53-55 (rc=0) 10000000:01000000:2.0:1788201230.488659:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788201230.488668:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00896b000/0x96d0c9b8c9a1c9c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c9cd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201230.488679:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc00896b000/0x96d0c9b8c9a1c9c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c9cd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201230.488688:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788201230.488691:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc0053a4000 from 58 10000000:01000000:2.0:1788201230.488700:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788201230.488728:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1c9d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201230.488735:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1c9d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201230.488744:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1c9d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201230.488759:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715265408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201230.488913:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201230.488942:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125a960c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201230.488995:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715265408 00000100:00100000:0.0:1788201230.489000:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715265408 00000100:00100000:0.0:1788201230.489066:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788201230.489074:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134207850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715265408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201230.489084:0:94461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201230.489102:0:94461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00896ae00/0x96d0c9b8c9a1c9db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c9d4 expref: -99 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201230.489126:0:94461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00896ae00/0x96d0c9b8c9a1c9db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c9d4 expref: 18 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201230.489137:0:94461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00896ae00/0x96d0c9b8c9a1c9db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c9d4 expref: 18 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201230.489146:0:94461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896ae00, rc 0) 00000100:00100000:0.0:1788201230.489185:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134207850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715265408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201230.489191:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788201230.489396:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715265408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201230.489409:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1c9d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c9db expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201230.489418:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1c9d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c9db expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201230.489483:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715265536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201230.489510:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201230.489541:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140c1ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201230.489637:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715265536 00000100:00100000:2.0:1788201230.489641:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715265536 00000100:00100000:2.0:1788201230.489673:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788201230.489680:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134204c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715265536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201230.489785:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134204c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715265536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201230.489792:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788201230.489953:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715265536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201230.490113:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715265664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201230.490150:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201230.490175:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140c1ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201230.490188:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715265664 00000100:00100000:1.0:1788201230.490192:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715265664 00000100:00100000:1.0:1788201230.490214:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788201230.490221:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715265664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201230.490290:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715265664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201230.490297:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788201230.490335:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715265664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201230.491187:0:95387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d52d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95387:1875060715265792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201230.491233:0:95387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201230.491292:0:95387:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc00274dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201230.491323:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715265792 00000100:00100000:1.0:1788201230.491328:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715265792 00000100:00100000:1.0:1788201230.491395:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788201230.491404:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:95387:x1875060715265792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201230.491499:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:95387:x1875060715265792:12345-0@lo:502:llog_process_th.0 Request processed in 96us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201230.491506:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788201230.491577:0:95387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d52d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95387:1875060715265792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201230.491615:0:95387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95387:1875060715265920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201230.491648:0:95387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201230.491926:0:95387:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103d01a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201230.492168:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715265920 00000100:00100000:2.0:1788201230.492173:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715265920 00000100:00100000:2.0:1788201230.492258:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788201230.492266:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+18:95387:x1875060715265920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201230.492346:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+18:95387:x1875060715265920:12345-0@lo:502:llog_process_th.0 Request processed in 80us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201230.492359:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788201230.492467:0:95387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95387:1875060715265920:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788201230.492490:0:95387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:3.0:1788201230.492611:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:3.0:1788201230.492629:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201230.492638:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1c9d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c9db expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201230.492649:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1c9d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c9db expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201230.492657:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788201230.492660:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:3.0:1788201230.492663:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788201230.492687:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d58200/0x96d0c9b8c9a1c9e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201230.492695:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc140d58200/0x96d0c9b8c9a1c9e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201230.492705:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc140d58200/0x96d0c9b8c9a1c9e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201230.492724:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715266048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201230.492751:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201230.492883:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715266048 00000100:00100000:1.0:1788201230.492893:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715266048 00000100:00100000:1.0:1788201230.492914:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788201230.492920:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715266048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201230.492928:0:94461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201230.492939:0:94461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fc000/0x96d0c9b8c9a1c9e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c9e2 expref: -99 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201230.492958:0:94461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fc000/0x96d0c9b8c9a1c9e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c9e2 expref: 19 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201230.492979:0:94461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fc000/0x96d0c9b8c9a1c9e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c9e2 expref: 19 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201230.492988:0:94461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fc000, rc 0) 00000100:00100000:3.0:1788201230.493056:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10bee3240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201230.493360:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715266048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 439us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201230.493367:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788201230.493484:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715266048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201230.493497:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc140d58200/0x96d0c9b8c9a1c9e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c9e9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201230.493507:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc140d58200/0x96d0c9b8c9a1c9e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c9e9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201230.493556:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715266176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201230.493579:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201230.493640:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10bee3240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201230.493668:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715266176 00000100:00100000:0.0:1788201230.493672:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715266176 00000100:00100000:0.0:1788201230.493734:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788201230.493742:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715266176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201230.493963:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715266176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 222us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201230.494104:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715266176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201230.494132:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715266304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201230.494171:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201230.494210:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788201230.494332:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10bee3240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201230.494505:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715266304 00000100:00100000:0.0:1788201230.494511:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715266304 00000100:00100000:0.0:1788201230.494541:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788201230.494548:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715266304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201230.494693:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715266304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201230.494700:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788201230.494919:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715266304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201230.495552:0:95388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95388:1875060715266432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201230.495602:0:95388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201230.495663:0:95388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc00750d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201230.495737:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715266432 00000100:00100000:2.0:1788201230.495742:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715266432 00000100:00100000:1.0:1788201230.495902:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788201230.495913:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:95388:x1875060715266432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201230.496210:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:95388:x1875060715266432:12345-0@lo:502:llog_process_th.0 Request processed in 299us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201230.496218:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788201230.496357:0:95388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95388:1875060715266432:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201230.496455:0:95388:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201230.496466:0:95388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201230.496469:0:95388:0:(obd_config.c:1563:class_process_config()) marker 48 (0x1) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:0.0:1788201230.496476:0:95388:0:(obd_config.c:1472:class_process_config()) processing cmd: ce022 00020000:01000000:0.0:1788201230.496490:0:95388:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000100:00100000:0.0:1788201230.496509:0:95388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95388:1875060715266560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201230.496543:0:95388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201230.496601:0:95388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc00750d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201230.496637:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715266560 00000100:00100000:2.0:1788201230.496642:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715266560 00000100:00100000:2.0:1788201230.496698:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788201230.496706:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:95388:x1875060715266560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201230.496906:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:95388:x1875060715266560:12345-0@lo:502:llog_process_th.0 Request processed in 200us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201230.496913:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788201230.496985:0:95388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95388:1875060715266560:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201230.497038:0:95388:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201230.497043:0:95388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201230.497045:0:95388:0:(obd_config.c:1563:class_process_config()) marker 48 (0x2) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1788201230.497049:0:95388:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000020:01000000:3.0:1788201230.497195:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-55 (rc=0) 10000000:01000000:3.0:1788201230.497220:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788201230.497231:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d58200/0x96d0c9b8c9a1c9e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c9e9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201230.497242:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc140d58200/0x96d0c9b8c9a1c9e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c9e9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201230.497258:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788201230.497261:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc001db6000 from 58 10000000:01000000:3.0:1788201230.497263:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201230.497286:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1c9f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201230.497294:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1c9f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201230.497304:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1c9f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201230.497318:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715266688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201230.497349:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201230.497624:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103d01a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201230.497688:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715266688 00000100:00100000:1.0:1788201230.497694:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715266688 00000100:00100000:1.0:1788201230.497728:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788201230.497735:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715266688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201230.497745:0:94461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201230.497910:0:94461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fc400/0x96d0c9b8c9a1c9f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c9f0 expref: -99 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201230.497935:0:94461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fc400/0x96d0c9b8c9a1c9f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c9f0 expref: 20 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201230.497945:0:94461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fc400/0x96d0c9b8c9a1c9f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c9f0 expref: 20 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201230.497954:0:94461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fc400, rc 0) 00000100:00100000:1.0:1788201230.498066:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715266688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 331us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201230.498073:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788201230.498244:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715266688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201230.498258:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1c9f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c9f7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201230.498267:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1c9f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c9f7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201230.498320:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715266816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201230.498346:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201230.498369:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103d01a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201230.498468:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715266816 00000100:00100000:1.0:1788201230.498473:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715266816 00000100:00100000:1.0:1788201230.498504:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788201230.498512:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715266816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201230.498611:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715266816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201230.498617:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788201230.498730:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715266816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201230.498756:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715266944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201230.498925:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201230.498951:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103d01a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201230.499111:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715266944 00000100:00100000:1.0:1788201230.499115:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715266944 00000100:00100000:1.0:1788201230.499148:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788201230.499154:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715266944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201230.499231:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715266944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201230.499237:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788201230.499344:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715266944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201230.499741:0:95389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95389:1875060715267072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201230.499908:0:95389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201230.499937:0:95389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103d01a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201230.500115:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715267072 00000100:00100000:1.0:1788201230.500126:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715267072 00000100:00100000:1.0:1788201230.500181:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788201230.500189:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:95389:x1875060715267072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201230.500278:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:95389:x1875060715267072:12345-0@lo:502:llog_process_th.0 Request processed in 89us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201230.500285:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788201230.500349:0:95389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95389:1875060715267072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201230.500401:0:95389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95389:1875060715267200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201230.500428:0:95389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201230.500639:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715267200 00000100:00100000:0.0:1788201230.500643:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715267200 00000100:00100000:0.0:1788201230.500667:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788201230.500673:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+20:95389:x1875060715267200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201230.500736:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+20:95389:x1875060715267200:12345-0@lo:502:llog_process_th.0 Request processed in 62us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201230.500743:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788201230.500927:0:95389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10bee3240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201230.500941:0:95389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95389:1875060715267200:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788201230.500961:0:95389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:1.0:1788201230.501261:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:1.0:1788201230.501282:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201230.501290:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1c9f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c9f7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201230.501300:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1c9f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c9f7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201230.501308:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788201230.501311:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1788201230.501313:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788201230.501339:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd400/0x96d0c9b8c9a1c9fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201230.501347:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd400/0x96d0c9b8c9a1c9fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201230.501355:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd400/0x96d0c9b8c9a1c9fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201230.501368:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715267328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201230.501467:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201230.501488:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006c05c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201230.501548:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715267328 00000100:00100000:0.0:1788201230.501552:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715267328 00000100:00100000:0.0:1788201230.501583:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788201230.501590:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715267328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201230.501605:0:94467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201230.501618:0:94467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00896a800/0x96d0c9b8c9a1ca05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1c9fe expref: -99 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201230.501640:0:94467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00896a800/0x96d0c9b8c9a1ca05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c9fe expref: 21 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201230.501650:0:94467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00896a800/0x96d0c9b8c9a1ca05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c9fe expref: 21 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201230.501659:0:94467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896a800, rc 0) 00000100:00100000:0.0:1788201230.501696:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715267328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201230.501702:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788201230.501922:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715267328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201230.501934:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd400/0x96d0c9b8c9a1c9fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca05 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201230.501943:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd400/0x96d0c9b8c9a1c9fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ca05 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201230.501999:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715267456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201230.502207:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201230.502236:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103d01a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201230.502304:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715267456 00000100:00100000:1.0:1788201230.502309:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715267456 00000100:00100000:1.0:1788201230.502341:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788201230.502347:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003bfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715267456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201230.502529:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003bfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715267456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201230.502536:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788201230.502623:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715267456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201230.502648:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715267584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201230.502687:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201230.502708:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103d01a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201230.502748:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715267584 00000100:00100000:1.0:1788201230.502752:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715267584 00000100:00100000:1.0:1788201230.502893:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788201230.502901:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003bfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715267584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201230.503104:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003bfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715267584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 204us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201230.503111:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788201230.503299:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715267584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201230.504713:0:95390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1788201230.505175:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1788201230.505202:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788201230.505212:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd400/0x96d0c9b8c9a1c9fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca05 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201230.505222:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd400/0x96d0c9b8c9a1c9fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca05 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201230.505232:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788201230.505235:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc13aa9f000 from 58 10000000:01000000:0.0:1788201230.505238:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201230.505272:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00896ac00/0x96d0c9b8c9a1ca0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201230.505295:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc00896ac00/0x96d0c9b8c9a1ca0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201230.505306:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc00896ac00/0x96d0c9b8c9a1ca0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201230.505329:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715267712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201230.508499:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201230.508644:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc00750d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201230.515115:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715267712 00000100:00100000:2.0:1788201230.515131:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715267712 00000100:00100000:2.0:1788201230.515237:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788201230.515247:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715267712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201230.515264:0:94467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201230.515282:0:94467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc100030800/0x96d0c9b8c9a1ca13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ca0c expref: -99 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201230.515309:0:94467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc100030800/0x96d0c9b8c9a1ca13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca0c expref: 22 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201230.515320:0:94467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc100030800/0x96d0c9b8c9a1ca13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca0c expref: 22 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201230.515330:0:94467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc100030800, rc 0) 00000100:00100000:2.0:1788201230.516533:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715267712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1282us (11143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201230.516563:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788201230.516690:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715267712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201230.516713:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc00896ac00/0x96d0c9b8c9a1ca0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca13 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201230.516725:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc00896ac00/0x96d0c9b8c9a1ca0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ca13 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201230.518668:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715267840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201230.518734:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201230.523002:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc00750d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201230.523473:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715267840 00000100:00100000:1.0:1788201230.523483:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715267840 00000100:00100000:3.0:1788201230.527170:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788201230.527196:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715267840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201230.528250:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715267840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1063us (9512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201230.528262:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788201230.529948:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715267840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201230.530947:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715267968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201230.531191:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201230.531235:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006c059c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201230.531275:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715267968 00000100:00100000:3.0:1788201230.531283:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715267968 00000100:00100000:3.0:1788201230.531348:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788201230.531359:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715267968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201230.531495:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715267968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201230.531502:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788201230.531530:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715267968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201230.533158:0:95391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95391:1875060715268096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201230.533217:0:95391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201230.533247:0:95391:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10bee3240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201230.533325:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715268096 00000100:00100000:1.0:1788201230.533332:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715268096 00000100:00100000:1.0:1788201230.533371:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788201230.533379:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+22:95391:x1875060715268096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201230.533490:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+22:95391:x1875060715268096:12345-0@lo:502:llog_process_th.0 Request processed in 111us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201230.533502:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788201230.533580:0:95391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95391:1875060715268096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201230.533629:0:95391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95391:1875060715268224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201230.533659:0:95391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201230.533681:0:95391:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005c6c000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201230.533875:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715268224 00000100:00100000:1.0:1788201230.533880:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715268224 00000100:00100000:1.0:1788201230.533909:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788201230.533915:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:95391:x1875060715268224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201230.533997:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:95391:x1875060715268224:12345-0@lo:502:llog_process_th.0 Request processed in 82us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201230.534038:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788201230.534625:0:95391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95391:1875060715268224:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788201230.534649:0:95391:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:1.0:1788201230.534961:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:1.0:1788201230.534993:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201230.535013:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00896ac00/0x96d0c9b8c9a1ca0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca13 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201230.535045:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc00896ac00/0x96d0c9b8c9a1ca0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca13 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201230.535054:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788201230.535057:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1788201230.535059:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788201230.535088:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1ca1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201230.535096:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1ca1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201230.535105:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1ca1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201230.535120:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715268352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201230.535168:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201230.535199:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006c05240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201230.535305:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715268352 00000100:00100000:3.0:1788201230.535316:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715268352 00000100:00100000:3.0:1788201230.535354:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788201230.535361:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715268352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201230.535371:0:94467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201230.535397:0:94467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1ca21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ca1a expref: -99 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201230.535421:0:94467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1ca21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca1a expref: 23 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201230.535430:0:94467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1ca21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca1a expref: 23 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201230.535438:0:94467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59000, rc 0) 00000100:00100000:3.0:1788201230.535487:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715268352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201230.535492:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788201230.535938:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715268352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201230.535953:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1ca1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca21 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201230.536150:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1ca1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ca21 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201230.536212:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715268480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201230.536243:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201230.536264:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006c05240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201230.536316:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715268480 00000100:00100000:0.0:1788201230.536321:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715268480 00000100:00100000:0.0:1788201230.536356:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788201230.536364:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715268480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201230.536493:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715268480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201230.536500:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788201230.536713:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715268480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201230.536741:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715268608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201230.536900:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201230.536922:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006c05240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201230.536960:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715268608 00000100:00100000:3.0:1788201230.537100:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715268608 00000100:00100000:3.0:1788201230.537135:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788201230.537142:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715268608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201230.537227:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715268608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201230.537234:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788201230.537340:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715268608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201230.539367:0:95392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1788201230.539695:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1788201230.539716:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788201230.539727:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1ca1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca21 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201230.539738:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1ca1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca21 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201230.539747:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788201230.539750:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dc12563cd28 from 1 10000000:01000000:1.0:1788201230.539753:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788201230.539905:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1ca28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201230.539913:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1ca28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201230.539923:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1ca28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201230.539945:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715268736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201230.540272:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201230.540346:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140c45000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201230.540388:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715268736 00000100:00100000:0.0:1788201230.540457:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715268736 00000100:00100000:0.0:1788201230.540532:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788201230.540542:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715268736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201230.540555:0:94464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201230.540569:0:94464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00896a000/0x96d0c9b8c9a1ca2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ca28 expref: -99 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201230.540591:0:94464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00896a000/0x96d0c9b8c9a1ca2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca28 expref: 24 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201230.540612:0:94464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00896a000/0x96d0c9b8c9a1ca2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca28 expref: 24 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201230.540622:0:94464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896a000, rc 0) 00000100:00100000:0.0:1788201230.540724:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715268736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201230.540731:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788201230.541225:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715268736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201230.541240:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1ca28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca2f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201230.541250:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1ca28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ca2f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201230.541308:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715268864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201230.541339:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201230.541368:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140c45000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201230.541474:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715268864 00000100:00100000:3.0:1788201230.541480:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715268864 00000100:00100000:3.0:1788201230.541517:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788201230.541525:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715268864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201230.541680:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715268864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (340us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201230.541689:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788201230.541893:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715268864:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788201230.541916:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788201230.541923:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1ca28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca2f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201230.541931:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1ca28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca2f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201231.126803:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201231.695510:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201231.695535:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715268992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201231.695606:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201231.695662:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715268992 00000100:00100000:1.0:1788201231.695670:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715268992 00000100:00100000:1.0:1788201231.695722:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4086 00000100:00100000:1.0:1788201231.695730:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715268992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201231.695766:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:1.0:1788201231.695813:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715268992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201231.695820:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4086 00000100:00100000:1.0:1788201231.695867:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715268992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201231.698741:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715269248:0@lo:400:kworker.0 00000100:00100000:1.0:1788201231.698824:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201231.698854:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715269760:0@lo:400:kworker.0 00000100:00100000:1.0:1788201231.698879:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201231.698898:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715270272:0@lo:400:kworker.0 00000100:00100000:1.0:1788201231.698921:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201231.698946:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788201231.698952:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715269120:0@lo:400:kworker.0 00000100:00100000:1.0:1788201231.698978:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201231.699044:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715269632:0@lo:400:kworker.0 00000100:00100000:1.0:1788201231.699068:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201231.699098:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715270144:0@lo:400:kworker.0 00000100:00100000:1.0:1788201231.699120:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201231.699146:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715269504:0@lo:400:kworker.0 00000100:00100000:1.0:1788201231.699168:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201231.699184:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715270016:0@lo:400:kworker.0 00000100:00100000:1.0:1788201231.699203:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201231.699218:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715270528:0@lo:400:kworker.0 00000100:00100000:1.0:1788201231.699237:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201231.699255:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788201231.699261:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715269376:0@lo:400:kworker.0 00000100:00100000:1.0:1788201231.699281:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201231.699845:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715269888:0@lo:400:kworker.0 00000100:00100000:1.0:1788201231.699880:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201231.699947:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715270400:0@lo:400:kworker.0 00000100:00100000:1.0:1788201231.699969:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201231.700050:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715269248 00000100:00100000:2.0:1788201231.700061:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715269248 00000100:00100000:2.0:1788201231.700113:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715269632 00000100:00100000:2.0:1788201231.700117:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715269632 00000100:00100000:2.0:1788201231.700129:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715270144 00000100:00100000:2.0:1788201231.700132:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715270144 00000100:00100000:2.0:1788201231.700142:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715269504 00000100:00100000:2.0:1788201231.700145:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715269504 00000100:00100000:2.0:1788201231.700156:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715270528 00000100:00100000:2.0:1788201231.700158:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715270528 00000100:00100000:2.0:1788201231.700167:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715269376 00000100:00100000:2.0:1788201231.700169:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715269376 00000100:00100000:2.0:1788201231.700185:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1485 00000100:00100000:2.0:1788201231.700192:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715269248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201231.700253:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715269248:12345-0@lo:400:kworker.0 Request processed in 61us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201231.700260:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1485 00000100:00100000:2.0:1788201231.700279:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1486 00000100:00100000:2.0:1788201231.700285:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715269632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201231.700330:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715269632:12345-0@lo:400:kworker.0 Request processed in 45us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201231.700336:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1486 00000100:00100000:2.0:1788201231.700348:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487 00000100:00100000:2.0:1788201231.700354:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715270144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201231.700380:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715270144:12345-0@lo:400:kworker.0 Request processed in 27us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201231.700397:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1487 00000100:00100000:2.0:1788201231.700409:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1488 00000100:00100000:2.0:1788201231.700416:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715269504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201231.700445:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715269504:12345-0@lo:400:kworker.0 Request processed in 31us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201231.700452:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1488 00000100:00100000:2.0:1788201231.700463:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1489 00000100:00100000:2.0:1788201231.700469:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715270528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201231.700494:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715270528:12345-0@lo:400:kworker.0 Request processed in 25us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201231.700500:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1489 00000100:00100000:2.0:1788201231.700510:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1490 00000100:00100000:2.0:1788201231.700516:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715269376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201231.700540:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715269376:12345-0@lo:400:kworker.0 Request processed in 25us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201231.700545:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1490 00000100:00080000:2.0:1788201231.700565:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201231.700569:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201231.708105:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715269504:0@lo:400:kworker.0 00000100:00100000:1.0:1788201231.708125:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715270528:0@lo:400:kworker.0 00000100:00100000:1.0:1788201231.708159:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715269376:0@lo:400:kworker.0 00000100:00100000:1.0:1788201231.708195:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715269760 00000100:00100000:1.0:1788201231.708202:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715269760 00000100:00100000:1.0:1788201231.708262:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4087 00000100:00100000:1.0:1788201231.708271:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715269760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201231.708356:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715269760:12345-0@lo:400:kworker.0 Request processed in 85us (9476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201231.708377:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4087 00000100:00100000:3.0:1788201231.708445:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715270272 00000100:00100000:3.0:1788201231.708450:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715270272 00000100:00080000:3.0:1788201231.708551:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201231.710234:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715270016 00000100:00100000:2.0:1788201231.710248:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715270016 00000100:00100000:2.0:1788201231.710323:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715269888 00000100:00100000:2.0:1788201231.710327:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715269888 00000100:00100000:2.0:1788201231.710350:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715270400 00000100:00100000:2.0:1788201231.710353:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715270400 00000100:00100000:2.0:1788201231.710384:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2887 00000100:00100000:2.0:1788201231.710394:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715270272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201231.710503:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715270272:12345-0@lo:400:kworker.0 Request processed in 111us (11580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201231.710511:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2887 00000100:00100000:2.0:1788201231.710532:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2888 00000100:00100000:2.0:1788201231.710539:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715270016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201231.711055:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715270016:12345-0@lo:400:kworker.0 Request processed in 515us (11848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201231.711063:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2888 00000100:00100000:2.0:1788201231.711081:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2889 00000100:00100000:2.0:1788201231.711089:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715269888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201231.711125:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715269888:12345-0@lo:400:kworker.0 Request processed in 38us (11244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201231.711131:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2889 00000100:00100000:2.0:1788201231.711143:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2890 00000100:00100000:2.0:1788201231.711149:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715270400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201231.711177:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715270400:12345-0@lo:400:kworker.0 Request processed in 29us (11207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201231.711183:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2890 00000100:00100000:2.0:1788201231.711234:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715269888:0@lo:400:kworker.0 00000100:00100000:2.0:1788201231.711247:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715270400:0@lo:400:kworker.0 00000100:00100000:2.0:1788201231.711258:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715270016:0@lo:400:kworker.0 00000100:00080000:0.0:1788201231.711432:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201231.711438:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201231.712332:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715269120 00000100:00100000:0.0:1788201231.712342:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715269120 00000100:00100000:0.0:1788201231.712392:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788201231.712401:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715269120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201231.712460:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715269120:12345-0@lo:400:kworker.0 Request processed in 60us (13481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201231.712483:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788201231.712934:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715269120:0@lo:400:kworker.0 00000100:00100000:1.0:1788201231.712951:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715269632:0@lo:400:kworker.0 00000100:00100000:1.0:1788201231.712965:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715270144:0@lo:400:kworker.0 00000100:00100000:1.0:1788201231.712977:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715269248:0@lo:400:kworker.0 00000100:00100000:1.0:1788201231.713003:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715269760:0@lo:400:kworker.0 00000100:00100000:1.0:1788201231.713135:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715270272:0@lo:400:kworker.0 00010000:00010000:0.0:1788201232.143196:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201232.211499:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201232.211523:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00388ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715270656:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201232.211592:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201232.211666:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715270656 00000100:00100000:3.0:1788201232.211675:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715270656 00000100:00100000:3.0:1788201232.211732:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4088 00000100:00100000:3.0:1788201232.211742:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715270656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201232.211779:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444913152 avail 1298673664 00000100:00100000:3.0:1788201232.211835:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715270656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201232.211842:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4088 00000100:00100000:1.0:1788201232.211880:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00388ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715270656:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201232.213456:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715270784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201232.213522:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201232.213625:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715270784 00000100:00100000:2.0:1788201232.213633:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715270784 00000100:00100000:2.0:1788201232.213693:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2346 00000100:00100000:2.0:1788201232.213723:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715270784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201232.213770:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201232.213825:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715270784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201232.213832:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2346 00000100:00100000:1.0:1788201232.214051:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715270784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201232.218524:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201232.218550:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715270912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201232.218623:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201232.218750:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715270912 00000100:00100000:1.0:1788201232.218759:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715270912 00000100:00100000:1.0:1788201232.218809:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2347 00000100:00100000:1.0:1788201232.218819:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715270912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201232.218849:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788201232.218904:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715270912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201232.218922:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2347 00000100:00100000:3.0:1788201232.219067:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715270912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201232.340361:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201232.340412:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201232.340451:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201232.340474:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201232.340494:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201232.340523:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695434880 00000100:00100000:0.0:1788201232.340535:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695434880 00000100:00100000:0.0:1788201232.340596:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695434752 00000100:00100000:0.0:1788201232.340600:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695434752 00000100:00100000:0.0:1788201232.340622:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2891 00000100:00100000:0.0:1788201232.340632:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2402:x1875060695434880:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201232.340714:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2402:x1875060695434880:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 83us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201232.340721:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2891 00000100:00100000:0.0:1788201232.340752:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2892 00000100:00100000:0.0:1788201232.340760:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695434752:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201232.340785:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695434752:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201232.340791:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2892 00000100:00100000:0.0:1788201232.340809:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695434624 00000100:00100000:0.0:1788201232.340812:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695434624 00000100:00100000:0.0:1788201232.340841:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695434496 00000100:00100000:0.0:1788201232.340844:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695434496 00000100:00100000:0.0:1788201232.340865:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1491 00000100:00100000:0.0:1788201232.340881:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2402:x1875060695434624:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201232.340908:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2402:x1875060695434624:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 29us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201232.340914:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1491 00000100:00100000:0.0:1788201232.340926:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1492 00000100:00100000:0.0:1788201232.340932:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2402:x1875060695434496:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201232.340954:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2402:x1875060695434496:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 22us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201232.340960:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1492 00000100:00080000:0.0:1788201232.340993:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201232.340997:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201232.340999:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201232.341001:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201232.342515:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695434368 00000100:00100000:1.0:1788201232.342530:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695434368 00000100:00100000:1.0:1788201232.342591:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 131 00000100:00100000:1.0:1788201232.342600:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695434368:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201232.342670:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695434368:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 71us (2323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201232.342677:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 131 00000020:00000080:0.0:1788201232.443925:0:95491:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fffc971db40 20000000:00000080:0.0:1788201232.443946:0:95491:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff8dc1201fc400 uarg=0000000000000000 00000040:00100000:0.0:1788201232.454168:0:95491:0:(llog.c:1072:llog_reverse_process()) index 60 : idx 49 20000000:01000000:0.0:1788201232.454178:0:95491:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 59 cmd:0xce022 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:0.0:1788201232.454195:0:95491:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.pool_134 fl=4 20000000:01000000:0.0:1788201232.454875:0:95492:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 42 1->4: lustre-clilov new lustre.pool_134 20000000:01000000:0.0:1788201232.454919:0:95492:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 54 marker 42 2->4: lustre-clilov new lustre.pool_134 00000040:00080000:0.0:1788201232.454931:0:95492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000040:00080000:2.0:1788201232.455214:0:95491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].61, 224 off18904 20000000:01000000:2.0:1788201232.455228:0:95491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:2.0:1788201232.455240:0:95491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].62, 112 off19016 00000040:00080000:2.0:1788201232.455253:0:95491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].63, 224 off19240 20000000:01000000:2.0:1788201232.455267:0:95491:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:0.0:1788201232.455728:0:95493:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 46 marker 43 1->4: lustre-MDT0000-mdtlov new lustre.pool_134 20000000:01000000:0.0:1788201232.455775:0:95493:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 49 marker 43 2->4: lustre-MDT0000-mdtlov new lustre.pool_134 00000040:00080000:0.0:1788201232.455788:0:95493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000040:00080000:2.0:1788201232.455984:0:95491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].56, 224 off18016 20000000:01000000:2.0:1788201232.455994:0:95491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:2.0:1788201232.456008:0:95491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].57, 120 off18136 00000040:00080000:2.0:1788201232.456051:0:95491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].58, 224 off18360 20000000:01000000:2.0:1788201232.456064:0:95491:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:0.0:1788201232.456590:0:95494:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 46 marker 44 1->4: lustre-MDT0001-mdtlov new lustre.pool_134 20000000:01000000:0.0:1788201232.456618:0:95494:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 49 marker 44 2->4: lustre-MDT0001-mdtlov new lustre.pool_134 00000040:00080000:0.0:1788201232.456630:0:95494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000040:00080000:2.0:1788201232.456783:0:95491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].56, 224 off18016 20000000:01000000:2.0:1788201232.456793:0:95491:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:2.0:1788201232.456804:0:95491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].57, 120 off18136 00000040:00080000:2.0:1788201232.456816:0:95491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].58, 224 off18360 10000000:01000000:2.0:1788201232.456825:0:95491:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788201232.456844:0:95491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc007ade000/0x96d0c9b8c9a1ca36 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.456863:0:95491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc100031e00/0x96d0c9b8c9a1c9aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786975 expref: 9 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.456872:0:95491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc00896ba00/0x96d0c9b8c9a1c9b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78697c expref: 9 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.456880:0:95491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c9bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c9b8 expref: 23 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.456893:0:95491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc100030000/0x96d0c9b8c9a1c9cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c9c6 expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.456900:0:95491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc00896ae00/0x96d0c9b8c9a1c9db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c9d4 expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.456907:0:95491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc0078fc000/0x96d0c9b8c9a1c9e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c9e2 expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.456913:0:95491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc0078fc400/0x96d0c9b8c9a1c9f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c9f0 expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.456920:0:95491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc00896a800/0x96d0c9b8c9a1ca05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c9fe expref: 23 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.456926:0:95491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc100030800/0x96d0c9b8c9a1ca13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca0c expref: 23 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.456933:0:95491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1ca21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca1a expref: 23 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.456940:0:95491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc00896a000/0x96d0c9b8c9a1ca2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca28 expref: 23 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.456947:0:95491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dc007ade000/0x96d0c9b8c9a1ca36 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.456997:0:95491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc00896a000/0x96d0c9b8c9a1ca2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1ca28 expref: 23 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.457046:0:95491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc00896a000/0x96d0c9b8c9a1ca2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ca28 expref: 23 pid: 94464 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201232.457063:0:95491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95491:1875060715271040:0@lo:104: 00000100:00100000:2.0:1788201232.457131:0:95491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201232.457185:0:95491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1ca21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1ca1a expref: 23 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.457193:0:95491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1ca21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ca1a expref: 23 pid: 94467 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201232.457202:0:95491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95491:1875060715271168:0@lo:104: 00000100:00100000:2.0:1788201232.457232:0:95491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201232.457254:0:95491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc100030800/0x96d0c9b8c9a1ca13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1ca0c expref: 23 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.457262:0:95491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc100030800/0x96d0c9b8c9a1ca13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ca0c expref: 23 pid: 94467 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201232.457270:0:95491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95491:1875060715271296:0@lo:104: 00000100:00100000:2.0:1788201232.457295:0:95491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201232.457435:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715271040 00000100:00100000:1.0:1788201232.457443:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715271040 00000100:00100000:1.0:1788201232.457483:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715271168 00000100:00100000:1.0:1788201232.457486:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715271168 00000100:00100000:1.0:1788201232.457496:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715271296 00000100:00100000:1.0:1788201232.457498:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715271296 00000100:00100000:1.0:1788201232.457509:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788201232.457517:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+5:95491:x1875060715271040:12345-0@lo:104: 00010000:00010000:1.0:1788201232.457530:0:19665:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1ca28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1ca2f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201232.457549:0:95383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788201232.457559:0:95383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a443b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c9b18af6-fecc-4172-82c2-66531890fe11+5:95491:x1875060715271168:12345-0@lo:104: 00010000:00010000:3.0:1788201232.457566:0:95383:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1ca1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1ca21 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.457580:0:19665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201232.457586:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+5:95491:x1875060715271040:12345-0@lo:104: Request processed in 69us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201232.457592:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00010000:00010000:3.0:1788201232.457601:0:95383:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788201232.457606:0:95383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a443b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c9b18af6-fecc-4172-82c2-66531890fe11+4:95491:x1875060715271168:12345-0@lo:104: Request processed in 50us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201232.457609:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788201232.457614:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+4:95491:x1875060715271296:12345-0@lo:104: 00000100:00100000:3.0:1788201232.457618:0:95383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00010000:00010000:1.0:1788201232.457621:0:19665:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc00896ac00/0x96d0c9b8c9a1ca0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1ca13 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.457638:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201232.457643:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1ca28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1ca2f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.457650:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd800 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:3.0:1788201232.457655:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1ca28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1ca2f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.457660:0:19665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1788201232.457663:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1ca28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1ca2f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201232.457664:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+3:95491:x1875060715271296:12345-0@lo:104: Request processed in 50us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201232.457671:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 10000000:00010000:3.0:1788201232.457671:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1ca28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1ca2f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201232.457677:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201232.457684:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201232.457689:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1ca1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1ca21 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.457695:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fce00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201232.457698:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1ca1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1ca21 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.457704:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1ca1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1ca21 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.457705:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1ca28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1ca2f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201232.457711:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1ca1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1ca21 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.457711:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:1.0:1788201232.457716:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201232.457727:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1ca1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1ca21 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.457732:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201232.457741:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1ca28 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1ca2f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.457746:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1ca1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1ca21 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.457748:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd800/0x96d0c9b8c9a1ca28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1ca2f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.457752:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0078fce00/0x96d0c9b8c9a1ca1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1ca21 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.457761:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201232.457764:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc00896ac00/0x96d0c9b8c9a1ca0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1ca13 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.457779:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896ac00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:3.0:1788201232.457782:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc00896ac00/0x96d0c9b8c9a1ca0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1ca13 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.457784:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201232.457785:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201232.457787:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201232.457790:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc00896ac00/0x96d0c9b8c9a1ca0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1ca13 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201232.457794:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 10000000:00010000:3.0:1788201232.457795:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc00896ac00/0x96d0c9b8c9a1ca0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1ca13 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201232.457800:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788201232.457807:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715271552:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201232.457813:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc00896ac00/0x96d0c9b8c9a1ca0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1ca13 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.457818:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201232.457823:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc00896ac00/0x96d0c9b8c9a1ca0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1ca13 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.457829:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc00896ac00/0x96d0c9b8c9a1ca0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1ca13 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201232.457832:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201232.457838:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201232.457839:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201232.457841:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201232.457847:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201232.457859:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715271680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201232.457861:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715271424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201232.457879:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201232.457907:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201232.458086:0:95491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc00896a800/0x96d0c9b8c9a1ca05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9fe expref: 23 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.458095:0:95491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc00896a800/0x96d0c9b8c9a1ca05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9fe expref: 23 pid: 94467 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201232.458103:0:95491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a442d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95491:1875060715271808:0@lo:104: 00000100:00100000:2.0:1788201232.458133:0:95491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201232.458202:0:95491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc0078fc400/0x96d0c9b8c9a1c9f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9f0 expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.458210:0:95491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc0078fc400/0x96d0c9b8c9a1c9f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9f0 expref: 23 pid: 94461 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201232.458218:0:95491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8d9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95491:1875060715271936:0@lo:104: 00000100:00100000:2.0:1788201232.458239:0:95491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201232.459181:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715271552 00000100:00100000:1.0:1788201232.459189:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715271552 00010000:00010000:1.0:1788201232.459221:0:26207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1ca21 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ca1a expref: 24 pid: 94467 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201232.459255:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715271680 00000100:00100000:1.0:1788201232.459259:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715271680 00010000:00010000:1.0:1788201232.459270:0:26207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc100030800/0x96d0c9b8c9a1ca13 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ca0c expref: 25 pid: 94467 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201232.460519:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715271424 00000100:00100000:1.0:1788201232.460530:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715271424 00010000:00010000:1.0:1788201232.460556:0:26207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc00896a000/0x96d0c9b8c9a1ca2f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ca28 expref: 26 pid: 94464 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201232.460581:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:1.0:1788201232.460590:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+26:3656:x1875060715271552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201232.460604:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201232.460610:0:26207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1ca21 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ca1a expref: 26 pid: 94467 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.460636:0:26207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1ca21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ca1a expref: 26 pid: 94467 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.460655:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201232.460720:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+26:3656:x1875060715271552:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (2886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201232.460728:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00000100:00100000:1.0:1788201232.460748:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602 00000100:00100000:1.0:1788201232.460754:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118143480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+25:3656:x1875060715271680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201232.460762:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201232.460766:0:26207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc100030800/0x96d0c9b8c9a1ca13 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ca0c expref: 25 pid: 94467 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.460775:0:26207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc100030800/0x96d0c9b8c9a1ca13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ca0c expref: 25 pid: 94467 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.460784:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201232.460807:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118143480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+25:3656:x1875060715271680:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (2926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201232.460813:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602 00000100:00100000:1.0:1788201232.460825:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2603 00000100:00100000:1.0:1788201232.460830:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715271424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201232.460837:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201232.460841:0:26207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc00896a000/0x96d0c9b8c9a1ca2f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ca28 expref: 24 pid: 94464 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.460850:0:26207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc00896a000/0x96d0c9b8c9a1ca2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ca28 expref: 24 pid: 94464 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201232.460867:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201232.460902:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715271424:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (2995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201232.460908:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2603 00000100:00100000:1.0:1788201232.460966:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715271680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201232.460991:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715271552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201232.462038:0:95383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715271808 00000100:00100000:0.0:1788201232.462048:0:95383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715271808 00010000:00010000:2.0:1788201232.462068:0:95491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc0078fc000/0x96d0c9b8c9a1c9e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9e2 expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.462080:0:95491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc0078fc000/0x96d0c9b8c9a1c9e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9e2 expref: 23 pid: 94461 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201232.462083:0:95383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715271936 00000100:00100000:0.0:1788201232.462086:0:95383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715271936 00000100:00100000:2.0:1788201232.462094:0:95491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8db100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95491:1875060715272064:0@lo:104: 00000100:00100000:0.0:1788201232.462102:0:95383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788201232.462109:0:95383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c9b18af6-fecc-4172-82c2-66531890fe11+4:95491:x1875060715271808:12345-0@lo:104: 00010000:00010000:0.0:1788201232.462120:0:95383:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd400/0x96d0c9b8c9a1c9fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1ca05 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201232.462134:0:95491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201232.462152:0:95491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc00896ae00/0x96d0c9b8c9a1c9db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9d4 expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.462159:0:95491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc00896ae00/0x96d0c9b8c9a1c9db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9d4 expref: 23 pid: 94461 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.462160:0:95383:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201232.462165:0:95383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c9b18af6-fecc-4172-82c2-66531890fe11+4:95491:x1875060715271808:12345-0@lo:104: Request processed in 57us (4032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201232.462168:0:95491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8d8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95491:1875060715272192:0@lo:104: 00000100:00100000:0.0:1788201232.462188:0:95383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00010000:00010000:2.0:1788201232.462197:0:95491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc100030000/0x96d0c9b8c9a1c9cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9c6 expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.462204:0:95491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc100030000/0x96d0c9b8c9a1c9cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9c6 expref: 23 pid: 94461 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201232.462209:0:95383:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788201232.462224:0:95383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201232.462227:0:95491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8daa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95491:1875060715272320:0@lo:104: 00000100:00100000:0.0:1788201232.462232:0:95383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715272064 00000100:00100000:0.0:1788201232.462235:0:95383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715272064 00000100:00100000:0.0:1788201232.462247:0:95383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715272192 00000100:00100000:2.0:1788201232.462248:0:95491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201232.462249:0:95383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715272192 00000100:00100000:0.0:1788201232.462257:0:95383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715272320 00000100:00100000:0.0:1788201232.462259:0:95383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715272320 00010000:00010000:2.0:1788201232.462265:0:95491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c9bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9b8 expref: 23 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201232.462268:0:95383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788201232.462274:0:95383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c9b18af6-fecc-4172-82c2-66531890fe11+6:95491:x1875060715271936:12345-0@lo:104: 00010000:00010000:2.0:1788201232.462274:0:95491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c9bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9b8 expref: 23 pid: 94464 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201232.462281:0:95491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95491:1875060715272448:0@lo:104: 00000100:00100000:2.0:1788201232.462311:0:95491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201232.462701:0:95383:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1c9f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c9f7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.462739:0:95383:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788201232.462745:0:95383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c9b18af6-fecc-4172-82c2-66531890fe11+6:95491:x1875060715271936:12345-0@lo:104: Request processed in 471us (4505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201232.462752:0:95383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788201232.462775:0:95383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715272448 00000100:00100000:0.0:1788201232.462779:0:95383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715272448 00000100:00100000:0.0:1788201232.462793:0:95383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788201232.462799:0:95383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b83a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c9b18af6-fecc-4172-82c2-66531890fe11+6:95491:x1875060715272064:12345-0@lo:104: 00010000:00010000:0.0:1788201232.462807:0:95383:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc140d58200/0x96d0c9b8c9a1c9e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c9e9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.462845:0:95383:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788201232.462850:0:95383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b83a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c9b18af6-fecc-4172-82c2-66531890fe11+6:95491:x1875060715272064:12345-0@lo:104: Request processed in 52us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201232.462855:0:95383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788201232.462886:0:95383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1788201232.462892:0:95383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c9b18af6-fecc-4172-82c2-66531890fe11+5:95491:x1875060715272192:12345-0@lo:104: 00010000:00010000:0.0:1788201232.462898:0:95383:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1c9d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c9db expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.462925:0:95383:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788201232.462929:0:95383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c9b18af6-fecc-4172-82c2-66531890fe11+5:95491:x1875060715272192:12345-0@lo:104: Request processed in 39us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201232.462934:0:95383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1788201232.462946:0:95383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1788201232.462951:0:95383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c9b18af6-fecc-4172-82c2-66531890fe11+4:95491:x1875060715272320:12345-0@lo:104: 00010000:00010000:0.0:1788201232.462957:0:95383:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc00896b000/0x96d0c9b8c9a1c9c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c9cd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.462993:0:95383:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788201232.462997:0:95383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c9b18af6-fecc-4172-82c2-66531890fe11+4:95491:x1875060715272320:12345-0@lo:104: Request processed in 47us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201232.463012:0:95383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1788201232.463050:0:95383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1788201232.463057:0:95383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c9b18af6-fecc-4172-82c2-66531890fe11+3:95491:x1875060715272448:12345-0@lo:104: 00010000:00010000:0.0:1788201232.463064:0:95383:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc00896aa00/0x96d0c9b8c9a1c9b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c9bf expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463095:0:95383:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788201232.463099:0:95383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c9b18af6-fecc-4172-82c2-66531890fe11+3:95491:x1875060715272448:12345-0@lo:104: Request processed in 44us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201232.463105:0:95383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00010000:00010000:0.0:1788201232.463127:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788201232.463133:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd400/0x96d0c9b8c9a1c9fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1ca05 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463139:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd400 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201232.463144:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd400/0x96d0c9b8c9a1c9fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1ca05 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463152:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd400/0x96d0c9b8c9a1c9fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1ca05 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201232.463159:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd400/0x96d0c9b8c9a1c9fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1ca05 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201232.463165:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201232.463196:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd400/0x96d0c9b8c9a1c9fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1ca05 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463203:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201232.463226:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd400/0x96d0c9b8c9a1c9fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1ca05 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463234:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd400/0x96d0c9b8c9a1c9fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1ca05 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463247:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788201232.463251:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1c9f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c9f7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463257:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58c00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201232.463260:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1c9f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1c9f7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463266:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1c9f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c9f7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201232.463273:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1c9f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c9f7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201232.463383:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201232.463399:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1c9f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c9f7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463404:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201232.463410:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1c9f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c9f7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463416:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1c9f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c9f7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463426:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788201232.463435:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc140d58200/0x96d0c9b8c9a1c9e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c9e9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463441:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58200 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201232.463444:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d58200/0x96d0c9b8c9a1c9e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1c9e9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463450:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc140d58200/0x96d0c9b8c9a1c9e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c9e9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201232.463455:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d58200/0x96d0c9b8c9a1c9e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c9e9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201232.463460:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201232.463470:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc140d58200/0x96d0c9b8c9a1c9e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c9e9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463475:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201232.463490:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc140d58200/0x96d0c9b8c9a1c9e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c9e9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463495:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc140d58200/0x96d0c9b8c9a1c9e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c9e9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463502:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201232.463505:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1c9d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c9db expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463511:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030600 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201232.463513:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1c9d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1c9db expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463529:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1c9d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c9db expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201232.463535:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1c9d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c9db expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201232.463539:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201232.463552:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1c9d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c9db expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463557:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201232.463562:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1c9d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c9db expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463569:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc100030600/0x96d0c9b8c9a1c9d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c9db expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463577:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201232.463580:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc00896b000/0x96d0c9b8c9a1c9c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c9cd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463585:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896b000 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201232.463588:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc00896b000/0x96d0c9b8c9a1c9c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1c9cd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463595:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc00896b000/0x96d0c9b8c9a1c9c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c9cd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201232.463600:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc00896b000/0x96d0c9b8c9a1c9c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c9cd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201232.463610:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201232.463621:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc00896b000/0x96d0c9b8c9a1c9c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c9cd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463626:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201232.463631:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc00896b000/0x96d0c9b8c9a1c9c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c9cd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463636:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc00896b000/0x96d0c9b8c9a1c9c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c9cd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463644:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201232.463647:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc00896aa00/0x96d0c9b8c9a1c9b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c9bf expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463652:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896aa00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201232.463655:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc00896aa00/0x96d0c9b8c9a1c9b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1c9bf expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463661:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc00896aa00/0x96d0c9b8c9a1c9b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c9bf expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201232.463667:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc00896aa00/0x96d0c9b8c9a1c9b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c9bf expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201232.463672:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201232.463684:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc00896aa00/0x96d0c9b8c9a1c9b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c9bf expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463690:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201232.463703:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc00896aa00/0x96d0c9b8c9a1c9b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c9bf expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463709:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc00896aa00/0x96d0c9b8c9a1c9b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c9bf expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463723:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201232.463724:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201232.463726:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201232.463742:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715272832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201232.463779:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201232.463813:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201232.463818:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715272960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201232.463838:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201232.463863:0:9535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715272832 00000100:00100000:0.0:1788201232.463868:0:9535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715272832 00010000:00010000:0.0:1788201232.463887:0:9535:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc0078fc000/0x96d0c9b8c9a1c9e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9e2 expref: 24 pid: 94461 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201232.463909:0:9535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715272960 00000100:00100000:0.0:1788201232.463913:0:9535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715272960 00010000:00010000:0.0:1788201232.463925:0:9535:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc00896ae00/0x96d0c9b8c9a1c9db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9d4 expref: 25 pid: 94461 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201232.463943:0:9535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604 00000100:00100000:0.0:1788201232.463948:0:9535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1032aa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9b18af6-fecc-4172-82c2-66531890fe11+25:3655:x1875060715272832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201232.463957:0:9535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201232.463961:0:9535:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc0078fc000/0x96d0c9b8c9a1c9e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9e2 expref: 25 pid: 94461 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.463995:0:9535:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc0078fc000/0x96d0c9b8c9a1c9e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9e2 expref: 25 pid: 94461 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.464011:0:9535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201232.464072:0:9535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1032aa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9b18af6-fecc-4172-82c2-66531890fe11+25:3655:x1875060715272832:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201232.464078:0:9535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604 00000100:00100000:0.0:1788201232.464114:0:9535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2605 00000100:00100000:0.0:1788201232.464120:0:9535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715272960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201232.464126:0:9535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201232.464130:0:9535:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc00896ae00/0x96d0c9b8c9a1c9db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9d4 expref: 24 pid: 94461 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.464138:0:9535:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc00896ae00/0x96d0c9b8c9a1c9db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9d4 expref: 24 pid: 94461 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.464148:0:9535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201232.464168:0:9535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715272960:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201232.464174:0:9535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2605 00000100:00100000:0.0:1788201232.464213:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715272960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201232.464221:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715272832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201232.464246:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715272576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201232.464269:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201232.464303:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715273088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201232.464332:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201232.464353:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788201232.464360:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715272704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201232.464376:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201232.464391:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715273216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201232.464408:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201232.464429:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715272576 00000100:00100000:0.0:1788201232.464433:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715272576 00010000:00010000:0.0:1788201232.464448:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc00896a800/0x96d0c9b8c9a1ca05 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9fe expref: 24 pid: 94467 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201232.464460:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715273088 00000100:00100000:0.0:1788201232.464463:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715273088 00010000:00010000:0.0:1788201232.464470:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc100030000/0x96d0c9b8c9a1c9cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9c6 expref: 25 pid: 94461 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201232.464478:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715272704 00000100:00100000:0.0:1788201232.464481:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715272704 00010000:00010000:0.0:1788201232.464489:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc0078fc400/0x96d0c9b8c9a1c9f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9f0 expref: 26 pid: 94461 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201232.464498:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715273216 00000100:00100000:0.0:1788201232.464500:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715273216 00010000:00010000:0.0:1788201232.464509:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c9bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9b8 expref: 27 pid: 94464 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201232.464518:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2606 00000100:00100000:0.0:1788201232.464523:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+27:3657:x1875060715272576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201232.464530:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201232.464539:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc00896a800/0x96d0c9b8c9a1ca05 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9fe expref: 27 pid: 94467 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.464547:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc00896a800/0x96d0c9b8c9a1ca05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9fe expref: 27 pid: 94467 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.464557:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201232.464585:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+27:3657:x1875060715272576:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201232.464591:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2606 00000100:00100000:0.0:1788201232.464604:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2607 00000100:00100000:0.0:1788201232.464611:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+26:3657:x1875060715273088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201232.464618:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201232.464623:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc100030000/0x96d0c9b8c9a1c9cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9c6 expref: 26 pid: 94461 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.464630:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc100030000/0x96d0c9b8c9a1c9cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9c6 expref: 26 pid: 94461 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.464641:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201232.464663:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+26:3657:x1875060715273088:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201232.464669:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2607 00000100:00100000:0.0:1788201232.464681:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2608 00000100:00100000:0.0:1788201232.464688:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a480000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+25:3657:x1875060715272704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201232.464695:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201232.464699:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc0078fc400/0x96d0c9b8c9a1c9f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9f0 expref: 25 pid: 94461 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.464715:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc0078fc400/0x96d0c9b8c9a1c9f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9f0 expref: 25 pid: 94461 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.464725:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201232.464747:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a480000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+25:3657:x1875060715272704:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201232.464753:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2608 00000100:00100000:0.0:1788201232.464766:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2609 00000100:00100000:0.0:1788201232.464772:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a480e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715273216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201232.464779:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201232.464783:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c9bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9b8 expref: 24 pid: 94464 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.464792:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c9bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9b8 expref: 24 pid: 94464 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.464801:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201232.464821:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a480e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715273216:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201232.464827:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2609 00000100:00100000:0.0:1788201232.464858:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715272704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201232.464866:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715273216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201232.464873:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715272576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201232.464880:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715273088:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201232.464900:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201232.464918:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201232.465404:0:95491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc00896ba00/0x96d0c9b8c9a1c9b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78697c expref: 9 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.465420:0:95491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc00896ba00/0x96d0c9b8c9a1c9b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78697c expref: 9 pid: 94464 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201232.465432:0:95491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95491:1875060715273344:192.168.201.20@tcp:104: 00010000:00010000:2.0:1788201232.465508:0:95491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc100031e00/0x96d0c9b8c9a1c9aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786975 expref: 9 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.465517:0:95491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc100031e00/0x96d0c9b8c9a1c9aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786975 expref: 9 pid: 94467 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201232.465526:0:95491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95491:1875060715273472:192.168.201.20@tcp:104: 00010000:00010000:3.0:1788201232.466599:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201232.469499:0:95491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140a45300 going to sleep for 11 seconds 00010000:00010000:2.0:1788201232.469540:0:95491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00896a000/0x96d0c9b8c9a1ca2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ca28 expref: 23 pid: 94464 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201232.469577:0:95491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95491:1875060715271040:0@lo:104: 00010000:00010000:2.0:1788201232.469593:0:95491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1ca21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ca1a expref: 22 pid: 94467 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201232.469602:0:95491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95491:1875060715271168:0@lo:104: 00010000:00010000:2.0:1788201232.469611:0:95491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc100030800/0x96d0c9b8c9a1ca13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ca0c expref: 21 pid: 94467 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201232.469618:0:95491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95491:1875060715271296:0@lo:104: 00010000:00010000:2.0:1788201232.469627:0:95491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00896a800/0x96d0c9b8c9a1ca05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9fe expref: 20 pid: 94467 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201232.469634:0:95491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a442d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95491:1875060715271808:0@lo:104: 00010000:00010000:2.0:1788201232.469643:0:95491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fc400/0x96d0c9b8c9a1c9f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9f0 expref: 19 pid: 94461 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201232.469651:0:95491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8d9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95491:1875060715271936:0@lo:104: 00010000:00010000:2.0:1788201232.469661:0:95491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fc000/0x96d0c9b8c9a1c9e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9e2 expref: 18 pid: 94461 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201232.469669:0:95491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8db100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95491:1875060715272064:0@lo:104: 00010000:00010000:2.0:1788201232.469685:0:95491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00896ae00/0x96d0c9b8c9a1c9db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9d4 expref: 17 pid: 94461 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201232.469693:0:95491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8d8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95491:1875060715272192:0@lo:104: 00010000:00010000:2.0:1788201232.469702:0:95491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc100030000/0x96d0c9b8c9a1c9cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9c6 expref: 16 pid: 94461 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201232.469717:0:95491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8daa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95491:1875060715272320:0@lo:104: 00010000:00010000:2.0:1788201232.469728:0:95491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fcc00/0x96d0c9b8c9a1c9bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c9b8 expref: 15 pid: 94464 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201232.469737:0:95491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95491:1875060715272448:0@lo:104: 00000100:00100000:2.0:1788201232.470092:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715271424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201232.472905:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201232.473004:0:95491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95491:1875060715273344:192.168.201.20@tcp:104: 00000100:00100000:2.0:1788201232.473037:0:95491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95491:1875060715273472:192.168.201.20@tcp:104: 00010000:00010000:2.0:1788201232.473095:0:95491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dc007ade000/0x96d0c9b8c9a1ca36 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201232.473272:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695435008 00000100:00100000:0.0:1788201232.473296:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695435008 00010000:00010000:0.0:1788201232.473336:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc00896ba00/0x96d0c9b8c9a1c9b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78697c expref: 10 pid: 94464 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201232.473380:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2610 00000100:00100000:0.0:1788201232.473392:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118142300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695435008:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201232.473410:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201232.473417:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc00896ba00/0x96d0c9b8c9a1c9b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78697c expref: 10 pid: 94464 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.473430:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc00896ba00/0x96d0c9b8c9a1c9b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78697c expref: 10 pid: 94464 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.473451:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00896ba00/0x96d0c9b8c9a1c9b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78697c expref: 10 pid: 94464 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201232.473471:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201232.473535:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118142300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:2400:x1875060695435008:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 145us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201232.473542:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2610 00000100:00100000:1.0:1788201232.477695:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201232.477800:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695435136 00000100:00100000:2.0:1788201232.477810:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695435136 00010000:00010000:2.0:1788201232.477852:0:26213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc100031e00/0x96d0c9b8c9a1c9aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786975 expref: 9 pid: 94467 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201232.477895:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2611 00000100:00100000:2.0:1788201232.477905:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10a10dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:2401:x1875060695435136:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201232.477919:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201232.477924:0:26213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc100031e00/0x96d0c9b8c9a1c9aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786975 expref: 9 pid: 94467 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.477935:0:26213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc100031e00/0x96d0c9b8c9a1c9aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786975 expref: 9 pid: 94467 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.477953:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc100031e00/0x96d0c9b8c9a1c9aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786975 expref: 9 pid: 94467 timeout: 4183 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.477993:0:26213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dc007ade000/0x96d0c9b8c9a1ca36 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.478000:0:26213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007ade000/0x96d0c9b8c9a1ca36 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.478049:0:26213:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc007ade000/0x96d0c9b8c9a1ca36 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.478056:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc007ade000/0x96d0c9b8c9a1ca36 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.478063:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc007ade000/0x96d0c9b8c9a1ca36 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.478069:0:26213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc007ade000/0x96d0c9b8c9a1ca36 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.478074:0:26213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201232.478078:0:26213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc007ade000/0x96d0c9b8c9a1ca36 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.478085:0:26213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc007ade000/0x96d0c9b8c9a1ca36 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.478097:0:26213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc007ade000/0x96d0c9b8c9a1ca36 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201232.478108:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201232.478166:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10a10dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:2401:x1875060695435136:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 262us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201232.478179:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2611 00010000:00010000:3.0:1788201232.479469:0:95491:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dc007ade000/0x96d0c9b8c9a1ca36 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.479497:0:95491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc007ade000/0x96d0c9b8c9a1ca36 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201232.479504:0:95491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007ade000/0x96d0c9b8c9a1ca36 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201233.167523:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201233.620666:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201233.620807:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695435264 00000100:00100000:3.0:1788201233.620818:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695435264 00000100:00100000:3.0:1788201233.620876:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 132 00000100:00100000:3.0:1788201233.620885:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71021:x1875060695435264:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201233.620902:0:94463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201233.620931:0:94463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140d59e00/0x96d0c9b8c9a1ca3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786983 expref: -99 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201233.620969:0:94463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140d59e00/0x96d0c9b8c9a1ca3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786983 expref: 9 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201233.620981:0:94463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140d59e00/0x96d0c9b8c9a1ca3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786983 expref: 9 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201233.620989:0:94463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59e00, rc 0) 00000100:00100000:3.0:1788201233.621066:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695435264:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 181us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201233.621073:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 132 00000100:00100000:1.0:1788201233.635152:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201233.635338:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695435392 00000100:00100000:2.0:1788201233.635350:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695435392 00000100:00100000:2.0:1788201233.635418:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 133 00000100:00100000:2.0:1788201233.635428:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695435392:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201233.635621:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695435392:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 193us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201233.635629:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 133 00000100:00100000:1.0:1788201233.639999:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201233.640131:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695435520 00000100:00100000:3.0:1788201233.640143:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695435520 00000100:00100000:3.0:1788201233.640211:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 134 00000100:00100000:3.0:1788201233.640222:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695435520:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201233.640380:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695435520:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 159us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201233.640389:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 134 00000100:00100000:3.0:1788201233.656461:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201233.656604:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695435648 00000100:00100000:2.0:1788201233.656615:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695435648 00000100:00100000:2.0:1788201233.656676:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 135 00000100:00100000:2.0:1788201233.656687:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:73416:x1875060695435648:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788201233.656847:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:73416:x1875060695435648:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 160us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201233.656856:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 135 00000100:00100000:1.0:1788201233.671741:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201233.671852:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695435776 00000100:00100000:3.0:1788201233.671862:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695435776 00000100:00100000:3.0:1788201233.671917:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 136 00000100:00100000:3.0:1788201233.671927:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:73416:x1875060695435776:12345-192.168.201.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788201233.672122:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:73416:x1875060695435776:12345-192.168.201.20@tcp:502:llog_process_th.0 Request processed in 195us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201233.672131:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 136 00000100:00100000:1.0:1788201233.685430:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201233.685527:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695435904 00000100:00100000:0.0:1788201233.685546:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695435904 00000100:00100000:0.0:1788201233.685604:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 137 00000100:00100000:0.0:1788201233.685613:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695435904:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201233.685629:0:94464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201233.685658:0:94464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00896ba00/0x96d0c9b8c9a1ca44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78698a expref: -99 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201233.685686:0:94464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00896ba00/0x96d0c9b8c9a1ca44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78698a expref: 10 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201233.685697:0:94464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00896ba00/0x96d0c9b8c9a1ca44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78698a expref: 10 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201233.685707:0:94464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896ba00, rc 0) 00000100:00100000:0.0:1788201233.685770:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695435904:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 158us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201233.685777:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 137 00000100:00100000:1.0:1788201233.692048:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201233.692129:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695436032 00000100:00100000:3.0:1788201233.692139:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695436032 00000100:00100000:3.0:1788201233.692195:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 138 00000100:00100000:3.0:1788201233.692204:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695436032:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201233.692348:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695436032:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 144us (337us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201233.692356:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 138 10000000:01000000:2.0:1788201234.191157:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788201234.191165:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc11d438000 from 61 10000000:01000000:2.0:1788201234.191171:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788201234.191224:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ade400/0x96d0c9b8c9a1ca4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201234.191236:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007ade400/0x96d0c9b8c9a1ca4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201234.191256:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007ade400/0x96d0c9b8c9a1ca4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201234.191300:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715273600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201234.191376:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201234.191418:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140a45e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201234.192114:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715273600 00000100:00100000:0.0:1788201234.192123:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715273600 00000100:00100000:0.0:1788201234.192190:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788201234.192201:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715273600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201234.192214:0:94464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201234.192228:0:94464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00896aa00/0x96d0c9b8c9a1ca52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ca4b expref: -99 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201234.192253:0:94464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00896aa00/0x96d0c9b8c9a1ca52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca4b expref: 16 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201234.192264:0:94464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00896aa00/0x96d0c9b8c9a1ca52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca4b expref: 16 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201234.192272:0:94464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896aa00, rc 0) 00000100:00100000:0.0:1788201234.192330:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715273600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201234.192346:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788201234.194594:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715273600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201234.194621:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007ade400/0x96d0c9b8c9a1ca4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca52 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.194634:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007ade400/0x96d0c9b8c9a1ca4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ca52 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201234.194731:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715273728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201234.194781:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201234.194835:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201234.194922:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715273728 00000100:00100000:0.0:1788201234.194934:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715273728 00000100:00100000:0.0:1788201234.194989:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788201234.194998:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715273728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201234.195152:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715273728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201234.195159:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00010000:00010000:3.0:1788201234.195689:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201234.196127:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715273728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201234.196190:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715273856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201234.196260:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201234.196291:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201234.196819:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715273856 00000100:00100000:0.0:1788201234.196826:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715273856 00000100:00100000:0.0:1788201234.196881:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788201234.196890:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715273856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201234.197054:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715273856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201234.197061:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788201234.197384:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715273856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201234.197862:0:95495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95495:1875060715273984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201234.197918:0:95495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201234.197963:0:95495:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201234.198272:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715273984 00000100:00100000:0.0:1788201234.198277:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715273984 00000100:00100000:0.0:1788201234.198354:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788201234.198362:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+16:95495:x1875060715273984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201234.198480:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+16:95495:x1875060715273984:12345-0@lo:502:llog_process_th.0 Request processed in 118us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201234.198487:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788201234.198574:0:95495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95495:1875060715273984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201234.198616:0:95495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95495:1875060715274112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201234.198652:0:95495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201234.202287:0:95495:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201234.203074:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715274112 00000100:00100000:2.0:1788201234.203087:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715274112 00000100:00100000:2.0:1788201234.203147:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788201234.203159:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:95495:x1875060715274112:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201234.203342:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:95495:x1875060715274112:12345-0@lo:502:llog_process_th.0 Request processed in 184us (4688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201234.203351:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788201234.203432:0:95495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95495:1875060715274112:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788201234.203618:0:95495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:2.0:1788201234.203690:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:2.0:1788201234.203707:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788201234.203840:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ade400/0x96d0c9b8c9a1ca4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca52 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201234.203851:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007ade400/0x96d0c9b8c9a1ca4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca52 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201234.203861:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788201234.203864:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 56 10000000:01000000:2.0:1788201234.203866:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788201234.203893:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adee00/0x96d0c9b8c9a1ca59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201234.204207:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007adee00/0x96d0c9b8c9a1ca59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201234.204227:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007adee00/0x96d0c9b8c9a1ca59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201234.204368:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715274240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201234.204414:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201234.204440:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140a45480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201234.204575:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715274240 00000100:00100000:3.0:1788201234.204581:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715274240 00000100:00100000:3.0:1788201234.204612:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788201234.204620:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715274240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201234.204629:0:94463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201234.204641:0:94463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140d58400/0x96d0c9b8c9a1ca60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ca59 expref: -99 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.204669:0:94463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140d58400/0x96d0c9b8c9a1ca60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca59 expref: 17 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.204680:0:94463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140d58400/0x96d0c9b8c9a1ca60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca59 expref: 17 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.204689:0:94463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58400, rc 0) 00000100:00100000:3.0:1788201234.204731:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715274240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201234.204737:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788201234.204868:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715274240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201234.204881:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007adee00/0x96d0c9b8c9a1ca59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca60 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201234.204890:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007adee00/0x96d0c9b8c9a1ca59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ca60 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201234.205147:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715274368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201234.205173:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201234.205187:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140a45480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201234.206106:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715274368 00000100:00100000:3.0:1788201234.206115:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715274368 00000100:00100000:3.0:1788201234.206151:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788201234.206159:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715274368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201234.206733:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715274368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 572us (1557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201234.206743:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788201234.208583:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715274368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201234.208648:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a480000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715274496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201234.208791:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201234.208880:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc00750dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201234.208994:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715274496 00000100:00100000:2.0:1788201234.209002:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715274496 00000100:00100000:2.0:1788201234.209147:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788201234.209157:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715274496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201234.209282:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715274496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201234.209289:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788201234.209379:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a480000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715274496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201234.209839:0:95496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95496:1875060715274624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201234.209879:0:95496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201234.215216:0:95496:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201234.215358:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715274624 00000100:00100000:0.0:1788201234.215368:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715274624 00000100:00100000:0.0:1788201234.215435:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788201234.215444:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:95496:x1875060715274624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201234.215616:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:95496:x1875060715274624:12345-0@lo:502:llog_process_th.0 Request processed in 173us (5735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201234.215624:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788201234.215729:0:95496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95496:1875060715274624:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201234.215762:0:95496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201234.215772:0:95496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201234.215775:0:95496:0:(obd_config.c:1563:class_process_config()) marker 50 (0x1) lustre-MDT0000-m del lustre.pool_134 00000020:00000080:1.0:1788201234.215779:0:95496:0:(obd_config.c:1472:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1788201234.216896:0:95496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95496:1875060715274752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201234.217053:0:95496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201234.217079:0:95496:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201234.217445:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715274752 00000100:00100000:1.0:1788201234.217451:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715274752 00000100:00100000:1.0:1788201234.217551:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788201234.217558:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:95496:x1875060715274752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201234.217643:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:95496:x1875060715274752:12345-0@lo:502:llog_process_th.0 Request processed in 84us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201234.217650:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788201234.217701:0:95496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95496:1875060715274752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201234.217843:0:95496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201234.217849:0:95496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201234.217851:0:95496:0:(obd_config.c:1563:class_process_config()) marker 50 (0x2) lustre-MDT0000-m del lustre.pool_134 00000040:00080000:1.0:1788201234.217856:0:95496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000020:01000000:3.0:1788201234.218377:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 56-58 (rc=0) 10000000:01000000:3.0:1788201234.218403:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788201234.218415:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adee00/0x96d0c9b8c9a1ca59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca60 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.218425:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007adee00/0x96d0c9b8c9a1ca59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca60 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201234.218434:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788201234.218437:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc0053a4000 from 61 10000000:01000000:3.0:1788201234.218447:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201234.218917:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1ca67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.218927:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1ca67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.218937:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1ca67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201234.218967:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715274880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201234.219072:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201234.219114:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201234.219134:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715274880 00000100:00100000:3.0:1788201234.219139:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715274880 00000100:00100000:3.0:1788201234.219168:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788201234.219175:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715274880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201234.219185:0:94463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201234.219199:0:94463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140d59800/0x96d0c9b8c9a1ca6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ca67 expref: -99 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.219220:0:94463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140d59800/0x96d0c9b8c9a1ca6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca67 expref: 18 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.219229:0:94463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140d59800/0x96d0c9b8c9a1ca6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca67 expref: 18 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.219238:0:94463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59800, rc 0) 00000100:00100000:3.0:1788201234.219285:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715274880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201234.219300:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788201234.219341:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715274880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201234.219354:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1ca67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca6e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201234.219362:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1ca67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ca6e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201234.219427:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715275008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201234.219451:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201234.219831:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201234.219845:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715275008 00000100:00100000:3.0:1788201234.219849:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715275008 00000100:00100000:3.0:1788201234.219870:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788201234.219876:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715275008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201234.220089:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715275008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 211us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201234.220095:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788201234.220129:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715275008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201234.220160:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715275136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201234.220201:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201234.220222:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201234.220233:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715275136 00000100:00100000:3.0:1788201234.220236:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715275136 00000100:00100000:3.0:1788201234.220545:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788201234.220560:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715275136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201234.220642:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715275136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201234.220648:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788201234.221374:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715275136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201234.222858:0:95497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95497:1875060715275264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201234.223009:0:95497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201234.223112:0:95497:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201234.223144:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715275264 00000100:00100000:0.0:1788201234.223151:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715275264 00000100:00100000:0.0:1788201234.223189:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788201234.223197:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:95497:x1875060715275264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201234.223405:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:95497:x1875060715275264:12345-0@lo:502:llog_process_th.0 Request processed in 208us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201234.223412:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788201234.223639:0:95497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95497:1875060715275264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201234.223681:0:95497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95497:1875060715275392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201234.223775:0:95497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201234.223827:0:95497:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201234.223854:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715275392 00000100:00100000:0.0:1788201234.223858:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715275392 00000100:00100000:0.0:1788201234.223997:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788201234.224005:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+18:95497:x1875060715275392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201234.224115:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+18:95497:x1875060715275392:12345-0@lo:502:llog_process_th.0 Request processed in 110us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201234.224121:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788201234.224413:0:95497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95497:1875060715275392:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788201234.224434:0:95497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:1.0:1788201234.224638:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:1.0:1788201234.224663:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201234.224674:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1ca67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca6e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.224684:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1ca67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca6e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201234.224694:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788201234.224697:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 56 10000000:01000000:1.0:1788201234.224699:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788201234.224737:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fda00/0x96d0c9b8c9a1ca75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.224746:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0078fda00/0x96d0c9b8c9a1ca75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.224766:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0078fda00/0x96d0c9b8c9a1ca75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201234.224781:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715275520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201234.224815:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201234.225210:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201234.225307:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715275520 00000100:00100000:2.0:1788201234.225313:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715275520 00000100:00100000:2.0:1788201234.225377:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788201234.225391:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715275520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201234.225402:0:94467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201234.225413:0:94467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1ca7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ca75 expref: -99 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201234.225436:0:94467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1ca7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca75 expref: 19 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201234.225445:0:94467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1ca7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca75 expref: 19 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201234.225466:0:94467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007adf200, rc 0) 00000100:00100000:2.0:1788201234.225499:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715275520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201234.225505:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788201234.225664:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715275520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201234.225676:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0078fda00/0x96d0c9b8c9a1ca75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca7c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201234.225686:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fda00/0x96d0c9b8c9a1ca75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ca7c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201234.225745:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715275648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201234.225772:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201234.225789:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140a45240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201234.226006:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715275648 00000100:00100000:1.0:1788201234.226011:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715275648 00000100:00100000:1.0:1788201234.226066:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788201234.226072:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715275648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201234.226179:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715275648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201234.226185:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788201234.226281:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715275648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201234.226307:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715275776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201234.226349:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201234.226363:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140a45240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201234.226375:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715275776 00000100:00100000:2.0:1788201234.226378:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715275776 00000100:00100000:2.0:1788201234.226399:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788201234.226404:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715275776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201234.226488:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715275776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201234.226494:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788201234.226532:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715275776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201234.226701:0:95498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95498:1875060715275904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201234.230284:0:95498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201234.230327:0:95498:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140a45240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201234.230444:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715275904 00000100:00100000:1.0:1788201234.230464:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715275904 00000100:00100000:1.0:1788201234.230522:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788201234.230533:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12e6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:95498:x1875060715275904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201234.230667:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12e6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:95498:x1875060715275904:12345-0@lo:502:llog_process_th.0 Request processed in 135us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201234.230674:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788201234.230741:0:95498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95498:1875060715275904:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201234.230775:0:95498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201234.230785:0:95498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201234.230787:0:95498:0:(obd_config.c:1563:class_process_config()) marker 51 (0x1) lustre-MDT0001-m del lustre.pool_134 00000020:00000080:1.0:1788201234.230792:0:95498:0:(obd_config.c:1472:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1788201234.230927:0:95498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95498:1875060715276032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201234.230980:0:95498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201234.231001:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715276032 00000100:00100000:1.0:1788201234.231005:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715276032 00000100:00100000:1.0:1788201234.231050:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788201234.231057:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12e6ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:95498:x1875060715276032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201234.231111:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12e6ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:95498:x1875060715276032:12345-0@lo:502:llog_process_th.0 Request processed in 54us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201234.231118:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788201234.231142:0:95498:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201234.231153:0:95498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95498:1875060715276032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201234.231168:0:95498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201234.231172:0:95498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201234.231173:0:95498:0:(obd_config.c:1563:class_process_config()) marker 51 (0x2) lustre-MDT0001-m del lustre.pool_134 00000040:00080000:1.0:1788201234.231177:0:95498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 59 count 58 00000020:01000000:2.0:1788201234.231759:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 56-58 (rc=0) 10000000:01000000:2.0:1788201234.231782:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788201234.231795:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fda00/0x96d0c9b8c9a1ca75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca7c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201234.231807:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0078fda00/0x96d0c9b8c9a1ca75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca7c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201234.231818:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788201234.231820:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc001db6000 from 61 10000000:01000000:2.0:1788201234.231823:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788201234.231850:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adf800/0x96d0c9b8c9a1ca83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201234.231858:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc007adf800/0x96d0c9b8c9a1ca83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201234.231874:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc007adf800/0x96d0c9b8c9a1ca83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201234.231889:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715276160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201234.232065:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201234.232087:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105d39780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201234.232172:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715276160 00000100:00100000:1.0:1788201234.232178:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715276160 00000100:00100000:1.0:1788201234.232209:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788201234.232216:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134207c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715276160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201234.232225:0:94461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201234.232237:0:94461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fd200/0x96d0c9b8c9a1ca8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ca83 expref: -99 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.232267:0:94461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fd200/0x96d0c9b8c9a1ca8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca83 expref: 20 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.232277:0:94461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fd200/0x96d0c9b8c9a1ca8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca83 expref: 20 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.232296:0:94461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fd200, rc 0) 00000100:00100000:1.0:1788201234.232324:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134207c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715276160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201234.232330:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788201234.232508:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715276160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201234.232521:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc007adf800/0x96d0c9b8c9a1ca83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca8a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201234.232529:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc007adf800/0x96d0c9b8c9a1ca83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ca8a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201234.232578:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715276288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201234.232601:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201234.232620:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105d39780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201234.234735:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715276288 00000100:00100000:1.0:1788201234.234748:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715276288 00000100:00100000:1.0:1788201234.234801:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788201234.234810:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134204850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715276288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201234.235170:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134204850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715276288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 359us (2567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201234.235178:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788201234.235278:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715276288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201234.235327:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715276416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201234.235379:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201234.235411:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105d39780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201234.235581:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715276416 00000100:00100000:1.0:1788201234.235586:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715276416 00000100:00100000:1.0:1788201234.235623:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788201234.235630:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134207450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715276416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201234.235726:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134207450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715276416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201234.235732:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788201234.235865:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715276416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201234.236498:0:95499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a480e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95499:1875060715276544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201234.236540:0:95499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201234.236572:0:95499:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1098dd780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201234.236676:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715276544 00000100:00100000:1.0:1788201234.236682:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715276544 00000100:00100000:1.0:1788201234.236721:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788201234.236728:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+20:95499:x1875060715276544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201234.236820:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+20:95499:x1875060715276544:12345-0@lo:502:llog_process_th.0 Request processed in 91us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201234.236827:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788201234.237053:0:95499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a480e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95499:1875060715276544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201234.237091:0:95499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a480e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95499:1875060715276672:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201234.237122:0:95499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201234.237146:0:95499:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1098dd780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201234.237232:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715276672 00000100:00100000:1.0:1788201234.237236:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715276672 00000100:00100000:1.0:1788201234.237377:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788201234.237385:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:95499:x1875060715276672:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201234.237468:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:95499:x1875060715276672:12345-0@lo:502:llog_process_th.0 Request processed in 84us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201234.237475:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788201234.239628:0:95499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a480e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95499:1875060715276672:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788201234.239678:0:95499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:1.0:1788201234.239927:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:1.0:1788201234.239961:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201234.239973:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adf800/0x96d0c9b8c9a1ca83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca8a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.239985:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc007adf800/0x96d0c9b8c9a1ca83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca8a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201234.239995:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788201234.239997:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1788201234.240000:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788201234.240066:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1ca91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.240075:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1ca91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.240085:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1ca91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201234.240107:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715276800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201234.240166:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201234.240214:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1182320c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201234.240405:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715276800 00000100:00100000:0.0:1788201234.240412:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715276800 00000100:00100000:0.0:1788201234.240454:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788201234.240462:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134205850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715276800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201234.240474:0:94461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201234.240487:0:94461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00896b000/0x96d0c9b8c9a1ca98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ca91 expref: -99 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201234.240509:0:94461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00896b000/0x96d0c9b8c9a1ca98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca91 expref: 21 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201234.240518:0:94461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00896b000/0x96d0c9b8c9a1ca98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca91 expref: 21 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201234.240527:0:94461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896b000, rc 0) 00000100:00100000:0.0:1788201234.240563:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134205850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715276800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201234.240569:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788201234.240605:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715276800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201234.240617:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1ca91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca98 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201234.240630:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1ca91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ca98 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201234.240677:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a480e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715276928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201234.240701:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201234.240724:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1098dd540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201234.240734:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715276928 00000100:00100000:0.0:1788201234.240736:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715276928 00000100:00100000:0.0:1788201234.240755:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788201234.240761:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134206450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715276928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201234.240865:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134206450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715276928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201234.240871:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788201234.240897:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a480e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715276928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201234.241174:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a480e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715277056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201234.241211:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201234.241225:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1098dd540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201234.241236:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715277056 00000100:00100000:0.0:1788201234.241239:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715277056 00000100:00100000:0.0:1788201234.241530:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788201234.241537:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134207850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715277056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201234.241614:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134207850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715277056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201234.241621:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788201234.241671:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a480e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715277056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788201234.244605:0:95500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1788201234.245040:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1788201234.245066:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788201234.245077:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1ca91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca98 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201234.245087:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1ca91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca98 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201234.245095:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788201234.245097:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc13aa9f000 from 61 10000000:01000000:0.0:1788201234.245100:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201234.245133:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1ca9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201234.245141:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1ca9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201234.245151:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1ca9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201234.245174:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a480e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715277184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201234.245242:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201234.245356:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125a96e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201234.245425:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715277184 00000100:00100000:1.0:1788201234.245432:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715277184 00000100:00100000:1.0:1788201234.245483:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788201234.245492:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134204c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715277184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201234.245504:0:94461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201234.245518:0:94461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fc400/0x96d0c9b8c9a1caa6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ca9f expref: -99 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.245541:0:94461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fc400/0x96d0c9b8c9a1caa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca9f expref: 22 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.245551:0:94461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fc400/0x96d0c9b8c9a1caa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca9f expref: 22 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.245560:0:94461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fc400, rc 0) 00000100:00100000:1.0:1788201234.245593:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134204c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715277184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201234.245599:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788201234.245955:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a480e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715277184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201234.245970:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1ca9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1caa6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201234.245978:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1ca9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1caa6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201234.246074:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a480e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715277312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201234.246102:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201234.246121:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125a96e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201234.246237:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715277312 00000100:00100000:1.0:1788201234.246242:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715277312 00000100:00100000:1.0:1788201234.246343:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788201234.246350:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715277312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201234.246472:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715277312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201234.246479:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788201234.246997:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a480e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715277312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201234.247062:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a480e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715277440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201234.247115:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201234.247143:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125a96e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201234.247159:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715277440 00000100:00100000:0.0:1788201234.247163:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715277440 00000100:00100000:0.0:1788201234.247194:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788201234.247201:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715277440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201234.247709:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715277440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 507us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201234.247724:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788201234.252842:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a480e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715277440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201234.258066:0:95501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a480e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95501:1875060715277568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201234.258157:0:95501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201234.258197:0:95501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125a966c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201234.258367:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715277568 00000100:00100000:1.0:1788201234.258380:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715277568 00000100:00100000:1.0:1788201234.258419:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788201234.258426:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:95501:x1875060715277568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201234.258553:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:95501:x1875060715277568:12345-0@lo:502:llog_process_th.0 Request processed in 126us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201234.258561:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788201234.258745:0:95501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a480e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95501:1875060715277568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201234.258790:0:95501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a480e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95501:1875060715277696:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201234.258820:0:95501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201234.258847:0:95501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125a966c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201234.258995:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715277696 00000100:00100000:1.0:1788201234.259000:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715277696 00000100:00100000:1.0:1788201234.259058:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788201234.259065:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:95501:x1875060715277696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201234.259133:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:95501:x1875060715277696:12345-0@lo:502:llog_process_th.0 Request processed in 68us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201234.259139:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788201234.259273:0:95501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a480e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:95501:1875060715277696:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788201234.259299:0:95501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:1.0:1788201234.259553:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:1.0:1788201234.259588:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201234.259598:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1ca9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1caa6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.259609:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1ca9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1caa6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201234.259618:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788201234.259620:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1788201234.259623:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788201234.259647:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1caad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.259655:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1caad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.259670:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1caad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201234.259683:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715277824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201234.259727:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201234.259754:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc104e14c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201234.259849:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715277824 00000100:00100000:0.0:1788201234.259854:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715277824 00000100:00100000:0.0:1788201234.259929:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788201234.259945:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715277824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201234.259956:0:94463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201234.259969:0:94463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00896b600/0x96d0c9b8c9a1cab4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1caad expref: -99 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201234.259990:0:94463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00896b600/0x96d0c9b8c9a1cab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1caad expref: 23 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201234.260000:0:94463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00896b600/0x96d0c9b8c9a1cab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1caad expref: 23 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201234.260008:0:94463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896b600, rc 0) 00000100:00100000:0.0:1788201234.260070:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715277824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201234.260076:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788201234.262090:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715277824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201234.262117:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1caad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1cab4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.262128:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1caad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1cab4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201234.262208:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715277952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201234.262259:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201234.265248:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc104e14c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201234.271608:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715277952 00000100:00100000:2.0:1788201234.271624:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715277952 00000100:00100000:3.0:1788201234.271775:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788201234.271790:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715277952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201234.272033:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715277952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (9754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201234.272043:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788201234.272122:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715277952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201234.272181:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715278080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201234.272248:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201234.272280:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846180 going to sleep for 11 seconds 00000100:00100000:3.0:1788201234.273821:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715278080 00000100:00100000:3.0:1788201234.273831:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715278080 00000100:00100000:3.0:1788201234.273885:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788201234.273893:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715278080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201234.274062:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715278080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (1812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201234.274069:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788201234.274117:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715278080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788201234.275296:0:95502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1788201234.283772:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1788201234.283825:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788201234.283839:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1caad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1cab4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.283853:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1caad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1cab4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201234.283867:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788201234.283871:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dc12563cd28 from 1 10000000:01000000:1.0:1788201234.283874:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788201234.283934:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1cabb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.283951:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1cabb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.283962:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1cabb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201234.283988:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715278208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201234.284087:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201234.284135:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc104e14cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201234.284283:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715278208 00000100:00100000:2.0:1788201234.284292:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715278208 00000100:00100000:2.0:1788201234.284354:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788201234.284364:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715278208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201234.284379:0:94461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201234.284391:0:94461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc007adf600/0x96d0c9b8c9a1cac2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1cabb expref: -99 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201234.284414:0:94461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc007adf600/0x96d0c9b8c9a1cac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1cabb expref: 24 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201234.284423:0:94461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc007adf600/0x96d0c9b8c9a1cac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1cabb expref: 24 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201234.284431:0:94461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007adf600, rc 0) 00000100:00100000:2.0:1788201234.284483:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715278208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201234.284490:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788201234.284637:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715278208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201234.284650:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1cabb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1cac2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.284659:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1cabb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1cac2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201234.284713:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715278336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201234.284742:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201234.284777:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc104e14cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201234.284852:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715278336 00000100:00100000:2.0:1788201234.284857:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715278336 00000100:00100000:2.0:1788201234.284891:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788201234.284908:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715278336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201234.285002:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715278336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (258us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201234.285009:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788201234.285118:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715278336:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788201234.285143:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788201234.285149:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1cabb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1cac2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201234.285156:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1cabb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1cac2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201234.767296:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715278464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201234.767373:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201234.767468:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715278464 00000100:00100000:2.0:1788201234.767477:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715278464 00000100:00100000:2.0:1788201234.767550:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2348 00000100:00100000:2.0:1788201234.767562:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715278464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201234.767593:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201234.767660:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715278464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201234.767667:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2348 00000100:00080000:3.0:1788201234.767727:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201234.767761:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715278464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201234.768154:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201234.768164:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715278592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201234.768195:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201234.768255:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715278592 00000100:00100000:3.0:1788201234.768260:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715278592 00000100:00100000:3.0:1788201234.768302:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2349 00000100:00100000:3.0:1788201234.768310:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715278592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201234.768327:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788201234.768364:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715278592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201234.768370:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2349 00000100:00100000:3.0:1788201234.768402:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715278592:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788201234.768446:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788201235.221397:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201236.239780:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201236.815587:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715278976:0@lo:400:kworker.0 00000100:00100000:1.0:1788201236.815666:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201236.815703:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715279488:0@lo:400:kworker.0 00000100:00100000:1.0:1788201236.815729:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201236.815770:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201236.815777:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715279104:0@lo:400:kworker.0 00000100:00100000:1.0:1788201236.815800:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201236.815831:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715278976 00000100:00100000:1.0:1788201236.815837:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715278976 00000100:00100000:1.0:1788201236.815885:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715279104 00000100:00100000:1.0:1788201236.815888:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715279104 00000100:00100000:1.0:1788201236.816054:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493 00000100:00100000:1.0:1788201236.816064:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715278976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201236.816111:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715278976:12345-0@lo:400:kworker.0 Request processed in 50us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201236.816118:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493 00000100:00100000:1.0:1788201236.816136:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1494 00000100:00100000:1.0:1788201236.816141:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715279104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201236.816163:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715279104:12345-0@lo:400:kworker.0 Request processed in 22us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201236.816169:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1494 00000100:00100000:1.0:1788201236.816184:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715279488 00000100:00100000:1.0:1788201236.816187:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715279488 00000100:00100000:1.0:1788201236.816207:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4089 00000100:00100000:1.0:1788201236.816228:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715279488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201236.816262:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715279488:12345-0@lo:400:kworker.0 Request processed in 35us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201236.816268:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4089 00000100:00100000:1.0:1788201236.816314:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715279104:0@lo:400:kworker.0 00000100:00100000:1.0:1788201236.816325:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715278976:0@lo:400:kworker.0 00000100:00100000:1.0:1788201236.816333:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715279488:0@lo:400:kworker.0 00000100:00080000:1.0:1788201236.816371:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201236.816376:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201236.816632:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715278720:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201236.816667:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201236.816698:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715279232:0@lo:400:kworker.0 00000100:00100000:0.0:1788201236.816722:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201236.816753:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715279744:0@lo:400:kworker.0 00000100:00100000:0.0:1788201236.816785:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201236.816809:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715280256:0@lo:400:kworker.0 00000100:00100000:0.0:1788201236.816841:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201236.816863:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788201236.816869:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715278848:0@lo:400:kworker.0 00000100:00100000:0.0:1788201236.816905:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201236.816930:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715279360:0@lo:400:kworker.0 00000100:00100000:0.0:1788201236.816950:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201236.816965:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715279872:0@lo:400:kworker.0 00000100:00100000:0.0:1788201236.816984:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201236.816999:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715280384:0@lo:400:kworker.0 00000100:00100000:0.0:1788201236.817048:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201236.817078:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715279616:0@lo:400:kworker.0 00000100:00100000:0.0:1788201236.817104:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201236.817122:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715280128:0@lo:400:kworker.0 00000100:00100000:0.0:1788201236.817143:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201236.817162:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201236.817168:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715280000:0@lo:400:kworker.0 00000100:00100000:0.0:1788201236.817188:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201236.817212:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715279232 00000100:00100000:0.0:1788201236.817216:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715279232 00000100:00100000:0.0:1788201236.817255:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715279360 00000100:00100000:0.0:1788201236.817258:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715279360 00000100:00100000:0.0:1788201236.817271:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715279872 00000100:00100000:0.0:1788201236.817274:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715279872 00000100:00100000:0.0:1788201236.817282:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715280384 00000100:00100000:0.0:1788201236.817284:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715280384 00000100:00100000:0.0:1788201236.817295:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1495 00000100:00100000:0.0:1788201236.817301:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715279232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201236.817350:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715279232:12345-0@lo:400:kworker.0 Request processed in 48us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201236.817357:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1495 00000100:00100000:0.0:1788201236.817373:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1496 00000100:00100000:0.0:1788201236.817379:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715279360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201236.817407:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715279360:12345-0@lo:400:kworker.0 Request processed in 28us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201236.817413:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1496 00000100:00100000:0.0:1788201236.817425:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1497 00000100:00100000:0.0:1788201236.817431:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715279872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201236.817457:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715279872:12345-0@lo:400:kworker.0 Request processed in 26us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201236.817629:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715279744 00000100:00100000:1.0:1788201236.817634:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715279744 00000100:00100000:1.0:1788201236.817663:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715280256 00000100:00100000:1.0:1788201236.817666:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715280256 00000100:00100000:1.0:1788201236.817681:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715279616 00000100:00100000:1.0:1788201236.817683:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715279616 00000100:00100000:1.0:1788201236.817698:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715280128 00000100:00100000:1.0:1788201236.817701:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715280128 00000100:00100000:1.0:1788201236.817716:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2893 00000100:00100000:1.0:1788201236.817721:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715279744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201236.817840:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715278720 00000100:00100000:3.0:1788201236.817845:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715278720 00000100:00100000:3.0:1788201236.817872:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715280000 00000100:00100000:3.0:1788201236.817875:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715280000 00000100:00100000:3.0:1788201236.817888:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4090 00000100:00100000:3.0:1788201236.817905:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715278720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788201236.817932:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:3.0:1788201236.817971:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715278720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201236.817977:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4090 00000100:00100000:3.0:1788201236.817992:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4091 00000100:00100000:3.0:1788201236.817998:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715280000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201236.818055:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715280000:12345-0@lo:400:kworker.0 Request processed in 58us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201236.818062:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4091 00000100:00100000:3.0:1788201236.818102:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715280000:0@lo:400:kworker.0 00000100:00100000:3.0:1788201236.818161:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2894 00000100:00100000:3.0:1788201236.818169:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715280256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201236.818200:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715280256:12345-0@lo:400:kworker.0 Request processed in 33us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201236.818206:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2894 00000100:00100000:3.0:1788201236.818221:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2895 00000100:00100000:3.0:1788201236.818227:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715279616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201236.818259:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715279616:12345-0@lo:400:kworker.0 Request processed in 32us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201236.818265:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2895 00000100:00100000:3.0:1788201236.818288:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2896 00000100:00100000:3.0:1788201236.818294:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715280128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201236.818323:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715280128:12345-0@lo:400:kworker.0 Request processed in 29us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201236.818329:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2896 00000100:00100000:3.0:1788201236.818353:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1498 00000100:00100000:3.0:1788201236.818360:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715280384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201236.818388:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715280384:12345-0@lo:400:kworker.0 Request processed in 29us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201236.818394:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1498 00000100:00080000:3.0:1788201236.818412:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201236.818416:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201236.818418:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201236.818420:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201236.818438:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715279616:0@lo:400:kworker.0 00000100:00100000:3.0:1788201236.818449:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715280128:0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.818663:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715278848 00000100:00100000:2.0:1788201236.818668:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715278848 00000100:00100000:2.0:1788201236.818701:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788201236.818707:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715278848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.818754:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715278848:12345-0@lo:400:kworker.0 Request processed in 47us (1859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201236.818760:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788201236.818823:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715278848:0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.818836:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715279360:0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.818847:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715279872:0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.818858:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715280384:0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.818875:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715278720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201236.818886:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715279232:0@lo:400:kworker.0 00000100:00100000:2.0:1788201236.818908:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715280256:0@lo:400:kworker.0 00000100:00100000:1.0:1788201236.819183:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715279744:12345-0@lo:400:kworker.0 Request processed in 1460us (2396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201236.819191:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2893 00000100:00100000:2.0:1788201236.819644:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715279744:0@lo:400:kworker.0 00000100:00100000:0.0:1788201236.820589:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1497 00010000:00010000:0.0:1788201237.265440:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201237.327343:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201237.327371:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715280512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201237.327446:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201237.327513:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715280512 00000100:00100000:1.0:1788201237.327519:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715280512 00000100:00100000:1.0:1788201237.327583:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4092 00000100:00100000:1.0:1788201237.327592:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715280512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201237.327639:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444937728 avail 1298698240 00000100:00100000:1.0:1788201237.327685:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715280512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201237.327692:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4092 00000100:00100000:1.0:1788201237.327719:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715280640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201237.327744:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201237.327784:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715280512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201237.327809:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715280640 00000100:00100000:1.0:1788201237.327812:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715280640 00000100:00100000:1.0:1788201237.327836:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2350 00000100:00100000:1.0:1788201237.327842:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715280640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201237.327859:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788201237.327911:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715280640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201237.327917:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2350 00000100:00100000:1.0:1788201237.327943:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715280640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201237.336857:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201237.336882:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715280768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201237.336960:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201237.337096:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715280768 00000100:00100000:2.0:1788201237.337118:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715280768 00000100:00100000:2.0:1788201237.337180:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2351 00000100:00100000:2.0:1788201237.337198:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715280768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201237.337236:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201237.337287:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715280768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201237.337294:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2351 00000100:00100000:3.0:1788201237.337510:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715280768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201237.483609:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201237.483666:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201237.483689:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201237.483707:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201237.483728:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201237.483758:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695436416 00000100:00100000:1.0:1788201237.483772:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695436416 00000100:00100000:1.0:1788201237.483831:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695436288 00000100:00100000:1.0:1788201237.483845:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695436288 00000100:00100000:1.0:1788201237.483874:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1499 00000100:00100000:1.0:1788201237.483898:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695436416:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201237.483968:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695436416:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 85us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201237.483975:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1499 00000100:00100000:1.0:1788201237.483995:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1500 00000100:00100000:1.0:1788201237.484002:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2403:x1875060695436288:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201237.484050:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2403:x1875060695436288:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 48us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201237.484055:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1500 00000100:00100000:1.0:1788201237.484074:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695436672 00000100:00100000:1.0:1788201237.484078:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695436672 00000100:00100000:1.0:1788201237.484104:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695436544 00000100:00100000:1.0:1788201237.484106:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695436544 00000100:00100000:1.0:1788201237.484125:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2897 00000100:00100000:1.0:1788201237.484132:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695436672:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201237.484157:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695436672:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201237.484163:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2897 00000100:00100000:1.0:1788201237.484174:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2898 00000100:00100000:1.0:1788201237.484180:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695436544:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201237.484434:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695436544:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 253us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201237.484442:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2898 00000100:00080000:1.0:1788201237.484478:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201237.484483:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201237.484485:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201237.484487:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201237.488202:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695436160 00000100:00100000:0.0:1788201237.488227:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695436160 00000100:00100000:0.0:1788201237.488297:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 178 00000100:00100000:0.0:1788201237.488308:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695436160:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201237.488411:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695436160:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 105us (4811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201237.488418:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 178 00000001:02000400:0.0:1788201237.981344:0:95600:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 135: Server failure in lock replay phase ========================================================== 14:33:56 (1788201236) 00000100:00100000:1.0:1788201238.069953:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201238.070368:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695436928 00000100:00100000:0.0:1788201238.070379:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695436928 00000100:00100000:0.0:1788201238.070453:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1464 00000100:00100000:0.0:1788201238.070481:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:73589:x1875060695436928:12345-192.168.201.20@tcp:36:mkdir.0 00010000:00010000:0.0:1788201238.070543:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201238.070572:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1c8d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78692f expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.070592:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:0.0:1788201238.070596:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201238.070660:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cac9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.070673:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cac9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.070682:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cac9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.070696:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1cad0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.070703:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1cad0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.070709:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1cad0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.072602:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1cad7 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.072625:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1cad7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.072710:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1cad7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201238.072744:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074ab302a reply state 000000002b09ca1b transno 124554051585 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1cad7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.072758:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1cad7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.072766:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201238.072768:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201238.072772:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788201238.072778:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:0.0:1788201238.072788:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cac9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.072795:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cac9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.072801:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cac9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.072807:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cac9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.072813:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896ae00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201238.072817:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cac9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.072824:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cac9 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.072835:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:0.0:1788201238.072837:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201238.072847:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cac9 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.072854:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cac9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201238.073006:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074ab302a reply state 000000002b09ca1b transno 124554051585 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1cad0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.074424:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1cad0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.074439:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff8dc0048bed00) 00010000:00010000:0.0:1788201238.074442:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201238.074446:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788201238.074643:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:73589:x1875060695436928:12345-192.168.201.20@tcp:36:mkdir.0 Request processed in 4151us (4687us total) trans 124554051585 rc 0/0 00000100:00100000:0.0:1788201238.074653:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1464 00000100:00100000:0.0:1788201238.120633:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201238.120734:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695437056 00000100:00100000:2.0:1788201238.120744:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695437056 00000100:00100000:2.0:1788201238.120812:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1465 00000100:00100000:2.0:1788201238.120823:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:73591:x1875060695437056:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1788201238.120849:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201238.120888:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1cade lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786991 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.120952:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1cae5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.120965:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1cae5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.120975:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1cae5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201238.121062:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788201238.121066:0:69485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201238.121084:0:69485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1cae5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.121109:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1cade lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786991 expref: 13 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.121149:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1cae5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786991 expref: 12 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.121158:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:2.0:1788201238.121161:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201238.121164:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ade000, rc 0) 00000100:00100000:2.0:1788201238.121231:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:73591:x1875060695437056:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 410us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201238.121239:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1465 00000100:00100000:1.0:1788201238.138298:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.138404:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695437312 00000100:00100000:3.0:1788201238.138413:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695437312 00000100:00100000:3.0:1788201238.138465:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1466 00000100:00100000:3.0:1788201238.138472:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:73591:x1875060695437312:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1788201238.138491:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201238.138504:0:66312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788201238.138527:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1cae5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786991 expref: 12 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.138543:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:3.0:1788201238.138546:0:66312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201238.138556:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1caec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786998 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.138672:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1caf3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.138682:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1caf3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.138689:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1caf3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.138696:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cafa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.138700:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cafa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.138704:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cafa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.138771:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1cb01 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.138780:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1cb01 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.138797:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1cb01 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201238.138808:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:3.0:1788201238.138824:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1cb01 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.138831:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1cb01 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.138837:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1cb01 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.138843:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201238.138848:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1cb01 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.138853:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1cb01 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.138860:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:3.0:1788201238.138862:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201238.138865:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1cb01 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.138869:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1cb01 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.138919:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1caf3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.138926:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1caf3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.138938:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1caf3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.138944:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1caf3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.138949:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201238.138953:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1caf3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.138963:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1caf3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.138972:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:3.0:1788201238.138974:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201238.138978:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1caf3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.138983:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1caf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.138992:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cafa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.138997:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cafa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.139003:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cafa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.139008:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201238.139047:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cafa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.139053:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cafa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.139062:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff8dc0048bed00) 00010000:00010000:3.0:1788201238.139064:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201238.139067:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cafa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.139072:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cafa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.139100:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1caec lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786998 expref: 12 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.139109:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:3.0:1788201238.139111:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201238.139114:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1caec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786998 expref: 12 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.139122:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58a00, rc 0) 00000100:00100000:3.0:1788201238.139907:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:73591:x1875060695437312:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 1429us (1611us total) trans 0 rc 301/301 00000100:00100000:3.0:1788201238.139918:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1466 00000100:00100000:3.0:1788201238.142956:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201238.143351:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695437440 00000100:00100000:0.0:1788201238.143361:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695437440 00000100:00100000:0.0:1788201238.143413:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1467 00000100:00100000:0.0:1788201238.143424:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:73591:x1875060695437440:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788201238.143444:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201238.143462:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b800/0x96d0c9b8c9a1cb08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78699f expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.143520:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1cb0f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.143531:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1cb0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.143546:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1cb0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201238.143581:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201238.143584:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201238.143598:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1cb0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.143617:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b800/0x96d0c9b8c9a1cb08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78699f expref: 13 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.143627:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1cb0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78699f expref: 12 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.143643:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:0.0:1788201238.143646:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201238.143649:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896be00, rc 0) 00000100:00100000:0.0:1788201238.144093:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:73591:x1875060695437440:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 669us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201238.144099:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1467 00000100:00100000:0.0:1788201238.149304:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.149420:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695437696 00000100:00100000:3.0:1788201238.149429:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695437696 00000100:00100000:3.0:1788201238.149480:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1468 00000100:00100000:3.0:1788201238.149495:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:73591:x1875060695437696:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1788201238.149513:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201238.149531:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1cb16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7869a6 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.149588:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cb1d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.149599:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cb1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.149608:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cb1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.149615:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cb24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.149619:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cb24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.149623:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cb24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201238.149724:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:3.0:1788201238.149787:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cb1d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.149792:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cb1d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.149797:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cb1d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.149809:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cb1d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.149812:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201238.149815:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cb1d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.149820:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cb1d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.149829:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:3.0:1788201238.149831:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201238.149834:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cb1d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.149838:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cb1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.149847:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cb24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.149850:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cb24 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.149853:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cb24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.149857:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201238.150365:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cb24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.150383:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cb24 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.150394:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff8dc0048bed00) 00010000:00010000:3.0:1788201238.150396:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201238.150399:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cb24 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.150404:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cb24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.150442:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1cb16 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869a6 expref: 14 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.150452:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:3.0:1788201238.150455:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201238.150458:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1cb16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869a6 expref: 14 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.150467:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58a00, rc 0) 00000100:00100000:3.0:1788201238.150580:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:73591:x1875060695437696:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 1085us (1286us total) trans 124554051586 rc 301/301 00000100:00100000:3.0:1788201238.150588:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1468 00000100:00100000:1.0:1788201238.153811:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.155341:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695437952 00000100:00100000:3.0:1788201238.155353:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695437952 00000100:00100000:3.0:1788201238.155416:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1469 00000100:00100000:3.0:1788201238.155427:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:73591:x1875060695437952:12345-192.168.201.20@tcp:36:lfs.0 00010000:00010000:3.0:1788201238.155521:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1cb32 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.155538:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1cb32 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.155551:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1cb32 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201238.155691:0:66312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000845106d1 reply state 00000000a4d2b9c2 transno 124554051587 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1cb32 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.155704:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1cb32 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.155711:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:3.0:1788201238.155714:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1788201238.155717:0:66312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788201238.155724:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00000100:00100000:3.0:1788201238.155801:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:73591:x1875060695437952:12345-192.168.201.20@tcp:36:lfs.0 Request processed in 375us (1996us total) trans 124554051587 rc 0/0 00000100:00100000:3.0:1788201238.155808:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1469 00000100:00100000:3.0:1788201238.159521:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201238.159894:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695438208 00000100:00100000:0.0:1788201238.159905:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695438208 00000100:00100000:0.0:1788201238.159965:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 244 00000100:00100000:0.0:1788201238.159977:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:73591:x1875060695438208:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:0.0:1788201238.160573:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:73591:x1875060695438208:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 595us (1059us total) trans 124554051588 rc 0/0 00000100:00100000:0.0:1788201238.160595:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 244 00000100:00100000:0.0:1788201238.178551:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.181750:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695438336 00000100:00100000:3.0:1788201238.181770:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695438336 00000100:00100000:3.0:1788201238.183685:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1470 00000100:00100000:3.0:1788201238.183710:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:73596:x1875060695438336:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:3.0:1788201238.183743:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201238.183768:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1cb39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7869ad expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.183853:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cb40 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.183867:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cb40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.183893:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cb40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.183906:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cb47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.183914:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cb47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.183920:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cb47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.184010:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1cb4e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.184049:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1cb4e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.184056:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1cb4e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201238.184093:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00000004:00200000:3.0:1788201238.184097:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201238.184144:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1cb4e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.184168:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cb40 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.184175:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cb40 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.184192:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cb40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.184199:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cb40 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.184204:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201238.184217:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cb40 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.184224:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cb40 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.184237:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:3.0:1788201238.184240:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201238.184245:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cb40 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.184251:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cb40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.184264:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cb47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.184269:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cb47 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.184285:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cb47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.184290:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201238.184293:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cb47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.184298:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cb47 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.184305:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff8dc0048bed00) 00010000:00010000:3.0:1788201238.184307:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201238.184310:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cb47 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.184315:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cb47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.184343:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1cb39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869ad expref: 18 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.184356:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1cb4e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869ad expref: 17 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.184362:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:3.0:1788201238.184364:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788201238.184366:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58200, rc 0) 00000100:00100000:3.0:1788201238.184432:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+17:73596:x1875060695438336:12345-192.168.201.20@tcp:101:touch.0 Request processed in 733us (5891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201238.184448:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1470 00000100:00100000:2.0:1788201238.197895:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201238.198346:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695438592 00000100:00100000:1.0:1788201238.198360:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695438592 00000100:00100000:1.0:1788201238.198426:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1471 00000100:00100000:1.0:1788201238.198438:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+17:73596:x1875060695438592:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:1.0:1788201238.198463:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201238.198489:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fce00/0x96d0c9b8c9a1cb55 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7869b4 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.198608:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1cb5c lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.198625:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1cb5c lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.198638:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1cb5c lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.198655:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1cb63 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.198662:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1cb63 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.198668:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1cb63 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201238.198980:0:66757:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x323:0x0], count =95 00000004:00080000:1.0:1788201238.198987:0:66757:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x323:0x0]+95 in llog 00000004:00080000:1.0:1788201238.199005:0:66757:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x382:0x0], index 0: 0 00010000:00010000:1.0:1788201238.199433:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1cb6a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.199444:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1cb6a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.199452:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1cb6a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.199487:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1cb5c lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.199494:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1cb5c lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.199499:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1cb5c lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.199505:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1cb5c lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.199512:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201238.199517:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1cb5c lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.199524:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1cb5c lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.199549:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:1.0:1788201238.199552:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201238.199556:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1cb5c lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.199563:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1cb5c lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201238.199578:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6d8c995 reply state 00000000f8f54558 transno 124554051589 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1cb63 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.199588:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1cb63 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.199595:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff8dc005cc6400) 00010000:00010000:1.0:1788201238.199597:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201238.199600:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201238.199632:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fce00/0x96d0c9b8c9a1cb55 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869b4 expref: 20 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.199648:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1cb6a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869b4 expref: 19 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.199655:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff8dc005cc6b00) 00010000:00010000:1.0:1788201238.199657:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201238.199659:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e3800, rc 0) 00000100:00100000:1.0:1788201238.199734:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:73596:x1875060695438592:12345-192.168.201.20@tcp:101:touch.0 Request processed in 1297us (1846us total) trans 124554051589 rc 0/0 00000100:00100000:1.0:1788201238.199742:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1471 00000100:00100000:1.0:1788201238.221147:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.223847:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695438848 00000100:00100000:3.0:1788201238.223866:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695438848 00000100:00100000:3.0:1788201238.223940:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1472 00000100:00100000:3.0:1788201238.223951:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:73596:x1875060695438848:12345-192.168.201.20@tcp:36:touch.0 00010000:00010000:3.0:1788201238.224038:0:66312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201238.224065:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1cb6a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869b4 expref: 20 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.224082:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff8dc005cc6b00) 00010000:00010000:3.0:1788201238.224094:0:66312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201238.224156:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1cb78 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.224168:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1cb78 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.224178:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1cb78 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201238.226561:0:66312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000fc67db3 reply state 00000000d1c5c27e transno 124554051590 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1cb78 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.226587:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1cb78 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.226597:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff8dc11248cb00) 00010000:00010000:3.0:1788201238.226600:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201238.226603:0:66312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201238.226804:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+21:73596:x1875060695438848:12345-192.168.201.20@tcp:36:touch.0 Request processed in 2851us (5662us total) trans 124554051590 rc 0/0 00000100:00100000:3.0:1788201238.226813:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1472 00000100:00100000:3.0:1788201238.231711:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.231756:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695438976 00000100:00100000:3.0:1788201238.231766:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695438976 00000100:00100000:3.0:1788201238.231832:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1473 00000100:00100000:3.0:1788201238.231843:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+21:73596:x1875060695438976:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:3.0:1788201238.231868:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201238.231902:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cb7f lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7869bb expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.231970:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cb7f lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869bb expref: 22 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.231986:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cb7f lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869bb expref: 22 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.232007:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff8dc11248cb00) 00010000:00010000:3.0:1788201238.232011:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201238.232035:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58800, rc 0) 00000100:00100000:3.0:1788201238.232101:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:73596:x1875060695438976:12345-192.168.201.20@tcp:101:touch.0 Request processed in 260us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201238.232108:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1473 00000100:00100000:3.0:1788201238.243497:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.243541:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695439104 00000100:00100000:3.0:1788201238.243552:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695439104 00000100:00100000:3.0:1788201238.243605:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5931 00000100:00100000:3.0:1788201238.243628:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695439104:12345-192.168.201.20@tcp:2:touch.0 00000100:00100000:3.0:1788201238.243877:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695439104:12345-192.168.201.20@tcp:2:touch.0 Request processed in 241us (380us total) trans 4294969458 rc 0/0 00000100:00100000:3.0:1788201238.243885:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5931 00000100:00100000:2.0:1788201238.253510:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.253591:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695439360 00000100:00100000:3.0:1788201238.253602:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695439360 00000100:00100000:3.0:1788201238.253653:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 245 00000100:00100000:3.0:1788201238.253663:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107db7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:73596:x1875060695439360:12345-192.168.201.20@tcp:35:touch.0 00000100:00100000:3.0:1788201238.253966:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107db7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+23:73596:x1875060695439360:12345-192.168.201.20@tcp:35:touch.0 Request processed in 304us (467us total) trans 124554051591 rc 0/0 00000100:00100000:3.0:1788201238.253972:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 245 00000100:00100000:2.0:1788201238.258112:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.258803:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695439616 00000100:00100000:3.0:1788201238.258814:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695439616 00000100:00100000:3.0:1788201238.258879:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1474 00000100:00100000:3.0:1788201238.258889:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+23:73596:x1875060695439616:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:3.0:1788201238.258912:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201238.258933:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cb86 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7869c2 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.259073:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1cb8d lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.259089:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1cb8d lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.259101:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1cb8d lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.259145:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1cb94 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.259153:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1cb94 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.259160:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1cb94 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201238.259629:0:69485:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x383:0x0], index 0: 0 00010000:00010000:3.0:1788201238.259784:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1cb9b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.259794:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1cb9b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.259801:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1cb9b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.259834:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1cb8d lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.259842:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1cb8d lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.259849:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1cb8d lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.259856:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1cb8d lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.259861:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201238.259880:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1cb8d lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.259888:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1cb8d lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.259900:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:3.0:1788201238.259903:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201238.259907:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1cb8d lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.259915:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1cb8d lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201238.259929:0:69485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b4ed5ff reply state 00000000be1c5dad transno 124554051592 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1cb94 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.259941:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1cb94 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.259947:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff8dc11248c200) 00010000:00010000:3.0:1788201238.259949:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201238.259951:0:69485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788201238.259980:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cb86 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869c2 expref: 26 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.259994:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1cb9b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869c2 expref: 25 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.260002:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff8dc11248cc00) 00010000:00010000:3.0:1788201238.260004:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201238.260012:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59600, rc 0) 00000100:00100000:3.0:1788201238.260101:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+26:73596:x1875060695439616:12345-192.168.201.20@tcp:101:touch.0 Request processed in 1213us (1998us total) trans 124554051592 rc 0/0 00000100:00100000:3.0:1788201238.260109:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1474 00000100:00100000:3.0:1788201238.266630:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.266663:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695439872 00000100:00100000:3.0:1788201238.266672:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695439872 00000100:00100000:3.0:1788201238.266728:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1475 00000100:00100000:3.0:1788201238.266739:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+26:73596:x1875060695439872:12345-192.168.201.20@tcp:36:touch.0 00010000:00010000:3.0:1788201238.266803:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201238.266832:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1cb9b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869c2 expref: 26 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.266851:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff8dc11248cc00) 00010000:00010000:3.0:1788201238.266861:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201238.266927:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1cba9 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.266942:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1cba9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.266951:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1cba9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201238.267072:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bab6e65d reply state 00000000040fef67 transno 124554051593 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1cba9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.267081:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1cba9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.267094:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff8dc11248c900) 00010000:00010000:3.0:1788201238.267096:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201238.267098:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201238.267183:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+27:73596:x1875060695439872:12345-192.168.201.20@tcp:36:touch.0 Request processed in 445us (559us total) trans 124554051593 rc 0/0 00000100:00100000:3.0:1788201238.267190:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1475 00000100:00100000:2.0:1788201238.278438:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201238.280147:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695440000 00000100:00100000:1.0:1788201238.280159:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695440000 00000100:00100000:1.0:1788201238.280228:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1476 00000100:00100000:1.0:1788201238.280239:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+27:73596:x1875060695440000:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:1.0:1788201238.280269:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201238.280291:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2200/0x96d0c9b8c9a1cbb0 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7869c9 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.280749:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2200/0x96d0c9b8c9a1cbb0 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869c9 expref: 28 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.280766:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2200/0x96d0c9b8c9a1cbb0 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869c9 expref: 28 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.280786:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff8dc11248c900) 00010000:00010000:1.0:1788201238.280789:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201238.280794:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e2200, rc 0) 00000100:00100000:1.0:1788201238.280863:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+28:73596:x1875060695440000:12345-192.168.201.20@tcp:101:touch.0 Request processed in 626us (2433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201238.280879:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1476 00000100:00100000:0.0:1788201238.286300:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.286375:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695440128 00000100:00100000:3.0:1788201238.286384:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695440128 00000100:00100000:3.0:1788201238.286429:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5932 00000100:00100000:3.0:1788201238.286436:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695440128:12345-192.168.201.20@tcp:2:touch.0 00000100:00100000:3.0:1788201238.286612:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695440128:12345-192.168.201.20@tcp:2:touch.0 Request processed in 176us (320us total) trans 4294969459 rc 0/0 00000100:00100000:3.0:1788201238.286617:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5932 00010000:00010000:3.0:1788201238.288399:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201238.289986:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201238.291171:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695440384 00000100:00100000:0.0:1788201238.291185:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695440384 00000100:00100000:0.0:1788201238.291259:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 246 00000100:00100000:0.0:1788201238.291270:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+28:73596:x1875060695440384:12345-192.168.201.20@tcp:35:touch.0 00000100:00100000:0.0:1788201238.291561:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+29:73596:x1875060695440384:12345-192.168.201.20@tcp:35:touch.0 Request processed in 292us (1581us total) trans 124554051594 rc 0/0 00000100:00100000:0.0:1788201238.291568:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 246 00000100:00100000:2.0:1788201238.295857:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.295941:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695440640 00000100:00100000:3.0:1788201238.295951:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695440640 00000100:00100000:3.0:1788201238.296009:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1477 00000100:00100000:3.0:1788201238.296051:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+29:73596:x1875060695440640:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:3.0:1788201238.296073:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201238.296092:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1cbb7 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7869d0 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.296195:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cbbe lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.296216:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cbbe lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.296239:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cbbe lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.296254:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1cbc5 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.296261:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1cbc5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.296267:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1cbc5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201238.296529:0:66312:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x384:0x0], index 0: 0 00010000:00010000:3.0:1788201238.296642:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1cbcc lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.296651:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1cbcc lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.296657:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1cbcc lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.296684:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cbbe lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.296691:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cbbe lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.296698:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cbbe lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.296704:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cbbe lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.296717:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201238.296722:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cbbe lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.296730:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cbbe lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.296743:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:3.0:1788201238.296746:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201238.296751:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cbbe lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.296757:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cbbe lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201238.296771:0:66312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000022c89ba6 reply state 000000001cb2c429 transno 124554051595 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1cbc5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.296782:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1cbc5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.296788:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff8dc11248cc00) 00010000:00010000:3.0:1788201238.296791:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201238.296793:0:66312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788201238.296819:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1cbb7 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869d0 expref: 32 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.296832:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1cbcc lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869d0 expref: 31 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.296850:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff8dc11248c400) 00010000:00010000:3.0:1788201238.296852:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201238.296855:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58000, rc 0) 00000100:00100000:3.0:1788201238.296920:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+32:73596:x1875060695440640:12345-192.168.201.20@tcp:101:touch.0 Request processed in 871us (1072us total) trans 124554051595 rc 0/0 00000100:00100000:3.0:1788201238.296928:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1477 00000100:00100000:0.0:1788201238.301129:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.301223:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695440896 00000100:00100000:3.0:1788201238.301233:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695440896 00000100:00100000:3.0:1788201238.301338:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1478 00000100:00100000:3.0:1788201238.301349:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+32:73596:x1875060695440896:12345-192.168.201.20@tcp:36:touch.0 00010000:00010000:3.0:1788201238.301405:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201238.301429:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1cbcc lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869d0 expref: 32 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.301448:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff8dc11248c400) 00010000:00010000:3.0:1788201238.301459:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201238.301509:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1cbda lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.301524:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1cbda lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.301532:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1cbda lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201238.301646:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045efcc95 reply state 00000000e8538354 transno 124554051596 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1cbda lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.301675:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1cbda lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.301681:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff8dc11248c300) 00010000:00010000:3.0:1788201238.301683:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201238.301686:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201238.301780:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+33:73596:x1875060695440896:12345-192.168.201.20@tcp:36:touch.0 Request processed in 433us (660us total) trans 124554051596 rc 0/0 00000100:00100000:3.0:1788201238.301788:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1478 00000100:00100000:1.0:1788201238.305011:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.305172:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695441024 00000100:00100000:3.0:1788201238.305193:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695441024 00000100:00100000:3.0:1788201238.305263:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1479 00000100:00100000:3.0:1788201238.305273:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+33:73596:x1875060695441024:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:3.0:1788201238.305294:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201238.305315:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031e00/0x96d0c9b8c9a1cbe1 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7869d7 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.305370:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031e00/0x96d0c9b8c9a1cbe1 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869d7 expref: 34 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.305385:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031e00/0x96d0c9b8c9a1cbe1 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869d7 expref: 34 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.305405:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff8dc11248c300) 00010000:00010000:3.0:1788201238.305407:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201238.305411:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc100031e00, rc 0) 00000100:00100000:3.0:1788201238.305464:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+34:73596:x1875060695441024:12345-192.168.201.20@tcp:101:touch.0 Request processed in 193us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201238.305484:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1479 00000100:00100000:3.0:1788201238.309184:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201238.309289:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695441152 00000100:00100000:0.0:1788201238.309299:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695441152 00000100:00100000:0.0:1788201238.309359:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5933 00000100:00100000:0.0:1788201238.309371:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2400:x1875060695441152:12345-192.168.201.20@tcp:2:touch.0 00000100:00100000:0.0:1788201238.309574:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2400:x1875060695441152:12345-192.168.201.20@tcp:2:touch.0 Request processed in 205us (409us total) trans 4294969460 rc 0/0 00000100:00100000:0.0:1788201238.309581:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5933 00000100:00100000:3.0:1788201238.312602:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201238.313198:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695441408 00000100:00100000:2.0:1788201238.313215:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695441408 00000100:00100000:2.0:1788201238.313266:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 247 00000100:00100000:2.0:1788201238.313277:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+34:73596:x1875060695441408:12345-192.168.201.20@tcp:35:touch.0 00000100:00100000:2.0:1788201238.313517:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+35:73596:x1875060695441408:12345-192.168.201.20@tcp:35:touch.0 Request processed in 241us (923us total) trans 124554051597 rc 0/0 00000100:00100000:2.0:1788201238.313525:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 247 00000100:00100000:1.0:1788201238.316943:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201238.317065:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695441664 00000100:00100000:0.0:1788201238.317077:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695441664 00000100:00100000:0.0:1788201238.317130:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1480 00000100:00100000:0.0:1788201238.317141:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+35:73596:x1875060695441664:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:0.0:1788201238.317165:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201238.317188:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cbe8 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7869de expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.317325:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1cbef lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.317339:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1cbef lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.317349:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1cbef lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.317363:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1cbf6 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.317369:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1cbf6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.317375:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1cbf6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201238.317676:0:66313:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x385:0x0], index 0: 0 00010000:00010000:0.0:1788201238.317810:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cbfd lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.317819:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cbfd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.317826:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cbfd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.317856:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1cbef lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.317885:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1cbef lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.317890:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1cbef lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.317896:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1cbef lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.317902:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896bc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201238.317906:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1cbef lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.317913:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1cbef lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.317924:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201238.317927:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201238.317931:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1cbef lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.317936:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1cbef lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201238.317948:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025b50c5a reply state 000000005b3a47c1 transno 124554051598 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1cbf6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.317958:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1cbf6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.317964:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff8dc0048bec00) 00010000:00010000:0.0:1788201238.317972:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201238.317974:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201238.318004:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cbe8 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869de expref: 38 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.318068:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cbfd lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869de expref: 37 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.318075:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff8dc0048be200) 00010000:00010000:0.0:1788201238.318078:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201238.318080:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896ae00, rc 0) 00000100:00100000:0.0:1788201238.318150:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+38:73596:x1875060695441664:12345-192.168.201.20@tcp:101:touch.0 Request processed in 1011us (1218us total) trans 124554051598 rc 0/0 00000100:00100000:0.0:1788201238.318158:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1480 00000100:00100000:0.0:1788201238.322325:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.322410:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695441920 00000100:00100000:3.0:1788201238.322420:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695441920 00000100:00100000:3.0:1788201238.322474:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1481 00000100:00100000:3.0:1788201238.322485:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0073b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+38:73596:x1875060695441920:12345-192.168.201.20@tcp:36:touch.0 00010000:00010000:3.0:1788201238.322540:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201238.322569:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cbfd lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869de expref: 38 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.322588:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff8dc0048be200) 00010000:00010000:3.0:1788201238.322599:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201238.322663:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1cc0b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.322676:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1cc0b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.322686:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1cc0b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201238.322800:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d94088ef reply state 00000000ddc7d2d1 transno 124554051599 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1cc0b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.322812:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1cc0b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.322819:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff8dc11248c400) 00010000:00010000:3.0:1788201238.322835:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201238.322838:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201238.322942:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0073b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+39:73596:x1875060695441920:12345-192.168.201.20@tcp:36:touch.0 Request processed in 457us (624us total) trans 124554051599 rc 0/0 00000100:00100000:3.0:1788201238.322949:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1481 00000100:00100000:3.0:1788201238.326296:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201238.326366:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695442048 00000100:00100000:0.0:1788201238.326377:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695442048 00000100:00100000:0.0:1788201238.326440:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1482 00000100:00100000:0.0:1788201238.326451:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+39:73596:x1875060695442048:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:0.0:1788201238.326471:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201238.326489:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b800/0x96d0c9b8c9a1cc12 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7869e5 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.326544:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b800/0x96d0c9b8c9a1cc12 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869e5 expref: 40 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.326557:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b800/0x96d0c9b8c9a1cc12 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869e5 expref: 40 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.326595:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff8dc11248c400) 00010000:00010000:0.0:1788201238.326598:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201238.326602:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896b800, rc 0) 00000100:00100000:0.0:1788201238.326670:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+40:73596:x1875060695442048:12345-192.168.201.20@tcp:101:touch.0 Request processed in 220us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201238.326676:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1482 00000100:00100000:0.0:1788201238.329608:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.329857:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695442176 00000100:00100000:3.0:1788201238.329876:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695442176 00000100:00100000:3.0:1788201238.329941:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5934 00000100:00100000:3.0:1788201238.329953:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2401:x1875060695442176:12345-192.168.201.20@tcp:2:touch.0 00000100:00100000:3.0:1788201238.330731:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2401:x1875060695442176:12345-192.168.201.20@tcp:2:touch.0 Request processed in 776us (1128us total) trans 4294969461 rc 0/0 00000100:00100000:3.0:1788201238.330742:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5934 00000100:00100000:2.0:1788201238.333460:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.333536:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695442432 00000100:00100000:3.0:1788201238.333546:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695442432 00000100:00100000:3.0:1788201238.333604:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 248 00000100:00100000:3.0:1788201238.333615:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+40:73596:x1875060695442432:12345-192.168.201.20@tcp:35:touch.0 00000100:00100000:3.0:1788201238.333930:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+41:73596:x1875060695442432:12345-192.168.201.20@tcp:35:touch.0 Request processed in 317us (480us total) trans 124554051600 rc 0/0 00000100:00100000:3.0:1788201238.333937:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 248 00000100:00100000:0.0:1788201238.337819:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201238.337926:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695442688 00000100:00100000:1.0:1788201238.337937:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695442688 00000100:00100000:1.0:1788201238.337992:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1483 00000100:00100000:1.0:1788201238.338002:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00586d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+41:73596:x1875060695442688:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:1.0:1788201238.338075:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201238.338097:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1cc19 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7869ec expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.338201:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1cc20 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.338226:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1cc20 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.338238:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1cc20 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.338254:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2800/0x96d0c9b8c9a1cc27 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.338261:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2800/0x96d0c9b8c9a1cc27 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.338269:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2800/0x96d0c9b8c9a1cc27 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201238.338538:0:66757:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x386:0x0], index 0: 0 00010000:00010000:0.0:1788201238.339729:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1cc2e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.339744:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1cc2e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.339754:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1cc2e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.339798:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1cc20 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.339807:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1cc20 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.339813:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1cc20 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.339819:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1cc20 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.339824:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3e00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201238.339841:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1cc20 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.339848:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1cc20 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.339861:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201238.339864:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201238.339878:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1cc20 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.339885:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1cc20 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201238.339900:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006f8a491 reply state 000000007bcc6632 transno 124554051601 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2800/0x96d0c9b8c9a1cc27 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.339912:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2800/0x96d0c9b8c9a1cc27 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.339919:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff8dc005cc6a00) 00010000:00010000:0.0:1788201238.339921:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201238.339924:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201238.339958:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1cc19 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869ec expref: 44 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.339973:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1cc2e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869ec expref: 43 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.339980:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff8dc0048be900) 00010000:00010000:0.0:1788201238.339983:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201238.339992:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896bc00, rc 0) 00000100:00100000:0.0:1788201238.342384:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00586d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+44:73596:x1875060695442688:12345-192.168.201.20@tcp:101:touch.0 Request processed in 4371us (4563us total) trans 124554051601 rc 0/0 00000100:00100000:0.0:1788201238.342397:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1483 00000100:00100000:1.0:1788201238.346452:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.346607:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695442944 00000100:00100000:3.0:1788201238.346618:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695442944 00000100:00100000:3.0:1788201238.346691:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1484 00000100:00100000:3.0:1788201238.346703:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+44:73596:x1875060695442944:12345-192.168.201.20@tcp:36:touch.0 00010000:00010000:3.0:1788201238.346764:0:69485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201238.346790:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1cc2e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869ec expref: 44 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.346823:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff8dc0048be900) 00010000:00010000:3.0:1788201238.346834:0:69485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201238.346896:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030000/0x96d0c9b8c9a1cc3c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.346909:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030000/0x96d0c9b8c9a1cc3c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.346919:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030000/0x96d0c9b8c9a1cc3c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201238.347241:0:69485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8ced091 reply state 00000000eb6e5890 transno 124554051602 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030000/0x96d0c9b8c9a1cc3c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.347254:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030000/0x96d0c9b8c9a1cc3c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.347261:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff8dc11248c800) 00010000:00010000:3.0:1788201238.347264:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201238.347267:0:69485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201238.347415:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+45:73596:x1875060695442944:12345-192.168.201.20@tcp:36:touch.0 Request processed in 714us (971us total) trans 124554051602 rc 0/0 00000100:00100000:3.0:1788201238.347424:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1484 00000100:00100000:1.0:1788201238.351275:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.351424:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695443072 00000100:00100000:3.0:1788201238.351436:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695443072 00000100:00100000:3.0:1788201238.351500:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1485 00000100:00100000:3.0:1788201238.351511:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+45:73596:x1875060695443072:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:3.0:1788201238.351536:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201238.351569:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1cc43 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7869f3 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.351630:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1cc43 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869f3 expref: 46 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.351657:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1cc43 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869f3 expref: 46 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.351675:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff8dc11248c800) 00010000:00010000:3.0:1788201238.351678:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201238.351682:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc100030800, rc 0) 00000100:00100000:3.0:1788201238.351741:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+46:73596:x1875060695443072:12345-192.168.201.20@tcp:101:touch.0 Request processed in 232us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201238.351749:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1485 00000100:00100000:2.0:1788201238.354848:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.354938:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695443200 00000100:00100000:3.0:1788201238.354948:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695443200 00000100:00100000:3.0:1788201238.355004:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5935 00000100:00100000:3.0:1788201238.355052:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2400:x1875060695443200:12345-192.168.201.20@tcp:2:touch.0 00000100:00100000:3.0:1788201238.355281:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2400:x1875060695443200:12345-192.168.201.20@tcp:2:touch.0 Request processed in 267us (441us total) trans 4294969462 rc 0/0 00000100:00100000:3.0:1788201238.355289:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5935 00000100:00100000:1.0:1788201238.358338:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201238.358428:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695443456 00000100:00100000:2.0:1788201238.358438:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695443456 00000100:00100000:2.0:1788201238.358504:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 249 00000100:00100000:2.0:1788201238.358514:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+46:73596:x1875060695443456:12345-192.168.201.20@tcp:35:touch.0 00000100:00100000:2.0:1788201238.358854:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+47:73596:x1875060695443456:12345-192.168.201.20@tcp:35:touch.0 Request processed in 340us (522us total) trans 124554051603 rc 0/0 00000100:00100000:2.0:1788201238.358862:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 249 00000100:00100000:1.0:1788201238.363576:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201238.363725:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695443712 00000100:00100000:0.0:1788201238.363734:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695443712 00000100:00100000:0.0:1788201238.363815:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1486 00000100:00100000:0.0:1788201238.363825:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+47:73596:x1875060695443712:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:0.0:1788201238.363847:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201238.363881:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1cc4a lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7869fa expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.363991:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cc51 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.364006:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cc51 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.364418:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cc51 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.364436:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cc58 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.364444:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cc58 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.364450:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cc58 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201238.364840:0:66757:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x387:0x0], index 0: 0 00010000:00010000:0.0:1788201238.364993:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1cc5f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.365003:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1cc5f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.365010:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1cc5f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.365063:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cc51 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.365070:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cc51 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.365077:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cc51 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.365084:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cc51 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.365091:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896ae00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201238.365095:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cc51 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.365102:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cc51 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.365114:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201238.365117:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201238.365121:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cc51 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.365138:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cc51 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201238.365152:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea03000e reply state 00000000e17092b5 transno 124554051604 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cc58 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.365161:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cc58 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.365167:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff8dc0048be600) 00010000:00010000:0.0:1788201238.365168:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201238.365170:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201238.365324:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1cc4a lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869fa expref: 50 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.365339:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1cc5f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869fa expref: 49 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.365345:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff8dc0048be000) 00010000:00010000:0.0:1788201238.365348:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201238.365350:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896a600, rc 0) 00000100:00100000:0.0:1788201238.365475:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+50:73596:x1875060695443712:12345-192.168.201.20@tcp:101:touch.0 Request processed in 1650us (1908us total) trans 124554051604 rc 0/0 00000100:00100000:0.0:1788201238.365483:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1486 00000100:00100000:1.0:1788201238.369360:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201238.369488:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695443968 00000100:00100000:0.0:1788201238.369498:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695443968 00000100:00100000:0.0:1788201238.369598:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1487 00000100:00100000:0.0:1788201238.369610:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+50:73596:x1875060695443968:12345-192.168.201.20@tcp:36:touch.0 00010000:00010000:0.0:1788201238.369696:0:69485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201238.369723:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1cc5f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869fa expref: 50 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.369741:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff8dc0048be000) 00010000:00010000:0.0:1788201238.369753:0:69485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201238.369811:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1cc6d lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.369825:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1cc6d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.369835:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1cc6d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201238.369955:0:69485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb67b991 reply state 00000000d9a129ad transno 124554051605 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1cc6d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.369968:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1cc6d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.369974:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff8dc0048be700) 00010000:00010000:0.0:1788201238.369977:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201238.369979:0:69485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201238.370093:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:73596:x1875060695443968:12345-192.168.201.20@tcp:36:touch.0 Request processed in 485us (743us total) trans 124554051605 rc 0/0 00000100:00100000:0.0:1788201238.370100:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1487 00000100:00100000:1.0:1788201238.373087:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.373176:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695444096 00000100:00100000:3.0:1788201238.373198:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695444096 00000100:00100000:3.0:1788201238.373258:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1488 00000100:00100000:3.0:1788201238.373269:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:73596:x1875060695444096:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:3.0:1788201238.373292:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201238.373328:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030e00/0x96d0c9b8c9a1cc74 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786a01 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.373391:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030e00/0x96d0c9b8c9a1cc74 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a01 expref: 52 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.373405:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030e00/0x96d0c9b8c9a1cc74 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a01 expref: 52 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.373424:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff8dc0048be700) 00010000:00010000:3.0:1788201238.373427:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201238.373431:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc100030e00, rc 0) 00000100:00100000:3.0:1788201238.373495:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+52:73596:x1875060695444096:12345-192.168.201.20@tcp:101:touch.0 Request processed in 228us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201238.373502:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1488 00000100:00100000:1.0:1788201238.376189:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201238.376342:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695444224 00000100:00100000:2.0:1788201238.376353:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695444224 00000100:00100000:2.0:1788201238.376401:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5936 00000100:00100000:2.0:1788201238.376410:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2401:x1875060695444224:12345-192.168.201.20@tcp:2:touch.0 00000100:00100000:2.0:1788201238.376612:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2401:x1875060695444224:12345-192.168.201.20@tcp:2:touch.0 Request processed in 201us (441us total) trans 4294969463 rc 0/0 00000100:00100000:2.0:1788201238.376619:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5936 00000100:00100000:2.0:1788201238.379409:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201238.379483:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695444480 00000100:00100000:0.0:1788201238.379492:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695444480 00000100:00100000:0.0:1788201238.379552:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 250 00000100:00100000:0.0:1788201238.379575:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+52:73596:x1875060695444480:12345-192.168.201.20@tcp:35:touch.0 00000100:00100000:0.0:1788201238.379855:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+53:73596:x1875060695444480:12345-192.168.201.20@tcp:35:touch.0 Request processed in 281us (454us total) trans 124554051606 rc 0/0 00000100:00100000:0.0:1788201238.379864:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 250 00000100:00100000:2.0:1788201238.383971:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201238.384092:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695444736 00000100:00100000:0.0:1788201238.384102:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695444736 00000100:00100000:0.0:1788201238.384163:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1489 00000100:00100000:0.0:1788201238.384182:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+53:73596:x1875060695444736:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:0.0:1788201238.384214:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201238.384237:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1cc7b lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786a08 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.384339:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1cc82 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.384354:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1cc82 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.384364:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1cc82 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.384379:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1cc89 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.384386:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1cc89 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.384393:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1cc89 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201238.384708:0:66757:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x388:0x0], index 0: 0 00010000:00010000:0.0:1788201238.384833:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1cc90 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.384841:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1cc90 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.384849:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1cc90 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.384888:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1cc82 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.384896:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1cc82 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.384902:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1cc82 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.384908:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1cc82 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.384913:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201238.384918:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1cc82 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.384926:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1cc82 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.384938:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201238.384940:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201238.384951:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1cc82 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.384958:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1cc82 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201238.384971:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008bd8d666 reply state 000000009ae911d1 transno 124554051607 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1cc89 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.384983:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1cc89 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.384989:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff8dc0048be000) 00010000:00010000:0.0:1788201238.384991:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201238.384994:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201238.385384:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1cc7b lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a08 expref: 56 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.385399:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1cc90 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a08 expref: 55 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.385407:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff8dc0048be500) 00010000:00010000:0.0:1788201238.385410:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201238.385412:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3200, rc 0) 00000100:00100000:2.0:1788201238.385918:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+56:73596:x1875060695444736:12345-192.168.201.20@tcp:101:touch.0 Request processed in 1744us (1955us total) trans 124554051607 rc 0/0 00000100:00100000:2.0:1788201238.385927:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1489 00000100:00100000:1.0:1788201238.390227:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.390599:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695444992 00000100:00100000:3.0:1788201238.390610:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695444992 00000100:00100000:3.0:1788201238.390762:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1490 00000100:00100000:3.0:1788201238.390772:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+56:73596:x1875060695444992:12345-192.168.201.20@tcp:36:touch.0 00010000:00010000:3.0:1788201238.390824:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201238.390848:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1cc90 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a08 expref: 56 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.390892:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff8dc0048be500) 00010000:00010000:3.0:1788201238.390904:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201238.390965:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1cc9e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.390997:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1cc9e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.391006:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1cc9e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201238.391151:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051b938d6 reply state 00000000060cd644 transno 124554051608 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1cc9e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.391164:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1cc9e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.391171:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff8dc11248ce00) 00010000:00010000:3.0:1788201238.391185:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201238.391188:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201238.391289:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+57:73596:x1875060695444992:12345-192.168.201.20@tcp:36:touch.0 Request processed in 518us (1072us total) trans 124554051608 rc 0/0 00000100:00100000:3.0:1788201238.391296:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1490 00000100:00100000:1.0:1788201238.394575:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201238.394777:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695445120 00000100:00100000:0.0:1788201238.394788:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695445120 00000100:00100000:0.0:1788201238.394880:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1491 00000100:00100000:0.0:1788201238.394890:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+57:73596:x1875060695445120:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:0.0:1788201238.394912:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201238.394934:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1cca5 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786a0f expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.395000:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1cca5 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a0f expref: 58 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.395032:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1cca5 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a0f expref: 58 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.395051:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff8dc11248ce00) 00010000:00010000:0.0:1788201238.395053:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201238.395057:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2200, rc 0) 00000100:00100000:0.0:1788201238.395152:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+58:73596:x1875060695445120:12345-192.168.201.20@tcp:101:touch.0 Request processed in 263us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201238.395159:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1491 00000100:00100000:2.0:1788201238.398448:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201238.398536:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695445248 00000100:00100000:0.0:1788201238.398545:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695445248 00000100:00100000:0.0:1788201238.398620:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5937 00000100:00100000:0.0:1788201238.398684:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2400:x1875060695445248:12345-192.168.201.20@tcp:2:touch.0 00000100:00100000:0.0:1788201238.398958:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2400:x1875060695445248:12345-192.168.201.20@tcp:2:touch.0 Request processed in 329us (518us total) trans 4294969464 rc 0/0 00000100:00100000:0.0:1788201238.398966:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5937 00000100:00100000:1.0:1788201238.402728:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.402840:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695445504 00000100:00100000:3.0:1788201238.402850:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695445504 00000100:00100000:3.0:1788201238.402912:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 251 00000100:00100000:3.0:1788201238.402923:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107db4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+58:73596:x1875060695445504:12345-192.168.201.20@tcp:35:touch.0 00000100:00100000:3.0:1788201238.403270:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107db4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:73596:x1875060695445504:12345-192.168.201.20@tcp:35:touch.0 Request processed in 348us (561us total) trans 124554051609 rc 0/0 00000100:00100000:3.0:1788201238.403278:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 251 00000100:00100000:1.0:1788201238.407473:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201238.407559:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695445760 00000100:00100000:2.0:1788201238.407569:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695445760 00000100:00100000:2.0:1788201238.407625:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1492 00000100:00100000:2.0:1788201238.407641:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:73596:x1875060695445760:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:2.0:1788201238.407666:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201238.407686:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1ccac lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786a16 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.407813:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1ccb3 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.407828:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1ccb3 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.407839:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1ccb3 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.407854:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1ccba lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.407861:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1ccba lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.407878:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1ccba lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201238.408227:0:66757:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x389:0x0], index 0: 0 00010000:00010000:2.0:1788201238.408358:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1ccc1 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.408367:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1ccc1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.408375:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1ccc1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.408407:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1ccb3 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.408427:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1ccb3 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.408434:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1ccb3 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.408441:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1ccb3 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.408446:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201238.408451:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1ccb3 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.408459:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1ccb3 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.408471:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201238.408474:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201238.408478:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1ccb3 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.408484:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1ccb3 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201238.408497:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e51e6c81 reply state 000000002cd84a94 transno 124554051610 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1ccba lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.408507:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1ccba lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.408513:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff8dc12196e700) 00010000:00010000:2.0:1788201238.408520:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201238.408522:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201238.408550:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1ccac lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a16 expref: 62 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.408563:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1ccc1 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a16 expref: 61 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.408570:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff8dc12196ec00) 00010000:00010000:2.0:1788201238.408572:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201238.408574:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ade000, rc 0) 00000100:00100000:2.0:1788201238.408629:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+62:73596:x1875060695445760:12345-192.168.201.20@tcp:101:touch.0 Request processed in 996us (1165us total) trans 124554051610 rc 0/0 00000100:00100000:2.0:1788201238.408637:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1492 00000100:00100000:2.0:1788201238.413951:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.414167:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695446016 00000100:00100000:3.0:1788201238.414584:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695446016 00000100:00100000:0.0:1788201238.414827:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1493 00000100:00100000:0.0:1788201238.414839:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+62:73596:x1875060695446016:12345-192.168.201.20@tcp:36:touch.0 00010000:00010000:0.0:1788201238.414906:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201238.414932:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1ccc1 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a16 expref: 62 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.414968:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff8dc12196ec00) 00010000:00010000:0.0:1788201238.414979:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201238.415080:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1cccf lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.415093:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1cccf lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.415102:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1cccf lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201238.415364:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c90aa1b3 reply state 00000000f8dfb703 transno 124554051611 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1cccf lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.415377:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1cccf lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.415383:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff8dc0048be500) 00010000:00010000:0.0:1788201238.415386:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201238.415388:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201238.415525:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+63:73596:x1875060695446016:12345-192.168.201.20@tcp:36:touch.0 Request processed in 687us (1583us total) trans 124554051611 rc 0/0 00000100:00100000:0.0:1788201238.415533:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1493 00000100:00100000:0.0:1788201238.418932:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.419357:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695446144 00000100:00100000:3.0:1788201238.419384:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695446144 00000100:00100000:0.0:1788201238.419505:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1494 00000100:00100000:0.0:1788201238.419516:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+63:73596:x1875060695446144:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:0.0:1788201238.419542:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201238.419564:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ccd6 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786a1d expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.419759:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ccd6 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a1d expref: 64 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.419776:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ccd6 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a1d expref: 64 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.419796:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff8dc0048be500) 00010000:00010000:0.0:1788201238.419799:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201238.419802:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3c00, rc 0) 00000100:00100000:0.0:1788201238.419873:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+64:73596:x1875060695446144:12345-192.168.201.20@tcp:101:touch.0 Request processed in 351us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201238.419881:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1494 00000100:00100000:3.0:1788201238.422626:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201238.422895:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695446272 00000100:00100000:2.0:1788201238.422906:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695446272 00000100:00100000:2.0:1788201238.422969:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5938 00000100:00100000:2.0:1788201238.422979:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2400:x1875060695446272:12345-192.168.201.20@tcp:2:touch.0 00000100:00100000:2.0:1788201238.423525:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:2400:x1875060695446272:12345-192.168.201.20@tcp:2:touch.0 Request processed in 546us (907us total) trans 4294969465 rc 0/0 00000100:00100000:2.0:1788201238.423534:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5938 00000100:00100000:2.0:1788201238.426549:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.426703:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695446528 00000100:00100000:3.0:1788201238.426716:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695446528 00000100:00100000:3.0:1788201238.426813:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 252 00000100:00100000:3.0:1788201238.426825:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+64:73596:x1875060695446528:12345-192.168.201.20@tcp:35:touch.0 00000100:00100000:3.0:1788201238.427155:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+65:73596:x1875060695446528:12345-192.168.201.20@tcp:35:touch.0 Request processed in 332us (616us total) trans 124554051612 rc 0/0 00000100:00100000:3.0:1788201238.427163:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 252 00000100:00100000:0.0:1788201238.430406:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201238.430510:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695446784 00000100:00100000:1.0:1788201238.430521:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695446784 00000100:00100000:1.0:1788201238.430584:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1495 00000100:00100000:1.0:1788201238.430595:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+65:73596:x1875060695446784:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:1.0:1788201238.430623:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201238.430655:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1ccdd lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786a24 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.430765:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cce4 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.430780:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cce4 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.430791:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cce4 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.430819:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1cceb lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.430827:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1cceb lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.430835:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1cceb lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201238.431167:0:66312:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x38a:0x0], index 0: 0 00010000:00010000:1.0:1788201238.436465:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ccf2 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.436489:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ccf2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.436500:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ccf2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.436547:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cce4 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.436554:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cce4 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.436559:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cce4 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.436567:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cce4 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.436573:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201238.436577:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cce4 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.436585:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cce4 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.436597:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:1.0:1788201238.436600:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201238.436604:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cce4 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.436697:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cce4 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201238.436719:0:66312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c9c97ad reply state 00000000ae6a0301 transno 124554051613 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1cceb lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.436732:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1cceb lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.436739:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff8dc005cc6100) 00010000:00010000:1.0:1788201238.436741:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201238.436744:0:66312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201238.436785:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1ccdd lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a24 expref: 68 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.436801:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ccf2 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a24 expref: 67 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.436809:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff8dc005cc6200) 00010000:00010000:1.0:1788201238.436811:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201238.436813:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e2c00, rc 0) 00000100:00100000:1.0:1788201238.436900:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+68:73596:x1875060695446784:12345-192.168.201.20@tcp:101:touch.0 Request processed in 6306us (6502us total) trans 124554051613 rc 0/0 00000100:00100000:1.0:1788201238.436908:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1495 00000100:00100000:0.0:1788201238.440546:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201238.440681:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695447040 00000100:00100000:1.0:1788201238.440692:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695447040 00000100:00100000:1.0:1788201238.440757:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1496 00000100:00100000:1.0:1788201238.440769:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+68:73596:x1875060695447040:12345-192.168.201.20@tcp:36:touch.0 00010000:00010000:1.0:1788201238.440843:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201238.440893:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ccf2 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a24 expref: 68 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.440913:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff8dc005cc6200) 00010000:00010000:1.0:1788201238.440924:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201238.440976:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1cd00 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.440990:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1cd00 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.441000:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1cd00 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201238.441127:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b11f85c6 reply state 0000000034287d3d transno 124554051614 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1cd00 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.441140:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1cd00 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.441146:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff8dc005cc6c00) 00010000:00010000:1.0:1788201238.441149:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201238.441152:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201238.441481:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+69:73596:x1875060695447040:12345-192.168.201.20@tcp:36:touch.0 Request processed in 712us (943us total) trans 124554051614 rc 0/0 00000100:00100000:1.0:1788201238.441488:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1496 00000100:00100000:0.0:1788201238.444429:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201238.444591:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695447168 00000100:00100000:1.0:1788201238.444601:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695447168 00000100:00100000:1.0:1788201238.444660:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1497 00000100:00100000:1.0:1788201238.444683:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+69:73596:x1875060695447168:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:1.0:1788201238.444707:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201238.444727:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1cd07 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786a2b expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.444785:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1cd07 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a2b expref: 70 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.444800:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1cd07 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a2b expref: 70 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.444821:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff8dc005cc6c00) 00010000:00010000:1.0:1788201238.444823:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201238.444827:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e3e00, rc 0) 00000100:00100000:1.0:1788201238.444894:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+70:73596:x1875060695447168:12345-192.168.201.20@tcp:101:touch.0 Request processed in 213us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201238.444901:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1497 00000100:00100000:1.0:1788201238.448107:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.448477:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695447296 00000100:00100000:3.0:1788201238.448489:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695447296 00000100:00100000:3.0:1788201238.448549:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5939 00000100:00100000:3.0:1788201238.448560:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:2400:x1875060695447296:12345-192.168.201.20@tcp:2:touch.0 00000100:00100000:3.0:1788201238.448886:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2400:x1875060695447296:12345-192.168.201.20@tcp:2:touch.0 Request processed in 327us (787us total) trans 4294969466 rc 0/0 00000100:00100000:3.0:1788201238.448894:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5939 00000100:00100000:0.0:1788201238.452821:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.452917:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695447552 00000100:00100000:3.0:1788201238.452929:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695447552 00000100:00100000:3.0:1788201238.452989:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 253 00000100:00100000:3.0:1788201238.453001:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+70:73596:x1875060695447552:12345-192.168.201.20@tcp:35:touch.0 00000100:00100000:3.0:1788201238.453337:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+71:73596:x1875060695447552:12345-192.168.201.20@tcp:35:touch.0 Request processed in 337us (526us total) trans 124554051615 rc 0/0 00000100:00100000:3.0:1788201238.453345:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 253 00000100:00100000:0.0:1788201238.457445:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201238.457533:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695447808 00000100:00100000:1.0:1788201238.457544:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695447808 00000100:00100000:1.0:1788201238.457600:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1498 00000100:00100000:1.0:1788201238.457610:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+71:73596:x1875060695447808:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:1.0:1788201238.457643:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201238.457663:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1cd0e lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786a32 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.457758:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1cd15 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.457783:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1cd15 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.457794:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1cd15 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.457806:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cd1c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.457812:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cd1c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.457818:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cd1c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201238.458192:0:66312:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x38b:0x0], index 0: 0 00010000:00010000:2.0:1788201238.458660:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1cd23 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.458672:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1cd23 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.458692:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1cd23 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.458732:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1cd15 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.458740:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1cd15 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.458746:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1cd15 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.458753:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1cd15 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.458760:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201238.458764:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1cd15 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.458772:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1cd15 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.458785:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201238.458789:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201238.458793:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1cd15 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.458799:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1cd15 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201238.458813:0:66312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dad8dd89 reply state 00000000b7d3fa4f transno 124554051616 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cd1c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.458834:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cd1c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.458840:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff8dc005cc6200) 00010000:00010000:2.0:1788201238.458843:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201238.458846:0:66312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201238.458888:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1cd0e lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a32 expref: 74 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.458903:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1cd23 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a32 expref: 73 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.458911:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff8dc12196e200) 00010000:00010000:2.0:1788201238.458913:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201238.458916:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007adfc00, rc 0) 00000100:00100000:2.0:1788201238.458988:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+74:73596:x1875060695447808:12345-192.168.201.20@tcp:101:touch.0 Request processed in 1379us (1550us total) trans 124554051616 rc 0/0 00000100:00100000:2.0:1788201238.458997:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1498 00000100:00100000:0.0:1788201238.463515:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201238.463711:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695448064 00000100:00100000:1.0:1788201238.463722:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695448064 00000100:00100000:1.0:1788201238.463780:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1499 00000100:00100000:1.0:1788201238.463791:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+74:73596:x1875060695448064:12345-192.168.201.20@tcp:36:touch.0 00010000:00010000:1.0:1788201238.463848:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201238.463884:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1cd23 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a32 expref: 74 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.463903:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff8dc12196e200) 00010000:00010000:1.0:1788201238.463915:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201238.463971:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1cd31 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.464001:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1cd31 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.464011:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1cd31 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201238.464757:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed667799 reply state 00000000d89a53e6 transno 124554051617 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1cd31 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.464772:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1cd31 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.464780:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff8dc005cc6f00) 00010000:00010000:1.0:1788201238.464782:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201238.464785:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201238.464935:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+75:73596:x1875060695448064:12345-192.168.201.20@tcp:36:touch.0 Request processed in 1144us (1428us total) trans 124554051617 rc 0/0 00000100:00100000:1.0:1788201238.464943:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1499 00000100:00100000:0.0:1788201238.468707:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.468804:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695448192 00000100:00100000:3.0:1788201238.468814:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695448192 00000100:00100000:3.0:1788201238.468919:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1500 00000100:00100000:3.0:1788201238.468947:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+75:73596:x1875060695448192:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:3.0:1788201238.468971:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201238.468991:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1cd38 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786a39 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.469082:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1cd38 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a39 expref: 76 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.469097:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1cd38 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a39 expref: 76 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.469116:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff8dc005cc6f00) 00010000:00010000:3.0:1788201238.469119:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201238.469123:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59600, rc 0) 00000100:00100000:3.0:1788201238.469188:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+76:73596:x1875060695448192:12345-192.168.201.20@tcp:101:touch.0 Request processed in 244us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201238.469196:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1500 00000100:00100000:0.0:1788201238.472606:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201238.472758:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695448320 00000100:00100000:1.0:1788201238.472768:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695448320 00000100:00100000:1.0:1788201238.472857:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5940 00000100:00100000:1.0:1788201238.472877:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2400:x1875060695448320:12345-192.168.201.20@tcp:2:touch.0 00000100:00100000:1.0:1788201238.473126:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:2400:x1875060695448320:12345-192.168.201.20@tcp:2:touch.0 Request processed in 259us (528us total) trans 4294969467 rc 0/0 00000100:00100000:1.0:1788201238.473135:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5940 00000100:00100000:0.0:1788201238.475966:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.476097:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695448576 00000100:00100000:3.0:1788201238.476107:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695448576 00000100:00100000:3.0:1788201238.476156:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 254 00000100:00100000:3.0:1788201238.476167:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+76:73596:x1875060695448576:12345-192.168.201.20@tcp:35:touch.0 00000100:00100000:3.0:1788201238.476474:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+77:73596:x1875060695448576:12345-192.168.201.20@tcp:35:touch.0 Request processed in 307us (515us total) trans 124554051618 rc 0/0 00000100:00100000:3.0:1788201238.476481:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 254 00000100:00100000:0.0:1788201238.480402:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.480495:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695448832 00000100:00100000:3.0:1788201238.480505:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695448832 00000100:00100000:3.0:1788201238.480590:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1501 00000100:00100000:3.0:1788201238.480614:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+77:73596:x1875060695448832:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:3.0:1788201238.480650:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201238.480672:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cd3f lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786a40 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.480791:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672600/0x96d0c9b8c9a1cd46 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.480806:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672600/0x96d0c9b8c9a1cd46 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.480817:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672600/0x96d0c9b8c9a1cd46 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.480833:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673a00/0x96d0c9b8c9a1cd4d lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.480840:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673a00/0x96d0c9b8c9a1cd4d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.480846:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673a00/0x96d0c9b8c9a1cd4d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201238.481194:0:66757:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x38c:0x0], index 0: 0 00010000:00010000:3.0:1788201238.481332:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1cd54 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.481341:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1cd54 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.481349:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1cd54 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.481392:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672600/0x96d0c9b8c9a1cd46 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.481399:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672600/0x96d0c9b8c9a1cd46 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.481404:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672600/0x96d0c9b8c9a1cd46 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.481410:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672600/0x96d0c9b8c9a1cd46 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.481415:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101672600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201238.481420:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672600/0x96d0c9b8c9a1cd46 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.481426:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672600/0x96d0c9b8c9a1cd46 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.481437:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:3.0:1788201238.481439:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201238.481443:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672600/0x96d0c9b8c9a1cd46 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.481448:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672600/0x96d0c9b8c9a1cd46 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201238.481462:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000235232ef reply state 0000000089fb461b transno 124554051619 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673a00/0x96d0c9b8c9a1cd4d lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.481472:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673a00/0x96d0c9b8c9a1cd4d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.481486:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff8dc11248ca00) 00010000:00010000:3.0:1788201238.481487:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201238.481490:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788201238.481516:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1cd3f lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a40 expref: 80 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.481530:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1cd54 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a40 expref: 79 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.481537:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff8dc11248c500) 00010000:00010000:3.0:1788201238.481556:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201238.481558:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc101672c00, rc 0) 00000100:00100000:3.0:1788201238.481614:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+80:73596:x1875060695448832:12345-192.168.201.20@tcp:101:touch.0 Request processed in 1003us (1222us total) trans 124554051619 rc 0/0 00000100:00100000:3.0:1788201238.481622:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1501 00000100:00100000:2.0:1788201238.486880:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201238.486992:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695449088 00000100:00100000:1.0:1788201238.487005:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695449088 00000100:00100000:1.0:1788201238.487361:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1502 00000100:00100000:1.0:1788201238.487385:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+80:73596:x1875060695449088:12345-192.168.201.20@tcp:36:touch.0 00010000:00010000:1.0:1788201238.487442:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201238.487470:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1cd54 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a40 expref: 80 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.487490:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff8dc11248c500) 00010000:00010000:1.0:1788201238.487500:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201238.487551:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1cd62 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.487564:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1cd62 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.487573:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1cd62 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201238.487792:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004938b83e reply state 00000000404f2532 transno 124554051620 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1cd62 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.487805:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1cd62 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.487810:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff8dc005cc6500) 00010000:00010000:1.0:1788201238.487813:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201238.487815:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201238.487962:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+81:73596:x1875060695449088:12345-192.168.201.20@tcp:36:touch.0 Request processed in 578us (1105us total) trans 124554051620 rc 0/0 00000100:00100000:1.0:1788201238.487970:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1502 00000100:00100000:1.0:1788201238.499374:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.499462:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695449216 00000100:00100000:3.0:1788201238.499474:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695449216 00000100:00100000:3.0:1788201238.499534:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1503 00000100:00100000:3.0:1788201238.499545:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+81:73596:x1875060695449216:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:3.0:1788201238.499568:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201238.499588:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672600/0x96d0c9b8c9a1cd69 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786a47 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.499727:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672600/0x96d0c9b8c9a1cd69 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a47 expref: 82 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.499744:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672600/0x96d0c9b8c9a1cd69 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a47 expref: 82 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.499779:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff8dc005cc6500) 00010000:00010000:3.0:1788201238.499782:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201238.499785:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc101672600, rc 0) 00000100:00100000:3.0:1788201238.500213:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+82:73596:x1875060695449216:12345-192.168.201.20@tcp:101:touch.0 Request processed in 661us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201238.500221:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1503 00000100:00100000:0.0:1788201238.512375:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.512484:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695449344 00000100:00100000:3.0:1788201238.512494:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695449344 00000100:00100000:3.0:1788201238.512606:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5941 00000100:00100000:3.0:1788201238.512616:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:2400:x1875060695449344:12345-192.168.201.20@tcp:2:touch.0 00000100:00100000:3.0:1788201238.512843:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:2400:x1875060695449344:12345-192.168.201.20@tcp:2:touch.0 Request processed in 228us (478us total) trans 4294969468 rc 0/0 00000100:00100000:3.0:1788201238.512851:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5941 00000100:00100000:2.0:1788201238.519945:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.520040:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695449600 00000100:00100000:3.0:1788201238.520050:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695449600 00000100:00100000:3.0:1788201238.520134:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 255 00000100:00100000:3.0:1788201238.520144:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+82:73596:x1875060695449600:12345-192.168.201.20@tcp:35:touch.0 00000100:00100000:3.0:1788201238.520413:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+83:73596:x1875060695449600:12345-192.168.201.20@tcp:35:touch.0 Request processed in 269us (477us total) trans 124554051621 rc 0/0 00000100:00100000:3.0:1788201238.520421:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 255 00000100:00100000:1.0:1788201238.525569:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.525930:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695449856 00000100:00100000:3.0:1788201238.525941:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695449856 00000100:00100000:3.0:1788201238.526005:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1504 00000100:00100000:3.0:1788201238.526035:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+83:73596:x1875060695449856:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:3.0:1788201238.526069:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201238.526089:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673600/0x96d0c9b8c9a1cd70 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786a4e expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.526196:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673800/0x96d0c9b8c9a1cd77 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.526342:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673800/0x96d0c9b8c9a1cd77 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.526354:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673800/0x96d0c9b8c9a1cd77 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.526371:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673200/0x96d0c9b8c9a1cd7e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.526377:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673200/0x96d0c9b8c9a1cd7e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.526383:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673200/0x96d0c9b8c9a1cd7e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201238.527382:0:66757:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x38d:0x0], index 0: 0 00010000:00010000:3.0:1788201238.527524:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672000/0x96d0c9b8c9a1cd85 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.527535:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672000/0x96d0c9b8c9a1cd85 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.527544:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672000/0x96d0c9b8c9a1cd85 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.527592:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673800/0x96d0c9b8c9a1cd77 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.527599:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673800/0x96d0c9b8c9a1cd77 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.527606:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673800/0x96d0c9b8c9a1cd77 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.527613:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673800/0x96d0c9b8c9a1cd77 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.527619:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101673800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201238.527623:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673800/0x96d0c9b8c9a1cd77 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.528119:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673800/0x96d0c9b8c9a1cd77 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.528133:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:3.0:1788201238.528136:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201238.528141:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673800/0x96d0c9b8c9a1cd77 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.528148:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673800/0x96d0c9b8c9a1cd77 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201238.528164:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1ea768b reply state 0000000000c250c7 transno 124554051622 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673200/0x96d0c9b8c9a1cd7e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.528188:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673200/0x96d0c9b8c9a1cd7e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.528388:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff8dc11248cd00) 00010000:00010000:3.0:1788201238.528393:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201238.528396:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788201238.528436:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673600/0x96d0c9b8c9a1cd70 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a4e expref: 86 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.528453:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672000/0x96d0c9b8c9a1cd85 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a4e expref: 85 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.528460:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff8dc11248c500) 00010000:00010000:3.0:1788201238.528463:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201238.528465:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc101672000, rc 0) 00000100:00100000:3.0:1788201238.528581:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+86:73596:x1875060695449856:12345-192.168.201.20@tcp:101:touch.0 Request processed in 2566us (3021us total) trans 124554051622 rc 0/0 00000100:00100000:3.0:1788201238.528592:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1504 00000100:00100000:0.0:1788201238.536340:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201238.536511:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695450112 00000100:00100000:1.0:1788201238.536522:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695450112 00000100:00100000:1.0:1788201238.536612:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1505 00000100:00100000:1.0:1788201238.536623:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+86:73596:x1875060695450112:12345-192.168.201.20@tcp:36:touch.0 00010000:00010000:1.0:1788201238.536691:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201238.536803:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672000/0x96d0c9b8c9a1cd85 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a4e expref: 86 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.536825:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff8dc11248c500) 00010000:00010000:1.0:1788201238.536836:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201238.536899:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1cd93 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.536913:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1cd93 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.536923:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1cd93 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201238.537062:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055745ef9 reply state 00000000c1ffc2ce transno 124554051623 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1cd93 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.537075:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1cd93 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.537082:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff8dc005cc6800) 00010000:00010000:1.0:1788201238.537086:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201238.537088:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201238.537473:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+87:73596:x1875060695450112:12345-192.168.201.20@tcp:36:touch.0 Request processed in 850us (1141us total) trans 124554051623 rc 0/0 00000100:00100000:1.0:1788201238.537497:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1505 00000100:00100000:2.0:1788201238.540832:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.541194:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695450240 00000100:00100000:3.0:1788201238.541205:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695450240 00000100:00100000:0.0:1788201238.541424:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1506 00000100:00100000:0.0:1788201238.541437:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+87:73596:x1875060695450240:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:0.0:1788201238.541473:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201238.541494:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1cd9a lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786a55 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.541552:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1cd9a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a55 expref: 88 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.541567:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1cd9a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a55 expref: 88 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.541585:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff8dc005cc6800) 00010000:00010000:0.0:1788201238.541588:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201238.541592:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2600, rc 0) 00000100:00100000:0.0:1788201238.541821:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+88:73596:x1875060695450240:12345-192.168.201.20@tcp:101:touch.0 Request processed in 385us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201238.541828:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1506 00000100:00100000:2.0:1788201238.544892:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201238.544969:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695450368 00000100:00100000:0.0:1788201238.544979:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695450368 00000100:00100000:0.0:1788201238.545102:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5942 00000100:00100000:0.0:1788201238.545112:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:2401:x1875060695450368:12345-192.168.201.20@tcp:2:touch.0 00000100:00100000:0.0:1788201238.545388:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6e293f14-c501-4bc5-9dd4-a18ef02756b4+17:2401:x1875060695450368:12345-192.168.201.20@tcp:2:touch.0 Request processed in 277us (504us total) trans 4294969469 rc 0/0 00000100:00100000:0.0:1788201238.545396:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5942 00000100:00100000:1.0:1788201238.548557:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201238.548700:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695450624 00000100:00100000:0.0:1788201238.548710:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695450624 00000100:00100000:0.0:1788201238.548881:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 256 00000100:00100000:0.0:1788201238.548892:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+88:73596:x1875060695450624:12345-192.168.201.20@tcp:35:touch.0 00000100:00100000:0.0:1788201238.549502:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+89:73596:x1875060695450624:12345-192.168.201.20@tcp:35:touch.0 Request processed in 609us (954us total) trans 124554051624 rc 0/0 00000100:00100000:0.0:1788201238.549510:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 256 00000100:00100000:3.0:1788201238.555255:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201238.555368:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695450880 00000100:00100000:2.0:1788201238.555378:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695450880 00000100:00100000:2.0:1788201238.555442:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1507 00000100:00100000:2.0:1788201238.555452:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+89:73596:x1875060695450880:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:2.0:1788201238.555474:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201238.555507:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1cda1 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786a5c expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.555606:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1cda8 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.555620:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1cda8 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.555641:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1cda8 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.555655:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1cdaf lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.555661:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1cdaf lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.555666:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1cdaf lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201238.555961:0:66757:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x38e:0x0], index 0: 0 00010000:00010000:2.0:1788201238.556152:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1cdb6 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.556162:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1cdb6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.556169:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1cdb6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.556200:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1cda8 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.556218:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1cda8 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.556224:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1cda8 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.556230:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1cda8 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.556236:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201238.556240:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1cda8 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.556248:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1cda8 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.556260:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201238.556263:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201238.556267:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1cda8 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.556273:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1cda8 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201238.556287:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005de04f39 reply state 000000002a5dd04a transno 124554051625 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1cdaf lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.556296:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1cdaf lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.556301:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff8dc12196e800) 00010000:00010000:2.0:1788201238.556310:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201238.556312:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201238.556342:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1cda1 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a5c expref: 92 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.556356:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1cdb6 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a5c expref: 91 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.556363:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff8dc12196e200) 00010000:00010000:2.0:1788201238.556365:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201238.556367:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007adfa00, rc 0) 00000100:00100000:2.0:1788201238.556424:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+92:73596:x1875060695450880:12345-192.168.201.20@tcp:101:touch.0 Request processed in 973us (1178us total) trans 124554051625 rc 0/0 00000100:00100000:2.0:1788201238.556432:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1507 00000100:00100000:1.0:1788201238.565354:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201238.565463:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695451136 00000100:00100000:0.0:1788201238.565473:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695451136 00000100:00100000:0.0:1788201238.565536:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1508 00000100:00100000:0.0:1788201238.565546:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+92:73596:x1875060695451136:12345-192.168.201.20@tcp:36:touch.0 00010000:00010000:0.0:1788201238.565601:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201238.565641:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1cdb6 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a5c expref: 92 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.565660:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff8dc12196e200) 00010000:00010000:0.0:1788201238.565671:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201238.565723:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1cdc4 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.565736:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1cdc4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.565745:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1cdc4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201238.565849:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000088735dcf reply state 00000000dca64a99 transno 124554051626 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1cdc4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.565861:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1cdc4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.565879:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff8dc0048be900) 00010000:00010000:0.0:1788201238.565894:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201238.565897:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201238.565994:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+93:73596:x1875060695451136:12345-192.168.201.20@tcp:36:touch.0 Request processed in 448us (650us total) trans 124554051626 rc 0/0 00000100:00100000:0.0:1788201238.566002:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1508 00000100:00100000:1.0:1788201238.569236:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201238.569380:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695451264 00000100:00100000:0.0:1788201238.569389:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695451264 00000100:00100000:0.0:1788201238.569449:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1509 00000100:00100000:0.0:1788201238.569459:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+93:73596:x1875060695451264:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:0.0:1788201238.569483:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201238.569504:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1cdcb lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786a63 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.569565:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1cdcb lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a63 expref: 94 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.569579:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1cdcb lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a63 expref: 94 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.569596:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff8dc0048be900) 00010000:00010000:0.0:1788201238.569599:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201238.569603:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3200, rc 0) 00000100:00100000:0.0:1788201238.569669:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+94:73596:x1875060695451264:12345-192.168.201.20@tcp:101:touch.0 Request processed in 211us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201238.569676:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1509 00000100:00100000:3.0:1788201238.575409:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201238.575530:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695451392 00000100:00100000:0.0:1788201238.575541:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695451392 00000100:00100000:0.0:1788201238.575591:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5943 00000100:00100000:0.0:1788201238.575615:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+17:2401:x1875060695451392:12345-192.168.201.20@tcp:2:touch.0 00000100:00100000:1.0:1788201238.576775:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+18:2401:x1875060695451392:12345-192.168.201.20@tcp:2:touch.0 Request processed in 1156us (1372us total) trans 4294969470 rc 0/0 00000100:00100000:1.0:1788201238.576786:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5943 00000100:00100000:1.0:1788201238.580054:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.580136:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695451648 00000100:00100000:3.0:1788201238.580148:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695451648 00000100:00100000:3.0:1788201238.580617:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 257 00000100:00100000:3.0:1788201238.580643:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107db6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+94:73596:x1875060695451648:12345-192.168.201.20@tcp:35:touch.0 00000100:00100000:3.0:1788201238.580978:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107db6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+95:73596:x1875060695451648:12345-192.168.201.20@tcp:35:touch.0 Request processed in 349us (960us total) trans 124554051627 rc 0/0 00000100:00100000:3.0:1788201238.580986:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 257 00000100:00100000:0.0:1788201238.587119:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201238.587366:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695451904 00000100:00100000:1.0:1788201238.587378:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695451904 00000100:00100000:1.0:1788201238.587481:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1510 00000100:00100000:1.0:1788201238.587493:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+95:73596:x1875060695451904:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:1.0:1788201238.587518:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201238.587539:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1cdd2 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786a6a expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.587668:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1cdd9 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.587683:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1cdd9 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.587694:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1cdd9 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.587707:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1cde0 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.587733:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1cde0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.587739:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1cde0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201238.588091:0:69485:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x38f:0x0], index 0: 0 00010000:00010000:1.0:1788201238.588237:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1cde7 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.588246:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1cde7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.588254:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1cde7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.588289:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1cdd9 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.588296:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1cdd9 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.588302:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1cdd9 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.588307:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1cdd9 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.588313:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2e00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201238.588317:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1cdd9 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.588334:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1cdd9 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.588345:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:1.0:1788201238.588348:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201238.588352:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1cdd9 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.588358:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1cdd9 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201238.588370:0:69485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8de8d7d reply state 000000002b0700e9 transno 124554051628 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1cde0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.588379:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1cde0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.588384:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff8dc005cc6000) 00010000:00010000:1.0:1788201238.588386:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201238.588388:0:69485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201238.588416:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1cdd2 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a6a expref: 98 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.588429:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1cde7 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a6a expref: 97 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.588435:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff8dc005cc6d00) 00010000:00010000:1.0:1788201238.588437:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201238.588440:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e3c00, rc 0) 00000100:00100000:1.0:1788201238.588516:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+98:73596:x1875060695451904:12345-192.168.201.20@tcp:101:touch.0 Request processed in 1026us (1500us total) trans 124554051628 rc 0/0 00000100:00100000:1.0:1788201238.588524:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1510 00000100:00100000:3.0:1788201238.592780:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201238.593540:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695452160 00000100:00100000:0.0:1788201238.593551:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695452160 00000100:00100000:0.0:1788201238.593615:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1511 00000100:00100000:0.0:1788201238.593785:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+98:73596:x1875060695452160:12345-192.168.201.20@tcp:36:touch.0 00010000:00010000:0.0:1788201238.593842:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201238.593945:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1cde7 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a6a expref: 98 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.593965:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff8dc005cc6d00) 00010000:00010000:0.0:1788201238.593976:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201238.594057:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cdf5 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.594071:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cdf5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.594080:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cdf5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201238.594368:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b85ac92 reply state 000000003594d0b4 transno 124554051629 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cdf5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.594381:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cdf5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.594387:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff8dc0048be200) 00010000:00010000:0.0:1788201238.594389:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201238.594404:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201238.594551:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+99:73596:x1875060695452160:12345-192.168.201.20@tcp:36:touch.0 Request processed in 926us (1780us total) trans 124554051629 rc 0/0 00000100:00100000:0.0:1788201238.594559:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1511 00000100:00100000:2.0:1788201238.601451:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.601551:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695452288 00000100:00100000:3.0:1788201238.601561:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695452288 00000100:00100000:3.0:1788201238.601723:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1512 00000100:00100000:3.0:1788201238.601736:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+99:73596:x1875060695452288:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:3.0:1788201238.601760:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201238.601782:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673600/0x96d0c9b8c9a1cdfc lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786a71 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.601840:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673600/0x96d0c9b8c9a1cdfc lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a71 expref: 100 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.601874:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673600/0x96d0c9b8c9a1cdfc lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a71 expref: 100 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.601894:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff8dc0048be200) 00010000:00010000:3.0:1788201238.601897:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201238.601901:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc101673600, rc 0) 00000100:00100000:3.0:1788201238.601965:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+100:73596:x1875060695452288:12345-192.168.201.20@tcp:101:touch.0 Request processed in 231us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201238.601971:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1512 00000100:00100000:1.0:1788201238.605807:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201238.605982:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695452416 00000100:00100000:2.0:1788201238.605993:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695452416 00000100:00100000:2.0:1788201238.606293:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5944 00000100:00100000:2.0:1788201238.606305:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+18:2401:x1875060695452416:12345-192.168.201.20@tcp:2:touch.0 00000100:00100000:2.0:1788201238.606524:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+19:2401:x1875060695452416:12345-192.168.201.20@tcp:2:touch.0 Request processed in 220us (727us total) trans 4294969471 rc 0/0 00000100:00100000:2.0:1788201238.606531:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5944 00000100:00100000:1.0:1788201238.610005:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201238.613323:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695452672 00000100:00100000:0.0:1788201238.613340:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695452672 00000100:00100000:1.0:1788201238.613521:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 258 00000100:00100000:1.0:1788201238.613534:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+100:73596:x1875060695452672:12345-192.168.201.20@tcp:35:touch.0 00000100:00100000:1.0:1788201238.614520:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+101:73596:x1875060695452672:12345-192.168.201.20@tcp:35:touch.0 Request processed in 984us (4522us total) trans 124554051630 rc 0/0 00000100:00100000:1.0:1788201238.614531:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 258 00000100:00100000:1.0:1788201238.618260:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201238.618430:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695452928 00000100:00100000:0.0:1788201238.618439:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695452928 00000100:00100000:0.0:1788201238.618498:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1513 00000100:00100000:0.0:1788201238.618507:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+101:73596:x1875060695452928:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:0.0:1788201238.618532:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201238.618554:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1ce03 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786a78 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.618752:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1ce0a lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.618767:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1ce0a lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.618778:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1ce0a lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.618792:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1ce11 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.618798:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1ce11 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.618805:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1ce11 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201238.619507:0:69485:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x390:0x0], index 0: 0 00010000:00010000:2.0:1788201238.619707:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1ce18 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.619718:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1ce18 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.619739:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1ce18 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.619772:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1ce0a lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.619780:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1ce0a lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.619786:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1ce0a lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.619793:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1ce0a lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.619799:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896bc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201238.619803:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1ce0a lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.619810:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1ce0a lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.619820:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201238.619823:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201238.619828:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1ce0a lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.619834:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1ce0a lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201238.619847:0:69485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000808a5da9 reply state 0000000040b4866e transno 124554051631 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1ce11 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.619874:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1ce11 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.619881:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff8dc0048be400) 00010000:00010000:2.0:1788201238.619883:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201238.619886:0:69485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201238.619917:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1ce03 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a78 expref: 104 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.619933:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1ce18 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a78 expref: 103 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.619940:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff8dc12196ec00) 00010000:00010000:2.0:1788201238.619942:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201238.619944:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ade000, rc 0) 00000100:00100000:2.0:1788201238.620079:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+104:73596:x1875060695452928:12345-192.168.201.20@tcp:101:touch.0 Request processed in 1573us (1827us total) trans 124554051631 rc 0/0 00000100:00100000:2.0:1788201238.620087:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1513 00000100:00100000:0.0:1788201238.623670:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201238.623752:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695453184 00000100:00100000:2.0:1788201238.623761:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695453184 00000100:00100000:2.0:1788201238.623821:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1514 00000100:00100000:2.0:1788201238.623831:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+104:73596:x1875060695453184:12345-192.168.201.20@tcp:36:touch.0 00010000:00010000:2.0:1788201238.623893:0:66312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201238.623918:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1ce18 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a78 expref: 104 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.623936:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff8dc12196ec00) 00010000:00010000:2.0:1788201238.623961:0:66312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201238.624013:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1ce26 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.624066:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1ce26 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.624075:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1ce26 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201238.624171:0:66312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd311dc3 reply state 00000000876063cc transno 124554051632 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1ce26 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.624182:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1ce26 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.624189:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff8dc12196e200) 00010000:00010000:2.0:1788201238.624192:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201238.624194:0:66312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201238.624279:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+105:73596:x1875060695453184:12345-192.168.201.20@tcp:36:touch.0 Request processed in 448us (617us total) trans 124554051632 rc 0/0 00000100:00100000:2.0:1788201238.624287:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1514 00000100:00100000:1.0:1788201238.627494:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.627572:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695453312 00000100:00100000:3.0:1788201238.627582:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695453312 00000100:00100000:3.0:1788201238.627641:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1515 00000100:00100000:3.0:1788201238.627650:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+105:73596:x1875060695453312:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:3.0:1788201238.627673:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201238.627692:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673800/0x96d0c9b8c9a1ce2d lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786a7f expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.627756:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673800/0x96d0c9b8c9a1ce2d lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a7f expref: 106 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.627770:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673800/0x96d0c9b8c9a1ce2d lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a7f expref: 106 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.627786:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff8dc12196e200) 00010000:00010000:3.0:1788201238.627789:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201238.627792:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc101673800, rc 0) 00000100:00100000:3.0:1788201238.627848:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+106:73596:x1875060695453312:12345-192.168.201.20@tcp:101:touch.0 Request processed in 199us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201238.627856:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1515 00000100:00100000:1.0:1788201238.632122:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201238.632226:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695453440 00000100:00100000:2.0:1788201238.632237:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695453440 00000100:00100000:2.0:1788201238.632292:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5945 00000100:00100000:2.0:1788201238.632302:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6e293f14-c501-4bc5-9dd4-a18ef02756b4+19:2400:x1875060695453440:12345-192.168.201.20@tcp:2:touch.0 00000100:00100000:2.0:1788201238.632536:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:2400:x1875060695453440:12345-192.168.201.20@tcp:2:touch.0 Request processed in 235us (423us total) trans 4294969472 rc 0/0 00000100:00100000:2.0:1788201238.632544:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5945 00000100:00100000:0.0:1788201238.636657:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.636751:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695453696 00000100:00100000:3.0:1788201238.636763:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695453696 00000100:00100000:3.0:1788201238.636830:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 259 00000100:00100000:3.0:1788201238.636842:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+106:73596:x1875060695453696:12345-192.168.201.20@tcp:35:touch.0 00000100:00100000:3.0:1788201238.637198:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+107:73596:x1875060695453696:12345-192.168.201.20@tcp:35:touch.0 Request processed in 356us (549us total) trans 124554051633 rc 0/0 00000100:00100000:3.0:1788201238.637206:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 259 00000100:00100000:3.0:1788201238.640987:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201238.641164:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695453952 00000100:00100000:2.0:1788201238.641187:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695453952 00000100:00100000:2.0:1788201238.641261:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1516 00000100:00100000:2.0:1788201238.641272:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+107:73596:x1875060695453952:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:2.0:1788201238.641298:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201238.641319:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1ce34 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786a86 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.641424:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1ce3b lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.641438:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1ce3b lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.641449:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1ce3b lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.641466:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1ce42 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.641474:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1ce42 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.641480:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1ce42 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201238.641773:0:69485:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x391:0x0], index 0: 0 00010000:00010000:2.0:1788201238.641910:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1ce49 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.641919:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1ce49 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.641939:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1ce49 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.641970:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1ce3b lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.641978:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1ce3b lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.641985:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1ce3b lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.641991:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1ce3b lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.641997:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfa00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201238.642002:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1ce3b lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.642010:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1ce3b lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.642413:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201238.642417:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201238.642422:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1ce3b lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.642429:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1ce3b lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201238.642443:0:69485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a200e568 reply state 0000000067e8ad04 transno 124554051634 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1ce42 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.642460:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1ce42 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.642466:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff8dc12196ec00) 00010000:00010000:2.0:1788201238.642468:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201238.642471:0:69485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201238.642503:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1ce34 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a86 expref: 110 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.642518:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1ce49 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a86 expref: 109 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.642526:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff8dc1207c9a00) 00010000:00010000:2.0:1788201238.642528:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201238.642531:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896bc00, rc 0) 00000100:00100000:2.0:1788201238.642657:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+110:73596:x1875060695453952:12345-192.168.201.20@tcp:101:touch.0 Request processed in 1386us (1679us total) trans 124554051634 rc 0/0 00000100:00100000:2.0:1788201238.642666:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1516 00000100:00100000:1.0:1788201238.646545:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201238.646691:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695454208 00000100:00100000:0.0:1788201238.646702:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695454208 00000100:00100000:0.0:1788201238.646788:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1517 00000100:00100000:0.0:1788201238.646799:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+110:73596:x1875060695454208:12345-192.168.201.20@tcp:36:touch.0 00010000:00010000:0.0:1788201238.646859:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201238.646893:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1ce49 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a86 expref: 110 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.646912:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff8dc1207c9a00) 00010000:00010000:0.0:1788201238.646923:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201238.646975:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1ce57 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.646988:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1ce57 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.646998:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1ce57 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201238.647144:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a56beca reply state 00000000437b39cc transno 124554051635 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1ce57 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.647156:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1ce57 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.647162:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff8dc0048be800) 00010000:00010000:0.0:1788201238.647187:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201238.647190:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201238.647281:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+111:73596:x1875060695454208:12345-192.168.201.20@tcp:36:touch.0 Request processed in 483us (746us total) trans 124554051635 rc 0/0 00000100:00100000:0.0:1788201238.647289:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1517 00000100:00100000:0.0:1788201238.651765:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201238.651847:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695454336 00000100:00100000:1.0:1788201238.651857:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695454336 00000100:00100000:1.0:1788201238.651924:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1518 00000100:00100000:1.0:1788201238.651934:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+111:73596:x1875060695454336:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:1.0:1788201238.651956:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201238.651978:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ce5e lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786a8d expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.652068:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ce5e lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a8d expref: 112 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.652084:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ce5e lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a8d expref: 112 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201238.652117:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff8dc0048be800) 00010000:00010000:1.0:1788201238.652120:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788201238.652123:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e2c00, rc 0) 00000100:00100000:1.0:1788201238.652192:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+112:73596:x1875060695454336:12345-192.168.201.20@tcp:101:touch.0 Request processed in 259us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201238.652199:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1518 00000100:00100000:1.0:1788201238.655006:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.655122:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695454464 00000100:00100000:3.0:1788201238.655131:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695454464 00000100:00100000:3.0:1788201238.655197:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5946 00000100:00100000:3.0:1788201238.655207:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:2401:x1875060695454464:12345-192.168.201.20@tcp:2:touch.0 00000100:00100000:3.0:1788201238.655413:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+21:2401:x1875060695454464:12345-192.168.201.20@tcp:2:touch.0 Request processed in 207us (416us total) trans 4294969473 rc 0/0 00000100:00100000:3.0:1788201238.655432:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5946 00000100:00100000:0.0:1788201238.657935:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201238.658059:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695454720 00000100:00100000:1.0:1788201238.658069:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695454720 00000100:00100000:1.0:1788201238.658116:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 260 00000100:00100000:1.0:1788201238.658127:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+112:73596:x1875060695454720:12345-192.168.201.20@tcp:35:touch.0 00000100:00100000:1.0:1788201238.658660:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+113:73596:x1875060695454720:12345-192.168.201.20@tcp:35:touch.0 Request processed in 533us (732us total) trans 124554051636 rc 0/0 00000100:00100000:1.0:1788201238.658668:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 260 00000100:00100000:1.0:1788201238.662076:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.662404:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695454976 00000100:00100000:3.0:1788201238.662417:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695454976 00000100:00100000:3.0:1788201238.662481:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1519 00000100:00100000:3.0:1788201238.662492:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+113:73596:x1875060695454976:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:3.0:1788201238.662517:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201238.662538:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1ce65 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786a94 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.662657:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1ce6c lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.662992:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1ce6c lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.663006:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1ce6c lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.663049:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672000/0x96d0c9b8c9a1ce73 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.663058:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672000/0x96d0c9b8c9a1ce73 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.663065:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672000/0x96d0c9b8c9a1ce73 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201238.663534:0:69485:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x392:0x0], index 0: 0 00000100:00100000:1.0:1788201238.663762:0:94475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94475:1875060715280896:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788201238.663833:0:94475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201238.663878:0:94475:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103892e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201238.663941:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715280896 00000100:00100000:0.0:1788201238.663948:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715280896 00000100:00100000:0.0:1788201238.664011:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5947 00000100:00100000:0.0:1788201238.664039:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120020a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:94475:x1875060715280896:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788201238.664075:0:23974:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 930 00000100:00100000:0.0:1788201238.665667:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120020a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:94475:x1875060715280896:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1627us (1830us total) trans 4294969474 rc 0/0 00000100:00100000:0.0:1788201238.665678:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5947 00010000:00010000:3.0:1788201238.666157:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1ce7a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.666283:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1ce7a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.666297:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1ce7a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.666340:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1ce6c lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.666347:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1ce6c lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.666352:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1ce6c lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.666358:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1ce6c lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.666363:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101673c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201238.666367:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1ce6c lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.666374:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1ce6c lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.666386:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:3.0:1788201238.666389:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201238.666393:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1ce6c lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.666399:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1ce6c lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201238.666422:0:69485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000928fada6 reply state 00000000244fb9a1 transno 124554051637 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672000/0x96d0c9b8c9a1ce73 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.666433:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672000/0x96d0c9b8c9a1ce73 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.666439:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff8dc11248c500) 00010000:00010000:3.0:1788201238.666441:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201238.666444:0:69485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788201238.666477:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1ce65 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a94 expref: 116 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.666489:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1ce7a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a94 expref: 115 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.666496:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff8dc103a3a400) 00010000:00010000:3.0:1788201238.666498:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201238.666500:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc101672c00, rc 0) 00000100:00100000:3.0:1788201238.666557:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+116:73596:x1875060695454976:12345-192.168.201.20@tcp:101:touch.0 Request processed in 4067us (4491us total) trans 124554051637 rc 0/0 00000100:00100000:3.0:1788201238.666565:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1519 00000100:00080000:1.0:1788201238.666673:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201238.666714:0:94475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94475:1875060715280896:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788201238.666729:0:94475:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x392:0x0]-[0x280000401:0x3c1:0x0] 00000100:00100000:1.0:1788201238.670484:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.670552:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695455232 00000100:00100000:3.0:1788201238.670561:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695455232 00000100:00100000:3.0:1788201238.670616:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1520 00000100:00100000:3.0:1788201238.670634:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120021c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+116:73596:x1875060695455232:12345-192.168.201.20@tcp:36:touch.0 00010000:00010000:3.0:1788201238.670687:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201238.670712:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1ce7a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a94 expref: 116 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.670746:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff8dc103a3a400) 00010000:00010000:3.0:1788201238.670758:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201238.670807:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1ce88 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.670819:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1ce88 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.670828:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1ce88 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201238.670933:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b317623 reply state 0000000030ba30fc transno 124554051638 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1ce88 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.670944:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1ce88 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.670950:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff8dc103a3a600) 00010000:00010000:3.0:1788201238.670953:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201238.670955:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201238.671050:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120021c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+117:73596:x1875060695455232:12345-192.168.201.20@tcp:36:touch.0 Request processed in 424us (574us total) trans 124554051638 rc 0/0 00000100:00100000:3.0:1788201238.671058:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1520 00000100:00100000:1.0:1788201238.674125:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201238.674367:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695455360 00000100:00100000:2.0:1788201238.674377:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695455360 00000100:00100000:2.0:1788201238.674446:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1521 00000100:00100000:2.0:1788201238.674457:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+117:73596:x1875060695455360:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:2.0:1788201238.674484:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201238.674506:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1ce8f lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786a9b expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.674560:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1ce8f lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a9b expref: 118 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.674588:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1ce8f lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a9b expref: 118 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.674610:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff8dc103a3a600) 00010000:00010000:2.0:1788201238.674613:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788201238.674617:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007adfa00, rc 0) 00000100:00100000:2.0:1788201238.674744:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+118:73596:x1875060695455360:12345-192.168.201.20@tcp:101:touch.0 Request processed in 288us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201238.674751:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1521 00000100:00100000:1.0:1788201238.678577:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201238.678686:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695455488 00000100:00100000:2.0:1788201238.678696:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695455488 00000100:00100000:2.0:1788201238.678756:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5948 00000100:00100000:2.0:1788201238.678768:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120022a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6e293f14-c501-4bc5-9dd4-a18ef02756b4+21:2400:x1875060695455488:12345-192.168.201.20@tcp:2:touch.0 00000100:00100000:2.0:1788201238.678991:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120022a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:2400:x1875060695455488:12345-192.168.201.20@tcp:2:touch.0 Request processed in 225us (421us total) trans 4294969475 rc 0/0 00000100:00100000:2.0:1788201238.678999:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5948 00000100:00100000:1.0:1788201238.686673:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201238.686910:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695455744 00000100:00100000:2.0:1788201238.686921:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695455744 00000100:00100000:2.0:1788201238.686982:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 261 00000100:00100000:2.0:1788201238.686993:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+118:73596:x1875060695455744:12345-192.168.201.20@tcp:35:touch.0 00000100:00100000:2.0:1788201238.687342:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+119:73596:x1875060695455744:12345-192.168.201.20@tcp:35:touch.0 Request processed in 349us (678us total) trans 124554051639 rc 0/0 00000100:00100000:2.0:1788201238.687350:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 261 00000100:00100000:0.0:1788201238.690566:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.690669:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695456000 00000100:00100000:3.0:1788201238.690680:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695456000 00000100:00100000:3.0:1788201238.690741:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1522 00000100:00100000:3.0:1788201238.690752:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+119:73596:x1875060695456000:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:3.0:1788201238.690777:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201238.690815:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1ce96 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786aa2 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.690929:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1ce9d lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.690944:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1ce9d lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.690956:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1ce9d lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.690973:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1cea4 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.690980:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1cea4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.690986:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1cea4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201238.691353:0:69485:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x393:0x0], index 0: 0 00010000:00010000:3.0:1788201238.691485:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8400/0x96d0c9b8c9a1ceab lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.691495:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8400/0x96d0c9b8c9a1ceab lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.691502:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8400/0x96d0c9b8c9a1ceab lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.691534:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1ce9d lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.691550:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1ce9d lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.691556:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1ce9d lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.691562:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1ce9d lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.691567:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101673e00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201238.691572:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1ce9d lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.691579:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1ce9d lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.691591:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:3.0:1788201238.691594:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201238.691598:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1ce9d lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.691604:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1ce9d lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201238.691618:0:69485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b82b50f7 reply state 00000000dfb3478c transno 124554051640 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1cea4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.691628:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1cea4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.691634:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff8dc103a3a400) 00010000:00010000:3.0:1788201238.691640:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201238.691642:0:69485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788201238.691669:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1ce96 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786aa2 expref: 122 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.691684:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8400/0x96d0c9b8c9a1ceab lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786aa2 expref: 121 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.691690:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff8dc103a3aa00) 00010000:00010000:3.0:1788201238.691692:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201238.691695:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc11cda8400, rc 0) 00000100:00100000:3.0:1788201238.691749:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+122:73596:x1875060695456000:12345-192.168.201.20@tcp:101:touch.0 Request processed in 999us (1193us total) trans 124554051640 rc 0/0 00000100:00100000:3.0:1788201238.691757:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1522 00000100:00100000:1.0:1788201238.695456:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201238.695564:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695456256 00000100:00100000:0.0:1788201238.695576:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695456256 00000100:00100000:0.0:1788201238.695648:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1523 00000100:00100000:0.0:1788201238.695658:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+122:73596:x1875060695456256:12345-192.168.201.20@tcp:36:touch.0 00010000:00010000:0.0:1788201238.695718:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201238.695744:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8400/0x96d0c9b8c9a1ceab lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786aa2 expref: 122 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.695761:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff8dc103a3aa00) 00010000:00010000:0.0:1788201238.695775:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201238.695832:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1ceb9 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.695857:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1ceb9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.695876:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1ceb9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201238.695993:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f440848 reply state 0000000064897b26 transno 124554051641 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1ceb9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.696006:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1ceb9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.696013:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff8dc0048be100) 00010000:00010000:0.0:1788201238.696059:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201238.696062:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201238.696143:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+123:73596:x1875060695456256:12345-192.168.201.20@tcp:36:touch.0 Request processed in 485us (696us total) trans 124554051641 rc 0/0 00000100:00100000:0.0:1788201238.696150:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1523 00000100:00100000:1.0:1788201238.700088:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.700250:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695456384 00000100:00100000:3.0:1788201238.700262:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695456384 00000100:00100000:3.0:1788201238.700320:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1524 00000100:00100000:3.0:1788201238.700331:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+123:73596:x1875060695456384:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:3.0:1788201238.700360:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201238.700382:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9800/0x96d0c9b8c9a1cec0 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786aa9 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.700440:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9800/0x96d0c9b8c9a1cec0 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786aa9 expref: 124 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.700456:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9800/0x96d0c9b8c9a1cec0 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786aa9 expref: 124 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.700494:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff8dc0048be100) 00010000:00010000:3.0:1788201238.700497:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201238.700500:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc11cda9800, rc 0) 00000100:00100000:3.0:1788201238.700569:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+124:73596:x1875060695456384:12345-192.168.201.20@tcp:101:touch.0 Request processed in 239us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201238.700577:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1524 00000100:00100000:1.0:1788201238.703722:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.703851:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695456512 00000100:00100000:3.0:1788201238.703886:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695456512 00000100:00100000:3.0:1788201238.703951:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5949 00000100:00100000:3.0:1788201238.703961:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:2400:x1875060695456512:12345-192.168.201.20@tcp:2:touch.0 00000100:00100000:3.0:1788201238.704351:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+23:2400:x1875060695456512:12345-192.168.201.20@tcp:2:touch.0 Request processed in 246us (495us total) trans 4294969476 rc 0/0 00000100:00100000:3.0:1788201238.704360:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5949 00000100:00100000:1.0:1788201238.707550:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.707648:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695456768 00000100:00100000:3.0:1788201238.707660:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695456768 00000100:00100000:3.0:1788201238.707718:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 262 00000100:00100000:3.0:1788201238.707728:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+124:73596:x1875060695456768:12345-192.168.201.20@tcp:35:touch.0 00000100:00100000:3.0:1788201238.708065:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+125:73596:x1875060695456768:12345-192.168.201.20@tcp:35:touch.0 Request processed in 337us (523us total) trans 124554051642 rc 0/0 00000100:00100000:3.0:1788201238.708073:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 262 00000100:00100000:1.0:1788201238.711482:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201238.711569:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695457024 00000100:00100000:0.0:1788201238.711577:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695457024 00000100:00100000:0.0:1788201238.711640:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1525 00000100:00100000:0.0:1788201238.711650:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+125:73596:x1875060695457024:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:0.0:1788201238.711671:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201238.711691:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1cec7 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ab0 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.711796:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1cece lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.711827:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1cece lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.711837:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1cece lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.711851:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1ced5 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.711858:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1ced5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.711876:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1ced5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201238.712180:0:66313:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x394:0x0], index 0: 0 00010000:00010000:0.0:1788201238.712319:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1cedc lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.712328:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1cedc lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.712335:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1cedc lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.712367:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1cece lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.712374:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1cece lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.712381:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1cece lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.712394:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1cece lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.712400:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782ce00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201238.712404:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1cece lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.712411:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1cece lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.712423:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201238.712426:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201238.712430:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1cece lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.712437:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1cece lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201238.712449:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e36d3a5 reply state 000000006717a9d0 transno 124554051643 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1ced5 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.712458:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1ced5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.712464:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff8dc0048bef00) 00010000:00010000:0.0:1788201238.712466:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201238.712468:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201238.712494:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1cec7 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ab0 expref: 128 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.712506:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1cedc lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ab0 expref: 127 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.712518:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff8dc0048beb00) 00010000:00010000:0.0:1788201238.712520:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201238.712523:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782c800, rc 0) 00000100:00100000:0.0:1788201238.712589:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+128:73596:x1875060695457024:12345-192.168.201.20@tcp:101:touch.0 Request processed in 941us (1116us total) trans 124554051643 rc 0/0 00000100:00100000:0.0:1788201238.712597:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1525 00000100:00100000:1.0:1788201238.720678:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201238.720780:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695457280 00000100:00100000:2.0:1788201238.720803:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695457280 00000100:00100000:2.0:1788201238.720872:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1526 00000100:00100000:2.0:1788201238.720882:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+128:73596:x1875060695457280:12345-192.168.201.20@tcp:36:touch.0 00010000:00010000:2.0:1788201238.720940:0:66312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201238.720967:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1cedc lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ab0 expref: 128 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.720985:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff8dc0048beb00) 00010000:00010000:2.0:1788201238.720995:0:66312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201238.721104:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1ceea lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.721118:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1ceea lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.721129:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1ceea lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201238.721253:0:66312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005188ba1 reply state 00000000057704a5 transno 124554051644 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1ceea lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.721265:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1ceea lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201238.721272:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff8dc1207c9500) 00010000:00010000:2.0:1788201238.721274:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201238.721277:0:66312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201238.721368:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+129:73596:x1875060695457280:12345-192.168.201.20@tcp:36:touch.0 Request processed in 486us (700us total) trans 124554051644 rc 0/0 00000100:00100000:2.0:1788201238.721376:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1526 00000100:00100000:2.0:1788201238.724974:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201238.725145:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695457408 00000100:00100000:0.0:1788201238.725157:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695457408 00000100:00100000:0.0:1788201238.725224:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1527 00000100:00100000:0.0:1788201238.725235:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+129:73596:x1875060695457408:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:0.0:1788201238.725261:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201238.725283:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1cef1 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ab7 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.725345:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1cef1 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ab7 expref: 130 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.725360:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1cef1 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ab7 expref: 130 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.725378:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff8dc1207c9500) 00010000:00010000:0.0:1788201238.725381:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788201238.725385:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782d000, rc 0) 00000100:00100000:0.0:1788201238.725436:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+130:73596:x1875060695457408:12345-192.168.201.20@tcp:101:touch.0 Request processed in 202us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201238.725459:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1527 00000100:00100000:1.0:1788201238.728872:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201238.728972:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695457536 00000100:00100000:2.0:1788201238.728984:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695457536 00000100:00100000:2.0:1788201238.729079:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5950 00000100:00100000:2.0:1788201238.729090:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+23:2400:x1875060695457536:12345-192.168.201.20@tcp:2:touch.0 00000100:00100000:2.0:1788201238.729322:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+24:2400:x1875060695457536:12345-192.168.201.20@tcp:2:touch.0 Request processed in 232us (466us total) trans 4294969477 rc 0/0 00000100:00100000:2.0:1788201238.729330:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5950 00000100:00100000:1.0:1788201238.737210:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.737284:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695457792 00000100:00100000:3.0:1788201238.737294:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695457792 00000100:00100000:3.0:1788201238.737356:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 263 00000100:00100000:3.0:1788201238.737367:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107db4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+130:73596:x1875060695457792:12345-192.168.201.20@tcp:35:touch.0 00000100:00100000:3.0:1788201238.737681:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107db4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+131:73596:x1875060695457792:12345-192.168.201.20@tcp:35:touch.0 Request processed in 315us (481us total) trans 124554051645 rc 0/0 00000100:00100000:3.0:1788201238.737690:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 263 00000100:00100000:1.0:1788201238.740780:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201238.740899:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695458048 00000100:00100000:0.0:1788201238.740909:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695458048 00000100:00100000:0.0:1788201238.740968:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1528 00000100:00100000:0.0:1788201238.740979:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+131:73596:x1875060695458048:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:0.0:1788201238.741001:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201238.741055:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1cef8 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786abe expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.741154:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1ceff lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.741170:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1ceff lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.741182:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1ceff lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.741198:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1cf06 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.741206:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1cf06 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.741212:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1cf06 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201238.741481:0:66314:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x395:0x0], index 0: 0 00010000:00010000:0.0:1788201238.741601:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1cf0d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.741638:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1cf0d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.741646:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1cf0d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.741679:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1ceff lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.741686:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1ceff lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.741692:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1ceff lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.741699:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1ceff lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.741705:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201238.741710:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1ceff lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.741716:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1ceff lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.741727:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201238.741730:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201238.741735:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1ceff lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.741740:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1ceff lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201238.741761:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001728c306 reply state 000000001adfecfa transno 124554051646 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1cf06 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.741771:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1cf06 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.741777:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff8dc0048beb00) 00010000:00010000:0.0:1788201238.741779:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201238.741782:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201238.741813:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1cef8 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786abe expref: 134 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.741827:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1cf0d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786abe expref: 133 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201238.741834:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff8dc103255800) 00010000:00010000:0.0:1788201238.741836:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201238.741839:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896bc00, rc 0) 00000100:00100000:0.0:1788201238.741900:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+134:73596:x1875060695458048:12345-192.168.201.20@tcp:101:touch.0 Request processed in 922us (1129us total) trans 124554051646 rc 0/0 00000100:00100000:0.0:1788201238.741909:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1528 00000100:00100000:2.0:1788201238.745553:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.745620:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695458304 00000100:00100000:3.0:1788201238.745637:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695458304 00000100:00100000:3.0:1788201238.745688:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1529 00000100:00100000:3.0:1788201238.745697:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+134:73596:x1875060695458304:12345-192.168.201.20@tcp:36:touch.0 00010000:00010000:3.0:1788201238.745751:0:66757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201238.745775:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896bc00/0x96d0c9b8c9a1cf0d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786abe expref: 134 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.745794:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff8dc103255800) 00010000:00010000:3.0:1788201238.745803:0:66757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201238.745849:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9c00/0x96d0c9b8c9a1cf1b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.745870:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9c00/0x96d0c9b8c9a1cf1b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.745880:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9c00/0x96d0c9b8c9a1cf1b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201238.745974:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad2eaae6 reply state 000000001a2210e3 transno 124554051647 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9c00/0x96d0c9b8c9a1cf1b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.745985:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9c00/0x96d0c9b8c9a1cf1b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.745991:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff8dc103a3a300) 00010000:00010000:3.0:1788201238.746004:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201238.746007:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201238.746122:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+135:73596:x1875060695458304:12345-192.168.201.20@tcp:36:touch.0 Request processed in 425us (578us total) trans 124554051647 rc 0/0 00000100:00100000:3.0:1788201238.746129:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1529 00000100:00100000:1.0:1788201238.748969:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.749080:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695458432 00000100:00100000:3.0:1788201238.749090:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695458432 00000100:00100000:3.0:1788201238.749140:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1530 00000100:00100000:3.0:1788201238.749150:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+135:73596:x1875060695458432:12345-192.168.201.20@tcp:101:touch.0 00010000:00010000:3.0:1788201238.749172:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201238.749194:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9600/0x96d0c9b8c9a1cf22 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ac5 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.749260:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9600/0x96d0c9b8c9a1cf22 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ac5 expref: 136 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.749274:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9600/0x96d0c9b8c9a1cf22 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ac5 expref: 136 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201238.749294:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff8dc103a3a300) 00010000:00010000:3.0:1788201238.749297:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788201238.749300:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc11cda9600, rc 0) 00000100:00100000:3.0:1788201238.749359:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+136:73596:x1875060695458432:12345-192.168.201.20@tcp:101:touch.0 Request processed in 210us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201238.749366:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1530 00000100:00100000:1.0:1788201238.755822:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.755925:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695458560 00000100:00100000:3.0:1788201238.755935:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695458560 00000100:00100000:3.0:1788201238.755999:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5951 00000100:00100000:3.0:1788201238.756064:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+24:2401:x1875060695458560:12345-192.168.201.20@tcp:2:touch.0 00000100:00100000:3.0:1788201238.756340:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+25:2401:x1875060695458560:12345-192.168.201.20@tcp:2:touch.0 Request processed in 278us (527us total) trans 4294969478 rc 0/0 00000100:00100000:3.0:1788201238.756348:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5951 00000100:00100000:2.0:1788201238.759081:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201238.759314:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695458816 00000100:00100000:3.0:1788201238.759324:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695458816 00000100:00100000:3.0:1788201238.759375:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 264 00000100:00100000:3.0:1788201238.759383:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+136:73596:x1875060695458816:12345-192.168.201.20@tcp:35:touch.0 00000100:00100000:3.0:1788201238.759738:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+137:73596:x1875060695458816:12345-192.168.201.20@tcp:35:touch.0 Request processed in 354us (664us total) trans 124554051648 rc 0/0 00000100:00100000:3.0:1788201238.759747:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 264 00010000:00010000:1.0:1788201239.313166:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201239.887381:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201239.887406:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715281024:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201239.887481:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201239.887572:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715281024 00000100:00100000:3.0:1788201239.887580:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715281024 00000100:00100000:3.0:1788201239.887657:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2352 00000100:00100000:3.0:1788201239.887667:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715281024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201239.887687:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1788201239.887729:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715281024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201239.887735:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2352 00000100:00080000:1.0:1788201239.887803:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201239.887837:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715281024:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201239.890491:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715281152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201239.890563:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201239.890725:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715281152 00000100:00100000:2.0:1788201239.890734:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715281152 00000100:00100000:2.0:1788201239.890796:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2353 00000100:00100000:2.0:1788201239.890808:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715281152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201239.890851:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201239.890903:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715281152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201239.890912:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2353 00000100:00100000:2.0:1788201239.890960:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715281152:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788201239.891130:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788201240.335789:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201240.747135:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201240.749113:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695458944 00000100:00100000:2.0:1788201240.749128:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695458944 00000100:00100000:2.0:1788201240.749224:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1531 00000100:00100000:2.0:1788201240.749235:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+137:73626:x1875060695458944:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:2.0:1788201240.749276:0:66312:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:2.0:1788201240.749360:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+137:73626:x1875060695458944:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 128us (2237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201240.749385:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1531 00000100:00080000:1.0:1788201240.749681:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201240.752680:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201240.752756:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695459072 00000100:00100000:0.0:1788201240.752765:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695459072 00000100:00100000:0.0:1788201240.752832:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1532 00000100:00100000:0.0:1788201240.752844:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:73626:x1875060695459072:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:0.0:1788201240.752883:0:69485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:0.0:1788201240.752975:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:73626:x1875060695459072:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 134us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201240.752999:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1532 00000100:00080000:1.0:1788201240.754809:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201240.759471:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201240.759524:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695459200 00000100:00100000:3.0:1788201240.759535:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695459200 00000100:00100000:3.0:1788201240.759617:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2354 00000100:00100000:3.0:1788201240.759629:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+25:73626:x1875060695459200:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:3.0:1788201240.759662:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00080000:1.0:1788201240.759675:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201240.759747:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+25:73626:x1875060695459200:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 120us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201240.759755:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2354 00000100:00100000:2.0:1788201240.762245:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201240.762410:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695459328 00000100:00100000:3.0:1788201240.762419:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695459328 00000100:00100000:3.0:1788201240.762487:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2355 00000100:00100000:3.0:1788201240.762498:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:73626:x1875060695459328:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:3.0:1788201240.762523:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201240.762599:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:73626:x1875060695459328:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 103us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201240.762607:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2355 00000100:00080000:1.0:1788201240.763750:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788201241.360646:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788201241.616382:0:94457:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051648 is committed 00010000:00010000:0.0:1788201241.616536:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1cad0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616549:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1cad0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616557:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1cad0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616564:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896a800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.616570:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1cad0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616578:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1cad0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616599:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff8dc0048bed00) 00010000:00010000:0.0:1788201241.616603:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.616608:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1cad0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616613:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1cad0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616636:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1cad7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616642:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1cad7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616663:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1cad7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616669:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896a000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.616672:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1cad7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616678:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1cad7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616688:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201241.616690:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.616693:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1cad7 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616700:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1cad7 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616717:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1cb32 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616723:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1cb32 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616728:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1cb32 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616733:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.616736:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1cb32 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616751:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1cb32 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616762:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201241.616765:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788201241.616768:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1cb32 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616773:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1cb32 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616790:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1cb63 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616796:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1cb63 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616802:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1cb63 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616807:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.616823:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1cb63 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616830:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1cb63 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616839:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff8dc005cc6400) 00010000:00010000:0.0:1788201241.616841:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.616844:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1cb63 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616857:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1cb63 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616876:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1cb78 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616881:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1cb78 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616887:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1cb78 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616891:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.616894:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1cb78 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616899:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1cb78 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616907:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff8dc11248cb00) 00010000:00010000:0.0:1788201241.616910:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.616912:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1cb78 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616918:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1cb78 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616928:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1cb94 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616935:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1cb94 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616948:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1cb94 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616952:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.616954:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1cb94 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616960:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1cb94 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616969:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff8dc11248c200) 00010000:00010000:0.0:1788201241.616971:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.616973:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1cb94 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616980:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1cb94 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.616999:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1cba9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617004:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1cba9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617009:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1cba9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617013:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.617063:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1cba9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617080:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1cba9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617089:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff8dc11248c900) 00010000:00010000:0.0:1788201241.617091:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.617094:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1cba9 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617099:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1cba9 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617111:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1cbc5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617125:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1cbc5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617131:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1cbc5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617136:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.617138:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1cbc5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617144:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1cbc5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617152:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff8dc11248cc00) 00010000:00010000:0.0:1788201241.617153:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.617156:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1cbc5 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617169:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1cbc5 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617185:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1cbda lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617192:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1cbda lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617199:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1cbda lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617205:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.617208:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1cbda lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617213:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1cbda lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617223:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff8dc11248c300) 00010000:00010000:0.0:1788201241.617226:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.617229:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1cbda lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617234:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1cbda lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617245:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1cbf6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617251:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1cbf6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617264:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1cbf6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617269:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896b200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.617272:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1cbf6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617278:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1cbf6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617286:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff8dc0048bec00) 00010000:00010000:0.0:1788201241.617288:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.617290:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1cbf6 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617296:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1cbf6 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617310:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1cc0b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617316:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1cc0b lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617321:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1cc0b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617326:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.617329:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1cc0b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617344:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1cc0b lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617354:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff8dc11248c400) 00010000:00010000:0.0:1788201241.617356:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.617359:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1cc0b lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617365:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030600/0x96d0c9b8c9a1cc0b lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617378:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2800/0x96d0c9b8c9a1cc27 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617383:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2800/0x96d0c9b8c9a1cc27 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617389:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2800/0x96d0c9b8c9a1cc27 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617394:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.617396:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2800/0x96d0c9b8c9a1cc27 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617401:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2800/0x96d0c9b8c9a1cc27 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617408:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff8dc005cc6a00) 00010000:00010000:0.0:1788201241.617410:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.617413:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2800/0x96d0c9b8c9a1cc27 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617425:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2800/0x96d0c9b8c9a1cc27 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617439:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030000/0x96d0c9b8c9a1cc3c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617445:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030000/0x96d0c9b8c9a1cc3c lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617451:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030000/0x96d0c9b8c9a1cc3c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617455:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.617458:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030000/0x96d0c9b8c9a1cc3c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617463:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030000/0x96d0c9b8c9a1cc3c lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617473:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff8dc11248c800) 00010000:00010000:0.0:1788201241.617476:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.617479:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030000/0x96d0c9b8c9a1cc3c lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617485:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030000/0x96d0c9b8c9a1cc3c lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617494:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cc58 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617500:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cc58 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617510:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cc58 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617515:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896ac00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.617517:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cc58 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617524:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cc58 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617531:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff8dc0048be600) 00010000:00010000:0.0:1788201241.617534:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.617537:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cc58 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617543:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cc58 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617561:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1cc6d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617566:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1cc6d lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617572:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1cc6d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617577:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2e00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.617580:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1cc6d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617598:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1cc6d lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201241.617598:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969478 is committed 00010000:00010000:0.0:1788201241.617614:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff8dc0048be700) 00000001:00080000:1.0:1788201241.617616:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969474 is committed 00010000:00010000:0.0:1788201241.617617:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.617623:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1cc6d lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617630:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1cc6d lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617646:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1cc89 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617652:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1cc89 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617658:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1cc89 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617664:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.617666:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1cc89 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617672:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1cc89 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617681:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff8dc0048be000) 00010000:00010000:0.0:1788201241.617683:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.617686:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1cc89 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617699:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1cc89 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617716:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1cc9e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617722:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1cc9e lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617727:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1cc9e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617732:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.617735:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1cc9e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617741:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1cc9e lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617748:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff8dc11248ce00) 00010000:00010000:0.0:1788201241.617751:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.617754:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1cc9e lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617759:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1cc9e lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617769:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1ccba lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617775:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1ccba lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617787:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1ccba lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617792:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfe00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.617795:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1ccba lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617800:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1ccba lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617808:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff8dc12196e700) 00010000:00010000:0.0:1788201241.617822:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.617825:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1ccba lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617831:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1ccba lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617847:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1cccf lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617852:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1cccf lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617858:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1cccf lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617862:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.617864:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1cccf lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617880:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1cccf lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617889:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff8dc0048be500) 00010000:00010000:0.0:1788201241.617891:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.617894:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1cccf lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617899:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1cccf lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617910:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1cceb lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617932:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1cceb lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617938:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1cceb lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617944:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.617947:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1cceb lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617953:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1cceb lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617962:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff8dc005cc6100) 00010000:00010000:0.0:1788201241.617964:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.617967:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1cceb lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617981:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1cceb lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.617997:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1cd00 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618003:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1cd00 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618009:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1cd00 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618049:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.618054:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1cd00 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618061:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1cd00 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618070:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff8dc005cc6c00) 00010000:00010000:0.0:1788201241.618072:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.618074:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1cd00 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618080:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1cd00 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618091:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cd1c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618098:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cd1c lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618111:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cd1c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618116:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.618119:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cd1c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618125:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cd1c lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618134:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff8dc005cc6200) 00010000:00010000:0.0:1788201241.618136:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.618139:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cd1c lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618144:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cd1c lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618158:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1cd31 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618164:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1cd31 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618169:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1cd31 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618174:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.618177:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1cd31 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618194:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1cd31 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618203:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff8dc005cc6f00) 00010000:00010000:0.0:1788201241.618205:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.618207:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1cd31 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618213:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1cd31 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618224:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673a00/0x96d0c9b8c9a1cd4d lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618230:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673a00/0x96d0c9b8c9a1cd4d lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618235:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673a00/0x96d0c9b8c9a1cd4d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618240:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101673a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.618242:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673a00/0x96d0c9b8c9a1cd4d lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618248:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673a00/0x96d0c9b8c9a1cd4d lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618255:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff8dc11248ca00) 00010000:00010000:0.0:1788201241.618257:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.618260:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673a00/0x96d0c9b8c9a1cd4d lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618273:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673a00/0x96d0c9b8c9a1cd4d lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618288:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1cd62 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618294:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1cd62 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618299:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1cd62 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618304:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.618307:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1cd62 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618313:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1cd62 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618320:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff8dc005cc6500) 00010000:00010000:0.0:1788201241.618323:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.618326:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1cd62 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618331:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1cd62 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618340:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673200/0x96d0c9b8c9a1cd7e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618346:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673200/0x96d0c9b8c9a1cd7e lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618358:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673200/0x96d0c9b8c9a1cd7e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618363:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101673200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.618366:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673200/0x96d0c9b8c9a1cd7e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618373:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673200/0x96d0c9b8c9a1cd7e lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618382:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff8dc11248cd00) 00010000:00010000:0.0:1788201241.618384:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.618386:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673200/0x96d0c9b8c9a1cd7e lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618392:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673200/0x96d0c9b8c9a1cd7e lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618407:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1cd93 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618413:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1cd93 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618418:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1cd93 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618422:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.618425:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1cd93 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618440:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1cd93 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618448:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff8dc005cc6800) 00010000:00010000:0.0:1788201241.618450:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.618452:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1cd93 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618457:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1cd93 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618468:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1cdaf lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618474:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1cdaf lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618480:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1cdaf lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618484:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.618487:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1cdaf lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618492:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1cdaf lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618498:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff8dc12196e800) 00010000:00010000:0.0:1788201241.618500:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.618502:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1cdaf lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618513:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1cdaf lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618529:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1cdc4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618535:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1cdc4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618540:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1cdc4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618544:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.618548:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1cdc4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618554:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1cdc4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618562:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff8dc0048be900) 00010000:00010000:0.0:1788201241.618564:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.618566:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1cdc4 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618571:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1cdc4 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618580:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1cde0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618586:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1cde0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618598:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1cde0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618603:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.618605:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1cde0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618611:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1cde0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618619:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff8dc005cc6000) 00010000:00010000:0.0:1788201241.618621:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.618623:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1cde0 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618628:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1cde0 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618643:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cdf5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618649:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cdf5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618654:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cdf5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618658:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896ae00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.618661:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cdf5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618675:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cdf5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618683:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff8dc0048be200) 00010000:00010000:0.0:1788201241.618685:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.618689:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cdf5 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618694:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cdf5 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618707:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1ce11 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618713:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1ce11 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618718:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1ce11 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618723:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.618726:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1ce11 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618731:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1ce11 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618739:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff8dc0048be400) 00010000:00010000:0.0:1788201241.618741:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.618743:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1ce11 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618756:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1ce11 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618775:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1ce26 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618781:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1ce26 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618787:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1ce26 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618792:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.618795:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1ce26 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618800:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1ce26 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.618808:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff8dc12196e200) 00010000:00010000:0.0:1788201241.619851:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.619858:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1ce26 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.619867:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1ce26 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.619887:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1ce42 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.619894:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1ce42 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.619912:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1ce42 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.622805:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896a600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.622822:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1ce42 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.622833:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1ce42 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.622853:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff8dc12196ec00) 00010000:00010000:0.0:1788201241.622856:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.622861:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1ce42 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.622867:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1ce42 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.622905:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1ce57 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.622912:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1ce57 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.624061:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1ce57 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.624068:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.624073:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1ce57 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.624101:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1ce57 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.624125:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff8dc0048be800) 00010000:00010000:0.0:1788201241.624128:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.624133:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1ce57 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.624829:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1ce57 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.624855:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672000/0x96d0c9b8c9a1ce73 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.624862:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672000/0x96d0c9b8c9a1ce73 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.624868:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672000/0x96d0c9b8c9a1ce73 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.624872:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101672000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.624876:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672000/0x96d0c9b8c9a1ce73 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.624881:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672000/0x96d0c9b8c9a1ce73 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.624892:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff8dc11248c500) 00010000:00010000:0.0:1788201241.624895:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.624898:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672000/0x96d0c9b8c9a1ce73 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.624912:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672000/0x96d0c9b8c9a1ce73 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625002:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1ce88 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625009:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1ce88 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625036:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1ce88 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625041:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.625044:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1ce88 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625050:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1ce88 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625060:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff8dc103a3a600) 00010000:00010000:0.0:1788201241.625063:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.625066:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1ce88 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625072:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1ce88 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625084:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1cea4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625090:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1cea4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625102:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1cea4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625108:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101673c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.625111:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1cea4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625117:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1cea4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625126:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff8dc103a3a400) 00010000:00010000:0.0:1788201241.625128:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.625131:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1cea4 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625212:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1cea4 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625229:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1ceb9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625235:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1ceb9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625240:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1ceb9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625245:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.625248:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1ceb9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625264:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1ceb9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625273:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff8dc0048be100) 00010000:00010000:0.0:1788201241.625276:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.625279:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1ceb9 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625285:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1ceb9 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625297:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1ced5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625303:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1ced5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625309:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1ced5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625314:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.625316:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1ced5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625322:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1ced5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625329:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff8dc0048bef00) 00010000:00010000:0.0:1788201241.625331:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.625333:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1ced5 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625345:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1ced5 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625362:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1ceea lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625368:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1ceea lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625374:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1ceea lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625379:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.625383:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1ceea lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625389:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1ceea lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625398:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff8dc1207c9500) 00010000:00010000:0.0:1788201241.625401:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.625404:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1ceea lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625410:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1ceea lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625423:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1cf06 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625429:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1cf06 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625441:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1cf06 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625447:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.625450:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1cf06 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625457:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1cf06 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625466:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff8dc0048beb00) 00010000:00010000:0.0:1788201241.625469:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.625471:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1cf06 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625476:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1cf06 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625492:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9c00/0x96d0c9b8c9a1cf1b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625498:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9c00/0x96d0c9b8c9a1cf1b lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625502:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9c00/0x96d0c9b8c9a1cf1b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625507:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda9c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.625509:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9c00/0x96d0c9b8c9a1cf1b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625523:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9c00/0x96d0c9b8c9a1cf1b lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625531:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff8dc103a3a300) 00010000:00010000:0.0:1788201241.625533:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.625536:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9c00/0x96d0c9b8c9a1cf1b lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.625541:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9c00/0x96d0c9b8c9a1cf1b lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201241.822265:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201241.823731:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695459584 00000100:00100000:0.0:1788201241.823749:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695459584 00000100:00100000:0.0:1788201241.823820:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1533 00000100:00100000:0.0:1788201241.823831:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+31:73667:x1875060695459584:12345-192.168.201.20@tcp:36:mcreate.0 00010000:00010000:0.0:1788201241.823889:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201241.823920:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1cb0f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78699f expref: 31 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.823938:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:0.0:1788201241.823943:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201241.824176:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cf29 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.824191:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cf29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.824201:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cf29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.824231:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1cf30 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.824240:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1cf30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.824246:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1cf30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.826735:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cf29 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.826750:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cf29 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.826756:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cf29 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.826762:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cf29 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.826767:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896ac00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.826771:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cf29 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.826779:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cf29 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.826795:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:0.0:1788201241.826798:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.826802:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cf29 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.826831:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cf29 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201241.826844:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000113f8e80 reply state 0000000068b1b2d5 transno 124554051649 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1cf30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.826856:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1cf30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.826862:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc111a9dd00) 00010000:00010000:0.0:1788201241.826865:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201241.826869:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201241.831574:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+32:73667:x1875060695459584:12345-192.168.201.20@tcp:36:mcreate.0 Request processed in 7733us (9307us total) trans 124554051649 rc 0/0 00000100:00100000:0.0:1788201241.831588:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1533 00000100:00100000:1.0:1788201241.872107:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201241.872256:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695459712 00000100:00100000:0.0:1788201241.872267:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695459712 00000100:00100000:0.0:1788201241.872876:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1534 00000100:00100000:0.0:1788201241.872888:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+32:73670:x1875060695459712:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1788201241.872912:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201241.872934:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cf37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786acc expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.873060:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1cf3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.873074:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1cf3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.873095:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1cf3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201241.873138:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201241.873142:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201241.873161:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1cf3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.873186:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cf37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786acc expref: 34 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.873202:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1cf3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786acc expref: 33 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.873210:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:0.0:1788201241.873213:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201241.873217:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896be00, rc 0) 00000100:00100000:0.0:1788201241.873280:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+33:73670:x1875060695459712:12345-192.168.201.20@tcp:101:rm.0 Request processed in 393us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201241.873288:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1534 00000100:00100000:2.0:1788201241.884664:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201241.884763:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695459840 00000100:00100000:3.0:1788201241.884853:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695459840 00000100:00100000:3.0:1788201241.884937:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1535 00000100:00100000:3.0:1788201241.884948:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+33:73670:x1875060695459840:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:3.0:1788201241.884978:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201241.885000:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1cf45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ad3 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885097:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9000/0x96d0c9b8c9a1cf4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885112:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9000/0x96d0c9b8c9a1cf4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885123:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9000/0x96d0c9b8c9a1cf4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885157:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1cf53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885165:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1cf53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885172:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1cf53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885282:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9e00/0x96d0c9b8c9a1cf5a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885291:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9e00/0x96d0c9b8c9a1cf5a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885308:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9e00/0x96d0c9b8c9a1cf5a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201241.885351:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x1a:0x0]: returning size 0 00000004:00200000:3.0:1788201241.885355:0:66313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201241.885374:0:66313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9e00/0x96d0c9b8c9a1cf5a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885385:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9e00/0x96d0c9b8c9a1cf5a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885393:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9000/0x96d0c9b8c9a1cf4c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885400:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9000/0x96d0c9b8c9a1cf4c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885416:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9000/0x96d0c9b8c9a1cf4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885423:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9000/0x96d0c9b8c9a1cf4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885428:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda9000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201241.885433:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9000/0x96d0c9b8c9a1cf4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885440:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9000/0x96d0c9b8c9a1cf4c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885452:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:3.0:1788201241.885456:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201241.885460:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9000/0x96d0c9b8c9a1cf4c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885467:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9000/0x96d0c9b8c9a1cf4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885480:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1cf53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885487:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1cf53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885493:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1cf53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885508:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda8800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201241.885517:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1cf53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885524:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1cf53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885532:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc111a9dd00) 00010000:00010000:3.0:1788201241.885534:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201241.885538:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1cf53 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885543:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1cf53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885569:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1cf45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ad3 expref: 35 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885582:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9e00/0x96d0c9b8c9a1cf5a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ad3 expref: 34 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201241.885589:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff8dc007bc4000) 00010000:00010000:3.0:1788201241.885591:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201241.885593:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc11cda9e00, rc 0) 00000100:00100000:3.0:1788201241.885651:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+34:73670:x1875060695459840:12345-192.168.201.20@tcp:101:rm.0 Request processed in 705us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201241.885658:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1535 00000100:00100000:3.0:1788201241.894488:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201241.894633:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695460096 00000100:00100000:0.0:1788201241.894645:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695460096 00000100:00100000:0.0:1788201241.894764:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1536 00000100:00100000:0.0:1788201241.894785:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+34:73670:x1875060695460096:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:0.0:1788201241.894846:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788201241.894873:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9e00/0x96d0c9b8c9a1cf5a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ad3 expref: 34 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.894915:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff8dc007bc4000) 00010000:00010000:0.0:1788201241.894935:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1cf3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786acc expref: 33 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.894944:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:0.0:1788201241.894948:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201241.894983:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cf61 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.894998:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cf61 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895007:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cf61 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895061:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1cf68 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895069:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1cf68 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895075:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1cf68 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895167:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1cf6f lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895176:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1cf6f lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895194:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1cf6f lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895676:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cf76 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895686:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cf76 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895693:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cf76 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895698:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cf76 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895704:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cf76 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895709:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cf76 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895732:0:66314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201241.895751:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1cf6f lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895757:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1cf6f lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895762:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1cf6f lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895767:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896a000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.895778:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1cf6f lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895786:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1cf6f lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895796:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff8dc111a9df00) 00010000:00010000:0.0:1788201241.895799:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201241.895803:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1cf6f lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895819:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1cf6f lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895834:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cf61 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895840:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cf61 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895845:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cf61 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895850:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cf61 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895854:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896ac00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201241.895857:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cf61 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895862:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cf61 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895879:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:0.0:1788201241.895882:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201241.895885:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cf61 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895890:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1cf61 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201241.895898:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000acdc8e2a reply state 00000000462a8aa5 transno 124554051650 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1cf68 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895908:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1cf68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201241.895920:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc111a9dd00) 00010000:00010000:0.0:1788201241.895923:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201241.895925:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201241.896004:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+34:73670:x1875060695460096:12345-192.168.201.20@tcp:36:rm.0 Request processed in 1229us (1521us total) trans 124554051650 rc 0/0 00000100:00100000:0.0:1788201241.896013:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1536 00010000:00010000:2.0:1788201241.896128:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201241.896136:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cf76 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201241.896142:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896ae00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201241.896146:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cf76 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201241.896152:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cf76 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201241.896161:0:24979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x1a:0x0].0x0 (ffff8dc111a9df00) 00010000:00010000:2.0:1788201241.896163:0:24979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788201241.896166:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cf76 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201241.896172:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1cf76 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201241.896186:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201241.896188:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201241.896189:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201241.935546:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715281408:0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.935617:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201241.935652:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715281920:0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.935678:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201241.935717:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715282432:0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.935740:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201241.935766:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788201241.935771:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715281536:0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.935792:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201241.935820:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715282048:0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.935843:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201241.935862:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715282560:0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.935883:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201241.935918:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715281920 00000100:00100000:2.0:1788201241.935925:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715281920 00000100:00100000:2.0:1788201241.935973:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715282432 00000100:00100000:2.0:1788201241.935977:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715282432 00000100:00100000:2.0:1788201241.936004:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4093 00000100:00100000:2.0:1788201241.936045:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12580b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715281920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.936096:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12580b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715281920:12345-0@lo:400:kworker.0 Request processed in 83us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201241.936103:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4093 00000100:00100000:1.0:1788201241.936120:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715282048 00000100:00100000:2.0:1788201241.936125:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4094 00000100:00100000:1.0:1788201241.936127:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715282048 00000100:00100000:2.0:1788201241.936134:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715282432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.936169:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715282432:12345-0@lo:400:kworker.0 Request processed in 35us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201241.936176:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715282560 00000100:00100000:2.0:1788201241.936176:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4094 00000100:00100000:1.0:1788201241.936181:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715282560 00000100:00100000:2.0:1788201241.936200:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201241.936210:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2899 00000100:00100000:2.0:1788201241.936212:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715282944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201241.936220:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715282048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.936242:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201241.936262:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715282048:12345-0@lo:400:kworker.0 Request processed in 45us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201241.936269:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2899 00000100:00100000:1.0:1788201241.936284:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2900 00000100:00100000:2.0:1788201241.936287:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715282944 00000100:00100000:1.0:1788201241.936289:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715282560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.936294:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715282944 00000100:00100000:1.0:1788201241.936313:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715282560:12345-0@lo:400:kworker.0 Request processed in 24us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201241.936317:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2900 00000100:00100000:2.0:1788201241.936326:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4095 00000100:00100000:2.0:1788201241.936334:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715282944:12345-0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1788201241.936341:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201241.936354:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715281408 00000100:00100000:1.0:1788201241.936358:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715281408 00000004:00000024:2.0:1788201241.936359:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:1.0:1788201241.936383:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715281536 00000100:00100000:1.0:1788201241.936386:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715281536 00000100:00100000:1.0:1788201241.936404:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1501 00000100:00100000:1.0:1788201241.936410:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715281408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.936410:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715282944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201241.936424:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4095 00000100:00100000:1.0:1788201241.936444:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715281408:12345-0@lo:400:kworker.0 Request processed in 34us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201241.936449:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1501 00000100:00100000:2.0:1788201241.936469:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715282944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201241.936470:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1502 00000100:00100000:1.0:1788201241.936477:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715281536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201241.936503:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715281536:12345-0@lo:400:kworker.0 Request processed in 27us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201241.936507:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715282048:0@lo:400:kworker.0 00000100:00100000:1.0:1788201241.936509:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1502 00000100:00080000:1.0:1788201241.936525:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201241.936526:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969474 gen 2 00000100:00080000:1.0:1788201241.936528:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201241.936541:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715282560:0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.936553:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715281408:0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.936560:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715281920:0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.936568:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715282432:0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.936591:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715281536:0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.936684:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715281280:0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.936721:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201241.936766:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715281792:0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.936791:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201241.936827:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715282304:0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.936850:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201241.936868:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715282816:0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.936889:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201241.936908:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788201241.936914:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715281664:0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.936936:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201241.936953:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715282176:0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.936974:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201241.936989:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715282688:0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.937008:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201241.937039:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715281792 00000100:00100000:1.0:1788201241.937045:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715281792 00000100:00100000:3.0:1788201241.937057:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715282304 00000100:00100000:3.0:1788201241.937063:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715282304 00000100:00100000:1.0:1788201241.937085:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715282816 00000100:00100000:1.0:1788201241.937090:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715282816 00000100:00100000:3.0:1788201241.937090:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715281664 00000100:00100000:3.0:1788201241.937095:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715281664 00000100:00100000:1.0:1788201241.937116:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1503 00000100:00100000:1.0:1788201241.937123:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00515e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715281792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201241.937161:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00515e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715281792:12345-0@lo:400:kworker.0 Request processed in 39us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201241.937976:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1503 00000100:00100000:0.0:1788201241.938009:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1504 00000100:00100000:0.0:1788201241.938045:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715282304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201241.938101:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715282304:12345-0@lo:400:kworker.0 Request processed in 84us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201241.938107:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1504 00000100:00100000:0.0:1788201241.938128:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1505 00000100:00100000:0.0:1788201241.938134:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715282816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201241.938163:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715282816:12345-0@lo:400:kworker.0 Request processed in 30us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201241.938180:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1505 00000100:00100000:0.0:1788201241.938208:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1506 00000100:00100000:0.0:1788201241.938216:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715281664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201241.938246:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715281664:12345-0@lo:400:kworker.0 Request processed in 32us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201241.938251:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1506 00000100:00080000:0.0:1788201241.938287:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201241.938291:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201241.938340:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715281664:0@lo:400:kworker.0 00000100:00100000:0.0:1788201241.938353:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715281792:0@lo:400:kworker.0 00000100:00100000:0.0:1788201241.938362:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715282304:0@lo:400:kworker.0 00000100:00100000:0.0:1788201241.938371:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715282816:0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.939687:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715281280 00000100:00100000:2.0:1788201241.939701:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715281280 00000100:00100000:2.0:1788201241.939763:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788201241.939772:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715281280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.939862:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715281280:12345-0@lo:400:kworker.0 Request processed in 92us (3139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201241.939869:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788201241.939919:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715282176 00000100:00100000:2.0:1788201241.939924:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715282176 00000100:00100000:2.0:1788201241.939970:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715282688 00000100:00100000:2.0:1788201241.939974:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715282688 00000100:00100000:2.0:1788201241.939997:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2901 00000100:00100000:2.0:1788201241.940004:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715282176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.940068:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715282176:12345-0@lo:400:kworker.0 Request processed in 64us (3093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201241.940074:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2901 00000100:00100000:2.0:1788201241.940086:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2902 00000100:00100000:2.0:1788201241.940092:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715282688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201241.940123:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715282688:12345-0@lo:400:kworker.0 Request processed in 31us (3114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201241.940129:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2902 00000100:00080000:0.0:1788201241.940580:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201241.940883:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715282176:0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.940898:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715282688:0@lo:400:kworker.0 00000100:00100000:3.0:1788201241.940909:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715281280:0@lo:400:kworker.0 00010000:00010000:3.0:1788201242.383874:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201242.447252:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715283072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201242.447323:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201242.447393:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715283200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201242.447424:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201242.447461:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715283072 00000100:00100000:1.0:1788201242.447469:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715283072 00000100:00100000:1.0:1788201242.447516:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2356 00000100:00100000:1.0:1788201242.447524:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715283072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201242.447547:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1788201242.447587:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715283072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201242.447609:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2356 00000100:00100000:1.0:1788201242.447634:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715283200 00000100:00100000:1.0:1788201242.447637:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715283200 00000100:00100000:1.0:1788201242.447660:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4096 00000100:00100000:1.0:1788201242.447667:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715283200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201242.447691:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:1.0:1788201242.447724:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715283200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201242.447730:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4096 00000100:00100000:1.0:1788201242.447774:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715283200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201242.447823:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715283072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201242.451308:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715283328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201242.451387:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201242.451580:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715283328 00000100:00100000:2.0:1788201242.451588:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715283328 00000100:00100000:2.0:1788201242.451632:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2357 00000100:00100000:2.0:1788201242.451641:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715283328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201242.451669:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201242.451714:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715283328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201242.451722:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2357 00000100:00100000:2.0:1788201242.451769:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715283328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201242.583455:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201242.583500:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201242.583575:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695460352 00000100:00100000:3.0:1788201242.583588:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695460352 00000100:00100000:3.0:1788201242.583668:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1507 00000100:00100000:3.0:1788201242.583678:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+34:2402:x1875060695460352:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201242.583755:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+34:2402:x1875060695460352:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 79us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201242.583762:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1507 00000100:00080000:1.0:1788201242.584236:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201242.584297:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695460224 00000100:00100000:0.0:1788201242.584303:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695460224 00000100:00100000:0.0:1788201242.584340:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 180 00000100:00100000:0.0:1788201242.584347:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695460224:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201242.584385:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695460224:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 39us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201242.584392:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 180 00000100:00100000:3.0:1788201242.597987:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201242.598046:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201242.598074:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201242.598098:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695460480 00000100:00100000:3.0:1788201242.598120:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695460480 00000100:00100000:3.0:1788201242.598185:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1508 00000100:00100000:3.0:1788201242.598196:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695460480:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201242.598268:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695460480:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 76us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201242.598276:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1508 00000100:00080000:3.0:1788201242.598298:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201242.598698:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695460608 00000100:00100000:0.0:1788201242.598704:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695460608 00000100:00100000:0.0:1788201242.598744:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695460736 00000100:00100000:0.0:1788201242.598748:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695460736 00000100:00100000:0.0:1788201242.598805:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2903 00000100:00100000:0.0:1788201242.598814:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695460608:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201242.598850:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695460608:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 38us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201242.598857:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2903 00000100:00100000:0.0:1788201242.598871:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2904 00000100:00100000:0.0:1788201242.598877:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695460736:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201242.598900:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695460736:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201242.598906:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2904 00000100:00080000:0.0:1788201242.598926:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201242.598928:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788201243.421065:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201244.440433:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201245.007474:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201245.007495:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715283456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201245.007575:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201245.007794:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715283456 00000100:00100000:0.0:1788201245.007803:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715283456 00000100:00100000:0.0:1788201245.007869:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2358 00000100:00100000:0.0:1788201245.007880:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715283456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201245.007908:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201245.007955:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715283456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201245.007962:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2358 00000100:00100000:0.0:1788201245.008007:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715283456:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788201245.008451:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201245.010975:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201245.010996:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715283584:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201245.011099:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201245.011138:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715283584 00000100:00100000:3.0:1788201245.011144:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715283584 00000100:00100000:3.0:1788201245.011185:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2359 00000100:00100000:3.0:1788201245.011194:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715283584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201245.011219:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00010000:00000080:3.0:1788201245.011232:0:8450:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc133369880 x1875060715283584/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:366/0 lens 224/368 e 0 to 0 dl 1788201256 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201245.011287:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715283584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201245.011295:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2359 00000100:00100000:3.0:1788201245.011351:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715283584:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788201245.011708:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788201245.455171:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201246.493597:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201247.056308:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715283712:0@lo:400:kworker.0 00000100:00100000:2.0:1788201247.056375:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201247.056411:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715284224:0@lo:400:kworker.0 00000100:00100000:2.0:1788201247.056437:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201247.056457:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715284736:0@lo:400:kworker.0 00000100:00100000:2.0:1788201247.056477:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201247.056568:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a9b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715285248:0@lo:400:kworker.0 00000100:00100000:2.0:1788201247.056591:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201247.056616:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788201247.056622:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715283840:0@lo:400:kworker.0 00000100:00100000:2.0:1788201247.056646:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201247.056663:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715284352:0@lo:400:kworker.0 00000100:00100000:2.0:1788201247.056686:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201247.056703:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715284864:0@lo:400:kworker.0 00000100:00100000:2.0:1788201247.056735:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201247.056763:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715283968:0@lo:400:kworker.0 00000100:00100000:2.0:1788201247.056787:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201247.056805:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715284480:0@lo:400:kworker.0 00000100:00100000:2.0:1788201247.056826:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201247.056842:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715284992:0@lo:400:kworker.0 00000100:00100000:2.0:1788201247.056861:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201247.056877:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788201247.056882:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715284096:0@lo:400:kworker.0 00000100:00100000:2.0:1788201247.056915:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201247.056926:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715284608:0@lo:400:kworker.0 00000100:00100000:2.0:1788201247.056943:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201247.056959:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715285120:0@lo:400:kworker.0 00000100:00100000:2.0:1788201247.056977:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201247.057003:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715283712 00000100:00100000:2.0:1788201247.057010:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715283712 00000100:00100000:2.0:1788201247.058171:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788201247.058181:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715283712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201247.058250:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715283712:12345-0@lo:400:kworker.0 Request processed in 69us (1874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201247.058258:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788201247.058297:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715284224 00000100:00100000:2.0:1788201247.058303:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715284224 00000100:00100000:2.0:1788201247.058332:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715284736 00000100:00100000:2.0:1788201247.058335:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715284736 00000100:00100000:2.0:1788201247.058346:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715285248 00000100:00100000:2.0:1788201247.058348:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715285248 00000100:00100000:2.0:1788201247.058357:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715283840 00000100:00100000:2.0:1788201247.058360:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715283840 00000100:00100000:2.0:1788201247.058370:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715283968 00000100:00100000:2.0:1788201247.058372:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715283968 00000100:00100000:2.0:1788201247.058384:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715284096 00000100:00100000:2.0:1788201247.058386:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715284096 00000100:00100000:2.0:1788201247.058399:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1509 00000100:00100000:2.0:1788201247.058405:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715284224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201247.058436:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715284224:12345-0@lo:400:kworker.0 Request processed in 31us (1998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201247.058455:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1509 00000100:00100000:2.0:1788201247.058469:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1510 00000100:00100000:2.0:1788201247.058474:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715284736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201247.058819:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1511 00000100:00100000:1.0:1788201247.058828:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715285248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201247.058866:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715285248:12345-0@lo:400:kworker.0 Request processed in 40us (2274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201247.058873:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1511 00000100:00100000:1.0:1788201247.058888:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1512 00000100:00100000:1.0:1788201247.058894:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715283840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201247.058922:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715283840:12345-0@lo:400:kworker.0 Request processed in 28us (2275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201247.058927:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1512 00000100:00100000:1.0:1788201247.058948:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1513 00000100:00100000:1.0:1788201247.058955:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715283968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201247.058990:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715283968:12345-0@lo:400:kworker.0 Request processed in 36us (2202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201247.058996:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1513 00000100:00100000:1.0:1788201247.059007:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1514 00000100:00100000:1.0:1788201247.059013:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715284096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201247.059139:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715284096:12345-0@lo:400:kworker.0 Request processed in 126us (2223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201247.059146:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1514 00000100:00100000:1.0:1788201247.059165:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715284480 00000100:00100000:1.0:1788201247.059170:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715284480 00000100:00100000:1.0:1788201247.059199:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715284992 00000100:00100000:1.0:1788201247.059202:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715284992 00000100:00100000:1.0:1788201247.059217:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715284608 00000100:00100000:1.0:1788201247.059219:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715284608 00000100:00100000:1.0:1788201247.059234:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715285120 00000100:00100000:1.0:1788201247.059237:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715285120 00000100:00100000:1.0:1788201247.059254:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2905 00000100:00100000:1.0:1788201247.059260:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715284480:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788201247.059273:0:26209:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11cc46300 x1875060715284480/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:368/0 lens 224/224 e 0 to 0 dl 1788201258 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201247.059301:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715284480:12345-0@lo:400:kworker.0 Request processed in 42us (2474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201247.059307:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2905 00000100:00100000:1.0:1788201247.059321:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2906 00000100:00100000:1.0:1788201247.059326:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715284992:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788201247.059344:0:26209:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11cc45f80 x1875060715284992/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:368/0 lens 224/224 e 0 to 0 dl 1788201258 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201247.059371:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715284992:12345-0@lo:400:kworker.0 Request processed in 45us (2509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201247.059377:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2906 00000100:00100000:1.0:1788201247.059388:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2907 00000100:00100000:1.0:1788201247.059394:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715284608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201247.059420:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715284608:12345-0@lo:400:kworker.0 Request processed in 26us (2476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201247.059425:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2907 00000100:00100000:1.0:1788201247.059435:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2908 00000100:00100000:1.0:1788201247.059441:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715285120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201247.059463:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715285120:12345-0@lo:400:kworker.0 Request processed in 22us (2486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201247.059469:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2908 00000100:00100000:2.0:1788201247.060165:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715284736:12345-0@lo:400:kworker.0 Request processed in 1689us (3685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201247.060174:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1510 00000100:00100000:2.0:1788201247.060208:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715284352 00000100:00100000:2.0:1788201247.060213:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715284352 00000100:00100000:2.0:1788201247.061656:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715284864 00000100:00100000:2.0:1788201247.061664:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715284864 00000100:00100000:3.0:1788201247.061796:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4097 00000100:00100000:3.0:1788201247.061809:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715284352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201247.061878:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715284352:12345-0@lo:400:kworker.0 Request processed in 73us (5190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201247.061885:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4097 00000100:00100000:3.0:1788201247.061904:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4098 00000100:00100000:3.0:1788201247.061910:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715284864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201247.061938:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715284864:12345-0@lo:400:kworker.0 Request processed in 28us (5201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201247.061943:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4098 00000100:00100000:0.0:1788201247.062167:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715284096:0@lo:400:kworker.0 00000100:00100000:0.0:1788201247.062181:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715284608:0@lo:400:kworker.0 00000100:00100000:0.0:1788201247.062193:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715285120:0@lo:400:kworker.0 00000100:00100000:0.0:1788201247.062217:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715283968:0@lo:400:kworker.0 00000100:00100000:0.0:1788201247.062228:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715284480:0@lo:400:kworker.0 00000100:00100000:0.0:1788201247.062239:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715284992:0@lo:400:kworker.0 00000100:00100000:1.0:1788201247.063301:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715285376:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201247.063356:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201247.063421:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715285376 00000100:00100000:1.0:1788201247.063427:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715285376 00000100:00100000:1.0:1788201247.063465:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4099 00000100:00100000:1.0:1788201247.063472:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715285376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201247.063515:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:1.0:1788201247.063558:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715285376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201247.063564:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4099 00000100:00100000:1.0:1788201247.063776:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715285376:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201247.068365:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715283840:0@lo:400:kworker.0 00000100:00100000:2.0:1788201247.068385:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715284352:0@lo:400:kworker.0 00000100:00100000:2.0:1788201247.068396:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715284864:0@lo:400:kworker.0 00000100:00100000:2.0:1788201247.068407:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715283712:0@lo:400:kworker.0 00000100:00100000:2.0:1788201247.068419:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715284224:0@lo:400:kworker.0 00000100:00100000:2.0:1788201247.068430:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715284736:0@lo:400:kworker.0 00000100:00100000:2.0:1788201247.068441:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a9b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715285248:0@lo:400:kworker.0 00000100:00080000:2.0:1788201247.069116:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201247.069123:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201247.069126:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201247.069129:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788201247.508251:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201247.568205:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715285504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201247.568288:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201247.568763:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715285632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201247.568794:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201247.568830:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715285632 00000100:00100000:0.0:1788201247.568837:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715285632 00000100:00100000:0.0:1788201247.568877:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4100 00000100:00100000:0.0:1788201247.568885:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715285632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201247.568917:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:0.0:1788201247.568959:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715285632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201247.568966:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4100 00000100:00100000:0.0:1788201247.569007:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715285632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201247.571898:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715285504 00000100:00100000:2.0:1788201247.571910:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715285504 00000100:00100000:2.0:1788201247.571970:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2360 00000100:00100000:2.0:1788201247.571987:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715285504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201247.572053:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201247.572138:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715285504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (3850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201247.572146:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2360 00000100:00100000:2.0:1788201247.572195:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715285504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201247.575610:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13336bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715285760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201247.575675:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201247.575991:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715285760 00000100:00100000:3.0:1788201247.575998:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715285760 00000100:00100000:3.0:1788201247.576068:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2361 00000100:00100000:3.0:1788201247.576077:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715285760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201247.576103:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00010000:00000080:3.0:1788201247.576119:0:8451:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12efc8e00 x1875060715285760/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:368/0 lens 224/368 e 0 to 0 dl 1788201258 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201247.576173:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715285760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201247.576180:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2361 00000100:00100000:3.0:1788201247.576238:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13336bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715285760:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788201247.577772:0:94457:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051650 is committed 00010000:00010000:2.0:1788201247.577807:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1cf30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201247.577819:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1cf30 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201247.577828:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1cf30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201247.577834:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896b200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201247.577839:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1cf30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201247.577847:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1cf30 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201247.577866:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc111a9dd00) 00010000:00010000:2.0:1788201247.577869:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201247.577875:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1cf30 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201247.577881:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1cf30 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201247.577909:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1cf68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201247.577915:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1cf68 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201247.577921:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1cf68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201247.577926:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896a800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201247.577930:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1cf68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201247.577935:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1cf68 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201247.577944:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc111a9dd00) 00010000:00010000:2.0:1788201247.577947:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201247.577949:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1cf68 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201247.577955:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1cf68 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201247.701186:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201247.701242:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201247.701277:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201247.701303:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201247.701330:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201247.701361:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695461376 00000100:00100000:0.0:1788201247.701371:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695461376 00000100:00100000:0.0:1788201247.701431:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695461248 00000100:00100000:0.0:1788201247.701448:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695461248 00000100:00100000:0.0:1788201247.701489:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2909 00000100:00100000:0.0:1788201247.701499:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140e9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2400:x1875060695461376:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201247.701579:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140e9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2400:x1875060695461376:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 81us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201247.701587:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2909 00000100:00100000:0.0:1788201247.701745:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2910 00000100:00100000:0.0:1788201247.701752:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695461248:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000080:0.0:1788201247.701766:0:26203:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc137c35180 x1875060695461248/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:368/0 lens 224/224 e 0 to 0 dl 1788201258 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201247.701791:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695461248:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 39us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201247.701797:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2910 00000100:00100000:0.0:1788201247.701816:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695461120 00000100:00100000:0.0:1788201247.701819:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695461120 00000100:00100000:0.0:1788201247.701848:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695460992 00000100:00100000:0.0:1788201247.701851:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695460992 00000100:00100000:0.0:1788201247.701872:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1515 00000100:00100000:0.0:1788201247.701879:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2400:x1875060695461120:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201247.701905:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2400:x1875060695461120:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201247.701912:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1515 00000100:00100000:0.0:1788201247.701924:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1516 00000100:00100000:0.0:1788201247.701930:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+30:2400:x1875060695460992:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201247.701950:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+30:2400:x1875060695460992:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 21us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201247.701964:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1516 00000100:00080000:0.0:1788201247.701984:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201247.701988:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201247.701990:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201247.701992:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201247.702700:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695460864 00000100:00100000:1.0:1788201247.702722:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695460864 00000100:00100000:1.0:1788201247.702762:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 182 00000100:00100000:1.0:1788201247.702771:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003bfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695460864:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201247.702810:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003bfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695460864:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 40us (1633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201247.702816:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 182 00010000:00010000:2.0:1788201248.528273:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201248.616353:0:95996:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: ost1 REPLAY BARRIER on lustre-OST0000 00000100:00100000:0.0:1788201248.929892:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201248.930418:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695461504 00000100:00100000:1.0:1788201248.930429:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695461504 00000100:00100000:1.0:1788201248.930506:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1537 00000100:00100000:1.0:1788201248.930518:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+30:73748:x1875060695461504:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:1.0:1788201248.930540:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201248.930562:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1cf7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ada expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.930630:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2800/0x96d0c9b8c9a1cf84 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.930646:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2800/0x96d0c9b8c9a1cf84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.930848:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2800/0x96d0c9b8c9a1cf84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201248.930901:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788201248.930904:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201248.931075:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2800/0x96d0c9b8c9a1cf84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.931101:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1cf7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ada expref: 32 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.931120:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2800/0x96d0c9b8c9a1cf84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ada expref: 31 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.931129:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:1.0:1788201248.931131:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201248.931135:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e2800, rc 0) 00000100:00100000:1.0:1788201248.931198:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+31:73748:x1875060695461504:12345-192.168.201.20@tcp:101:dd.0 Request processed in 682us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201248.931206:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1537 00000100:00100000:0.0:1788201248.949397:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201248.949457:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201248.949620:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695461632 00000100:00100000:2.0:1788201248.949632:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695461632 00000100:00100000:2.0:1788201248.949701:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695461760 00000100:00100000:2.0:1788201248.949705:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695461760 00000100:00100000:2.0:1788201248.949730:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1538 00000100:00100000:2.0:1788201248.949740:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+32:73751:x1875060695461632:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:2.0:1788201248.949779:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201248.949802:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1cf8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ae1 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201248.949848:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00010000:00010000:2.0:1788201248.949869:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1cf92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201248.949876:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00010000:00010000:2.0:1788201248.949883:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1cf92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201248.949890:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695461888 00000100:00100000:0.0:1788201248.949893:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695461888 00010000:00010000:2.0:1788201248.949895:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1cf92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201248.949949:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788201248.949953:0:69485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201248.949976:0:69485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1cf92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201248.950010:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1cf8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ae1 expref: 35 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201248.950056:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1cf92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ae1 expref: 34 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201248.950066:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:2.0:1788201248.950068:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201248.950072:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbc200, rc 0) 00000100:00100000:2.0:1788201248.950126:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+34:73751:x1875060695461632:12345-192.168.201.20@tcp:101:dd.0 Request processed in 387us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201248.951875:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1539 00000100:00100000:1.0:1788201248.951901:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+34:73749:x1875060695461760:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:1.0:1788201248.951932:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201248.951952:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1cf99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ae8 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.952009:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1cfa0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.952036:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1cfa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.952047:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1cfa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201248.952109:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788201248.952113:0:66313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201248.952133:0:66313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1cfa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.952154:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1cf99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ae8 expref: 36 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.952169:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1cfa0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ae8 expref: 35 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.952177:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:1.0:1788201248.952179:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201248.952182:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e3400, rc 0) 00000100:00100000:1.0:1788201248.952231:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+35:73749:x1875060695461760:12345-192.168.201.20@tcp:101:dd.0 Request processed in 343us (2785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201248.952239:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1539 00000100:00100000:1.0:1788201248.952279:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695462144 00000100:00100000:1.0:1788201248.952286:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695462144 00000100:00100000:1.0:1788201248.952310:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1540 00000100:00100000:1.0:1788201248.952317:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+35:73748:x1875060695462144:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:1.0:1788201248.952325:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201248.952334:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1cfa7 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786af6 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.952428:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cfae lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.952457:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cfae lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.952465:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cfae lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.952479:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1cfb5 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.952500:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1cfb5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.952507:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1cfb5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.952556:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1cfbc lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.952564:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1cfbc lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.952571:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1cfbc lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201248.952579:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x6:0x0]: returning size 0 00010000:00010000:1.0:1788201248.952669:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cfae lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.953239:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cfae lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.953246:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cfae lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.953260:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cfae lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.953266:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201248.953271:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cfae lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.953279:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cfae lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.953291:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:1.0:1788201248.953294:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201248.953298:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cfae lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.953304:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1cfae lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.953318:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1cfb5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.953324:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1cfb5 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.953330:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1cfb5 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.953335:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201248.953338:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1cfb5 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.953354:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1cfb5 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.953363:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff8dc005cc6300) 00010000:00010000:1.0:1788201248.953365:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201248.953368:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1cfb5 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.953374:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1cfb5 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.953416:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1cfa7 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786af6 expref: 38 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.953429:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1cfbc lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786af6 expref: 37 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.953435:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff8dc11248cb00) 00010000:00010000:1.0:1788201248.953437:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201248.953440:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e2000, rc 0) 00000100:00100000:1.0:1788201248.953475:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+37:73748:x1875060695462144:12345-192.168.201.20@tcp:101:dd.0 Request processed in 1157us (3597us total) trans 124554051651 rc 0/0 00000100:00100000:1.0:1788201248.953482:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1540 00000100:00100000:0.0:1788201248.963178:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1541 00000100:00100000:0.0:1788201248.963206:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+36:73750:x1875060695461888:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:0.0:1788201248.963227:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201248.963667:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1cfca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786aef expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201248.964050:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1538 00010000:00010000:0.0:1788201248.965094:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1cfd1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201248.965110:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1cfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201248.965121:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1cfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201248.965165:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201248.965169:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201248.965201:0:66312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1cfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201248.965226:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1cfca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786aef expref: 37 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201248.965243:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1cfd1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786aef expref: 36 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201248.965266:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:0.0:1788201248.965269:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201248.965273:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896be00, rc 0) 00000100:00100000:0.0:1788201248.965347:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+36:73750:x1875060695461888:12345-192.168.201.20@tcp:101:dd.0 Request processed in 2154us (15497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201248.965355:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1541 00000100:00100000:0.0:1788201248.966468:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201248.966496:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201248.966545:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201248.966585:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695462656 00000100:00100000:0.0:1788201248.966594:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695462656 00000100:00100000:0.0:1788201248.966643:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 719 00000100:00100000:0.0:1788201248.966652:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+36:2401:x1875060695462656:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201248.966665:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788201248.966817:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695462400 00000100:00100000:3.0:1788201248.966822:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695462400 00000100:00100000:3.0:1788201248.966849:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695462528 00000100:00100000:3.0:1788201248.966852:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695462528 00000100:00100000:3.0:1788201248.966870:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1542 00000100:00100000:3.0:1788201248.966876:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00586c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+38:73749:x1875060695462400:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:3.0:1788201248.966892:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201248.966906:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1cfd8 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786afd expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.967058:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1cfdf lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.967072:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1cfdf lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.967081:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1cfdf lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.967096:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9000/0x96d0c9b8c9a1cfe6 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.967102:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9000/0x96d0c9b8c9a1cfe6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.967121:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9000/0x96d0c9b8c9a1cfe6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.967178:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8000/0x96d0c9b8c9a1cfed lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.967186:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8000/0x96d0c9b8c9a1cfed lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.967193:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8000/0x96d0c9b8c9a1cfed lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201248.967202:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788201248.967293:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1cfdf lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201248.967297:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1543 00010000:00010000:3.0:1788201248.967301:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1cfdf lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.967306:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1cfdf lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.967313:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1cfdf lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201248.967318:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0039d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+40:73748:x1875060695462528:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:3.0:1788201248.967318:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda8200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201248.967323:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1cfdf lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201248.967326:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201248.967330:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1cfdf lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201248.967335:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1cffb lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b04 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.967352:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201248.967353:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc400/0x96d0c9b8c9a1d002 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.967355:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201248.967359:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1cfdf lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201248.967361:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc400/0x96d0c9b8c9a1d002 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.967366:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1cfdf lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201248.967369:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc400/0x96d0c9b8c9a1d002 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.967378:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9000/0x96d0c9b8c9a1cfe6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.967383:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9000/0x96d0c9b8c9a1cfe6 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.967389:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9000/0x96d0c9b8c9a1cfe6 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.967393:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda9000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201248.967396:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9000/0x96d0c9b8c9a1cfe6 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.967401:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9000/0x96d0c9b8c9a1cfe6 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.967408:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff8dc007bc4700) 00010000:00010000:3.0:1788201248.967410:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201248.967412:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9000/0x96d0c9b8c9a1cfe6 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.967418:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9000/0x96d0c9b8c9a1cfe6 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201248.967438:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1cffb lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b04 expref: 42 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.967460:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1cfd8 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786afd expref: 42 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201248.967462:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc400/0x96d0c9b8c9a1d002 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b04 expref: 42 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201248.967469:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff8dc11248cb00) 00010000:00010000:3.0:1788201248.967471:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8000/0x96d0c9b8c9a1cfed lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786afd expref: 41 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201248.967472:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788201248.967474:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbc400, rc 0) 00010000:00010000:3.0:1788201248.967477:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff8dc11248c900) 00010000:00010000:3.0:1788201248.967479:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201248.967481:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc11cda8000, rc 0) 00000100:00100000:2.0:1788201248.967522:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+41:73748:x1875060695462528:12345-192.168.201.20@tcp:101:dd.0 Request processed in 217us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201248.967529:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1543 00000100:00100000:3.0:1788201248.967719:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00586c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+40:73749:x1875060695462400:12345-192.168.201.20@tcp:101:dd.0 Request processed in 841us (1256us total) trans 124554051652 rc 0/0 00000100:00100000:3.0:1788201248.967726:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1542 00010000:00010000:0.0:1788201248.968370:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1cfa0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ae8 expref: 39 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201248.968385:0:26207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:0.0:1788201248.968389:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201248.968429:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0039d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+38:2401:x1875060695462656:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 1777us (1884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201248.968437:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 719 00000100:00100000:0.0:1788201248.984210:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201248.984406:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695462784 00000100:00100000:1.0:1788201248.984418:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695462784 00000100:00100000:1.0:1788201248.984508:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 720 00000100:00100000:1.0:1788201248.984519:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+38:2403:x1875060695462784:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201248.984558:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201248.984583:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1cf92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ae1 expref: 38 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.984602:0:26215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:1.0:1788201248.984606:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201248.984662:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+37:2403:x1875060695462784:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 146us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201248.984669:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 720 00000100:00100000:0.0:1788201248.984905:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201248.984942:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201248.985012:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695462912 00000100:00100000:2.0:1788201248.985041:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695462912 00000100:00100000:2.0:1788201248.985078:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695463168 00000100:00100000:2.0:1788201248.985082:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695463168 00000100:00100000:3.0:1788201248.985087:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1544 00000100:00100000:3.0:1788201248.985097:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+38:73749:x1875060695462912:12345-192.168.201.20@tcp:101:dd.0 00000100:00100000:2.0:1788201248.985102:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1545 00000100:00100000:2.0:1788201248.985108:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+38:73748:x1875060695463168:12345-192.168.201.20@tcp:36:dd.0 00010000:00010000:3.0:1788201248.985117:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201248.985132:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1d009 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b0b expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201248.985145:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201248.985157:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1cfbc lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786af6 expref: 39 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.985162:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9000/0x96d0c9b8c9a1d010 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201248.985168:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff8dc11248cb00) 00010000:00010000:2.0:1788201248.985171:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201248.985172:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9000/0x96d0c9b8c9a1d010 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.985181:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9000/0x96d0c9b8c9a1d010 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201248.985341:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1d017 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201248.985351:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1d017 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201248.985358:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1d017 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788201248.985404:0:66313:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051653 00000004:00010000:2.0:1788201248.985426:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de842729 reply state 00000000f5bef841 transno 124554051654 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1d017 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201248.985438:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1d017 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201248.985456:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff8dc11248cb00) 00010000:00010000:2.0:1788201248.985459:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201248.985462:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201248.985530:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+41:73748:x1875060695463168:12345-192.168.201.20@tcp:36:dd.0 Request processed in 421us (585us total) trans 124554051654 rc 0/0 00000100:00100000:2.0:1788201248.985546:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1545 00000020:00080000:2.0:1788201248.985550:0:66313:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788201248.985661:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1d009 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b0b expref: 41 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.986643:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9000/0x96d0c9b8c9a1d010 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b0b expref: 40 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.986654:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff8dc11248c900) 00010000:00010000:3.0:1788201248.986656:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788201248.986659:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc11cda9000, rc 0) 00000100:00100000:3.0:1788201248.986720:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+40:73749:x1875060695462912:12345-192.168.201.20@tcp:101:dd.0 Request processed in 1625us (2470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201248.986727:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1544 00000100:00100000:0.0:1788201248.991366:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201248.992729:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201248.992936:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695463424 00000100:00100000:3.0:1788201248.992948:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695463424 00000100:00100000:3.0:1788201248.993080:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1546 00000100:00100000:3.0:1788201248.993092:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+40:73754:x1875060695463424:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:3.0:1788201248.993114:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201248.993135:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1d01e lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b12 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.994216:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9200/0x96d0c9b8c9a1d025 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.994233:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9200/0x96d0c9b8c9a1d025 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.994244:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9200/0x96d0c9b8c9a1d025 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201248.995273:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695463552 00000100:00100000:1.0:1788201248.995283:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695463552 00000100:00100000:1.0:1788201248.995349:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 721 00000100:00100000:1.0:1788201248.995360:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+42:2403:x1875060695463552:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201248.995373:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201248.995394:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1cfd1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786aef expref: 42 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201248.995409:0:26213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:1.0:1788201248.995414:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201248.995481:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+41:2403:x1875060695463552:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 124us (4125us total) trans 0 rc 0/0 00010000:00010000:3.0:1788201248.995915:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8e00/0x96d0c9b8c9a1d02c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.995926:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8e00/0x96d0c9b8c9a1d02c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.995934:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8e00/0x96d0c9b8c9a1d02c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201248.995947:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 721 00010000:00010000:3.0:1788201248.996029:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8a00/0x96d0c9b8c9a1d033 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.996039:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8a00/0x96d0c9b8c9a1d033 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.996046:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8a00/0x96d0c9b8c9a1d033 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201248.996057:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xc:0x0]: returning size 0 00010000:00010000:3.0:1788201248.996140:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9200/0x96d0c9b8c9a1d025 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.996148:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9200/0x96d0c9b8c9a1d025 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.996154:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9200/0x96d0c9b8c9a1d025 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.996161:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9200/0x96d0c9b8c9a1d025 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.996166:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda9200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201248.996178:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9200/0x96d0c9b8c9a1d025 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.996187:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9200/0x96d0c9b8c9a1d025 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.996197:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:3.0:1788201248.996200:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201248.996214:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9200/0x96d0c9b8c9a1d025 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.996220:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9200/0x96d0c9b8c9a1d025 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.996230:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8e00/0x96d0c9b8c9a1d02c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.996236:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8e00/0x96d0c9b8c9a1d02c lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.996242:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8e00/0x96d0c9b8c9a1d02c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.996247:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda8e00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201248.996250:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8e00/0x96d0c9b8c9a1d02c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.996256:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8e00/0x96d0c9b8c9a1d02c lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.996264:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff8dc007bc4700) 00010000:00010000:3.0:1788201248.996266:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201248.996275:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8e00/0x96d0c9b8c9a1d02c lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.996281:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8e00/0x96d0c9b8c9a1d02c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.996327:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1d01e lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b12 expref: 42 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.996341:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8a00/0x96d0c9b8c9a1d033 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b12 expref: 41 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201248.996347:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff8dc11248ce00) 00010000:00010000:3.0:1788201248.996349:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201248.996352:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc11cda8a00, rc 0) 00000100:00100000:3.0:1788201248.996399:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+41:73754:x1875060695463424:12345-192.168.201.20@tcp:101:dd.0 Request processed in 3309us (3675us total) trans 124554051655 rc 0/0 00000100:00100000:3.0:1788201248.996406:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1546 00000100:00100000:0.0:1788201249.007876:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.007981:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201249.008106:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695463936 00000100:00100000:1.0:1788201249.008118:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695463936 00000100:00100000:1.0:1788201249.008192:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1547 00000100:00100000:1.0:1788201249.008203:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+41:73749:x1875060695463936:12345-192.168.201.20@tcp:36:dd.0 00010000:00010000:1.0:1788201249.008289:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201249.008317:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8000/0x96d0c9b8c9a1cfed lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786afd expref: 41 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.008335:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff8dc11248c900) 00010000:00010000:1.0:1788201249.008339:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201249.008524:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1d041 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.008538:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1d041 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.008548:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1d041 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201249.008593:0:66313:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051656 00000004:00010000:1.0:1788201249.008616:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000268ecad2 reply state 000000001874f3dc transno 124554051657 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1d041 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.008629:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1d041 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.008635:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff8dc11248c900) 00010000:00010000:1.0:1788201249.008637:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201249.008640:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201249.008748:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+43:73749:x1875060695463936:12345-192.168.201.20@tcp:36:dd.0 Request processed in 546us (765us total) trans 124554051657 rc 0/0 00000100:00100000:1.0:1788201249.008756:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1547 00000020:00080000:1.0:1788201249.008761:0:66313:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1788201249.009143:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201249.009390:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695463680 00000100:00100000:2.0:1788201249.009397:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695463680 00000100:00100000:2.0:1788201249.009463:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5952 00000100:00100000:2.0:1788201249.009472:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:73748:x1875060695463680:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:2.0:1788201249.009492:0:26206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201249.009508:0:26206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1d048 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b19 expref: -99 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201249.009529:0:26206:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x382:0x0] initial LVB size: 0, mtime: 0x6a95c916, atime: 0x6a95c916, ctime: 0x6a95c916, blocks: 0x0 00010000:00010000:2.0:1788201249.009546:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x382:0x0].0x0 since=4100s v=(0 0) 00010000:00010000:2.0:1788201249.009550:0:26206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x382:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201249.009557:0:26206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1d048 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b19 expref: 6 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.009573:0:26206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1d048 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b19 expref: 6 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.009584:0:26206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbde00, rc 0) 00010000:00000080:2.0:1788201249.009591:0:26206:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc00388e300 x1875060695463680/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 328/400 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201249.009632:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:73748:x1875060695463680:12345-192.168.201.20@tcp:101:dd.0 Request processed in 162us (1766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201249.009638:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5952 00000100:00080000:0.0:1788201249.009834:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201249.010045:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.010076:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201249.010082:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695464064 00000100:00100000:3.0:1788201249.010087:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695464064 00000100:00100000:3.0:1788201249.010121:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695464320 00000100:00100000:3.0:1788201249.010124:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695464320 00000100:00100000:3.0:1788201249.010146:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1548 00000100:00100000:3.0:1788201249.010153:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+44:73754:x1875060695464064:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:3.0:1788201249.010166:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201249.010180:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1d04f lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b20 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010207:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8e00/0x96d0c9b8c9a1d056 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010225:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8e00/0x96d0c9b8c9a1d056 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010234:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8e00/0x96d0c9b8c9a1d056 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010339:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1d04f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b20 expref: 46 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010354:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8e00/0x96d0c9b8c9a1d056 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b20 expref: 45 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010361:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff8dc11248ce00) 00010000:00010000:3.0:1788201249.010363:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788201249.010366:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc11cda8e00, rc 0) 00000100:00100000:3.0:1788201249.010406:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+45:73754:x1875060695464064:12345-192.168.201.20@tcp:101:dd.0 Request processed in 254us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201249.010412:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1548 00000100:00100000:3.0:1788201249.010428:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1549 00000100:00100000:3.0:1788201249.010435:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+44:73753:x1875060695464320:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:3.0:1788201249.010452:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201249.010462:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9200/0x96d0c9b8c9a1d05d lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b27 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010549:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1d064 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010567:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1d064 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010574:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1d064 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010588:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9400/0x96d0c9b8c9a1d06b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010595:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9400/0x96d0c9b8c9a1d06b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010602:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9400/0x96d0c9b8c9a1d06b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010642:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8600/0x96d0c9b8c9a1d072 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010650:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8600/0x96d0c9b8c9a1d072 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010656:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8600/0x96d0c9b8c9a1d072 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201249.010664:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788201249.010732:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1d064 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010739:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1d064 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010745:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1d064 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010759:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1d064 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010764:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda8800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201249.010769:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1d064 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010777:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1d064 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010787:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:3.0:1788201249.010789:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201249.010794:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1d064 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010800:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1d064 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010809:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9400/0x96d0c9b8c9a1d06b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010815:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9400/0x96d0c9b8c9a1d06b lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010821:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9400/0x96d0c9b8c9a1d06b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010826:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda9400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201249.010829:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9400/0x96d0c9b8c9a1d06b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010844:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9400/0x96d0c9b8c9a1d06b lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010852:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff8dc007bc4700) 00010000:00010000:3.0:1788201249.010854:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201249.010857:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9400/0x96d0c9b8c9a1d06b lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010862:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9400/0x96d0c9b8c9a1d06b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010894:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9200/0x96d0c9b8c9a1d05d lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b27 expref: 47 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010905:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8600/0x96d0c9b8c9a1d072 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b27 expref: 46 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.010912:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff8dc0048be700) 00010000:00010000:3.0:1788201249.010914:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201249.010916:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc11cda8600, rc 0) 00000100:00100000:3.0:1788201249.010943:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+46:73753:x1875060695464320:12345-192.168.201.20@tcp:101:dd.0 Request processed in 509us (866us total) trans 124554051658 rc 0/0 00000100:00100000:3.0:1788201249.010949:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1549 00000100:00100000:0.0:1788201249.023748:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.023786:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.023822:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.023852:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695464832 00000100:00100000:1.0:1788201249.023852:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695464448 00000100:00100000:0.0:1788201249.023861:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695464832 00000100:00100000:1.0:1788201249.023861:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695464448 00000100:00100000:1.0:1788201249.023903:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695464704 00000100:00100000:1.0:1788201249.023905:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695464704 00000100:00100000:0.0:1788201249.023907:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5953 00000100:00100000:1.0:1788201249.023921:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1550 00000100:00100000:1.0:1788201249.023931:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+47:73753:x1875060695464448:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:1.0:1788201249.023951:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201249.023972:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1d080 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b2e expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024045:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1d087 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024060:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1d087 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024071:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1d087 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201249.024167:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:73749:x1875060695464832:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:0.0:1788201249.024176:0:26205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201249.024178:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1d080 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b2e expref: 49 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.024188:0:26205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ab5e6bc/0x96d0c9b8c9a1d08e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b3c expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024195:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1d087 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b2e expref: 48 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024203:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff8dc0048be700) 00010000:00010000:1.0:1788201249.024205:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00002000:00010000:0.0:1788201249.024209:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x383:0x0] initial LVB size: 0, mtime: 0x6a95c916, atime: 0x6a95c916, ctime: 0x6a95c916, blocks: 0x0 00010000:00010000:1.0:1788201249.024209:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e2a00, rc 0) 00010000:00010000:0.0:1788201249.024223:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x383:0x0].0x0 since=4100s v=(0 0) 00010000:00010000:0.0:1788201249.024227:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x383:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201249.024234:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ab5e6bc/0x96d0c9b8c9a1d08e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b3c expref: 7 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201249.024268:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+48:73753:x1875060695464448:12345-192.168.201.20@tcp:101:dd.0 Request processed in 339us (529us total) trans 0 rc 0/0 00010000:00010000:0.0:1788201249.024272:0:26205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003ab5e6bc/0x96d0c9b8c9a1d08e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b3c expref: 7 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201249.024275:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1550 00010000:00010000:0.0:1788201249.024282:0:26205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896bc00, rc 0) 00010000:00000080:0.0:1788201249.024288:0:26205:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc005d59880 x1875060695464832/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 328/400 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201249.024301:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1551 00000100:00100000:0.0:1788201249.024319:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:73749:x1875060695464832:12345-192.168.201.20@tcp:101:dd.0 Request processed in 157us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201249.024319:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+47:73756:x1875060695464704:12345-192.168.201.20@tcp:101:dd.0 00000100:00100000:0.0:1788201249.024325:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5953 00010000:00010000:1.0:1788201249.024327:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201249.024336:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1d095 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b35 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024430:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d09c lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024440:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d09c lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024448:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d09c lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024460:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d0a3 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024467:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d0a3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024474:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d0a3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024519:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1d0aa lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024526:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1d0aa lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024533:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1d0aa lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201249.024552:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788201249.024631:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d09c lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024638:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d09c lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024644:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d09c lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024651:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d09c lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024656:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201249.024660:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d09c lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024667:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d09c lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024678:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:1.0:1788201249.024692:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201249.024696:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d09c lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024702:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d09c lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024712:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d0a3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024718:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d0a3 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024730:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d0a3 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024735:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201249.024738:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d0a3 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024744:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d0a3 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024752:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff8dc005cc6300) 00010000:00010000:1.0:1788201249.024755:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201249.024758:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d0a3 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024764:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d0a3 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024797:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1d095 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b35 expref: 50 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024809:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1d0aa lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b35 expref: 49 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.024816:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff8dc005cc6c00) 00010000:00010000:1.0:1788201249.024818:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201249.024820:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e3600, rc 0) 00000100:00100000:1.0:1788201249.024855:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+49:73756:x1875060695464704:12345-192.168.201.20@tcp:101:dd.0 Request processed in 536us (1068us total) trans 124554051659 rc 0/0 00000100:00100000:1.0:1788201249.024870:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1551 00000100:00100000:0.0:1788201249.025707:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201249.025824:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695465216 00000100:00100000:1.0:1788201249.025832:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695465216 00000100:00100000:1.0:1788201249.025865:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1552 00000100:00100000:1.0:1788201249.025872:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+49:73754:x1875060695465216:12345-192.168.201.20@tcp:36:dd.0 00010000:00010000:1.0:1788201249.025923:0:69485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201249.025941:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8a00/0x96d0c9b8c9a1d033 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b12 expref: 49 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.025955:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff8dc11248ce00) 00010000:00010000:1.0:1788201249.025960:0:69485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201249.026127:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1d0b8 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.026138:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1d0b8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.026146:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1d0b8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201249.026189:0:69485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051660 00000004:00010000:1.0:1788201249.026210:0:69485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000230dd3c1 reply state 000000002f0ca098 transno 124554051661 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1d0b8 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.026221:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1d0b8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.026227:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff8dc11248ce00) 00010000:00010000:1.0:1788201249.026229:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201249.026241:0:69485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201249.026323:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:73754:x1875060695465216:12345-192.168.201.20@tcp:36:dd.0 Request processed in 450us (617us total) trans 124554051661 rc 0/0 00000100:00100000:1.0:1788201249.026329:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1552 00000020:00080000:1.0:1788201249.026333:0:69485:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788201249.033115:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201249.033208:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695464960 00000100:00100000:3.0:1788201249.033218:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695464960 00002000:00010000:3.0:1788201249.033268:0:8453:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/898 (0->18446744073709551615) 00002000:00100000:3.0:1788201249.033273:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc13a440e00 with x1875060695464960 ext(0->18446744073709551615) 00002000:00010000:3.0:1788201249.033287:0:8453:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc13a440e00. 00000100:00100000:3.0:1788201249.033330:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1008 00000100:00100000:3.0:1788201249.033341:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2400:x1875060695464960:12345-192.168.201.20@tcp:10:dd.0 00002000:00010000:3.0:1788201249.033520:0:8453:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x382:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788201249.033525:0:8453:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x382:0x0] updating lvb mtime from disk: 1788201238 -> 1788201249 00002000:00010000:3.0:1788201249.033527:0:8453:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x382:0x0] updating lvb atime from disk: 1788201238 -> 1788201238 00002000:00010000:3.0:1788201249.033529:0:8453:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x382:0x0] updating lvb ctime from disk: 1788201238 -> 1788201249 00002000:00010000:3.0:1788201249.033531:0:8453:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x382:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1788201249.033540:0:8453:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc13a440e00 x1875060695464960/t4294969479(0) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 440/432 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201249.033599:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2400:x1875060695464960:12345-192.168.201.20@tcp:10:dd.0 Request processed in 261us (494us total) trans 4294969479 rc 0/0 00000100:00100000:3.0:1788201249.033608:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1008 00002000:00010000:3.0:1788201249.033612:0:8453:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/898 (0->18446744073709551615) 00002000:00100000:3.0:1788201249.033615:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc13a440e00 with x1875060695464960 ext(0->18446744073709551615) 00002000:00010000:3.0:1788201249.033620:0:8453:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc13a440e00. 00000100:00100000:2.0:1788201249.059291:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.059333:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.059373:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201249.060786:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695465600 00000100:00100000:1.0:1788201249.060801:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695465600 00000100:00100000:1.0:1788201249.060863:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695465856 00000100:00100000:1.0:1788201249.060867:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695465856 00000100:00100000:1.0:1788201249.060883:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695465344 00000100:00100000:1.0:1788201249.060886:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695465344 00000100:00100000:1.0:1788201249.060903:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1553 00000100:00100000:1.0:1788201249.060923:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+53:73751:x1875060695465600:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:1.0:1788201249.060944:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201249.060967:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1d0bf lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b43 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.061111:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d0c6 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.061125:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d0c6 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.061137:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d0c6 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.061150:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d0cd lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.061157:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d0cd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.061184:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d0cd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.061242:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1d0d4 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.061654:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1d0d4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.061662:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1d0d4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201249.062350:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x9:0x0]: returning size 0 00000100:00100000:2.0:1788201249.063395:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1554 00000100:00100000:2.0:1788201249.063413:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+55:73753:x1875060695465856:12345-192.168.201.20@tcp:36:dd.0 00010000:00010000:2.0:1788201249.063641:0:69485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201249.063667:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8600/0x96d0c9b8c9a1d072 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b27 expref: 55 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.063780:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d0c6 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.063791:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d0c6 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.063798:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d0c6 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.063805:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d0c6 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.063811:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201249.063815:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d0c6 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.063823:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d0c6 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.063853:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:1.0:1788201249.063856:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201249.063861:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d0c6 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.063866:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d0c6 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.063880:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d0cd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.063885:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d0cd lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.063891:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d0cd lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.063897:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201249.063900:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d0cd lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.063905:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d0cd lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.063993:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff8dc0048be700) 00010000:00010000:2.0:1788201249.063997:0:69485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201249.064172:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d0e2 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.064185:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d0e2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.064193:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d0e2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788201249.064234:0:69485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051663 00010000:00010000:1.0:1788201249.068319:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff8dc005cc6300) 00010000:00010000:1.0:1788201249.068329:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201249.068337:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d0cd lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.068349:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d0cd lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201249.069064:0:69485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc8a69cc reply state 0000000035c86e76 transno 124554051664 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d0e2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.069085:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d0e2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.069094:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff8dc0048be700) 00010000:00010000:2.0:1788201249.069105:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201249.069109:0:69485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201249.069242:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+57:73753:x1875060695465856:12345-192.168.201.20@tcp:36:dd.0 Request processed in 5833us (9903us total) trans 124554051664 rc 0/0 00000100:00100000:0.0:1788201249.069377:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1555 00000100:00100000:0.0:1788201249.069526:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+57:73756:x1875060695465344:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:0.0:1788201249.069547:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201249.069564:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1d0e9 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b4a expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.069595:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1d0f0 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.069605:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1d0f0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.069613:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1d0f0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.070060:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ac00/0x96d0c9b8c9a1d0e9 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b4a expref: 59 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.070078:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1d0f0 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b4a expref: 58 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.070086:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff8dc005cc6c00) 00010000:00010000:0.0:1788201249.070089:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788201249.070092:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896b200, rc 0) 00000100:00100000:0.0:1788201249.070133:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+58:73756:x1875060695465344:12345-192.168.201.20@tcp:101:dd.0 Request processed in 746us (10759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201249.070140:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1555 00010000:00010000:1.0:1788201249.070244:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1d0bf lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b43 expref: 58 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.070571:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1d0d4 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b43 expref: 57 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.070579:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff8dc11248c400) 00010000:00010000:1.0:1788201249.070582:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201249.070584:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e3000, rc 0) 00000100:00100000:1.0:1788201249.070630:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+57:73751:x1875060695465600:12345-192.168.201.20@tcp:101:dd.0 Request processed in 9719us (11348us total) trans 124554051662 rc 0/0 00000100:00100000:1.0:1788201249.070637:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1553 00000100:00100000:2.0:1788201249.070779:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1554 00000020:00080000:2.0:1788201249.070783:0:69485:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788201249.075506:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.075545:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.075613:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.076045:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695465984 00000100:00100000:2.0:1788201249.076057:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695465984 00000100:00100000:2.0:1788201249.076114:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5954 00000100:00100000:2.0:1788201249.076124:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:73754:x1875060695465984:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:2.0:1788201249.076142:0:23974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201249.076162:0:23974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1d0f7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b51 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201249.076187:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x388:0x0] initial LVB size: 0, mtime: 0x6a95c916, atime: 0x6a95c916, ctime: 0x6a95c916, blocks: 0x0 00010000:00010000:2.0:1788201249.076210:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x388:0x0].0x0 since=4100s v=(0 0) 00010000:00010000:2.0:1788201249.076215:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x388:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201249.076224:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1d0f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b51 expref: 9 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.076239:0:23974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1d0f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b51 expref: 9 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.076368:0:23974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbd200, rc 0) 00010000:00000080:2.0:1788201249.076377:0:23974:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc0078e2d80 x1875060695465984/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 328/400 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201249.076583:0:24874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695466112 00000100:00100000:3.0:1788201249.076589:0:24874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695466112 00002000:00010000:3.0:1788201249.076612:0:24874:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/899 (0->18446744073709551615) 00002000:00100000:3.0:1788201249.076616:0:24874:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc005d52d80 with x1875060695466112 ext(0->18446744073709551615) 00002000:00010000:3.0:1788201249.076625:0:24874:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc005d52d80. 00000100:00100000:3.0:1788201249.076645:0:24874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1009 00000100:00100000:3.0:1788201249.076652:0:24874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2403:x1875060695466112:12345-192.168.201.20@tcp:10:dd.0 00002000:00010000:3.0:1788201249.076857:0:24874:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x383:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788201249.076860:0:24874:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x383:0x0] updating lvb mtime from disk: 1788201238 -> 1788201249 00002000:00010000:3.0:1788201249.076863:0:24874:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x383:0x0] updating lvb atime from disk: 1788201238 -> 1788201238 00002000:00010000:3.0:1788201249.076878:0:24874:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x383:0x0] updating lvb ctime from disk: 1788201238 -> 1788201249 00002000:00010000:3.0:1788201249.076880:0:24874:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x383:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1788201249.076889:0:24874:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc005d52d80 x1875060695466112/t4294969480(0) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 440/432 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201249.077350:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:73754:x1875060695465984:12345-192.168.201.20@tcp:101:dd.0 Request processed in 1226us (1852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201249.077365:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5954 00000100:00100000:2.0:1788201249.077397:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695466368 00000100:00100000:2.0:1788201249.077402:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695466368 00000100:00100000:2.0:1788201249.077431:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 265 00000100:00100000:2.0:1788201249.077438:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+56:73748:x1875060695466368:12345-192.168.201.20@tcp:35:dd.0 00000100:00100000:3.0:1788201249.077783:0:24874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2403:x1875060695466112:12345-192.168.201.20@tcp:10:dd.0 Request processed in 1129us (2235us total) trans 4294969480 rc 0/0 00000100:00100000:3.0:1788201249.077790:0:24874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1009 00002000:00010000:3.0:1788201249.077794:0:24874:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/899 (0->18446744073709551615) 00002000:00100000:3.0:1788201249.077797:0:24874:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc005d52d80 with x1875060695466112 ext(0->18446744073709551615) 00002000:00010000:3.0:1788201249.077803:0:24874:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc005d52d80. 00000100:00100000:3.0:1788201249.082327:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201249.082377:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201249.082525:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695466752 00000100:00100000:1.0:1788201249.082538:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695466752 00000100:00100000:1.0:1788201249.082607:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1556 00000100:00100000:1.0:1788201249.082618:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+57:73756:x1875060695466752:12345-192.168.201.20@tcp:36:dd.0 00010000:00010000:1.0:1788201249.082702:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201249.082733:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1d0aa lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b35 expref: 57 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.082752:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff8dc005cc6c00) 00010000:00010000:1.0:1788201249.082757:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201249.082956:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d0fe lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.082971:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d0fe lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.082995:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d0fe lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201249.083073:0:66313:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051665 00000004:00010000:1.0:1788201249.083096:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000013ca59da reply state 000000001cb619ca transno 124554051666 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d0fe lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.083108:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d0fe lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.083114:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff8dc005cc6c00) 00010000:00010000:1.0:1788201249.083117:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201249.083119:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201249.083212:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:73756:x1875060695466752:12345-192.168.201.20@tcp:36:dd.0 Request processed in 594us (832us total) trans 124554051666 rc 0/0 00000100:00100000:1.0:1788201249.083219:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1556 00000020:00080000:1.0:1788201249.083224:0:66313:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788201249.084665:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695466496 00000100:00100000:2.0:1788201249.084695:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695466496 00000100:00100000:2.0:1788201249.084753:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5955 00000100:00100000:2.0:1788201249.084763:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:73753:x1875060695466496:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:2.0:1788201249.084780:0:26210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201249.084800:0:26210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1d105 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b58 expref: -99 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201249.084823:0:26210:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x387:0x0] initial LVB size: 0, mtime: 0x6a95c916, atime: 0x6a95c916, ctime: 0x6a95c916, blocks: 0x0 00010000:00010000:2.0:1788201249.084841:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x387:0x0].0x0 since=4100s v=(0 0) 00010000:00010000:2.0:1788201249.084846:0:26210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x387:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201249.084853:0:26210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1d105 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b58 expref: 11 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.084866:0:26210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1d105 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b58 expref: 11 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.084879:0:26210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbc000, rc 0) 00010000:00000080:2.0:1788201249.084886:0:26210:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12efca300 x1875060695466496/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 328/400 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201249.085427:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:73753:x1875060695466496:12345-192.168.201.20@tcp:101:dd.0 Request processed in 664us (3109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201249.085435:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5955 00000100:00100000:3.0:1788201249.087331:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201249.087387:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695467264 00000100:00100000:3.0:1788201249.087397:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695467264 00002000:00010000:3.0:1788201249.087429:0:25729:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/904 (0->18446744073709551615) 00002000:00100000:3.0:1788201249.087435:0:25729:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc12efcbb80 with x1875060695467264 ext(0->18446744073709551615) 00002000:00010000:3.0:1788201249.087454:0:25729:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc12efcbb80. 00000100:00100000:3.0:1788201249.087484:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1010 00000100:00100000:3.0:1788201249.087495:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695467264:12345-192.168.201.20@tcp:10:dd.0 00002000:00010000:3.0:1788201249.087702:0:25729:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x388:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788201249.087705:0:25729:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x388:0x0] updating lvb mtime from disk: 1788201238 -> 1788201249 00002000:00010000:3.0:1788201249.087708:0:25729:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x388:0x0] updating lvb atime from disk: 1788201238 -> 1788201238 00002000:00010000:3.0:1788201249.087710:0:25729:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x388:0x0] updating lvb ctime from disk: 1788201238 -> 1788201249 00002000:00010000:3.0:1788201249.087712:0:25729:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x388:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1788201249.087719:0:25729:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12efcbb80 x1875060695467264/t4294969481(0) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 440/432 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201249.087793:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2403:x1875060695467264:12345-192.168.201.20@tcp:10:dd.0 Request processed in 299us (468us total) trans 4294969481 rc 0/0 00000100:00100000:3.0:1788201249.087800:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1010 00002000:00010000:3.0:1788201249.087804:0:25729:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/904 (0->18446744073709551615) 00002000:00100000:3.0:1788201249.087806:0:25729:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc12efcbb80 with x1875060695467264 ext(0->18446744073709551615) 00002000:00010000:3.0:1788201249.087811:0:25729:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc12efcbb80. 00000100:00100000:3.0:1788201249.087847:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.087930:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695466880 00000100:00100000:2.0:1788201249.087935:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695466880 00000100:00100000:2.0:1788201249.087978:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1557 00000100:00100000:2.0:1788201249.087986:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:73751:x1875060695466880:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:2.0:1788201249.088003:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201249.088044:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbdc00/0x96d0c9b8c9a1d10c lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b5f expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.088077:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1d113 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.088091:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1d113 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.088102:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1d113 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.088198:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbdc00/0x96d0c9b8c9a1d10c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b5f expref: 61 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.088215:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1d113 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b5f expref: 60 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.088225:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff8dc11248c400) 00010000:00010000:2.0:1788201249.088234:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788201249.088238:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbd400, rc 0) 00000100:00100000:2.0:1788201249.088403:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:73751:x1875060695466880:12345-192.168.201.20@tcp:101:dd.0 Request processed in 416us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201249.088410:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1557 00000100:00100000:0.0:1788201249.092012:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:73748:x1875060695466368:12345-192.168.201.20@tcp:35:dd.0 Request processed in 14564us (16388us total) trans 124554051667 rc 0/0 00000100:00100000:0.0:1788201249.092040:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 265 00000100:00100000:3.0:1788201249.092082:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201249.092218:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201249.092250:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695467776 00000100:00100000:3.0:1788201249.092257:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695467776 00002000:00010000:3.0:1788201249.092284:0:8452:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/903 (0->18446744073709551615) 00002000:00100000:3.0:1788201249.092288:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc004b39f80 with x1875060695467776 ext(0->18446744073709551615) 00002000:00010000:3.0:1788201249.092299:0:8452:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc004b39f80. 00000100:00100000:3.0:1788201249.092318:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1011 00000100:00100000:3.0:1788201249.092327:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2402:x1875060695467776:12345-192.168.201.20@tcp:10:dd.0 00002000:00010000:3.0:1788201249.092424:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x387:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788201249.092427:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x387:0x0] updating lvb mtime from disk: 1788201238 -> 1788201249 00002000:00010000:3.0:1788201249.092430:0:8452:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x387:0x0] updating lvb atime from disk: 1788201238 -> 1788201238 00002000:00010000:3.0:1788201249.092432:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x387:0x0] updating lvb ctime from disk: 1788201238 -> 1788201249 00002000:00010000:3.0:1788201249.092434:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x387:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1788201249.092442:0:8452:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004b39f80 x1875060695467776/t4294969482(0) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 440/432 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201249.092475:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:2402:x1875060695467776:12345-192.168.201.20@tcp:10:dd.0 Request processed in 150us (257us total) trans 4294969482 rc 0/0 00000100:00100000:3.0:1788201249.092495:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1011 00002000:00010000:3.0:1788201249.092498:0:8452:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/903 (0->18446744073709551615) 00002000:00100000:3.0:1788201249.092501:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc004b39f80 with x1875060695467776 ext(0->18446744073709551615) 00002000:00010000:3.0:1788201249.092506:0:8452:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc004b39f80. 00000100:00100000:0.0:1788201249.093559:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695467392 00000100:00100000:0.0:1788201249.093569:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695467392 00000100:00100000:0.0:1788201249.093609:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5956 00000100:00100000:0.0:1788201249.093617:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13336bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:73756:x1875060695467392:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:0.0:1788201249.093629:0:26201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201249.093650:0:26201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f6d99c0/0x96d0c9b8c9a1d11a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b6d expref: -99 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201249.093695:0:26201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38a:0x0] initial LVB size: 0, mtime: 0x6a95c916, atime: 0x6a95c916, ctime: 0x6a95c916, blocks: 0x0 00010000:00010000:0.0:1788201249.093718:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38a:0x0].0x0 since=4100s v=(0 0) 00010000:00010000:0.0:1788201249.093723:0:26201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201249.093732:0:26201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f6d99c0/0x96d0c9b8c9a1d11a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b6d expref: 14 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.093748:0:26201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f6d99c0/0x96d0c9b8c9a1d11a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b6d expref: 14 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.093765:0:26201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896ae00, rc 0) 00010000:00000080:0.0:1788201249.093772:0:26201:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc13336bb80 x1875060695467392/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 328/400 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201249.093829:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13336bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:73756:x1875060695467392:12345-192.168.201.20@tcp:101:dd.0 Request processed in 212us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201249.093835:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5956 00000100:00100000:3.0:1788201249.103875:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201249.103918:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201249.103954:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.104091:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695467648 00000100:00100000:0.0:1788201249.104101:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695467648 00000100:00100000:0.0:1788201249.104155:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695468288 00000100:00100000:0.0:1788201249.104158:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695468288 00000100:00100000:0.0:1788201249.104176:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 266 00000100:00100000:0.0:1788201249.104186:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+61:73749:x1875060695467648:12345-192.168.201.20@tcp:35:dd.0 00000100:00100000:1.0:1788201249.104354:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695468032 00000100:00100000:1.0:1788201249.104359:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695468032 00000100:00100000:1.0:1788201249.104388:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1558 00000100:00100000:1.0:1788201249.104396:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+63:73751:x1875060695468032:12345-192.168.201.20@tcp:36:dd.0 00010000:00010000:1.0:1788201249.104421:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201249.104459:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1d0d4 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b43 expref: 63 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.104477:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff8dc11248c400) 00010000:00010000:1.0:1788201249.104482:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201249.104487:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+62:73749:x1875060695467648:12345-192.168.201.20@tcp:35:dd.0 Request processed in 302us (568us total) trans 124554051668 rc 0/0 00000100:00100000:0.0:1788201249.104494:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 266 00000100:00100000:0.0:1788201249.104524:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 267 00000100:00100000:0.0:1788201249.104530:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+62:73754:x1875060695468288:12345-192.168.201.20@tcp:35:dd.0 00010000:00010000:1.0:1788201249.104561:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1d121 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.104580:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1d121 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.104591:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1d121 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201249.104624:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+63:73754:x1875060695468288:12345-192.168.201.20@tcp:35:dd.0 Request processed in 93us (669us total) trans 124554051670 rc 0/0 00000100:00100000:0.0:1788201249.104630:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 267 00000001:00080000:1.0:1788201249.104631:0:66314:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051669 00000004:00010000:1.0:1788201249.104652:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000141275a9 reply state 00000000cc8c5724 transno 124554051671 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1d121 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.104664:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1d121 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.104691:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff8dc11248c400) 00010000:00010000:1.0:1788201249.104694:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201249.104696:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201249.104737:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+64:73751:x1875060695468032:12345-192.168.201.20@tcp:36:dd.0 Request processed in 341us (873us total) trans 124554051671 rc 0/0 00000100:00100000:1.0:1788201249.104743:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1558 00000020:00080000:1.0:1788201249.104746:0:66314:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788201249.110108:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201249.110143:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.110256:0:25502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695468672 00000100:00100000:2.0:1788201249.110267:0:25502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695468672 00002000:00010000:2.0:1788201249.110309:0:25502:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/906 (0->18446744073709551615) 00002000:00100000:2.0:1788201249.110314:0:25502:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc001e41c00 with x1875060695468672 ext(0->18446744073709551615) 00002000:00010000:2.0:1788201249.110325:0:25502:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc001e41c00. 00000100:00100000:2.0:1788201249.110358:0:25502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1012 00000100:00100000:2.0:1788201249.110368:0:25502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2402:x1875060695468672:12345-192.168.201.20@tcp:10:dd.0 00002000:00010000:2.0:1788201249.110558:0:25502:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788201249.110562:0:25502:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x38a:0x0] updating lvb mtime from disk: 1788201238 -> 1788201249 00002000:00010000:2.0:1788201249.110564:0:25502:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x38a:0x0] updating lvb atime from disk: 1788201238 -> 1788201238 00002000:00010000:2.0:1788201249.110566:0:25502:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x38a:0x0] updating lvb ctime from disk: 1788201238 -> 1788201249 00002000:00010000:2.0:1788201249.110568:0:25502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38a:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1788201249.110576:0:25502:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc001e41c00 x1875060695468672/t4294969483(0) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 440/432 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201249.110641:0:25502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:2402:x1875060695468672:12345-192.168.201.20@tcp:10:dd.0 Request processed in 275us (498us total) trans 4294969483 rc 0/0 00000100:00100000:2.0:1788201249.110649:0:25502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1012 00002000:00010000:2.0:1788201249.110652:0:25502:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/906 (0->18446744073709551615) 00002000:00100000:2.0:1788201249.110655:0:25502:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc001e41c00 with x1875060695468672 ext(0->18446744073709551615) 00002000:00010000:2.0:1788201249.110659:0:25502:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc001e41c00. 00000100:00100000:0.0:1788201249.111111:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695468544 00000100:00100000:0.0:1788201249.111119:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695468544 00000100:00100000:0.0:1788201249.111160:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 268 00000100:00100000:0.0:1788201249.111168:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+64:73753:x1875060695468544:12345-192.168.201.20@tcp:35:dd.0 00000100:00100000:0.0:1788201249.111389:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+65:73753:x1875060695468544:12345-192.168.201.20@tcp:35:dd.0 Request processed in 221us (1290us total) trans 124554051672 rc 0/0 00000100:00100000:0.0:1788201249.111395:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 268 00000100:00100000:3.0:1788201249.118186:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.118280:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695467136 00000100:00100000:0.0:1788201249.118291:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695467136 00000100:00100000:0.0:1788201249.118343:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1559 00000100:00100000:0.0:1788201249.118354:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+65:73752:x1875060695467136:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:0.0:1788201249.118375:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201249.118395:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1d128 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b66 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.118554:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1d12f lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.118569:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1d12f lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.118580:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1d12f lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.118607:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d136 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.118614:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d136 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.118622:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d136 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.118702:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1d13d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.118710:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1d13d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.118716:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1d13d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201249.118725:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xa:0x0]: returning size 0 00010000:00010000:0.0:1788201249.118798:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1d12f lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.118805:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1d12f lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.118811:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1d12f lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.118817:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1d12f lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.118822:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896be00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201249.118832:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1d12f lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.118839:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1d12f lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.118852:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201249.118855:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201249.118859:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1d12f lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.118865:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1d12f lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.118877:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d136 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.118882:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d136 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.118886:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d136 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.118891:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896a600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201249.118894:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d136 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.118899:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d136 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.118905:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff8dc0048bed00) 00010000:00010000:0.0:1788201249.118907:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201249.118927:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d136 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.118933:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d136 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.118974:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1d128 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b66 expref: 68 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.118988:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1d13d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b66 expref: 67 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.118996:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff8dc11248c800) 00010000:00010000:0.0:1788201249.118998:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201249.119000:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896a800, rc 0) 00000100:00100000:0.0:1788201249.119098:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+67:73752:x1875060695467136:12345-192.168.201.20@tcp:101:dd.0 Request processed in 746us (922us total) trans 124554051673 rc 0/0 00000100:00100000:0.0:1788201249.119106:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1559 00000100:00100000:1.0:1788201249.128458:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201249.129741:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201249.129832:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.130060:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695468928 00000100:00100000:2.0:1788201249.130083:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695468928 00000100:00100000:2.0:1788201249.130143:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695469184 00000100:00100000:2.0:1788201249.130147:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695469184 00000100:00100000:2.0:1788201249.130174:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1560 00000100:00100000:2.0:1788201249.130183:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+68:73752:x1875060695468928:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:2.0:1788201249.130212:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201249.130232:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbdc00/0x96d0c9b8c9a1d14b lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b7b expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.130269:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1d152 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.130282:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1d152 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.130293:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1d152 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.130403:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbdc00/0x96d0c9b8c9a1d14b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b7b expref: 70 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.130421:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1d152 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b7b expref: 69 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.130430:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff8dc11248c800) 00010000:00010000:2.0:1788201249.130432:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788201249.130435:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbca00, rc 0) 00000100:00100000:2.0:1788201249.130506:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+69:73752:x1875060695468928:12345-192.168.201.20@tcp:101:dd.0 Request processed in 323us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201249.130513:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1560 00000100:00100000:2.0:1788201249.130538:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1561 00000100:00100000:2.0:1788201249.130545:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+68:73766:x1875060695469184:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:2.0:1788201249.130552:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201249.130561:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1d159 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b82 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.130660:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d160 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.130690:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d160 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.130697:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d160 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.130711:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1d167 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.130718:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1d167 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.130723:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1d167 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.130770:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1d16e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.130779:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1d16e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.130785:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1d16e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201249.130804:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x18:0x0]: returning size 0 00010000:00010000:2.0:1788201249.130879:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d160 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.130886:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d160 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.130892:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d160 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.130898:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d160 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.130902:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbda00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201249.130906:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d160 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.131518:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d160 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.131531:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201249.131533:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201249.131536:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d160 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.131543:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d160 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.131556:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1d167 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.131573:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1d167 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.131579:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1d167 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.131583:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201249.131586:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1d167 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.131591:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1d167 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.131599:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff8dc1207c9100) 00010000:00010000:2.0:1788201249.131601:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201249.131604:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1d167 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.131610:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1d167 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.131651:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1d159 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b82 expref: 71 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.131663:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1d16e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b82 expref: 70 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.131689:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff8dc1207c9500) 00010000:00010000:2.0:1788201249.131692:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201249.131700:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbc200, rc 0) 00000100:00100000:2.0:1788201249.131744:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+70:73766:x1875060695469184:12345-192.168.201.20@tcp:101:dd.0 Request processed in 1199us (1911us total) trans 124554051674 rc 0/0 00000100:00100000:2.0:1788201249.131752:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1561 00000100:00100000:3.0:1788201249.132701:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695468800 00000100:00100000:3.0:1788201249.132710:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695468800 00000100:00100000:3.0:1788201249.132751:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5957 00000100:00100000:3.0:1788201249.132759:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:73751:x1875060695468800:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:3.0:1788201249.132772:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201249.132789:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf834a51/0x96d0c9b8c9a1d17c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b74 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201249.132812:0:8446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x385:0x0] initial LVB size: 0, mtime: 0x6a95c916, atime: 0x6a95c916, ctime: 0x6a95c916, blocks: 0x0 00010000:00010000:3.0:1788201249.132829:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x385:0x0].0x0 since=4100s v=(0 0) 00010000:00010000:3.0:1788201249.132833:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x385:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201249.132841:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf834a51/0x96d0c9b8c9a1d17c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b74 expref: 16 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.132855:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cf834a51/0x96d0c9b8c9a1d17c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b74 expref: 16 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.132879:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc11cda9200, rc 0) 00010000:00000080:3.0:1788201249.132887:0:8446:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc005255f80 x1875060695468800/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 328/400 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201249.132988:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:73751:x1875060695468800:12345-192.168.201.20@tcp:101:dd.0 Request processed in 229us (4550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201249.132995:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5957 00000100:00100000:2.0:1788201249.140232:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.140339:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.140414:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201249.140485:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695469440 00000100:00100000:3.0:1788201249.140496:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695469440 00000100:00100000:3.0:1788201249.140561:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 269 00000100:00100000:3.0:1788201249.140572:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107db4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+70:73756:x1875060695469440:12345-192.168.201.20@tcp:35:dd.0 00000100:00100000:3.0:1788201249.140868:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107db4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+71:73756:x1875060695469440:12345-192.168.201.20@tcp:35:dd.0 Request processed in 297us (646us total) trans 124554051675 rc 0/0 00000100:00100000:3.0:1788201249.140877:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 269 00000100:00100000:2.0:1788201249.145384:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201249.148079:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695469568 00000100:00100000:1.0:1788201249.148095:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695469568 00000100:00100000:1.0:1788201249.148264:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695469824 00000100:00100000:1.0:1788201249.148269:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695469824 00000100:00100000:3.0:1788201249.150222:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695470080 00000100:00100000:3.0:1788201249.150236:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695470080 00000100:00100000:3.0:1788201249.150291:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1562 00000100:00100000:3.0:1788201249.150302:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+73:73766:x1875060695469568:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:3.0:1788201249.150324:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201249.150345:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8c00/0x96d0c9b8c9a1d183 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b89 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.150381:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9400/0x96d0c9b8c9a1d18a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.150396:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9400/0x96d0c9b8c9a1d18a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.150426:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9400/0x96d0c9b8c9a1d18a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.150778:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8c00/0x96d0c9b8c9a1d183 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b89 expref: 75 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.150799:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9400/0x96d0c9b8c9a1d18a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b89 expref: 74 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.150808:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff8dc1207c9500) 00010000:00010000:3.0:1788201249.150811:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788201249.150815:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc11cda9400, rc 0) 00000100:00100000:3.0:1788201249.150882:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+74:73766:x1875060695469568:12345-192.168.201.20@tcp:101:dd.0 Request processed in 582us (10543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201249.150889:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1562 00000100:00100000:3.0:1788201249.150915:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1563 00000100:00100000:3.0:1788201249.150923:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+73:73750:x1875060695469824:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:3.0:1788201249.150933:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201249.150942:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1d191 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b90 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.151288:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1d198 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.151299:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1d198 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.151319:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1d198 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.151334:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9a00/0x96d0c9b8c9a1d19f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.151342:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9a00/0x96d0c9b8c9a1d19f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.151349:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9a00/0x96d0c9b8c9a1d19f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.151399:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8600/0x96d0c9b8c9a1d1a6 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.151407:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8600/0x96d0c9b8c9a1d1a6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.151414:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8600/0x96d0c9b8c9a1d1a6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201249.151423:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x8:0x0]: returning size 0 00000100:00100000:2.0:1788201249.151703:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1564 00000100:00100000:2.0:1788201249.151715:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+74:73752:x1875060695470080:12345-192.168.201.20@tcp:36:dd.0 00010000:00010000:2.0:1788201249.151748:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201249.151766:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1d13d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b66 expref: 74 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.151781:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff8dc11248c800) 00010000:00010000:2.0:1788201249.151785:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201249.151914:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1d1ad lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.151924:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1d1ad lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.151932:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1d1ad lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788201249.151974:0:66314:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051676 00010000:00010000:3.0:1788201249.152112:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1d198 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.152119:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1d198 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.152125:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1d198 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.152130:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1d198 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.152143:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda8200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201249.152148:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1d198 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.152154:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1d198 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.152163:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:3.0:1788201249.152166:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201249.152169:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1d198 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.152174:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8200/0x96d0c9b8c9a1d198 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.152184:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9a00/0x96d0c9b8c9a1d19f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.152190:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9a00/0x96d0c9b8c9a1d19f lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.152196:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9a00/0x96d0c9b8c9a1d19f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.152201:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda9a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201249.152219:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9a00/0x96d0c9b8c9a1d19f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.152225:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9a00/0x96d0c9b8c9a1d19f lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.152242:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff8dc007bc4d00) 00010000:00010000:3.0:1788201249.152244:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201249.152246:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9a00/0x96d0c9b8c9a1d19f lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.152253:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9a00/0x96d0c9b8c9a1d19f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.152294:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8800/0x96d0c9b8c9a1d191 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b90 expref: 77 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.152307:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8600/0x96d0c9b8c9a1d1a6 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b90 expref: 76 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.152314:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff8dc11248c300) 00010000:00010000:3.0:1788201249.152317:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201249.152319:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc11cda8600, rc 0) 00000100:00100000:3.0:1788201249.152362:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+76:73750:x1875060695469824:12345-192.168.201.20@tcp:101:dd.0 Request processed in 1440us (11949us total) trans 124554051678 rc 0/0 00000100:00100000:3.0:1788201249.152369:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1563 00000100:00100000:3.0:1788201249.152436:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.152897:0:25936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695470208 00000100:00100000:0.0:1788201249.152905:0:25936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695470208 00002000:00010000:0.0:1788201249.152944:0:25936:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/901 (0->18446744073709551615) 00002000:00100000:0.0:1788201249.152949:0:25936:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc004b3a680 with x1875060695470208 ext(0->18446744073709551615) 00002000:00010000:0.0:1788201249.152957:0:25936:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc004b3a680. 00000100:00100000:0.0:1788201249.152989:0:25936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1013 00000100:00100000:0.0:1788201249.152998:0:25936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:2401:x1875060695470208:12345-192.168.201.20@tcp:10:dd.0 00002000:00010000:0.0:1788201249.153135:0:25936:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x385:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788201249.153139:0:25936:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x385:0x0] updating lvb mtime from disk: 1788201238 -> 1788201249 00002000:00010000:0.0:1788201249.153141:0:25936:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x385:0x0] updating lvb atime from disk: 1788201238 -> 1788201238 00002000:00010000:0.0:1788201249.153151:0:25936:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x385:0x0] updating lvb ctime from disk: 1788201238 -> 1788201249 00002000:00010000:0.0:1788201249.153153:0:25936:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x385:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1788201249.153163:0:25936:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004b3a680 x1875060695470208/t4294969484(0) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 440/432 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201249.153202:0:25936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+17:2401:x1875060695470208:12345-192.168.201.20@tcp:10:dd.0 Request processed in 206us (765us total) trans 4294969484 rc 0/0 00000100:00100000:0.0:1788201249.153210:0:25936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1013 00002000:00010000:0.0:1788201249.153213:0:25936:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/901 (0->18446744073709551615) 00002000:00100000:0.0:1788201249.153216:0:25936:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc004b3a680 with x1875060695470208 ext(0->18446744073709551615) 00002000:00010000:0.0:1788201249.153221:0:25936:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc004b3a680. 00000004:00010000:2.0:1788201249.156368:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000377b7589 reply state 0000000002878bed transno 124554051677 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1d1ad lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.156427:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1d1ad lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.156437:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff8dc11248c800) 00010000:00010000:2.0:1788201249.156440:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201249.156457:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201249.156612:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+76:73752:x1875060695470080:12345-192.168.201.20@tcp:36:dd.0 Request processed in 4895us (11231us total) trans 124554051677 rc 0/0 00000100:00100000:2.0:1788201249.156621:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1564 00000020:00080000:2.0:1788201249.156628:0:66314:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788201249.157538:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201249.157606:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695470464 00000100:00100000:3.0:1788201249.157616:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695470464 00000100:00100000:3.0:1788201249.157665:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1565 00000100:00100000:3.0:1788201249.157692:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+76:73755:x1875060695470464:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:3.0:1788201249.157713:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201249.157731:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8a00/0x96d0c9b8c9a1d1bb lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b97 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.157866:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9e00/0x96d0c9b8c9a1d1c2 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.157879:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9e00/0x96d0c9b8c9a1d1c2 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.157888:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9e00/0x96d0c9b8c9a1d1c2 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.157900:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9c00/0x96d0c9b8c9a1d1c9 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.157906:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9c00/0x96d0c9b8c9a1d1c9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.157928:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9c00/0x96d0c9b8c9a1d1c9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.157978:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8400/0x96d0c9b8c9a1d1d0 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.157986:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8400/0x96d0c9b8c9a1d1d0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.157993:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8400/0x96d0c9b8c9a1d1d0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201249.158002:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xd:0x0]: returning size 0 00010000:00010000:3.0:1788201249.158096:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9e00/0x96d0c9b8c9a1d1c2 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.158103:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9e00/0x96d0c9b8c9a1d1c2 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.158114:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9e00/0x96d0c9b8c9a1d1c2 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.158120:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9e00/0x96d0c9b8c9a1d1c2 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.158125:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda9e00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201249.158130:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9e00/0x96d0c9b8c9a1d1c2 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.158138:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9e00/0x96d0c9b8c9a1d1c2 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.158150:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:3.0:1788201249.158152:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201249.158156:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9e00/0x96d0c9b8c9a1d1c2 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.158162:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9e00/0x96d0c9b8c9a1d1c2 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.158175:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9c00/0x96d0c9b8c9a1d1c9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.158180:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9c00/0x96d0c9b8c9a1d1c9 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.158185:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9c00/0x96d0c9b8c9a1d1c9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.158190:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda9c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201249.158198:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9c00/0x96d0c9b8c9a1d1c9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.158204:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9c00/0x96d0c9b8c9a1d1c9 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.158211:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff8dc007bc4f00) 00010000:00010000:3.0:1788201249.158213:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201249.158216:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9c00/0x96d0c9b8c9a1d1c9 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.158221:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9c00/0x96d0c9b8c9a1d1c9 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.158463:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8a00/0x96d0c9b8c9a1d1bb lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b97 expref: 79 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.158479:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8400/0x96d0c9b8c9a1d1d0 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b97 expref: 78 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.158486:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff8dc0048be500) 00010000:00010000:3.0:1788201249.158489:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201249.158491:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc11cda8400, rc 0) 00000100:00100000:3.0:1788201249.158545:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+78:73755:x1875060695470464:12345-192.168.201.20@tcp:101:dd.0 Request processed in 855us (1010us total) trans 124554051679 rc 0/0 00000100:00100000:3.0:1788201249.158552:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1565 00000100:00100000:0.0:1788201249.160519:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.160585:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.160633:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695470976 00000100:00100000:2.0:1788201249.160642:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695470976 00000100:00100000:2.0:1788201249.160706:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1566 00000100:00100000:2.0:1788201249.160716:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+78:73766:x1875060695470976:12345-192.168.201.20@tcp:36:dd.0 00010000:00010000:2.0:1788201249.160770:0:66757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201249.160796:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1d16e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b82 expref: 78 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.160812:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff8dc1207c9500) 00010000:00010000:2.0:1788201249.160817:0:66757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201249.160974:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d1de lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.160987:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d1de lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.160998:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d1de lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788201249.161089:0:66757:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051680 00000004:00010000:2.0:1788201249.161110:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061d0e456 reply state 000000000de129cc transno 124554051681 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d1de lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.161123:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d1de lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.161130:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff8dc1207c9500) 00010000:00010000:2.0:1788201249.161133:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201249.161135:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201249.161224:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+80:73766:x1875060695470976:12345-192.168.201.20@tcp:36:dd.0 Request processed in 508us (637us total) trans 124554051681 rc 0/0 00000100:00100000:2.0:1788201249.161231:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1566 00000020:00080000:2.0:1788201249.161236:0:66757:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788201249.161302:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695470720 00000100:00100000:1.0:1788201249.161312:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695470720 00000100:00100000:1.0:1788201249.161355:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5958 00000100:00100000:1.0:1788201249.161362:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+17:73752:x1875060695470720:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:1.0:1788201249.161372:0:26200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201249.161387:0:26200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000587aac9c/0x96d0c9b8c9a1d1e5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ba5 expref: -99 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201249.161407:0:26200:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x386:0x0] initial LVB size: 0, mtime: 0x6a95c916, atime: 0x6a95c916, ctime: 0x6a95c916, blocks: 0x0 00010000:00010000:1.0:1788201249.161423:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x386:0x0].0x0 since=4100s v=(0 0) 00010000:00010000:1.0:1788201249.161428:0:26200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x386:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201249.161436:0:26200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000587aac9c/0x96d0c9b8c9a1d1e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ba5 expref: 18 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.161463:0:26200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000587aac9c/0x96d0c9b8c9a1d1e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ba5 expref: 18 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.161474:0:26200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e3600, rc 0) 00010000:00000080:1.0:1788201249.161481:0:26200:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc118143b80 x1875060695470720/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 328/400 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201249.161516:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+18:73752:x1875060695470720:12345-192.168.201.20@tcp:101:dd.0 Request processed in 154us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201249.161523:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5958 00000100:00100000:0.0:1788201249.163467:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201249.164514:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695470592 00000100:00100000:3.0:1788201249.164525:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695470592 00000100:00100000:3.0:1788201249.164586:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1567 00000100:00100000:3.0:1788201249.164595:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+80:73750:x1875060695470592:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:3.0:1788201249.164629:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201249.164650:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1d1ec lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b9e expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.164701:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672000/0x96d0c9b8c9a1d1f3 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.164715:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672000/0x96d0c9b8c9a1d1f3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.164726:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672000/0x96d0c9b8c9a1d1f3 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.164838:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1d1ec lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b9e expref: 82 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.164856:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672000/0x96d0c9b8c9a1d1f3 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b9e expref: 81 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.164865:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff8dc11248c300) 00010000:00010000:3.0:1788201249.164868:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788201249.164871:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc101672000, rc 0) 00000100:00100000:3.0:1788201249.165459:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+81:73750:x1875060695470592:12345-192.168.201.20@tcp:101:dd.0 Request processed in 861us (1997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201249.165468:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1567 00000100:00100000:2.0:1788201249.165561:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201249.165647:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695471104 00000100:00100000:3.0:1788201249.165653:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695471104 00000100:00100000:3.0:1788201249.165794:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5959 00000100:00100000:3.0:1788201249.165803:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a9b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+18:73766:x1875060695471104:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:3.0:1788201249.165821:0:26202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201249.165837:0:26202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae2bee79/0x96d0c9b8c9a1d1fa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786bac expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201249.165857:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x394:0x0] initial LVB size: 0, mtime: 0x6a95c916, atime: 0x6a95c916, ctime: 0x6a95c916, blocks: 0x0 00010000:00010000:3.0:1788201249.165873:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x394:0x0].0x0 since=4100s v=(0 0) 00010000:00010000:3.0:1788201249.165878:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x394:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201249.165885:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae2bee79/0x96d0c9b8c9a1d1fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bac expref: 19 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.165898:0:26202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ae2bee79/0x96d0c9b8c9a1d1fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bac expref: 19 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.165979:0:26202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc101673200, rc 0) 00010000:00000080:3.0:1788201249.165996:0:26202:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc00a9b4380 x1875060695471104/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 328/400 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201249.166058:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a9b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+19:73766:x1875060695471104:12345-192.168.201.20@tcp:101:dd.0 Request processed in 256us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201249.166063:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5959 00000100:00100000:2.0:1788201249.174321:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.174401:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.174452:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.174479:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.174511:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.174536:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.174566:0:24876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695471232 00000100:00100000:2.0:1788201249.174576:0:24876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695471232 00002000:00010000:2.0:1788201249.174614:0:24876:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/902 (0->18446744073709551615) 00002000:00100000:2.0:1788201249.174620:0:24876:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc004eb7480 with x1875060695471232 ext(0->18446744073709551615) 00002000:00010000:2.0:1788201249.174631:0:24876:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc004eb7480. 00000100:00100000:2.0:1788201249.174653:0:24876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695472000 00000100:00100000:2.0:1788201249.174656:0:24876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695472000 00002000:00010000:2.0:1788201249.174696:0:24876:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/916 (0->18446744073709551615) 00002000:00100000:2.0:1788201249.174700:0:24876:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc10604bb80 with x1875060695472000 ext(0->18446744073709551615) 00002000:00010000:2.0:1788201249.174705:0:24876:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc10604bb80. 00000100:00100000:2.0:1788201249.174724:0:24876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1014 00000100:00100000:2.0:1788201249.174735:0:24876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:2403:x1875060695471232:12345-192.168.201.20@tcp:10:dd.0 00002000:00010000:2.0:1788201249.174887:0:24876:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x386:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788201249.174896:0:24876:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x386:0x0] updating lvb mtime from disk: 1788201238 -> 1788201249 00002000:00010000:2.0:1788201249.174900:0:24876:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x386:0x0] updating lvb atime from disk: 1788201238 -> 1788201238 00002000:00010000:2.0:1788201249.174903:0:24876:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x386:0x0] updating lvb ctime from disk: 1788201238 -> 1788201249 00002000:00010000:2.0:1788201249.174904:0:24876:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x386:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1788201249.174914:0:24876:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004eb7480 x1875060695471232/t4294969485(0) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 440/432 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201249.174973:0:24876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+21:2403:x1875060695471232:12345-192.168.201.20@tcp:10:dd.0 Request processed in 240us (572us total) trans 4294969485 rc 0/0 00000100:00100000:2.0:1788201249.174982:0:24876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1014 00002000:00010000:2.0:1788201249.174986:0:24876:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/902 (0->18446744073709551615) 00002000:00100000:2.0:1788201249.174989:0:24876:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc004eb7480 with x1875060695471232 ext(0->18446744073709551615) 00002000:00010000:2.0:1788201249.174993:0:24876:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc004eb7480. 00000100:00100000:2.0:1788201249.175010:0:24876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1015 00000100:00100000:2.0:1788201249.175045:0:24876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:2400:x1875060695472000:12345-192.168.201.20@tcp:10:dd.0 00002000:00010000:2.0:1788201249.175109:0:24876:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x394:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788201249.175112:0:24876:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x394:0x0] updating lvb mtime from disk: 1788201238 -> 1788201249 00002000:00010000:2.0:1788201249.175114:0:24876:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x394:0x0] updating lvb atime from disk: 1788201238 -> 1788201238 00002000:00010000:2.0:1788201249.175116:0:24876:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x394:0x0] updating lvb ctime from disk: 1788201238 -> 1788201249 00002000:00010000:2.0:1788201249.175117:0:24876:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x394:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1788201249.175130:0:24876:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc10604bb80 x1875060695472000/t4294969486(0) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 440/432 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201249.175155:0:24876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+21:2400:x1875060695472000:12345-192.168.201.20@tcp:10:dd.0 Request processed in 139us (643us total) trans 4294969486 rc 0/0 00000100:00100000:2.0:1788201249.175162:0:24876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1015 00002000:00010000:2.0:1788201249.175165:0:24876:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/916 (0->18446744073709551615) 00002000:00100000:2.0:1788201249.175167:0:24876:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc10604bb80 with x1875060695472000 ext(0->18446744073709551615) 00002000:00010000:2.0:1788201249.175172:0:24876:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc10604bb80. 00000100:00100000:2.0:1788201249.175198:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695471872 00000100:00100000:2.0:1788201249.175213:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695471872 00000100:00100000:2.0:1788201249.175243:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695471616 00000100:00100000:2.0:1788201249.175246:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695471616 00000100:00100000:2.0:1788201249.175262:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695472256 00000100:00100000:2.0:1788201249.175265:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695472256 00000100:00100000:2.0:1788201249.175278:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1568 00000100:00100000:2.0:1788201249.175284:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+83:73757:x1875060695471872:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:2.0:1788201249.175300:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201249.175318:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1d201 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786bb3 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175432:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbdc00/0x96d0c9b8c9a1d208 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175447:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbdc00/0x96d0c9b8c9a1d208 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175459:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbdc00/0x96d0c9b8c9a1d208 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175484:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d20f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175492:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d20f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175499:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d20f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175556:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1d216 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175565:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1d216 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175572:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1d216 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201249.175582:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xf:0x0]: returning size 0 00010000:00010000:2.0:1788201249.175636:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbdc00/0x96d0c9b8c9a1d208 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175643:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbdc00/0x96d0c9b8c9a1d208 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175649:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbdc00/0x96d0c9b8c9a1d208 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175656:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbdc00/0x96d0c9b8c9a1d208 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175662:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbdc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201249.175673:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbdc00/0x96d0c9b8c9a1d208 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175695:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbdc00/0x96d0c9b8c9a1d208 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175707:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201249.175711:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201249.175715:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbdc00/0x96d0c9b8c9a1d208 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175721:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbdc00/0x96d0c9b8c9a1d208 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175735:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d20f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175741:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d20f lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175747:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d20f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175752:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201249.175756:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d20f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175762:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d20f lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175770:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff8dc1207c9100) 00010000:00010000:2.0:1788201249.175772:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201249.175781:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d20f lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175788:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d20f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175832:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1d201 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bb3 expref: 86 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175846:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1d216 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bb3 expref: 85 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175853:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff8dc005cc6f00) 00010000:00010000:2.0:1788201249.175856:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201249.175859:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbce00, rc 0) 00000100:00100000:2.0:1788201249.175885:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+85:73757:x1875060695471872:12345-192.168.201.20@tcp:101:dd.0 Request processed in 601us (1442us total) trans 124554051682 rc 0/0 00000100:00100000:2.0:1788201249.175892:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1568 00000100:00100000:2.0:1788201249.175912:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1569 00000100:00100000:2.0:1788201249.175920:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+84:73755:x1875060695471616:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:2.0:1788201249.175928:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201249.175939:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1d224 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786bba expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175956:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1d22b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175964:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1d22b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.175982:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1d22b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.176080:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1d224 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bba expref: 86 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.176092:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1d22b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bba expref: 85 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.176100:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff8dc0048be500) 00010000:00010000:2.0:1788201249.176103:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788201249.176106:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbd000, rc 0) 00000100:00100000:2.0:1788201249.176133:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+85:73755:x1875060695471616:12345-192.168.201.20@tcp:101:dd.0 Request processed in 214us (1653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201249.176140:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1569 00000100:00100000:2.0:1788201249.176153:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1570 00000100:00100000:2.0:1788201249.176160:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+84:73750:x1875060695472256:12345-192.168.201.20@tcp:36:dd.0 00010000:00010000:2.0:1788201249.176189:0:66757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201249.176217:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8600/0x96d0c9b8c9a1d1a6 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b90 expref: 84 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.176228:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff8dc11248c300) 00010000:00010000:2.0:1788201249.176232:0:66757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201249.176342:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1d232 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.176351:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1d232 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.176366:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1d232 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788201249.176412:0:66757:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051683 00000004:00010000:2.0:1788201249.176431:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e55efb63 reply state 00000000bcc58577 transno 124554051684 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1d232 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.176443:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1d232 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.176449:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff8dc11248c300) 00010000:00010000:2.0:1788201249.176452:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201249.176454:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201249.176496:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+86:73750:x1875060695472256:12345-192.168.201.20@tcp:36:dd.0 Request processed in 336us (1958us total) trans 124554051684 rc 0/0 00000100:00100000:2.0:1788201249.176502:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1570 00000020:00080000:2.0:1788201249.176506:0:66757:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788201249.177897:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695471488 00000100:00100000:3.0:1788201249.177983:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695471488 00000100:00100000:2.0:1788201249.178212:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 270 00000100:00100000:2.0:1788201249.178222:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+86:73751:x1875060695471488:12345-192.168.201.20@tcp:35:dd.0 00000100:00100000:2.0:1788201249.179256:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+87:73751:x1875060695471488:12345-192.168.201.20@tcp:35:dd.0 Request processed in 1028us (4937us total) trans 124554051685 rc 0/0 00000100:00100000:2.0:1788201249.179266:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 270 00000100:00100000:3.0:1788201249.180862:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.182538:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695472512 00000100:00100000:2.0:1788201249.182553:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695472512 00000100:00100000:2.0:1788201249.182631:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1571 00000100:00100000:2.0:1788201249.182641:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+87:73755:x1875060695472512:12345-192.168.201.20@tcp:36:dd.0 00010000:00010000:2.0:1788201249.182724:0:66757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201249.182758:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8400/0x96d0c9b8c9a1d1d0 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b97 expref: 87 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.182777:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff8dc0048be500) 00010000:00010000:2.0:1788201249.182781:0:66757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201249.182939:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74400/0x96d0c9b8c9a1d239 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.182953:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74400/0x96d0c9b8c9a1d239 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.182962:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74400/0x96d0c9b8c9a1d239 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788201249.183006:0:66757:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051686 00000004:00010000:2.0:1788201249.183056:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce424ac7 reply state 00000000b27f9583 transno 124554051687 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74400/0x96d0c9b8c9a1d239 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.183068:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74400/0x96d0c9b8c9a1d239 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.183073:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff8dc0048be500) 00010000:00010000:2.0:1788201249.183075:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201249.183078:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201249.183162:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+89:73755:x1875060695472512:12345-192.168.201.20@tcp:36:dd.0 Request processed in 522us (2308us total) trans 124554051687 rc 0/0 00000100:00100000:2.0:1788201249.183168:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1571 00000020:00080000:2.0:1788201249.183173:0:66757:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788201249.185366:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201249.185466:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695473024 00000100:00100000:1.0:1788201249.185475:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695473024 00000100:00100000:1.0:1788201249.185532:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1572 00000100:00100000:1.0:1788201249.185542:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+89:73759:x1875060695473024:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:1.0:1788201249.185579:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201249.185601:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1d240 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786bc8 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.185736:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1d247 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.185752:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1d247 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.185762:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1d247 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.185777:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d24e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.185784:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d24e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.185792:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d24e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.185850:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1d255 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.185859:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1d255 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.185866:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1d255 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201249.185876:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x11:0x0]: returning size 0 00010000:00010000:1.0:1788201249.185963:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1d247 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.185972:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1d247 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.185978:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1d247 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.185983:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1d247 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.185988:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201249.185993:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1d247 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.185999:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1d247 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.186011:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:1.0:1788201249.186166:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201249.186172:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1d247 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.186179:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1d247 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.186192:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d24e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.186199:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d24e lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.186215:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d24e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.186227:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201249.186231:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d24e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.186237:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d24e lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.186246:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff8dc005cc6600) 00010000:00010000:1.0:1788201249.186248:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201249.186251:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d24e lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.186257:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1d24e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.186302:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1d240 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bc8 expref: 92 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.186317:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1d255 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bc8 expref: 91 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.186324:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff8dc005cc6800) 00010000:00010000:1.0:1788201249.186326:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201249.186328:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e2e00, rc 0) 00000100:00100000:1.0:1788201249.186396:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+91:73759:x1875060695473024:12345-192.168.201.20@tcp:101:dd.0 Request processed in 855us (1039us total) trans 124554051688 rc 0/0 00000100:00100000:1.0:1788201249.186405:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1572 00000100:00100000:0.0:1788201249.188750:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.188796:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.188881:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695473280 00000100:00100000:2.0:1788201249.188891:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695473280 00000100:00100000:2.0:1788201249.188942:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 271 00000100:00100000:2.0:1788201249.188953:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+91:73752:x1875060695473280:12345-192.168.201.20@tcp:35:dd.0 00000100:00100000:2.0:1788201249.189275:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+92:73752:x1875060695473280:12345-192.168.201.20@tcp:35:dd.0 Request processed in 324us (477us total) trans 124554051689 rc 0/0 00000100:00100000:2.0:1788201249.189283:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 271 00000100:00100000:1.0:1788201249.190465:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695472640 00000100:00100000:1.0:1788201249.190494:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695472640 00000100:00100000:1.0:1788201249.190541:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5960 00000100:00100000:1.0:1788201249.190549:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+21:73750:x1875060695472640:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:1.0:1788201249.190562:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201249.190586:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009117cd9/0x96d0c9b8c9a1d263 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786bcf expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201249.190611:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x384:0x0] initial LVB size: 0, mtime: 0x6a95c916, atime: 0x6a95c916, ctime: 0x6a95c916, blocks: 0x0 00010000:00010000:1.0:1788201249.190631:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x384:0x0].0x0 since=4100s v=(0 0) 00010000:00010000:1.0:1788201249.190635:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x384:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201249.190644:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009117cd9/0x96d0c9b8c9a1d263 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bcf expref: 22 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.190658:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000009117cd9/0x96d0c9b8c9a1d263 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bcf expref: 22 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.190671:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e3a00, rc 0) 00010000:00000080:1.0:1788201249.190705:0:8448:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12ee2ca80 x1875060695472640/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 328/400 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201249.190747:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:73750:x1875060695472640:12345-192.168.201.20@tcp:101:dd.0 Request processed in 198us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201249.190754:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5960 00000100:00100000:2.0:1788201249.192174:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.192243:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695472768 00000100:00100000:0.0:1788201249.192250:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695472768 00000100:00100000:0.0:1788201249.192303:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1573 00000100:00100000:0.0:1788201249.192313:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+92:73757:x1875060695472768:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:0.0:1788201249.192329:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201249.192347:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d26a lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786bc1 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.192379:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1d271 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.192405:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1d271 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.192415:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1d271 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.192547:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d26a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bc1 expref: 94 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.192566:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1d271 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bc1 expref: 93 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.192575:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff8dc005cc6f00) 00010000:00010000:0.0:1788201249.192578:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788201249.192582:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896a000, rc 0) 00000100:00100000:3.0:1788201249.192750:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.192797:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695473408 00000100:00100000:2.0:1788201249.192801:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695473408 00000100:00100000:2.0:1788201249.192837:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5961 00000100:00100000:2.0:1788201249.192844:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:73755:x1875060695473408:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:2.0:1788201249.192852:0:26199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201249.192865:0:26199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040edfed0/0x96d0c9b8c9a1d278 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786bd6 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201249.192885:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x389:0x0] initial LVB size: 0, mtime: 0x6a95c916, atime: 0x6a95c916, ctime: 0x6a95c916, blocks: 0x0 00010000:00010000:2.0:1788201249.192901:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x389:0x0].0x0 since=4100s v=(0 0) 00010000:00010000:2.0:1788201249.194641:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x389:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201249.194656:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040edfed0/0x96d0c9b8c9a1d278 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bd6 expref: 23 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.194692:0:26199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000040edfed0/0x96d0c9b8c9a1d278 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bd6 expref: 23 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.194708:0:26199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c75000, rc 0) 00010000:00000080:2.0:1788201249.194716:0:26199:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004b3ad80 x1875060695473408/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 328/400 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201249.195403:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+93:73757:x1875060695472768:12345-192.168.201.20@tcp:101:dd.0 Request processed in 3086us (3231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201249.195413:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1573 00000100:00100000:0.0:1788201249.197097:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201249.197184:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695473664 00000100:00100000:3.0:1788201249.197195:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695473664 00000100:00100000:3.0:1788201249.197270:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 272 00000100:00100000:3.0:1788201249.197293:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+93:73766:x1875060695473664:12345-192.168.201.20@tcp:35:dd.0 00000100:00100000:3.0:1788201249.198793:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+94:73766:x1875060695473664:12345-192.168.201.20@tcp:35:dd.0 Request processed in 1495us (1695us total) trans 124554051690 rc 0/0 00000100:00100000:3.0:1788201249.198806:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 272 00000100:00100000:0.0:1788201249.199091:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.199127:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201249.199240:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695473920 00000100:00100000:3.0:1788201249.199247:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695473920 00000100:00100000:3.0:1788201249.199289:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695474048 00000100:00100000:3.0:1788201249.199293:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695474048 00000100:00100000:3.0:1788201249.199315:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1574 00000100:00100000:3.0:1788201249.199324:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+95:73758:x1875060695473920:12345-192.168.201.20@tcp:101:dd.0 00000100:00100000:1.0:1788201249.199332:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1575 00000100:00100000:1.0:1788201249.199340:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+95:73759:x1875060695474048:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:3.0:1788201249.199342:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201249.199346:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201249.199362:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1d27f lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786bdd expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.199365:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1d286 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786be4 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.199395:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fce00/0x96d0c9b8c9a1d28d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.199409:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fce00/0x96d0c9b8c9a1d28d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.199419:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fce00/0x96d0c9b8c9a1d28d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.199513:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1d286 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786be4 expref: 98 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.199530:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fce00/0x96d0c9b8c9a1d28d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786be4 expref: 97 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.199541:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff8dc005cc6800) 00010000:00010000:1.0:1788201249.199544:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788201249.199548:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fce00, rc 0) 00000100:00100000:1.0:1788201249.199587:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+97:73759:x1875060695474048:12345-192.168.201.20@tcp:101:dd.0 Request processed in 248us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201249.199593:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1575 00010000:00010000:3.0:1788201249.199673:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673a00/0x96d0c9b8c9a1d294 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.199695:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673a00/0x96d0c9b8c9a1d294 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.199703:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673a00/0x96d0c9b8c9a1d294 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.199717:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1d29b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.199725:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1d29b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.199732:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1d29b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.199790:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1d2a2 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.199799:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1d2a2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.199806:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1d2a2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201249.199816:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x10:0x0]: returning size 0 00010000:00010000:3.0:1788201249.199887:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673a00/0x96d0c9b8c9a1d294 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.199895:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673a00/0x96d0c9b8c9a1d294 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.199899:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673a00/0x96d0c9b8c9a1d294 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.199904:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673a00/0x96d0c9b8c9a1d294 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.199907:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101673a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201249.199911:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673a00/0x96d0c9b8c9a1d294 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.199918:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673a00/0x96d0c9b8c9a1d294 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.199928:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:3.0:1788201249.199930:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201249.199939:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673a00/0x96d0c9b8c9a1d294 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.199945:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673a00/0x96d0c9b8c9a1d294 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.199956:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1d29b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.199963:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1d29b lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.199969:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1d29b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.199973:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101672c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201249.199975:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1d29b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.199978:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1d29b lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.199984:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff8dc007bc4f00) 00010000:00010000:3.0:1788201249.199995:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201249.199998:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1d29b lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.200001:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1d29b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.200061:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1d27f lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bdd expref: 98 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.200085:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1d2a2 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bdd expref: 97 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.200090:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff8dc005cc6500) 00010000:00010000:3.0:1788201249.200092:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201249.200094:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc101673e00, rc 0) 00000100:00100000:3.0:1788201249.200121:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+97:73758:x1875060695473920:12345-192.168.201.20@tcp:101:dd.0 Request processed in 798us (1031us total) trans 124554051691 rc 0/0 00000100:00100000:3.0:1788201249.200127:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1574 00000100:00100000:2.0:1788201249.200738:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+23:73755:x1875060695473408:12345-192.168.201.20@tcp:101:dd.0 Request processed in 7890us (7985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201249.200756:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5961 00000100:00100000:0.0:1788201249.203726:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.203799:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201249.203832:0:24857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695474176 00000100:00100000:1.0:1788201249.203842:0:24857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695474176 00002000:00010000:1.0:1788201249.203879:0:24857:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/900 (0->18446744073709551615) 00002000:00100000:1.0:1788201249.203885:0:24857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc12ee2d180 with x1875060695474176 ext(0->18446744073709551615) 00002000:00010000:1.0:1788201249.203897:0:24857:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc12ee2d180. 00000100:00100000:3.0:1788201249.203954:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695474432 00000100:00100000:3.0:1788201249.203959:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695474432 00000100:00100000:3.0:1788201249.204032:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1576 00000100:00100000:3.0:1788201249.204043:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+97:73757:x1875060695474432:12345-192.168.201.20@tcp:36:dd.0 00010000:00010000:3.0:1788201249.204089:0:66312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201249.204113:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1d216 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bb3 expref: 97 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.204129:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff8dc005cc6f00) 00010000:00010000:3.0:1788201249.204133:0:66312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201249.204297:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1d2b0 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.204312:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1d2b0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.204321:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1d2b0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788201249.204383:0:66312:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051692 00000004:00010000:3.0:1788201249.204404:0:66312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029dbec22 reply state 0000000073b034aa transno 124554051693 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1d2b0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.204415:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1d2b0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.204421:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff8dc005cc6f00) 00010000:00010000:3.0:1788201249.204423:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201249.204425:0:66312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201249.204476:0:24857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1016 00000100:00100000:1.0:1788201249.204490:0:24857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+23:2402:x1875060695474176:12345-192.168.201.20@tcp:10:dd.0 00000100:00100000:3.0:1788201249.204512:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+99:73757:x1875060695474432:12345-192.168.201.20@tcp:36:dd.0 Request processed in 471us (712us total) trans 124554051693 rc 0/0 00000100:00100000:3.0:1788201249.204519:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1576 00000020:00080000:3.0:1788201249.204524:0:66312:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00002000:00010000:1.0:1788201249.204591:0:24857:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x384:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788201249.204595:0:24857:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x384:0x0] updating lvb mtime from disk: 1788201238 -> 1788201249 00002000:00010000:1.0:1788201249.204598:0:24857:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x384:0x0] updating lvb atime from disk: 1788201238 -> 1788201238 00002000:00010000:1.0:1788201249.204600:0:24857:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x384:0x0] updating lvb ctime from disk: 1788201238 -> 1788201249 00002000:00010000:1.0:1788201249.204603:0:24857:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x384:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1788201249.204611:0:24857:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12ee2d180 x1875060695474176/t4294969487(0) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 440/432 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201249.204638:0:24857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+24:2402:x1875060695474176:12345-192.168.201.20@tcp:10:dd.0 Request processed in 149us (923us total) trans 4294969487 rc 0/0 00000100:00100000:1.0:1788201249.204644:0:24857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1016 00002000:00010000:1.0:1788201249.204647:0:24857:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/900 (0->18446744073709551615) 00002000:00100000:1.0:1788201249.204650:0:24857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc12ee2d180 with x1875060695474176 ext(0->18446744073709551615) 00002000:00010000:1.0:1788201249.204655:0:24857:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc12ee2d180. 00000100:00100000:0.0:1788201249.205651:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201249.205756:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695474688 00000100:00100000:1.0:1788201249.205763:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695474688 00000100:00100000:1.0:1788201249.205805:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1577 00000100:00100000:1.0:1788201249.205812:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+99:73759:x1875060695474688:12345-192.168.201.20@tcp:36:dd.0 00010000:00010000:1.0:1788201249.205852:0:69485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201249.205871:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1d255 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bc8 expref: 99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.205885:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff8dc005cc6800) 00010000:00010000:1.0:1788201249.205889:0:69485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201249.206445:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1d2b7 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.206468:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1d2b7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.206476:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1d2b7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201249.206516:0:69485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051694 00000004:00010000:1.0:1788201249.206535:0:69485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041fd6ca0 reply state 000000005e713013 transno 124554051695 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1d2b7 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.206546:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1d2b7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.206552:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff8dc005cc6800) 00010000:00010000:1.0:1788201249.206554:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201249.206556:0:69485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201249.206634:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+101:73759:x1875060695474688:12345-192.168.201.20@tcp:36:dd.0 Request processed in 822us (987us total) trans 124554051695 rc 0/0 00000100:00100000:1.0:1788201249.206641:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1577 00000020:00080000:1.0:1788201249.206645:0:69485:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788201249.210829:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.210867:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.210897:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201249.210927:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695475072 00000100:00100000:1.0:1788201249.210938:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695475072 00000100:00100000:0.0:1788201249.210942:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.210963:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00002000:00010000:1.0:1788201249.210978:0:8452:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/905 (0->18446744073709551615) 00002000:00100000:1.0:1788201249.210983:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc005abd180 with x1875060695475072 ext(0->18446744073709551615) 00002000:00010000:1.0:1788201249.210994:0:8452:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc005abd180. 00000100:00100000:0.0:1788201249.210997:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201249.211035:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1017 00000100:00100000:0.0:1788201249.211040:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695475584 00000100:00100000:0.0:1788201249.211043:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695475584 00000100:00100000:1.0:1788201249.211045:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+24:2403:x1875060695475072:12345-192.168.201.20@tcp:10:dd.0 00000100:00100000:0.0:1788201249.211066:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695475712 00000100:00100000:0.0:1788201249.211069:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695475712 00000100:00100000:0.0:1788201249.211083:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5962 00000100:00100000:0.0:1788201249.211089:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+26:73757:x1875060695475584:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:0.0:1788201249.211097:0:26205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201249.211118:0:26205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000362585d6/0x96d0c9b8c9a1d2be lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786bf9 expref: -99 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201249.211136:0:26205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38b:0x0] initial LVB size: 0, mtime: 0x6a95c916, atime: 0x6a95c916, ctime: 0x6a95c916, blocks: 0x0 00010000:00010000:0.0:1788201249.211152:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38b:0x0].0x0 since=4100s v=(0 0) 00010000:00010000:0.0:1788201249.211156:0:26205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201249.211164:0:26205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000362585d6/0x96d0c9b8c9a1d2be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bf9 expref: 28 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.211178:0:26205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000362585d6/0x96d0c9b8c9a1d2be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bf9 expref: 28 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201249.211188:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x389:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:0.0:1788201249.211191:0:26205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896ac00, rc 0) 00002000:00010000:1.0:1788201249.211196:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x389:0x0] updating lvb mtime from disk: 1788201238 -> 1788201249 00010000:00000080:0.0:1788201249.211198:0:26205:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004be6a00 x1875060695475584/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 328/400 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00010000:1.0:1788201249.211199:0:8452:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x389:0x0] updating lvb atime from disk: 1788201238 -> 1788201238 00002000:00010000:1.0:1788201249.211201:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x389:0x0] updating lvb ctime from disk: 1788201238 -> 1788201249 00002000:00010000:1.0:1788201249.211217:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x389:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1788201249.211224:0:8452:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc005abd180 x1875060695475072/t4294969488(0) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 440/432 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201249.211285:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695475200 00000100:00100000:2.0:1788201249.211289:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695475200 00000100:00100000:2.0:1788201249.211324:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695475456 00000100:00100000:2.0:1788201249.211327:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695475456 00000100:00100000:2.0:1788201249.211348:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1578 00000100:00100000:2.0:1788201249.211355:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+102:73758:x1875060695475200:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:2.0:1788201249.211369:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201249.211383:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75200/0x96d0c9b8c9a1d2c5 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786beb expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.211410:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75800/0x96d0c9b8c9a1d2cc lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.211421:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75800/0x96d0c9b8c9a1d2cc lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.211430:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75800/0x96d0c9b8c9a1d2cc lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.211519:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75200/0x96d0c9b8c9a1d2c5 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786beb expref: 104 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201249.211524:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+28:2403:x1875060695475072:12345-192.168.201.20@tcp:10:dd.0 Request processed in 480us (654us total) trans 4294969488 rc 0/0 00000100:00100000:1.0:1788201249.211531:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1017 00002000:00010000:1.0:1788201249.211535:0:8452:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/905 (0->18446744073709551615) 00010000:00010000:2.0:1788201249.211536:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75800/0x96d0c9b8c9a1d2cc lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786beb expref: 103 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1788201249.211537:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc005abd180 with x1875060695475072 ext(0->18446744073709551615) 00002000:00010000:1.0:1788201249.211542:0:8452:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc005abd180. 00010000:00010000:2.0:1788201249.211544:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff8dc005cc6500) 00010000:00010000:2.0:1788201249.211546:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788201249.211554:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c75800, rc 0) 00000100:00100000:1.0:1788201249.211567:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5963 00000100:00100000:1.0:1788201249.211575:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+27:73759:x1875060695475712:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:1.0:1788201249.211582:0:8491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201249.211592:0:8491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1d2d3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c00 expref: -99 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201249.211605:0:8491:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38d:0x0] initial LVB size: 0, mtime: 0x6a95c916, atime: 0x6a95c916, ctime: 0x6a95c916, blocks: 0x0 00010000:00010000:1.0:1788201249.211614:0:8491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38d:0x0].0x0 since=4100s v=(0 0) 00010000:00010000:1.0:1788201249.211617:0:8491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201249.211623:0:8491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1d2d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c00 expref: 28 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.211634:0:8491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1d2d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c00 expref: 28 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.211652:0:8491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ec600, rc 0) 00010000:00000080:1.0:1788201249.211657:0:8491:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc003a72a00 x1875060695475712/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 328/400 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201249.211779:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+28:73757:x1875060695475584:12345-192.168.201.20@tcp:101:dd.0 Request processed in 689us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201249.211793:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5962 00000100:00100000:0.0:1788201249.211820:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1579 00000100:00100000:0.0:1788201249.211826:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+103:73760:x1875060695475456:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:0.0:1788201249.211836:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201249.211845:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1d2da lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786bf2 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.211939:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1d2e1 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.211948:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1d2e1 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.211957:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1d2e1 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.211973:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d2e8 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.211980:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d2e8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.211994:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d2e8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.212058:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1d2ef lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.212066:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1d2ef lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.212082:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1d2ef lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201249.212090:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x12:0x0]: returning size 0 00010000:00010000:0.0:1788201249.212146:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1d2e1 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.212153:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1d2e1 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.212159:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1d2e1 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.212165:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1d2e1 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.212170:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896a800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201249.212173:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1d2e1 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.212180:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1d2e1 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.212189:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201249.212194:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201249.212197:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1d2e1 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.212213:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1d2e1 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.212223:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d2e8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.212234:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d2e8 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.212241:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d2e8 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.212245:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896a600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201249.212248:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d2e8 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.212254:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d2e8 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.212262:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff8dc103a1b700) 00010000:00010000:0.0:1788201249.212265:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201249.212267:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d2e8 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.212272:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d2e8 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.212305:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1d2da lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bf2 expref: 106 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.212317:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1d2ef lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bf2 expref: 105 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.212323:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff8dc0048be900) 00010000:00010000:0.0:1788201249.212326:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201249.212334:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ade000, rc 0) 00000100:00100000:0.0:1788201249.212486:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+105:73760:x1875060695475456:12345-192.168.201.20@tcp:101:dd.0 Request processed in 659us (1520us total) trans 124554051696 rc 0/0 00000100:00100000:0.0:1788201249.212493:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1579 00000100:00100000:3.0:1788201249.212603:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695474944 00000100:00100000:3.0:1788201249.212608:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695474944 00000100:00100000:3.0:1788201249.212639:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 273 00000100:00100000:3.0:1788201249.212644:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+105:73750:x1875060695474944:12345-192.168.201.20@tcp:35:dd.0 00000100:00100000:3.0:1788201249.212794:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+106:73750:x1875060695474944:12345-192.168.201.20@tcp:35:dd.0 Request processed in 149us (1978us total) trans 124554051697 rc 0/0 00000100:00100000:3.0:1788201249.212798:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 273 00000100:00100000:2.0:1788201249.212918:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+105:73758:x1875060695475200:12345-192.168.201.20@tcp:101:dd.0 Request processed in 1562us (2019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201249.212924:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1578 00000100:00100000:1.0:1788201249.212980:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+27:73759:x1875060695475712:12345-192.168.201.20@tcp:101:dd.0 Request processed in 1405us (1992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201249.212988:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5963 00000100:00100000:0.0:1788201249.219912:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.219959:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.220046:0:25502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695476096 00000100:00100000:2.0:1788201249.220056:0:25502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695476096 00002000:00010000:2.0:1788201249.220092:0:25502:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/907 (0->18446744073709551615) 00002000:00100000:2.0:1788201249.220095:0:25502:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc11cc42300 with x1875060695476096 ext(0->18446744073709551615) 00002000:00010000:2.0:1788201249.220106:0:25502:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc11cc42300. 00000100:00100000:2.0:1788201249.220133:0:25502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1018 00000100:00100000:2.0:1788201249.220144:0:25502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+27:2401:x1875060695476096:12345-192.168.201.20@tcp:10:dd.0 00002000:00010000:2.0:1788201249.220290:0:25502:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788201249.220293:0:25502:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x38b:0x0] updating lvb mtime from disk: 1788201238 -> 1788201249 00002000:00010000:2.0:1788201249.220296:0:25502:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x38b:0x0] updating lvb atime from disk: 1788201238 -> 1788201238 00002000:00010000:2.0:1788201249.220298:0:25502:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x38b:0x0] updating lvb ctime from disk: 1788201238 -> 1788201249 00002000:00010000:2.0:1788201249.220300:0:25502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38b:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1788201249.220308:0:25502:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11cc42300 x1875060695476096/t4294969489(0) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 440/432 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201249.220363:0:25502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+28:2401:x1875060695476096:12345-192.168.201.20@tcp:10:dd.0 Request processed in 220us (403us total) trans 4294969489 rc 0/0 00000100:00100000:2.0:1788201249.220370:0:25502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1018 00002000:00010000:2.0:1788201249.220374:0:25502:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/907 (0->18446744073709551615) 00002000:00100000:2.0:1788201249.220377:0:25502:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc11cc42300 with x1875060695476096 ext(0->18446744073709551615) 00002000:00010000:2.0:1788201249.220381:0:25502:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc11cc42300. 00000100:00100000:3.0:1788201249.222101:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695475968 00000100:00100000:3.0:1788201249.222113:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695475968 00000100:00100000:3.0:1788201249.222174:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1580 00000100:00100000:3.0:1788201249.222184:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+105:73758:x1875060695475968:12345-192.168.201.20@tcp:36:dd.0 00010000:00010000:3.0:1788201249.222246:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201249.222275:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1d2a2 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bdd expref: 105 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.222307:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff8dc005cc6500) 00010000:00010000:3.0:1788201249.222312:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201249.222459:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1d2fd lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.222473:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1d2fd lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.222482:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1d2fd lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788201249.222524:0:66313:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051698 00000004:00010000:3.0:1788201249.222543:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055e6d11a reply state 00000000ecde879c transno 124554051699 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1d2fd lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.222551:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1d2fd lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.222555:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff8dc005cc6500) 00010000:00010000:3.0:1788201249.222557:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201249.222559:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201249.222628:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+107:73758:x1875060695475968:12345-192.168.201.20@tcp:36:dd.0 Request processed in 445us (2723us total) trans 124554051699 rc 0/0 00000100:00100000:3.0:1788201249.222634:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1580 00000020:00080000:3.0:1788201249.222638:0:66313:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788201249.223201:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.223335:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695476224 00000100:00100000:2.0:1788201249.223342:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695476224 00000100:00100000:2.0:1788201249.223381:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1581 00000100:00100000:2.0:1788201249.223389:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+107:73760:x1875060695476224:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:2.0:1788201249.223400:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201249.223412:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75200/0x96d0c9b8c9a1d304 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c07 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.223450:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75a00/0x96d0c9b8c9a1d30b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.223459:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75a00/0x96d0c9b8c9a1d30b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.223468:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75a00/0x96d0c9b8c9a1d30b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201249.223501:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201249.223524:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695476480 00000100:00100000:1.0:1788201249.223527:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695476480 00010000:00010000:2.0:1788201249.223544:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75200/0x96d0c9b8c9a1d304 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c07 expref: 110 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201249.223552:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1582 00000100:00100000:1.0:1788201249.223559:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+109:73761:x1875060695476480:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:2.0:1788201249.223559:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75a00/0x96d0c9b8c9a1d30b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c07 expref: 109 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.223567:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201249.223567:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff8dc0048be900) 00010000:00010000:2.0:1788201249.223569:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788201249.223573:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c75a00, rc 0) 00010000:00010000:1.0:1788201249.223576:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec400/0x96d0c9b8c9a1d312 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c0e expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201249.223603:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+110:73760:x1875060695476224:12345-192.168.201.20@tcp:101:dd.0 Request processed in 215us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201249.223610:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1581 00010000:00010000:1.0:1788201249.224554:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1d319 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.224568:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1d319 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.224576:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1d319 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.224590:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d320 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.224605:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d320 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.224612:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d320 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.225186:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1d327 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.225197:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1d327 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.225204:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1d327 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201249.225216:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x13:0x0]: returning size 0 00010000:00010000:1.0:1788201249.225353:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1d319 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.225360:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1d319 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.225367:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1d319 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.225374:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1d319 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.225378:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ecc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201249.225382:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1d319 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.225399:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1d319 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.225412:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:1.0:1788201249.225415:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201249.225419:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1d319 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.225425:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1d319 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.225437:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d320 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.225568:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d320 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.225575:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d320 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.225580:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064edc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201249.225583:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d320 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.225589:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d320 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.225597:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff8dc005cc6200) 00010000:00010000:1.0:1788201249.225600:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201249.225603:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d320 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.225619:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d320 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.225732:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec400/0x96d0c9b8c9a1d312 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c0e expref: 111 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.225750:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1d327 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c0e expref: 110 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.225757:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff8dc0048be200) 00010000:00010000:1.0:1788201249.225759:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201249.225762:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ed600, rc 0) 00000100:00100000:1.0:1788201249.227560:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+110:73761:x1875060695476480:12345-192.168.201.20@tcp:101:dd.0 Request processed in 3993us (4050us total) trans 124554051700 rc 0/0 00000100:00100000:1.0:1788201249.227572:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1582 00000100:00100000:2.0:1788201249.228124:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.228629:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.228758:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.228832:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.228869:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.228892:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695476736 00000100:00100000:2.0:1788201249.228902:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695476736 00000100:00100000:3.0:1788201249.229000:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695477504 00000100:00100000:3.0:1788201249.229004:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695477504 00000100:00100000:3.0:1788201249.229076:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 274 00000100:00100000:3.0:1788201249.229085:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107db6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+111:73757:x1875060695477504:12345-192.168.201.20@tcp:35:dd.0 00000100:00100000:0.0:1788201249.229304:0:25936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695476864 00000100:00100000:0.0:1788201249.229310:0:25936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695476864 00002000:00010000:0.0:1788201249.229331:0:25936:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/909 (0->18446744073709551615) 00002000:00100000:0.0:1788201249.229336:0:25936:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc10604a680 with x1875060695476864 ext(0->18446744073709551615) 00002000:00010000:0.0:1788201249.229347:0:25936:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc10604a680. 00000100:00100000:0.0:1788201249.229367:0:25936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1019 00000100:00100000:0.0:1788201249.229374:0:25936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+28:2400:x1875060695476864:12345-192.168.201.20@tcp:10:dd.0 00002000:00010000:0.0:1788201249.229494:0:25936:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788201249.229498:0:25936:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x38d:0x0] updating lvb mtime from disk: 1788201238 -> 1788201249 00002000:00010000:0.0:1788201249.229500:0:25936:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x38d:0x0] updating lvb atime from disk: 1788201238 -> 1788201238 00002000:00010000:0.0:1788201249.229502:0:25936:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x38d:0x0] updating lvb ctime from disk: 1788201238 -> 1788201249 00002000:00010000:0.0:1788201249.229504:0:25936:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38d:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1788201249.229512:0:25936:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc10604a680 x1875060695476864/t4294969490(0) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 440/432 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201249.229570:0:25936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+29:2400:x1875060695476864:12345-192.168.201.20@tcp:10:dd.0 Request processed in 196us (941us total) trans 4294969490 rc 0/0 00000100:00100000:0.0:1788201249.229576:0:25936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1019 00002000:00010000:0.0:1788201249.229580:0:25936:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/909 (0->18446744073709551615) 00002000:00100000:0.0:1788201249.229583:0:25936:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc10604a680 with x1875060695476864 ext(0->18446744073709551615) 00002000:00010000:0.0:1788201249.229587:0:25936:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc10604a680. 00000100:00100000:1.0:1788201249.229628:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695476992 00000100:00100000:1.0:1788201249.229633:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695476992 00000100:00100000:1.0:1788201249.229746:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5964 00000100:00100000:1.0:1788201249.229755:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+29:73758:x1875060695476992:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:1.0:1788201249.229763:0:23974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201249.229780:0:23974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000957cff04/0x96d0c9b8c9a1d335 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c15 expref: -99 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201249.229796:0:23974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38c:0x0] initial LVB size: 0, mtime: 0x6a95c916, atime: 0x6a95c916, ctime: 0x6a95c916, blocks: 0x0 00000100:00100000:3.0:1788201249.229801:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107db6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+112:73757:x1875060695477504:12345-192.168.201.20@tcp:35:dd.0 Request processed in 717us (932us total) trans 124554051701 rc 0/0 00000100:00100000:3.0:1788201249.229808:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 274 00010000:00010000:1.0:1788201249.229811:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38c:0x0].0x0 since=4100s v=(0 0) 00010000:00010000:1.0:1788201249.229815:0:23974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201249.229829:0:23974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000957cff04/0x96d0c9b8c9a1d335 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c15 expref: 30 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201249.229841:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695477248 00000100:00100000:3.0:1788201249.229844:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695477248 00010000:00010000:1.0:1788201249.229846:0:23974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000957cff04/0x96d0c9b8c9a1d335 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c15 expref: 30 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.229859:0:23974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ed800, rc 0) 00010000:00000080:1.0:1788201249.229864:0:23974:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc106048a80 x1875060695476992/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 328/400 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201249.229867:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1583 00000100:00100000:3.0:1788201249.229873:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+112:73760:x1875060695477248:12345-192.168.201.20@tcp:36:dd.0 00000100:00100000:1.0:1788201249.229887:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+30:73758:x1875060695476992:12345-192.168.201.20@tcp:101:dd.0 Request processed in 136us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201249.229893:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5964 00010000:00010000:3.0:1788201249.229912:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201249.229933:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1d2ef lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bf2 expref: 112 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.229946:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff8dc0048be900) 00010000:00010000:3.0:1788201249.229950:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201249.230043:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1d33c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.230057:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1d33c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.230066:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1d33c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788201249.230102:0:66313:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051702 00000004:00010000:3.0:1788201249.230125:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f07d75b6 reply state 00000000348af328 transno 124554051703 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1d33c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.230135:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1d33c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.230151:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff8dc0048be900) 00010000:00010000:3.0:1788201249.230154:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201249.230157:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201249.230199:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+114:73760:x1875060695477248:12345-192.168.201.20@tcp:36:dd.0 Request processed in 325us (1366us total) trans 124554051703 rc 0/0 00000100:00100000:2.0:1788201249.230573:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 275 00000100:00100000:2.0:1788201249.230582:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+114:73755:x1875060695476736:12345-192.168.201.20@tcp:35:dd.0 00000100:00100000:2.0:1788201249.230731:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+115:73755:x1875060695476736:12345-192.168.201.20@tcp:35:dd.0 Request processed in 150us (2609us total) trans 124554051704 rc 0/0 00000100:00100000:2.0:1788201249.230738:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 275 00000100:00100000:3.0:1788201249.233953:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1583 00000020:00080000:3.0:1788201249.233961:0:66313:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788201249.239499:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.239548:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.239586:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.239623:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.239642:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695477632 00000100:00100000:2.0:1788201249.239653:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695477632 00000100:00100000:3.0:1788201249.239688:0:24876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695478016 00000100:00100000:3.0:1788201249.239692:0:24876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695478016 00002000:00010000:3.0:1788201249.239718:0:24876:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/908 (0->18446744073709551615) 00002000:00100000:3.0:1788201249.239723:0:24876:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc120091880 with x1875060695478016 ext(0->18446744073709551615) 00000100:00100000:2.0:1788201249.239728:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695477888 00000100:00100000:2.0:1788201249.239731:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695477888 00002000:00010000:3.0:1788201249.239734:0:24876:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc120091880. 00000100:00100000:3.0:1788201249.239752:0:24876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1020 00000100:00100000:2.0:1788201249.239753:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1584 00000100:00100000:2.0:1788201249.239761:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+115:73761:x1875060695477632:12345-192.168.201.20@tcp:101:dd.0 00000100:00100000:3.0:1788201249.239761:0:24876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+30:2400:x1875060695478016:12345-192.168.201.20@tcp:10:dd.0 00010000:00010000:2.0:1788201249.239779:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201249.239796:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75200/0x96d0c9b8c9a1d343 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c1c expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.239829:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75c00/0x96d0c9b8c9a1d34a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.239842:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75c00/0x96d0c9b8c9a1d34a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.239852:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75c00/0x96d0c9b8c9a1d34a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201249.239903:0:24876:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788201249.239906:0:24876:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x38c:0x0] updating lvb mtime from disk: 1788201238 -> 1788201249 00002000:00010000:3.0:1788201249.239908:0:24876:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x38c:0x0] updating lvb atime from disk: 1788201238 -> 1788201238 00002000:00010000:3.0:1788201249.239911:0:24876:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x38c:0x0] updating lvb ctime from disk: 1788201238 -> 1788201249 00002000:00010000:3.0:1788201249.239913:0:24876:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38c:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1788201249.239923:0:24876:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc120091880 x1875060695478016/t4294969491(0) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 440/432 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1788201249.239978:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75200/0x96d0c9b8c9a1d343 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c1c expref: 117 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201249.239979:0:24876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+31:2400:x1875060695478016:12345-192.168.201.20@tcp:10:dd.0 Request processed in 219us (392us total) trans 4294969491 rc 0/0 00010000:00010000:2.0:1788201249.239997:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75c00/0x96d0c9b8c9a1d34a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c1c expref: 116 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201249.239998:0:24876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1020 00002000:00010000:3.0:1788201249.240002:0:24876:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/908 (0->18446744073709551615) 00010000:00010000:2.0:1788201249.240006:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff8dc0048be200) 00010000:00010000:2.0:1788201249.240009:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00002000:00100000:3.0:1788201249.240010:0:24876:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc120091880 with x1875060695478016 ext(0->18446744073709551615) 00010000:00010000:2.0:1788201249.240013:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c75c00, rc 0) 00002000:00010000:3.0:1788201249.240032:0:24876:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc120091880. 00000100:00100000:2.0:1788201249.240054:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+116:73761:x1875060695477632:12345-192.168.201.20@tcp:101:dd.0 Request processed in 294us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201249.240060:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1584 00000100:00100000:2.0:1788201249.240074:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1585 00000100:00100000:2.0:1788201249.240080:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+115:73762:x1875060695477888:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:2.0:1788201249.240089:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201249.240097:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75e00/0x96d0c9b8c9a1d351 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c23 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.240187:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1d358 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.240197:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1d358 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.240205:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1d358 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.240236:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1d35f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.240244:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1d35f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201249.240249:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695478144 00000100:00100000:1.0:1788201249.240254:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695478144 00000100:00100000:1.0:1788201249.240291:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5965 00000100:00100000:1.0:1788201249.240299:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+31:73760:x1875060695478144:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:1.0:1788201249.240307:0:26209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201249.240318:0:26209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3011c0a/0x96d0c9b8c9a1d366 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c2a expref: -99 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201249.240333:0:26209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38e:0x0] initial LVB size: 0, mtime: 0x6a95c916, atime: 0x6a95c916, ctime: 0x6a95c916, blocks: 0x0 00010000:00010000:1.0:1788201249.240346:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38e:0x0].0x0 since=4100s v=(0 0) 00010000:00010000:1.0:1788201249.240350:0:26209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201249.240357:0:26209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3011c0a/0x96d0c9b8c9a1d366 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c2a expref: 32 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.240384:0:26209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c3011c0a/0x96d0c9b8c9a1d366 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c2a expref: 32 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.240394:0:26209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ec400, rc 0) 00010000:00000080:1.0:1788201249.240399:0:26209:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc120092680 x1875060695478144/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 328/400 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201249.240430:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+32:73760:x1875060695478144:12345-192.168.201.20@tcp:101:dd.0 Request processed in 132us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201249.240436:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5965 00010000:00010000:2.0:1788201249.240518:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1d35f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.240569:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74000/0x96d0c9b8c9a1d36d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.240577:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74000/0x96d0c9b8c9a1d36d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.240584:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74000/0x96d0c9b8c9a1d36d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201249.240593:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x14:0x0]: returning size 0 00010000:00010000:2.0:1788201249.240651:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1d358 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.240658:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1d358 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201249.241126:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.241549:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695478400 00000100:00100000:0.0:1788201249.241557:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695478400 00000100:00100000:0.0:1788201249.241592:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 276 00000100:00100000:0.0:1788201249.241599:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+118:73759:x1875060695478400:12345-192.168.201.20@tcp:35:dd.0 00000100:00100000:0.0:1788201249.241802:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+119:73759:x1875060695478400:12345-192.168.201.20@tcp:35:dd.0 Request processed in 202us (676us total) trans 124554051706 rc 0/0 00000100:00100000:0.0:1788201249.241809:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 276 00010000:00010000:2.0:1788201249.242056:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1d358 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.242064:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1d358 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.242069:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201249.242085:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1d358 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.242092:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1d358 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.242105:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201249.242108:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201249.242111:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1d358 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.242117:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1d358 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.242130:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1d35f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.242136:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1d35f lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.242141:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1d35f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.242146:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201249.242149:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1d35f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.242155:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1d35f lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.242162:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff8dc1207c9100) 00010000:00010000:2.0:1788201249.242164:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201249.242173:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1d35f lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.242179:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1d35f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.242221:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75e00/0x96d0c9b8c9a1d351 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c23 expref: 119 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.242235:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74000/0x96d0c9b8c9a1d36d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c23 expref: 118 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.242241:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff8dc12196e200) 00010000:00010000:2.0:1788201249.242467:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201249.242470:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c74000, rc 0) 00000100:00100000:2.0:1788201249.242507:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+118:73762:x1875060695477888:12345-192.168.201.20@tcp:101:dd.0 Request processed in 2427us (2959us total) trans 124554051705 rc 0/0 00000100:00100000:2.0:1788201249.242514:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1585 00000100:00100000:3.0:1788201249.245995:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.249616:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201249.249897:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695478912 00000100:00100000:3.0:1788201249.249908:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695478912 00000100:00100000:3.0:1788201249.249983:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1586 00000100:00100000:3.0:1788201249.249994:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+118:73761:x1875060695478912:12345-192.168.201.20@tcp:36:dd.0 00010000:00010000:3.0:1788201249.250099:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201249.250125:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1d327 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c0e expref: 118 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.250143:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff8dc0048be200) 00010000:00010000:3.0:1788201249.250148:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201249.250829:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1d37b lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.250845:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1d37b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.250855:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1d37b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788201249.250904:0:66313:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051707 00000004:00010000:3.0:1788201249.254388:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b7a5e57 reply state 000000002767e05f transno 124554051708 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1d37b lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.254415:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1d37b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.254455:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff8dc0048be200) 00010000:00010000:3.0:1788201249.254458:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201249.254462:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201249.255633:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695478656 00000100:00100000:1.0:1788201249.255644:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695478656 00000100:00100000:1.0:1788201249.255713:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 277 00000100:00100000:1.0:1788201249.255727:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+121:73758:x1875060695478656:12345-192.168.201.20@tcp:35:dd.0 00000100:00100000:3.0:1788201249.256693:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+122:73761:x1875060695478912:12345-192.168.201.20@tcp:36:dd.0 Request processed in 6687us (7072us total) trans 124554051708 rc 0/0 00000100:00100000:3.0:1788201249.256703:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1586 00000020:00080000:3.0:1788201249.256709:0:66313:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788201249.257795:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+121:73758:x1875060695478656:12345-192.168.201.20@tcp:35:dd.0 Request processed in 2065us (11802us total) trans 124554051709 rc 0/0 00000100:00100000:1.0:1788201249.257807:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 277 00000100:00100000:2.0:1788201249.257932:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201249.258132:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695479040 00000100:00100000:1.0:1788201249.258142:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695479040 00000100:00100000:1.0:1788201249.258186:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1587 00000100:00100000:1.0:1788201249.258195:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+121:73762:x1875060695479040:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:1.0:1788201249.258216:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201249.258237:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d382 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c31 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.258803:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1d389 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.258817:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1d389 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.258829:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1d389 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.259362:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d382 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c31 expref: 123 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.259382:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1d389 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c31 expref: 122 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.259391:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff8dc12196e200) 00010000:00010000:1.0:1788201249.259393:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788201249.259397:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ecc00, rc 0) 00000100:00100000:1.0:1788201249.259517:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+122:73762:x1875060695479040:12345-192.168.201.20@tcp:101:dd.0 Request processed in 1321us (1584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201249.259524:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1587 00000100:00100000:3.0:1788201249.259760:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201249.259810:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.259869:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695479296 00000100:00100000:2.0:1788201249.259876:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695479296 00000100:00100000:2.0:1788201249.259918:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1588 00000100:00100000:2.0:1788201249.259928:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc103189450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+122:73763:x1875060695479296:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:2.0:1788201249.259941:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201249.259953:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74c00/0x96d0c9b8c9a1d390 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c38 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.260078:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1d397 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.260100:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1d397 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.260108:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1d397 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.260123:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1d39e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.260130:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1d39e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.260138:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1d39e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.260188:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1d3a5 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.260196:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1d3a5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201249.260614:0:24874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695479424 00000100:00100000:1.0:1788201249.260619:0:24874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695479424 00002000:00010000:1.0:1788201249.260643:0:24874:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/910 (0->18446744073709551615) 00002000:00100000:1.0:1788201249.260647:0:24874:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc12b635f80 with x1875060695479424 ext(0->18446744073709551615) 00002000:00010000:1.0:1788201249.260656:0:24874:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc12b635f80. 00000100:00100000:1.0:1788201249.260694:0:24874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1021 00000100:00100000:1.0:1788201249.260709:0:24874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+32:2403:x1875060695479424:12345-192.168.201.20@tcp:10:dd.0 00002000:00010000:1.0:1788201249.260837:0:24874:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788201249.260841:0:24874:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x38e:0x0] updating lvb mtime from disk: 1788201238 -> 1788201249 00002000:00010000:1.0:1788201249.260843:0:24874:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x38e:0x0] updating lvb atime from disk: 1788201238 -> 1788201238 00002000:00010000:1.0:1788201249.260846:0:24874:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x38e:0x0] updating lvb ctime from disk: 1788201238 -> 1788201249 00002000:00010000:1.0:1788201249.260848:0:24874:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38e:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1788201249.260856:0:24874:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12b635f80 x1875060695479424/t4294969492(0) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 440/432 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201249.260899:0:24874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+33:2403:x1875060695479424:12345-192.168.201.20@tcp:10:dd.0 Request processed in 190us (1093us total) trans 4294969492 rc 0/0 00000100:00100000:1.0:1788201249.260905:0:24874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1021 00002000:00010000:1.0:1788201249.260920:0:24874:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/910 (0->18446744073709551615) 00002000:00100000:1.0:1788201249.260922:0:24874:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc12b635f80 with x1875060695479424 ext(0->18446744073709551615) 00002000:00010000:1.0:1788201249.260927:0:24874:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc12b635f80. 00010000:00010000:2.0:1788201249.262109:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1d3a5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201249.262132:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x15:0x0]: returning size 0 00010000:00010000:2.0:1788201249.262234:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1d397 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.262243:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1d397 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.262250:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1d397 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.262269:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1d397 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.262274:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201249.262278:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1d397 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.262285:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1d397 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.262298:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201249.262301:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201249.262305:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1d397 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.262312:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1d397 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.262328:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1d39e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.262335:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1d39e lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.262342:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1d39e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.262347:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201249.262350:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1d39e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.262365:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1d39e lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.262373:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff8dc1207c9e00) 00010000:00010000:2.0:1788201249.262376:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201249.262379:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1d39e lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.262386:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1d39e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.262431:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74c00/0x96d0c9b8c9a1d390 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c38 expref: 125 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.262446:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1d3a5 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c38 expref: 124 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.262453:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff8dc0048be800) 00010000:00010000:2.0:1788201249.262455:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201249.262457:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbce00, rc 0) 00000100:00100000:2.0:1788201249.264237:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc103189450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+124:73763:x1875060695479296:12345-192.168.201.20@tcp:101:dd.0 Request processed in 4301us (4468us total) trans 124554051710 rc 0/0 00000100:00100000:2.0:1788201249.264249:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1588 00000100:00100000:2.0:1788201249.284964:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.285013:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201249.285061:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695479808 00000100:00100000:3.0:1788201249.285072:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695479808 00000100:00100000:3.0:1788201249.285135:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1589 00000100:00100000:3.0:1788201249.285145:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+124:73762:x1875060695479808:12345-192.168.201.20@tcp:36:dd.0 00010000:00010000:3.0:1788201249.285226:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201249.285495:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74000/0x96d0c9b8c9a1d36d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c23 expref: 124 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.285516:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff8dc12196e200) 00010000:00010000:3.0:1788201249.285522:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201249.285709:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1d3b3 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.285722:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1d3b3 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.285731:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1d3b3 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788201249.285790:0:66313:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051711 00000004:00010000:3.0:1788201249.285813:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002496178d reply state 00000000d14e2181 transno 124554051712 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1d3b3 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.285825:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1d3b3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.285832:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff8dc12196e200) 00010000:00010000:3.0:1788201249.285834:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201249.285837:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201249.285971:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+126:73762:x1875060695479808:12345-192.168.201.20@tcp:36:dd.0 Request processed in 826us (1016us total) trans 124554051712 rc 0/0 00000100:00100000:3.0:1788201249.285978:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1589 00000020:00080000:3.0:1788201249.285983:0:66313:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788201249.286797:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695479680 00000100:00100000:0.0:1788201249.286805:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695479680 00000100:00100000:0.0:1788201249.286850:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5966 00000100:00100000:0.0:1788201249.286860:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6e293f14-c501-4bc5-9dd4-a18ef02756b4+33:73761:x1875060695479680:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:0.0:1788201249.286874:0:26211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201249.286892:0:26211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1d3ba lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c3f expref: -99 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201249.286914:0:26211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38f:0x0] initial LVB size: 0, mtime: 0x6a95c916, atime: 0x6a95c916, ctime: 0x6a95c916, blocks: 0x0 00010000:00010000:0.0:1788201249.286932:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38f:0x0].0x0 since=4100s v=(0 0) 00010000:00010000:0.0:1788201249.286938:0:26211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201249.286946:0:26211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1d3ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c3f expref: 34 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.286961:0:26211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1d3ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c3f expref: 34 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.286985:0:26211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ade800, rc 0) 00010000:00000080:0.0:1788201249.286993:0:26211:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12ee2ea00 x1875060695479680/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 328/400 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201249.287175:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.287534:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.287564:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.289188:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6e293f14-c501-4bc5-9dd4-a18ef02756b4+34:73761:x1875060695479680:12345-192.168.201.20@tcp:101:dd.0 Request processed in 2319us (4164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201249.289200:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5966 00000100:00100000:3.0:1788201249.291925:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695480192 00000100:00100000:3.0:1788201249.291941:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695480192 00000100:00100000:3.0:1788201249.292002:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695480448 00000100:00100000:3.0:1788201249.292007:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695480448 00000100:00100000:3.0:1788201249.292052:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1590 00000100:00100000:3.0:1788201249.292062:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+127:73763:x1875060695480192:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:3.0:1788201249.292084:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201249.292107:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673a00/0x96d0c9b8c9a1d3c1 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c46 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292143:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74c00/0x96d0c9b8c9a1d3c8 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292158:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74c00/0x96d0c9b8c9a1d3c8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292187:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74c00/0x96d0c9b8c9a1d3c8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292303:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673a00/0x96d0c9b8c9a1d3c1 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c46 expref: 129 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292322:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74c00/0x96d0c9b8c9a1d3c8 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c46 expref: 128 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292331:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff8dc0048be800) 00010000:00010000:3.0:1788201249.292334:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788201249.292338:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c74c00, rc 0) 00000100:00100000:3.0:1788201249.292398:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+128:73763:x1875060695480192:12345-192.168.201.20@tcp:101:dd.0 Request processed in 337us (4864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201249.292404:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1590 00000100:00100000:3.0:1788201249.292426:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1591 00000100:00100000:3.0:1788201249.292433:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+127:73764:x1875060695480448:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:3.0:1788201249.292448:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201249.292457:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1d3cf lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c4d expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292569:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1d3d6 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292579:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1d3d6 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292598:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1d3d6 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292612:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75e00/0x96d0c9b8c9a1d3dd lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292620:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75e00/0x96d0c9b8c9a1d3dd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292626:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75e00/0x96d0c9b8c9a1d3dd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292671:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1d3e4 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292711:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1d3e4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292719:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1d3e4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201249.292729:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x16:0x0]: returning size 0 00010000:00010000:3.0:1788201249.292807:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1d3d6 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292814:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1d3d6 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292821:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1d3d6 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292827:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1d3d6 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292840:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201249.292845:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1d3d6 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292852:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1d3d6 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292864:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:3.0:1788201249.292866:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201249.292870:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1d3d6 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292877:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1d3d6 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292888:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75e00/0x96d0c9b8c9a1d3dd lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292894:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75e00/0x96d0c9b8c9a1d3dd lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292899:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75e00/0x96d0c9b8c9a1d3dd lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292905:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75e00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201249.292907:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75e00/0x96d0c9b8c9a1d3dd lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292913:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75e00/0x96d0c9b8c9a1d3dd lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292932:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff8dc007bc4f00) 00010000:00010000:3.0:1788201249.292935:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201249.292938:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75e00/0x96d0c9b8c9a1d3dd lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292943:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75e00/0x96d0c9b8c9a1d3dd lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292978:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1d3cf lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c4d expref: 130 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292990:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1d3e4 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c4d expref: 129 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.292996:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff8dc103a3a600) 00010000:00010000:3.0:1788201249.292999:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201249.293001:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c74200, rc 0) 00000100:00100000:3.0:1788201249.293162:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+129:73764:x1875060695480448:12345-192.168.201.20@tcp:101:dd.0 Request processed in 729us (5595us total) trans 124554051713 rc 0/0 00000100:00100000:3.0:1788201249.293169:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1591 00000100:00100000:2.0:1788201249.293462:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.293621:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201249.293806:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695480704 00000100:00100000:3.0:1788201249.293813:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695480704 00002000:00010000:3.0:1788201249.293843:0:25729:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/911 (0->18446744073709551615) 00002000:00100000:3.0:1788201249.293847:0:25729:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc12ee2ce00 with x1875060695480704 ext(0->18446744073709551615) 00002000:00010000:3.0:1788201249.293856:0:25729:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc12ee2ce00. 00000100:00100000:3.0:1788201249.293883:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1022 00000100:00100000:3.0:1788201249.293892:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6e293f14-c501-4bc5-9dd4-a18ef02756b4+34:2400:x1875060695480704:12345-192.168.201.20@tcp:10:dd.0 00002000:00010000:3.0:1788201249.294036:0:25729:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x38f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788201249.294040:0:25729:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x38f:0x0] updating lvb mtime from disk: 1788201238 -> 1788201249 00002000:00010000:3.0:1788201249.294042:0:25729:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x38f:0x0] updating lvb atime from disk: 1788201238 -> 1788201238 00002000:00010000:3.0:1788201249.294044:0:25729:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x38f:0x0] updating lvb ctime from disk: 1788201238 -> 1788201249 00002000:00010000:3.0:1788201249.294046:0:25729:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x38f:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1788201249.294055:0:25729:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12ee2ce00 x1875060695480704/t4294969493(0) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 440/432 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201249.294088:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6e293f14-c501-4bc5-9dd4-a18ef02756b4+35:2400:x1875060695480704:12345-192.168.201.20@tcp:10:dd.0 Request processed in 199us (468us total) trans 4294969493 rc 0/0 00000100:00100000:3.0:1788201249.294094:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1022 00002000:00010000:3.0:1788201249.294097:0:25729:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/911 (0->18446744073709551615) 00002000:00100000:3.0:1788201249.294099:0:25729:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc12ee2ce00 with x1875060695480704 ext(0->18446744073709551615) 00002000:00010000:3.0:1788201249.294103:0:25729:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc12ee2ce00. 00000100:00100000:0.0:1788201249.294163:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695480576 00000100:00100000:0.0:1788201249.294168:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695480576 00000100:00100000:0.0:1788201249.294205:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5967 00000100:00100000:0.0:1788201249.294213:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+35:73762:x1875060695480576:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:0.0:1788201249.294222:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201249.294238:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1d3f2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c54 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201249.294255:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x390:0x0] initial LVB size: 0, mtime: 0x6a95c916, atime: 0x6a95c916, ctime: 0x6a95c916, blocks: 0x0 00010000:00010000:0.0:1788201249.294269:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x390:0x0].0x0 since=4100s v=(0 0) 00010000:00010000:0.0:1788201249.294273:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x390:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201249.294280:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1d3f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c54 expref: 36 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.294293:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1d3f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c54 expref: 36 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.294304:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007ade000, rc 0) 00010000:00000080:0.0:1788201249.294315:0:8449:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12ee2d880 x1875060695480576/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 328/400 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201249.294339:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+36:73762:x1875060695480576:12345-192.168.201.20@tcp:101:dd.0 Request processed in 127us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201249.294345:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5967 00000100:00100000:2.0:1788201249.296856:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695480064 00000100:00100000:2.0:1788201249.296868:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695480064 00000100:00100000:3.0:1788201249.297769:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.298242:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 278 00000100:00100000:2.0:1788201249.298257:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+129:73760:x1875060695480064:12345-192.168.201.20@tcp:35:dd.0 00000100:00100000:2.0:1788201249.298551:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+130:73760:x1875060695480064:12345-192.168.201.20@tcp:35:dd.0 Request processed in 299us (11375us total) trans 124554051714 rc 0/0 00000100:00100000:2.0:1788201249.298559:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 278 00000100:00100000:1.0:1788201249.298625:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695480960 00000100:00100000:1.0:1788201249.298632:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695480960 00000100:00100000:1.0:1788201249.298674:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1592 00000100:00100000:1.0:1788201249.298695:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+130:73763:x1875060695480960:12345-192.168.201.20@tcp:36:dd.0 00010000:00010000:1.0:1788201249.298726:0:66312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201249.298751:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1d3a5 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c38 expref: 130 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.298768:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff8dc0048be800) 00010000:00010000:1.0:1788201249.298772:0:66312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201249.298868:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d3f9 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.298895:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d3f9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.298905:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d3f9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201249.298946:0:66312:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051715 00000004:00010000:1.0:1788201249.298968:0:66312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000751c1192 reply state 000000001537acfc transno 124554051716 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d3f9 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.298980:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d3f9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.298986:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff8dc0048be800) 00010000:00010000:1.0:1788201249.298989:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201249.298992:0:66312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201249.299059:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+132:73763:x1875060695480960:12345-192.168.201.20@tcp:36:dd.0 Request processed in 365us (1294us total) trans 124554051716 rc 0/0 00000100:00100000:1.0:1788201249.299065:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1592 00000020:00080000:1.0:1788201249.299068:0:66312:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788201249.300177:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201249.300222:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201249.300233:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695481088 00000100:00100000:3.0:1788201249.300240:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695481088 00000100:00100000:1.0:1788201249.300243:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201249.300268:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00002000:00010000:3.0:1788201249.300346:0:8452:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/912 (0->18446744073709551615) 00002000:00100000:3.0:1788201249.300351:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc005254700 with x1875060695481088 ext(0->18446744073709551615) 00002000:00010000:3.0:1788201249.300361:0:8452:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc005254700. 00000100:00100000:3.0:1788201249.300387:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1023 00000100:00100000:3.0:1788201249.300396:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+36:2403:x1875060695481088:12345-192.168.201.20@tcp:10:dd.0 00000100:00100000:0.0:1788201249.300475:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695481728 00000100:00100000:0.0:1788201249.300479:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695481728 00000100:00100000:0.0:1788201249.300515:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 279 00000100:00100000:0.0:1788201249.300522:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+132:73761:x1875060695481728:12345-192.168.201.20@tcp:35:dd.0 00000100:00100000:0.0:1788201249.300725:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+133:73761:x1875060695481728:12345-192.168.201.20@tcp:35:dd.0 Request processed in 202us (455us total) trans 124554051717 rc 0/0 00000100:00100000:0.0:1788201249.300733:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 279 00000100:00100000:0.0:1788201249.300790:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695481216 00000100:00100000:0.0:1788201249.300794:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695481216 00000100:00100000:0.0:1788201249.300816:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695481472 00000100:00100000:0.0:1788201249.300820:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695481472 00000100:00100000:0.0:1788201249.300839:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1593 00000100:00100000:0.0:1788201249.300845:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+134:73764:x1875060695481216:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:0.0:1788201249.300854:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201249.300870:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1d400 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c5b expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.300896:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1d407 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.300907:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1d407 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.300934:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1d407 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301008:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1d400 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c5b expref: 136 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301041:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1d407 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c5b expref: 135 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201249.301045:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x390:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:0.0:1788201249.301049:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff8dc103a3a600) 00002000:00010000:3.0:1788201249.301049:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x390:0x0] updating lvb mtime from disk: 1788201238 -> 1788201249 00002000:00010000:3.0:1788201249.301051:0:8452:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x390:0x0] updating lvb atime from disk: 1788201238 -> 1788201238 00010000:00010000:0.0:1788201249.301052:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00002000:00010000:3.0:1788201249.301054:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x390:0x0] updating lvb ctime from disk: 1788201238 -> 1788201249 00010000:00010000:0.0:1788201249.301055:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007adfe00, rc 0) 00002000:00010000:3.0:1788201249.301062:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x390:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1788201249.301070:0:8452:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc005254700 x1875060695481088/t4294969494(0) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 440/432 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201249.301080:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+135:73764:x1875060695481216:12345-192.168.201.20@tcp:101:dd.0 Request processed in 236us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201249.301086:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1593 00000100:00100000:3.0:1788201249.301092:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+37:2403:x1875060695481088:12345-192.168.201.20@tcp:10:dd.0 Request processed in 699us (921us total) trans 4294969494 rc 0/0 00000100:00100000:3.0:1788201249.301098:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1023 00000100:00100000:0.0:1788201249.301099:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1594 00002000:00010000:3.0:1788201249.301101:0:8452:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/912 (0->18446744073709551615) 00002000:00100000:3.0:1788201249.301104:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc005254700 with x1875060695481088 ext(0->18446744073709551615) 00000100:00100000:0.0:1788201249.301105:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+134:73765:x1875060695481472:12345-192.168.201.20@tcp:101:dd.0 00002000:00010000:3.0:1788201249.301109:0:8452:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc005254700. 00010000:00010000:0.0:1788201249.301112:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201249.301121:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1d40e lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c62 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301212:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d415 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301221:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d415 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301238:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d415 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301253:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1d41c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301260:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1d41c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301267:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1d41c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301310:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1d423 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301318:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1d423 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301324:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1d423 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201249.301332:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x17:0x0]: returning size 0 00010000:00010000:0.0:1788201249.301381:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d415 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301388:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d415 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301395:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d415 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301401:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d415 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301414:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896a600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201249.301418:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d415 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301427:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d415 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301438:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201249.301440:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201249.301444:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d415 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301451:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d415 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301461:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1d41c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301468:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1d41c lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301474:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1d41c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301479:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896a800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201249.301482:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1d41c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301488:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1d41c lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301507:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff8dc103a1b200) 00010000:00010000:0.0:1788201249.301509:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201249.301512:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1d41c lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301518:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a800/0x96d0c9b8c9a1d41c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301550:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896be00/0x96d0c9b8c9a1d40e lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c62 expref: 137 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301562:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1d423 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c62 expref: 136 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.301569:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff8dc0048be100) 00010000:00010000:0.0:1788201249.301571:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201249.301574:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2400, rc 0) 00000100:00100000:0.0:1788201249.301604:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+136:73765:x1875060695481472:12345-192.168.201.20@tcp:101:dd.0 Request processed in 499us (1360us total) trans 124554051718 rc 0/0 00000100:00100000:0.0:1788201249.301610:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1594 00000100:00100000:0.0:1788201249.310889:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.310930:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.311012:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.311058:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695482112 00000100:00100000:0.0:1788201249.311067:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695482112 00000100:00100000:0.0:1788201249.311119:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695482240 00000100:00100000:0.0:1788201249.311123:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695482240 00000100:00100000:0.0:1788201249.311144:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1595 00000100:00100000:0.0:1788201249.311167:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+137:73764:x1875060695482112:12345-192.168.201.20@tcp:36:dd.0 00010000:00010000:0.0:1788201249.311238:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201249.311266:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1d3e4 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c4d expref: 137 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.311285:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff8dc103a3a600) 00010000:00010000:0.0:1788201249.311290:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201249.311446:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1d431 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.311460:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1d431 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.311470:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1d431 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788201249.311512:0:66314:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051719 00000004:00010000:0.0:1788201249.311534:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3b9a5b3 reply state 0000000060a597b0 transno 124554051720 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1d431 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.311546:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1d431 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.311553:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff8dc103a3a600) 00010000:00010000:0.0:1788201249.311555:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201249.311558:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201249.311635:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+139:73764:x1875060695482112:12345-192.168.201.20@tcp:36:dd.0 Request processed in 469us (703us total) trans 124554051720 rc 0/0 00000100:00100000:0.0:1788201249.311642:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1595 00000020:00080000:0.0:1788201249.311646:0:66314:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788201249.311669:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1596 00000100:00100000:0.0:1788201249.311688:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+138:73765:x1875060695482240:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:0.0:1788201249.311699:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201249.311709:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1d438 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c70 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.311729:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1d43f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.311737:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1d43f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.311745:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1d43f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.311809:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1d438 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c70 expref: 140 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.311822:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1d43f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c70 expref: 139 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.311830:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff8dc0048be100) 00010000:00010000:0.0:1788201249.311832:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788201249.311835:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2000, rc 0) 00000100:00100000:0.0:1788201249.311860:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+139:73765:x1875060695482240:12345-192.168.201.20@tcp:101:dd.0 Request processed in 184us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201249.311866:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1596 00000100:00100000:3.0:1788201249.312416:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695481856 00000100:00100000:3.0:1788201249.312423:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695481856 00000100:00100000:3.0:1788201249.312464:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5968 00000100:00100000:3.0:1788201249.312472:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6e293f14-c501-4bc5-9dd4-a18ef02756b4+37:73763:x1875060695481856:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:3.0:1788201249.312481:0:26208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201249.312496:0:26208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002723d596/0x96d0c9b8c9a1d446 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c69 expref: -99 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201249.312518:0:26208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x391:0x0] initial LVB size: 0, mtime: 0x6a95c916, atime: 0x6a95c916, ctime: 0x6a95c916, blocks: 0x0 00010000:00010000:3.0:1788201249.312534:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x391:0x0].0x0 since=4100s v=(0 0) 00010000:00010000:3.0:1788201249.312539:0:26208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x391:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201249.312547:0:26208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002723d596/0x96d0c9b8c9a1d446 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c69 expref: 38 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.312559:0:26208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002723d596/0x96d0c9b8c9a1d446 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c69 expref: 38 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.312582:0:26208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c75400, rc 0) 00010000:00000080:3.0:1788201249.312589:0:26208:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc120090380 x1875060695481856/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 328/400 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201249.312629:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6e293f14-c501-4bc5-9dd4-a18ef02756b4+38:73763:x1875060695481856:12345-192.168.201.20@tcp:101:dd.0 Request processed in 158us (1750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201249.312635:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5968 00000100:00100000:1.0:1788201249.314181:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201249.314234:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.314336:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695482496 00000100:00100000:0.0:1788201249.314343:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695482496 00000100:00100000:0.0:1788201249.314405:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1597 00000100:00100000:0.0:1788201249.314414:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+139:73767:x1875060695482496:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:0.0:1788201249.314430:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201249.314447:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1d44d lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c77 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.314568:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d454 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.314581:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d454 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.314591:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d454 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.314606:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1d45b lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.314612:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1d45b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.314618:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1d45b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.314667:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d462 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.314675:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d462 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.314698:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d462 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201249.314719:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x19:0x0]: returning size 0 00010000:00010000:0.0:1788201249.314789:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d454 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.314797:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d454 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.314803:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d454 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.314809:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d454 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.314815:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201249.314819:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d454 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.314826:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d454 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.314840:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201249.314843:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201249.314847:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d454 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.314852:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d454 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.314867:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1d45b lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.314880:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1d45b lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.314886:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1d45b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.314890:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201249.314893:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1d45b lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.314900:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1d45b lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.314907:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff8dc103a1b500) 00010000:00010000:0.0:1788201249.314910:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201249.314913:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1d45b lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.314919:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1d45b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.314960:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030400/0x96d0c9b8c9a1d44d lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c77 expref: 142 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.314973:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d462 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c77 expref: 141 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.314981:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff8dc103a3a300) 00010000:00010000:0.0:1788201249.314983:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201249.314990:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58c00, rc 0) 00000100:00100000:0.0:1788201249.315070:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+141:73767:x1875060695482496:12345-192.168.201.20@tcp:101:dd.0 Request processed in 656us (894us total) trans 124554051721 rc 0/0 00000100:00100000:0.0:1788201249.315077:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1597 00000100:00100000:2.0:1788201249.315199:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695482752 00000100:00100000:2.0:1788201249.315215:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695482752 00000100:00100000:2.0:1788201249.315255:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 280 00000100:00100000:2.0:1788201249.315262:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+141:73762:x1875060695482752:12345-192.168.201.20@tcp:35:dd.0 00000100:00100000:2.0:1788201249.315423:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+142:73762:x1875060695482752:12345-192.168.201.20@tcp:35:dd.0 Request processed in 160us (1188us total) trans 124554051722 rc 0/0 00000100:00100000:2.0:1788201249.315431:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 280 00000100:00100000:1.0:1788201249.319224:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.320775:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695483008 00000100:00100000:2.0:1788201249.320792:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695483008 00000100:00100000:2.0:1788201249.320855:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1598 00000100:00100000:2.0:1788201249.320865:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+142:73765:x1875060695483008:12345-192.168.201.20@tcp:36:dd.0 00010000:00010000:2.0:1788201249.320919:0:66312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201249.320948:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1d423 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c62 expref: 142 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.320964:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff8dc0048be100) 00010000:00010000:2.0:1788201249.320969:0:66312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201249.321185:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1d470 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.321199:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1d470 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.321219:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1d470 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788201249.321262:0:66312:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051723 00000004:00010000:2.0:1788201249.321284:0:66312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000738a8f79 reply state 0000000021f435f0 transno 124554051724 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1d470 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.321296:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1d470 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.321302:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff8dc0048be100) 00010000:00010000:2.0:1788201249.321305:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201249.321308:0:66312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201249.321400:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+144:73765:x1875060695483008:12345-192.168.201.20@tcp:36:dd.0 Request processed in 535us (2195us total) trans 124554051724 rc 0/0 00000100:00100000:2.0:1788201249.321408:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1598 00000020:00080000:2.0:1788201249.321412:0:66312:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788201249.322876:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.328284:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.328370:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201249.328439:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695483264 00000100:00100000:3.0:1788201249.328450:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695483264 00000100:00100000:3.0:1788201249.328514:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695483392 00000100:00100000:3.0:1788201249.328518:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695483392 00000100:00100000:3.0:1788201249.328544:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5969 00000100:00100000:3.0:1788201249.328554:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+39:73765:x1875060695483264:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:3.0:1788201249.328570:0:26202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201249.328592:0:26202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1d477 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c85 expref: -99 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201249.328618:0:26202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x393:0x0] initial LVB size: 0, mtime: 0x6a95c916, atime: 0x6a95c916, ctime: 0x6a95c916, blocks: 0x0 00010000:00010000:3.0:1788201249.328639:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x393:0x0].0x0 since=4100s v=(0 0) 00010000:00010000:3.0:1788201249.328645:0:26202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x393:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201249.328653:0:26202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1d477 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c85 expref: 40 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.328669:0:26202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1d477 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c85 expref: 40 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.328709:0:26202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c74800, rc 0) 00010000:00000080:3.0:1788201249.328718:0:26202:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12ee2df80 x1875060695483264/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 328/400 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201249.329180:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5970 00000100:00100000:2.0:1788201249.329193:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6e293f14-c501-4bc5-9dd4-a18ef02756b4+40:73764:x1875060695483392:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:2.0:1788201249.329202:0:26214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201249.329214:0:26214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1d47e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c8c expref: -99 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201249.329243:0:26214:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x392:0x0] initial LVB size: 0, mtime: 0x6a95c916, atime: 0x6a95c916, ctime: 0x6a95c916, blocks: 0x0 00010000:00010000:2.0:1788201249.329254:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x392:0x0].0x0 since=4100s v=(0 0) 00010000:00010000:2.0:1788201249.329258:0:26214:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x392:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201249.329265:0:26214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1d47e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c8c expref: 41 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.329277:0:26214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1d47e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c8c expref: 41 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201249.329287:0:26214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbce00, rc 0) 00010000:00000080:2.0:1788201249.329292:0:26214:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12ee2c700 x1875060695483392/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 328/400 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201249.329345:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6e293f14-c501-4bc5-9dd4-a18ef02756b4+41:73764:x1875060695483392:12345-192.168.201.20@tcp:101:dd.0 Request processed in 157us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201249.329352:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5970 00000100:00100000:1.0:1788201249.330322:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695483136 00000100:00100000:1.0:1788201249.330332:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695483136 00000100:00100000:1.0:1788201249.330425:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1599 00000100:00100000:1.0:1788201249.330435:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+144:73767:x1875060695483136:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:1.0:1788201249.330450:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201249.330465:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1d485 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c7e expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.330506:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1d48c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.330519:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1d48c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.330529:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1d48c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.330638:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec200/0x96d0c9b8c9a1d485 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c7e expref: 146 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.330655:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1d48c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c7e expref: 145 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201249.330663:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff8dc103a3a300) 00010000:00010000:1.0:1788201249.330666:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788201249.330669:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064eda00, rc 0) 00000100:00100000:1.0:1788201249.330734:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+145:73767:x1875060695483136:12345-192.168.201.20@tcp:101:dd.0 Request processed in 300us (7863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201249.330741:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1599 00000100:00100000:2.0:1788201249.332557:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+40:73765:x1875060695483264:12345-192.168.201.20@tcp:101:dd.0 Request processed in 3996us (4274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201249.332568:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5969 00000100:00100000:2.0:1788201249.332637:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201249.332935:0:25933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695483520 00000100:00100000:1.0:1788201249.332944:0:25933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695483520 00002000:00010000:1.0:1788201249.332996:0:25933:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/913 (0->18446744073709551615) 00002000:00100000:1.0:1788201249.333001:0:25933:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc12ee2fb80 with x1875060695483520 ext(0->18446744073709551615) 00002000:00010000:1.0:1788201249.333011:0:25933:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc12ee2fb80. 00000100:00100000:1.0:1788201249.333065:0:25933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1024 00000100:00100000:1.0:1788201249.333075:0:25933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+40:2401:x1875060695483520:12345-192.168.201.20@tcp:10:dd.0 00002000:00010000:1.0:1788201249.333225:0:25933:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x391:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788201249.333229:0:25933:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x391:0x0] updating lvb mtime from disk: 1788201238 -> 1788201249 00002000:00010000:1.0:1788201249.333232:0:25933:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x391:0x0] updating lvb atime from disk: 1788201238 -> 1788201238 00002000:00010000:1.0:1788201249.333234:0:25933:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x391:0x0] updating lvb ctime from disk: 1788201238 -> 1788201249 00002000:00010000:1.0:1788201249.333236:0:25933:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x391:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1788201249.333539:0:25933:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12ee2fb80 x1875060695483520/t4294969495(0) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 440/432 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201249.333591:0:25933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+41:2401:x1875060695483520:12345-192.168.201.20@tcp:10:dd.0 Request processed in 519us (955us total) trans 4294969495 rc 0/0 00000100:00100000:1.0:1788201249.333598:0:25933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1024 00002000:00010000:1.0:1788201249.333602:0:25933:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/913 (0->18446744073709551615) 00002000:00100000:1.0:1788201249.333604:0:25933:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc12ee2fb80 with x1875060695483520 ext(0->18446744073709551615) 00002000:00010000:1.0:1788201249.333610:0:25933:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc12ee2fb80. 00000100:00100000:2.0:1788201249.334274:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.334548:0:25936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695483648 00000100:00100000:0.0:1788201249.334556:0:25936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695483648 00002000:00010000:0.0:1788201249.334586:0:25936:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/915 (0->18446744073709551615) 00002000:00100000:0.0:1788201249.334590:0:25936:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc12ee2f480 with x1875060695483648 ext(0->18446744073709551615) 00002000:00010000:0.0:1788201249.334598:0:25936:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc12ee2f480. 00000100:00100000:0.0:1788201249.334628:0:25936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1025 00000100:00100000:0.0:1788201249.334637:0:25936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+41:2403:x1875060695483648:12345-192.168.201.20@tcp:10:dd.0 00002000:00010000:0.0:1788201249.334763:0:25936:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x393:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788201249.334767:0:25936:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x393:0x0] updating lvb mtime from disk: 1788201238 -> 1788201249 00002000:00010000:0.0:1788201249.334770:0:25936:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x393:0x0] updating lvb atime from disk: 1788201238 -> 1788201238 00002000:00010000:0.0:1788201249.334772:0:25936:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x393:0x0] updating lvb ctime from disk: 1788201238 -> 1788201249 00002000:00010000:0.0:1788201249.334774:0:25936:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x393:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1788201249.334780:0:25936:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12ee2f480 x1875060695483648/t4294969496(0) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 440/432 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201249.334832:0:25936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+42:2403:x1875060695483648:12345-192.168.201.20@tcp:10:dd.0 Request processed in 196us (561us total) trans 4294969496 rc 0/0 00000100:00100000:0.0:1788201249.334839:0:25936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1025 00002000:00010000:0.0:1788201249.334842:0:25936:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/915 (0->18446744073709551615) 00002000:00100000:0.0:1788201249.334845:0:25936:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc12ee2f480 with x1875060695483648 ext(0->18446744073709551615) 00002000:00010000:0.0:1788201249.334850:0:25936:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc12ee2f480. 00000100:00100000:0.0:1788201249.337342:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201249.337503:0:24876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695483776 00000100:00100000:3.0:1788201249.337513:0:24876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695483776 00002000:00010000:3.0:1788201249.337551:0:24876:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/914 (0->18446744073709551615) 00002000:00100000:3.0:1788201249.337555:0:24876:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc120090700 with x1875060695483776 ext(0->18446744073709551615) 00002000:00010000:3.0:1788201249.337568:0:24876:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc120090700. 00000100:00100000:3.0:1788201249.337606:0:24876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1026 00000100:00100000:3.0:1788201249.337625:0:24876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+42:2401:x1875060695483776:12345-192.168.201.20@tcp:10:dd.0 00002000:00010000:3.0:1788201249.337765:0:24876:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x392:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788201249.337768:0:24876:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x392:0x0] updating lvb mtime from disk: 1788201238 -> 1788201249 00002000:00010000:3.0:1788201249.337771:0:24876:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x392:0x0] updating lvb atime from disk: 1788201238 -> 1788201238 00002000:00010000:3.0:1788201249.337773:0:24876:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x392:0x0] updating lvb ctime from disk: 1788201238 -> 1788201249 00002000:00010000:3.0:1788201249.337775:0:24876:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x392:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1788201249.337782:0:24876:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc120090700 x1875060695483776/t4294969497(0) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 440/432 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201249.337845:0:24876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+43:2401:x1875060695483776:12345-192.168.201.20@tcp:10:dd.0 Request processed in 222us (512us total) trans 4294969497 rc 0/0 00000100:00100000:3.0:1788201249.337852:0:24876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1026 00002000:00010000:3.0:1788201249.337856:0:24876:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/914 (0->18446744073709551615) 00002000:00100000:3.0:1788201249.337859:0:24876:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc120090700 with x1875060695483776 ext(0->18446744073709551615) 00002000:00010000:3.0:1788201249.337863:0:24876:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc120090700. 00000100:00100000:3.0:1788201249.341671:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201249.341785:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.341890:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695484288 00000100:00100000:0.0:1788201249.341914:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695484288 00000100:00100000:0.0:1788201249.341979:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1600 00000100:00100000:0.0:1788201249.341998:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+145:73767:x1875060695484288:12345-192.168.201.20@tcp:36:dd.0 00010000:00010000:0.0:1788201249.342095:0:66757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201249.342121:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d462 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c77 expref: 145 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.342138:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff8dc103a3a300) 00010000:00010000:0.0:1788201249.342143:0:66757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201249.342321:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d493 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.342335:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d493 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.342346:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d493 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788201249.342390:0:66757:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 124554051725 00000004:00010000:0.0:1788201249.342412:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000948f57d6 reply state 00000000d4bea400 transno 124554051726 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d493 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.342424:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d493 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201249.342430:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff8dc103a3a300) 00010000:00010000:0.0:1788201249.342433:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201249.342436:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201249.342520:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+147:73767:x1875060695484288:12345-192.168.201.20@tcp:36:dd.0 Request processed in 524us (734us total) trans 124554051726 rc 0/0 00000100:00100000:0.0:1788201249.342528:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1600 00000020:00080000:0.0:1788201249.342539:0:66757:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788201249.342716:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201249.349187:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201249.350894:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201249.350980:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695484800 00000100:00100000:0.0:1788201249.351000:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695484800 00000100:00100000:0.0:1788201249.351082:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 281 00000100:00100000:0.0:1788201249.351094:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+147:73764:x1875060695484800:12345-192.168.201.20@tcp:35:dd.0 00000100:00100000:0.0:1788201249.351397:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+148:73764:x1875060695484800:12345-192.168.201.20@tcp:35:dd.0 Request processed in 305us (2219us total) trans 124554051727 rc 0/0 00000100:00100000:0.0:1788201249.351405:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 281 00000100:00100000:1.0:1788201249.352420:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695484032 00000100:00100000:1.0:1788201249.352432:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695484032 00000100:00100000:2.0:1788201249.352514:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695484544 00000100:00100000:2.0:1788201249.352519:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695484544 00000100:00100000:2.0:1788201249.352607:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 282 00000100:00100000:2.0:1788201249.352617:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+149:73763:x1875060695484544:12345-192.168.201.20@tcp:35:dd.0 00000100:00100000:2.0:1788201249.352855:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+150:73763:x1875060695484544:12345-192.168.201.20@tcp:35:dd.0 Request processed in 239us (10139us total) trans 124554051728 rc 0/0 00000100:00100000:2.0:1788201249.352865:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 282 00000100:00100000:3.0:1788201249.352982:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695484928 00000100:00100000:3.0:1788201249.352998:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695484928 00000100:00100000:3.0:1788201249.353062:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5971 00000100:00100000:3.0:1788201249.353070:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+43:73767:x1875060695484928:12345-192.168.201.20@tcp:101:dd.0 00010000:00010000:3.0:1788201249.353081:0:26199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201249.353101:0:26199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2e436a5/0x96d0c9b8c9a1d49a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c93 expref: -99 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201249.353127:0:26199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x395:0x0] initial LVB size: 0, mtime: 0x6a95c916, atime: 0x6a95c916, ctime: 0x6a95c916, blocks: 0x0 00010000:00010000:3.0:1788201249.353144:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x395:0x0].0x0 since=4100s v=(0 0) 00010000:00010000:3.0:1788201249.353149:0:26199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x395:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201249.353157:0:26199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2e436a5/0x96d0c9b8c9a1d49a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c93 expref: 44 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.353173:0:26199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a2e436a5/0x96d0c9b8c9a1d49a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c93 expref: 44 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201249.353186:0:26199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c75e00, rc 0) 00010000:00000080:3.0:1788201249.353193:0:26199:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004be4380 x1875060695484928/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 328/400 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201249.353219:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+44:73767:x1875060695484928:12345-192.168.201.20@tcp:101:dd.0 Request processed in 151us (2333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201249.353233:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5971 00000100:00100000:2.0:1788201249.357775:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 283 00000100:00100000:2.0:1788201249.357789:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107db5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+149:73765:x1875060695484032:12345-192.168.201.20@tcp:35:dd.0 00000100:00100000:2.0:1788201249.358090:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107db5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+150:73765:x1875060695484032:12345-192.168.201.20@tcp:35:dd.0 Request processed in 303us (16427us total) trans 124554051729 rc 0/0 00000100:00100000:2.0:1788201249.358097:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 283 00000100:00100000:3.0:1788201249.365216:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201249.366075:0:24874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695485056 00000100:00100000:1.0:1788201249.366087:0:24874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695485056 00002000:00010000:1.0:1788201249.366128:0:24874:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/917 (0->18446744073709551615) 00002000:00100000:1.0:1788201249.366133:0:24874:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc004be7b80 with x1875060695485056 ext(0->18446744073709551615) 00002000:00010000:1.0:1788201249.366143:0:24874:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc004be7b80. 00000100:00100000:1.0:1788201249.366165:0:24874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1027 00000100:00100000:1.0:1788201249.366183:0:24874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+44:2401:x1875060695485056:12345-192.168.201.20@tcp:10:dd.0 00002000:00010000:1.0:1788201249.366339:0:24874:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x395:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788201249.366343:0:24874:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x395:0x0] updating lvb mtime from disk: 1788201238 -> 1788201249 00002000:00010000:1.0:1788201249.366345:0:24874:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x395:0x0] updating lvb atime from disk: 1788201238 -> 1788201238 00002000:00010000:1.0:1788201249.366346:0:24874:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x395:0x0] updating lvb ctime from disk: 1788201238 -> 1788201249 00002000:00010000:1.0:1788201249.366348:0:24874:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x395:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1788201249.366354:0:24874:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004be7b80 x1875060695485056/t4294969498(0) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:370/0 lens 440/432 e 0 to 0 dl 1788201260 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201249.366413:0:24874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+45:2401:x1875060695485056:12345-192.168.201.20@tcp:10:dd.0 Request processed in 230us (1208us total) trans 4294969498 rc 0/0 00000100:00100000:1.0:1788201249.366420:0:24874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1027 00002000:00010000:1.0:1788201249.366424:0:24874:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/917 (0->18446744073709551615) 00002000:00100000:1.0:1788201249.366427:0:24874:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc004be7b80 with x1875060695485056 ext(0->18446744073709551615) 00002000:00010000:1.0:1788201249.366431:0:24874:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc004be7b80. 00000100:00100000:3.0:1788201249.371271:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201249.371336:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695485312 00000100:00100000:2.0:1788201249.371348:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695485312 00000100:00100000:2.0:1788201249.371409:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 284 00000100:00100000:2.0:1788201249.371420:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+150:73767:x1875060695485312:12345-192.168.201.20@tcp:35:dd.0 00000100:00100000:2.0:1788201249.371807:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+151:73767:x1875060695485312:12345-192.168.201.20@tcp:35:dd.0 Request processed in 386us (545us total) trans 124554051730 rc 0/0 00000100:00100000:2.0:1788201249.371815:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 284 00010000:00010000:2.0:1788201249.551228:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201250.131985:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201250.132011:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715285888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201250.132102:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201250.132155:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715285888 00000100:00100000:2.0:1788201250.132163:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715285888 00000100:00100000:2.0:1788201250.132218:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2362 00000100:00100000:2.0:1788201250.132229:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715285888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201250.132257:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201250.132303:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715285888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201250.132324:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2362 00000100:00080000:2.0:1788201250.132344:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201250.132381:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715285888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201250.133153:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715286016:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201250.133200:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201250.133270:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715286016 00000100:00100000:2.0:1788201250.133276:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715286016 00000100:00100000:2.0:1788201250.133317:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2363 00000100:00100000:2.0:1788201250.133325:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715286016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201250.133345:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00010000:00000080:2.0:1788201250.133358:0:8450:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004be4a80 x1875060715286016/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:371/0 lens 224/368 e 0 to 0 dl 1788201261 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201250.133398:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715286016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201250.133404:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2363 00000100:00100000:2.0:1788201250.133439:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715286016:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788201250.133745:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788201250.575297:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788201251.098930:0:96093:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788201251.098995:0:96093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1ca9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1caa6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201251.099009:0:96093:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1ca9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1caa6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201251.099033:0:96093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1ca9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1caa6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201251.099040:0:96093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1ca9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1caa6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201251.099061:0:96093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788201251.099066:0:96093:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788201251.099089:0:96093:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201251.099093:0:96093:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788201251.099098:0:96093:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788201251.099122:0:96093:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788201251.099509:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201251.099517:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1ca9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1caa6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.099525:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896a200 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:3.0:1788201251.099529:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1ca9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1caa6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.099539:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1ca9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1caa6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201251.099546:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1ca9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1caa6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201251.099551:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788201251.099553:0:6521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788201251.099555:0:6521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788201251.099581:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1ca9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1caa6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.099587:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201251.099618:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1ca9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1caa6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.099639:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1ca9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1caa6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.099660:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201251.099662:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201251.099664:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201251.099680:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715286144:0@lo:39:umount.0 00000100:00100000:3.0:1788201251.099751:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201251.100062:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715286272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201251.100095:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201251.100139:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715286144 00000100:00100000:1.0:1788201251.100146:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715286144 00000100:00100000:1.0:1788201251.100204:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1601 00000100:00100000:1.0:1788201251.100214:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875060715286144:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788201251.100237:0:69485:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c6cb 00000100:00080000:1.0:1788201251.100251:0:69485:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86d800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788201251.100304:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+1:3654:x1875060715286144:12345-0@lo:39:umount.0 Request processed in 92us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201251.100312:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1601 00000020:00000080:1.0:1788201251.100331:0:69485:0:(genops.c:885:class_export_put()) final put ffff8dc13f869000/lustre-MDT0000-lwp-OST0000_UUID 00000100:00080000:3.0:1788201251.100427:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201251.100455:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788201251.100464:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715286144:0@lo:39:umount.0 00000100:00080000:0.0:1788201251.102158:0:96093:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201251.102167:0:96093:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788201251.102182:0:96093:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788201251.102999:0:96093:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788201251.103003:0:96093:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788201251.103008:0:96093:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788201251.103056:0:96093:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c7000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788201251.103449:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715286272 00000100:00100000:2.0:1788201251.103459:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715286272 00000100:00100000:2.0:1788201251.103530:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:2.0:1788201251.103540:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005257800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715286272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201251.103553:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201251.103573:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fc400/0x96d0c9b8c9a1caa6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca9f expref: 24 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201251.103589:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201251.103670:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005257800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+23:3658:x1875060715286272:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (3574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201251.103677:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00100000:3.0:1788201251.103807:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715286400:0@lo:39:umount.0 00000100:00100000:3.0:1788201251.103848:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201251.103888:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715286400 00000100:00100000:3.0:1788201251.103892:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715286400 00000100:00100000:3.0:1788201251.103927:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1602 00000100:00100000:3.0:1788201251.103935:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875060715286400:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788201251.104092:0:66313:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a16446 00000100:00080000:3.0:1788201251.104101:0:66313:0:(import.c:65:import_set_state_nolock()) ffff8dc12f1aa800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788201251.104236:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+1:3654:x1875060715286400:12345-0@lo:39:umount.0 Request processed in 302us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201251.104244:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1602 00000020:00000080:3.0:1788201251.104254:0:66313:0:(genops.c:885:class_export_put()) final put ffff8dc12f1ad800/lustre-MDT0001-lwp-OST0000_UUID 00000100:00080000:3.0:1788201251.104276:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:3.0:1788201251.104288:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12f1ad800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788201251.104328:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc12f1aa800 for lustre-MDT0001 00000100:00080000:2.0:1788201251.104403:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c7000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788201251.104429:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715286400:0@lo:39:umount.0 00000100:00080000:3.0:1788201251.104521:0:96093:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788201251.104525:0:96093:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788201251.104529:0:96093:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788201251.105588:0:96093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1caad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1cab4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.105603:0:96093:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1caad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1cab4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.105610:0:96093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1caad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1cab4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.105617:0:96093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1caad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1cab4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201251.105961:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715286272:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1788201251.106038:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13f869000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788201251.106095:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc13f86d800 for lustre-MDT0000 00010000:00010000:0.0:1788201251.106268:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201251.106276:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1caad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1cab4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201251.106283:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fc000 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201251.106287:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1caad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1cab4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201251.106296:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1caad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1cab4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201251.106304:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1caad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1cab4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201251.106310:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201251.106312:0:24979:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1788201251.106338:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1caad lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1cab4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201251.106344:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201251.106389:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715286528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201251.106448:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201251.106499:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1caad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1cab4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201251.106508:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201251.106510:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201251.106512:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201251.106533:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715286528 00000100:00100000:0.0:1788201251.106539:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715286528 00000100:00100000:0.0:1788201251.106575:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:0.0:1788201251.106583:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+23:3655:x1875060715286528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201251.106594:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201251.106607:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00896b600/0x96d0c9b8c9a1cab4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1caad expref: 23 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201251.106620:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201251.106756:0:96093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201251.106762:0:96093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0078fc000/0x96d0c9b8c9a1caad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1cab4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.106783:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201251.106791:0:96093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782de00/0x96d0c9b8c9a1c69a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c6a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.106799:0:96093:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782de00/0x96d0c9b8c9a1c69a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c6a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.106805:0:96093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782de00/0x96d0c9b8c9a1c69a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1c6a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.106812:0:96093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc00782de00/0x96d0c9b8c9a1c69a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1c6a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.106832:0:96093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788201251.106837:0:96093:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1788201251.106841:0:96093:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788201251.106927:0:96093:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788201251.106932:0:96093:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00010000:00010000:3.0:1788201251.106941:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201251.106945:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc00782de00/0x96d0c9b8c9a1c69a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1c6a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.106962:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782de00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:3.0:1788201251.106965:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782de00/0x96d0c9b8c9a1c69a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1c6a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.106972:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc00782de00/0x96d0c9b8c9a1c69a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1c6a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201251.106977:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782de00/0x96d0c9b8c9a1c69a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1c6a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201251.106982:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788201251.106984:0:6521:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788201251.106986:0:6521:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788201251.106999:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc00782de00/0x96d0c9b8c9a1c69a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c6a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.107005:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201251.107044:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201251.108833:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+22:3655:x1875060715286528:12345-0@lo:103:ldlm_bl.0 Request processed in 2243us (2378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201251.108846:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:0.0:1788201251.108884:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715286656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201251.108932:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201251.109069:0:9535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715286656 00000100:00100000:0.0:1788201251.109076:0:9535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715286656 00000100:00100000:0.0:1788201251.109117:0:9535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:0.0:1788201251.109125:0:9535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9b18af6-fecc-4172-82c2-66531890fe11+22:3656:x1875060715286656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201251.109137:0:9535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201251.109154:0:9535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae2c00/0x96d0c9b8c9a1c6a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c69a expref: 22 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201251.109168:0:9535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201251.109197:0:9535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9b18af6-fecc-4172-82c2-66531890fe11+21:3656:x1875060715286656:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201251.109203:0:9535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:0.0:1788201251.109919:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715286656:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201251.110084:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc00782de00/0x96d0c9b8c9a1c69a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c6a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.110094:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc00782de00/0x96d0c9b8c9a1c69a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c6a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.110120:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201251.110122:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201251.110124:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788201251.110152:0:96093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1788201251.110165:0:96093:0:(obd_config.c:933:class_cleanup()) Failing over lustre-OST0000 00000100:00100000:2.0:1788201251.112180:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715286528:0@lo:103:ldlm_bl.0 00002000:00000080:3.0:1788201251.112897:0:96093:0:(ofd_obd.c:1268:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:3.0:1788201251.112944:0:96093:0:(ofd_obd.c:1282:ofd_iocontrol()) syncing ost lustre-OST0000 00000001:00080000:1.0:1788201251.113508:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969498 is committed 00000020:00000080:3.0:1788201251.113680:0:96093:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:3.0:1788201251.113690:0:96093:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8dc004016800 6e293f14-c501-4bc5-9dd4-a18ef02756b4 192.168.201.20@tcp 24 (0 0 20) 0 0 0 0: 0000000000000000 4294969498 stale:0 00000020:00080000:3.0:1788201251.113696:0:96093:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8dc0059d2800 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294969474 stale:0 00000020:00080000:3.0:1788201251.113700:0:96093:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8dc1201cb800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294969456 stale:0 00000020:00080000:3.0:1788201251.113704:0:96093:0:(genops.c:1553:class_disconnect_exports()) OBD device 18 (ffff8dc12f30b370) has exports, disconnecting them 00000020:00080000:3.0:1788201251.113709:0:96093:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.201.20@tcp (ffff8dc004016800), last request at 1788201249 00000020:00000080:3.0:1788201251.113716:0:96093:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c8df 00000020:00010000:3.0:1788201251.113725:0:96093:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc004016800: total 0 00000100:00080000:3.0:1788201251.113730:0:96093:0:(import.c:65:import_set_state_nolock()) ffff8dc004014000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788201251.113753:0:96093:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.201.20@tcp (ffff8dc004016800): rc 0 00000020:00080000:3.0:1788201251.113757:0:96093:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8dc0059d2800), last request at 1788201247 00000020:00000080:3.0:1788201251.113759:0:96093:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c5ac 00000100:00080000:3.0:1788201251.113764:0:96093:0:(import.c:65:import_set_state_nolock()) ffff8dc0059d0800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788201251.113782:0:96093:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc0059d2800): rc 0 00000020:00000080:3.0:1788201251.113784:0:96093:0:(genops.c:885:class_export_put()) final put ffff8dc0059d2800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:3.0:1788201251.113794:0:96093:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8dc1201cb800), last request at 1788201250 00000020:00000080:3.0:1788201251.113797:0:96093:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a163c8 00000100:00080000:3.0:1788201251.113802:0:96093:0:(import.c:65:import_set_state_nolock()) ffff8dc1201ca000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788201251.113814:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0059d2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788201251.113856:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc0059d0800 for lustre-OST0000 00000020:00080000:3.0:1788201251.113870:0:96093:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc1201cb800): rc 0 00000020:00000080:3.0:1788201251.113872:0:96093:0:(genops.c:885:class_export_put()) final put ffff8dc1201cb800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788201251.113887:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1201cb800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788201251.113905:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1201ca000 for lustre-OST0000 00000020:00080000:3.0:1788201251.113929:0:96093:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8dc12f30b370) has no exports 00010000:00010000:3.0:1788201251.113997:0:96093:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1d048 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b19 expref: 21 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.114055:0:96093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1d048 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b19 expref: 21 pid: 26206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.114104:0:96093:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 000000003ab5e6bc/0x96d0c9b8c9a1d08e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b3c expref: 20 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.114115:0:96093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ab5e6bc/0x96d0c9b8c9a1d08e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x383:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b3c expref: 20 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.114144:0:96093:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 0000000009117cd9/0x96d0c9b8c9a1d263 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x384:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bcf expref: 19 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.114154:0:96093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009117cd9/0x96d0c9b8c9a1d263 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x384:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bcf expref: 19 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.114183:0:96093:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000cf834a51/0x96d0c9b8c9a1d17c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b74 expref: 18 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.114210:0:96093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf834a51/0x96d0c9b8c9a1d17c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b74 expref: 18 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.114238:0:96093:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000587aac9c/0x96d0c9b8c9a1d1e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ba5 expref: 17 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.114248:0:96093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000587aac9c/0x96d0c9b8c9a1d1e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ba5 expref: 17 pid: 26200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.114276:0:96093:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1d105 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b58 expref: 16 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.114287:0:96093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1d105 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x387:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b58 expref: 16 pid: 26210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.114314:0:96093:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1d0f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b51 expref: 15 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.114324:0:96093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1d0f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b51 expref: 15 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.114350:0:96093:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 0000000040edfed0/0x96d0c9b8c9a1d278 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bd6 expref: 14 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.114375:0:96093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040edfed0/0x96d0c9b8c9a1d278 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bd6 expref: 14 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201251.114402:0:96093:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 000000005f6d99c0/0x96d0c9b8c9a1d11a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106480000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b6d expref: 13 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:0.0:1788201251.114566:0:24979:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc004016800: total 0 00010000:00010000:0.0:1788201251.114577:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201251.114618:0:24979:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc004016800, canceled 0 locks, left on hash table 12. 00010000:00010000:0.0:1788201251.114665:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1d47e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c8c expref: 13 pid: 26214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201251.114695:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae2bee79/0x96d0c9b8c9a1d1fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bac expref: 12 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201251.114714:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000362585d6/0x96d0c9b8c9a1d2be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bf9 expref: 11 pid: 26205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201251.114733:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3011c0a/0x96d0c9b8c9a1d366 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c2a expref: 10 pid: 26209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201251.114753:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002723d596/0x96d0c9b8c9a1d446 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c69 expref: 9 pid: 26208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201251.114772:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1d477 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c85 expref: 8 pid: 26202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201251.114791:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000957cff04/0x96d0c9b8c9a1d335 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c15 expref: 7 pid: 23974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201251.114811:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1d3f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c54 expref: 6 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201251.114845:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2e436a5/0x96d0c9b8c9a1d49a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c93 expref: 5 pid: 26199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201251.114866:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1d2d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c00 expref: 4 pid: 8491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201251.114883:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1d3ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c3f expref: 3 pid: 26211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201251.114895:0:24979:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc004016800, canceled 12 locks, left on hash table 0. 00010000:00010000:0.0:1788201251.115769:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201251.115773:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201251.115775:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201251.115961:0:96093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f6d99c0/0x96d0c9b8c9a1d11a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907480000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b6d expref: 1 pid: 26201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788201251.115971:0:96093:0:(genops.c:885:class_export_put()) final put ffff8dc004016800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 00010000:00010000:1.0:1788201251.117818:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201251.117830:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788201251.119716:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc004016800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 for lustre-OST0000 00000020:00000080:0.0:1788201251.119786:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc004014000 for lustre-OST0000 00000020:01000000:3.0:1788201251.119865:0:96093:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc00340b1e0 - data ffff8dc11db30000/ffff8dc12f1e6800 00000020:01000000:3.0:1788201251.120148:0:96093:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc002582480 - data ffff8dc11da65870/ffff8dc13c3d7c00 00100000:10000000:0.0:1788201251.138735:0:96093:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788201251.151761:0:96093:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c99cf91e 00000020:00000080:2.0:1788201251.151773:0:96093:0:(genops.c:885:class_export_put()) final put ffff8dc001e29800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788201251.151832:0:96093:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc13aa9f000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788201251.151836:0:96093:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc13aa9f000 2 00000020:01000004:2.0:1788201251.151848:0:96093:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dc13aa9f000 from lustre-OST0000 00000020:00000080:2.0:1788201251.151871:0:96093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201251.151883:0:96093:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788201251.151886:0:96093:0:(genops.c:885:class_export_put()) final put ffff8dc001e2d000/lustre-OST0000_UUID 00000020:00000080:2.0:1788201251.151889:0:96093:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc001e2d000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788201251.151896:0:96093:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788201251.151946:0:96093:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:2.0:1788201251.151951:0:96093:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788201251.151955:0:96093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201251.151961:0:96093:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788201251.151968:0:96093:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8dc106077000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788201251.151974:0:96093:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8dc1401b3370) has exports, disconnecting them 00000020:00080000:2.0:1788201251.151979:0:96093:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8dc106077000), last request at 1788197372 00000020:00000080:2.0:1788201251.151983:0:96093:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c99cf948 00000020:00080000:2.0:1788201251.151993:0:96093:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc106077000): rc 0 00000020:00000080:2.0:1788201251.151998:0:96093:0:(genops.c:885:class_export_put()) final put ffff8dc106077000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788201251.152213:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc001e29800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788201251.153185:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc106077000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788201251.153518:0:96093:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788201251.153523:0:96093:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201251.153528:0:96093:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788201251.153533:0:96093:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788201251.153693:0:96093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201251.153705:0:96093:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1788201251.153710:0:96093:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788201251.153715:0:96093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201251.153721:0:96093:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788201251.153726:0:96093:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8dc106070000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201251.153732:0:96093:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8dc002644d28) has exports, disconnecting them 00000020:00080000:3.0:1788201251.153746:0:96093:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8dc106070000), last request at 1788197372 00000020:00000080:3.0:1788201251.153750:0:96093:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c99cf95d 00000020:00080000:3.0:1788201251.153762:0:96093:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc106070000): rc 0 00000020:00000080:3.0:1788201251.153766:0:96093:0:(genops.c:885:class_export_put()) final put ffff8dc106070000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788201251.154507:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1401c4000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788201251.154515:0:57134:0:(genops.c:885:class_export_put()) final put ffff8dc106075000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788201251.154518:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc106075000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788201251.154529:0:57134:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788201251.154597:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc106070000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788201251.161075:0:96093:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788201251.161084:0:96093:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788201251.161088:0:96093:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788201251.161095:0:96093:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201251.161122:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1401c7000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788201251.161271:0:96093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201251.161283:0:96093:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788201251.161288:0:96093:0:(genops.c:885:class_export_put()) final put ffff8dc106076800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788201251.161291:0:96093:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc106076800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788201251.161298:0:96093:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788201251.161370:0:96093:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc13aa9f000 1 00000020:00000080:1.0:1788201251.161376:0:96093:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c99cf8e6 00000020:00000080:1.0:1788201251.161382:0:96093:0:(genops.c:885:class_export_put()) final put ffff8dc13aa99000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788201251.161389:0:96093:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788201251.161395:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13aa99000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788201251.161402:0:96093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201251.161419:0:96093:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788201251.161422:0:96093:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8dc12f0c4d28) has no exports 00000020:00000080:1.0:1788201251.181481:0:96093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201251.181500:0:96093:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788201251.181506:0:96093:0:(genops.c:885:class_export_put()) final put ffff8dc13aa98800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788201251.181510:0:96093:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13aa98800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788201251.181521:0:96093:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788201251.181657:0:96093:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dc13aa9a000 00000020:02000400:1.0:1788201251.181793:0:96093:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788201251.599181:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201252.180799:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715286912:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.180860:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201252.180902:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715287424:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.180926:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201252.180956:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715287936:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.180977:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201252.181000:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788201252.181006:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715286784:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.181060:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201252.181083:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715287296:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.181100:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201252.181113:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715287808:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.181128:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201252.181148:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715287040:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.181165:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201252.181178:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715287552:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.181194:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201252.181207:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715288064:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.181226:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201252.181243:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788201252.181247:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715287168:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.181268:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201252.181285:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715287680:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.181303:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201252.181416:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715286912 00000100:00100000:0.0:1788201252.181425:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715286912 00000100:00100000:0.0:1788201252.181473:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715287040 00000100:00100000:0.0:1788201252.181475:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715287040 00000100:00100000:0.0:1788201252.181485:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715287552 00000100:00100000:0.0:1788201252.181486:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715287552 00000100:00100000:0.0:1788201252.181496:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715288064 00000100:00100000:0.0:1788201252.181497:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715288064 00000100:00100000:0.0:1788201252.181510:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1517 00000100:00100000:0.0:1788201252.181518:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715286912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.181573:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715286912:12345-0@lo:400:kworker.0 Request processed in 56us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201252.181580:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1517 00000100:00100000:0.0:1788201252.181599:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1518 00000100:00100000:0.0:1788201252.181604:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715287040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.181646:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715287040:12345-0@lo:400:kworker.0 Request processed in 42us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201252.181652:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1518 00000100:00100000:0.0:1788201252.181663:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1519 00000100:00100000:0.0:1788201252.181669:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715287552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.181692:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715287552:12345-0@lo:400:kworker.0 Request processed in 24us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201252.181698:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1519 00000100:00100000:0.0:1788201252.181707:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1520 00000100:00100000:0.0:1788201252.181712:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715288064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.181729:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715288064:12345-0@lo:400:kworker.0 Request processed in 17us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201252.181734:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1520 00000100:00100000:0.0:1788201252.181750:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715287424 00000100:00100000:0.0:1788201252.181753:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715287424 00000100:00100000:0.0:1788201252.181774:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715287936 00000100:00100000:0.0:1788201252.181776:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715287936 00000100:00100000:0.0:1788201252.181788:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715287296 00000100:00100000:0.0:1788201252.181790:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715287296 00000100:00100000:0.0:1788201252.181800:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715287808 00000100:00100000:0.0:1788201252.181802:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715287808 00000100:00100000:0.0:1788201252.181813:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2911 00000100:00100000:0.0:1788201252.181823:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715287424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.181847:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715287424:12345-0@lo:400:kworker.0 Request processed in 25us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201252.181853:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2911 00000100:00100000:0.0:1788201252.181861:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2912 00000100:00100000:0.0:1788201252.181866:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715287936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.181884:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715287936:12345-0@lo:400:kworker.0 Request processed in 18us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201252.181889:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2912 00000100:00100000:0.0:1788201252.181899:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5972 00000100:00100000:0.0:1788201252.181903:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3658:x1875060715287296:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788201252.181908:0:26204:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788201252.181930:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3658:x1875060715287296:12345-0@lo:400:kworker.0 Request processed in 26us (829us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788201252.181935:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5972 00000100:00100000:0.0:1788201252.181946:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5973 00000100:00100000:0.0:1788201252.181950:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3658:x1875060715287808:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788201252.181954:0:26204:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788201252.181975:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3658:x1875060715287808:12345-0@lo:400:kworker.0 Request processed in 24us (846us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788201252.181980:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5973 00000100:00100000:0.0:1788201252.182000:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715286784 00000100:00100000:0.0:1788201252.182004:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715286784 00000100:00100000:0.0:1788201252.182053:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788201252.182060:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003bfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:3658:x1875060715286784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.182087:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003bfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:3658:x1875060715286784:12345-0@lo:400:kworker.0 Request processed in 29us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201252.182098:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788201252.182137:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715287168 00000100:00100000:0.0:1788201252.182141:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715287168 00000100:00100000:0.0:1788201252.182165:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715287680 00000100:00100000:0.0:1788201252.182168:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715287680 00000100:00100000:0.0:1788201252.182182:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4101 00000100:00100000:0.0:1788201252.182188:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715287168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.182219:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715287168:12345-0@lo:400:kworker.0 Request processed in 31us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201252.182224:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4101 00000100:00100000:0.0:1788201252.182236:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4102 00000100:00100000:0.0:1788201252.182241:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715287680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.182266:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715287680:12345-0@lo:400:kworker.0 Request processed in 25us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201252.182272:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4102 00000100:00100000:0.0:1788201252.182442:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715287168:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.182452:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715287680:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.182463:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715287040:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.182471:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715287552:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.182481:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715288064:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.182513:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715286784:0@lo:400:kworker.0 00000100:00080000:0.0:1788201252.182523:0:3658:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788201252.182528:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788201252.182538:0:3658:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:0.0:1788201252.182551:0:3658:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:0.0:1788201252.182554:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201252.182558:0:3658:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3184 00000100:00080000:0.0:1788201252.182563:0:3658:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8dc006d84000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201252.182586:0:3658:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13ab55c00 x1875060715288192/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201252.182608:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715287296:0@lo:400:kworker.0 00000100:00080000:0.0:1788201252.182619:0:3658:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788201252.182621:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788201252.182624:0:3658:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:0.0:1788201252.182653:0:3658:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:0.0:1788201252.182655:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201252.182658:0:3658:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 4052 00000100:00080000:0.0:1788201252.182662:0:3658:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dc109815000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201252.182673:0:3658:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13ab56d80 x1875060715288320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201252.182682:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715287808:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.182695:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715286912:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.182704:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715287424:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.182712:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715287936:0@lo:400:kworker.0 00000100:00100000:0.0:1788201252.182740:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715288192:0@lo:8:ptlrpcd_00_03.0 00000100:00100000:0.0:1788201252.182778:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201252.182798:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715288320:0@lo:8:ptlrpcd_00_03.0 00000100:00100000:0.0:1788201252.182816:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201252.182841:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715288192 00000100:00100000:0.0:1788201252.182845:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715288192 00000100:00100000:0.0:1788201252.182863:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715288320 00000100:00100000:0.0:1788201252.182866:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715288320 00000100:00100000:0.0:1788201252.182879:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5974 00000100:00100000:0.0:1788201252.182884:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3654:x1875060715288192:12345-0@lo:8:ptlrpcd_00_03.0 00010000:00020000:0.0:1788201252.182901:0:26211:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201252.182932:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3654:x1875060715288192:12345-0@lo:8:ptlrpcd_00_03.0 Request processed in 46us (153us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201252.182937:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5974 00000100:00100000:0.0:1788201252.182948:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5975 00000100:00100000:0.0:1788201252.182951:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3654:x1875060715288320:12345-0@lo:8:ptlrpcd_00_03.0 00010000:00020000:0.0:1788201252.182960:0:26211:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201252.182981:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3654:x1875060715288320:12345-0@lo:8:ptlrpcd_00_03.0 Request processed in 28us (164us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201252.182986:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5975 00000100:00080000:0.0:1788201252.183009:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201252.183041:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201252.183045:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715288192:0@lo:8:ptlrpcd_00_03.0 00000100:00080000:0.0:1788201252.183055:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201252.183057:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201252.183060:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715288320:0@lo:8:ptlrpcd_00_03.0 00000100:00080000:1.0:1788201252.184277:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201252.184285:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201252.184288:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201252.186726:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715288448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201252.186802:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201252.186915:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715288448 00000100:00100000:1.0:1788201252.186923:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715288448 00000100:00100000:1.0:1788201252.186983:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4103 00000100:00100000:1.0:1788201252.186993:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715288448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201252.187052:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:1.0:1788201252.187100:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715288448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201252.187107:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4103 00000100:00100000:1.0:1788201252.187150:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715288448:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788201252.625972:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201252.697053:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201252.697079:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715288576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201252.697141:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201252.697185:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715288576 00000100:00100000:0.0:1788201252.697192:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715288576 00000100:00100000:0.0:1788201252.697232:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2364 00000100:00100000:0.0:1788201252.697240:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715288576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201252.697265:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201252.697301:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715288576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201252.697307:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2364 00000100:00100000:0.0:1788201252.697347:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715288576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201252.697499:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201252.697509:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715288704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201252.697540:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201252.697600:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715288704 00000100:00100000:1.0:1788201252.697604:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715288704 00000100:00100000:1.0:1788201252.697647:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4104 00000100:00100000:1.0:1788201252.697654:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715288704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201252.697674:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:1.0:1788201252.697706:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715288704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201252.697712:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4104 00000100:00100000:1.0:1788201252.697746:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715288704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201252.826327:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201252.826381:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201252.826415:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201252.826434:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201252.826461:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201252.826492:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695485696 00000100:00100000:2.0:1788201252.826492:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695485952 00000100:00100000:1.0:1788201252.826502:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695485696 00000100:00100000:2.0:1788201252.826502:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695485952 00000100:00100000:3.0:1788201252.826550:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695485568 00000100:00100000:3.0:1788201252.826555:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695485568 00000100:00100000:1.0:1788201252.826627:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1521 00000100:00100000:1.0:1788201252.826639:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2400:x1875060695485696:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201252.826709:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2400:x1875060695485696:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 73us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201252.826717:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1521 00000100:00100000:0.0:1788201252.826776:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695485440 00000100:00100000:0.0:1788201252.826781:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695485440 00000100:00100000:0.0:1788201252.826809:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 184 00000100:00100000:0.0:1788201252.826815:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695485440:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201252.826841:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695485440:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201252.826847:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 184 00000100:00100000:2.0:1788201252.827524:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695485824 00000100:00100000:2.0:1788201252.827530:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695485824 00000100:00100000:2.0:1788201252.827548:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2913 00000100:00100000:2.0:1788201252.827557:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2400:x1875060695485952:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201252.827592:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2400:x1875060695485952:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 37us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201252.827598:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2913 00000100:00100000:2.0:1788201252.827610:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5976 00000100:00100000:2.0:1788201252.827626:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:2400:x1875060695485824:12345-192.168.201.20@tcp:400:kworker.0 00000020:00080000:2.0:1788201252.827633:0:26214:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.20@tcp 00000100:00100000:2.0:1788201252.827654:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:2400:x1875060695485824:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 38us (1193us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788201252.827660:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5976 00000100:00100000:3.0:1788201252.833355:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1522 00000100:00100000:3.0:1788201252.833374:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+151:2400:x1875060695485568:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201252.833470:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+151:2400:x1875060695485568:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 101us (7034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201252.833478:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1522 00000100:00080000:1.0:1788201252.833548:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201252.833554:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201252.833557:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201252.851372:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201252.851557:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695486080 00000100:00100000:3.0:1788201252.851568:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695486080 00000100:00100000:3.0:1788201252.851622:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5977 00000100:00100000:3.0:1788201252.851631:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:2399:x1875060695486080:12345-192.168.201.20@tcp:8:ptlrpcd_00_00.0 00010000:00020000:3.0:1788201252.851655:0:26202:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201252.851719:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:2399:x1875060695486080:12345-192.168.201.20@tcp:8:ptlrpcd_00_00.0 Request processed in 87us (356us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201252.851726:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5977 00010000:00010000:1.0:1788201253.647339:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201254.678052:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788201254.738105:0:94457:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051730 is committed 00010000:00010000:2.0:1788201254.738290:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1d017 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738305:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1d017 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738313:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1d017 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738319:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201254.738324:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1d017 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738333:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1d017 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738425:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff8dc11248cb00) 00010000:00010000:2.0:1788201254.738428:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201254.738432:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1d017 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738439:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1d017 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738464:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1d041 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738470:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1d041 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738476:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1d041 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738481:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201254.738484:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1d041 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738490:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1d041 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738497:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff8dc11248c900) 00010000:00010000:2.0:1788201254.738499:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201254.738501:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1d041 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738508:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1d041 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738529:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1d0b8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738535:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1d0b8 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738541:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1d0b8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738546:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201254.738549:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1d0b8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738554:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1d0b8 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738561:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff8dc11248ce00) 00010000:00010000:2.0:1788201254.738564:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201254.738566:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1d0b8 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738572:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1d0b8 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738608:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d0e2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738616:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d0e2 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738622:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d0e2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738632:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbcc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201254.738636:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d0e2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738642:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d0e2 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738651:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff8dc0048be700) 00010000:00010000:2.0:1788201254.738653:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201254.738656:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d0e2 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738662:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d0e2 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738674:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d0fe lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738681:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d0fe lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738687:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d0fe lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738691:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201254.738694:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d0fe lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738699:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d0fe lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738716:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff8dc005cc6c00) 00010000:00010000:2.0:1788201254.738718:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201254.738721:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d0fe lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738727:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1d0fe lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738740:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1d121 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738746:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1d121 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738751:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1d121 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738756:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201254.738759:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1d121 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738765:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1d121 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738772:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff8dc11248c400) 00010000:00010000:2.0:1788201254.738774:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201254.738777:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1d121 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738783:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1d121 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738805:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1d1ad lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738812:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1d1ad lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738818:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1d1ad lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738823:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201254.738825:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1d1ad lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738831:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1d1ad lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738838:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff8dc11248c800) 00010000:00010000:2.0:1788201254.738840:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201254.738842:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1d1ad lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738848:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1d1ad lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738859:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d1de lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738865:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d1de lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738870:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d1de lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.738880:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbda00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201254.738883:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d1de lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740641:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d1de lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740671:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff8dc1207c9500) 00010000:00010000:2.0:1788201254.740673:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201254.740679:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d1de lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740685:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d1de lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740712:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1d232 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740718:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1d232 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740725:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1d232 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740730:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201254.740733:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1d232 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740739:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1d232 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740765:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff8dc11248c300) 00010000:00010000:2.0:1788201254.740767:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201254.740771:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1d232 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740776:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1d232 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740789:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74400/0x96d0c9b8c9a1d239 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740795:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74400/0x96d0c9b8c9a1d239 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740801:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74400/0x96d0c9b8c9a1d239 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740807:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201254.740809:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74400/0x96d0c9b8c9a1d239 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740815:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74400/0x96d0c9b8c9a1d239 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740821:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff8dc0048be500) 00010000:00010000:2.0:1788201254.740823:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201254.740826:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74400/0x96d0c9b8c9a1d239 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740831:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74400/0x96d0c9b8c9a1d239 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740855:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1d2b0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740862:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1d2b0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740868:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1d2b0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740872:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201254.740875:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1d2b0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740881:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1d2b0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740904:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff8dc005cc6f00) 00010000:00010000:2.0:1788201254.740907:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201254.740910:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1d2b0 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740916:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd400/0x96d0c9b8c9a1d2b0 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740929:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1d2b7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740935:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1d2b7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740941:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1d2b7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740952:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ece00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201254.740955:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1d2b7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740960:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1d2b7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740968:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff8dc005cc6800) 00010000:00010000:2.0:1788201254.740969:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201254.740972:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1d2b7 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.740977:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1d2b7 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741008:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1d2fd lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741042:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1d2fd lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741049:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1d2fd lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741054:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201254.741056:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1d2fd lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741062:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1d2fd lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741081:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff8dc005cc6500) 00010000:00010000:2.0:1788201254.741084:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201254.741087:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1d2fd lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741093:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1d2fd lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741120:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1d33c lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741127:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1d33c lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741132:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1d33c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741138:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101673c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201254.741141:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1d33c lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741147:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1d33c lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741156:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff8dc0048be900) 00010000:00010000:2.0:1788201254.741158:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201254.741161:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1d33c lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741166:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673c00/0x96d0c9b8c9a1d33c lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741189:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1d37b lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741198:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1d37b lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741204:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1d37b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741208:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101673e00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201254.741211:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1d37b lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741217:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1d37b lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741225:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff8dc0048be200) 00010000:00010000:2.0:1788201254.741227:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201254.741230:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1d37b lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741236:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673e00/0x96d0c9b8c9a1d37b lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741247:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1d3b3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741252:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1d3b3 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741258:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1d3b3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741268:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101672c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201254.741271:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1d3b3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741277:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1d3b3 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741286:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff8dc12196e200) 00010000:00010000:2.0:1788201254.741288:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201254.741290:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1d3b3 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741297:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672c00/0x96d0c9b8c9a1d3b3 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741311:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d3f9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741317:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d3f9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741322:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d3f9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741327:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064edc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201254.741329:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d3f9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741334:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d3f9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741363:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff8dc0048be800) 00010000:00010000:2.0:1788201254.741365:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201254.741369:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d3f9 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741374:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d3f9 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741391:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1d431 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741397:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1d431 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741402:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1d431 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741406:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201254.741408:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1d431 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741413:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1d431 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741421:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff8dc103a3a600) 00010000:00010000:2.0:1788201254.741423:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201254.741425:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1d431 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741430:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1d431 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741453:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1d470 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741458:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1d470 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741463:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1d470 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741468:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201254.741471:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1d470 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741476:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1d470 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741483:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff8dc0048be100) 00010000:00010000:2.0:1788201254.741485:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201254.741487:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1d470 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741491:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1d470 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741502:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d493 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741506:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d493 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741511:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d493 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741520:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201254.741524:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d493 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741528:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d493 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741535:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff8dc103a3a300) 00010000:00010000:2.0:1788201254.741537:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201254.741540:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d493 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201254.741545:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d493 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201255.250008:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715288832:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201255.250119:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201255.250603:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715288832 00000100:00100000:2.0:1788201255.250612:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715288832 00000100:00100000:2.0:1788201255.250729:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2365 00000100:00100000:2.0:1788201255.250740:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715288832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201255.250767:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201255.250824:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715288832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201255.250831:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2365 00000100:00100000:3.0:1788201255.250909:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715288832:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788201255.254372:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788201255.698219:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201256.720084:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201257.298047:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201257.298055:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788201257.298059:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201257.298066:0:76267:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 4103 00000100:00080000:3.0:1788201257.298072:0:76267:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201257.298078:0:76267:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8dc006d84000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201257.298102:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005abfb80 x1875060715289600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201257.298226:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715288960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201257.298376:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201257.298416:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715289472:0@lo:400:kworker.0 00000100:00100000:1.0:1788201257.298442:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201257.298469:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201257.298475:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715289344:0@lo:400:kworker.0 00000100:00100000:1.0:1788201257.298517:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201257.298561:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715288960 00000100:00100000:1.0:1788201257.298569:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715288960 00000100:00100000:1.0:1788201257.298609:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715289472 00000100:00100000:1.0:1788201257.298612:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715289472 00000100:00100000:1.0:1788201257.298635:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4105 00000100:00100000:1.0:1788201257.298645:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715288960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201257.298681:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:1.0:1788201257.298728:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715288960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201257.298736:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4105 00000100:00100000:1.0:1788201257.298754:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4106 00000100:00100000:1.0:1788201257.298761:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715289472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201257.298794:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715289472:12345-0@lo:400:kworker.0 Request processed in 33us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201257.298801:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4106 00000100:00100000:1.0:1788201257.298819:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715289344 00000100:00100000:1.0:1788201257.298823:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715289344 00000100:00100000:1.0:1788201257.298858:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1523 00000100:00100000:1.0:1788201257.298865:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715289344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201257.298896:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715289344:12345-0@lo:400:kworker.0 Request processed in 32us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201257.298902:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1523 00000100:00080000:1.0:1788201257.298921:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201257.298953:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715289344:0@lo:400:kworker.0 00000100:00100000:1.0:1788201257.298969:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715288960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201257.298988:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715289472:0@lo:400:kworker.0 00000100:00100000:1.0:1788201257.299064:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715289600:0@lo:8:kworker.0 00000100:00100000:1.0:1788201257.299092:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201257.299262:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715289216:0@lo:400:kworker.0 00000100:00100000:1.0:1788201257.299292:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201257.299396:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201257.299402:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715289088:0@lo:400:kworker.0 00000100:00100000:1.0:1788201257.299430:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201257.299467:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715289600 00000100:00100000:1.0:1788201257.299471:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715289600 00000100:00100000:1.0:1788201257.299493:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5978 00000100:00100000:1.0:1788201257.299498:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3654:x1875060715289600:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788201257.299517:0:26205:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201257.299562:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3654:x1875060715289600:12345-0@lo:8:kworker.0 Request processed in 62us (468us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201257.299569:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5978 00000100:00100000:1.0:1788201257.299587:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715289088 00000100:00100000:1.0:1788201257.299591:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715289088 00000100:00100000:1.0:1788201257.299618:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788201257.299624:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:3658:x1875060715289088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201257.299661:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:3658:x1875060715289088:12345-0@lo:400:kworker.0 Request processed in 37us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201257.299667:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:1.0:1788201257.299708:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201257.299713:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201257.299725:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715289600:0@lo:8:kworker.0 00000100:00100000:1.0:1788201257.299753:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715289088:0@lo:400:kworker.0 00000100:00080000:3.0:1788201257.299862:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201257.299866:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788201257.299870:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201257.299874:0:76267:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 4103 00000100:00080000:3.0:1788201257.299878:0:76267:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201257.299883:0:76267:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dc109815000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201257.299900:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005abca80 x1875060715289984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201257.299957:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715290112:0@lo:400:kworker.0 00000100:00100000:3.0:1788201257.299990:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201257.300012:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201257.300033:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715290240:0@lo:400:kworker.0 00000100:00100000:3.0:1788201257.300056:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201257.300081:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715290112 00000100:00100000:3.0:1788201257.300092:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715290112 00000100:00100000:3.0:1788201257.300221:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2914 00000100:00100000:3.0:1788201257.300229:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715290112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201257.300269:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715290112:12345-0@lo:400:kworker.0 Request processed in 41us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201257.300275:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2914 00000100:00100000:3.0:1788201257.300295:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715289216 00000100:00100000:3.0:1788201257.300372:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715289216 00000100:00100000:3.0:1788201257.300407:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715290240 00000100:00100000:3.0:1788201257.300411:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715290240 00000100:00100000:3.0:1788201257.300433:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1524 00000100:00100000:3.0:1788201257.300440:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715289216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201257.300476:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715289216:12345-0@lo:400:kworker.0 Request processed in 37us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201257.300482:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1524 00000100:00100000:3.0:1788201257.300493:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1525 00000100:00100000:3.0:1788201257.300499:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715290240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201257.300527:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715290240:12345-0@lo:400:kworker.0 Request processed in 29us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201257.300533:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1525 00000100:00100000:3.0:1788201257.300578:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715290240:0@lo:400:kworker.0 00000100:00100000:3.0:1788201257.300589:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715290112:0@lo:400:kworker.0 00000100:00080000:3.0:1788201257.300611:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201257.300615:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201257.300640:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715289984:0@lo:8:kworker.0 00000100:00100000:3.0:1788201257.300665:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201257.300704:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715289984 00000100:00100000:3.0:1788201257.300708:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715289984 00000100:00100000:3.0:1788201257.300728:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5979 00000100:00100000:3.0:1788201257.300733:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3654:x1875060715289984:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788201257.300747:0:23974:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201257.300779:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3654:x1875060715289984:12345-0@lo:8:kworker.0 Request processed in 45us (114us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201257.300785:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5979 00000100:00080000:3.0:1788201257.300811:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201257.300816:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201257.300819:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715289984:0@lo:8:kworker.0 00000100:00100000:3.0:1788201257.300842:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715289856:0@lo:400:kworker.0 00000100:00100000:3.0:1788201257.300866:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201257.300894:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715289216:0@lo:400:kworker.0 00000100:00100000:3.0:1788201257.300905:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201257.300910:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715289728:0@lo:400:kworker.0 00000100:00100000:3.0:1788201257.300931:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201257.300959:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715289728 00000100:00100000:3.0:1788201257.300964:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715289728 00000100:00100000:3.0:1788201257.300997:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2915 00000100:00100000:3.0:1788201257.301003:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715289728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201257.301062:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715289728:12345-0@lo:400:kworker.0 Request processed in 58us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201257.301068:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2915 00000100:00100000:3.0:1788201257.301089:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715289856 00000100:00100000:3.0:1788201257.301093:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715289856 00000100:00100000:2.0:1788201257.301258:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1526 00000100:00100000:2.0:1788201257.301268:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715289856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201257.301318:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715289856:12345-0@lo:400:kworker.0 Request processed in 52us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201257.301324:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1526 00000100:00080000:3.0:1788201257.301516:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201257.301547:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715289728:0@lo:400:kworker.0 00000100:00100000:3.0:1788201257.301559:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715289856:0@lo:400:kworker.0 00010000:00010000:1.0:1788201257.745168:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201257.810404:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715290368:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201257.810478:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201257.810522:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201257.810541:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715290496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201257.810568:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201257.810608:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715290496 00000100:00100000:2.0:1788201257.810616:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715290496 00000100:00100000:2.0:1788201257.810666:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2366 00000100:00100000:2.0:1788201257.810676:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715290496:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201257.810688:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715290368 00000100:00100000:1.0:1788201257.810693:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715290368 00002000:00000024:2.0:1788201257.810706:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201257.810720:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4107 00000100:00100000:1.0:1788201257.810726:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715290368:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201257.810750:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715290496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (181us total) trans 0 rc 0/0 00000004:00000024:1.0:1788201257.810753:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:2.0:1788201257.810757:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2366 00000100:00100000:1.0:1788201257.810786:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715290368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201257.810792:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4107 00000100:00100000:2.0:1788201257.810807:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715290496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201257.810821:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715290368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201257.944108:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201257.944205:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201257.944287:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201257.944315:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201257.944340:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201257.946959:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695486464 00000100:00100000:3.0:1788201257.946976:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695486464 00000100:00100000:3.0:1788201257.947066:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 186 00000100:00100000:3.0:1788201257.947078:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695486464:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201257.947170:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695486464:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 94us (2964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201257.947178:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 186 00000100:00100000:3.0:1788201257.947220:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695486720 00000100:00100000:3.0:1788201257.947224:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695486720 00000100:00100000:3.0:1788201257.947265:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695486592 00000100:00100000:3.0:1788201257.947268:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695486592 00000100:00100000:3.0:1788201257.947289:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1527 00000100:00100000:3.0:1788201257.947297:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695486720:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201257.947330:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695486720:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 34us (3043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201257.947336:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1527 00000100:00100000:3.0:1788201257.947349:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1528 00000100:00100000:3.0:1788201257.947355:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2403:x1875060695486592:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201257.947381:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2403:x1875060695486592:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (3067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201257.947387:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1528 00000100:00080000:3.0:1788201257.947406:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201257.948052:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695486848 00000100:00100000:2.0:1788201257.948059:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695486848 00000100:00100000:2.0:1788201257.948101:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695486976 00000100:00100000:2.0:1788201257.948105:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695486976 00000100:00100000:2.0:1788201257.948141:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2916 00000100:00100000:2.0:1788201257.948149:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695486976:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201257.948186:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695486976:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 39us (3845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201257.948192:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2916 00000100:00100000:2.0:1788201257.948207:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5980 00000100:00100000:2.0:1788201257.948211:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2399:x1875060695486848:12345-192.168.201.20@tcp:8:kworker.0 00010000:00020000:2.0:1788201257.948242:0:26209:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201257.948269:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2399:x1875060695486848:12345-192.168.201.20@tcp:8:kworker.0 Request processed in 56us (4257us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201257.948276:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5980 00000100:00080000:3.0:1788201257.951115:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201257.951120:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788201258.768139:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201258.855216:0:96438:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing load_module ../libcfs/libcfs/libcfs 00010000:00010000:3.0:1788201259.793240:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201260.374980:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201260.375005:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715290624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201260.375106:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201260.375429:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715290624 00000100:00100000:2.0:1788201260.375438:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715290624 00000100:00100000:2.0:1788201260.375512:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2367 00000100:00100000:2.0:1788201260.375524:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715290624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201260.375554:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201260.375600:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715290624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201260.375608:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2367 00000100:00080000:3.0:1788201260.375664:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201260.375734:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715290624:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788201260.816142:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201261.839247:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1788201262.415522:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201262.415537:0:57134:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000100:00000040:2.0:1788201262.415567:0:57134:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging c9b18af6-fecc-4172-82c2-66531890fe11->MGS req@ffff8dc005256d80 x1875060715290752/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201262.415583:0:57134:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ad8fc85c] to pc [ptlrpcd_00_01+1] req@ffff8dc005256d80 x1875060715290752/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201262.415623:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201262.415629:0:57134:0:(genops.c:1210:class_import_get()) import ffff8dc0034f0000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1788201262.415637:0:57134:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff8dc001e40e00 x1875060715290880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201262.415647:0:57134:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003c7ba146] to pc [ptlrpcd_00_02+2] req@ffff8dc001e40e00 x1875060715290880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201262.415671:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201262.415676:0:57134:0:(genops.c:1210:class_import_get()) import ffff8dc0034f2000 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1788201262.415684:0:57134:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff8dc001e40000 x1875060715291008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201262.415693:0:57134:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006d5b56a8] to pc [ptlrpcd_00_03+3] req@ffff8dc001e40000 x1875060715291008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201262.415701:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201262.415705:0:57134:0:(genops.c:1210:class_import_get()) import ffff8dc109813800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1788201262.415712:0:57134:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff8dc001e42300 x1875060715291136/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201262.415719:0:57134:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d1918006] to pc [ptlrpcd_00_00+0] req@ffff8dc001e42300 x1875060715291136/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201262.415727:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201262.415731:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788201262.415734:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201262.415739:0:57134:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 4108 00000100:00080000:2.0:1788201262.415744:0:57134:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00000040:2.0:1788201262.415747:0:57134:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 50 to 0@lo 00000100:00000040:2.0:1788201262.415750:0:57134:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000020:00000040:2.0:1788201262.415753:0:57134:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a163b3 00000020:00000040:2.0:1788201262.415757:0:57134:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc12f3a2800 refcount=4 00000100:00000040:2.0:1788201262.415760:0:57134:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 50 to 0@lo 00000100:00000040:2.0:1788201262.415763:0:57134:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000020:00000040:2.0:1788201262.415766:0:57134:0:(genops.c:879:class_export_put()) PUTting export ffff8dc12f3a2800 : new refcount 3 00000100:00080000:2.0:1788201262.415769:0:57134:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8dc006d84000 using connection 192.168.201.120@tcp/0@lo 00000020:00000040:2.0:1788201262.415785:0:57134:0:(genops.c:1210:class_import_get()) import ffff8dc006d84000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:2.0:1788201262.415796:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc001e43480 x1875060715291264/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201262.415804:0:57134:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000505111d2] to pc [ptlrpcd_rcv+-1] req@ffff8dc001e43480 x1875060715291264/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201262.415815:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201262.415820:0:57134:0:(genops.c:1210:class_import_get()) import ffff8dc1031f8800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1788201262.415826:0:57134:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff8dc133330000 x1875060715291392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201262.415834:0:57134:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000038f19d98] to pc [ptlrpcd_00_01+1] req@ffff8dc133330000 x1875060715291392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201262.415842:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201262.415846:0:57134:0:(genops.c:1210:class_import_get()) import ffff8dc001db0000 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1788201262.415852:0:57134:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff8dc133332680 x1875060715291520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201262.415861:0:57134:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000670611f4] to pc [ptlrpcd_00_02+2] req@ffff8dc133332680 x1875060715291520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201262.415867:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201262.415872:0:57134:0:(genops.c:1210:class_import_get()) import ffff8dc104281000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1788201262.415878:0:57134:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff8dc133331880 x1875060715291648/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201262.415887:0:57134:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004ee4197b] to pc [ptlrpcd_00_03+3] req@ffff8dc133331880 x1875060715291648/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201262.415895:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201262.415903:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788201262.415905:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201262.415909:0:57134:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 4108 00000100:00080000:2.0:1788201262.415911:0:57134:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00000040:2.0:1788201262.415914:0:57134:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 50 to 0@lo 00000100:00000040:2.0:1788201262.415916:0:57134:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000020:00000040:2.0:1788201262.415918:0:57134:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c597 00000020:00000040:2.0:1788201262.415921:0:57134:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc005d70800 refcount=4 00000100:00000040:2.0:1788201262.415924:0:57134:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 50 to 0@lo 00000100:00000040:2.0:1788201262.415926:0:57134:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000020:00000040:2.0:1788201262.415929:0:57134:0:(genops.c:879:class_export_put()) PUTting export ffff8dc005d70800 : new refcount 3 00000100:00080000:2.0:1788201262.415931:0:57134:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dc109815000 using connection 192.168.201.120@tcp/0@lo 00000020:00000040:2.0:1788201262.415937:0:57134:0:(genops.c:1210:class_import_get()) import ffff8dc109815000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:2.0:1788201262.415944:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc133331500 x1875060715291776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201262.415954:0:57134:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c3d85cdf] to pc [ptlrpcd_rcv+-1] req@ffff8dc133331500 x1875060715291776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201262.415962:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201262.415967:0:57134:0:(genops.c:1210:class_import_get()) import ffff8dc1257f0800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1788201262.415973:0:57134:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff8dc12fb0ed80 x1875060715291904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201262.415980:0:57134:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004e9eb435] to pc [ptlrpcd_00_00+0] req@ffff8dc12fb0ed80 x1875060715291904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201262.415986:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201262.415991:0:57134:0:(genops.c:1210:class_import_get()) import ffff8dc137d33000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1788201262.415996:0:57134:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff8dc12fb0ca80 x1875060715292032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201262.416010:0:57134:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000030bf40] to pc [ptlrpcd_00_01+1] req@ffff8dc12fb0ca80 x1875060715292032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201262.416148:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc001e42300 x1875060715291136/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201262.416163:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715291136:0@lo:400:kworker.0 00000100:00000040:0.0:1788201262.416192:0:3655:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc001e42300 x1875060715291136/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201278 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201262.416200:0:3655:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201262.416238:0:3655:0:(events.c:337:request_in_callback()) incoming req@ffff8dc120092d80 x1875060715291136 msgsize 224 00000100:00100000:0.0:1788201262.416243:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788201262.416267:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc001e42300 x1875060715291136/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201278 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201262.416280:0:3655:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1335355 usecs (1336 jiffies) 00000100:00000040:0.0:1788201262.416289:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc12fb0ed80 x1875060715291904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201262.416298:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715291904:0@lo:400:kworker.0 00000100:00000040:0.0:1788201262.416308:0:3655:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc12fb0ed80 x1875060715291904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201278 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201262.416314:0:3655:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201262.416327:0:3655:0:(events.c:337:request_in_callback()) incoming req@ffff8dc120091500 x1875060715291904 msgsize 224 00000100:00100000:0.0:1788201262.416331:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788201262.416344:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc12fb0ed80 x1875060715291904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201278 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201262.416353:0:3655:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 7145 usecs (8 jiffies) 00000100:00100000:0.0:1788201262.416366:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00000040:0.0:1788201262.416371:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc005256d80 x1875060715290752/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201262.416379:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715290752:0@lo:400:kworker.0 00000100:00000040:0.0:1788201262.416398:0:3655:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc005256d80 x1875060715290752/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201278 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201262.416488:0:57134:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (4118) 00000100:00000040:2.0:1788201262.416507:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc001e40e00 x1875060715290880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201262.416515:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715290880:0@lo:400:kworker.0 00000100:00000040:2.0:1788201262.416530:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc001e40e00 x1875060715290880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201278 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201262.416537:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201262.416553:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff8dc12fb0d180 x1875060715290880 msgsize 224 00000100:00100000:2.0:1788201262.416556:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201262.416570:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc001e40e00 x1875060715290880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201278 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201262.416578:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8500 usecs (9 jiffies) 00000100:00000040:2.0:1788201262.416583:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc133332680 x1875060715291520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201262.416591:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715291520:0@lo:400:kworker.0 00000100:00000040:2.0:1788201262.416601:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc133332680 x1875060715291520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201278 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201262.416607:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201262.416617:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff8dc12fb0e300 x1875060715291520 msgsize 224 00000100:00100000:2.0:1788201262.416620:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201262.416630:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc133332680 x1875060715291520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201278 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201262.416639:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 85068 usecs (86 jiffies) 00000100:00100000:2.0:1788201262.416647:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00000040:2.0:1788201262.416659:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc001e40000 x1875060715291008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201262.416667:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715291008:0@lo:400:kworker.0 00000100:00000040:2.0:1788201262.416679:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc001e40000 x1875060715291008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201278 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201262.416685:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201262.416698:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff8dc12fb0c700 x1875060715291008 msgsize 224 00000100:00100000:2.0:1788201262.416702:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201262.416712:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc001e40000 x1875060715291008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201278 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201262.416720:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 8656 usecs (9 jiffies) 00000100:00000040:2.0:1788201262.416725:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc133331880 x1875060715291648/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201262.416733:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715291648:0@lo:400:kworker.0 00000100:00000040:2.0:1788201262.416745:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc133331880 x1875060715291648/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201278 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201262.416751:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201262.416761:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff8dc12fb0fb80 x1875060715291648 msgsize 224 00000100:00100000:2.0:1788201262.416765:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201262.416774:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc133331880 x1875060715291648/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201278 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201262.416783:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 3225 usecs (4 jiffies) 00000100:00000040:0.0:1788201262.418152:0:3655:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201262.418195:0:3655:0:(events.c:337:request_in_callback()) incoming req@ffff8dc0072a9050 x1875060715290752 msgsize 224 00000100:00100000:0.0:1788201262.418200:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788201262.418202:0:3655:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1788201262.418227:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc005256d80 x1875060715290752/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201278 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201262.418258:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc133330000 x1875060715291392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201262.418269:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715291392:0@lo:400:kworker.0 00000100:00000040:0.0:1788201262.418289:0:3655:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc133330000 x1875060715291392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201278 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201262.418296:0:3655:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201262.418310:0:3655:0:(events.c:337:request_in_callback()) incoming req@ffff8dc120090a80 x1875060715291392 msgsize 224 00000100:00100000:0.0:1788201262.418314:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788201262.418330:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc133330000 x1875060715291392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201278 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201262.418340:0:3655:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5602 usecs (6 jiffies) 00000100:00100000:0.0:1788201262.418347:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:0.0:1788201262.418359:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc12fb0ca80 x1875060715292032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201262.418368:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715292032:0@lo:400:kworker.0 00000100:00000040:0.0:1788201262.418379:0:3655:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc12fb0ca80 x1875060715292032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201278 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201262.418386:0:3655:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201262.418398:0:3655:0:(events.c:337:request_in_callback()) incoming req@ffff8dc120091c00 x1875060715292032 msgsize 224 00000100:00100000:0.0:1788201262.418407:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788201262.418419:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc12fb0ca80 x1875060715292032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201278 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201262.418430:0:3655:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 5806 usecs (6 jiffies) 00000100:00100000:0.0:1788201262.418467:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715291136 00000100:00100000:0.0:1788201262.418476:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715291136 00000020:00000040:0.0:1788201262.418479:0:83817:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c54a 00000020:00000040:0.0:1788201262.418483:0:83817:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc103486000 refcount=7 00000100:00000040:0.0:1788201262.418503:0:83817:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:0.0:1788201262.418524:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715291648 00000100:00100000:0.0:1788201262.418528:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715291648 00000020:00000040:0.0:1788201262.418530:0:83817:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c582 00000020:00000040:0.0:1788201262.418532:0:83817:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc11d63c000 refcount=5 00000100:00100000:0.0:1788201262.418553:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4108 00000100:00000040:0.0:1788201262.418557:0:83817:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc103486000 : new rpc_count 1 00000100:00000040:0.0:1788201262.418562:0:83817:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc120092d80 x1875060715291136/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:383/0 lens 224/0 e 0 to 0 dl 1788201273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201262.418574:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715291136:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1788201262.418594:0:83817:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1875060715291136 00000100:00000040:0.0:1788201262.418603:0:83817:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:0.0:1788201262.418608:0:83817:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201262.418625:0:83817:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc001e42300 x1875060715291136/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201262.418641:0:83817:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:0.0:1788201262.418646:0:83817:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc120092d80 x1875060715291136/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:383/0 lens 224/224 e 0 to 0 dl 1788201273 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201262.418653:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715291136:12345-0@lo:400:kworker.0 Request processed in 81us (2414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201262.418660:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4108 00000100:00000040:0.0:1788201262.418668:0:83817:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc103486000 : new rpc_count 0 00000020:00000040:0.0:1788201262.418677:0:83817:0:(genops.c:879:class_export_put()) PUTting export ffff8dc103486000 : new refcount 6 00000100:00100000:0.0:1788201262.418687:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4109 00000100:00000040:0.0:1788201262.418690:0:83817:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc11d63c000 : new rpc_count 1 00000100:00000040:0.0:1788201262.418693:0:83817:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc12fb0fb80 x1875060715291648/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:383/0 lens 224/0 e 0 to 0 dl 1788201273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201262.418703:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715291648:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1788201262.418712:0:83817:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715291648 00000100:00000040:0.0:1788201262.418716:0:83817:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:0.0:1788201262.418719:0:83817:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201262.418734:0:83817:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc133331880 x1875060715291648/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201262.418753:0:83817:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:0.0:1788201262.418757:0:83817:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12fb0fb80 x1875060715291648/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:383/0 lens 224/224 e 0 to 0 dl 1788201273 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201262.418766:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715291648:12345-0@lo:400:kworker.0 Request processed in 64us (2003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201262.418771:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4109 00000100:00000040:0.0:1788201262.418773:0:83817:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc11d63c000 : new rpc_count 0 00000020:00000040:0.0:1788201262.418779:0:83817:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11d63c000 : new refcount 4 00000100:00100000:0.0:1788201262.418794:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715291904 00000100:00100000:0.0:1788201262.418797:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715291904 00000020:00000040:0.0:1788201262.418799:0:26200:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c5ba 00000020:00000040:0.0:1788201262.418801:0:26200:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc0059d1800 refcount=5 00000020:00000040:0.0:1788201262.418810:0:26200:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff8dc139bbcd28) now 10 - evictor 00000100:00000040:0.0:1788201262.418825:0:26200:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:0.0:1788201262.418840:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715291392 00000100:00100000:0.0:1788201262.418843:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715291392 00000020:00000040:0.0:1788201262.418844:0:26200:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a163d6 00000020:00000040:0.0:1788201262.418852:0:26200:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1201ce800 refcount=5 00000100:00100000:0.0:1788201262.418877:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2917 00000100:00000040:0.0:1788201262.418880:0:26200:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc0059d1800 : new rpc_count 1 00000100:00000040:0.0:1788201262.418884:0:26200:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc120091500 x1875060715291904/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:383/0 lens 224/0 e 0 to 0 dl 1788201273 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201262.418894:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715291904:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1788201262.418904:0:26200:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969457, transno 0, xid 1875060715291904 00000100:00000040:0.0:1788201262.418908:0:26200:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:0.0:1788201262.418912:0:26200:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201262.418929:0:26200:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc12fb0ed80 x1875060715291904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201262.418942:0:26200:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:0.0:1788201262.418946:0:26200:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc120091500 x1875060715291904/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:383/0 lens 224/224 e 0 to 0 dl 1788201273 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201262.418953:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715291904:12345-0@lo:400:kworker.0 Request processed in 60us (2624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201262.418957:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2917 00000100:00000040:0.0:1788201262.418959:0:26200:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc0059d1800 : new rpc_count 0 00000020:00000040:0.0:1788201262.418965:0:26200:0:(genops.c:879:class_export_put()) PUTting export ffff8dc0059d1800 : new refcount 4 00000100:00100000:0.0:1788201262.418973:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2918 00000100:00000040:0.0:1788201262.418976:0:26200:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1201ce800 : new rpc_count 1 00000100:00000040:0.0:1788201262.418979:0:26200:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc120090a80 x1875060715291392/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:383/0 lens 224/0 e 0 to 0 dl 1788201273 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201262.418989:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715291392:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1788201262.418997:0:26200:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969442, transno 0, xid 1875060715291392 00000100:00000040:0.0:1788201262.419002:0:26200:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:0.0:1788201262.419011:0:26200:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201262.419055:0:26200:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc133330000 x1875060715291392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201262.419067:0:26200:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:0.0:1788201262.419072:0:26200:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc120090a80 x1875060715291392/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:383/0 lens 224/224 e 0 to 0 dl 1788201273 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201262.419080:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715291392:12345-0@lo:400:kworker.0 Request processed in 93us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201262.419085:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2918 00000100:00000040:0.0:1788201262.419087:0:26200:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1201ce800 : new rpc_count 0 00000020:00000040:0.0:1788201262.419093:0:26200:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1201ce800 : new refcount 4 00000100:00100000:0.0:1788201262.419110:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715290752 00000100:00100000:0.0:1788201262.419113:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715290752 00000020:00000040:0.0:1788201262.419115:0:94461:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:0.0:1788201262.419118:0:94461:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=21 00000100:00000040:0.0:1788201262.419128:0:94461:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788201262.419148:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00000040:0.0:1788201262.419150:0:94461:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:0.0:1788201262.419155:0:94461:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc0072a9050 x1875060715290752/t0(0) o400->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:383/0 lens 224/0 e 0 to 0 dl 1788201273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201262.419166:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:3655:x1875060715290752:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1788201262.419175:0:94461:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715290752 00000100:00000040:0.0:1788201262.419179:0:94461:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:0.0:1788201262.419182:0:94461:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201262.419197:0:94461:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc005256d80 x1875060715290752/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201262.419209:0:94461:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:0.0:1788201262.419213:0:94461:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc0072a9050 x1875060715290752/t0(0) o400->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:383/0 lens 224/224 e 0 to 0 dl 1788201273 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201262.419226:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:3655:x1875060715290752:12345-0@lo:400:kworker.0 Request processed in 62us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201262.419232:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00000040:0.0:1788201262.419234:0:94461:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:0.0:1788201262.419239:0:94461:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 20 00000100:00080000:0.0:1788201262.419274:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1788201262.419278:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff8dc139bbcd28) now 10 - evictor 00000100:00000040:0.0:1788201262.419315:0:3657:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1788201262.419323:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc133331880 x1875060715291648/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201262.419332:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc133331880 x1875060715291648/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201262.419339:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715291648:0@lo:400:kworker.0 00000100:00000040:0.0:1788201262.419347:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc133331880 x1875060715291648/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788201262.419357:0:3657:0:(genops.c:1223:class_import_put()) import ffff8dc104281000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1788201262.419381:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc005256d80 x1875060715290752/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201262.419389:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005256d80 x1875060715290752/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201262.419395:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715290752:0@lo:400:kworker.0 00000100:00000040:0.0:1788201262.419406:0:3655:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969442 00000100:00000040:0.0:1788201262.419410:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc133330000 x1875060715291392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201262.419431:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc133330000 x1875060715291392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201262.419437:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715291392:0@lo:400:kworker.0 00000100:00000040:0.0:1788201262.419462:0:3655:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:0.0:1788201262.419467:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc001e42300 x1875060715291136/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201262.419475:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc001e42300 x1875060715291136/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201262.419480:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715291136:0@lo:400:kworker.0 00000100:00000040:0.0:1788201262.419491:0:3655:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969457 00000100:00000040:0.0:1788201262.419495:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc12fb0ed80 x1875060715291904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201262.419501:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12fb0ed80 x1875060715291904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201262.419507:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715291904:0@lo:400:kworker.0 00000100:00000040:0.0:1788201262.419511:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc005256d80 x1875060715290752/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788201262.419518:0:3655:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 00000100:00000040:0.0:1788201262.419524:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc133330000 x1875060715291392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788201262.419530:0:3655:0:(genops.c:1223:class_import_put()) import ffff8dc1031f8800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1788201262.419534:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc001e42300 x1875060715291136/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788201262.419553:0:3655:0:(genops.c:1223:class_import_put()) import ffff8dc109813800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1788201262.419559:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc12fb0ed80 x1875060715291904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788201262.419565:0:3655:0:(genops.c:1223:class_import_put()) import ffff8dc1257f0800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1788201262.419699:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc001e43480 x1875060715291264/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201262.419710:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715291264:0@lo:8:kworker.0 00000100:00000040:3.0:1788201262.419728:0:3654:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc001e43480 x1875060715291264/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788201282 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201262.419735:0:3654:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201262.419751:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005abd500 x1875060715291264 msgsize 520 00000100:00100000:3.0:1788201262.419755:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201262.419771:0:3654:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc001e43480 x1875060715291264/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788201282 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201262.419780:0:3654:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 6036 usecs (7 jiffies) 00000100:00000040:3.0:1788201262.419788:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc133331500 x1875060715291776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201262.419795:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715291776:0@lo:8:kworker.0 00000100:00000040:3.0:1788201262.419807:0:3654:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc133331500 x1875060715291776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788201282 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201262.419813:0:3654:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201262.419824:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005abe300 x1875060715291776 msgsize 520 00000100:00100000:3.0:1788201262.419828:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201262.419839:0:3654:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc133331500 x1875060715291776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788201282 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201262.419848:0:3654:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 6812 usecs (7 jiffies) 00000100:00100000:3.0:1788201262.419869:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715290880 00000100:00100000:3.0:1788201262.419874:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715290880 00000020:00000040:3.0:1788201262.419881:0:66312:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c6d2 00000020:00000040:3.0:1788201262.419884:0:66312:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc11cdda800 refcount=5 00000020:00000040:3.0:1788201262.419891:0:66312:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff8dc13f870000) now 14 - evictor 00000100:00000040:3.0:1788201262.419908:0:66312:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:3.0:1788201262.419925:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715291520 00000100:00100000:3.0:1788201262.419928:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715291520 00000020:00000040:3.0:1788201262.419930:0:66312:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c6d9 00000020:00000040:3.0:1788201262.419932:0:66312:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc11d63e800 refcount=5 00000100:00100000:3.0:1788201262.419945:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715291008 00000100:00100000:3.0:1788201262.419948:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715291008 00000020:00000040:3.0:1788201262.419949:0:66312:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1644d 00000020:00000040:3.0:1788201262.419952:0:66312:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc10558f000 refcount=5 00000020:00000040:3.0:1788201262.419957:0:66312:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff8dc1060e4d28) now 10 - evictor 00000100:00100000:3.0:1788201262.419967:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715292032 00000100:00100000:3.0:1788201262.419969:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715292032 00000020:00000040:3.0:1788201262.419971:0:66312:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c6e0 00000020:00000040:3.0:1788201262.419973:0:66312:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc137d37000 refcount=5 00000100:00100000:3.0:1788201262.419985:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1529 00000100:00000040:3.0:1788201262.419988:0:66312:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc11cdda800 : new rpc_count 1 00000100:00000040:3.0:1788201262.419992:0:66312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc12fb0d180 x1875060715290880/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:383/0 lens 224/0 e 0 to 0 dl 1788201273 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201262.420003:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715290880:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1788201262.420031:0:66312:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715290880 00000100:00000040:3.0:1788201262.420036:0:66312:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:3.0:1788201262.420040:0:66312:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201262.420056:0:66312:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc001e40e00 x1875060715290880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201262.420075:0:66312:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:3.0:1788201262.420080:0:66312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12fb0d180 x1875060715290880/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:383/0 lens 224/224 e 0 to 0 dl 1788201273 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201262.420099:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715290880:12345-0@lo:400:kworker.0 Request processed in 97us (3544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201262.420105:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1529 00000100:00000040:3.0:1788201262.420107:0:66312:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc11cdda800 : new rpc_count 0 00000020:00000040:3.0:1788201262.420116:0:66312:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11cdda800 : new refcount 4 00000100:00100000:3.0:1788201262.420125:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1530 00000100:00000040:3.0:1788201262.420127:0:66312:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc11d63e800 : new rpc_count 1 00000100:00000040:3.0:1788201262.420131:0:66312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc12fb0e300 x1875060715291520/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:383/0 lens 224/0 e 0 to 0 dl 1788201273 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201262.420141:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715291520:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1788201262.420151:0:66312:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715291520 00000100:00000040:3.0:1788201262.420155:0:66312:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:3.0:1788201262.420158:0:66312:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201262.420175:0:66312:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc133332680 x1875060715291520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201262.420186:0:66312:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:3.0:1788201262.420190:0:66312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12fb0e300 x1875060715291520/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:383/0 lens 224/224 e 0 to 0 dl 1788201273 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201262.420197:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715291520:12345-0@lo:400:kworker.0 Request processed in 59us (3579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201262.420203:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1530 00000100:00000040:3.0:1788201262.420204:0:66312:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc11d63e800 : new rpc_count 0 00000020:00000040:3.0:1788201262.420210:0:66312:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11d63e800 : new refcount 4 00000100:00100000:3.0:1788201262.420218:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1531 00000100:00000040:3.0:1788201262.420220:0:66312:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc10558f000 : new rpc_count 1 00000100:00000040:3.0:1788201262.420224:0:66312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc12fb0c700 x1875060715291008/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:383/0 lens 224/0 e 0 to 0 dl 1788201273 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201262.420239:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715291008:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1788201262.420248:0:66312:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715291008 00000100:00000040:3.0:1788201262.420253:0:66312:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:3.0:1788201262.420256:0:66312:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201262.420270:0:66312:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc001e40000 x1875060715291008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201262.420282:0:66312:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:3.0:1788201262.420286:0:66312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12fb0c700 x1875060715291008/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:383/0 lens 224/224 e 0 to 0 dl 1788201273 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201262.420293:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715291008:12345-0@lo:400:kworker.0 Request processed in 57us (3594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201262.420299:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1531 00000100:00000040:3.0:1788201262.420301:0:66312:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc10558f000 : new rpc_count 0 00000020:00000040:3.0:1788201262.420307:0:66312:0:(genops.c:879:class_export_put()) PUTting export ffff8dc10558f000 : new refcount 4 00000100:00100000:3.0:1788201262.420315:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1532 00000100:00000040:3.0:1788201262.420317:0:66312:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc137d37000 : new rpc_count 1 00000100:00000040:3.0:1788201262.420321:0:66312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc120091c00 x1875060715292032/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:383/0 lens 224/0 e 0 to 0 dl 1788201273 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201262.420331:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715292032:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1788201262.420340:0:66312:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715292032 00000100:00000040:3.0:1788201262.420344:0:66312:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:3.0:1788201262.420346:0:66312:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201262.420359:0:66312:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc12fb0ca80 x1875060715292032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201262.420376:0:66312:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:3.0:1788201262.420385:0:66312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc120091c00 x1875060715292032/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:383/0 lens 224/224 e 0 to 0 dl 1788201273 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201262.420393:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715292032:12345-0@lo:400:kworker.0 Request processed in 63us (1993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201262.420399:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1532 00000100:00000040:3.0:1788201262.420401:0:66312:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc137d37000 : new rpc_count 0 00000020:00000040:3.0:1788201262.420407:0:66312:0:(genops.c:879:class_export_put()) PUTting export ffff8dc137d37000 : new refcount 4 00000100:00100000:3.0:1788201262.420433:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715291264 00000100:00100000:3.0:1788201262.420437:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715291264 00000020:00000040:3.0:1788201262.420438:0:26208:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a163c8 00000100:00100000:3.0:1788201262.420468:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715291776 00000100:00100000:3.0:1788201262.420471:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715291776 00000020:00000040:3.0:1788201262.420473:0:26208:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c5ac 00000100:00100000:3.0:1788201262.420489:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5981 00000100:00000040:3.0:1788201262.420493:0:26208:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005abd500 x1875060715291264/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788201282 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201262.420501:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3654:x1875060715291264:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788201262.420518:0:26208:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:3.0:1788201262.420527:0:26208:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:3.0:1788201262.420529:0:26208:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:3.0:1788201262.420532:0:26208:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201262.420547:0:26208:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff8dc001e43480 x1875060715291264/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788201282 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201262.420563:0:26208:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:3.0:1788201262.420567:0:26208:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005abd500 x1875060715291264/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788201282 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201262.420575:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3654:x1875060715291264:12345-0@lo:8:kworker.0 Request processed in 73us (822us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201262.420588:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5981 00000100:00100000:3.0:1788201262.420600:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5982 00000100:00000040:3.0:1788201262.420604:0:26208:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005abe300 x1875060715291776/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788201282 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201262.420611:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3654:x1875060715291776:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788201262.420621:0:26208:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:3.0:1788201262.420627:0:26208:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:3.0:1788201262.420630:0:26208:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:3.0:1788201262.420633:0:26208:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201262.420647:0:26208:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff8dc133331500 x1875060715291776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788201282 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201262.420658:0:26208:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:3.0:1788201262.420661:0:26208:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005abe300 x1875060715291776/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788201282 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201262.420669:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3654:x1875060715291776:12345-0@lo:8:kworker.0 Request processed in 57us (843us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201262.420675:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5982 00000100:00080000:3.0:1788201262.420700:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:3.0:1788201262.420703:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001 (ffff8dc1060e4d28) now 10 - evictor 00000100:00080000:3.0:1788201262.420706:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:3.0:1788201262.420708:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (ffff8dc13f870000) now 14 - evictor 00000100:00000040:3.0:1788201262.420727:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc001e43480 x1875060715291264/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788201282 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201262.420736:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201262.420740:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:3.0:1788201262.420744:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc001e43480 x1875060715291264/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788201282 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201262.420757:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715291264:0@lo:8:kworker.0 00000100:00000040:3.0:1788201262.420769:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc133331500 x1875060715291776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788201282 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201262.420775:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201262.420778:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:3.0:1788201262.420781:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc133331500 x1875060715291776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788201282 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201262.420787:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715291776:0@lo:8:kworker.0 00000100:00000040:3.0:1788201262.420793:0:3654:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc001e43480 x1875060715291264/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788201282 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201262.420802:0:3654:0:(genops.c:1223:class_import_put()) import ffff8dc006d84000 refcount=2 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1788201262.420809:0:3654:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc133331500 x1875060715291776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788201282 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201262.420816:0:3654:0:(genops.c:1223:class_import_put()) import ffff8dc109815000 refcount=2 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1788201262.420837:0:3657:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:3.0:1788201262.420842:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc001e40000 x1875060715291008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201262.420850:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc001e40000 x1875060715291008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201262.420856:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715291008:0@lo:400:kworker.0 00000100:00000040:3.0:1788201262.420866:0:3657:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:3.0:1788201262.420870:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc001e40e00 x1875060715290880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201262.420891:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc001e40e00 x1875060715290880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201262.420898:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715290880:0@lo:400:kworker.0 00000100:00000040:3.0:1788201262.420910:0:3657:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:3.0:1788201262.420914:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc133332680 x1875060715291520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201262.420920:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc133332680 x1875060715291520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201262.420926:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715291520:0@lo:400:kworker.0 00000100:00000040:3.0:1788201262.420931:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc001e40000 x1875060715291008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201262.420939:0:3657:0:(genops.c:1223:class_import_put()) import ffff8dc0034f2000 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:3.0:1788201262.420944:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc001e40e00 x1875060715290880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201262.420952:0:3657:0:(genops.c:1223:class_import_put()) import ffff8dc0034f0000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:3.0:1788201262.420960:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc133332680 x1875060715291520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201262.420967:0:3657:0:(genops.c:1223:class_import_put()) import ffff8dc001db0000 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:3.0:1788201262.420986:0:3655:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:3.0:1788201262.420992:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc12fb0ca80 x1875060715292032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201262.421000:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12fb0ca80 x1875060715292032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201262.421006:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715292032:0@lo:400:kworker.0 00000100:00000040:3.0:1788201262.421038:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc12fb0ca80 x1875060715292032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201262.421046:0:3655:0:(genops.c:1223:class_import_put()) import ffff8dc137d33000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000020:00000040:2.0:1788201262.422602:0:94473:0:(genops.c:1210:class_import_get()) import ffff8dc104281000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1788201262.422637:0:94473:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000030bf40] to pc [ptlrpcd_00_02+2] req@ffff8dc12fb0ca80 x1875060715292160/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201262.422719:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:0.0:1788201262.422733:0:3658:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc12fb0ca80 x1875060715292160/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201262.422746:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715292160:0@lo:41:osp-pre-1-0.0 00000100:00000040:0.0:1788201262.422774:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc12fb0ca80 x1875060715292160/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201278 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201262.422782:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201262.422814:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff8dc120091f80 x1875060715292160 msgsize 224 00000100:00100000:0.0:1788201262.422819:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788201262.422848:0:3658:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc12fb0ca80 x1875060715292160/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201278 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201262.422861:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 3265 usecs (4 jiffies) 00000100:00100000:2.0:1788201262.422986:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715292160 00000100:00100000:2.0:1788201262.422993:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715292160 00000020:00000040:2.0:1788201262.423003:0:83817:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c582 00000020:00000040:2.0:1788201262.423007:0:83817:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc11d63c000 refcount=5 00000100:00000040:2.0:1788201262.423051:0:83817:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1788201262.423079:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4110 00000100:00000040:2.0:1788201262.423083:0:83817:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc11d63c000 : new rpc_count 1 00000100:00000040:2.0:1788201262.423088:0:83817:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc120091f80 x1875060715292160/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:383/0 lens 224/0 e 0 to 0 dl 1788201273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201262.423100:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715292160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201262.423130:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00010000:00000040:2.0:1788201262.423141:0:83817:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715292160 00000100:00000040:2.0:1788201262.423149:0:83817:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:2.0:1788201262.423154:0:83817:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201262.423172:0:83817:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8dc12fb0ca80 x1875060715292160/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201278 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201262.423190:0:83817:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:2.0:1788201262.423195:0:83817:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc120091f80 x1875060715292160/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:383/0 lens 224/368 e 0 to 0 dl 1788201273 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201262.423203:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715292160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201262.423210:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4110 00000100:00000040:2.0:1788201262.423213:0:83817:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc11d63c000 : new rpc_count 0 00000020:00000040:2.0:1788201262.423222:0:83817:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11d63c000 : new refcount 4 00000100:00000040:0.0:1788201262.423306:0:3658:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1788201262.423313:0:3658:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc12fb0ca80 x1875060715292160/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1788201262.423324:0:3658:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352879 avail=317176 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023680 state=0: rc = 0 00000100:00000040:0.0:1788201262.423331:0:3658:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12fb0ca80 x1875060715292160/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201278 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201262.423338:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715292160:0@lo:41:osp-pre-1-0.0 00000100:00000040:0.0:1788201262.423343:0:3658:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc12fb0ca80 x1875060715292160/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201278 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788201262.423363:0:3658:0:(genops.c:1223:class_import_put()) import ffff8dc104281000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00010000:00010000:3.0:1788201262.868662:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:2.0:1788201262.927101:0:94477:0:(genops.c:1210:class_import_get()) import ffff8dc1257f0800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1788201262.927146:0:94477:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004e9eb435] to pc [ptlrpcd_00_03+3] req@ffff8dc12fb0ed80 x1875060715292288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201262.927290:0:3658:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc12fb0ed80 x1875060715292288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201262.927304:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715292288:0@lo:13:osp-pre-1-0.0 00000100:00000040:3.0:1788201262.927338:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc12fb0ed80 x1875060715292288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201278 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201262.927347:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:1.0:1788201262.927362:0:75746:0:(genops.c:1210:class_import_get()) import ffff8dc109813800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1788201262.927380:0:75746:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000000780173] to pc [ptlrpcd_00_00+0] req@ffff8dc003a73b80 x1875060715292416/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201262.927389:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005abed80 x1875060715292288 msgsize 224 00000100:00100000:3.0:1788201262.927394:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201262.927519:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc003a73b80 x1875060715292416/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201262.927547:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715292416:0@lo:41:osp-pre-0-1.0 00000100:00000040:2.0:1788201262.927562:0:3655:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc003a73b80 x1875060715292416/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201278 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201262.927569:0:3655:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201262.927601:0:3658:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc12fb0ed80 x1875060715292288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201278 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201262.930711:0:3655:0:(events.c:337:request_in_callback()) incoming req@ffff8dc12fb0ca80 x1875060715292416 msgsize 224 00000100:00100000:2.0:1788201262.930725:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201262.930762:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc003a73b80 x1875060715292416/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201278 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201262.930778:0:3655:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1331637 usecs (1332 jiffies) 00000100:00100000:2.0:1788201262.930822:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715292288 00000100:00100000:2.0:1788201262.930831:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715292288 00000020:00000040:2.0:1788201262.930834:0:8451:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c5ba 00000100:00100000:1.0:1788201262.930838:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715292416 00000020:00000040:2.0:1788201262.930839:0:8451:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc0059d1800 refcount=5 00000100:00100000:1.0:1788201262.930841:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715292416 00000020:00000040:1.0:1788201262.930843:0:8458:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c54a 00000020:00000040:1.0:1788201262.930845:0:8458:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc103486000 refcount=7 00000100:00000040:1.0:1788201262.930864:0:8458:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00000040:2.0:1788201262.930864:0:8451:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:1.0:1788201262.930890:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4111 00000100:00100000:2.0:1788201262.930890:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2368 00000100:00000040:1.0:1788201262.930895:0:8458:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc103486000 : new rpc_count 1 00000100:00000040:2.0:1788201262.930895:0:8451:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc0059d1800 : new rpc_count 1 00000100:00000040:1.0:1788201262.930901:0:8458:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc12fb0ca80 x1875060715292416/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:383/0 lens 224/0 e 0 to 0 dl 1788201273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201262.930901:0:8451:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005abed80 x1875060715292288/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:383/0 lens 224/0 e 0 to 0 dl 1788201273 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201262.930913:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715292288:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201262.930920:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715292416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201262.930945:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00002000:00000024:2.0:1788201262.930945:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00010000:00000040:1.0:1788201262.930956:0:8458:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1875060715292416 00010000:00000040:2.0:1788201262.930956:0:8451:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969457, transno 0, xid 1875060715292288 00000100:00000040:1.0:1788201262.930965:0:8458:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 53 to 0@lo 00000100:00000040:2.0:1788201262.930965:0:8451:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 53 to 0@lo 00000100:00000040:1.0:1788201262.930971:0:8458:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201262.930971:0:8451:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201262.930994:0:8458:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8dc003a73b80 x1875060715292416/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201278 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201262.930994:0:8451:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8dc12fb0ed80 x1875060715292288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201278 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201262.931010:0:8451:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:1.0:1788201262.931012:0:8458:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:2.0:1788201262.931036:0:8451:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005abed80 x1875060715292288/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:383/0 lens 224/368 e 0 to 0 dl 1788201273 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201262.931039:0:8458:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12fb0ca80 x1875060715292416/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:383/0 lens 224/368 e 0 to 0 dl 1788201273 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201262.931049:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715292416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201262.931049:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715292288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (3658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201262.931056:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4111 00000100:00100000:2.0:1788201262.931056:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2368 00000100:00000040:1.0:1788201262.931059:0:8458:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc103486000 : new rpc_count 0 00000100:00000040:2.0:1788201262.931059:0:8451:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc0059d1800 : new rpc_count 0 00000020:00000040:1.0:1788201262.931069:0:8458:0:(genops.c:879:class_export_put()) PUTting export ffff8dc103486000 : new refcount 6 00000020:00000040:2.0:1788201262.931069:0:8451:0:(genops.c:879:class_export_put()) PUTting export ffff8dc0059d1800 : new refcount 4 00000100:00000040:1.0:1788201262.931110:0:3655:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:1.0:1788201262.931116:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc003a73b80 x1875060715292416/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1788201262.931127:0:3655:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352767 avail=317064 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023575 state=0: rc = 0 00000100:00000040:1.0:1788201262.931135:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc003a73b80 x1875060715292416/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201278 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201262.931142:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715292416:0@lo:41:osp-pre-0-1.0 00000100:00000040:1.0:1788201262.931148:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc003a73b80 x1875060715292416/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201278 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201262.931167:0:3655:0:(genops.c:1223:class_import_put()) import ffff8dc109813800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1788201262.931299:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 7041 usecs (8 jiffies) 00000100:00000040:3.0:1788201262.931317:0:3658:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969457 00000100:00000040:3.0:1788201262.931323:0:3658:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc12fb0ed80 x1875060715292288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1788201262.931330:0:3658:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:3.0:1788201262.931332:0:3658:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261731 state=0: rc = 0 00000100:00000040:3.0:1788201262.931339:0:3658:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12fb0ed80 x1875060715292288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201278 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201262.931345:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715292288:0@lo:13:osp-pre-1-0.0 00000100:00000040:3.0:1788201262.931350:0:3658:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc12fb0ed80 x1875060715292288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201278 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201262.931370:0:3658:0:(genops.c:1223:class_import_put()) import ffff8dc1257f0800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1788201263.061905:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff8dc003a73b80 x1875060695487232 msgsize 224 00000100:00100000:1.0:1788201263.061927:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00000040:1.0:1788201263.065860:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff8dc003a73800 x1875060695487616 msgsize 224 00000100:00100000:1.0:1788201263.065883:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00000040:1.0:1788201263.065944:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff8dc0072a8450 x1875060695487104 msgsize 224 00000100:00100000:1.0:1788201263.065949:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00000040:1.0:1788201263.065951:0:3649:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1788201263.065992:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff8dc003a71f80 x1875060695487360 msgsize 224 00000100:00100000:1.0:1788201263.065999:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00000040:1.0:1788201263.066050:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff8dc003a70a80 x1875060695487488 msgsize 520 00000100:00100000:1.0:1788201263.066056:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201263.066117:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695487616 00000100:00100000:1.0:1788201263.066130:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695487616 00000020:00000040:1.0:1788201263.066134:0:26204:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c8e6 00000020:00000040:1.0:1788201263.066141:0:26204:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c6800 refcount=7 00000020:00000040:1.0:1788201263.066161:0:26204:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff8dc139bbcd28) now 10 - evictor 00000100:00000040:1.0:1788201263.066193:0:26204:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1788201263.066221:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695487488 00000100:00100000:1.0:1788201263.066224:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695487488 00000020:00000040:1.0:1788201263.066226:0:26204:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c8df 00000100:00100000:1.0:1788201263.066251:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2919 00000100:00000040:1.0:1788201263.066256:0:26204:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c6800 : new rpc_count 1 00000100:00000040:1.0:1788201263.066266:0:26204:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc003a73800 x1875060695487616/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:384/0 lens 224/0 e 0 to 0 dl 1788201274 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201263.066282:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2402:x1875060695487616:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000040:1.0:1788201263.066311:0:26204:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060695487616 00000100:00000040:1.0:1788201263.066325:0:26204:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 9 to 192.168.201.20@tcp 00000100:00000040:1.0:1788201263.066348:0:26204:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:1.0:1788201263.066401:0:26204:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 8 to 192.168.201.20@tcp 00000100:00000040:1.0:1788201263.066407:0:26204:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc003a73800 x1875060695487616/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:384/0 lens 224/224 e 0 to 0 dl 1788201274 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201263.066416:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2402:x1875060695487616:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 138us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201263.066425:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2919 00000100:00000040:1.0:1788201263.066429:0:26204:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c6800 : new rpc_count 0 00000020:00000040:1.0:1788201263.066459:0:26204:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c6800 : new refcount 6 00000100:00100000:1.0:1788201263.066470:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5983 00000100:00000040:1.0:1788201263.066474:0:26204:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc003a70a80 x1875060695487488/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788201283 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201263.066483:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:2399:x1875060695487488:12345-192.168.201.20@tcp:8:kworker.0 00010000:00020000:1.0:1788201263.066509:0:26204:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:1.0:1788201263.066524:0:26204:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 9 to 192.168.201.20@tcp 00000100:00000040:1.0:1788201263.066528:0:26204:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8dc140da5c80 refcount 9 to 192.168.201.20@tcp 00000100:00000040:1.0:1788201263.066531:0:26204:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:1.0:1788201263.066544:0:26204:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 8 to 192.168.201.20@tcp 00000100:00000040:1.0:1788201263.066548:0:26204:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc003a70a80 x1875060695487488/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201263.066557:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:2399:x1875060695487488:12345-192.168.201.20@tcp:8:kworker.0 Request processed in 73us (505us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201263.066564:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5983 00000100:00100000:1.0:1788201263.066587:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695487104 00000100:00100000:1.0:1788201263.066592:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695487104 00000020:00000040:1.0:1788201263.066594:0:94464:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4cc 00000020:00000040:1.0:1788201263.066597:0:94464:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc13aa9c000 refcount=10 00000100:00000040:1.0:1788201263.066618:0:94464:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788201263.066640:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 188 00000100:00000040:1.0:1788201263.066643:0:94464:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc13aa9c000 : new rpc_count 1 00000100:00000040:1.0:1788201263.066647:0:94464:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc0072a8450 x1875060695487104/t0(0) o400->93ba7067-43b5-4e46-8db7-27c040fa03d9@192.168.201.20@tcp:384/0 lens 224/0 e 0 to 0 dl 1788201274 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201263.066657:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695487104:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000040:1.0:1788201263.066668:0:94464:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060695487104 00000100:00000040:1.0:1788201263.066673:0:94464:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 9 to 192.168.201.20@tcp 00000100:00000040:1.0:1788201263.066676:0:94464:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:1.0:1788201263.066691:0:94464:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 8 to 192.168.201.20@tcp 00000100:00000040:1.0:1788201263.066696:0:94464:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc0072a8450 x1875060695487104/t0(0) o400->93ba7067-43b5-4e46-8db7-27c040fa03d9@192.168.201.20@tcp:384/0 lens 224/224 e 0 to 0 dl 1788201274 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201263.066704:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695487104:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 49us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201263.066711:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 188 00000100:00000040:1.0:1788201263.066713:0:94464:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc13aa9c000 : new rpc_count 0 00000020:00000040:1.0:1788201263.066719:0:94464:0:(genops.c:879:class_export_put()) PUTting export ffff8dc13aa9c000 : new refcount 9 00000100:00080000:1.0:1788201263.066747:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1788201263.066753:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff8dc139bbcd28) now 10 - evictor 00000100:00100000:3.0:1788201263.067377:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695487232 00000100:00100000:3.0:1788201263.067386:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695487232 00000020:00000040:3.0:1788201263.067388:0:66312:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c551 00000020:00000040:3.0:1788201263.067393:0:66312:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc103483800 refcount=51 00000020:00000040:3.0:1788201263.067407:0:66312:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff8dc13f870000) now 14 - evictor 00000100:00100000:2.0:1788201263.068319:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695487360 00000100:00100000:2.0:1788201263.068330:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695487360 00000020:00000040:2.0:1788201263.068332:0:69485:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1bb4f 00000020:00000040:2.0:1788201263.068337:0:69485:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc12e647000 refcount=11 00000020:00000040:2.0:1788201263.068354:0:69485:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff8dc1060e4d28) now 10 - evictor 00000100:00000040:3.0:1788201263.068510:0:66312:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:3.0:1788201263.071617:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1533 00000100:00000040:3.0:1788201263.071626:0:66312:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc103483800 : new rpc_count 1 00000100:00000040:3.0:1788201263.071637:0:66312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc003a73b80 x1875060695487232/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:384/0 lens 224/0 e 0 to 0 dl 1788201274 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201263.071663:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2402:x1875060695487232:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000040:3.0:1788201263.071701:0:66312:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 124554051730, transno 0, xid 1875060695487232 00000100:00000040:3.0:1788201263.071713:0:66312:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 9 to 192.168.201.20@tcp 00000100:00000040:3.0:1788201263.071719:0:66312:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:3.0:1788201263.072116:0:66312:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 8 to 192.168.201.20@tcp 00000100:00000040:3.0:1788201263.072123:0:66312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc003a73b80 x1875060695487232/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:384/0 lens 224/224 e 0 to 0 dl 1788201274 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201263.072133:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2402:x1875060695487232:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 484us (10231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201263.072142:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1533 00000100:00000040:3.0:1788201263.072146:0:66312:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc103483800 : new rpc_count 0 00000020:00000040:3.0:1788201263.072163:0:66312:0:(genops.c:879:class_export_put()) PUTting export ffff8dc103483800 : new refcount 50 00000100:00000040:2.0:1788201263.076762:0:69485:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1788201263.076823:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1534 00000100:00000040:2.0:1788201263.076829:0:69485:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc12e647000 : new rpc_count 1 00000100:00000040:2.0:1788201263.076840:0:69485:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc003a71f80 x1875060695487360/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:384/0 lens 224/0 e 0 to 0 dl 1788201274 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201263.076862:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2402:x1875060695487360:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000040:2.0:1788201263.076894:0:69485:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 77309411473, transno 0, xid 1875060695487360 00000100:00000040:2.0:1788201263.076907:0:69485:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 9 to 192.168.201.20@tcp 00000100:00000040:2.0:1788201263.076913:0:69485:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:2.0:1788201263.077001:0:69485:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 8 to 192.168.201.20@tcp 00000100:00000040:2.0:1788201263.077007:0:69485:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc003a71f80 x1875060695487360/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:384/0 lens 224/224 e 0 to 0 dl 1788201274 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201263.077030:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2402:x1875060695487360:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 163us (11033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201263.077039:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1534 00000100:00000040:2.0:1788201263.077043:0:69485:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc12e647000 : new rpc_count 0 00000020:00000040:2.0:1788201263.077069:0:69485:0:(genops.c:879:class_export_put()) PUTting export ffff8dc12e647000 : new refcount 10 00000100:00080000:1.0:1788201263.077425:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1788201263.077434:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001 (ffff8dc1060e4d28) now 10 - evictor 00000100:00080000:1.0:1788201263.077592:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:1.0:1788201263.077595:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (ffff8dc13f870000) now 14 - evictor 00010000:00010000:1.0:1788201263.887297:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201264.911239:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:3.0:1788201265.495579:0:75750:0:(genops.c:1210:class_import_get()) import ffff8dc1031f8800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:3.0:1788201265.495646:0:75750:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e34735eb] to pc [ptlrpcd_00_01+1] req@ffff8dc005abdc00 x1875060715292544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201265.495773:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc005abdc00 x1875060715292544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201265.495790:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715292544:0@lo:13:osp-pre-1-1.0 00000100:00000040:1.0:1788201265.495849:0:3656:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc005abdc00 x1875060715292544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201281 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201265.495859:0:3656:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201265.495911:0:3656:0:(events.c:337:request_in_callback()) incoming req@ffff8dc003a71c00 x1875060715292544 msgsize 224 00000100:00100000:1.0:1788201265.495916:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788201265.495955:0:3656:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc005abdc00 x1875060715292544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201281 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201265.495974:0:3656:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5600 usecs (6 jiffies) 00000100:00100000:3.0:1788201265.496146:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715292544 00000100:00100000:3.0:1788201265.496167:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715292544 00000020:00000040:3.0:1788201265.496171:0:8450:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a163d6 00000020:00000040:3.0:1788201265.496177:0:8450:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1201ce800 refcount=5 00000020:00000040:3.0:1788201265.496195:0:8450:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff8dc139bbcd28) now 10 - evictor 00000100:00000040:3.0:1788201265.496231:0:8450:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:3.0:1788201265.496263:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2369 00000100:00000040:3.0:1788201265.496268:0:8450:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1201ce800 : new rpc_count 1 00000100:00000040:3.0:1788201265.496274:0:8450:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc003a71c00 x1875060715292544/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:386/0 lens 224/0 e 0 to 0 dl 1788201276 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201265.496292:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715292544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201265.496335:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00010000:00000040:3.0:1788201265.496351:0:8450:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969442, transno 0, xid 1875060715292544 00000100:00000040:3.0:1788201265.496363:0:8450:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:3.0:1788201265.496369:0:8450:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201265.496404:0:8450:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8dc005abdc00 x1875060715292544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201281 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201265.496424:0:8450:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:3.0:1788201265.496428:0:8450:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc003a71c00 x1875060715292544/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:386/0 lens 224/368 e 0 to 0 dl 1788201276 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201265.496437:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715292544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 151us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201265.496445:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2369 00000100:00000040:3.0:1788201265.496449:0:8450:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1201ce800 : new rpc_count 0 00000020:00000040:3.0:1788201265.496636:0:8450:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1201ce800 : new refcount 4 00000100:00080000:1.0:1788201265.496705:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1788201265.496711:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff8dc139bbcd28) now 10 - evictor 00000100:00000040:1.0:1788201265.496750:0:3656:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969442 00000100:00000040:1.0:1788201265.496758:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc005abdc00 x1875060715292544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1788201265.496770:0:3656:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:1.0:1788201265.496774:0:3656:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261731 state=0: rc = 0 00000100:00000040:1.0:1788201265.496782:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005abdc00 x1875060715292544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201281 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201265.496789:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715292544:0@lo:13:osp-pre-1-1.0 00000100:00000040:1.0:1788201265.496796:0:3656:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc005abdc00 x1875060715292544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201281 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201265.496876:0:3656:0:(genops.c:1223:class_import_put()) import ffff8dc1031f8800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00010000:00010000:1.0:1788201265.935591:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201266.969314:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1788201267.536874:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788201267.536910:0:76267:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000100:00000040:3.0:1788201267.536946:0:76267:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging c9b18af6-fecc-4172-82c2-66531890fe11->MGS req@ffff8dc005abfb80 x1875060715292672/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788201267.536963:0:76267:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000eb67b991] to pc [ptlrpcd_00_02+2] req@ffff8dc005abfb80 x1875060715292672/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201267.536988:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788201267.536993:0:76267:0:(genops.c:1210:class_import_get()) import ffff8dc0034f0000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:3.0:1788201267.537000:0:76267:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff8dc005abce00 x1875060715292800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788201267.537008:0:76267:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ea03000e] to pc [ptlrpcd_00_03+3] req@ffff8dc005abce00 x1875060715292800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201267.537177:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788201267.537182:0:76267:0:(genops.c:1210:class_import_get()) import ffff8dc0034f2000 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:3.0:1788201267.537190:0:76267:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff8dc005abc380 x1875060715292928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788201267.537199:0:76267:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f9f320c7] to pc [ptlrpcd_00_00+0] req@ffff8dc005abc380 x1875060715292928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201267.537219:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788201267.537224:0:76267:0:(genops.c:1210:class_import_get()) import ffff8dc109813800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1788201267.537233:0:76267:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff8dc005abf100 x1875060715293056/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788201267.537241:0:76267:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000037129cd9] to pc [ptlrpcd_00_01+1] req@ffff8dc005abf100 x1875060715293056/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201267.537248:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201267.537257:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788201267.537260:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201267.537264:0:76267:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 4113 00000100:00080000:3.0:1788201267.537269:0:76267:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00000040:3.0:1788201267.537272:0:76267:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 50 to 0@lo 00000100:00000040:3.0:1788201267.537275:0:76267:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000020:00000040:3.0:1788201267.537279:0:76267:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a163b3 00000020:00000040:3.0:1788201267.537283:0:76267:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc12f3a2800 refcount=4 00000100:00000040:3.0:1788201267.537286:0:76267:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 50 to 0@lo 00000100:00000040:3.0:1788201267.537287:0:76267:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000020:00000040:3.0:1788201267.537290:0:76267:0:(genops.c:879:class_export_put()) PUTting export ffff8dc12f3a2800 : new refcount 3 00000100:00080000:3.0:1788201267.537293:0:76267:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8dc006d84000 using connection 192.168.201.120@tcp/0@lo 00000020:00000040:3.0:1788201267.537304:0:76267:0:(genops.c:1210:class_import_get()) import ffff8dc006d84000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:3.0:1788201267.537316:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005abdc00 x1875060715293184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788201267.537324:0:76267:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e34735eb] to pc [ptlrpcd_rcv+-1] req@ffff8dc005abdc00 x1875060715293184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201267.537337:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788201267.537344:0:76267:0:(genops.c:1210:class_import_get()) import ffff8dc1031f8800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:3.0:1788201267.537350:0:76267:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff8dc11d29dc00 x1875060715293312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788201267.537370:0:76267:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a672662c] to pc [ptlrpcd_00_02+2] req@ffff8dc11d29dc00 x1875060715293312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201267.537378:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788201267.537384:0:76267:0:(genops.c:1210:class_import_get()) import ffff8dc001db0000 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:3.0:1788201267.537391:0:76267:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff8dc11d29c000 x1875060715293440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788201267.537406:0:76267:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000082f8de2a] to pc [ptlrpcd_00_03+3] req@ffff8dc11d29c000 x1875060715293440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201267.537413:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788201267.537418:0:76267:0:(genops.c:1210:class_import_get()) import ffff8dc104281000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1788201267.537426:0:76267:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff8dc11d29ca80 x1875060715293568/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788201267.537434:0:76267:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000bf80cca7] to pc [ptlrpcd_00_00+0] req@ffff8dc11d29ca80 x1875060715293568/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201267.537441:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201267.537444:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788201267.537446:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201267.537449:0:76267:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 4113 00000100:00080000:3.0:1788201267.537452:0:76267:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00000040:3.0:1788201267.537454:0:76267:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 50 to 0@lo 00000100:00000040:3.0:1788201267.537456:0:76267:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000020:00000040:3.0:1788201267.537458:0:76267:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c597 00000020:00000040:3.0:1788201267.537460:0:76267:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc005d70800 refcount=4 00000100:00000040:3.0:1788201267.537463:0:76267:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 50 to 0@lo 00000100:00000040:3.0:1788201267.537465:0:76267:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000020:00000040:3.0:1788201267.537467:0:76267:0:(genops.c:879:class_export_put()) PUTting export ffff8dc005d70800 : new refcount 3 00000100:00080000:3.0:1788201267.537469:0:76267:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dc109815000 using connection 192.168.201.120@tcp/0@lo 00000020:00000040:3.0:1788201267.537476:0:76267:0:(genops.c:1210:class_import_get()) import ffff8dc109815000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:3.0:1788201267.537484:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11d29d880 x1875060715293696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788201267.537492:0:76267:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ea163604] to pc [ptlrpcd_rcv+-1] req@ffff8dc11d29d880 x1875060715293696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201267.537506:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788201267.537511:0:76267:0:(genops.c:1210:class_import_get()) import ffff8dc1257f0800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1788201267.537520:0:76267:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff8dc11d29c700 x1875060715293824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788201267.537528:0:76267:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000085215ef6] to pc [ptlrpcd_00_01+1] req@ffff8dc11d29c700 x1875060715293824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201267.537536:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788201267.537541:0:76267:0:(genops.c:1210:class_import_get()) import ffff8dc137d33000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:3.0:1788201267.537547:0:76267:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff8dc11d29d180 x1875060715293952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788201267.537555:0:76267:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000088735dcf] to pc [ptlrpcd_00_02+2] req@ffff8dc11d29d180 x1875060715293952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201267.537564:0:76267:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (4124) 00000100:00000040:3.0:1788201267.537580:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc005abc380 x1875060715292928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201267.537591:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715292928:0@lo:400:kworker.0 00000100:00000040:3.0:1788201267.537620:0:3655:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc005abc380 x1875060715292928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201283 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201267.537627:0:3655:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201267.537666:0:3655:0:(events.c:337:request_in_callback()) incoming req@ffff8dc11d29d500 x1875060715292928 msgsize 224 00000100:00100000:3.0:1788201267.537671:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201267.537690:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc005abc380 x1875060715292928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201283 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201267.537703:0:3655:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 8652 usecs (9 jiffies) 00000100:00000040:3.0:1788201267.537720:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc11d29ca80 x1875060715293568/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201267.537729:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715293568:0@lo:400:kworker.0 00000100:00000040:3.0:1788201267.537745:0:3655:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc11d29ca80 x1875060715293568/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201283 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201267.537750:0:3655:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201267.537765:0:3655:0:(events.c:337:request_in_callback()) incoming req@ffff8dc11d29f100 x1875060715293568 msgsize 224 00000100:00100000:3.0:1788201267.537769:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201267.537784:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc11d29ca80 x1875060715293568/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201283 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201267.537793:0:3655:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 3173 usecs (4 jiffies) 00000100:00100000:3.0:1788201267.537806:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00000040:3.0:1788201267.537811:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc005abf100 x1875060715293056/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201267.537820:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715293056:0@lo:400:kworker.0 00000100:00000040:3.0:1788201267.537831:0:3655:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc005abf100 x1875060715293056/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201283 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201267.537838:0:3655:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201267.537851:0:3655:0:(events.c:337:request_in_callback()) incoming req@ffff8dc11d29e680 x1875060715293056 msgsize 224 00000100:00100000:3.0:1788201267.537854:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201267.537866:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc005abf100 x1875060715293056/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201283 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201267.537875:0:3655:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1327941 usecs (1328 jiffies) 00000100:00000040:3.0:1788201267.537880:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc11d29c700 x1875060715293824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201267.537887:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715293824:0@lo:400:kworker.0 00000100:00000040:3.0:1788201267.537898:0:3655:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc11d29c700 x1875060715293824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201283 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201267.537910:0:3655:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201267.537924:0:3655:0:(events.c:337:request_in_callback()) incoming req@ffff8dc11d29f800 x1875060715293824 msgsize 224 00000100:00100000:3.0:1788201267.537928:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201267.537940:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc11d29c700 x1875060715293824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201283 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201267.537949:0:3655:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 6975 usecs (7 jiffies) 00000100:00000040:3.0:1788201267.537966:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc005abdc00 x1875060715293184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201267.537975:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715293184:0@lo:8:kworker.0 00000100:00000040:3.0:1788201267.537986:0:3654:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc005abdc00 x1875060715293184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788201292 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201267.537993:0:3654:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201267.538004:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8dc11d29ce00 x1875060715293184 msgsize 520 00000100:00100000:3.0:1788201267.538008:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201267.538050:0:3654:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc005abdc00 x1875060715293184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788201292 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201267.538060:0:3654:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 6036 usecs (7 jiffies) 00000100:00000040:3.0:1788201267.538064:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc11d29d880 x1875060715293696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201267.538071:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715293696:0@lo:8:kworker.0 00000100:00000040:3.0:1788201267.538082:0:3654:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc11d29d880 x1875060715293696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788201292 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201267.538088:0:3654:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201267.538102:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8dc140e9e850 x1875060715293696 msgsize 520 00000100:00100000:3.0:1788201267.538105:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201267.538107:0:3654:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788201267.538118:0:3654:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc11d29d880 x1875060715293696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788201292 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201267.538133:0:3654:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 6782 usecs (7 jiffies) 00000100:00100000:3.0:1788201267.538154:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715293568 00000100:00100000:3.0:1788201267.538162:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715293568 00000020:00000040:3.0:1788201267.538164:0:83817:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c582 00000020:00000040:3.0:1788201267.538167:0:83817:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc11d63c000 refcount=5 00000100:00000040:3.0:1788201267.538188:0:83817:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:3.0:1788201267.538211:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715293056 00000100:00100000:3.0:1788201267.538214:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715293056 00000020:00000040:3.0:1788201267.538215:0:83817:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c54a 00000020:00000040:3.0:1788201267.538218:0:83817:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc103486000 refcount=7 00000100:00100000:3.0:1788201267.538239:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4112 00000100:00000040:3.0:1788201267.538243:0:83817:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc11d63c000 : new rpc_count 1 00000100:00000040:3.0:1788201267.538249:0:83817:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc11d29f100 x1875060715293568/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:388/0 lens 224/0 e 0 to 0 dl 1788201278 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201267.538260:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715293568:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1788201267.538285:0:83817:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715293568 00000100:00000040:3.0:1788201267.538294:0:83817:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:3.0:1788201267.538299:0:83817:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201267.538315:0:83817:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc11d29ca80 x1875060715293568/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201267.538333:0:83817:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:3.0:1788201267.538337:0:83817:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29f100 x1875060715293568/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:388/0 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201267.538345:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715293568:12345-0@lo:400:kworker.0 Request processed in 87us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201267.538352:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4112 00000100:00000040:3.0:1788201267.538355:0:83817:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc11d63c000 : new rpc_count 0 00000100:00100000:0.0:1788201267.538440:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4113 00000100:00000040:0.0:1788201267.538446:0:8457:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc103486000 : new rpc_count 1 00000100:00000040:0.0:1788201267.538451:0:8457:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc11d29e680 x1875060715293056/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:388/0 lens 224/0 e 0 to 0 dl 1788201278 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201267.538462:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715293056:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1788201267.538473:0:8457:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1875060715293056 00000100:00000040:0.0:1788201267.538478:0:8457:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:0.0:1788201267.538482:0:8457:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201267.538499:0:8457:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc005abf100 x1875060715293056/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201267.538512:0:8457:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:0.0:1788201267.538516:0:8457:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29e680 x1875060715293056/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:388/0 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201267.538523:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715293056:12345-0@lo:400:kworker.0 Request processed in 64us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201267.538527:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4113 00000100:00000040:0.0:1788201267.538530:0:8457:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc103486000 : new rpc_count 0 00000020:00000040:0.0:1788201267.538539:0:8457:0:(genops.c:879:class_export_put()) PUTting export ffff8dc103486000 : new refcount 6 00000020:00000040:0.0:1788201267.538558:0:94473:0:(genops.c:1210:class_import_get()) import ffff8dc104281000 refcount=4 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1788201267.538573:0:94473:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000d01a6e6] to pc [ptlrpcd_00_03+3] req@ffff8dc120092300 x1875060715294080/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201267.539622:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc005abfb80 x1875060715292672/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201267.539636:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715292672:0@lo:400:kworker.0 00000100:00000040:1.0:1788201267.539659:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc005abfb80 x1875060715292672/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201283 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201267.539674:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201267.539700:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff8dc0072a9450 x1875060715292672 msgsize 224 00000100:00100000:1.0:1788201267.539704:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788201267.539706:0:3657:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1788201267.539722:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc005abfb80 x1875060715292672/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201283 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201267.539748:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc11d29dc00 x1875060715293312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201267.539757:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715293312:0@lo:400:kworker.0 00000100:00000040:1.0:1788201267.539771:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc11d29dc00 x1875060715293312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201283 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201267.539778:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201267.539791:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff8dc003a71180 x1875060715293312 msgsize 224 00000100:00100000:1.0:1788201267.539795:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788201267.539807:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc11d29dc00 x1875060715293312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201283 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201267.539816:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5587 usecs (6 jiffies) 00000100:00000040:1.0:1788201267.539822:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc11d29d180 x1875060715293952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201267.539830:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715293952:0@lo:400:kworker.0 00000100:00000040:1.0:1788201267.539842:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc11d29d180 x1875060715293952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201283 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201267.539848:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201267.539861:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff8dc003a72d80 x1875060715293952 msgsize 224 00000100:00100000:1.0:1788201267.539864:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788201267.539879:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc11d29d180 x1875060715293952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201283 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201267.539900:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 5792 usecs (6 jiffies) 00000100:00100000:1.0:1788201267.539912:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00000040:1.0:1788201267.539932:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc005abce00 x1875060715292800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201267.539940:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715292800:0@lo:400:kworker.0 00000100:00000040:1.0:1788201267.539953:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc005abce00 x1875060715292800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201283 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201267.539959:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201267.539971:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff8dc003a70e00 x1875060715292800 msgsize 224 00000100:00100000:1.0:1788201267.539975:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788201267.539988:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc005abce00 x1875060715292800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201283 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201267.539997:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8497 usecs (9 jiffies) 00000100:00000040:1.0:1788201267.540002:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc11d29c000 x1875060715293440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201267.540010:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715293440:0@lo:400:kworker.0 00000100:00000040:1.0:1788201267.540042:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc11d29c000 x1875060715293440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201283 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201267.540049:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201267.540059:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff8dc003a71880 x1875060715293440 msgsize 224 00000100:00100000:1.0:1788201267.540062:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788201267.540075:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc11d29c000 x1875060715293440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201283 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201267.540084:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 84688 usecs (85 jiffies) 00000100:00000040:1.0:1788201267.540089:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc120092300 x1875060715294080/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201267.540108:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715294080:0@lo:41:osp-pre-1-0.0 00000100:00000040:1.0:1788201267.540121:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc120092300 x1875060715294080/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201283 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201267.540127:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201267.540140:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff8dc003a70700 x1875060715294080 msgsize 224 00000100:00100000:1.0:1788201267.540144:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788201267.540161:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc120092300 x1875060715294080/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201283 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201267.540170:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 3173 usecs (4 jiffies) 00000100:00100000:1.0:1788201267.540189:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715292928 00000100:00100000:1.0:1788201267.540195:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715292928 00000020:00000040:1.0:1788201267.540197:0:69485:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1644d 00000020:00000040:1.0:1788201267.540201:0:69485:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc10558f000 refcount=5 00000020:00000040:1.0:1788201267.540213:0:69485:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff8dc1060e4d28) now 10 - evictor 00000100:00000040:1.0:1788201267.540233:0:69485:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:1.0:1788201267.540251:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715293952 00000100:00100000:1.0:1788201267.540253:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715293952 00000020:00000040:1.0:1788201267.540255:0:69485:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c6e0 00000020:00000040:1.0:1788201267.540257:0:69485:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc137d37000 refcount=5 00000100:00100000:1.0:1788201267.540268:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715292800 00000100:00100000:1.0:1788201267.540270:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715292800 00000020:00000040:1.0:1788201267.540271:0:69485:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c6d2 00000020:00000040:1.0:1788201267.540273:0:69485:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc11cdda800 refcount=5 00000020:00000040:1.0:1788201267.540278:0:69485:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff8dc13f870000) now 14 - evictor 00000100:00100000:1.0:1788201267.540287:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715293440 00000100:00100000:1.0:1788201267.540289:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715293440 00000020:00000040:1.0:1788201267.540290:0:69485:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c6d9 00000020:00000040:1.0:1788201267.540292:0:69485:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc11d63e800 refcount=5 00000100:00100000:1.0:1788201267.540303:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1535 00000100:00000040:1.0:1788201267.540306:0:69485:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc10558f000 : new rpc_count 1 00000100:00000040:1.0:1788201267.540315:0:69485:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc11d29d500 x1875060715292928/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:388/0 lens 224/0 e 0 to 0 dl 1788201278 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201267.540325:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715292928:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788201267.540343:0:69485:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715292928 00000100:00000040:1.0:1788201267.540350:0:69485:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:1.0:1788201267.540353:0:69485:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201267.540383:0:69485:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc005abc380 x1875060715292928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201267.540397:0:69485:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:1.0:1788201267.540402:0:69485:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29d500 x1875060715292928/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:388/0 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201267.540409:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715292928:12345-0@lo:400:kworker.0 Request processed in 85us (2742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201267.540415:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1535 00000100:00000040:1.0:1788201267.540418:0:69485:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc10558f000 : new rpc_count 0 00000020:00000040:1.0:1788201267.540428:0:69485:0:(genops.c:879:class_export_put()) PUTting export ffff8dc10558f000 : new refcount 4 00000100:00100000:1.0:1788201267.540436:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1536 00000100:00000040:1.0:1788201267.540438:0:69485:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc137d37000 : new rpc_count 1 00000100:00000040:1.0:1788201267.540441:0:69485:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc003a72d80 x1875060715293952/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:388/0 lens 224/0 e 0 to 0 dl 1788201278 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201267.540449:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715293952:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788201267.540457:0:69485:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715293952 00000100:00000040:1.0:1788201267.540461:0:69485:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:1.0:1788201267.540464:0:69485:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201267.540474:0:69485:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc11d29d180 x1875060715293952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201267.540501:0:69485:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:1.0:1788201267.540507:0:69485:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc003a72d80 x1875060715293952/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:388/0 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201267.540513:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715293952:12345-0@lo:400:kworker.0 Request processed in 65us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201267.540519:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1536 00000100:00000040:1.0:1788201267.540521:0:69485:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc137d37000 : new rpc_count 0 00000020:00000040:1.0:1788201267.540525:0:69485:0:(genops.c:879:class_export_put()) PUTting export ffff8dc137d37000 : new refcount 4 00000100:00100000:1.0:1788201267.540533:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1537 00000100:00000040:1.0:1788201267.540534:0:69485:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc11cdda800 : new rpc_count 1 00000100:00000040:1.0:1788201267.540537:0:69485:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc003a70e00 x1875060715292800/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:388/0 lens 224/0 e 0 to 0 dl 1788201278 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201267.540545:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715292800:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788201267.540553:0:69485:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715292800 00000100:00000040:1.0:1788201267.540557:0:69485:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:1.0:1788201267.540560:0:69485:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201267.540572:0:69485:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc005abce00 x1875060715292800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201267.540582:0:69485:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:1.0:1788201267.540586:0:69485:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc003a70e00 x1875060715292800/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:388/0 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201267.540592:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715292800:12345-0@lo:400:kworker.0 Request processed in 48us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201267.540597:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1537 00000100:00000040:1.0:1788201267.540598:0:69485:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc11cdda800 : new rpc_count 0 00000020:00000040:1.0:1788201267.540609:0:69485:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11cdda800 : new refcount 4 00000100:00100000:1.0:1788201267.540617:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1538 00000100:00000040:1.0:1788201267.540620:0:69485:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc11d63e800 : new rpc_count 1 00000100:00000040:1.0:1788201267.540623:0:69485:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc003a71880 x1875060715293440/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:388/0 lens 224/0 e 0 to 0 dl 1788201278 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201267.540632:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715293440:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788201267.540639:0:69485:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715293440 00000100:00000040:1.0:1788201267.540643:0:69485:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:1.0:1788201267.540646:0:69485:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201267.540659:0:69485:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc11d29c000 x1875060715293440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201267.540669:0:69485:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:1.0:1788201267.540673:0:69485:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc003a71880 x1875060715293440/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:388/0 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201267.540679:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715293440:12345-0@lo:400:kworker.0 Request processed in 49us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201267.540684:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1538 00000100:00000040:1.0:1788201267.540686:0:69485:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc11d63e800 : new rpc_count 0 00000020:00000040:1.0:1788201267.540691:0:69485:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11d63e800 : new refcount 4 00000100:00080000:1.0:1788201267.540704:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:1.0:1788201267.540707:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (ffff8dc13f870000) now 14 - evictor 00000100:00080000:1.0:1788201267.540710:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1788201267.540711:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001 (ffff8dc1060e4d28) now 10 - evictor 00000100:00000040:1.0:1788201267.540739:0:3657:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:1.0:1788201267.540745:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc005abce00 x1875060715292800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201267.540753:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005abce00 x1875060715292800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201267.540766:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715292800:0@lo:400:kworker.0 00000100:00000040:1.0:1788201267.540779:0:3657:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:1.0:1788201267.540782:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc11d29c000 x1875060715293440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201267.540789:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29c000 x1875060715293440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201267.540795:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715293440:0@lo:400:kworker.0 00000100:00000040:1.0:1788201267.540803:0:3657:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1788201267.540806:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc11d29d180 x1875060715293952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201267.540813:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29d180 x1875060715293952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201267.540819:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715293952:0@lo:400:kworker.0 00000100:00000040:1.0:1788201267.540824:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc005abce00 x1875060715292800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201267.540833:0:3657:0:(genops.c:1223:class_import_put()) import ffff8dc0034f0000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:1.0:1788201267.540843:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc11d29c000 x1875060715293440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201267.540848:0:3657:0:(genops.c:1223:class_import_put()) import ffff8dc001db0000 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:1.0:1788201267.540853:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc11d29d180 x1875060715293952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201267.540858:0:3657:0:(genops.c:1223:class_import_put()) import ffff8dc137d33000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00100000:2.0:1788201267.542391:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715293824 00000100:00100000:2.0:1788201267.542402:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715293824 00000020:00000040:2.0:1788201267.542405:0:26209:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c5ba 00000020:00000040:2.0:1788201267.542411:0:26209:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc0059d1800 refcount=5 00000020:00000040:2.0:1788201267.542425:0:26209:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff8dc139bbcd28) now 10 - evictor 00000100:00000040:2.0:1788201267.542446:0:26209:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:2.0:1788201267.542465:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715293184 00000100:00100000:2.0:1788201267.542468:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715293184 00000020:00000040:2.0:1788201267.542470:0:26209:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a163c8 00000100:00100000:2.0:1788201267.542489:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715293696 00000100:00100000:2.0:1788201267.542491:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715293696 00000020:00000040:2.0:1788201267.542493:0:26209:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c5ac 00000100:00100000:2.0:1788201267.542505:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715293312 00000100:00100000:2.0:1788201267.542508:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715293312 00000020:00000040:2.0:1788201267.542509:0:26209:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a163d6 00000020:00000040:2.0:1788201267.542511:0:26209:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1201ce800 refcount=5 00000100:00100000:2.0:1788201267.542537:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2920 00000100:00000040:2.0:1788201267.542542:0:26209:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc0059d1800 : new rpc_count 1 00000100:00000040:2.0:1788201267.542548:0:26209:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc11d29f800 x1875060715293824/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:388/0 lens 224/0 e 0 to 0 dl 1788201278 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201267.542561:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715293824:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788201267.542578:0:26209:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969457, transno 0, xid 1875060715293824 00000100:00000040:2.0:1788201267.542587:0:26209:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:2.0:1788201267.542591:0:26209:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201267.542627:0:26209:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc11d29c700 x1875060715293824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201267.542644:0:26209:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:2.0:1788201267.542648:0:26209:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29f800 x1875060715293824/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:388/0 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201267.542667:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715293824:12345-0@lo:400:kworker.0 Request processed in 109us (4741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201267.542673:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2920 00000100:00000040:2.0:1788201267.542676:0:26209:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc0059d1800 : new rpc_count 0 00000020:00000040:2.0:1788201267.542685:0:26209:0:(genops.c:879:class_export_put()) PUTting export ffff8dc0059d1800 : new refcount 4 00000100:00100000:2.0:1788201267.542694:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2921 00000100:00000040:2.0:1788201267.542696:0:26209:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1201ce800 : new rpc_count 1 00000100:00000040:2.0:1788201267.542700:0:26209:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc003a71180 x1875060715293312/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:388/0 lens 224/0 e 0 to 0 dl 1788201278 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201267.542709:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715293312:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788201267.542718:0:26209:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969442, transno 0, xid 1875060715293312 00000100:00000040:2.0:1788201267.542723:0:26209:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:2.0:1788201267.542725:0:26209:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201267.542742:0:26209:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc11d29dc00 x1875060715293312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201267.542759:0:26209:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:2.0:1788201267.542763:0:26209:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc003a71180 x1875060715293312/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:388/0 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201267.542771:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715293312:12345-0@lo:400:kworker.0 Request processed in 63us (2978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201267.542776:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2921 00000100:00000040:2.0:1788201267.542778:0:26209:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1201ce800 : new rpc_count 0 00000020:00000040:2.0:1788201267.542784:0:26209:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1201ce800 : new refcount 4 00000100:00100000:2.0:1788201267.542792:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5984 00000100:00000040:2.0:1788201267.542796:0:26209:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc11d29ce00 x1875060715293184/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788201287 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201267.542814:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3654:x1875060715293184:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788201267.542834:0:26209:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:2.0:1788201267.542845:0:26209:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:2.0:1788201267.542848:0:26209:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:2.0:1788201267.542850:0:26209:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201267.542865:0:26209:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff8dc005abdc00 x1875060715293184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788201292 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201267.542883:0:26209:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:2.0:1788201267.542886:0:26209:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29ce00 x1875060715293184/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788201287 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201267.542893:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3654:x1875060715293184:12345-0@lo:8:kworker.0 Request processed in 80us (4887us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201267.542899:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5984 00000100:00100000:2.0:1788201267.542910:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5985 00000100:00000040:2.0:1788201267.542914:0:26209:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc140e9e850 x1875060715293696/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788201287 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201267.542921:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140e9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3654:x1875060715293696:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788201267.542930:0:26209:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:2.0:1788201267.542936:0:26209:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:2.0:1788201267.542938:0:26209:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:2.0:1788201267.542940:0:26209:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201267.542953:0:26209:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff8dc11d29d880 x1875060715293696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788201292 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201267.542963:0:26209:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:2.0:1788201267.542966:0:26209:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc140e9e850 x1875060715293696/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788201287 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201267.542980:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140e9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3654:x1875060715293696:12345-0@lo:8:kworker.0 Request processed in 58us (4876us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201267.542985:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5985 00000100:00000040:2.0:1788201267.543179:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc005abdc00 x1875060715293184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788201292 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201267.543190:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201267.543194:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:2.0:1788201267.543198:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005abdc00 x1875060715293184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788201292 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201267.543206:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715293184:0@lo:8:kworker.0 00000100:00000040:2.0:1788201267.543218:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc11d29d880 x1875060715293696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788201292 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201267.543224:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201267.543227:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:2.0:1788201267.543230:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29d880 x1875060715293696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788201292 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201267.543237:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715293696:0@lo:8:kworker.0 00000100:00000040:2.0:1788201267.543242:0:3654:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc005abdc00 x1875060715293184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788201292 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788201267.543252:0:3654:0:(genops.c:1223:class_import_put()) import ffff8dc006d84000 refcount=2 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:2.0:1788201267.543259:0:3654:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc11d29d880 x1875060715293696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788201292 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788201267.543265:0:3654:0:(genops.c:1223:class_import_put()) import ffff8dc109815000 refcount=2 obd=lustre-OST0000-osc-MDT0000 00000100:00080000:2.0:1788201267.543280:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1788201267.543288:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff8dc139bbcd28) now 10 - evictor 00000100:00000040:2.0:1788201267.543585:0:3657:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969442 00000100:00000040:2.0:1788201267.543591:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc11d29dc00 x1875060715293312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201267.543600:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29dc00 x1875060715293312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201267.543607:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715293312:0@lo:400:kworker.0 00000100:00000040:2.0:1788201267.543612:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc11d29dc00 x1875060715293312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788201267.543620:0:3657:0:(genops.c:1223:class_import_put()) import ffff8dc1031f8800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00100000:0.0:1788201267.545825:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715294080 00000100:00100000:0.0:1788201267.545841:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715294080 00000020:00000040:0.0:1788201267.545844:0:8457:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c582 00000020:00000040:0.0:1788201267.545869:0:8457:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc11d63c000 refcount=6 00000100:00100000:0.0:1788201267.545931:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4114 00000100:00000040:0.0:1788201267.545936:0:8457:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc11d63c000 : new rpc_count 1 00000100:00000040:0.0:1788201267.545944:0:8457:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc003a70700 x1875060715294080/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:388/0 lens 224/0 e 0 to 0 dl 1788201278 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201267.545957:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715294080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201267.546046:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00010000:00000040:0.0:1788201267.546067:0:8457:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715294080 00000100:00000040:0.0:1788201267.546077:0:8457:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:0.0:1788201267.546082:0:8457:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201267.546124:0:8457:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8dc120092300 x1875060715294080/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201283 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201267.546156:0:8457:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:0.0:1788201267.546161:0:8457:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc003a70700 x1875060715294080/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:388/0 lens 224/368 e 0 to 0 dl 1788201278 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201267.546169:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715294080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 215us (6027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201267.546175:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4114 00000100:00000040:0.0:1788201267.546178:0:8457:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc11d63c000 : new rpc_count 0 00000020:00000040:0.0:1788201267.546188:0:8457:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11d63c000 : new refcount 5 00000100:00100000:0.0:1788201267.546207:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715292672 00000100:00100000:0.0:1788201267.546211:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715292672 00000020:00000040:0.0:1788201267.546213:0:94461:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:0.0:1788201267.546215:0:94461:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=21 00000100:00000040:0.0:1788201267.546227:0:94461:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788201267.546250:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00000040:0.0:1788201267.546253:0:94461:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:0.0:1788201267.546257:0:94461:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc0072a9450 x1875060715292672/t0(0) o400->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:388/0 lens 224/0 e 0 to 0 dl 1788201278 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201267.546274:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:3657:x1875060715292672:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1788201267.546284:0:94461:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715292672 00000100:00000040:0.0:1788201267.546288:0:94461:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:0.0:1788201267.546291:0:94461:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201267.546307:0:94461:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc005abfb80 x1875060715292672/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201267.546320:0:94461:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:0.0:1788201267.546324:0:94461:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc0072a9450 x1875060715292672/t0(0) o400->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:388/0 lens 224/224 e 0 to 0 dl 1788201278 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201267.546332:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:3657:x1875060715292672:12345-0@lo:400:kworker.0 Request processed in 60us (6630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201267.546337:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00000040:0.0:1788201267.546339:0:94461:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:0.0:1788201267.546345:0:94461:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 20 00000100:00000040:2.0:1788201267.547633:0:3657:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1788201267.547646:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc120092300 x1875060715294080/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1788201267.547659:0:3657:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352879 avail=317176 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023680 state=0: rc = 0 00000100:00000040:2.0:1788201267.547666:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc120092300 x1875060715294080/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201283 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201267.547673:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715294080:0@lo:41:osp-pre-1-0.0 00000100:00000040:2.0:1788201267.547685:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc005abfb80 x1875060715292672/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201267.547693:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005abfb80 x1875060715292672/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201267.547700:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715292672:0@lo:400:kworker.0 00000100:00000040:2.0:1788201267.547706:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc120092300 x1875060715294080/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201283 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788201267.547729:0:3657:0:(genops.c:1223:class_import_put()) import ffff8dc104281000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1788201267.547737:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc005abfb80 x1875060715292672/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788201267.547745:0:3657:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 00000020:00000040:3.0:1788201267.548698:0:83817:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11d63c000 : new refcount 4 00000100:00000040:3.0:1788201267.548747:0:3655:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:3.0:1788201267.548755:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc005abf100 x1875060715293056/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201267.548764:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005abf100 x1875060715293056/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201267.548770:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715293056:0@lo:400:kworker.0 00000100:00000040:3.0:1788201267.548784:0:3655:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969457 00000100:00000040:3.0:1788201267.548788:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc11d29c700 x1875060715293824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201267.548796:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29c700 x1875060715293824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201267.548804:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715293824:0@lo:400:kworker.0 00000100:00000040:3.0:1788201267.548815:0:3655:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:3.0:1788201267.548818:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc005abc380 x1875060715292928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201267.548825:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005abc380 x1875060715292928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201267.548831:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715292928:0@lo:400:kworker.0 00000100:00000040:3.0:1788201267.548841:0:3655:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:3.0:1788201267.548844:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc11d29ca80 x1875060715293568/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201267.548851:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29ca80 x1875060715293568/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201267.548858:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715293568:0@lo:400:kworker.0 00000100:00000040:3.0:1788201267.548871:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc005abf100 x1875060715293056/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201267.548880:0:3655:0:(genops.c:1223:class_import_put()) import ffff8dc109813800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1788201267.548888:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc11d29c700 x1875060715293824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201267.548894:0:3655:0:(genops.c:1223:class_import_put()) import ffff8dc1257f0800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1788201267.548899:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc005abc380 x1875060715292928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201267.548905:0:3655:0:(genops.c:1223:class_import_put()) import ffff8dc0034f2000 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:3.0:1788201267.548910:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc11d29ca80 x1875060715293568/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201283 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201267.548924:0:3655:0:(genops.c:1223:class_import_put()) import ffff8dc104281000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00010000:00010000:1.0:1788201267.985090:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:1.0:1788201268.047161:0:75746:0:(genops.c:1210:class_import_get()) import ffff8dc109813800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1788201268.047203:0:75746:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ad2eaae6] to pc [ptlrpcd_00_00+0] req@ffff8dc003a73480 x1875060715294208/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201268.047259:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000020:00000040:1.0:1788201268.048464:0:94477:0:(genops.c:1210:class_import_get()) import ffff8dc1257f0800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1788201268.048491:0:94477:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000055e6d11a] to pc [ptlrpcd_00_01+1] req@ffff8dc003a70000 x1875060715294336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201268.050782:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc003a70000 x1875060715294336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201268.050803:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715294336:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1788201268.050839:0:3656:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc003a70000 x1875060715294336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201284 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201268.050849:0:3656:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201268.050890:0:3656:0:(events.c:337:request_in_callback()) incoming req@ffff8dc120090000 x1875060715294336 msgsize 224 00000100:00100000:0.0:1788201268.050895:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788201268.050926:0:3656:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc003a70000 x1875060715294336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201284 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201268.050941:0:3656:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 7220 usecs (8 jiffies) 00000100:00000040:0.0:1788201268.050960:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc003a73480 x1875060715294208/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201268.050970:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715294208:0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1788201268.050984:0:3656:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc003a73480 x1875060715294208/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201284 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201268.050991:0:3656:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201268.051008:0:3656:0:(events.c:337:request_in_callback()) incoming req@ffff8dc120093800 x1875060715294208 msgsize 224 00000100:00100000:0.0:1788201268.051012:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788201268.051046:0:3656:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc003a73480 x1875060715294208/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201284 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201268.051056:0:3656:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1324292 usecs (1325 jiffies) 00000100:00100000:0.0:1788201268.051092:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715294336 00000100:00100000:0.0:1788201268.051099:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715294336 00000020:00000040:0.0:1788201268.051102:0:10112:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c5ba 00000020:00000040:0.0:1788201268.051107:0:10112:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc0059d1800 refcount=5 00000100:00000040:0.0:1788201268.051146:0:10112:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:0.0:1788201268.051177:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2370 00000100:00000040:0.0:1788201268.051181:0:10112:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc0059d1800 : new rpc_count 1 00000100:00000040:0.0:1788201268.051187:0:10112:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc120090000 x1875060715294336/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:389/0 lens 224/0 e 0 to 0 dl 1788201279 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201268.051199:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715294336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201268.051230:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00010000:00000040:0.0:1788201268.051241:0:10112:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969457, transno 0, xid 1875060715294336 00000100:00000040:0.0:1788201268.051251:0:10112:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:0.0:1788201268.051256:0:10112:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201268.051274:0:10112:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8dc003a70000 x1875060715294336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201284 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201268.051291:0:10112:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:0.0:1788201268.051301:0:10112:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc120090000 x1875060715294336/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:389/0 lens 224/368 e 0 to 0 dl 1788201279 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201268.051309:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715294336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201268.051326:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2370 00000100:00000040:0.0:1788201268.051329:0:10112:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc0059d1800 : new rpc_count 0 00000020:00000040:0.0:1788201268.051339:0:10112:0:(genops.c:879:class_export_put()) PUTting export ffff8dc0059d1800 : new refcount 4 00000100:00100000:0.0:1788201268.051363:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715294208 00000100:00100000:0.0:1788201268.051367:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715294208 00000020:00000040:0.0:1788201268.051368:0:8457:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c54a 00000020:00000040:0.0:1788201268.051371:0:8457:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc103486000 refcount=7 00000100:00000040:0.0:1788201268.051381:0:8457:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:0.0:1788201268.051397:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4115 00000100:00000040:0.0:1788201268.051399:0:8457:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc103486000 : new rpc_count 1 00000100:00000040:0.0:1788201268.051404:0:8457:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc120093800 x1875060715294208/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:389/0 lens 224/0 e 0 to 0 dl 1788201279 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201268.051414:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715294208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201268.051438:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00010000:00000040:0.0:1788201268.051488:0:8457:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1875060715294208 00000100:00000040:0.0:1788201268.051494:0:8457:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:0.0:1788201268.051498:0:8457:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201268.051515:0:8457:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8dc003a73480 x1875060715294208/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201284 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201268.051529:0:8457:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:0.0:1788201268.051533:0:8457:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc120093800 x1875060715294208/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:389/0 lens 224/368 e 0 to 0 dl 1788201279 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201268.051542:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715294208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201268.051558:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4115 00000100:00000040:0.0:1788201268.051561:0:8457:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc103486000 : new rpc_count 0 00000020:00000040:0.0:1788201268.051567:0:8457:0:(genops.c:879:class_export_put()) PUTting export ffff8dc103486000 : new refcount 6 00000100:00000040:0.0:1788201268.051604:0:3656:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969457 00000100:00000040:0.0:1788201268.051610:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc003a70000 x1875060715294336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1788201268.051620:0:3656:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:0.0:1788201268.051624:0:3656:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261731 state=0: rc = 0 00000100:00000040:0.0:1788201268.051632:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc003a70000 x1875060715294336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201284 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201268.051640:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715294336:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1788201268.051650:0:3656:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:0.0:1788201268.051654:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc003a73480 x1875060715294208/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1788201268.051662:0:3656:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352767 avail=317064 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023575 state=0: rc = 0 00000100:00000040:0.0:1788201268.051669:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc003a73480 x1875060715294208/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201284 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201268.051676:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715294208:0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1788201268.051682:0:3656:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc003a70000 x1875060715294336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201284 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788201268.051690:0:3656:0:(genops.c:1223:class_import_put()) import ffff8dc1257f0800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1788201268.051698:0:3656:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc003a73480 x1875060715294208/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201284 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788201268.051716:0:3656:0:(genops.c:1223:class_import_put()) import ffff8dc109813800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1788201268.189138:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff8dc120090e00 x1875060695487872 msgsize 224 00000100:00100000:0.0:1788201268.189155:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00000040:0.0:1788201268.189192:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff8dc120092300 x1875060695488256 msgsize 224 00000100:00100000:0.0:1788201268.189197:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00000040:0.0:1788201268.189224:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff8dc0072ab850 x1875060695487744 msgsize 224 00000100:00100000:0.0:1788201268.189228:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00000040:0.0:1788201268.189230:0:3648:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1788201268.189246:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff8dc120092680 x1875060695488000 msgsize 224 00000100:00100000:0.0:1788201268.189250:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00000040:0.0:1788201268.189269:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff8dc120090380 x1875060695488128 msgsize 520 00000100:00100000:0.0:1788201268.189273:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201268.189297:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695488256 00000100:00100000:0.0:1788201268.189307:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695488256 00000020:00000040:0.0:1788201268.189310:0:26214:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c8e6 00000020:00000040:0.0:1788201268.189327:0:26214:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c6800 refcount=7 00000020:00000040:0.0:1788201268.189340:0:26214:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff8dc139bbcd28) now 10 - evictor 00000100:00000040:0.0:1788201268.189373:0:26214:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:0.0:1788201268.189394:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695488128 00000100:00100000:0.0:1788201268.189397:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695488128 00000020:00000040:0.0:1788201268.189399:0:26214:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c8df 00000100:00100000:0.0:1788201268.189416:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2922 00000100:00000040:0.0:1788201268.189421:0:26214:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c6800 : new rpc_count 1 00000100:00000040:0.0:1788201268.189429:0:26214:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc120092300 x1875060695488256/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:389/0 lens 224/0 e 0 to 0 dl 1788201279 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201268.189443:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2402:x1875060695488256:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000040:0.0:1788201268.189464:0:26214:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060695488256 00000100:00000040:0.0:1788201268.189474:0:26214:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 9 to 192.168.201.20@tcp 00000100:00000040:0.0:1788201268.189491:0:26214:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:0.0:1788201268.189529:0:26214:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 8 to 192.168.201.20@tcp 00000100:00000040:0.0:1788201268.189534:0:26214:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc120092300 x1875060695488256/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:389/0 lens 224/224 e 0 to 0 dl 1788201279 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201268.189544:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2402:x1875060695488256:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 103us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201268.189551:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2922 00000100:00000040:0.0:1788201268.189554:0:26214:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c6800 : new rpc_count 0 00000020:00000040:0.0:1788201268.189564:0:26214:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c6800 : new refcount 6 00000100:00100000:0.0:1788201268.189574:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5986 00000100:00000040:0.0:1788201268.189578:0:26214:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc120090380 x1875060695488128/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788201288 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201268.189587:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:2399:x1875060695488128:12345-192.168.201.20@tcp:8:kworker.0 00010000:00020000:0.0:1788201268.189606:0:26214:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:0.0:1788201268.189618:0:26214:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 9 to 192.168.201.20@tcp 00000100:00000040:0.0:1788201268.189620:0:26214:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8dc140da5c80 refcount 9 to 192.168.201.20@tcp 00000100:00000040:0.0:1788201268.189623:0:26214:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:0.0:1788201268.189634:0:26214:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 8 to 192.168.201.20@tcp 00000100:00000040:0.0:1788201268.189638:0:26214:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc120090380 x1875060695488128/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788201288 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201268.189647:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:2399:x1875060695488128:12345-192.168.201.20@tcp:8:kworker.0 Request processed in 59us (375us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201268.190050:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5986 00000100:00080000:0.0:1788201268.190075:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1788201268.190079:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff8dc139bbcd28) now 10 - evictor 00000100:00100000:1.0:1788201268.192485:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695487744 00000100:00100000:1.0:1788201268.192500:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695487744 00000020:00000040:1.0:1788201268.192504:0:94464:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4cc 00000020:00000040:1.0:1788201268.192509:0:94464:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc13aa9c000 refcount=10 00000100:00000040:1.0:1788201268.192534:0:94464:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788201268.192565:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 190 00000100:00000040:1.0:1788201268.192570:0:94464:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc13aa9c000 : new rpc_count 1 00000100:00000040:1.0:1788201268.192578:0:94464:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc0072ab850 x1875060695487744/t0(0) o400->93ba7067-43b5-4e46-8db7-27c040fa03d9@192.168.201.20@tcp:389/0 lens 224/0 e 0 to 0 dl 1788201279 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201268.192592:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695487744:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000040:1.0:1788201268.192612:0:94464:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060695487744 00000100:00000040:1.0:1788201268.192621:0:94464:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 9 to 192.168.201.20@tcp 00000100:00000040:1.0:1788201268.192627:0:94464:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:1.0:1788201268.193102:0:94464:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 8 to 192.168.201.20@tcp 00000100:00000040:1.0:1788201268.193262:0:94464:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc0072ab850 x1875060695487744/t0(0) o400->93ba7067-43b5-4e46-8db7-27c040fa03d9@192.168.201.20@tcp:389/0 lens 224/224 e 0 to 0 dl 1788201279 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201268.193275:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695487744:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 684us (4047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201268.193283:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 190 00000100:00000040:1.0:1788201268.193287:0:94464:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc13aa9c000 : new rpc_count 0 00000020:00000040:1.0:1788201268.193300:0:94464:0:(genops.c:879:class_export_put()) PUTting export ffff8dc13aa9c000 : new refcount 9 00000100:00100000:1.0:1788201268.193422:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695487872 00000100:00100000:1.0:1788201268.193427:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695487872 00000020:00000040:1.0:1788201268.193429:0:66314:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c551 00000020:00000040:1.0:1788201268.193434:0:66314:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc103483800 refcount=51 00000020:00000040:1.0:1788201268.193449:0:66314:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff8dc13f870000) now 14 - evictor 00000100:00100000:3.0:1788201268.193604:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695488000 00000100:00100000:3.0:1788201268.193609:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695488000 00000020:00000040:3.0:1788201268.193611:0:69485:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1bb4f 00000020:00000040:3.0:1788201268.193614:0:69485:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc12e647000 refcount=11 00000020:00000040:3.0:1788201268.193624:0:69485:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff8dc1060e4d28) now 10 - evictor 00000100:00000040:1.0:1788201268.193651:0:66314:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:1.0:1788201268.193684:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1539 00000100:00000040:1.0:1788201268.193688:0:66314:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc103483800 : new rpc_count 1 00000100:00000040:1.0:1788201268.193693:0:66314:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc120090e00 x1875060695487872/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:389/0 lens 224/0 e 0 to 0 dl 1788201279 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201268.193705:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2402:x1875060695487872:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000040:1.0:1788201268.193722:0:66314:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 124554051730, transno 0, xid 1875060695487872 00000100:00000040:1.0:1788201268.193730:0:66314:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 9 to 192.168.201.20@tcp 00000100:00000040:1.0:1788201268.193734:0:66314:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:1.0:1788201268.193760:0:66314:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 8 to 192.168.201.20@tcp 00000100:00000040:1.0:1788201268.193765:0:66314:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc120090e00 x1875060695487872/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:389/0 lens 224/224 e 0 to 0 dl 1788201279 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201268.193774:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2402:x1875060695487872:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 71us (4638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201268.193781:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1539 00000100:00000040:1.0:1788201268.193784:0:66314:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc103483800 : new rpc_count 0 00000020:00000040:1.0:1788201268.193790:0:66314:0:(genops.c:879:class_export_put()) PUTting export ffff8dc103483800 : new refcount 50 00000100:00080000:0.0:1788201268.195833:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1788201268.195853:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001 (ffff8dc1060e4d28) now 10 - evictor 00000100:00080000:0.0:1788201268.195858:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1788201268.195860:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (ffff8dc13f870000) now 14 - evictor 00000100:00000040:3.0:1788201268.197944:0:69485:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:3.0:1788201268.198061:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1540 00000100:00000040:3.0:1788201268.198066:0:69485:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc12e647000 : new rpc_count 1 00000100:00000040:3.0:1788201268.198075:0:69485:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc120092680 x1875060695488000/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:389/0 lens 224/0 e 0 to 0 dl 1788201279 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201268.198093:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695488000:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000040:3.0:1788201268.198128:0:69485:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 77309411473, transno 0, xid 1875060695488000 00000100:00000040:3.0:1788201268.198139:0:69485:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 9 to 192.168.201.20@tcp 00000100:00000040:3.0:1788201268.198144:0:69485:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:3.0:1788201268.198198:0:69485:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 8 to 192.168.201.20@tcp 00000100:00000040:3.0:1788201268.198216:0:69485:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc120092680 x1875060695488000/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:389/0 lens 224/224 e 0 to 0 dl 1788201279 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201268.198226:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695488000:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 139us (8977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201268.198233:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1540 00000100:00000040:3.0:1788201268.198236:0:69485:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc12e647000 : new rpc_count 0 00000020:00000040:3.0:1788201268.198246:0:69485:0:(genops.c:879:class_export_put()) PUTting export ffff8dc12e647000 : new refcount 10 00010000:00010000:0.0:1788201269.008276:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201270.032755:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:3.0:1788201270.607401:0:75750:0:(genops.c:1210:class_import_get()) import ffff8dc1031f8800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:3.0:1788201270.607508:0:75750:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000bf80cca7] to pc [ptlrpcd_00_02+2] req@ffff8dc11d29ca80 x1875060715294464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201270.607579:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc11d29ca80 x1875060715294464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201270.607593:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715294464:0@lo:13:osp-pre-1-1.0 00000100:00000040:2.0:1788201270.607640:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc11d29ca80 x1875060715294464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201286 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201270.607647:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201270.607687:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff8dc12fb0ed80 x1875060715294464 msgsize 224 00000100:00100000:2.0:1788201270.607692:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201270.607730:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc11d29ca80 x1875060715294464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201286 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201270.607743:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5593 usecs (6 jiffies) 00000100:00100000:0.0:1788201270.607911:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715294464 00000100:00100000:0.0:1788201270.607919:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715294464 00000020:00000040:0.0:1788201270.607922:0:8451:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a163d6 00000020:00000040:0.0:1788201270.607927:0:8451:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1201ce800 refcount=5 00000020:00000040:0.0:1788201270.607941:0:8451:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff8dc139bbcd28) now 10 - evictor 00000100:00000040:0.0:1788201270.607973:0:8451:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:0.0:1788201270.607999:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2371 00000100:00000040:0.0:1788201270.608003:0:8451:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1201ce800 : new rpc_count 1 00000100:00000040:0.0:1788201270.608008:0:8451:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc12fb0ed80 x1875060715294464/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:391/0 lens 224/0 e 0 to 0 dl 1788201281 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201270.608044:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715294464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201270.608082:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00010000:00000040:0.0:1788201270.608094:0:8451:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969442, transno 0, xid 1875060715294464 00000100:00000040:0.0:1788201270.608104:0:8451:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:0.0:1788201270.608109:0:8451:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201270.608129:0:8451:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8dc11d29ca80 x1875060715294464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201286 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201270.608699:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1788201270.608704:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff8dc139bbcd28) now 10 - evictor 00000100:00000040:0.0:1788201270.617797:0:8451:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:0.0:1788201270.617814:0:8451:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12fb0ed80 x1875060715294464/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:391/0 lens 224/368 e 0 to 0 dl 1788201281 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201270.617826:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715294464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 9785us (10136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201270.617836:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2371 00000100:00000040:0.0:1788201270.617840:0:8451:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1201ce800 : new rpc_count 0 00000020:00000040:0.0:1788201270.617873:0:8451:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1201ce800 : new refcount 4 00000100:00000040:2.0:1788201270.622568:0:3657:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969442 00000100:00000040:2.0:1788201270.622584:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc11d29ca80 x1875060715294464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1788201270.622598:0:3657:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:2.0:1788201270.622602:0:3657:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261731 state=0: rc = 0 00000100:00000040:2.0:1788201270.622612:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29ca80 x1875060715294464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201286 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201270.622620:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715294464:0@lo:13:osp-pre-1-1.0 00000100:00000040:2.0:1788201270.622628:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc11d29ca80 x1875060715294464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201286 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788201270.622653:0:3657:0:(genops.c:1223:class_import_put()) import ffff8dc1031f8800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000020:01000004:2.0:1788201270.822123:0:97034:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788201270.822127:0:97034:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788201270.822129:0:97034:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788201270.822243:0:97034:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dc120724000 00000020:01000004:2.0:1788201270.822260:0:97034:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788201270.822320:0:97034:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788201270.822334:0:97034:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8dc12f0c4d28) 00000020:00000040:2.0:1788201270.822342:0:97034:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8dc120727000 with handle 0x96d0c9b8c9a1d4a1 to hash 00000020:00000040:2.0:1788201270.822349:0:97034:0:(genops.c:879:class_export_put()) PUTting export ffff8dc120727000 : new refcount 1 00000020:00000040:2.0:1788201270.822356:0:97034:0:(obd_config.c:995:class_incref()) incref lustre-OST0000-osd (ffff8dc12f0c4d28) now 2 - obd_device_list 00000020:00000080:2.0:1788201270.822361:0:97034:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00010000:00010000:2.0:1788201271.055364:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000040:2.0:1788201271.655867:0:97034:0:(osd_compat.c:234:osd_last_rcvd_subdir_count()) read last_rcvd header, uuid = lustre-OST0000_UUID, subdir count = 32 00100000:10000000:3.0:1788201271.678395:0:97034:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788201271.680220:0:97034:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788201271.680253:0:97034:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788201271.680275:0:97034:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788201271.680307:0:97034:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788201271.680329:0:97034:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788201271.680397:0:97034:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1788201271.682147:0:97034:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000040:3.0:1788201271.682611:0:97034:0:(obd_config.c:995:class_incref()) incref lustre-OST0000-osd (ffff8dc12f0c4d28) now 3 - setup 00000020:00000080:3.0:1788201271.682618:0:97034:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788201271.682630:0:97034:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000040:3.0:1788201271.682637:0:97034:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8dc1201ca000 with handle 0x96d0c9b8c9a1d4a8 to hash 00000020:00000040:3.0:1788201271.682645:0:97034:0:(obd_config.c:995:class_incref()) incref lustre-OST0000-osd (ffff8dc12f0c4d28) now 4 - export 00000020:00000040:3.0:1788201271.682649:0:97034:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1201ca000 : new refcount 1 00000020:00000080:3.0:1788201271.682651:0:97034:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x96d0c9b8c9a1d4a8 00000020:00000040:3.0:1788201271.682654:0:97034:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4a8 00000020:00000040:3.0:1788201271.682667:0:97034:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1201ca000 refcount=2 00000020:01000004:3.0:1788201271.682674:0:97034:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788201271.682699:0:97034:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.120@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788201271.682703:0:97034:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788201271.682711:0:97034:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788201271.682742:0:97034:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788201271.682746:0:97034:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000020:00000040:3.0:1788201271.685923:0:97034:0:(genops.c:868:class_export_get()) GET export ffff8dc120727000 refcount=2 00000040:00000040:3.0:1788201271.685931:0:97034:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8dc12fb11000 : new refcount 2 00000040:00000040:3.0:1788201271.687821:0:97034:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8dc12fb11000 : new refcount 1 00000040:01000000:3.0:1788201271.687827:0:97034:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 10000000:00000040:3.0:1788201271.687831:0:97034:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8dc12fb11000 : new refcount 2 10000000:00000040:3.0:1788201271.687833:0:97034:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8dc12fb11000 : new refcount 1 00000020:00000040:3.0:1788201271.687836:0:97034:0:(obd_config.c:995:class_incref()) incref MGC192.168.201.120@tcp (ffff8dc12563cd28) now 6 - mgc_fs 00000020:01000004:3.0:1788201271.688165:0:97034:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.120@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788201271.688170:0:97034:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788201271.688172:0:97034:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201271.688173:0:97034:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201271.688174:0:97034:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201271.688176:0:97034:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201271.688177:0:97034:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201271.688179:0:97034:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201271.688180:0:97034:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201271.688181:0:97034:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788201271.688185:0:97034:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788201271.688187:0:97034:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788201271.688188:0:97034:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201271.688189:0:97034:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201271.688190:0:97034:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201271.688192:0:97034:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201271.688193:0:97034:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201271.688194:0:97034:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201271.688195:0:97034:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201271.688196:0:97034:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:00000040:3.0:1788201271.688203:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 10000000:01000000:3.0:1788201271.688224:0:97034:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:3.0:1788201271.688245:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc11d29c700 x1875060715294592/t0(0) o253->MGC192.168.201.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.688260:0:97034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715294592:0@lo:253:mount.lustre.0 00000100:00000040:3.0:1788201271.688299:0:97034:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc11d29c700 x1875060715294592/t0(0) o253->MGC192.168.201.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788201287 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.688309:0:97034:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201271.688955:0:97034:0:(events.c:337:request_in_callback()) incoming req@ffff8dc0072aac50 x1875060715294592 msgsize 4848 00000100:00100000:3.0:1788201271.688963:0:97034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201271.688965:0:97034:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788201271.689163:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8dc11d29c700 x1875060715294592/t0(0) o253->MGC192.168.201.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788201287 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.689196:0:97034:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201271.692639:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715294592 00000100:00100000:0.0:1788201271.692656:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715294592 00000020:00000040:0.0:1788201271.692659:0:94461:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:0.0:1788201271.692665:0:94461:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=21 00000100:00000040:0.0:1788201271.692726:0:94461:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788201271.692763:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00000040:0.0:1788201271.692769:0:94461:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:0.0:1788201271.692777:0:94461:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc0072aac50 x1875060715294592/t0(0) o253->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 4848/0 e 0 to 0 dl 1788201282 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.692804:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:97034:x1875060715294592:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788201271.692840:0:94461:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788201271.692842:0:94461:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788201271.692846:0:94461:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00000040:0.0:1788201271.693401:0:94461:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715294592 00000100:00000040:0.0:1788201271.693413:0:94461:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:0.0:1788201271.693421:0:94461:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201271.693471:0:94461:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff8dc11d29c700 x1875060715294592/t0(0) o253->MGC192.168.201.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201271.693503:0:94461:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:0.0:1788201271.693508:0:94461:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc0072aac50 x1875060715294592/t0(0) o253->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 4848/4768 e 0 to 0 dl 1788201282 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.693517:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:97034:x1875060715294592:12345-0@lo:253:mount.lustre.0 Request processed in 718us (4561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201271.693525:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00000040:0.0:1788201271.693528:0:94461:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:0.0:1788201271.693540:0:94461:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 20 00000100:00000040:3.0:1788201271.696853:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc11d29c700 x1875060715294592/t0(0) o253->MGC192.168.201.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.696882:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29c700 x1875060715294592/t0(0) o253->MGC192.168.201.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788201287 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.696891:0:97034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715294592:0@lo:253:mount.lustre.0 00000100:00000040:3.0:1788201271.696900:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc11d29c700 x1875060715294592/t0(0) o253->MGC192.168.201.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788201287 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788201271.696915:0:97034:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788201271.696919:0:97034:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788201271.696921:0:97034:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201271.696923:0:97034:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201271.696924:0:97034:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201271.696926:0:97034:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201271.696928:0:97034:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201271.696929:0:97034:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201271.696931:0:97034:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201271.696932:0:97034:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000100:00000040:3.0:1788201271.696952:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc11d29c700 x1875060715294592/t0(0) o253->MGC192.168.201.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788201287 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201271.696964:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 00000020:01000004:3.0:1788201271.696985:0:97034:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dc120724000 from lustre-OST0000 10000000:01000000:2.0:1788201271.704641:0:97034:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788201271.704651:0:97034:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:00000040:2.0:1788201271.704661:0:97034:0:(mgc_request.c:108:config_log_get()) log lustre-sptlrpc (ffff8dc106085c00) refs 5 10000000:01000000:2.0:1788201271.704666:0:97034:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8dc12563cd28 local copy 00000020:00000040:2.0:1788201271.704671:0:97034:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc0078fcc00 refcount=2 00010000:00010000:2.0:1788201271.704680:0:97034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1cabb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1cac2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:2.0:1788201271.704802:0:97034:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8dc109832540 : new refcount 2 10000000:00000040:2.0:1788201271.704807:0:97034:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8dc12fb11000 : new refcount 2 10000000:00000040:2.0:1788201271.704809:0:97034:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.201.120@tcp: copy local log lustre-sptlrpc 00000020:00000040:2.0:1788201271.704862:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:2.0:1788201271.704881:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=5 obd=MGC192.168.201.120@tcp 00000100:00000040:2.0:1788201271.704924:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc12ee2ca80 x1875060715294720/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.704939:0:97034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715294720:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1788201271.705589:0:97034:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc12ee2ca80 x1875060715294720/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788201287 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.705599:0:97034:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201271.705641:0:97034:0:(events.c:337:request_in_callback()) incoming req@ffff8dc1330ff850 x1875060715294720 msgsize 512 00000100:00100000:2.0:1788201271.705646:0:97034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201271.705648:0:97034:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788201271.705679:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8dc12ee2ca80 x1875060715294720/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788201287 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.705793:0:97034:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fae1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201271.705876:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715294720 00000100:00100000:0.0:1788201271.705894:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715294720 00000020:00000040:0.0:1788201271.705897:0:94467:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:0.0:1788201271.705901:0:94467:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=21 00000100:00000040:0.0:1788201271.705923:0:94467:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788201271.705959:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00000040:0.0:1788201271.705964:0:94467:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:0.0:1788201271.705970:0:94467:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc1330ff850 x1875060715294720/t0(0) o501->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 512/0 e 0 to 0 dl 1788201282 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.706052:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:97034:x1875060715294720:12345-0@lo:501:mount.lustre.0 00000040:00000040:0.0:1788201271.706141:0:94467:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-sptlrpc 00000040:00000040:0.0:1788201271.706145:0:94467:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8dc140ffbe40 : new refcount 2 00000040:00000040:0.0:1788201271.706172:0:94467:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8dc140ffbe40 : new refcount 1 00010000:00000040:0.0:1788201271.706176:0:94467:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715294720 00000100:00000040:0.0:1788201271.706186:0:94467:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:0.0:1788201271.706190:0:94467:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201271.706209:0:94467:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff8dc12ee2ca80 x1875060715294720/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201271.708012:0:94467:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:0.0:1788201271.708041:0:94467:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc1330ff850 x1875060715294720/t0(0) o501->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 512/272 e 0 to 0 dl 1788201282 ref 1 fl Interpret:/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.708053:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:97034:x1875060715294720:12345-0@lo:501:mount.lustre.0 Request processed in 2072us (2410us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201271.708063:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00000040:0.0:1788201271.708066:0:94467:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:0.0:1788201271.708089:0:94467:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 20 00000100:00000040:2.0:1788201271.711339:0:97034:0:(client.c:1510:ptlrpc_check_status()) @@@ check status: rc = -2 req@ffff8dc12ee2ca80 x1875060715294720/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQU/200/0 rc 0/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.711357:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc12ee2ca80 x1875060715294720/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.711367:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12ee2ca80 x1875060715294720/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788201287 ref 2 fl Interpret:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.711374:0:97034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715294720:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1788201271.711385:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc12ee2ca80 x1875060715294720/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788201287 ref 2 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788201271.711399:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000100:00000040:2.0:1788201271.711404:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc12ee2ca80 x1875060715294720/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788201287 ref 1 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788201271.711415:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 10000000:01000000:2.0:1788201271.711428:0:97034:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788201271.711480:0:97034:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00000020:00000040:2.0:1788201271.711487:0:97034:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc0078fcc00 refcount=3 00010000:00010000:2.0:1788201271.711494:0:97034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1cabb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1cac2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201271.711521:0:97034:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1cabb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1cac2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201271.711560:0:97034:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dc120724000 10000000:01000000:2.0:1788201271.711566:0:97034:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00000020:00000040:2.0:1788201271.711571:0:97034:0:(genops.c:868:class_export_get()) GET export ffff8dc104285000 refcount=18 10000000:00000040:2.0:1788201271.711575:0:97034:0:(mgc_request.c:108:config_log_get()) log nodemap (ffff8dc12f1be400) refs 4 10000000:01000000:2.0:1788201271.711577:0:97034:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788201271.711581:0:97034:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:2.0:1788201271.711583:0:97034:0:(genops.c:868:class_export_get()) GET export ffff8dc104285000 refcount=19 10000000:01000000:2.0:1788201271.711588:0:97034:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788201271.711590:0:97034:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00000020:00000040:2.0:1788201271.711597:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00010000:00000040:2.0:1788201271.711618:0:97034:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff8dc12196ed00 count: 8 00000020:00000040:2.0:1788201271.711627:0:97034:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8dc006dbc600 with handle 0x96d0c9b8c9a1d4af to hash 00010000:00010000:2.0:1788201271.711634:0:97034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc600/0x96d0c9b8c9a1d4af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201271.711642:0:97034:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc600/0x96d0c9b8c9a1d4af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201271.711652:0:97034:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc600/0x96d0c9b8c9a1d4af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1788201271.711669:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc12ee2ca80 x1875060715294848/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.711680:0:97034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715294848:0@lo:101:mount.lustre.0 00000100:00000040:2.0:1788201271.711702:0:97034:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc12ee2ca80 x1875060715294848/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201287 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.711717:0:97034:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201271.711763:0:97034:0:(events.c:337:request_in_callback()) incoming req@ffff8dc1330fc050 x1875060715294848 msgsize 328 00000100:00100000:2.0:1788201271.711767:0:97034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201271.711770:0:97034:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788201271.711856:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8dc12ee2ca80 x1875060715294848/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201287 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.711885:0:97034:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fae1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201271.716348:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715294848 00000100:00100000:0.0:1788201271.716365:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715294848 00000020:00000040:0.0:1788201271.716369:0:94461:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:0.0:1788201271.716374:0:94461:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=21 00000100:00000040:1.0:1788201271.716801:0:94461:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788201271.716925:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00000040:1.0:1788201271.716931:0:94461:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:1.0:1788201271.716941:0:94461:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc1330fc050 x1875060715294848/t0(0) o101->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 328/0 e 0 to 0 dl 1788201282 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.716967:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:97034:x1875060715294848:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201271.716993:0:94461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:1.0:1788201271.717005:0:94461:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff8dc11248c700 count: 10 00000020:00000040:1.0:1788201271.717028:0:94461:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8dc1064eca00 with handle 0x96d0c9b8c9a1d4b6 to hash 00010000:00010000:1.0:1788201271.717035:0:94461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064eca00/0x96d0c9b8c9a1d4b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1d4af expref: -99 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788201271.717043:0:94461:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff8dc110735800 : new locks_count 16 00000020:00000040:1.0:1788201271.717046:0:94461:0:(genops.c:868:class_export_get()) GET export ffff8dc110735800 refcount=22 00010000:00000040:1.0:1788201271.717065:0:94461:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff8dc11248c700) refcount = 10 00010000:00000040:1.0:1788201271.717068:0:94461:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1788201271.717187:0:94461:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc007adf600/0x96d0c9b8c9a1cac2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1cabb expref: 22 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788201271.717197:0:94461:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc00896b000/0x96d0c9b8c9a1ca98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca91 expref: 22 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788201271.717204:0:94461:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc0078fd200/0x96d0c9b8c9a1ca8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca83 expref: 22 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788201271.717212:0:94461:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1ca7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca75 expref: 22 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788201271.717219:0:94461:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc140d59800/0x96d0c9b8c9a1ca6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca67 expref: 22 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788201271.717226:0:94461:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc140d58400/0x96d0c9b8c9a1ca60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca59 expref: 22 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788201271.717233:0:94461:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc00896aa00/0x96d0c9b8c9a1ca52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca4b expref: 22 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788201271.717250:0:94461:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc00896ba00/0x96d0c9b8c9a1ca44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78698a expref: 9 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788201271.717258:0:94461:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc140d59e00/0x96d0c9b8c9a1ca3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786983 expref: 9 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201271.717266:0:94461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064eca00/0x96d0c9b8c9a1d4b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d4af expref: 22 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201271.717278:0:94461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064eca00/0x96d0c9b8c9a1d4b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d4af expref: 22 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201271.717297:0:94461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064eca00, rc 0) 00010000:00000040:1.0:1788201271.717301:0:94461:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715294848 00000100:00000040:1.0:1788201271.717312:0:94461:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:1.0:1788201271.717318:0:94461:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201271.717366:0:94461:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff8dc12ee2ca80 x1875060715294848/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.717400:0:94461:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:1.0:1788201271.717404:0:94461:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc1330fc050 x1875060715294848/t0(0) o101->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 328/344 e 0 to 0 dl 1788201282 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.717412:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:97034:x1875060715294848:12345-0@lo:101:mount.lustre.0 Request processed in 450us (5649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201271.717419:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00000040:1.0:1788201271.717422:0:94461:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:1.0:1788201271.717433:0:94461:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 21 00000100:00000040:0.0:1788201271.717517:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc12ee2ca80 x1875060715294848/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201271.717527:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12ee2ca80 x1875060715294848/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201287 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.717534:0:97034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715294848:0@lo:101:mount.lustre.0 00000100:00000040:0.0:1788201271.717543:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc12ee2ca80 x1875060715294848/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201287 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788201271.717554:0:97034:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc006dbc600 refcount=4 00010000:00000040:0.0:1788201271.717559:0:97034:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff8dc006dbc600, remote cookie: 0x96d0c9b8c9a1d4b6, flags: 0x0 00010000:00000040:0.0:1788201271.717564:0:97034:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff8dc12196ed00) refcount = 8 00010000:00000040:0.0:1788201271.717566:0:97034:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1788201271.717569:0:97034:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1cabb lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1cac2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788201271.717576:0:97034:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1ca91 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ca98 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788201271.717582:0:97034:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.201.120@tcp lock: ffff8dc007adf800/0x96d0c9b8c9a1ca83 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ca8a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788201271.717588:0:97034:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.201.120@tcp lock: ffff8dc0078fda00/0x96d0c9b8c9a1ca75 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ca7c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788201271.717594:0:97034:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1ca67 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ca6e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788201271.717601:0:97034:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.201.120@tcp lock: ffff8dc007adee00/0x96d0c9b8c9a1ca59 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ca60 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788201271.717606:0:97034:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.201.120@tcp lock: ffff8dc007ade400/0x96d0c9b8c9a1ca4b lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ca52 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201271.717618:0:97034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc600/0x96d0c9b8c9a1d4af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d4b6 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201271.717626:0:97034:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc600/0x96d0c9b8c9a1d4af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d4b6 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1788201271.717636:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc12ee2ca80 x1875060715294848/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201287 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788201271.717646:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 10000000:00000040:0.0:1788201271.717654:0:97034:0:(mgc_request.c:108:config_log_get()) log lustre-OST0000 (ffff8dc12bc32400) refs 2 00000020:00000040:0.0:1788201271.717658:0:97034:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc006dbc600 refcount=3 10000000:00000040:0.0:1788201271.717691:0:97034:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8dc109832540 : new refcount 2 10000000:00000040:0.0:1788201271.717695:0:97034:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8dc12fb11000 : new refcount 2 10000000:00000040:0.0:1788201271.717697:0:97034:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.201.120@tcp: copy local log lustre-OST0000 00000040:00080000:0.0:1788201271.717889:0:97034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788201271.719123:0:97034:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201271.722826:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788201271.724231:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788201271.724264:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788201271.724282:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788201271.724307:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788201271.724319:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788201271.724342:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788201271.724347:0:97034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000020:00000040:0.0:1788201271.724422:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:0.0:1788201271.724429:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=5 obd=MGC192.168.201.120@tcp 00000100:00000040:0.0:1788201271.724470:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc120091180 x1875060715294976/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.724483:0:97034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715294976:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1788201271.724527:0:97034:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc120091180 x1875060715294976/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788201287 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201271.724535:0:97034:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201271.724578:0:97034:0:(events.c:337:request_in_callback()) incoming req@ffff8dc1330fe050 x1875060715294976 msgsize 512 00000100:00100000:0.0:1788201271.724583:0:97034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788201271.724585:0:97034:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1788201271.724610:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8dc120091180 x1875060715294976/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788201287 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.724641:0:97034:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038e0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201271.725332:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715294976 00000100:00100000:2.0:1788201271.725341:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715294976 00000020:00000040:2.0:1788201271.725345:0:94464:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:2.0:1788201271.725349:0:94464:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=22 00000100:00000040:2.0:1788201271.725371:0:94464:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1788201271.725403:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00000040:2.0:1788201271.725407:0:94464:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:2.0:1788201271.725414:0:94464:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc1330fe050 x1875060715294976/t0(0) o501->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 512/0 e 0 to 0 dl 1788201282 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.725426:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:97034:x1875060715294976:12345-0@lo:501:mount.lustre.0 00000040:00000040:2.0:1788201271.725448:0:94464:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-OST0000 00000040:00000040:2.0:1788201271.725451:0:94464:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8dc140ffbe40 : new refcount 2 00000040:00000040:2.0:1788201271.725521:0:94464:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8dc140ffbe40 : new refcount 1 00000020:00000040:2.0:1788201271.725531:0:94464:0:(genops.c:868:class_export_get()) GET export ffff8dc110735800 refcount=23 00000020:00000040:2.0:1788201271.725535:0:94464:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 22 00010000:00000040:2.0:1788201271.725540:0:94464:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715294976 00000100:00000040:2.0:1788201271.725550:0:94464:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:2.0:1788201271.725555:0:94464:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201271.725582:0:94464:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff8dc120091180 x1875060715294976/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.725621:0:94464:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:2.0:1788201271.725627:0:94464:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc1330fe050 x1875060715294976/t0(0) o501->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 512/272 e 0 to 0 dl 1788201282 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.725647:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:97034:x1875060715294976:12345-0@lo:501:mount.lustre.0 Request processed in 222us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201271.725655:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00000040:2.0:1788201271.725658:0:94464:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:2.0:1788201271.725666:0:94464:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 21 00000100:00000040:3.0:1788201271.725898:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc120091180 x1875060715294976/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.725909:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc120091180 x1875060715294976/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788201287 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.725917:0:97034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715294976:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1788201271.725925:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc120091180 x1875060715294976/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788201287 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201271.725936:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000100:00000040:3.0:1788201271.725940:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc120091180 x1875060715294976/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788201287 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201271.725950:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 00000020:00000040:3.0:1788201271.725964:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:3.0:1788201271.725969:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=5 obd=MGC192.168.201.120@tcp 00000100:00000040:3.0:1788201271.727163:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc11d29c700 x1875060715295104/t0(0) o503->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.727179:0:97034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715295104:0@lo:503:mount.lustre.0 00000100:00000040:3.0:1788201271.727217:0:97034:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc11d29c700 x1875060715295104/t0(0) o503->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788201287 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.727225:0:97034:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201271.727255:0:97034:0:(events.c:337:request_in_callback()) incoming req@ffff8dc1330fc450 x1875060715295104 msgsize 272 00000100:00100000:3.0:1788201271.727260:0:97034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201271.727262:0:97034:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788201271.727296:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8dc11d29c700 x1875060715295104/t0(0) o503->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788201287 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.727329:0:97034:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201271.727447:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715295104 00000100:00100000:2.0:1788201271.727455:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715295104 00000020:00000040:2.0:1788201271.727458:0:94463:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:2.0:1788201271.727462:0:94463:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=22 00000100:00000040:2.0:1788201271.727481:0:94463:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1788201271.727512:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00000040:2.0:1788201271.727517:0:94463:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:2.0:1788201271.727522:0:94463:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc1330fc450 x1875060715295104/t0(0) o503->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 272/0 e 0 to 0 dl 1788201282 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.727533:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:97034:x1875060715295104:12345-0@lo:503:mount.lustre.0 00000040:00000040:2.0:1788201271.727560:0:94463:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8dc140ffbe40 : new refcount 2 00000040:00000040:2.0:1788201271.727607:0:94463:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8dc140ffbe40 : new refcount 1 00010000:00000040:2.0:1788201271.727612:0:94463:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715295104 00000100:00000040:2.0:1788201271.727620:0:94463:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:2.0:1788201271.727624:0:94463:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201271.727645:0:94463:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff8dc11d29c700 x1875060715295104/t0(0) o503->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.727715:0:94463:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:2.0:1788201271.727721:0:94463:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc1330fc450 x1875060715295104/t0(0) o503->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 272/8416 e 0 to 0 dl 1788201282 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.727729:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:97034:x1875060715295104:12345-0@lo:503:mount.lustre.0 Request processed in 198us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201271.727744:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00000040:2.0:1788201271.727747:0:94463:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:2.0:1788201271.727756:0:94463:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 21 00000100:00000040:0.0:1788201271.734266:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc11d29c700 x1875060715295104/t0(0) o503->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201271.734283:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29c700 x1875060715295104/t0(0) o503->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788201287 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.734301:0:97034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715295104:0@lo:503:mount.lustre.0 00000100:00000040:0.0:1788201271.734309:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc11d29c700 x1875060715295104/t0(0) o503->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788201287 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201271.734326:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc11d29c700 x1875060715295104/t0(0) o503->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788201287 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788201271.734351:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:1.0:1788201271.734470:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 00000040:00080000:1.0:1788201271.736324:0:97034:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:1.0:1788201271.736403:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:1.0:1788201271.736411:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=5 obd=MGC192.168.201.120@tcp 00000100:00000040:1.0:1788201271.736446:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc003a73480 x1875060715295232/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.736461:0:97034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715295232:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1788201271.736498:0:97034:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc003a73480 x1875060715295232/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.736507:0:97034:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201271.736548:0:97034:0:(events.c:337:request_in_callback()) incoming req@ffff8dc107d23050 x1875060715295232 msgsize 272 00000100:00100000:1.0:1788201271.736554:0:97034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788201271.736556:0:97034:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1788201271.736577:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8dc003a73480 x1875060715295232/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.736606:0:97034:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1060ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201271.741483:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715295232 00000100:00100000:0.0:1788201271.741504:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715295232 00000020:00000040:0.0:1788201271.741509:0:94467:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:0.0:1788201271.741515:0:94467:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=22 00000100:00000040:0.0:1788201271.741551:0:94467:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788201271.741594:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00000040:0.0:1788201271.741599:0:94467:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:0.0:1788201271.741609:0:94467:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc107d23050 x1875060715295232/t0(0) o502->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 272/0 e 0 to 0 dl 1788201282 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.741645:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+22:97034:x1875060715295232:12345-0@lo:502:mount.lustre.0 00000040:00000040:0.0:1788201271.741685:0:94467:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8dc140ffbe40 : new refcount 2 00000040:00000040:0.0:1788201271.742598:0:94467:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8dc140ffbe40 : new refcount 1 00010000:00000040:0.0:1788201271.742606:0:94467:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715295232 00000100:00000040:0.0:1788201271.742619:0:94467:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:0.0:1788201271.742625:0:94467:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201271.742680:0:94467:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff8dc003a73480 x1875060715295232/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201271.742719:0:94467:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:0.0:1788201271.742725:0:94467:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc107d23050 x1875060715295232/t0(0) o502->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 272/8472 e 0 to 0 dl 1788201282 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.742735:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+22:97034:x1875060715295232:12345-0@lo:502:mount.lustre.0 Request processed in 1093us (6185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201271.742743:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00000040:0.0:1788201271.742747:0:94467:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:0.0:1788201271.742757:0:94467:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 21 00000100:00000040:1.0:1788201271.742867:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc003a73480 x1875060715295232/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.742878:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc003a73480 x1875060715295232/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.742886:0:97034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715295232:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1788201271.742895:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc003a73480 x1875060715295232/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.742908:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc003a73480 x1875060715295232/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201271.742925:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:1.0:1788201271.742946:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 00000040:00080000:1.0:1788201271.743233:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788201271.743265:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788201271.743302:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788201271.743317:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788201271.743330:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788201271.743351:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788201271.743369:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788201271.743381:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788201271.743393:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788201271.743419:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788201271.743433:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788201271.743448:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000020:00000040:1.0:1788201271.743454:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:1.0:1788201271.743459:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=5 obd=MGC192.168.201.120@tcp 00000100:00000040:1.0:1788201271.743483:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc003a73480 x1875060715295360/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.743496:0:97034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715295360:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1788201271.743524:0:97034:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc003a73480 x1875060715295360/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.743531:0:97034:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201271.743554:0:97034:0:(events.c:337:request_in_callback()) incoming req@ffff8dc004c3e050 x1875060715295360 msgsize 272 00000100:00100000:1.0:1788201271.743559:0:97034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788201271.743561:0:97034:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1788201271.743583:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8dc003a73480 x1875060715295360/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.743609:0:97034:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1060ca000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201271.743897:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715295360 00000100:00100000:2.0:1788201271.743904:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715295360 00000020:00000040:2.0:1788201271.743908:0:94463:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:2.0:1788201271.743913:0:94463:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=22 00000100:00000040:2.0:1788201271.743933:0:94463:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1788201271.743962:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00000040:2.0:1788201271.743966:0:94463:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:2.0:1788201271.743971:0:94463:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc004c3e050 x1875060715295360/t0(0) o502->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 272/0 e 0 to 0 dl 1788201282 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.743994:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:97034:x1875060715295360:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1788201271.744038:0:94463:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8dc140ffbe40 : new refcount 2 00000040:00000040:2.0:1788201271.744095:0:94463:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8dc140ffbe40 : new refcount 1 00010000:00000040:2.0:1788201271.744099:0:94463:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715295360 00000100:00000040:2.0:1788201271.744106:0:94463:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:2.0:1788201271.744110:0:94463:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201271.744131:0:94463:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff8dc003a73480 x1875060715295360/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.744154:0:94463:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:2.0:1788201271.744158:0:94463:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc004c3e050 x1875060715295360/t0(0) o502->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 272/8472 e 0 to 0 dl 1788201282 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.744166:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:97034:x1875060715295360:12345-0@lo:502:mount.lustre.0 Request processed in 184us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201271.744173:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00000040:2.0:1788201271.744175:0:94463:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:2.0:1788201271.744188:0:94463:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 21 00000100:00000040:1.0:1788201271.744379:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc003a73480 x1875060715295360/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.744392:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc003a73480 x1875060715295360/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.744400:0:97034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715295360:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1788201271.744609:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc003a73480 x1875060715295360/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.744622:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc003a73480 x1875060715295360/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201271.744637:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:1.0:1788201271.744643:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 00000040:00080000:1.0:1788201271.744675:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788201271.744684:0:97034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 10000000:00000040:1.0:1788201271.744983:0:97034:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8dc109832540 : new refcount 1 00000020:00000040:1.0:1788201271.744988:0:97034:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-OST0000 00000020:01000000:2.0:1788201271.745691:0:97038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788201271.745700:0:97038:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788201271.745706:0:97038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201271.745708:0:97038:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788201271.745715:0:97038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201271.745731:0:97038:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8dc004fd4d28) 00000020:00000040:2.0:1788201271.745738:0:97038:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8dc003b6c800 with handle 0x96d0c9b8c9a1d4bd to hash 00000020:00000040:2.0:1788201271.745743:0:97038:0:(genops.c:879:class_export_put()) PUTting export ffff8dc003b6c800 : new refcount 1 00000020:00000040:2.0:1788201271.745757:0:97038:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8dc004fd4d28) now 2 - obd_device_list 00000020:00000080:2.0:1788201271.745763:0:97038:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000040:2.0:1788201271.745768:0:97038:0:(obd_config.c:1949:class_config_llog_handler()) For 1.8 interoperability, set this index to '0' 00000020:00000080:2.0:1788201271.745770:0:97038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788201271.748092:0:97038:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc120724000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788201271.748113:0:97038:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000040:2.0:1788201271.748121:0:97038:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8dc001e2e000 with handle 0x96d0c9b8c9a1d4c4 to hash 00000020:00000040:2.0:1788201271.748129:0:97038:0:(obd_config.c:995:class_incref()) incref lustre-OST0000-osd (ffff8dc12f0c4d28) now 5 - export 00000020:00000040:2.0:1788201271.748133:0:97038:0:(genops.c:879:class_export_put()) PUTting export ffff8dc001e2e000 : new refcount 1 00000020:00000080:2.0:1788201271.748136:0:97038:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x96d0c9b8c9a1d4c4 00000020:00000040:2.0:1788201271.748138:0:97038:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4c4 00000020:00000040:2.0:1788201271.748140:0:97038:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc001e2e000 refcount=2 00010000:00010000:2.0:1788201271.753747:0:97038:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00000040:2.0:1788201271.753759:0:97038:0:(obd_cksum.c:32:obd_cksum_types_supported_server()) lustre-OST0000: checksum speed: crc 507, crc32c 4658, adler 605, t10ip512 1944, t10ip4k 2479, t10crc512 466, t10crc4k 482 00002000:00000040:2.0:1788201271.753804:0:97038:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xb:0x0] 00000001:00000040:2.0:1788201271.753881:0:97038:0:(tgt_lastrcvd.c:685:tgt_server_data_read()) lustre-OST0000: read last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294969456: rc = 0 00000001:00000040:2.0:1788201271.753887:0:97038:0:(tgt_lastrcvd.c:1991:tgt_server_data_init()) lustre-OST0000: restored maximum client count: 0 00000001:00000040:2.0:1788201271.753896:0:97038:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8320 uuid = lustre-MDT0001-mdtlov_UUID, last_transno = 4294969456, last_xid = 1875060715197312, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:2.0:1788201271.753901:0:97038:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294969456 srv lr: 4294969456 lx: 1875060715197312 gen 0 00000020:00000040:2.0:1788201271.753916:0:97038:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8dc001e28800 with handle 0x96d0c9b8c9a1d4cb to hash 00000020:00000040:2.0:1788201271.753936:0:97038:0:(genops.c:868:class_export_get()) GET export ffff8dc001e28800 refcount=3 00000020:00000040:2.0:1788201271.753941:0:97038:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8dc004fd4d28) now 3 - export 00000001:00000040:2.0:1788201271.753945:0:97038:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 0 with UUID 'lustre-MDT0001-mdtlov_UUID' added, generation 0 00000020:00000040:2.0:1788201271.753949:0:97038:0:(genops.c:879:class_export_put()) PUTting export ffff8dc001e28800 : new refcount 2 00000001:00000040:2.0:1788201271.753956:0:97038:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8448 uuid = lustre-MDT0000-mdtlov_UUID, last_transno = 4294969474, last_xid = 1875060715280896, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:2.0:1788201271.753960:0:97038:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 1 lr: 4294969474 srv lr: 4294969456 lx: 1875060715280896 gen 0 00000020:00000040:2.0:1788201271.753968:0:97038:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8dc002a56800 with handle 0x96d0c9b8c9a1d4d2 to hash 00000020:00000040:2.0:1788201271.753978:0:97038:0:(genops.c:868:class_export_get()) GET export ffff8dc002a56800 refcount=3 00000020:00000040:2.0:1788201271.753980:0:97038:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8dc004fd4d28) now 4 - export 00000001:00000040:2.0:1788201271.753983:0:97038:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 1 with UUID 'lustre-MDT0000-mdtlov_UUID' added, generation 0 00000020:00000040:2.0:1788201271.753985:0:97038:0:(genops.c:879:class_export_put()) PUTting export ffff8dc002a56800 : new refcount 2 00000001:00000040:2.0:1788201271.753989:0:97038:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8576 uuid = 6e293f14-c501-4bc5-9dd4-a18ef02756b4, last_transno = 4294969478, last_xid = 1875060695458560, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:2.0:1788201271.753994:0:97038:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 6e293f14-c501-4bc5-9dd4-a18ef02756b4 idx: 2 lr: 4294969478 srv lr: 4294969456 lx: 1875060695458560 gen 0 00000020:00000040:2.0:1788201271.753998:0:97038:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8dc1401c7000 with handle 0x96d0c9b8c9a1d4d9 to hash 00000020:00000040:2.0:1788201271.754010:0:97038:0:(genops.c:868:class_export_get()) GET export ffff8dc1401c7000 refcount=3 00000020:00000040:2.0:1788201271.754013:0:97038:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8dc004fd4d28) now 5 - export 00000001:00000040:2.0:1788201271.754581:0:97038:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 2 with UUID '6e293f14-c501-4bc5-9dd4-a18ef02756b4' added, generation 0 00000020:00000040:2.0:1788201271.754584:0:97038:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 2 00000001:00000040:2.0:1788201271.754591:0:97038:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8704 uuid = , last_transno = 0, last_xid = 0, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00000040:2.0:1788201271.754595:0:97038:0:(tgt_lastrcvd.c:1736:tgt_clients_data_init()) skipping zeroed client at offset 3 00000001:00000004:2.0:1788201271.754600:0:97038:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294969478 00000001:00000040:2.0:1788201271.754652:0:97038:0:(tgt_lastrcvd.c:707:tgt_server_data_write()) lustre-OST0000: write last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294969478: rc = 0 00000001:00000040:2.0:1788201271.754667:0:97038:0:(tgt_lastrcvd.c:761:tgt_server_data_update()) lustre-OST0000: update last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294969478: rc = 0 00002000:00000040:2.0:1788201271.754687:0:97038:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x5:0x0] 40000000:00000040:2.0:1788201271.754730:0:97038:0:(fid_store.c:167:seq_store_read()) srv-lustre-OST0000: Space - [0x0000000280000402-0x00000002c0000400]:0:ost 40000000:00000040:2.0:1788201271.754790:0:97038:0:(fid_handler.c:58:seq_server_set_cli()) srv-lustre-OST0000: Attached sequence controller cli-lustre-OST0000-super 80000000:00000040:2.0:1788201271.754799:0:97038:0:(fld_cache.c:66:fld_cache_init()) srv-lustre-OST0000: FLD cache - Size: 74898, Threshold: 7489 00002000:00000040:2.0:1788201271.754805:0:97038:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x3:0x0] 80000000:00000040:2.0:1788201271.754844:0:97038:0:(fld_cache.c:417:fld_cache_insert_nolock()) insert range [0x0000000280000400-0x00000002c0000400]:0:ost 80000000:00000040:2.0:1788201271.754852:0:97038:0:(fld_handler.c:101:fld_name_to_index()) get index from srv-lustre-OST0000 00002000:00000040:2.0:1788201271.754893:0:97038:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x1018:0x0] 00002000:00000040:2.0:1788201271.754911:0:97038:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x101e:0x0] 00002000:00000040:2.0:1788201271.754954:0:97038:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xd:0x0] 00000001:00000040:2.0:1788201271.755001:0:97038:0:(nodemap_storage.c:303:nodemap_cache_find_create()) removing old index, creating new one 00002000:00000040:2.0:1788201271.755958:0:97038:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x2:0x0] 00002000:00000040:2.0:1788201271.756246:0:97038:0:(ofd_dev.c:466:ofd_object_free()) object free, fid = [0x200000003:0x2:0x0] 00080000:10000000:2.0:1788201271.756527:0:97038:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000040:3.0:1788201271.758963:0:97038:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8dc004fd4d28) now 6 - setup 00000020:00000080:3.0:1788201271.758971:0:97038:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788201271.758981:0:97038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201271.758988:0:97038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201271.758990:0:97038:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788201271.758993:0:97038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788201271.758997:0:97038:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1788201271.758998:0:97038:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201271.759000:0:97038:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201271.759001:0:97038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788201271.759003:0:97038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201271.759005:0:97038:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788201271.759007:0:97038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201271.759010:0:97038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201271.759011:0:97038:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788201271.759073:0:97038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788201271.759076:0:97038:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788201271.759080:0:97038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201271.759082:0:97038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201271.759084:0:97038:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788201271.759086:0:97038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201271.759088:0:97038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201271.759089:0:97038:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788201271.759093:0:97038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788201271.759125:0:97038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201271.759128:0:97038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201271.759130:0:97038:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788201271.759133:0:97038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788201271.759386:0:97034:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788201271.759438:0:97034:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00000020:00000040:1.0:1788201271.759456:0:97034:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc006dbc600 refcount=3 00010000:00010000:1.0:1788201271.759464:0:97034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc600/0x96d0c9b8c9a1d4af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d4b6 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201271.759475:0:97034:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc600/0x96d0c9b8c9a1d4af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d4b6 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201271.759483:0:97034:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc120724000 from 1 10000000:01000000:1.0:1788201271.759486:0:97034:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000020:00000040:1.0:1788201271.759493:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00010000:00000040:1.0:1788201271.759514:0:97034:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff8dc12196e100 count: 4 00000020:00000040:1.0:1788201271.759521:0:97034:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8dc1064ed400 with handle 0x96d0c9b8c9a1d4e0 to hash 00010000:00010000:1.0:1788201271.759528:0:97034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1d4e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201271.759536:0:97034:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1d4e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201271.759563:0:97034:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1d4e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1788201271.759587:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc003a73480 x1875060715295488/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.759601:0:97034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715295488:0@lo:101:mount.lustre.0 00000100:00000040:1.0:1788201271.759628:0:97034:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc003a73480 x1875060715295488/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201287 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.759636:0:97034:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201271.759673:0:97034:0:(events.c:337:request_in_callback()) incoming req@ffff8dc004c3c050 x1875060715295488 msgsize 328 00000100:00100000:1.0:1788201271.759678:0:97034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788201271.759680:0:97034:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1788201271.759696:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8dc003a73480 x1875060715295488/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201287 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.759721:0:97034:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1060ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201271.759913:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715295488 00000100:00100000:0.0:1788201271.759921:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715295488 00000020:00000040:0.0:1788201271.759924:0:94461:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:0.0:1788201271.759927:0:94461:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=22 00000100:00000040:0.0:1788201271.759946:0:94461:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788201271.759981:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00000040:0.0:1788201271.759985:0:94461:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:0.0:1788201271.759991:0:94461:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc004c3c050 x1875060715295488/t0(0) o101->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 328/0 e 0 to 0 dl 1788201282 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.760004:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:97034:x1875060715295488:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201271.760075:0:94461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:0.0:1788201271.760085:0:94461:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff8dc1207c9400 count: 5 00000020:00000040:0.0:1788201271.760092:0:94461:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8dc140d59000 with handle 0x96d0c9b8c9a1d4e7 to hash 00010000:00010000:0.0:1788201271.760096:0:94461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1d4e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1d4e0 expref: -99 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788201271.760102:0:94461:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff8dc110735800 : new locks_count 17 00000020:00000040:0.0:1788201271.760105:0:94461:0:(genops.c:868:class_export_get()) GET export ffff8dc110735800 refcount=23 00010000:00000040:0.0:1788201271.760120:0:94461:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff8dc1207c9400) refcount = 5 00010000:00000040:0.0:1788201271.760123:0:94461:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1788201271.760127:0:94461:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc00782c600/0x96d0c9b8c9a1c677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c670 expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788201271.760135:0:94461:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc0078fdc00/0x96d0c9b8c9a1c64d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c646 expref: 23 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788201271.760141:0:94461:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc00782cc00/0x96d0c9b8c9a1c5d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c5cf expref: 23 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788201271.760149:0:94461:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc007adec00/0x96d0c9b8c9a1c4e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78691a expref: 9 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201271.760155:0:94461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1d4e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d4e0 expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201271.760166:0:94461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1d4e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d4e0 expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201271.760174:0:94461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59000, rc 0) 00010000:00000040:0.0:1788201271.760178:0:94461:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715295488 00000100:00000040:0.0:1788201271.760188:0:94461:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:0.0:1788201271.760200:0:94461:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201271.760220:0:94461:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff8dc003a73480 x1875060715295488/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201271.760240:0:94461:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:0.0:1788201271.760244:0:94461:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc004c3c050 x1875060715295488/t0(0) o101->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 328/344 e 0 to 0 dl 1788201282 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.760252:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:97034:x1875060715295488:12345-0@lo:101:mount.lustre.0 Request processed in 251us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201271.760258:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00000040:0.0:1788201271.760261:0:94461:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:0.0:1788201271.760269:0:94461:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 22 00000100:00000040:1.0:1788201271.762243:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc003a73480 x1875060715295488/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.762258:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc003a73480 x1875060715295488/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201287 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.762266:0:97034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715295488:0@lo:101:mount.lustre.0 00000100:00000040:1.0:1788201271.762275:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc003a73480 x1875060715295488/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201287 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201271.762300:0:97034:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc1064ed400 refcount=4 00010000:00000040:1.0:1788201271.762308:0:97034:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff8dc1064ed400, remote cookie: 0x96d0c9b8c9a1d4e7, flags: 0x0 00010000:00000040:1.0:1788201271.762315:0:97034:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff8dc12196e100) refcount = 4 00010000:00000040:1.0:1788201271.762324:0:97034:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1788201271.762328:0:97034:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c670 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c677 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788201271.762337:0:97034:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3600/0x96d0c9b8c9a1c646 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c64d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788201271.762355:0:97034:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.201.120@tcp lock: ffff8dc007adea00/0x96d0c9b8c9a1c5cf lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c5d6 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201271.762363:0:97034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1d4e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d4e7 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201271.762373:0:97034:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1d4e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d4e7 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1788201271.762384:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc003a73480 x1875060715295488/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201287 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201271.762395:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 10000000:00000040:1.0:1788201271.762416:0:97034:0:(mgc_request.c:108:config_log_get()) log params (ffff8dc12bc32600) refs 2 00000020:00000040:1.0:1788201271.762420:0:97034:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc1064ed400 refcount=3 10000000:00000040:1.0:1788201271.762453:0:97034:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8dc109832540 : new refcount 2 10000000:00000040:1.0:1788201271.762457:0:97034:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8dc12fb11000 : new refcount 2 10000000:00000040:1.0:1788201271.762460:0:97034:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.201.120@tcp: copy local log params 00000040:00080000:1.0:1788201271.762620:0:97034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788201271.762847:0:97034:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201271.763012:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788201271.763525:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788201271.763545:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788201271.763552:0:97034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000020:00000040:1.0:1788201271.763593:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:1.0:1788201271.763599:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=5 obd=MGC192.168.201.120@tcp 00000100:00000040:1.0:1788201271.763638:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc003a73480 x1875060715295616/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.763652:0:97034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715295616:0@lo:501:mount.lustre.0 00000100:00000040:1.0:1788201271.763675:0:97034:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc003a73480 x1875060715295616/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788201287 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.763684:0:97034:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201271.763720:0:97034:0:(events.c:337:request_in_callback()) incoming req@ffff8dc004c3c450 x1875060715295616 msgsize 504 00000100:00100000:1.0:1788201271.763725:0:97034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788201271.763727:0:97034:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1788201271.763747:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8dc003a73480 x1875060715295616/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788201287 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.763776:0:97034:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1060ca600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201271.765563:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715295616 00000100:00100000:0.0:1788201271.765577:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715295616 00000020:00000040:0.0:1788201271.765580:0:94463:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:0.0:1788201271.765585:0:94463:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=23 00000100:00000040:0.0:1788201271.765611:0:94463:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788201271.765638:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00000040:0.0:1788201271.765643:0:94463:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:0.0:1788201271.765650:0:94463:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc004c3c450 x1875060715295616/t0(0) o501->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 504/0 e 0 to 0 dl 1788201282 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.765664:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+23:97034:x1875060715295616:12345-0@lo:501:mount.lustre.0 00000040:00000040:0.0:1788201271.765692:0:94463:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log params 00000040:00000040:0.0:1788201271.765696:0:94463:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8dc140ffbe40 : new refcount 2 00000040:00000040:0.0:1788201271.765777:0:94463:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8dc140ffbe40 : new refcount 1 00010000:00000040:0.0:1788201271.765784:0:94463:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715295616 00000100:00000040:0.0:1788201271.765794:0:94463:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:0.0:1788201271.765799:0:94463:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201271.765840:0:94463:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff8dc003a73480 x1875060715295616/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201271.765899:0:94463:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:0.0:1788201271.765904:0:94463:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc004c3c450 x1875060715295616/t0(0) o501->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 504/272 e 0 to 0 dl 1788201282 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.765912:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+23:97034:x1875060715295616:12345-0@lo:501:mount.lustre.0 Request processed in 250us (2190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201271.765919:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00000040:0.0:1788201271.765922:0:94463:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:0.0:1788201271.765933:0:94463:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 22 00000100:00000040:2.0:1788201271.772696:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc003a73480 x1875060715295616/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.772715:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc003a73480 x1875060715295616/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788201287 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.772724:0:97034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715295616:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1788201271.772734:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc003a73480 x1875060715295616/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788201287 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788201271.772749:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000100:00000040:2.0:1788201271.772754:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc003a73480 x1875060715295616/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1788201287 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788201271.772765:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 00000020:00000040:2.0:1788201271.772781:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:2.0:1788201271.772786:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=5 obd=MGC192.168.201.120@tcp 00000100:00000040:2.0:1788201271.772813:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc12ee2ea00 x1875060715295744/t0(0) o503->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.772834:0:97034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715295744:0@lo:503:mount.lustre.0 00000100:00000040:2.0:1788201271.772873:0:97034:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc12ee2ea00 x1875060715295744/t0(0) o503->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788201287 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.772882:0:97034:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201271.772924:0:97034:0:(events.c:337:request_in_callback()) incoming req@ffff8dc004c3f850 x1875060715295744 msgsize 272 00000100:00100000:2.0:1788201271.772929:0:97034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201271.772932:0:97034:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788201271.772952:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8dc12ee2ea00 x1875060715295744/t0(0) o503->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788201287 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.772982:0:97034:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f1f00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201271.773063:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715295744 00000100:00100000:1.0:1788201271.773071:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715295744 00000020:00000040:1.0:1788201271.773074:0:94461:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:1.0:1788201271.773079:0:94461:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=23 00000100:00000040:1.0:1788201271.773100:0:94461:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788201271.773130:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00000040:1.0:1788201271.773135:0:94461:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:1.0:1788201271.773140:0:94461:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc004c3f850 x1875060715295744/t0(0) o503->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 272/0 e 0 to 0 dl 1788201282 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.773153:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:97034:x1875060715295744:12345-0@lo:503:mount.lustre.0 00000040:00000040:1.0:1788201271.773182:0:94461:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8dc140ffbe40 : new refcount 2 00000040:00000040:1.0:1788201271.773232:0:94461:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8dc140ffbe40 : new refcount 1 00010000:00000040:1.0:1788201271.773238:0:94461:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715295744 00000100:00000040:1.0:1788201271.773247:0:94461:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:1.0:1788201271.773253:0:94461:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201271.773274:0:94461:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff8dc12ee2ea00 x1875060715295744/t0(0) o503->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.773318:0:94461:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:1.0:1788201271.773323:0:94461:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc004c3f850 x1875060715295744/t0(0) o503->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 272/8416 e 0 to 0 dl 1788201282 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.773330:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:97034:x1875060715295744:12345-0@lo:503:mount.lustre.0 Request processed in 180us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201271.773337:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00000040:1.0:1788201271.773341:0:94461:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:1.0:1788201271.773353:0:94461:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 22 00000100:00000040:2.0:1788201271.773941:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc12ee2ea00 x1875060715295744/t0(0) o503->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.773951:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12ee2ea00 x1875060715295744/t0(0) o503->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788201287 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.773958:0:97034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715295744:0@lo:503:mount.lustre.0 00000100:00000040:2.0:1788201271.773964:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc12ee2ea00 x1875060715295744/t0(0) o503->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788201287 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.773976:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc12ee2ea00 x1875060715295744/t0(0) o503->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788201287 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788201271.773991:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:2.0:1788201271.773998:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 00000040:00080000:2.0:1788201271.774475:0:97034:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:2.0:1788201271.774536:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:2.0:1788201271.774542:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=5 obd=MGC192.168.201.120@tcp 00000100:00000040:2.0:1788201271.774566:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc12ee2ea00 x1875060715295872/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.774589:0:97034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715295872:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1788201271.774617:0:97034:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc12ee2ea00 x1875060715295872/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.774624:0:97034:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201271.774693:0:97034:0:(events.c:337:request_in_callback()) incoming req@ffff8dc004c3cc50 x1875060715295872 msgsize 272 00000100:00100000:2.0:1788201271.774698:0:97034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201271.774700:0:97034:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788201271.774725:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8dc12ee2ea00 x1875060715295872/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.774749:0:97034:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f1f00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201271.776574:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715295872 00000100:00100000:3.0:1788201271.776586:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715295872 00000020:00000040:3.0:1788201271.776589:0:94463:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:3.0:1788201271.776594:0:94463:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=23 00000100:00000040:3.0:1788201271.776630:0:94463:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1788201271.776663:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00000040:3.0:1788201271.776668:0:94463:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:3.0:1788201271.776675:0:94463:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc004c3cc50 x1875060715295872/t0(0) o502->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 272/0 e 0 to 0 dl 1788201282 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.776688:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+23:97034:x1875060715295872:12345-0@lo:502:mount.lustre.0 00000040:00000040:3.0:1788201271.776721:0:94463:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8dc140ffbe40 : new refcount 2 00000040:00000040:3.0:1788201271.776782:0:94463:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8dc140ffbe40 : new refcount 1 00010000:00000040:3.0:1788201271.776787:0:94463:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715295872 00000100:00000040:3.0:1788201271.776798:0:94463:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:3.0:1788201271.776804:0:94463:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201271.776846:0:94463:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff8dc12ee2ea00 x1875060715295872/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.776871:0:94463:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:3.0:1788201271.776875:0:94463:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc004c3cc50 x1875060715295872/t0(0) o502->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 272/8472 e 0 to 0 dl 1788201282 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.776884:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+23:97034:x1875060715295872:12345-0@lo:502:mount.lustre.0 Request processed in 197us (2189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201271.776891:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00000040:3.0:1788201271.776894:0:94463:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:3.0:1788201271.776904:0:94463:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 22 00000100:00000040:0.0:1788201271.778176:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc12ee2ea00 x1875060715295872/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201271.778191:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12ee2ea00 x1875060715295872/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.778200:0:97034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715295872:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1788201271.778209:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc12ee2ea00 x1875060715295872/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201271.778224:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc12ee2ea00 x1875060715295872/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788201271.778240:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:0.0:1788201271.778249:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 00000040:00080000:0.0:1788201271.778500:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788201271.778534:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788201271.778548:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788201271.778560:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788201271.778575:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000020:00000040:0.0:1788201271.778581:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:0.0:1788201271.778586:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=5 obd=MGC192.168.201.120@tcp 00000100:00000040:0.0:1788201271.778619:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc120091500 x1875060715296000/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.778630:0:97034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715296000:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1788201271.778659:0:97034:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc120091500 x1875060715296000/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201271.778666:0:97034:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201271.778698:0:97034:0:(events.c:337:request_in_callback()) incoming req@ffff8dc004c3ec50 x1875060715296000 msgsize 272 00000100:00100000:0.0:1788201271.778702:0:97034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788201271.778704:0:97034:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1788201271.778720:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8dc120091500 x1875060715296000/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.778749:0:97034:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc142075600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201271.778821:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715296000 00000100:00100000:1.0:1788201271.778827:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715296000 00000020:00000040:1.0:1788201271.778830:0:94461:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:1.0:1788201271.778834:0:94461:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=23 00000100:00000040:1.0:1788201271.778852:0:94461:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788201271.778878:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00000040:1.0:1788201271.778882:0:94461:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:1.0:1788201271.778887:0:94461:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc004c3ec50 x1875060715296000/t0(0) o502->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 272/0 e 0 to 0 dl 1788201282 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.778899:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:97034:x1875060715296000:12345-0@lo:502:mount.lustre.0 00000040:00000040:1.0:1788201271.778920:0:94461:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8dc140ffbe40 : new refcount 2 00000040:00000040:1.0:1788201271.778959:0:94461:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8dc140ffbe40 : new refcount 1 00010000:00000040:1.0:1788201271.778964:0:94461:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715296000 00000100:00000040:1.0:1788201271.778973:0:94461:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:1.0:1788201271.778977:0:94461:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201271.778994:0:94461:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff8dc120091500 x1875060715296000/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.779060:0:94461:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:1.0:1788201271.779065:0:94461:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc004c3ec50 x1875060715296000/t0(0) o502->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 272/8472 e 0 to 0 dl 1788201282 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.779081:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:97034:x1875060715296000:12345-0@lo:502:mount.lustre.0 Request processed in 183us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201271.779088:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00000040:1.0:1788201271.779091:0:94461:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:1.0:1788201271.779102:0:94461:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 22 00000100:00000040:0.0:1788201271.781204:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc120091500 x1875060715296000/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201271.781220:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc120091500 x1875060715296000/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.781228:0:97034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715296000:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1788201271.781236:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc120091500 x1875060715296000/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201271.781255:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc120091500 x1875060715296000/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788201271.781274:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:0.0:1788201271.781282:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 00000040:00080000:0.0:1788201271.781356:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788201271.781372:0:97034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 10000000:00000040:0.0:1788201271.781680:0:97034:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8dc109832540 : new refcount 1 00000020:00000040:0.0:1788201271.781685:0:97034:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog params 00000020:01000000:3.0:1788201271.782559:0:97042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201271.782570:0:97042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201271.782572:0:97042:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788201271.782581:0:97042:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc120724000 00000020:00000080:3.0:1788201271.782583:0:97042:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788201271.782592:0:97042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201271.782595:0:97042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201271.782603:0:97042:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788201271.782606:0:97042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201271.782608:0:97042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201271.782609:0:97042:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788201271.782612:0:97042:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc120724000 00000020:00000080:3.0:1788201271.782614:0:97042:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788201271.782684:0:97042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201271.782688:0:97042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201271.782689:0:97042:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788201271.782692:0:97042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 7 00000020:01000000:2.0:1788201271.787760:0:97034:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1788201271.787809:0:97034:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00000020:00000040:2.0:1788201271.787829:0:97034:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc1064ed400 refcount=3 00010000:00010000:2.0:1788201271.787837:0:97034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1d4e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d4e7 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201271.787849:0:97034:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1d4e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d4e7 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201271.787914:0:97034:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788201271.787918:0:97034:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dc120724000 10000000:01000000:2.0:1788201271.787921:0:97034:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dc120724000 10000000:01000000:2.0:1788201271.787925:0:97034:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:2.0:1788201271.787930:0:97034:0:(genops.c:868:class_export_get()) GET export ffff8dc104285000 refcount=20 10000000:01000000:2.0:1788201271.787935:0:97034:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc120724000 from 1 10000000:01000000:2.0:1788201271.787938:0:97034:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000020:00000040:2.0:1788201271.787945:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00010000:00000040:2.0:1788201271.787968:0:97034:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff8dc12196ed00 count: 9 00000020:00000040:2.0:1788201271.787986:0:97034:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8dc006dbce00 with handle 0x96d0c9b8c9a1d4ee to hash 00010000:00010000:2.0:1788201271.787992:0:97034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbce00/0x96d0c9b8c9a1d4ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201271.787999:0:97034:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc006dbce00/0x96d0c9b8c9a1d4ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201271.788010:0:97034:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc006dbce00/0x96d0c9b8c9a1d4ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1788201271.789186:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc12ee2d880 x1875060715296128/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.789201:0:97034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715296128:0@lo:101:mount.lustre.0 00000100:00000040:2.0:1788201271.789230:0:97034:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc12ee2d880 x1875060715296128/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201287 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.789240:0:97034:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201271.789280:0:97034:0:(events.c:337:request_in_callback()) incoming req@ffff8dc004c3e450 x1875060715296128 msgsize 328 00000100:00100000:2.0:1788201271.789296:0:97034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201271.789298:0:97034:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788201271.789359:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8dc12ee2d880 x1875060715296128/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201287 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.789390:0:97034:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f1f03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201271.795761:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715296128 00000100:00100000:3.0:1788201271.795775:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715296128 00000020:00000040:3.0:1788201271.795778:0:94463:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:3.0:1788201271.795784:0:94463:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=23 00000100:00000040:0.0:1788201271.795962:0:94463:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788201271.796075:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00000040:0.0:1788201271.796081:0:94463:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:0.0:1788201271.796089:0:94463:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc004c3e450 x1875060715296128/t0(0) o101->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 328/0 e 0 to 0 dl 1788201282 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.796104:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+23:97034:x1875060715296128:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201271.796121:0:94463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:0.0:1788201271.796133:0:94463:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff8dc11248c700 count: 11 00000020:00000040:0.0:1788201271.796140:0:94463:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8dc140d59c00 with handle 0x96d0c9b8c9a1d4f5 to hash 00010000:00010000:0.0:1788201271.796146:0:94463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140d59c00/0x96d0c9b8c9a1d4f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1d4ee expref: -99 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788201271.796155:0:94463:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff8dc110735800 : new locks_count 18 00000020:00000040:0.0:1788201271.796157:0:94463:0:(genops.c:868:class_export_get()) GET export ffff8dc110735800 refcount=24 00010000:00000040:0.0:1788201271.796175:0:94463:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff8dc11248c700) refcount = 11 00010000:00000040:0.0:1788201271.796178:0:94463:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1788201271.796182:0:94463:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc1064eca00/0x96d0c9b8c9a1d4b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d4af expref: 24 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788201271.796190:0:94463:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc007adf600/0x96d0c9b8c9a1cac2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1cabb expref: 24 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788201271.796198:0:94463:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc00896b000/0x96d0c9b8c9a1ca98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca91 expref: 24 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788201271.796205:0:94463:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc0078fd200/0x96d0c9b8c9a1ca8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca83 expref: 24 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788201271.796211:0:94463:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1ca7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca75 expref: 24 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788201271.796231:0:94463:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc140d59800/0x96d0c9b8c9a1ca6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca67 expref: 24 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788201271.796238:0:94463:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc140d58400/0x96d0c9b8c9a1ca60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca59 expref: 24 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788201271.796245:0:94463:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc00896aa00/0x96d0c9b8c9a1ca52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca4b expref: 24 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788201271.796254:0:94463:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc00896ba00/0x96d0c9b8c9a1ca44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78698a expref: 9 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788201271.796261:0:94463:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc140d59e00/0x96d0c9b8c9a1ca3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786983 expref: 9 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201271.796268:0:94463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140d59c00/0x96d0c9b8c9a1d4f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d4ee expref: 24 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201271.796280:0:94463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140d59c00/0x96d0c9b8c9a1d4f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d4ee expref: 24 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201271.796301:0:94463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59c00, rc 0) 00010000:00000040:0.0:1788201271.796304:0:94463:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715296128 00000100:00000040:0.0:1788201271.796315:0:94463:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:0.0:1788201271.796321:0:94463:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201271.796381:0:94463:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff8dc12ee2d880 x1875060715296128/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.798156:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc12ee2d880 x1875060715296128/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.798171:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12ee2d880 x1875060715296128/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201287 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.798178:0:97034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715296128:0@lo:101:mount.lustre.0 00000100:00000040:3.0:1788201271.798187:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc12ee2d880 x1875060715296128/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201287 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201271.798200:0:97034:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc006dbce00 refcount=4 00010000:00000040:3.0:1788201271.798206:0:97034:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff8dc006dbce00, remote cookie: 0x96d0c9b8c9a1d4f5, flags: 0x0 00010000:00000040:3.0:1788201271.798213:0:97034:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff8dc12196ed00) refcount = 9 00010000:00000040:3.0:1788201271.798216:0:97034:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1788201271.798220:0:97034:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc600/0x96d0c9b8c9a1d4af lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d4b6 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788201271.798227:0:97034:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1cabb lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1cac2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788201271.798244:0:97034:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1ca91 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ca98 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788201271.798251:0:97034:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.201.120@tcp lock: ffff8dc007adf800/0x96d0c9b8c9a1ca83 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ca8a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788201271.798257:0:97034:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.201.120@tcp lock: ffff8dc0078fda00/0x96d0c9b8c9a1ca75 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ca7c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788201271.798263:0:97034:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1ca67 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ca6e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788201271.798270:0:97034:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.201.120@tcp lock: ffff8dc007adee00/0x96d0c9b8c9a1ca59 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ca60 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788201271.798276:0:97034:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.201.120@tcp lock: ffff8dc007ade400/0x96d0c9b8c9a1ca4b lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ca52 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201271.798283:0:97034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc006dbce00/0x96d0c9b8c9a1d4ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d4f5 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201271.798304:0:97034:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc006dbce00/0x96d0c9b8c9a1d4ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d4f5 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1788201271.798315:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc12ee2d880 x1875060715296128/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201287 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201271.798325:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 10000000:00000040:3.0:1788201271.798335:0:97034:0:(mgc_request.c:108:config_log_get()) log lustre-client (ffff8dc0038cc000) refs 2 00000020:00000040:3.0:1788201271.798338:0:97034:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc006dbce00 refcount=3 10000000:00000040:3.0:1788201271.798383:0:97034:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8dc109832540 : new refcount 2 10000000:00000040:3.0:1788201271.798391:0:97034:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8dc12fb11000 : new refcount 2 10000000:00000040:3.0:1788201271.798394:0:97034:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.201.120@tcp: copy local log lustre-client 00000040:00080000:3.0:1788201271.798757:0:97034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788201271.799007:0:97034:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201271.799331:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788201271.800159:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788201271.800179:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788201271.800191:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788201271.800205:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788201271.800219:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788201271.800236:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788201271.800249:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788201271.800261:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788201271.800273:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788201271.800321:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000100:00000040:0.0:1788201271.800482:0:94463:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:0.0:1788201271.800494:0:94463:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc004c3e450 x1875060715296128/t0(0) o101->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 328/344 e 0 to 0 dl 1788201282 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.800516:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:97034:x1875060715296128:12345-0@lo:101:mount.lustre.0 Request processed in 4413us (11234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201271.800525:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00000040:0.0:1788201271.800529:0:94463:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:0.0:1788201271.800541:0:94463:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 23 00000040:00080000:3.0:1788201271.800813:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788201271.800843:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788201271.800858:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788201271.800872:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788201271.800886:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788201271.800898:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788201271.800911:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788201271.800925:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788201271.800938:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788201271.800950:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788201271.800962:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788201271.800974:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788201271.800986:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788201271.800998:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1788201271.801011:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1788201271.801046:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1788201271.801145:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1788201271.801159:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788201271.801185:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788201271.801630:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788201271.801650:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788201271.801664:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788201271.801677:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788201271.801691:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788201271.801706:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788201271.801719:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788201271.801744:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788201271.801750:0:97034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000020:00000040:3.0:1788201271.801823:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:3.0:1788201271.801830:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=5 obd=MGC192.168.201.120@tcp 00000100:00000040:3.0:1788201271.801867:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc11d29c700 x1875060715296256/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.801881:0:97034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715296256:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1788201271.801906:0:97034:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc11d29c700 x1875060715296256/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788201287 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.801914:0:97034:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201271.801953:0:97034:0:(events.c:337:request_in_callback()) incoming req@ffff8dc004c3d450 x1875060715296256 msgsize 512 00000100:00100000:3.0:1788201271.801958:0:97034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201271.801960:0:97034:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788201271.811584:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8dc11d29c700 x1875060715296256/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788201287 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.811660:0:97034:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201271.811815:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715296256 00000100:00100000:2.0:1788201271.811825:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715296256 00000020:00000040:2.0:1788201271.811829:0:94464:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:2.0:1788201271.811834:0:94464:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=24 00000100:00000040:2.0:1788201271.811865:0:94464:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1788201271.811903:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00000040:2.0:1788201271.811908:0:94464:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:2.0:1788201271.811915:0:94464:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc004c3d450 x1875060715296256/t0(0) o501->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 512/0 e 0 to 0 dl 1788201282 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.811941:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:97034:x1875060715296256:12345-0@lo:501:mount.lustre.0 00000040:00000040:2.0:1788201271.811968:0:94464:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-client 00000040:00000040:2.0:1788201271.811972:0:94464:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8dc140ffbe40 : new refcount 2 00000040:00000040:2.0:1788201271.812197:0:94464:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8dc140ffbe40 : new refcount 1 00000020:00000040:2.0:1788201271.812207:0:94464:0:(genops.c:868:class_export_get()) GET export ffff8dc110735800 refcount=25 00000020:00000040:2.0:1788201271.812210:0:94464:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 24 00010000:00000040:2.0:1788201271.812216:0:94464:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715296256 00000100:00000040:2.0:1788201271.812226:0:94464:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:2.0:1788201271.812232:0:94464:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201271.812268:0:94464:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff8dc11d29c700 x1875060715296256/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.812375:0:94464:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:2.0:1788201271.812382:0:94464:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc004c3d450 x1875060715296256/t0(0) o501->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 512/272 e 0 to 0 dl 1788201282 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.812391:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:97034:x1875060715296256:12345-0@lo:501:mount.lustre.0 Request processed in 454us (10436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201271.812399:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00000040:2.0:1788201271.812415:0:94464:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:2.0:1788201271.812425:0:94464:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 23 00000100:00000040:3.0:1788201271.812664:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc11d29c700 x1875060715296256/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.812675:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29c700 x1875060715296256/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788201287 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.812682:0:97034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715296256:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1788201271.812700:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc11d29c700 x1875060715296256/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788201287 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201271.812712:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000100:00000040:3.0:1788201271.812716:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc11d29c700 x1875060715296256/t0(0) o501->MGC192.168.201.120@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1788201287 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201271.812724:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 00000020:00000040:3.0:1788201271.812736:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:3.0:1788201271.812739:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=5 obd=MGC192.168.201.120@tcp 00000100:00000040:3.0:1788201271.812761:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc11d29c700 x1875060715296384/t0(0) o503->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.812772:0:97034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715296384:0@lo:503:mount.lustre.0 00000100:00000040:3.0:1788201271.812805:0:97034:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc11d29c700 x1875060715296384/t0(0) o503->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788201287 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.812811:0:97034:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201271.812829:0:97034:0:(events.c:337:request_in_callback()) incoming req@ffff8dc004c3f050 x1875060715296384 msgsize 272 00000100:00100000:3.0:1788201271.812834:0:97034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201271.812836:0:97034:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788201271.812858:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8dc11d29c700 x1875060715296384/t0(0) o503->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788201287 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.812877:0:97034:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201271.812962:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715296384 00000100:00100000:2.0:1788201271.812967:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715296384 00000020:00000040:2.0:1788201271.812969:0:94467:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:2.0:1788201271.812973:0:94467:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=24 00000100:00000040:2.0:1788201271.812985:0:94467:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1788201271.813185:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00000040:2.0:1788201271.813188:0:94467:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:2.0:1788201271.813194:0:94467:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc004c3f050 x1875060715296384/t0(0) o503->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 272/0 e 0 to 0 dl 1788201282 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.813216:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:97034:x1875060715296384:12345-0@lo:503:mount.lustre.0 00000040:00000040:2.0:1788201271.813234:0:94467:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8dc140ffbe40 : new refcount 2 00000040:00000040:2.0:1788201271.813266:0:94467:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8dc140ffbe40 : new refcount 1 00010000:00000040:2.0:1788201271.813270:0:94467:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715296384 00000100:00000040:2.0:1788201271.813275:0:94467:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:2.0:1788201271.813279:0:94467:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201271.813313:0:94467:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff8dc11d29c700 x1875060715296384/t0(0) o503->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.813331:0:94467:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:2.0:1788201271.813335:0:94467:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc004c3f050 x1875060715296384/t0(0) o503->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 272/8416 e 0 to 0 dl 1788201282 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.814039:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc11d29c700 x1875060715296384/t0(0) o503->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.814062:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29c700 x1875060715296384/t0(0) o503->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788201287 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.814069:0:97034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715296384:0@lo:503:mount.lustre.0 00000100:00000040:3.0:1788201271.814077:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc11d29c700 x1875060715296384/t0(0) o503->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788201287 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.814099:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc11d29c700 x1875060715296384/t0(0) o503->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1788201287 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201271.814116:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:3.0:1788201271.814124:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 00000040:00080000:3.0:1788201271.814729:0:97034:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:3.0:1788201271.814784:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:3.0:1788201271.814789:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=5 obd=MGC192.168.201.120@tcp 00000100:00000040:3.0:1788201271.814812:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc11d29c700 x1875060715296512/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.814823:0:97034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715296512:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1788201271.814854:0:97034:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc11d29c700 x1875060715296512/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.814863:0:97034:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201271.814896:0:97034:0:(events.c:337:request_in_callback()) incoming req@ffff8dc004c3d050 x1875060715296512 msgsize 272 00000100:00100000:3.0:1788201271.814900:0:97034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201271.814903:0:97034:0:(events.c:349:request_in_callback()) Buffer complete: 62 buffers still posted 00000100:00100000:2.0:1788201271.814998:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:97034:x1875060715296384:12345-0@lo:503:mount.lustre.0 Request processed in 129us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201271.815009:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00000040:2.0:1788201271.815012:0:94467:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:2.0:1788201271.815064:0:94467:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 23 00000100:00000040:3.0:1788201271.815396:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8dc11d29c700 x1875060715296512/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.815537:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715296512 00000100:00100000:1.0:1788201271.815545:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715296512 00000020:00000040:1.0:1788201271.815548:0:94461:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:1.0:1788201271.815553:0:94461:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=24 00000100:00000040:1.0:1788201271.815573:0:94461:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788201271.815594:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00000040:1.0:1788201271.815598:0:94461:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:1.0:1788201271.815604:0:94461:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc004c3d050 x1875060715296512/t0(0) o502->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 272/0 e 0 to 0 dl 1788201282 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.815615:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:97034:x1875060715296512:12345-0@lo:502:mount.lustre.0 00000040:00000040:1.0:1788201271.815644:0:94461:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8dc140ffbe40 : new refcount 2 00000040:00000040:1.0:1788201271.815695:0:94461:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8dc140ffbe40 : new refcount 1 00010000:00000040:1.0:1788201271.815701:0:94461:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715296512 00000100:00000040:1.0:1788201271.815711:0:94461:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:1.0:1788201271.815715:0:94461:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201271.815740:0:94461:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff8dc11d29c700 x1875060715296512/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.815754:0:94461:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:1.0:1788201271.815758:0:94461:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc004c3d050 x1875060715296512/t0(0) o502->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 272/8472 e 0 to 0 dl 1788201282 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.815767:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:97034:x1875060715296512:12345-0@lo:502:mount.lustre.0 Request processed in 154us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201271.815781:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00000040:1.0:1788201271.815783:0:94461:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:1.0:1788201271.815792:0:94461:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 23 00000100:00100000:3.0:1788201271.817259:0:97034:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040540 going to sleep for 11 seconds 00000100:00000040:3.0:1788201271.817303:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc11d29c700 x1875060715296512/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.817314:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29c700 x1875060715296512/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.817320:0:97034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715296512:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1788201271.817329:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc11d29c700 x1875060715296512/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.817368:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc11d29c700 x1875060715296512/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201271.817384:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:3.0:1788201271.817392:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 00000040:00080000:3.0:1788201271.817772:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788201271.817808:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788201271.817828:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788201271.817840:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788201271.817852:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788201271.817864:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788201271.817876:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788201271.817889:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788201271.817903:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788201271.817915:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788201271.817928:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788201271.817943:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788201271.817957:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788201271.817971:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788201271.817984:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788201271.817997:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788201271.818010:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788201271.818209:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788201271.818223:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788201271.818235:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788201271.818247:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788201271.818259:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788201271.818272:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788201271.818296:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788201271.818315:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1788201271.818329:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1788201271.818467:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1788201271.818499:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1788201271.818513:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1788201271.818528:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1788201271.818542:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1788201271.818555:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1788201271.818569:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1788201271.818584:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1788201271.818597:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1788201271.818611:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1788201271.818627:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1788201271.818641:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1788201271.818655:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1788201271.818668:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1788201271.818682:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1788201271.818693:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1788201271.818706:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1788201271.818720:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1788201271.818733:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1788201271.818746:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1788201271.818759:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1788201271.818772:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000020:00000040:3.0:1788201271.818789:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:3.0:1788201271.818795:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=5 obd=MGC192.168.201.120@tcp 00000100:00000040:3.0:1788201271.818828:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc11d29c700 x1875060715296640/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.818840:0:97034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715296640:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1788201271.818876:0:97034:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc11d29c700 x1875060715296640/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.818885:0:97034:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201271.818926:0:97034:0:(events.c:337:request_in_callback()) incoming req@ffff8dc004c3e850 x1875060715296640 msgsize 272 00000100:00100000:3.0:1788201271.818931:0:97034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201271.818938:0:97034:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788201271.819140:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8dc11d29c700 x1875060715296640/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.819165:0:97034:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201271.820624:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715296640 00000100:00100000:1.0:1788201271.820635:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715296640 00000020:00000040:1.0:1788201271.820637:0:94461:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:1.0:1788201271.820654:0:94461:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=24 00000100:00000040:1.0:1788201271.820677:0:94461:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788201271.820747:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00000040:1.0:1788201271.820752:0:94461:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:1.0:1788201271.820758:0:94461:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc004c3e850 x1875060715296640/t0(0) o502->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 272/0 e 0 to 0 dl 1788201282 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.820771:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:97034:x1875060715296640:12345-0@lo:502:mount.lustre.0 00000040:00000040:1.0:1788201271.820806:0:94461:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8dc140ffbe40 : new refcount 2 00000040:00000040:1.0:1788201271.820865:0:94461:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8dc140ffbe40 : new refcount 1 00010000:00000040:1.0:1788201271.820870:0:94461:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715296640 00000100:00000040:1.0:1788201271.820880:0:94461:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:1.0:1788201271.820885:0:94461:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201271.820926:0:94461:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff8dc11d29c700 x1875060715296640/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.820995:0:94461:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:1.0:1788201271.821000:0:94461:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc004c3e850 x1875060715296640/t0(0) o502->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 272/8472 e 0 to 0 dl 1788201282 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.821009:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:97034:x1875060715296640:12345-0@lo:502:mount.lustre.0 Request processed in 241us (2082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201271.821032:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00000040:1.0:1788201271.821037:0:94461:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:1.0:1788201271.821131:0:94461:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 23 00000100:00000040:3.0:1788201271.821783:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc11d29c700 x1875060715296640/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.821795:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29c700 x1875060715296640/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.821802:0:97034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715296640:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1788201271.821811:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc11d29c700 x1875060715296640/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.821825:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc11d29c700 x1875060715296640/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201271.821841:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:3.0:1788201271.821849:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 00000040:00080000:3.0:1788201271.822092:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788201271.822124:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000040:00080000:3.0:1788201271.822141:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1788201271.822158:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].52, 224 off17176 00000040:00080000:3.0:1788201271.822174:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].53, 112 off17288 00000040:00080000:0.0:1788201271.822366:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].54, 224 off17512 00000040:00080000:0.0:1788201271.822387:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].55, 224 off17736 00000040:00080000:0.0:1788201271.822400:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].56, 136 off17872 00000040:00080000:0.0:1788201271.822430:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].57, 224 off18096 00000040:00080000:0.0:1788201271.822445:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].58, 224 off18320 00000040:00080000:0.0:1788201271.822460:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].59, 136 off18456 00000040:00080000:0.0:1788201271.822475:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].60, 224 off18680 00000040:00080000:0.0:1788201271.822490:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].61, 224 off18904 00000040:00080000:0.0:1788201271.822506:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].62, 112 off19016 00000020:00000040:0.0:1788201271.822514:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:0.0:1788201271.822521:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=5 obd=MGC192.168.201.120@tcp 00000100:00000040:0.0:1788201271.822550:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc120091500 x1875060715296768/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.822562:0:97034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715296768:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1788201271.822594:0:97034:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc120091500 x1875060715296768/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201271.822602:0:97034:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201271.822635:0:97034:0:(events.c:337:request_in_callback()) incoming req@ffff8dc140d79850 x1875060715296768 msgsize 272 00000100:00100000:0.0:1788201271.822640:0:97034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788201271.822642:0:97034:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1788201271.823158:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8dc120091500 x1875060715296768/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.823187:0:97034:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004e40d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201271.823309:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715296768 00000100:00100000:2.0:1788201271.823317:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715296768 00000020:00000040:2.0:1788201271.823320:0:94467:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:2.0:1788201271.823325:0:94467:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=24 00000100:00000040:2.0:1788201271.823347:0:94467:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1788201271.823386:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00000040:2.0:1788201271.823391:0:94467:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:2.0:1788201271.823397:0:94467:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc140d79850 x1875060715296768/t0(0) o502->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 272/0 e 0 to 0 dl 1788201282 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.823409:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:97034:x1875060715296768:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1788201271.823445:0:94467:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8dc140ffbe40 : new refcount 2 00000040:00000040:2.0:1788201271.823502:0:94467:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8dc140ffbe40 : new refcount 1 00010000:00000040:2.0:1788201271.823507:0:94467:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715296768 00000100:00000040:2.0:1788201271.823516:0:94467:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:2.0:1788201271.823520:0:94467:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201271.823549:0:94467:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff8dc120091500 x1875060715296768/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.823574:0:94467:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 51 to 0@lo 00000100:00000040:2.0:1788201271.823578:0:94467:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc140d79850 x1875060715296768/t0(0) o502->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 272/8472 e 0 to 0 dl 1788201282 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.823587:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:97034:x1875060715296768:12345-0@lo:502:mount.lustre.0 Request processed in 180us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201271.823594:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00000040:2.0:1788201271.823597:0:94467:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:2.0:1788201271.823606:0:94467:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 23 00000100:00000040:2.0:1788201271.823654:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc120091500 x1875060715296768/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.823664:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc120091500 x1875060715296768/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.823671:0:97034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715296768:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1788201271.823678:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc120091500 x1875060715296768/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.823689:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc120091500 x1875060715296768/t0(0) o502->MGC192.168.201.120@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1788201287 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788201271.823703:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:2.0:1788201271.823710:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 00000040:00080000:2.0:1788201271.823764:0:97034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].63, 224 off19240 00000040:00080000:2.0:1788201271.823776:0:97034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 10000000:00000040:2.0:1788201271.824272:0:97034:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8dc109832540 : new refcount 1 00000020:00000040:2.0:1788201271.824278:0:97034:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-client 00000100:00000040:0.0:1788201271.824853:0:97045:0:(lustre_peer.c:130:class_add_uuid()) found uuid 192.168.201.120@tcp 192.168.201.120@tcp cnt=1 00000020:01000004:0.0:1788201271.824876:0:97045:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788201271.824892:0:97045:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8dc12f30b370) 00000020:00000040:0.0:1788201271.824899:0:97045:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8dc00520a000 with handle 0x96d0c9b8c9a1d4fc to hash 00000020:00000040:0.0:1788201271.824906:0:97045:0:(genops.c:879:class_export_put()) PUTting export ffff8dc00520a000 : new refcount 1 00000020:00000040:0.0:1788201271.824920:0:97045:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff8dc12f30b370) now 2 - obd_device_list 00000020:00000080:0.0:1788201271.824925:0:97045:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788201271.825007:0:97045:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc120724000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788201271.825011:0:97045:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc120724000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788201271.825042:0:97045:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc120724000 3 00000020:00000040:0.0:1788201271.825071:0:97045:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff8dc12f30b370) now 3 - import 00000020:00000040:0.0:1788201271.825079:0:97045:0:(genops.c:1223:class_import_put()) import ffff8dc004014000 refcount=1 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:0.0:1788201271.825088:0:97045:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:0.0:1788201271.825091:0:97045:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8dc125a970c0 refcount 52 to 0@lo 00000100:00000040:0.0:1788201271.825092:0:97045:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.201.120@tcp -> ffff8dc125a970c0 00010000:00080000:0.0:1788201271.825096:0:97045:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc004014000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.120@tcp at head 00010000:00010000:0.0:1788201271.827645:0:97045:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000040:0.0:1788201271.828223:0:97045:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff8dc12f30b370) now 4 - setup 00000020:00000080:0.0:1788201271.828229:0:97045:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788201271.828298:0:97045:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000040:0.0:1788201271.828306:0:97045:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8dc11077f800 with handle 0x96d0c9b8c9a1d503 to hash 00000020:00000040:0.0:1788201271.828314:0:97045:0:(genops.c:868:class_export_get()) GET export ffff8dc11077f800 refcount=3 00000020:00000040:0.0:1788201271.828319:0:97045:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff8dc12f30b370) now 5 - export 00000020:00000040:0.0:1788201271.828323:0:97045:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11077f800 : new refcount 2 00000020:00000080:0.0:1788201271.828325:0:97045:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x96d0c9b8c9a1d503 00000020:00000040:0.0:1788201271.828327:0:97045:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d503 00000020:00000040:0.0:1788201271.828329:0:97045:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc11077f800 refcount=3 00000100:00080000:0.0:1788201271.828337:0:97045:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:0.0:1788201271.828342:0:97045:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 53 to 0@lo 00000020:00000040:0.0:1788201271.828344:0:97045:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d503 00000020:00000040:0.0:1788201271.828353:0:97045:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc11077f800 refcount=4 00000100:00000040:0.0:1788201271.828356:0:97045:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 54 to 0@lo 00000020:00000040:0.0:1788201271.828358:0:97045:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11077f800 : new refcount 3 00000100:00080000:0.0:1788201271.828360:0:97045:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc004014000 using connection 192.168.201.120@tcp/0@lo 00000020:00000040:0.0:1788201271.828374:0:97045:0:(genops.c:1210:class_import_get()) import ffff8dc004014000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00100000:0.0:1788201271.828399:0:97045:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc120090a80 x1875060715296896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1788201271.828414:0:97045:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ae174cfa] to pc [ptlrpcd_rcv+-1] req@ffff8dc120090a80 x1875060715296896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.828463:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc120090a80 x1875060715296896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.828476:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715296896:0@lo:38:llog_process_th.0 00000100:00000040:3.0:1788201271.828508:0:3654:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc120090a80 x1875060715296896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788201281 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.828516:0:3654:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201271.828555:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8dc11d29c700 x1875060715296896 msgsize 520 00000100:00100000:3.0:1788201271.828565:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201271.828596:0:3654:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc120090a80 x1875060715296896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788201281 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.828609:0:3654:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000100:00080000:0.0:1788201271.828643:0:97045:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:00000040:0.0:1788201271.828647:0:97045:0:(genops.c:1210:class_import_get()) import ffff8dc004014000 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00100000:1.0:1788201271.828763:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715296896 00000100:00100000:1.0:1788201271.828771:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715296896 00000020:00000040:1.0:1788201271.828773:0:66313:0:(genops.c:804:class_conn2export()) looking for export cookie 0x0 00000100:00100000:1.0:1788201271.828811:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1603 00000100:00000040:1.0:1788201271.828818:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc11d29c700 x1875060715296896/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1788201291 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.828828:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715296896:12345-0@lo:38:llog_process_th.0 00000020:00000040:1.0:1788201271.828839:0:66313:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff8dc13f870000) now 14 - find 00010000:00000040:1.0:1788201271.828849:0:66313:0:(ldlm_lib.c:1263:target_handle_connect()) lustre-MDT0000: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00010000:00080000:1.0:1788201271.828855:0:66313:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 4123 last 0 00000020:00000040:1.0:1788201271.828862:0:66313:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8dc13aa99000 with handle 0x96d0c9b8c9a1d50a to hash 00000020:00000040:1.0:1788201271.828884:0:66313:0:(genops.c:868:class_export_get()) GET export ffff8dc13aa99000 refcount=3 00000020:00000040:1.0:1788201271.828887:0:66313:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff8dc13f870000) now 15 - export 00000020:00000040:1.0:1788201271.828890:0:66313:0:(genops.c:879:class_export_put()) PUTting export ffff8dc13aa99000 : new refcount 2 00000020:00000080:1.0:1788201271.828892:0:66313:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x96d0c9b8c9a1d50a 00000020:00000040:1.0:1788201271.828894:0:66313:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d50a 00000020:00000040:1.0:1788201271.828895:0:66313:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc13aa99000 refcount=3 00000001:00000040:1.0:1788201271.828905:0:66313:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.201.120@tcp 00000001:00000040:1.0:1788201271.828911:0:66313:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8dc1330c8800) : new refcount 17 00000020:00000040:1.0:1788201271.828914:0:66313:0:(genops.c:868:class_export_get()) GET export ffff8dc13aa99000 refcount=4 00000001:00000040:1.0:1788201271.828916:0:66313:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8dc1330c8800) : new refcount 18 00000001:00000040:1.0:1788201271.828919:0:66313:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff8dc1330c8800) : new refcount 17 00000004:00100000:1.0:1788201271.828924:0:66313:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000040:1.0:1788201271.828932:0:66313:0:(lprocfs_status_server.c:748:lprocfs_exp_setup()) Found stats ffff8dc0055e59c0 for nid 0@lo - ref 6 00000020:00000040:1.0:1788201271.828939:0:66313:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff8dc13f870000) now 16 - import 00000020:00000040:1.0:1788201271.828945:0:66313:0:(genops.c:1223:class_import_put()) import ffff8dc13aa9e800 refcount=1 obd=lustre-MDT0000 00000020:00000040:1.0:1788201271.828951:0:66313:0:(genops.c:868:class_export_get()) GET export ffff8dc13aa99000 refcount=5 00000100:00000040:1.0:1788201271.828954:0:66313:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff8dc13aa99000 : new rpc_count 1 00000100:00000040:1.0:1788201271.828965:0:66313:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 55 to 0@lo 00000100:00000040:1.0:1788201271.828968:0:66313:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8dc125a970c0 refcount 55 to 0@lo 00000020:00000040:1.0:1788201271.828971:0:66313:0:(genops.c:868:class_export_get()) GET export ffff8dc13aa99000 refcount=6 00000100:00000040:1.0:1788201271.828976:0:66313:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 56 to 0@lo 00000100:00080000:1.0:1788201271.828983:0:66313:0:(import.c:65:import_set_state_nolock()) ffff8dc13aa9e800 : changing import state from RECOVER to FULL 00000020:00000040:1.0:1788201271.828988:0:66313:0:(genops.c:879:class_export_put()) PUTting export ffff8dc13aa99000 : new refcount 5 00000020:00000040:1.0:1788201271.828990:0:66313:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (ffff8dc13f870000) now 16 - find 00010000:00000040:1.0:1788201271.829004:0:66313:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715296896 00000100:00000040:1.0:1788201271.829013:0:66313:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 57 to 0@lo 00000100:00000040:1.0:1788201271.829214:0:66313:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201271.829237:0:66313:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff8dc120090a80 x1875060715296896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788201281 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.831109:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201271.831123:0:57134:0:(genops.c:1210:class_import_get()) import ffff8dc0034f0000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1788201271.831148:0:57134:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff8dc12ee2c700 x1875060715297024/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201271.831163:0:57134:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000001611ac92] to pc [ptlrpcd_00_03+3] req@ffff8dc12ee2c700 x1875060715297024/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.831188:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201271.831194:0:57134:0:(genops.c:1210:class_import_get()) import ffff8dc0034f2000 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1788201271.831201:0:57134:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff8dc12ee2df80 x1875060715297152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201271.831209:0:57134:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000001791c1cf] to pc [ptlrpcd_00_00+0] req@ffff8dc12ee2df80 x1875060715297152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.831226:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201271.831231:0:57134:0:(genops.c:1210:class_import_get()) import ffff8dc109813800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1788201271.831239:0:57134:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff8dc12ee2d880 x1875060715297280/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201271.831248:0:57134:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b28e037b] to pc [ptlrpcd_00_01+1] req@ffff8dc12ee2d880 x1875060715297280/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201271.831256:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201271.831259:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788201271.831262:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201271.831272:0:57134:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 4119 00000100:00080000:2.0:1788201271.831276:0:57134:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00000040:2.0:1788201271.831279:0:57134:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 56 to 0@lo 00000100:00000040:2.0:1788201271.831282:0:57134:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 57 to 0@lo 00000020:00000040:2.0:1788201271.831316:0:57134:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a163b3 00000020:00000040:2.0:1788201271.831320:0:57134:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc12f3a2800 refcount=4 00000100:00000040:2.0:1788201271.831323:0:57134:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 56 to 0@lo 00000100:00000040:2.0:1788201271.831325:0:57134:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 57 to 0@lo 00000020:00000040:2.0:1788201271.831328:0:57134:0:(genops.c:879:class_export_put()) PUTting export ffff8dc12f3a2800 : new refcount 3 00000100:00080000:2.0:1788201271.831331:0:57134:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8dc006d84000 using connection 192.168.201.120@tcp/0@lo 00000020:00000040:2.0:1788201271.831343:0:57134:0:(genops.c:1210:class_import_get()) import ffff8dc006d84000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:2.0:1788201271.831354:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12ee2ea00 x1875060715297408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201271.831363:0:57134:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c5490506] to pc [ptlrpcd_rcv+-1] req@ffff8dc12ee2ea00 x1875060715297408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.831531:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc12ee2ea00 x1875060715297408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.831545:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715297408:0@lo:8:kworker.0 00000100:00000040:3.0:1788201271.831575:0:3654:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc12ee2ea00 x1875060715297408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788201296 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.831584:0:3654:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201271.831621:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8dc11d29ca80 x1875060715297408 msgsize 520 00000100:00100000:3.0:1788201271.831626:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201271.831645:0:3654:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc12ee2ea00 x1875060715297408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788201296 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.831657:0:3654:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 6040 usecs (7 jiffies) 00000100:00000040:1.0:1788201271.834161:0:66313:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 56 to 0@lo 00000100:00000040:1.0:1788201271.834174:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29c700 x1875060715296896/t0(0) o38->lustre-MDT0000-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1788201291 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.834186:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875060715296896:12345-0@lo:38:llog_process_th.0 Request processed in 5358us (5629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201271.834198:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1603 00000100:00000040:1.0:1788201271.834201:0:66313:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc13aa99000 : new rpc_count 0 00000020:00000040:1.0:1788201271.834218:0:66313:0:(genops.c:879:class_export_put()) PUTting export ffff8dc13aa99000 : new refcount 4 00000100:00000040:1.0:1788201271.834356:0:3658:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc12ee2c700 x1875060715297024/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.834369:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715297024:0@lo:400:kworker.0 00000100:00000040:1.0:1788201271.834394:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc12ee2c700 x1875060715297024/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201287 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.834402:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201271.834435:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff8dc003a70000 x1875060715297024 msgsize 224 00000100:00100000:1.0:1788201271.834440:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788201271.834469:0:3658:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc12ee2c700 x1875060715297024/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201287 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.834481:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8491 usecs (9 jiffies) 00000100:00000040:1.0:1788201271.834507:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc12ee2df80 x1875060715297152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.834517:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715297152:0@lo:400:kworker.0 00000100:00000040:1.0:1788201271.834531:0:3655:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc12ee2df80 x1875060715297152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201287 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.834537:0:3655:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201271.834550:0:3655:0:(events.c:337:request_in_callback()) incoming req@ffff8dc003a72a00 x1875060715297152 msgsize 224 00000100:00100000:1.0:1788201271.834554:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788201271.834568:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc12ee2df80 x1875060715297152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201287 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.834578:0:3655:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 8661 usecs (9 jiffies) 00000100:00100000:1.0:1788201271.834586:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:1.0:1788201271.834591:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc12ee2d880 x1875060715297280/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.834600:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715297280:0@lo:400:kworker.0 00000100:00000040:1.0:1788201271.834613:0:3655:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc12ee2d880 x1875060715297280/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201287 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.834619:0:3655:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201271.834670:0:3655:0:(events.c:337:request_in_callback()) incoming req@ffff8dc003a73800 x1875060715297280 msgsize 224 00000100:00100000:1.0:1788201271.834675:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788201271.834689:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc12ee2d880 x1875060715297280/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201287 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.834699:0:3655:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1320640 usecs (1321 jiffies) 00000100:00100000:1.0:1788201271.834716:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715297024 00000100:00100000:1.0:1788201271.834731:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715297024 00000020:00000040:1.0:1788201271.834733:0:66312:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c6d2 00000020:00000040:1.0:1788201271.834737:0:66312:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc11cdda800 refcount=5 00000020:00000040:1.0:1788201271.834766:0:66312:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff8dc13f870000) now 16 - evictor 00000100:00000040:1.0:1788201271.834789:0:66312:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:1.0:1788201271.834809:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715297152 00000100:00100000:1.0:1788201271.834812:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715297152 00000020:00000040:1.0:1788201271.834813:0:66312:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1644d 00000020:00000040:1.0:1788201271.834815:0:66312:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc10558f000 refcount=5 00000020:00000040:1.0:1788201271.834822:0:66312:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff8dc1060e4d28) now 10 - evictor 00000100:00100000:1.0:1788201271.834841:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1541 00000100:00000040:1.0:1788201271.834845:0:66312:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc11cdda800 : new rpc_count 1 00000100:00000040:1.0:1788201271.834850:0:66312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc003a70000 x1875060715297024/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:392/0 lens 224/0 e 0 to 0 dl 1788201282 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.834861:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715297024:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788201271.834884:0:66312:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715297024 00000100:00000040:1.0:1788201271.834894:0:66312:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 57 to 0@lo 00000100:00000040:1.0:1788201271.834898:0:66312:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201271.834914:0:66312:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc12ee2c700 x1875060715297024/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.834931:0:66312:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 56 to 0@lo 00000100:00000040:1.0:1788201271.834935:0:66312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc003a70000 x1875060715297024/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:392/0 lens 224/224 e 0 to 0 dl 1788201282 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.834942:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715297024:12345-0@lo:400:kworker.0 Request processed in 84us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201271.834948:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1541 00000100:00000040:1.0:1788201271.834950:0:66312:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc11cdda800 : new rpc_count 0 00000020:00000040:1.0:1788201271.834958:0:66312:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11cdda800 : new refcount 4 00000100:00100000:1.0:1788201271.834965:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1542 00000100:00000040:1.0:1788201271.834974:0:66312:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc10558f000 : new rpc_count 1 00000100:00000040:1.0:1788201271.834977:0:66312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc003a72a00 x1875060715297152/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:392/0 lens 224/0 e 0 to 0 dl 1788201282 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.834987:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715297152:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788201271.834996:0:66312:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715297152 00000100:00000040:1.0:1788201271.835001:0:66312:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 57 to 0@lo 00000100:00000040:1.0:1788201271.835004:0:66312:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201271.835045:0:66312:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc12ee2df80 x1875060715297152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.835141:0:66312:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 56 to 0@lo 00000100:00000040:1.0:1788201271.835146:0:66312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc003a72a00 x1875060715297152/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:392/0 lens 224/224 e 0 to 0 dl 1788201282 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.835154:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715297152:12345-0@lo:400:kworker.0 Request processed in 168us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201271.835159:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1542 00000100:00000040:1.0:1788201271.835161:0:66312:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc10558f000 : new rpc_count 0 00000020:00000040:1.0:1788201271.835168:0:66312:0:(genops.c:879:class_export_put()) PUTting export ffff8dc10558f000 : new refcount 4 00000100:00100000:1.0:1788201271.835201:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715297280 00000100:00100000:1.0:1788201271.835206:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715297280 00000020:00000040:1.0:1788201271.835207:0:8458:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c54a 00000020:00000040:1.0:1788201271.835210:0:8458:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc103486000 refcount=7 00000100:00000040:1.0:1788201271.835222:0:8458:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:1.0:1788201271.835242:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4116 00000100:00000040:1.0:1788201271.835245:0:8458:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc103486000 : new rpc_count 1 00000100:00000040:1.0:1788201271.835249:0:8458:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc003a73800 x1875060715297280/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:392/0 lens 224/0 e 0 to 0 dl 1788201282 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.835259:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715297280:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788201271.835278:0:8458:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1875060715297280 00000100:00000040:1.0:1788201271.835283:0:8458:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 57 to 0@lo 00000100:00000040:1.0:1788201271.835297:0:8458:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201271.835315:0:8458:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc12ee2d880 x1875060715297280/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.835328:0:8458:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 56 to 0@lo 00000100:00000040:1.0:1788201271.835333:0:8458:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc003a73800 x1875060715297280/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:392/0 lens 224/224 e 0 to 0 dl 1788201282 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.835340:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715297280:12345-0@lo:400:kworker.0 Request processed in 82us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201271.835346:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4116 00000100:00000040:1.0:1788201271.835348:0:8458:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc103486000 : new rpc_count 0 00000020:00000040:1.0:1788201271.835357:0:8458:0:(genops.c:879:class_export_put()) PUTting export ffff8dc103486000 : new refcount 6 00000100:00080000:1.0:1788201271.835370:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1788201271.835373:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001 (ffff8dc1060e4d28) now 10 - evictor 00000100:00080000:1.0:1788201271.835376:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:1.0:1788201271.835378:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (ffff8dc13f870000) now 16 - evictor 00000100:00000040:1.0:1788201271.835412:0:3658:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:1.0:1788201271.835418:0:3658:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc12ee2c700 x1875060715297024/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.835427:0:3658:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12ee2c700 x1875060715297024/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.835435:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715297024:0@lo:400:kworker.0 00000100:00000040:1.0:1788201271.835441:0:3658:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc12ee2c700 x1875060715297024/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201271.835451:0:3658:0:(genops.c:1223:class_import_put()) import ffff8dc0034f0000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:1.0:1788201271.835483:0:3655:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:1.0:1788201271.835489:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc12ee2d880 x1875060715297280/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.835497:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12ee2d880 x1875060715297280/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.835503:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715297280:0@lo:400:kworker.0 00000100:00000040:1.0:1788201271.835513:0:3655:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:1.0:1788201271.835517:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc12ee2df80 x1875060715297152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.835524:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12ee2df80 x1875060715297152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.835531:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715297152:0@lo:400:kworker.0 00000100:00000040:1.0:1788201271.835536:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc12ee2d880 x1875060715297280/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201271.835542:0:3655:0:(genops.c:1223:class_import_put()) import ffff8dc109813800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1788201271.835547:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc12ee2df80 x1875060715297152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201271.835554:0:3655:0:(genops.c:1223:class_import_put()) import ffff8dc0034f2000 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1788201271.836695:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201271.836707:0:57134:0:(genops.c:1210:class_import_get()) import ffff8dc1031f8800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1788201271.836729:0:57134:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff8dc12ee2ca80 x1875060715297536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201271.836744:0:57134:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ed328feb] to pc [ptlrpcd_00_02+2] req@ffff8dc12ee2ca80 x1875060715297536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.836765:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201271.836771:0:57134:0:(genops.c:1210:class_import_get()) import ffff8dc001db0000 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1788201271.836779:0:57134:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff8dc12ee2df80 x1875060715297664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201271.836787:0:57134:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000001791c1cf] to pc [ptlrpcd_00_03+3] req@ffff8dc12ee2df80 x1875060715297664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.836803:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201271.836808:0:57134:0:(genops.c:1210:class_import_get()) import ffff8dc104281000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1788201271.836816:0:57134:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff8dc12ee2d880 x1875060715297792/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201271.836826:0:57134:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b28e037b] to pc [ptlrpcd_00_00+0] req@ffff8dc12ee2d880 x1875060715297792/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201271.836838:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201271.836842:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788201271.836845:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201271.836850:0:57134:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 4119 00000100:00080000:2.0:1788201271.836854:0:57134:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00000040:2.0:1788201271.836856:0:57134:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 55 to 0@lo 00000100:00000040:2.0:1788201271.836860:0:57134:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 56 to 0@lo 00000020:00000040:2.0:1788201271.836862:0:57134:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c597 00000020:00000040:2.0:1788201271.836865:0:57134:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc005d70800 refcount=4 00000100:00000040:2.0:1788201271.836868:0:57134:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 55 to 0@lo 00000100:00000040:2.0:1788201271.836870:0:57134:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 56 to 0@lo 00000020:00000040:2.0:1788201271.836872:0:57134:0:(genops.c:879:class_export_put()) PUTting export ffff8dc005d70800 : new refcount 3 00000100:00080000:2.0:1788201271.836875:0:57134:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dc109815000 using connection 192.168.201.120@tcp/0@lo 00000020:00000040:2.0:1788201271.836885:0:57134:0:(genops.c:1210:class_import_get()) import ffff8dc109815000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:2.0:1788201271.836897:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12ee2c700 x1875060715297920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201271.836904:0:57134:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000001611ac92] to pc [ptlrpcd_rcv+-1] req@ffff8dc12ee2c700 x1875060715297920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.836912:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201271.836922:0:57134:0:(genops.c:1210:class_import_get()) import ffff8dc1257f0800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1788201271.836930:0:57134:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff8dc004be6a00 x1875060715298048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201271.836938:0:57134:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002e81929f] to pc [ptlrpcd_00_01+1] req@ffff8dc004be6a00 x1875060715298048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.836945:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201271.836949:0:57134:0:(genops.c:1210:class_import_get()) import ffff8dc137d33000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1788201271.836955:0:57134:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff8dc004be4380 x1875060715298176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201271.836962:0:57134:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000048c37498] to pc [ptlrpcd_00_02+2] req@ffff8dc004be4380 x1875060715298176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.836972:0:57134:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (4128) 00000100:00000040:2.0:1788201271.836993:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc12ee2ca80 x1875060715297536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.837005:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715297536:0@lo:400:kworker.0 00000100:00000040:1.0:1788201271.837151:0:3658:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc12ee2df80 x1875060715297664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.837160:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715297664:0@lo:400:kworker.0 00000100:00000040:2.0:1788201271.837192:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc12ee2ca80 x1875060715297536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201287 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.837201:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201271.838993:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc12ee2df80 x1875060715297664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201287 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.839005:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201271.839146:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff8dc003a70a80 x1875060715297664 msgsize 224 00000100:00100000:1.0:1788201271.839152:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788201271.839180:0:3658:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc12ee2df80 x1875060715297664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201287 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.839194:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 84301 usecs (85 jiffies) 00000100:00000040:1.0:1788201271.839229:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc12ee2d880 x1875060715297792/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.839241:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715297792:0@lo:400:kworker.0 00000100:00000040:1.0:1788201271.839263:0:3655:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc12ee2d880 x1875060715297792/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201287 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.839270:0:3655:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201271.839297:0:3655:0:(events.c:337:request_in_callback()) incoming req@ffff8dc003a72680 x1875060715297792 msgsize 224 00000100:00100000:1.0:1788201271.839301:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788201271.839318:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc12ee2d880 x1875060715297792/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201287 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.839328:0:3655:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 3835 usecs (4 jiffies) 00000100:00100000:1.0:1788201271.839337:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:1.0:1788201271.839390:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc004be6a00 x1875060715298048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.839400:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715298048:0@lo:400:kworker.0 00000100:00000040:1.0:1788201271.839414:0:3655:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc004be6a00 x1875060715298048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201287 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.839421:0:3655:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201271.839436:0:3655:0:(events.c:337:request_in_callback()) incoming req@ffff8dc003a73480 x1875060715298048 msgsize 224 00000100:00100000:1.0:1788201271.839440:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788201271.839457:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc004be6a00 x1875060715298048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201287 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.839467:0:3655:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 7107 usecs (8 jiffies) 00000100:00100000:1.0:1788201271.839494:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715297792 00000100:00100000:1.0:1788201271.839501:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715297792 00000020:00000040:1.0:1788201271.839504:0:8457:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c582 00000020:00000040:1.0:1788201271.839508:0:8457:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc11d63c000 refcount=5 00000100:00000040:1.0:1788201271.839528:0:8457:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:1.0:1788201271.839554:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4117 00000100:00000040:1.0:1788201271.839558:0:8457:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc11d63c000 : new rpc_count 1 00000100:00000040:1.0:1788201271.839564:0:8457:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc003a72680 x1875060715297792/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:392/0 lens 224/0 e 0 to 0 dl 1788201282 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.839575:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715297792:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788201271.839598:0:8457:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715297792 00000100:00000040:1.0:1788201271.839608:0:8457:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 57 to 0@lo 00000100:00000040:1.0:1788201271.839612:0:8457:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201271.839629:0:8457:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc12ee2d880 x1875060715297792/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.839646:0:8457:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 56 to 0@lo 00000100:00000040:1.0:1788201271.839650:0:8457:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc003a72680 x1875060715297792/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:392/0 lens 224/224 e 0 to 0 dl 1788201282 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.839658:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715297792:12345-0@lo:400:kworker.0 Request processed in 85us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201271.839664:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4117 00000100:00000040:1.0:1788201271.839668:0:8457:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc11d63c000 : new rpc_count 0 00000020:00000040:1.0:1788201271.839678:0:8457:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11d63c000 : new refcount 4 00000100:00100000:1.0:1788201271.839694:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715297408 00000100:00100000:1.0:1788201271.839698:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715297408 00000020:00000040:1.0:1788201271.839700:0:26199:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a163c8 00000100:00100000:1.0:1788201271.839718:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715298048 00000100:00100000:1.0:1788201271.839721:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715298048 00000020:00000040:1.0:1788201271.839723:0:26199:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c5ba 00000020:00000040:1.0:1788201271.839731:0:26199:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc0059d1800 refcount=5 00000020:00000040:1.0:1788201271.839744:0:26199:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff8dc139bbcd28) now 10 - evictor 00000100:00000040:1.0:1788201271.839760:0:26199:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1788201271.839775:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2923 00000100:00000040:1.0:1788201271.839778:0:26199:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc0059d1800 : new rpc_count 1 00000100:00000040:1.0:1788201271.839782:0:26199:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc003a73480 x1875060715298048/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:392/0 lens 224/0 e 0 to 0 dl 1788201282 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.839791:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715298048:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788201271.839801:0:26199:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969457, transno 0, xid 1875060715298048 00000100:00000040:1.0:1788201271.839806:0:26199:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 57 to 0@lo 00000100:00000040:1.0:1788201271.839809:0:26199:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201271.839824:0:26199:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc004be6a00 x1875060715298048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.839835:0:26199:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 56 to 0@lo 00000100:00000040:1.0:1788201271.839839:0:26199:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc003a73480 x1875060715298048/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:392/0 lens 224/224 e 0 to 0 dl 1788201282 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.839846:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715298048:12345-0@lo:400:kworker.0 Request processed in 56us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201271.839852:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2923 00000100:00000040:1.0:1788201271.839854:0:26199:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc0059d1800 : new rpc_count 0 00000020:00000040:1.0:1788201271.839861:0:26199:0:(genops.c:879:class_export_put()) PUTting export ffff8dc0059d1800 : new refcount 4 00000100:00100000:1.0:1788201271.839870:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5987 00000100:00000040:1.0:1788201271.839874:0:26199:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc11d29ca80 x1875060715297408/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788201291 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.839882:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3654:x1875060715297408:12345-0@lo:8:kworker.0 00000020:00000040:1.0:1788201271.839897:0:26199:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8dc004fd4d28) now 7 - find 00010000:00000040:1.0:1788201271.839901:0:26199:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:1.0:1788201271.839910:0:26199:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0000 (ffff8dc004fd4d28) now 7 - find 00000100:00000040:1.0:1788201271.839922:0:26199:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 57 to 0@lo 00000100:00000040:1.0:1788201271.839925:0:26199:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8dc125a970c0 refcount 57 to 0@lo 00000100:00000040:1.0:1788201271.839927:0:26199:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201271.839946:0:26199:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff8dc12ee2ea00 x1875060715297408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788201296 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.839959:0:26199:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 56 to 0@lo 00000100:00000040:1.0:1788201271.839965:0:26199:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29ca80 x1875060715297408/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788201291 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.839972:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3654:x1875060715297408:12345-0@lo:8:kworker.0 Request processed in 90us (8350us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788201271.839978:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5987 00000100:00000040:1.0:1788201271.840036:0:3655:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969457 00000100:00000040:1.0:1788201271.840042:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc004be6a00 x1875060715298048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.840173:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff8dc11cc47b80 x1875060715297536 msgsize 224 00000100:00100000:2.0:1788201271.840179:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201271.840199:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc12ee2ca80 x1875060715297536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201287 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.840210:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5631 usecs (6 jiffies) 00000100:00000040:2.0:1788201271.840218:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc004be4380 x1875060715298176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.840226:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715298176:0@lo:400:kworker.0 00000100:00000040:2.0:1788201271.840250:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc004be4380 x1875060715298176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201287 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.840256:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201271.840272:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff8dc11cc47480 x1875060715298176 msgsize 224 00000100:00100000:2.0:1788201271.840276:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201271.840304:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc004be4380 x1875060715298176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201287 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.840314:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 5667 usecs (6 jiffies) 00000100:00100000:2.0:1788201271.840356:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715297664 00000100:00100000:2.0:1788201271.840360:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715297664 00000020:00000040:2.0:1788201271.840362:0:66757:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c6d9 00000020:00000040:2.0:1788201271.840365:0:66757:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc11d63e800 refcount=5 00000100:00000040:2.0:1788201271.840378:0:66757:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1788201271.840395:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715298176 00000100:00100000:2.0:1788201271.840398:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715298176 00000020:00000040:2.0:1788201271.840399:0:66757:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c6e0 00000020:00000040:2.0:1788201271.840401:0:66757:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc137d37000 refcount=5 00000100:00100000:2.0:1788201271.840419:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1543 00000100:00000040:2.0:1788201271.840422:0:66757:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc11d63e800 : new rpc_count 1 00000100:00000040:2.0:1788201271.840426:0:66757:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc003a70a80 x1875060715297664/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:392/0 lens 224/0 e 0 to 0 dl 1788201282 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.840435:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715297664:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788201271.840447:0:66757:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715297664 00000100:00000040:2.0:1788201271.840451:0:66757:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 57 to 0@lo 00000100:00000040:2.0:1788201271.840455:0:66757:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201271.840472:0:66757:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc12ee2df80 x1875060715297664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.840491:0:66757:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 56 to 0@lo 00000100:00000040:2.0:1788201271.840496:0:66757:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc003a70a80 x1875060715297664/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:392/0 lens 224/224 e 0 to 0 dl 1788201282 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.840510:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715297664:12345-0@lo:400:kworker.0 Request processed in 75us (1362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201271.840516:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1543 00000100:00000040:2.0:1788201271.840519:0:66757:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc11d63e800 : new rpc_count 0 00000020:00000040:2.0:1788201271.840525:0:66757:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11d63e800 : new refcount 4 00000100:00100000:2.0:1788201271.840535:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1544 00000100:00000040:2.0:1788201271.840537:0:66757:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc137d37000 : new rpc_count 1 00000100:00000040:2.0:1788201271.840540:0:66757:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc11cc47480 x1875060715298176/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:392/0 lens 224/0 e 0 to 0 dl 1788201282 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.840549:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715298176:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788201271.840559:0:66757:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715298176 00000100:00000040:2.0:1788201271.840564:0:66757:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 57 to 0@lo 00000100:00000040:2.0:1788201271.840567:0:66757:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201271.840582:0:66757:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc004be4380 x1875060715298176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.840598:0:66757:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 56 to 0@lo 00000100:00000040:2.0:1788201271.840602:0:66757:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11cc47480 x1875060715298176/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:392/0 lens 224/224 e 0 to 0 dl 1788201282 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.840609:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715298176:12345-0@lo:400:kworker.0 Request processed in 61us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201271.840614:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1544 00000100:00000040:2.0:1788201271.840616:0:66757:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc137d37000 : new rpc_count 0 00000020:00000040:2.0:1788201271.840621:0:66757:0:(genops.c:879:class_export_put()) PUTting export ffff8dc137d37000 : new refcount 4 00000100:00000040:2.0:1788201271.840642:0:3657:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1788201271.840646:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc004be4380 x1875060715298176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.840666:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc004be4380 x1875060715298176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.840673:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715298176:0@lo:400:kworker.0 00000100:00000040:2.0:1788201271.840680:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc004be4380 x1875060715298176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788201271.840690:0:3657:0:(genops.c:1223:class_import_put()) import ffff8dc137d33000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:1.0:1788201271.840924:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc004be6a00 x1875060715298048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.840931:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715298048:0@lo:400:kworker.0 00000100:00000040:1.0:1788201271.840946:0:3655:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1788201271.840950:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc12ee2d880 x1875060715297792/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.840957:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12ee2d880 x1875060715297792/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.840963:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715297792:0@lo:400:kworker.0 00000100:00000040:1.0:1788201271.840968:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc004be6a00 x1875060715298048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201271.840987:0:3655:0:(genops.c:1223:class_import_put()) import ffff8dc1257f0800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1788201271.840993:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc12ee2d880 x1875060715297792/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201271.841000:0:3655:0:(genops.c:1223:class_import_put()) import ffff8dc104281000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00100000:1.0:1788201271.841169:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715297536 00000100:00100000:1.0:1788201271.841173:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715297536 00000020:00000040:1.0:1788201271.841175:0:26205:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a163d6 00000020:00000040:1.0:1788201271.841178:0:26205:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1201ce800 refcount=5 00000100:00000040:1.0:1788201271.841190:0:26205:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1788201271.841245:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2924 00000100:00000040:1.0:1788201271.841248:0:26205:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1201ce800 : new rpc_count 1 00000100:00000040:1.0:1788201271.841253:0:26205:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc11cc47b80 x1875060715297536/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:392/0 lens 224/0 e 0 to 0 dl 1788201282 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.841264:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715297536:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788201271.841276:0:26205:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969442, transno 0, xid 1875060715297536 00000100:00000040:1.0:1788201271.841281:0:26205:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 57 to 0@lo 00000100:00000040:1.0:1788201271.841297:0:26205:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201271.841319:0:26205:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc12ee2ca80 x1875060715297536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.841341:0:26205:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 56 to 0@lo 00000100:00000040:1.0:1788201271.841397:0:26205:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11cc47b80 x1875060715297536/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:392/0 lens 224/224 e 0 to 0 dl 1788201282 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201271.841412:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715297536:12345-0@lo:400:kworker.0 Request processed in 150us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201271.841418:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2924 00000100:00000040:1.0:1788201271.841420:0:26205:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1201ce800 : new rpc_count 0 00000020:00000040:1.0:1788201271.841429:0:26205:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1201ce800 : new refcount 4 00000100:00000040:2.0:1788201271.841498:0:3657:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969442 00000100:00000040:2.0:1788201271.841504:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc12ee2ca80 x1875060715297536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.841512:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12ee2ca80 x1875060715297536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.841519:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715297536:0@lo:400:kworker.0 00000100:00000040:2.0:1788201271.841524:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc12ee2ca80 x1875060715297536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788201271.841531:0:3657:0:(genops.c:1223:class_import_put()) import ffff8dc1031f8800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00100000:3.0:1788201271.841634:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:3.0:1788201271.841638:0:3654:0:(client.c:3235:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:3.0:1788201271.841644:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc120090a80 x1875060715296896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201271.841655:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 29 00000020:00000040:3.0:1788201271.841657:0:3654:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d503 00000020:00000040:3.0:1788201271.841659:0:3654:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc11077f800 refcount=4 00000100:00080000:3.0:1788201271.841665:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:3.0:1788201271.841668:0:3654:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11077f800 : new refcount 3 00000100:00080000:3.0:1788201271.841671:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788201271.841674:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc004014000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00000040:3.0:1788201271.841681:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc120090a80 x1875060715296896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201281 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.841695:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715296896:0@lo:38:llog_process_th.0 00000100:00000040:3.0:1788201271.841702:0:3654:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc120090a80 x1875060715296896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201281 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201271.841711:0:3654:0:(genops.c:1223:class_import_put()) import ffff8dc004014000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:3.0:1788201271.841725:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc12ee2c700 x1875060715297920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.841734:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715297920:0@lo:8:kworker.0 00000100:00000040:3.0:1788201271.841753:0:3654:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc12ee2c700 x1875060715297920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788201296 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.841760:0:3654:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201271.841777:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8dc11d29dc00 x1875060715297920 msgsize 520 00000100:00100000:3.0:1788201271.841782:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201271.842006:0:3654:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc12ee2c700 x1875060715297920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788201296 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.842038:0:3654:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 6795 usecs (7 jiffies) 00000100:00100000:0.0:1788201271.842191:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715297920 00000100:00100000:0.0:1788201271.842197:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715297920 00000020:00000040:0.0:1788201271.842199:0:23974:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c5ac 00000100:00100000:0.0:1788201271.842226:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5988 00000100:00000040:0.0:1788201271.842231:0:23974:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc11d29dc00 x1875060715297920/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788201291 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.842240:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3654:x1875060715297920:12345-0@lo:8:kworker.0 00000020:00000040:0.0:1788201271.842255:0:23974:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8dc004fd4d28) now 7 - find 00010000:00000040:0.0:1788201271.842260:0:23974:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:0.0:1788201271.842262:0:23974:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0000 (ffff8dc004fd4d28) now 7 - find 00000100:00000040:0.0:1788201271.842273:0:23974:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 57 to 0@lo 00000100:00000040:0.0:1788201271.842276:0:23974:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8dc125a970c0 refcount 57 to 0@lo 00000100:00000040:0.0:1788201271.842279:0:23974:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201271.842537:0:3654:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294969456 00000100:00000040:3.0:1788201271.842543:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc12ee2ea00 x1875060715297408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788201296 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201271.842550:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201271.842554:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:3.0:1788201271.842557:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12ee2ea00 x1875060715297408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788201296 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.842562:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715297408:0@lo:8:kworker.0 00000100:00000040:3.0:1788201271.842567:0:3654:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc12ee2ea00 x1875060715297408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788201296 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201271.842581:0:3654:0:(genops.c:1223:class_import_put()) import ffff8dc006d84000 refcount=2 obd=lustre-OST0000-osc-MDT0001 00000020:00000040:3.0:1788201271.842654:0:97045:0:(genops.c:868:class_export_get()) GET export ffff8dc11077f800 refcount=4 00000020:00000040:3.0:1788201271.842668:0:97045:0:(genops.c:868:class_export_get()) GET export ffff8dc11077f800 refcount=5 00000100:00000040:3.0:1788201271.842738:0:97045:0:(lustre_peer.c:130:class_add_uuid()) found uuid 192.168.201.120@tcp 192.168.201.120@tcp cnt=1 00000020:01000004:3.0:1788201271.842758:0:97045:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788201271.842775:0:97045:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8dc12ef60000) 00000020:00000040:3.0:1788201271.842782:0:97045:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8dc001e2d000 with handle 0x96d0c9b8c9a1d511 to hash 00000020:00000040:3.0:1788201271.842788:0:97045:0:(genops.c:879:class_export_put()) PUTting export ffff8dc001e2d000 : new refcount 1 00000020:00000040:3.0:1788201271.842799:0:97045:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff8dc12ef60000) now 2 - obd_device_list 00000020:00000080:3.0:1788201271.842804:0:97045:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1788201271.842888:0:97045:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc120724000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788201271.842891:0:97045:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc120724000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788201271.842894:0:97045:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc120724000 3 00000020:00000040:3.0:1788201271.842910:0:97045:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff8dc12ef60000) now 3 - import 00000020:00000040:3.0:1788201271.842916:0:97045:0:(genops.c:1223:class_import_put()) import ffff8dc13f869000 refcount=1 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:3.0:1788201271.842924:0:97045:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 58 to 0@lo 00000100:00000040:3.0:1788201271.842927:0:97045:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8dc125a970c0 refcount 58 to 0@lo 00000100:00000040:3.0:1788201271.842929:0:97045:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.201.120@tcp -> ffff8dc125a970c0 00010000:00080000:3.0:1788201271.842933:0:97045:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc13f869000@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.120@tcp at head 00010000:00010000:3.0:1788201271.844503:0:97045:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000020:00000040:3.0:1788201271.844690:0:97045:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff8dc12ef60000) now 4 - setup 00000020:00000080:3.0:1788201271.844694:0:97045:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788201271.844734:0:97045:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000040:3.0:1788201271.844742:0:97045:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8dc00397e800 with handle 0x96d0c9b8c9a1d518 to hash 00000020:00000040:3.0:1788201271.844750:0:97045:0:(genops.c:868:class_export_get()) GET export ffff8dc00397e800 refcount=3 00000020:00000040:3.0:1788201271.844753:0:97045:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff8dc12ef60000) now 5 - export 00000020:00000040:3.0:1788201271.844756:0:97045:0:(genops.c:879:class_export_put()) PUTting export ffff8dc00397e800 : new refcount 2 00000020:00000080:3.0:1788201271.844758:0:97045:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x96d0c9b8c9a1d518 00000020:00000040:3.0:1788201271.844761:0:97045:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d518 00000020:00000040:3.0:1788201271.844768:0:97045:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc00397e800 refcount=3 00000100:00080000:3.0:1788201271.844779:0:97045:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:3.0:1788201271.844783:0:97045:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 59 to 0@lo 00000020:00000040:3.0:1788201271.844785:0:97045:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d518 00000020:00000040:3.0:1788201271.844787:0:97045:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc00397e800 refcount=4 00000100:00000040:3.0:1788201271.844789:0:97045:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 60 to 0@lo 00000020:00000040:3.0:1788201271.844791:0:97045:0:(genops.c:879:class_export_put()) PUTting export ffff8dc00397e800 : new refcount 3 00000100:00080000:3.0:1788201271.844794:0:97045:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8dc13f869000 using connection 192.168.201.120@tcp/0@lo 00000020:00000040:3.0:1788201271.844808:0:97045:0:(genops.c:1210:class_import_get()) import ffff8dc13f869000 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00100000:3.0:1788201271.844830:0:97045:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11d29d880 x1875060715298304/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788201271.844845:0:97045:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ea163604] to pc [ptlrpcd_rcv+-1] req@ffff8dc11d29d880 x1875060715298304/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201271.844869:0:97045:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000020:00000040:3.0:1788201271.844873:0:97045:0:(genops.c:1210:class_import_get()) import ffff8dc13f869000 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:3.0:1788201271.844930:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc11d29d880 x1875060715298304/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.844942:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715298304:0@lo:38:llog_process_th.0 00000100:00000040:2.0:1788201271.845125:0:57134:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (4128) 00000020:00000040:2.0:1788201271.845137:0:97047:0:(genops.c:868:class_export_get()) GET export ffff8dc11077f800 refcount=6 00000020:00000040:2.0:1788201271.845142:0:97047:0:(genops.c:868:class_export_get()) GET export ffff8dc11077f800 refcount=7 00000020:00000040:2.0:1788201271.845146:0:97047:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11077f800 : new refcount 6 00000100:00080000:1.0:1788201271.845625:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1788201271.845632:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff8dc139bbcd28) now 10 - evictor 00000100:00000040:0.0:1788201271.845991:0:23974:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff8dc12ee2c700 x1875060715297920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788201296 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201271.846040:0:23974:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 59 to 0@lo 00000100:00000040:0.0:1788201271.850204:0:23974:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29dc00 x1875060715297920/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1788201291 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.850246:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3654:x1875060715297920:12345-0@lo:8:kworker.0 Request processed in 8001us (8462us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788201271.850258:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5988 00000020:00000040:2.0:1788201271.850563:0:97045:0:(genops.c:868:class_export_get()) GET export ffff8dc00397e800 refcount=4 00000020:00000040:2.0:1788201271.850585:0:97045:0:(genops.c:868:class_export_get()) GET export ffff8dc00397e800 refcount=5 00000040:00080000:2.0:1788201271.850696:0:97045:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64 count 63 00000020:01000000:2.0:1788201271.850823:0:97034:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:2.0:1788201271.850857:0:97034:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00000020:00000040:2.0:1788201271.850876:0:97034:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc006dbce00 refcount=3 00010000:00010000:2.0:1788201271.850883:0:97034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbce00/0x96d0c9b8c9a1d4ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d4f5 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201271.850902:0:97034:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc006dbce00/0x96d0c9b8c9a1d4ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d4f5 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788201271.850956:0:97034:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788201271.850959:0:97034:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201271.850960:0:97034:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201271.850962:0:97034:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201271.850963:0:97034:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201271.850965:0:97034:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201271.850966:0:97034:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201271.850968:0:97034:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201271.850969:0:97034:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788201271.850973:0:97034:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788201271.850975:0:97034:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788201271.850977:0:97034:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201271.850978:0:97034:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201271.850979:0:97034:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201271.850980:0:97034:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201271.850981:0:97034:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201271.850982:0:97034:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201271.850983:0:97034:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201271.850984:0:97034:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:00000040:2.0:1788201271.850991:0:97034:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 10000000:01000000:2.0:1788201271.851032:0:97034:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:2.0:1788201271.851123:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc11cc44000 x1875060715298432/t0(0) o253->MGC192.168.201.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.851137:0:97034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715298432:0@lo:253:mount.lustre.0 00000100:00000040:2.0:1788201271.851206:0:97034:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc11cc44000 x1875060715298432/t0(0) o253->MGC192.168.201.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788201287 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.851215:0:97034:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201271.851254:0:97034:0:(events.c:337:request_in_callback()) incoming req@ffff8dc140d78450 x1875060715298432 msgsize 4848 00000100:00100000:2.0:1788201271.851258:0:97034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201271.851264:0:97034:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1788201271.851339:0:3658:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:3.0:1788201271.851344:0:3654:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc11d29d880 x1875060715298304/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788201281 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.851358:0:3654:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201271.851376:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8dc11d29f800 x1875060715298304 msgsize 520 00000100:00100000:3.0:1788201271.851381:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201271.851399:0:3654:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc11d29d880 x1875060715298304/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788201281 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.851466:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8dc11cc44000 x1875060715298432/t0(0) o253->MGC192.168.201.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788201287 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.851481:0:3658:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc12ee2df80 x1875060715297664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.851491:0:3658:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12ee2df80 x1875060715297664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.851492:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715298432 00000100:00100000:1.0:1788201271.851497:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715297664:0@lo:400:kworker.0 00000100:00100000:2.0:1788201271.851498:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715298432 00000020:00000040:2.0:1788201271.851501:0:94467:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:2.0:1788201271.851504:0:94467:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=24 00000100:00000040:1.0:1788201271.851505:0:3658:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc12ee2df80 x1875060715297664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201287 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.851521:0:94467:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1788201271.851546:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00000040:2.0:1788201271.851550:0:94467:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:2.0:1788201271.851554:0:94467:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc140d78450 x1875060715298432/t0(0) o253->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 4848/0 e 0 to 0 dl 1788201282 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.851566:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:97034:x1875060715298432:12345-0@lo:253:mount.lustre.0 00000020:00000040:1.0:1788201271.851571:0:3658:0:(genops.c:1223:class_import_put()) import ffff8dc001db0000 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 20000000:01000000:2.0:1788201271.851592:0:94467:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788201271.851604:0:94467:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788201271.851724:0:97034:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a86e240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201271.852487:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715298304 00000100:00100000:2.0:1788201271.852493:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715298304 00000020:00000040:2.0:1788201271.852495:0:66757:0:(genops.c:804:class_conn2export()) looking for export cookie 0x0 00000100:00100000:2.0:1788201271.852526:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1604 00000100:00000040:2.0:1788201271.852532:0:66757:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc11d29f800 x1875060715298304/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1788201291 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.852540:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715298304:12345-0@lo:38:llog_process_th.0 00000020:00000040:2.0:1788201271.852552:0:66757:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff8dc1060e4d28) now 10 - find 00000100:00000040:3.0:1788201271.852617:0:3654:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000100:00000040:3.0:1788201271.852645:0:3654:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: skip recheck: last_committed 4294969474 00000100:00000040:3.0:1788201271.852657:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc12ee2c700 x1875060715297920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788201296 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201271.852667:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201271.852671:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:3.0:1788201271.852675:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12ee2c700 x1875060715297920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788201296 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.852681:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715297920:0@lo:8:kworker.0 00000100:00000040:3.0:1788201271.852688:0:3654:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc12ee2c700 x1875060715297920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1788201296 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201271.852697:0:3654:0:(genops.c:1223:class_import_put()) import ffff8dc109815000 refcount=2 obd=lustre-OST0000-osc-MDT0000 00000020:00000040:0.0:1788201271.852868:0:97048:0:(genops.c:879:class_export_put()) PUTting export ffff8dc00397e800 : new refcount 4 00010000:00000040:2.0:1788201271.853144:0:66757:0:(ldlm_lib.c:1263:target_handle_connect()) lustre-MDT0001: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00010000:00080000:2.0:1788201271.853152:0:66757:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 4123 last 0 00000020:00000040:2.0:1788201271.853161:0:66757:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8dc11cdde000 with handle 0x96d0c9b8c9a1d51f to hash 00000020:00000040:2.0:1788201271.853184:0:66757:0:(genops.c:868:class_export_get()) GET export ffff8dc11cdde000 refcount=3 00000020:00000040:2.0:1788201271.853193:0:66757:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff8dc1060e4d28) now 11 - export 00000020:00000040:2.0:1788201271.853196:0:66757:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11cdde000 : new refcount 2 00000020:00000080:2.0:1788201271.853198:0:66757:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x96d0c9b8c9a1d51f 00000020:00000040:2.0:1788201271.853200:0:66757:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d51f 00000020:00000040:2.0:1788201271.853203:0:66757:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc11cdde000 refcount=3 00000001:00000040:2.0:1788201271.853212:0:66757:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.201.120@tcp 00000001:00000040:2.0:1788201271.853217:0:66757:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8dc1330c8800) : new refcount 18 00000020:00000040:2.0:1788201271.853221:0:66757:0:(genops.c:868:class_export_get()) GET export ffff8dc11cdde000 refcount=4 00000001:00000040:2.0:1788201271.853223:0:66757:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8dc1330c8800) : new refcount 19 00000001:00000040:2.0:1788201271.853226:0:66757:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff8dc1330c8800) : new refcount 18 00000004:00100000:2.0:1788201271.853230:0:66757:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000040:2.0:1788201271.853238:0:66757:0:(lprocfs_status_server.c:748:lprocfs_exp_setup()) Found stats ffff8dc13a8406c0 for nid 0@lo - ref 4 00000020:00000040:2.0:1788201271.853246:0:66757:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff8dc1060e4d28) now 12 - import 00000020:00000040:2.0:1788201271.853252:0:66757:0:(genops.c:1223:class_import_put()) import ffff8dc001e29800 refcount=1 obd=lustre-MDT0001 00000020:00000040:2.0:1788201271.853258:0:66757:0:(genops.c:868:class_export_get()) GET export ffff8dc11cdde000 refcount=5 00000100:00000040:2.0:1788201271.853260:0:66757:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff8dc11cdde000 : new rpc_count 1 00000100:00000040:2.0:1788201271.853265:0:66757:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 60 to 0@lo 00000100:00000040:2.0:1788201271.853268:0:66757:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8dc125a970c0 refcount 60 to 0@lo 00000020:00000040:2.0:1788201271.853271:0:66757:0:(genops.c:868:class_export_get()) GET export ffff8dc11cdde000 refcount=6 00000100:00000040:2.0:1788201271.853276:0:66757:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 61 to 0@lo 00000100:00080000:2.0:1788201271.853294:0:66757:0:(import.c:65:import_set_state_nolock()) ffff8dc001e29800 : changing import state from RECOVER to FULL 00000020:00000040:2.0:1788201271.853299:0:66757:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11cdde000 : new refcount 5 00000020:00000040:2.0:1788201271.853302:0:66757:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001 (ffff8dc1060e4d28) now 12 - find 00010000:00000040:2.0:1788201271.853313:0:66757:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715298304 00000100:00000040:2.0:1788201271.853321:0:66757:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 62 to 0@lo 00000100:00000040:2.0:1788201271.853326:0:66757:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201271.853355:0:66757:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff8dc11d29d880 x1875060715298304/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788201281 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.853381:0:66757:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 61 to 0@lo 00000100:00000040:2.0:1788201271.853386:0:66757:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29f800 x1875060715298304/t0(0) o38->lustre-MDT0001-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1788201291 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.853493:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:0.0:1788201271.853497:0:3654:0:(client.c:3235:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:0.0:1788201271.853503:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc11d29d880 x1875060715298304/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201271.853513:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 18 00000020:00000040:0.0:1788201271.853515:0:3654:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d518 00000020:00000040:0.0:1788201271.853517:0:3654:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc00397e800 refcount=5 00000100:00080000:0.0:1788201271.853523:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:0.0:1788201271.853525:0:3654:0:(genops.c:879:class_export_put()) PUTting export ffff8dc00397e800 : new refcount 4 00000100:00080000:0.0:1788201271.853529:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788201271.853531:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f869000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00000040:0.0:1788201271.853537:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29d880 x1875060715298304/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201281 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.853544:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715298304:0@lo:38:llog_process_th.0 00000100:00000040:0.0:1788201271.853550:0:3654:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc11d29d880 x1875060715298304/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201281 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788201271.853558:0:3654:0:(genops.c:1223:class_import_put()) import ffff8dc13f869000 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00100000:2.0:1788201271.853623:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875060715298304:12345-0@lo:38:llog_process_th.0 Request processed in 1081us (2244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201271.853631:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1604 00000100:00000040:2.0:1788201271.853634:0:66757:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc11cdde000 : new rpc_count 0 00000020:00000040:2.0:1788201271.853645:0:66757:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11cdde000 : new refcount 4 20000000:01000000:1.0:1788201271.861469:0:94467:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788201271.861492:0:94467:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788201271.861612:0:94465:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788201271.861617:0:94465:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00000040:3.0:1788201271.861628:0:94465:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff8dc12b661700 count: 4 00000020:00000040:3.0:1788201271.861639:0:94465:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8dc108c75000 with handle 0x96d0c9b8c9a1d526 to hash 00010000:00010000:3.0:1788201271.861646:0:94465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc108c75000/0x96d0c9b8c9a1d526 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201271.861663:0:94465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc0078fc200/0x96d0c9b8c9a1c607 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c600 expref: 24 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201271.861671:0:94465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc00782da00/0x96d0c9b8c9a1c623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c61c expref: 24 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201271.861681:0:94465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc0078fde00/0x96d0c9b8c9a1c6c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786928 expref: 9 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201271.861689:0:94465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dc108c75000/0x96d0c9b8c9a1d526 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788201271.861710:0:94465:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff8dc12b661700) refcount = 4 00010000:00000040:3.0:1788201271.861713:0:94465:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1788201271.861717:0:94465:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc0078fde00/0x96d0c9b8c9a1c6c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786928 expref: 9 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788201271.861723:0:94465:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc00782da00/0x96d0c9b8c9a1c623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c61c expref: 24 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788201271.861729:0:94465:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc0078fc200/0x96d0c9b8c9a1c607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c600 expref: 24 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788201271.861733:0:94465:0:(ldlm_resource.c:1894:ldlm_resource_dump()) Waiting locks: 00010000:00000040:3.0:1788201271.861735:0:94465:0:(ldlm_resource.c:1896:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc108c75000/0x96d0c9b8c9a1d526 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:3.0:1788201271.861757:0:94465:0:(genops.c:1210:class_import_get()) import ffff8dc103487000 refcount=2 obd=MGS 00010000:00010000:3.0:1788201271.861777:0:94465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc0078fde00/0x96d0c9b8c9a1c6c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786928 expref: 9 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201271.861790:0:94465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc0078fde00/0x96d0c9b8c9a1c6c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786928 expref: 9 pid: 94464 timeout: 4223 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1788201271.861804:0:94465:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc11d29ce00 x1875060715298560/t0(0) o104->MGS@192.168.201.20@tcp:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201271.861816:0:94465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715298560:192.168.201.20@tcp:104: 00000100:00000040:3.0:1788201271.861843:0:94465:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff8dc11d29ce00 x1875060715298560/t0(0) o104->MGS@192.168.201.20@tcp:15/16 lens 328/224 e 0 to 0 dl 1788201287 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788201271.861852:0:94465:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000020:00000040:3.0:1788201271.861922:0:94465:0:(genops.c:1210:class_import_get()) import ffff8dc110732000 refcount=2 obd=MGS 00010000:00010000:3.0:1788201271.861938:0:94465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc00782da00/0x96d0c9b8c9a1c623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c61c expref: 24 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201271.861947:0:94465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc00782da00/0x96d0c9b8c9a1c623 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c61c expref: 24 pid: 94467 timeout: 4223 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1788201271.861957:0:94465:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc11d29d180 x1875060715298688/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201271.861965:0:94465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715298688:0@lo:104: 00010000:00000040:1.0:1788201271.861969:0:94467:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715298432 00000100:00000040:3.0:1788201271.861976:0:94465:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff8dc11d29d180 x1875060715298688/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788201287 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788201271.861980:0:94467:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 62 to 0@lo 00000100:00000040:3.0:1788201271.861984:0:94465:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201271.861986:0:94467:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201271.863279:0:94467:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff8dc11cc44000 x1875060715298432/t0(0) o253->MGC192.168.201.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201271.863327:0:94467:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 61 to 0@lo 00000100:00000040:1.0:1788201271.863334:0:94467:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc140d78450 x1875060715298432/t0(0) o253->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 4848/4768 e 0 to 0 dl 1788201282 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.863372:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc11cc44000 x1875060715298432/t0(0) o253->MGC192.168.201.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788201287 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201271.863384:0:97034:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11cc44000 x1875060715298432/t0(0) o253->MGC192.168.201.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788201287 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201271.863392:0:97034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:97034:1875060715298432:0@lo:253:mount.lustre.0 00000100:00000040:2.0:1788201271.863410:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc11cc44000 x1875060715298432/t0(0) o253->MGC192.168.201.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788201287 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788201271.863424:0:97034:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788201271.863427:0:97034:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201271.863429:0:97034:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788201271.863431:0:97034:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201271.863432:0:97034:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201271.863433:0:97034:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201271.863435:0:97034:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201271.863436:0:97034:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201271.863438:0:97034:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201271.863439:0:97034:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00000040:2.0:1788201271.863443:0:97034:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc11cc44000 x1875060715298432/t0(0) o253->MGC192.168.201.120@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1788201287 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1788201271.863453:0:97034:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 00000020:02000000:2.0:1788201271.863464:0:97034:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788201271.863475:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:97034:x1875060715298432:12345-0@lo:253:mount.lustre.0 Request processed in 11779us (12086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201271.863486:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00000040:1.0:1788201271.863489:0:94467:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:1.0:1788201271.863500:0:94467:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 23 00002000:00000040:2.0:1788201271.863589:0:97034:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x3:0x0] 00002000:00000040:2.0:1788201271.863605:0:97034:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xf:0x0] 00002000:00000040:2.0:1788201271.863668:0:97034:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x4:0x0] 00002000:00000040:2.0:1788201271.863702:0:97034:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x1:0x0] 00002000:00000040:2.0:1788201271.863732:0:97034:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x10:0x0] 00002000:00000040:2.0:1788201271.863759:0:97034:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x5:0x0] 00002000:00000040:2.0:1788201271.863778:0:97034:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x2:0x0] 00002000:00000040:2.0:1788201271.863796:0:97034:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x16:0x0] 00002000:00000040:2.0:1788201271.863824:0:97034:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x6:0x0] 00002000:00000040:2.0:1788201271.863861:0:97034:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x3:0x0] 00002000:00000040:1.0:1788201271.864576:0:97034:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x12:0x0] 00010000:00080000:1.0:1788201271.864687:0:97034:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 4294969478 00000100:00000040:0.0:1788201271.864866:0:3649:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc11d29ce00 x1875060715298560/t0(0) o104->MGS@192.168.201.20@tcp:15/16 lens 328/224 e 0 to 0 dl 1788201287 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788201271.864914:0:94465:0:(events.c:337:request_in_callback()) incoming req@ffff8dc11d29c000 x1875060715298688 msgsize 328 00000100:00100000:3.0:1788201271.864921:0:94465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201271.865009:0:94465:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc11d29d180 x1875060715298688/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788201287 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201271.865340:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715298688 00000100:00100000:0.0:1788201271.865358:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715298688 00000020:00000040:0.0:1788201271.865362:0:6516:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c99cf69a 00000020:00000040:0.0:1788201271.865376:0:6516:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc104282800 refcount=3 00000100:00000040:0.0:1788201271.865397:0:6516:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_cbd at +6s 00000100:00100000:0.0:1788201271.865508:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00000040:0.0:1788201271.865513:0:6516:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc104282800 : new rpc_count 1 00000100:00000040:0.0:1788201271.865518:0:6516:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc11d29c000 x1875060715298688/t0(0) o104->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 328/0 e 0 to 0 dl 1788201282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201271.865532:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+3:94465:x1875060715298688:12345-0@lo:104: 00000020:00000040:0.0:1788201271.865543:0:6516:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc125ae3e00 refcount=2 00010000:00010000:0.0:1788201271.865552:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1c61c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c623 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1788201271.865575:0:6516:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 62 to 0@lo 00010000:00080000:1.0:1788201271.865576:0:97051:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-OST0000: started recovery thread pid 97051 00000100:00000040:0.0:1788201271.865579:0:6516:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00010000:02000000:1.0:1788201271.865586:0:97051:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-OST0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1788201271.865589:0:97051:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:1.0:1788201271.865592:0:97051:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00000040:0.0:1788201271.865612:0:6516:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff8dc11d29d180 x1875060715298688/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1788201271.865626:0:6516:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 61 to 0@lo 00000020:01000004:1.0:1788201271.865634:0:97034:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:00000040:1.0:1788201271.865642:0:97034:0:(lustre_log.h:374:llog_ctxt_get()) GETting ctxt ffff8dc12fb11000 : new refcount 2 00010000:00010000:0.0:1788201271.865643:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000040:00000040:1.0:1788201271.865646:0:97034:0:(lustre_log.h:389:llog_ctxt_put()) PUTting ctxt ffff8dc12fb11000 : new refcount 1 00000100:00000040:0.0:1788201271.865648:0:6516:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29c000 x1875060715298688/t0(0) o104->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 328/224 e 0 to 0 dl 1788201282 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201271.865656:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+3:94465:x1875060715298688:12345-0@lo:104: Request processed in 127us (740us total) trans 0 rc 0/0 00010000:00010000:1.0:1788201271.865657:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788201271.865663:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00010000:00010000:1.0:1788201271.865664:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1c61c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c623 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1788201271.865666:0:6516:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc104282800 : new rpc_count 0 00010000:00010000:1.0:1788201271.865671:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3e00 already unused, calling callback (ffffffffc1280c20) 00000020:00000040:0.0:1788201271.865674:0:6516:0:(genops.c:879:class_export_put()) PUTting export ffff8dc104282800 : new refcount 2 10000000:00010000:1.0:1788201271.865675:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1c61c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1c623 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1788201271.865682:0:6521:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc125ae3e00 refcount=3 00010000:00010000:1.0:1788201271.865686:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1c61c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c623 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201271.865693:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1c61c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c623 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201271.865699:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00000040:1.0:1788201271.865702:0:6521:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=1) 10000000:00000040:1.0:1788201271.865704:0:6521:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:1.0:1788201271.865718:0:6521:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff8dc13a9a6200) refs 2 00000020:00000040:1.0:1788201271.865726:0:6521:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff8dc125ae3e00 with handle 0x96d0c9b8c9a1c61c from hash 00000020:00000040:1.0:1788201271.865736:0:6521:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00010000:00010000:1.0:1788201271.865752:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1c61c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c623 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201271.865768:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00000040:1.0:1788201271.865780:0:6521:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000001611ac92] to pc [ptlrpcd_00_03+3] req@ffff8dc12ee2c700 x1875060715298816/t0(0) o103->MGC192.168.201.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788201271.865813:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1c61c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c623 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201271.865821:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1c61c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c623 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201271.865828:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1788201271.865833:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201271.865834:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201271.865836:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1788201271.865841:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc12ee2c700 x1875060715298816/t0(0) o103->MGC192.168.201.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.865853:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715298816:0@lo:103:ldlm_bl.0 00000100:00000040:3.0:1788201271.865873:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc12ee2c700 x1875060715298816/t0(0) o103->MGC192.168.201.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788201287 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.865881:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201271.865899:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff8dc10a225850 x1875060715298816 msgsize 328 00000100:00100000:3.0:1788201271.865903:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201271.865905:0:3657:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788201271.865920:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc12ee2c700 x1875060715298816/t0(0) o103->MGC192.168.201.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788201287 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201271.865944:0:97034:0:(genops.c:879:class_export_put()) PUTting export ffff8dc120727000 : new refcount 1 00000100:00100000:3.0:1788201271.865953:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715298816 00000020:00000040:1.0:1788201271.865958:0:97034:0:(obd_config.c:1023:class_decref()) Decref MGC192.168.201.120@tcp (ffff8dc12563cd28) now 6 - mgc_fs 10000000:01000000:1.0:1788201271.865961:0:97034:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000100:00100000:3.0:1788201271.865963:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715298816 00000020:00000040:3.0:1788201271.865965:0:6519:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:3.0:1788201271.865967:0:6519:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=24 00000100:00000040:3.0:1788201271.865979:0:6519:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:01000004:1.0:1788201271.865980:0:97034:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000020:00000040:3.0:1788201271.865984:0:6519:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc00782da00 refcount=6 00010000:00010000:3.0:1788201271.865989:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc00782da00/0x96d0c9b8c9a1c623 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c61c expref: 24 pid: 94467 timeout: 4223 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00000004:1.0:1788201271.866003:0:97034:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000100:00100000:3.0:1788201271.866011:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2612 00000100:00000040:3.0:1788201271.866038:0:6519:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:3.0:1788201271.866043:0:6519:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc10a225850 x1875060715298816/t0(0) o103->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 328/0 e 0 to 0 dl 1788201282 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.866065:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10a225850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715298816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201271.866076:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:3.0:1788201271.866078:0:6519:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc00782da00 refcount=6 00010000:00000040:3.0:1788201271.866081:0:6519:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff8dc12b661700 count: 5 00010000:00010000:3.0:1788201271.866086:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc00782da00/0x96d0c9b8c9a1c623 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c61c expref: 24 pid: 94467 timeout: 4223 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201271.866095:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc00782da00/0x96d0c9b8c9a1c623 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c61c expref: 24 pid: 94467 timeout: 4223 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:3.0:1788201271.866107:0:6519:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff8dc00782da00 with handle 0x96d0c9b8c9a1c623 from hash 00010000:00000040:3.0:1788201271.866111:0:6519:0:(ldlm_lock.c:1986:ldlm_reprocess_queue()) Reprocessing lock ffff8dc108c75000 00010000:00010000:3.0:1788201271.866116:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:3.0:1788201271.866121:0:6519:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 62 to 0@lo 00000100:00000040:3.0:1788201271.866125:0:6519:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201271.866142:0:6519:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc12ee2c700 x1875060715298816/t0(0) o103->MGC192.168.201.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.866158:0:6519:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 61 to 0@lo 00000100:00000040:3.0:1788201271.866169:0:6519:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc10a225850 x1875060715298816/t0(0) o103->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 328/224 e 0 to 0 dl 1788201282 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.866175:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10a225850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715298816:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201271.866181:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2612 00000100:00000040:3.0:1788201271.866183:0:6519:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:3.0:1788201271.866189:0:6519:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 23 00000100:00000040:3.0:1788201271.866254:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc12ee2c700 x1875060715298816/t0(0) o103->MGC192.168.201.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.866263:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12ee2c700 x1875060715298816/t0(0) o103->MGC192.168.201.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788201287 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.866270:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715298816:0@lo:103:ldlm_bl.0 00000100:00000040:3.0:1788201271.866275:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc12ee2c700 x1875060715298816/t0(0) o103->MGC192.168.201.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788201287 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201271.866295:0:3657:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 00000100:00000040:2.0:1788201271.866615:0:3648:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff8dc11d29ce00 x1875060715298560/t0(0) o104->MGS@192.168.201.20@tcp:15/16 lens 328/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:2.0:1788201271.866648:0:94465:0:(genops.c:1210:class_import_get()) import ffff8dc110732000 refcount=3 obd=MGS 00010000:00010000:2.0:1788201271.866659:0:94465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc0078fc200/0x96d0c9b8c9a1c607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1c600 expref: 23 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201271.866671:0:94465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc0078fc200/0x96d0c9b8c9a1c607 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c600 expref: 23 pid: 94467 timeout: 4223 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1788201271.866682:0:94465:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc11cc44000 x1875060715298944/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201271.866690:0:94465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc44000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715298944:0@lo:104: 00000100:00000040:2.0:1788201271.866703:0:94465:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff8dc11cc44000 x1875060715298944/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788201287 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201271.866709:0:94465:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201271.866723:0:94465:0:(events.c:337:request_in_callback()) incoming req@ffff8dc11cc46300 x1875060715298944 msgsize 328 00000100:00100000:2.0:1788201271.866727:0:94465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201271.866755:0:94465:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc11cc44000 x1875060715298944/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788201287 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201271.866768:0:94465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040240 going to sleep for 11 seconds 00000100:00000040:2.0:1788201271.866780:0:94465:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc11d29ce00 x1875060715298560/t0(0) o104->MGS@192.168.201.20@tcp:15/16 lens 328/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201271.866800:0:94465:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29ce00 x1875060715298560/t0(0) o104->MGS@192.168.201.20@tcp:15/16 lens 328/224 e 0 to 0 dl 1788201287 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201271.866808:0:94465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715298560:192.168.201.20@tcp:104: 00000100:00000040:2.0:1788201271.866821:0:94465:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc11d29d180 x1875060715298688/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1788201271.866830:0:94465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782da00/0x96d0c9b8c9a1c623 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c61c expref: 23 pid: 94467 timeout: 4223 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788201271.866837:0:94465:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff8dc110735800 : new locks_count 17 00000020:00000040:2.0:1788201271.866839:0:94465:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 22 00000100:00000040:2.0:1788201271.866845:0:94465:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29d180 x1875060715298688/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788201287 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201271.866852:0:94465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715298688:0@lo:104: 00000020:00000004:2.0:1788201271.868100:0:97034:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788201271.868325:0:97034:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788201271.868850:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715298944 00000100:00100000:3.0:1788201271.868859:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715298944 00000020:00000040:3.0:1788201271.868861:0:6515:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c99cf69a 00000020:00000040:3.0:1788201271.868865:0:6515:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc104282800 refcount=3 00000100:00000040:3.0:1788201271.868885:0:6515:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_cbd at +6s 00000100:00100000:3.0:1788201271.868993:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00000040:3.0:1788201271.868998:0:6515:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc104282800 : new rpc_count 1 00000100:00000040:3.0:1788201271.869004:0:6515:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc11cc46300 x1875060715298944/t0(0) o104->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 328/0 e 0 to 0 dl 1788201282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201271.869036:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9b18af6-fecc-4172-82c2-66531890fe11+3:94465:x1875060715298944:12345-0@lo:104: 00000020:00000040:3.0:1788201271.869044:0:6515:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc00782ca00 refcount=2 00010000:00010000:3.0:1788201271.869058:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc00782ca00/0x96d0c9b8c9a1c600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c607 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1788201271.869077:0:6515:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 62 to 0@lo 00000100:00000040:3.0:1788201271.869082:0:6515:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201271.869116:0:6515:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff8dc11cc44000 x1875060715298944/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788201271.869139:0:6515:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 61 to 0@lo 00010000:00010000:3.0:1788201271.869149:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00000040:3.0:1788201271.869153:0:6515:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11cc46300 x1875060715298944/t0(0) o104->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 328/224 e 0 to 0 dl 1788201282 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201271.869161:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9b18af6-fecc-4172-82c2-66531890fe11+3:94465:x1875060715298944:12345-0@lo:104: Request processed in 147us (2436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201271.869167:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00000040:3.0:1788201271.869170:0:6515:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc104282800 : new rpc_count 0 00000020:00000040:3.0:1788201271.869179:0:6515:0:(genops.c:879:class_export_put()) PUTting export ffff8dc104282800 : new refcount 2 00010000:00010000:3.0:1788201271.869198:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201271.869203:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc00782ca00/0x96d0c9b8c9a1c600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1c607 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201271.869211:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782ca00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:3.0:1788201271.869215:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782ca00/0x96d0c9b8c9a1c600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1c607 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:3.0:1788201271.869221:0:24979:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc00782ca00 refcount=3 00010000:00010000:3.0:1788201271.869225:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc00782ca00/0x96d0c9b8c9a1c600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1c607 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201271.869231:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782ca00/0x96d0c9b8c9a1c600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1c607 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201271.869246:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00000040:3.0:1788201271.869249:0:24979:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=1) 10000000:00000040:3.0:1788201271.869251:0:24979:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:3.0:1788201271.869258:0:24979:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff8dc007377800) refs 2 00000020:00000040:3.0:1788201271.869264:0:24979:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff8dc00782ca00 with handle 0x96d0c9b8c9a1c600 from hash 00000020:00000040:3.0:1788201271.869273:0:24979:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00010000:00010000:3.0:1788201271.869298:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc00782ca00/0x96d0c9b8c9a1c600 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c607 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201271.869305:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00000040:3.0:1788201271.869314:0:24979:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ea163604] to pc [ptlrpcd_00_00+0] req@ffff8dc11d29d880 x1875060715299072/t0(0) o103->MGC192.168.201.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788201271.869333:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc00782ca00/0x96d0c9b8c9a1c600 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c607 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201271.869339:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc00782ca00/0x96d0c9b8c9a1c600 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1c607 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788201271.869346:0:24979:0:(ldlm_resource.c:1704:ldlm_resource_putref()) putref res: ffff8dc10bed3800 count: 0 00010000:00010000:3.0:1788201271.869358:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201271.869360:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201271.869361:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1788201271.869374:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc11d29d880 x1875060715299072/t0(0) o103->MGC192.168.201.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.869387:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11d29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715299072:0@lo:103:ldlm_bl.0 00000100:00000040:3.0:1788201271.869459:0:3655:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc11d29d880 x1875060715299072/t0(0) o103->MGC192.168.201.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788201287 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.869467:0:3655:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201271.869494:0:3655:0:(events.c:337:request_in_callback()) incoming req@ffff8dc125643b80 x1875060715299072 msgsize 328 00000100:00100000:3.0:1788201271.869499:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201271.869516:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc11d29d880 x1875060715299072/t0(0) o103->MGC192.168.201.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788201287 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.869559:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715299072 00000100:00100000:3.0:1788201271.869563:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715299072 00000020:00000040:3.0:1788201271.869565:0:26207:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:3.0:1788201271.869568:0:26207:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=23 00000100:00000040:3.0:1788201271.869579:0:26207:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:00000040:3.0:1788201271.869584:0:26207:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc0078fc200 refcount=5 00010000:00010000:3.0:1788201271.869589:0:26207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc0078fc200/0x96d0c9b8c9a1c607 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c600 expref: 23 pid: 94467 timeout: 4223 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201271.869612:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2613 00000100:00000040:3.0:1788201271.869615:0:26207:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:3.0:1788201271.869619:0:26207:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc125643b80 x1875060715299072/t0(0) o103->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 328/0 e 0 to 0 dl 1788201282 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.869630:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125643b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+23:3655:x1875060715299072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201271.869641:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:3.0:1788201271.869643:0:26207:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc0078fc200 refcount=5 00010000:00000040:3.0:1788201271.869646:0:26207:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff8dc12b661700 count: 4 00010000:00010000:3.0:1788201271.869650:0:26207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc0078fc200/0x96d0c9b8c9a1c607 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c600 expref: 23 pid: 94467 timeout: 4223 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201271.869660:0:26207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc0078fc200/0x96d0c9b8c9a1c607 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c600 expref: 23 pid: 94467 timeout: 4223 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:3.0:1788201271.869671:0:26207:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff8dc0078fc200 with handle 0x96d0c9b8c9a1c607 from hash 00010000:00000040:3.0:1788201271.869676:0:26207:0:(ldlm_lock.c:1986:ldlm_reprocess_queue()) Reprocessing lock ffff8dc108c75000 00010000:00010000:3.0:1788201271.869681:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:3.0:1788201271.869690:0:26207:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 62 to 0@lo 00000100:00000040:3.0:1788201271.869694:0:26207:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201271.869709:0:26207:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc11d29d880 x1875060715299072/t0(0) o103->MGC192.168.201.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.869726:0:26207:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 61 to 0@lo 00000100:00000040:3.0:1788201271.869731:0:26207:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc125643b80 x1875060715299072/t0(0) o103->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:392/0 lens 328/224 e 0 to 0 dl 1788201282 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.869739:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125643b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+23:3655:x1875060715299072:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201271.869746:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2613 00000100:00000040:3.0:1788201271.869749:0:26207:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:3.0:1788201271.869756:0:26207:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 22 00000100:00000040:3.0:1788201271.869785:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc11d29d880 x1875060715299072/t0(0) o103->MGC192.168.201.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201271.869795:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29d880 x1875060715299072/t0(0) o103->MGC192.168.201.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788201287 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201271.869804:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11d29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715299072:0@lo:103:ldlm_bl.0 00000100:00000040:3.0:1788201271.869810:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc11d29d880 x1875060715299072/t0(0) o103->MGC192.168.201.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788201287 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201271.869820:0:3655:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 00000100:00000040:3.0:1788201271.869849:0:94465:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc11cc44000 x1875060715298944/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788201287 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1788201271.869859:0:94465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fc200/0x96d0c9b8c9a1c607 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1c600 expref: 22 pid: 94467 timeout: 4223 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1788201271.869867:0:94465:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff8dc110735800 : new locks_count 16 00000020:00000040:3.0:1788201271.869868:0:94465:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 21 00000100:00000040:3.0:1788201271.869880:0:94465:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11cc44000 x1875060715298944/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788201287 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201271.869886:0:94465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc44000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715298944:0@lo:104: 00000100:00000040:3.0:1788201271.869897:0:94465:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc11d29ce00 x1875060715298560/t0(0) o104->MGS@192.168.201.20@tcp:15/16 lens 328/224 e 0 to 0 dl 1788201287 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:3.0:1788201271.869905:0:94465:0:(genops.c:1223:class_import_put()) import ffff8dc103487000 refcount=1 obd=MGS 00000100:00000040:3.0:1788201271.869911:0:94465:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc11d29d180 x1875060715298688/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788201287 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:3.0:1788201271.869917:0:94465:0:(genops.c:1223:class_import_put()) import ffff8dc110732000 refcount=2 obd=MGS 00000100:00000040:3.0:1788201271.869922:0:94465:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc11cc44000 x1875060715298944/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1788201287 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:3.0:1788201271.869929:0:94465:0:(genops.c:1223:class_import_put()) import ffff8dc110732000 refcount=1 obd=MGS 00010000:00010000:3.0:1788201271.869939:0:94465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dc108c75000/0x96d0c9b8c9a1d526 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1788201271.871345:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff8dc11cc44000 x1875060695488384 msgsize 328 00000100:00100000:2.0:1788201271.871356:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201271.871432:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695488384 00000100:00100000:0.0:1788201271.871439:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695488384 00000020:00000040:0.0:1788201271.871441:0:6517:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4cc 00000020:00000040:0.0:1788201271.871445:0:6517:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc13aa9c000 refcount=10 00000100:00000040:0.0:1788201271.871464:0:6517:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:00000040:0.0:1788201271.871477:0:6517:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc0078fde00 refcount=4 00010000:00010000:0.0:1788201271.871483:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc0078fde00/0x96d0c9b8c9a1c6c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786928 expref: 10 pid: 94464 timeout: 4223 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201271.871522:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2614 00000100:00000040:0.0:1788201271.871526:0:6517:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc13aa9c000 : new rpc_count 1 00000100:00000040:0.0:1788201271.871532:0:6517:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc11cc44000 x1875060695488384/t0(0) o103->93ba7067-43b5-4e46-8db7-27c040fa03d9@192.168.201.20@tcp:392/0 lens 328/0 e 0 to 0 dl 1788201282 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.871544:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695488384:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201271.871559:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:0.0:1788201271.871561:0:6517:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc0078fde00 refcount=4 00010000:00000040:0.0:1788201271.871565:0:6517:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff8dc12b661700 count: 3 00010000:00010000:0.0:1788201271.871569:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc0078fde00/0x96d0c9b8c9a1c6c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786928 expref: 10 pid: 94464 timeout: 4223 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201271.871580:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc0078fde00/0x96d0c9b8c9a1c6c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786928 expref: 10 pid: 94464 timeout: 4223 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1788201271.871594:0:6517:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff8dc0078fde00 with handle 0x96d0c9b8c9a1c6c4 from hash 00010000:00010000:0.0:1788201271.871599:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fde00/0x96d0c9b8c9a1c6c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786928 expref: 10 pid: 94464 timeout: 4223 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788201271.871606:0:6517:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff8dc13aa9c000 : new locks_count 3 00000020:00000040:0.0:1788201271.871609:0:6517:0:(genops.c:879:class_export_put()) PUTting export ffff8dc13aa9c000 : new refcount 9 00010000:00000040:0.0:1788201271.871614:0:6517:0:(ldlm_lock.c:1986:ldlm_reprocess_queue()) Reprocessing lock ffff8dc108c75000 00010000:00010000:0.0:1788201271.871619:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dc108c75000/0x96d0c9b8c9a1d526 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1788201271.871627:0:6517:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff8dc12b661700) refcount = 2 00010000:00010000:0.0:1788201271.871636:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc108c75000/0x96d0c9b8c9a1d526 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788201271.871652:0:6517:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.036317302s 00000020:00000040:0.0:1788201271.871655:0:6517:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc108c75000 refcount=5 00010000:00010000:0.0:1788201271.871659:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc108c75000/0x96d0c9b8c9a1d526 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201271.871666:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc108c75000/0x96d0c9b8c9a1d526 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201271.871673:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc108c75000/0x96d0c9b8c9a1d526 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201271.871680:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc108c75000/0x96d0c9b8c9a1d526 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201271.871686:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201271.871691:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc108c75000/0x96d0c9b8c9a1d526 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1788201271.871697:0:6517:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc108c75000 refcount=6 00010000:00010000:0.0:1788201271.871701:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc108c75000/0x96d0c9b8c9a1d526 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:0.0:1788201271.871713:0:6517:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff8dc108c75000 with handle 0x96d0c9b8c9a1d526 from hash 00010000:00010000:0.0:1788201271.871718:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc108c75000/0x96d0c9b8c9a1d526 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201271.871727:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:0.0:1788201271.871736:0:6517:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 9 to 192.168.201.20@tcp 00000100:00000040:0.0:1788201271.871741:0:6517:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:0.0:1788201271.871782:0:6517:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 8 to 192.168.201.20@tcp 00000100:00000040:0.0:1788201271.871787:0:6517:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11cc44000 x1875060695488384/t0(0) o103->93ba7067-43b5-4e46-8db7-27c040fa03d9@192.168.201.20@tcp:392/0 lens 328/224 e 0 to 0 dl 1788201282 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201271.871798:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:2401:x1875060695488384:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 254us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201271.871804:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2614 00000100:00000040:0.0:1788201271.871807:0:6517:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc13aa9c000 : new rpc_count 0 00000020:00000040:0.0:1788201271.871816:0:6517:0:(genops.c:879:class_export_put()) PUTting export ffff8dc13aa9c000 : new refcount 8 00010000:00010000:2.0:1788201271.873606:0:94465:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dc108c75000/0x96d0c9b8c9a1d526 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201271.873620:0:94465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc108c75000/0x96d0c9b8c9a1d526 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201271.873627:0:94465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc108c75000/0x96d0c9b8c9a1d526 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788201271.873634:0:94465:0:(ldlm_resource.c:1704:ldlm_resource_putref()) putref res: ffff8dc12b661700 count: 0 00010000:00010000:1.0:1788201272.083305:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:0.0:1788201272.655319:0:94473:0:(genops.c:1210:class_import_get()) import ffff8dc104281000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1788201272.655378:0:94473:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006789f30e] to pc [ptlrpcd_00_01+1] req@ffff8dc120093100 x1875060715299200/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201272.657212:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc120093100 x1875060715299200/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201272.657235:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715299200:0@lo:41:osp-pre-1-0.0 00000100:00000040:3.0:1788201272.657288:0:3656:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc120093100 x1875060715299200/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201288 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201272.657299:0:3656:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201272.657356:0:3656:0:(events.c:337:request_in_callback()) incoming req@ffff8dc125640380 x1875060715299200 msgsize 224 00000100:00100000:3.0:1788201272.657361:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201272.657406:0:3656:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc120093100 x1875060715299200/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201288 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201272.657423:0:3656:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 3878 usecs (4 jiffies) 00000100:00100000:0.0:1788201272.657620:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715299200 00000100:00100000:0.0:1788201272.657634:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715299200 00000020:00000040:0.0:1788201272.657638:0:8458:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c582 00000020:00000040:0.0:1788201272.657644:0:8458:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc11d63c000 refcount=5 00000100:00000040:0.0:1788201272.657677:0:8458:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:0.0:1788201272.665731:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4118 00000100:00000040:0.0:1788201272.665743:0:8458:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc11d63c000 : new rpc_count 1 00000100:00000040:0.0:1788201272.665769:0:8458:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc125640380 x1875060715299200/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:393/0 lens 224/0 e 0 to 0 dl 1788201283 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201272.665797:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125640380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715299200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201272.665859:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00010000:00000040:0.0:1788201272.665874:0:8458:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715299200 00000100:00000040:0.0:1788201272.665890:0:8458:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 62 to 0@lo 00000100:00000040:0.0:1788201272.665909:0:8458:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201272.665977:0:8458:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8dc120093100 x1875060715299200/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201288 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201272.666041:0:8458:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 61 to 0@lo 00000100:00000040:0.0:1788201272.666058:0:8458:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc125640380 x1875060715299200/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:393/0 lens 224/368 e 0 to 0 dl 1788201283 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201272.666068:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125640380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715299200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 284us (8710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201272.666077:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4118 00000100:00000040:0.0:1788201272.666081:0:8458:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc11d63c000 : new rpc_count 0 00000020:00000040:0.0:1788201272.666096:0:8458:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11d63c000 : new refcount 4 00000100:00000040:3.0:1788201272.666496:0:3656:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:3.0:1788201272.666506:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc120093100 x1875060715299200/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1788201272.666530:0:3656:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352879 avail=317176 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023680 state=0: rc = 0 00000100:00000040:3.0:1788201272.666541:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc120093100 x1875060715299200/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201288 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201272.666549:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715299200:0@lo:41:osp-pre-1-0.0 00000100:00000040:3.0:1788201272.666559:0:3656:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc120093100 x1875060715299200/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201288 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201272.666572:0:3656:0:(genops.c:1223:class_import_put()) import ffff8dc104281000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000020:00000004:0.0:1788201272.989619:0:97100:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788201272.989841:0:97100:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:00000040:3.0:1788201273.039963:0:6529:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff8dc007377800) refs 2 10000000:01000000:3.0:1788201273.039975:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788201273.039978:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc11d438000 from 128 10000000:01000000:3.0:1788201273.039982:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:3.0:1788201273.039992:0:6529:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:3.0:1788201273.040041:0:6529:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8dc108c74000 with handle 0x96d0c9b8c9a1d52d to hash 00010000:00010000:3.0:1788201273.040051:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1d52d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201273.040061:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1d52d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201273.040072:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1d52d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1788201273.040097:0:6529:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc125641f80 x1875060715299328/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201273.040110:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125641f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715299328:0@lo:101:ll_cfg_requeue.0 00000100:00000040:3.0:1788201273.040137:0:6529:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc125641f80 x1875060715299328/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201289 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201273.040154:0:6529:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201273.040200:0:6529:0:(events.c:337:request_in_callback()) incoming req@ffff8dc140d78c50 x1875060715299328 msgsize 328 00000100:00100000:3.0:1788201273.040205:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201273.040207:0:6529:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788201273.040226:0:6529:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8dc125641f80 x1875060715299328/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201289 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201273.040254:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201273.040335:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715299328 00000100:00100000:1.0:1788201273.040343:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715299328 00000020:00000040:1.0:1788201273.040346:0:94461:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:1.0:1788201273.040350:0:94461:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=22 00000100:00000040:1.0:1788201273.040376:0:94461:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788201273.040411:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00000040:1.0:1788201273.040416:0:94461:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:1.0:1788201273.040421:0:94461:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc140d78c50 x1875060715299328/t0(0) o101->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.040432:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715299328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201273.040455:0:94461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:00000040:1.0:1788201273.040504:0:94461:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8dc1064ed600 with handle 0x96d0c9b8c9a1d534 to hash 00010000:00010000:1.0:1788201273.040508:0:94461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1d534 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1d52d expref: -99 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788201273.040516:0:94461:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff8dc110735800 : new locks_count 17 00000020:00000040:1.0:1788201273.040518:0:94461:0:(genops.c:868:class_export_get()) GET export ffff8dc110735800 refcount=23 00010000:00000040:1.0:1788201273.040533:0:94461:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff8dc103b47100) refcount = 1 00010000:00010000:1.0:1788201273.040538:0:94461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1d534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d52d expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201273.040548:0:94461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1d534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d52d expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201273.040556:0:94461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ed600, rc 0) 00010000:00000040:1.0:1788201273.040560:0:94461:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715299328 00000100:00000040:1.0:1788201273.040571:0:94461:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 62 to 0@lo 00000100:00000040:1.0:1788201273.040576:0:94461:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201273.040673:0:94461:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff8dc125641f80 x1875060715299328/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201289 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201273.040693:0:94461:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 61 to 0@lo 00000100:00000040:1.0:1788201273.040698:0:94461:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc140d78c50 x1875060715299328/t0(0) o101->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:394/0 lens 328/344 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.040706:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715299328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 275us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201273.040713:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00000040:1.0:1788201273.040716:0:94461:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:1.0:1788201273.040727:0:94461:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 22 00000100:00000040:3.0:1788201273.040946:0:6529:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc125641f80 x1875060715299328/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201289 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201273.040956:0:6529:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc125641f80 x1875060715299328/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201289 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201273.040963:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125641f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715299328:0@lo:101:ll_cfg_requeue.0 00000100:00000040:3.0:1788201273.040971:0:6529:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc125641f80 x1875060715299328/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201289 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201273.040982:0:6529:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc108c74000 refcount=4 00010000:00000040:3.0:1788201273.040987:0:6529:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff8dc108c74000, remote cookie: 0x96d0c9b8c9a1d534, flags: 0x0 00010000:00000040:3.0:1788201273.040992:0:6529:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff8dc007d9c100) refcount = 1 00010000:00010000:3.0:1788201273.040996:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1d52d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d534 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201273.041005:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1d52d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d534 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1788201273.041032:0:6529:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc125641f80 x1875060715299328/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201289 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201273.041042:0:6529:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 10000000:00000040:3.0:1788201273.041050:0:6529:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff8dc007377800) refs 3 00000020:00000040:3.0:1788201273.041059:0:6529:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc108c74000 refcount=3 00000020:00000040:3.0:1788201273.041074:0:6529:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:3.0:1788201273.041087:0:6529:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=5 obd=MGC192.168.201.120@tcp 00000100:00000040:3.0:1788201273.041098:0:6529:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc125641f80 x1875060715299456/t0(0) o256->MGC192.168.201.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201273.041107:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125641f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715299456:0@lo:256:ll_cfg_requeue.0 00000100:00000040:3.0:1788201273.041128:0:6529:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc125641f80 x1875060715299456/t0(0) o256->MGC192.168.201.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788201289 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201273.041135:0:6529:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201273.041153:0:6529:0:(events.c:337:request_in_callback()) incoming req@ffff8dc140d7b450 x1875060715299456 msgsize 304 00000100:00100000:3.0:1788201273.041157:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201273.041158:0:6529:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788201273.041174:0:6529:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8dc125641f80 x1875060715299456/t0(0) o256->MGC192.168.201.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788201289 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201273.041190:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201273.043001:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715299456 00000100:00100000:1.0:1788201273.043033:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715299456 00000020:00000040:1.0:1788201273.043037:0:94463:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:1.0:1788201273.043042:0:94463:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=23 00000100:00000040:1.0:1788201273.043067:0:94463:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788201273.043093:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00000040:1.0:1788201273.043099:0:94463:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:1.0:1788201273.043105:0:94463:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc140d7b450 x1875060715299456/t0(0) o256->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:394/0 lens 304/0 e 0 to 0 dl 1788201284 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.043118:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715299456:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788201273.043143:0:94463:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:1.0:1788201273.043157:0:94463:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:1.0:1788201273.043163:0:94463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788201273.043166:0:94463:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 128 00000020:00000040:1.0:1788201273.043171:0:94463:0:(genops.c:868:class_export_get()) GET export ffff8dc110735800 refcount=24 00000020:00000040:1.0:1788201273.043242:0:94463:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 23 00010000:00000040:1.0:1788201273.043255:0:94463:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715299456 00000100:00000040:1.0:1788201273.043280:0:94463:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 62 to 0@lo 00000100:00000040:1.0:1788201273.043285:0:94463:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201273.043303:0:94463:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff8dc125641f80 x1875060715299456/t0(0) o256->MGC192.168.201.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788201289 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201273.043318:0:94463:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 61 to 0@lo 00000100:00000040:1.0:1788201273.043323:0:94463:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc140d7b450 x1875060715299456/t0(0) o256->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:394/0 lens 304/240 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.043331:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715299456:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 215us (2176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201273.043338:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00000040:1.0:1788201273.043341:0:94463:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:1.0:1788201273.043352:0:94463:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 22 00000100:00000040:1.0:1788201273.043402:0:6529:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff8dc125641f80 x1875060715299456/t0(0) o256->MGC192.168.201.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788201289 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201273.043411:0:6529:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff8dc125641f80 x1875060715299456/t0(0) o256->MGC192.168.201.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788201289 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201273.043419:0:6529:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc125641f80 x1875060715299456/t0(0) o256->MGC192.168.201.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788201289 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.043425:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125641f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715299456:0@lo:256:ll_cfg_requeue.0 00000100:00000040:1.0:1788201273.043433:0:6529:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc125641f80 x1875060715299456/t0(0) o256->MGC192.168.201.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788201289 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:1.0:1788201273.043442:0:6529:0:(mgc_request.c:1600:mgc_process_recover_log()) Latest version 128, more 0. 10000000:00000040:1.0:1788201273.043452:0:6529:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1788201273.043466:0:6529:0:(lustre_peer.c:232:class_check_uuid()) check if uuid 192.168.201.120@tcp has 192.168.201.120@tcp. 10000000:00000040:1.0:1788201273.043480:0:6529:0:(mgc_request.c:1470:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0000 target is obsoleted(1/2), reconnect 00000100:00080000:1.0:1788201273.043484:0:6529:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8dc109815000 already not connected (conn 6, was 0): DISCONN 00000100:00000040:1.0:1788201273.043493:0:6529:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 62 to 0@lo 00000100:00000040:1.0:1788201273.043496:0:6529:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8dc125a970c0 refcount 62 to 0@lo 00000100:00000040:1.0:1788201273.043498:0:6529:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.201.120@tcp -> ffff8dc125a970c0 00010000:00080000:1.0:1788201273.043501:0:6529:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8dc109815000@lustre-OST0000-osc-MDT0000: found existing conn 192.168.201.120@tcp, moved to head 00010000:00000040:1.0:1788201273.043505:0:6529:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 61 to 0@lo 00000100:00080000:1.0:1788201273.043509:0:6529:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:1.0:1788201273.043514:0:6529:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 60 to 0@lo 00000100:00000040:1.0:1788201273.043516:0:6529:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 61 to 0@lo 00000020:00000040:1.0:1788201273.043518:0:6529:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c597 00000020:00000040:1.0:1788201273.043521:0:6529:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc005d70800 refcount=4 00000100:00000040:1.0:1788201273.043523:0:6529:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 60 to 0@lo 00000100:00000040:1.0:1788201273.043526:0:6529:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 61 to 0@lo 00000020:00000040:1.0:1788201273.043527:0:6529:0:(genops.c:879:class_export_put()) PUTting export ffff8dc005d70800 : new refcount 3 00000100:00080000:1.0:1788201273.043535:0:6529:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dc109815000 using connection 192.168.201.120@tcp/0@lo 00000020:00000040:1.0:1788201273.043547:0:6529:0:(genops.c:1210:class_import_get()) import ffff8dc109815000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:1.0:1788201273.043562:0:6529:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12ee2df80 x1875060715299584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788201273.043575:0:6529:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000001791c1cf] to pc [ptlrpcd_rcv+-1] req@ffff8dc12ee2df80 x1875060715299584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:1.0:1788201273.044573:0:6529:0:(mgc_request.c:1487:mgc_apply_recover_logs()) ir apply logs 128/128 for lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1788201273.044588:0:6529:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc125641f80 x1875060715299456/t0(0) o256->MGC192.168.201.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788201289 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201273.044711:0:6529:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:1.0:1788201273.044715:0:6529:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 10000000:01000000:1.0:1788201273.044742:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:1.0:1788201273.044749:0:6529:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc108c74000 refcount=3 00010000:00010000:1.0:1788201273.044756:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1d52d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d534 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201273.044766:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1d52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d534 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:1.0:1788201273.044776:0:6529:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff8dc13a9a6200) refs 2 10000000:00000040:1.0:1788201273.044779:0:6529:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff8dc007377800) refs 3 10000000:01000000:1.0:1788201273.044782:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788201273.044785:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc0053a4000 from 128 10000000:01000000:1.0:1788201273.044788:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:1.0:1788201273.044794:0:6529:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00010000:00000040:1.0:1788201273.044810:0:6529:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff8dc007d9c100 count: 2 00000020:00000040:1.0:1788201273.044817:0:6529:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8dc1064ede00 with handle 0x96d0c9b8c9a1d53b to hash 00010000:00010000:1.0:1788201273.044824:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1d53b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201273.044913:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1d53b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201273.044924:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1d53b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1788201273.044940:0:6529:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc12ee2ea00 x1875060715299712/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.044952:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715299712:0@lo:101:ll_cfg_requeue.0 00000100:00000040:1.0:1788201273.044973:0:6529:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc12ee2ea00 x1875060715299712/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201289 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201273.044980:0:6529:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201273.045009:0:6529:0:(events.c:337:request_in_callback()) incoming req@ffff8dc004c3d850 x1875060715299712 msgsize 328 00000100:00100000:1.0:1788201273.045029:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788201273.045031:0:6529:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1788201273.045054:0:6529:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8dc12ee2ea00 x1875060715299712/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201289 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.045080:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccbf00 going to sleep for 11 seconds 00000100:00000040:0.0:1788201273.045305:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc12ee2df80 x1875060715299584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201273.045315:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715299584:0@lo:8:ll_cfg_requeue.0 00000100:00000040:0.0:1788201273.045332:0:3654:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc12ee2df80 x1875060715299584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788201298 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201273.045339:0:3654:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201273.045357:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8dc120090a80 x1875060715299584 msgsize 520 00000100:00100000:0.0:1788201273.045361:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788201273.045376:0:3654:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc12ee2df80 x1875060715299584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788201298 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201273.045387:0:3654:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 7238 usecs (8 jiffies) 00000100:00100000:2.0:1788201273.049438:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715299712 00000100:00100000:2.0:1788201273.049458:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715299712 00000020:00000040:2.0:1788201273.049461:0:94461:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:2.0:1788201273.049468:0:94461:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=23 00000100:00000040:2.0:1788201273.049501:0:94461:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1788201273.049538:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00000040:2.0:1788201273.049543:0:94461:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:2.0:1788201273.049551:0:94461:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc004c3d850 x1875060715299712/t0(0) o101->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201273.049565:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715299712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201273.049580:0:94461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:2.0:1788201273.049591:0:94461:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff8dc103b47100 count: 2 00000020:00000040:2.0:1788201273.049599:0:94461:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8dc006dbd200 with handle 0x96d0c9b8c9a1d542 to hash 00010000:00010000:2.0:1788201273.049604:0:94461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006dbd200/0x96d0c9b8c9a1d542 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1d53b expref: -99 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1788201273.049613:0:94461:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff8dc110735800 : new locks_count 18 00000020:00000040:2.0:1788201273.049615:0:94461:0:(genops.c:868:class_export_get()) GET export ffff8dc110735800 refcount=24 00010000:00000040:2.0:1788201273.049636:0:94461:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff8dc103b47100) refcount = 2 00010000:00000040:2.0:1788201273.049639:0:94461:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1788201273.049643:0:94461:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1d534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d52d expref: 24 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201273.049651:0:94461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006dbd200/0x96d0c9b8c9a1d542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d53b expref: 24 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201273.049660:0:94461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006dbd200/0x96d0c9b8c9a1d542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d53b expref: 24 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201273.049670:0:94461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbd200, rc 0) 00010000:00000040:2.0:1788201273.049687:0:94461:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715299712 00000100:00000040:2.0:1788201273.049698:0:94461:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 62 to 0@lo 00000100:00000040:2.0:1788201273.049704:0:94461:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201273.049751:0:94461:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff8dc12ee2ea00 x1875060715299712/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201289 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201273.049782:0:94461:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 61 to 0@lo 00000100:00000040:2.0:1788201273.049787:0:94461:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc004c3d850 x1875060715299712/t0(0) o101->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:394/0 lens 328/344 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201273.049796:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715299712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 232us (4785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201273.049802:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00000040:2.0:1788201273.049806:0:94461:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:2.0:1788201273.049817:0:94461:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 23 00000100:00100000:1.0:1788201273.051981:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715299584 00000100:00100000:1.0:1788201273.051995:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715299584 00000020:00000040:1.0:1788201273.053699:0:8446:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c5ac 00000100:00100000:1.0:1788201273.053757:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5989 00000100:00000040:1.0:1788201273.053768:0:8446:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc120090a80 x1875060715299584/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788201293 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.053781:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3654:x1875060715299584:12345-0@lo:8:ll_cfg_requeue.0 00000020:00000040:1.0:1788201273.053801:0:8446:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8dc004fd4d28) now 7 - find 00010000:00000040:1.0:1788201273.053814:0:8446:0:(ldlm_lib.c:1263:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:1.0:1788201273.053909:0:8446:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff8dc002a56800, cookie 0x96d0c9b8c9a1d4d2 00010000:00080000:1.0:1788201273.053916:0:8446:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff8dc002a56800 cur 4124 last 1788201271 00010000:02000400:1.0:1788201273.053924:0:8446:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00010000:00080000:1.0:1788201273.053930:0:8446:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00000001:00000040:1.0:1788201273.053944:0:8446:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.201.120@tcp 00000001:00000040:1.0:1788201273.053948:0:8446:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8dc1330c8800) : new refcount 19 00000020:00000040:1.0:1788201273.053952:0:8446:0:(genops.c:868:class_export_get()) GET export ffff8dc002a56800 refcount=4 00000001:00000040:1.0:1788201273.053954:0:8446:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8dc1330c8800) : new refcount 20 00000001:00000040:1.0:1788201273.053958:0:8446:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff8dc1330c8800) : new refcount 19 00002000:00100000:1.0:1788201273.053961:0:8446:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8dc002a56800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788201273.053965:0:8446:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788201273.053967:0:8446:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:1.0:1788201273.053976:0:8446:0:(lprocfs_status_server.c:748:lprocfs_exp_setup()) Found stats ffff8dc00532fd80 for nid 0@lo - ref 2 00000020:00000040:1.0:1788201273.054147:0:8446:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8dc004fd4d28) now 8 - import 00000020:00000040:1.0:1788201273.054154:0:8446:0:(genops.c:1223:class_import_put()) import ffff8dc005a4a000 refcount=1 obd=lustre-OST0000 00000020:00000040:1.0:1788201273.054161:0:8446:0:(genops.c:868:class_export_get()) GET export ffff8dc002a56800 refcount=5 00000100:00000040:1.0:1788201273.054163:0:8446:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff8dc002a56800 : new rpc_count 1 00000100:00000040:1.0:1788201273.054168:0:8446:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 62 to 0@lo 00000100:00000040:1.0:1788201273.054171:0:8446:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8dc125a970c0 refcount 62 to 0@lo 00000020:00000040:1.0:1788201273.054174:0:8446:0:(genops.c:868:class_export_get()) GET export ffff8dc002a56800 refcount=6 00000100:00000040:1.0:1788201273.054179:0:8446:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 63 to 0@lo 00000100:00080000:1.0:1788201273.054909:0:8446:0:(import.c:65:import_set_state_nolock()) ffff8dc005a4a000 : changing import state from RECOVER to FULL 00000020:00000040:1.0:1788201273.054920:0:8446:0:(genops.c:879:class_export_put()) PUTting export ffff8dc002a56800 : new refcount 5 00000020:00000040:1.0:1788201273.054924:0:8446:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0000 (ffff8dc004fd4d28) now 8 - find 00010000:00000040:1.0:1788201273.054937:0:8446:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969474, transno 0, xid 1875060715299584 00000100:00000040:1.0:1788201273.054946:0:8446:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 64 to 0@lo 00000100:00000040:1.0:1788201273.054952:0:8446:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201273.055084:0:8446:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff8dc12ee2df80 x1875060715299584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788201298 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201273.055130:0:8446:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 63 to 0@lo 00000100:00000040:1.0:1788201273.055136:0:8446:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc120090a80 x1875060715299584/t0(0) o8->lustre-MDT0000-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1788201293 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.055144:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715299584:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 1363us (9785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201273.055151:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5989 00000100:00000040:1.0:1788201273.055154:0:8446:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc002a56800 : new rpc_count 0 00000020:00000040:1.0:1788201273.055165:0:8446:0:(genops.c:879:class_export_put()) PUTting export ffff8dc002a56800 : new refcount 4 00010000:00080000:1.0:1788201273.055890:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc12ee2df80 x1875060715299584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201273.055902:0:3654:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: skip recheck: last_committed 4294969474 00000100:00000040:1.0:1788201273.055907:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc12ee2df80 x1875060715299584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201273.055918:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000020:00000040:1.0:1788201273.055921:0:3654:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c597 00000020:00000040:1.0:1788201273.055926:0:3654:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc005d70800 refcount=4 00000020:00000040:1.0:1788201273.055933:0:3654:0:(genops.c:879:class_export_put()) PUTting export ffff8dc005d70800 : new refcount 3 00000100:00080000:1.0:1788201273.055938:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1788201273.055943:0:3654:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788201273.055945:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969474 gen 2 00000100:00000040:1.0:1788201273.055947:0:3654:0:(client.c:3235:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:1.0:1788201273.055950:0:3654:0:(recover.c:53:ptlrpc_replay_next()) import ffff8dc109815000 from lustre-OST0000_UUID committed 4294969474 last 0 00000100:00080000:1.0:1788201273.055953:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:1.0:1788201273.055957:0:3654:0:(genops.c:1210:class_import_get()) import ffff8dc109815000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1788201273.055994:0:6529:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc12ee2ea00 x1875060715299712/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201289 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201273.056058:0:6529:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12ee2ea00 x1875060715299712/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201289 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.056066:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715299712:0@lo:101:ll_cfg_requeue.0 00000100:00000040:1.0:1788201273.056077:0:6529:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc12ee2ea00 x1875060715299712/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201289 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201273.056091:0:6529:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc1064ede00 refcount=4 00010000:00000040:1.0:1788201273.056097:0:6529:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff8dc1064ede00, remote cookie: 0x96d0c9b8c9a1d542, flags: 0x0 00010000:00000040:1.0:1788201273.056105:0:6529:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff8dc007d9c100) refcount = 2 00010000:00000040:1.0:1788201273.056108:0:6529:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1788201273.056112:0:6529:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1d52d lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d534 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201273.056121:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1d53b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d542 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201273.056129:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1d53b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d542 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1788201273.056138:0:6529:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc12ee2ea00 x1875060715299712/t0(0) o101->MGC192.168.201.120@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1788201289 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201273.056149:0:6529:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 10000000:00000040:1.0:1788201273.056159:0:6529:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff8dc13a9a6200) refs 3 00000020:00000040:1.0:1788201273.056162:0:6529:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc1064ede00 refcount=3 00000020:00000040:1.0:1788201273.056182:0:6529:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:1.0:1788201273.056213:0:6529:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=5 obd=MGC192.168.201.120@tcp 00000100:00000040:1.0:1788201273.056229:0:6529:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc12ee2ea00 x1875060715299840/t0(0) o256->MGC192.168.201.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.056251:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715299840:0@lo:256:ll_cfg_requeue.0 00000100:00000040:1.0:1788201273.056288:0:6529:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc12ee2ea00 x1875060715299840/t0(0) o256->MGC192.168.201.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788201289 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201273.056296:0:6529:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201273.056325:0:6529:0:(events.c:337:request_in_callback()) incoming req@ffff8dc007116c50 x1875060715299840 msgsize 304 00000100:00100000:1.0:1788201273.056331:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788201273.056333:0:6529:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1788201273.056353:0:6529:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8dc12ee2ea00 x1875060715299840/t0(0) o256->MGC192.168.201.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788201289 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.056378:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201273.056541:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715299840 00000100:00100000:0.0:1788201273.056549:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715299840 00000020:00000040:0.0:1788201273.056551:0:94463:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:0.0:1788201273.056555:0:94463:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=24 00000100:00000040:0.0:1788201273.056577:0:94463:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1788201273.056610:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00000040:0.0:1788201273.056614:0:94463:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:0.0:1788201273.056620:0:94463:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc007116c50 x1875060715299840/t0(0) o256->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:394/0 lens 304/0 e 0 to 0 dl 1788201284 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201273.056644:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715299840:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788201273.056663:0:94463:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:0.0:1788201273.056673:0:94463:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:0.0:1788201273.056679:0:94463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788201273.056682:0:94463:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 128 00000020:00000040:0.0:1788201273.056687:0:94463:0:(genops.c:868:class_export_get()) GET export ffff8dc110735800 refcount=25 00000020:00000040:0.0:1788201273.056731:0:94463:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 24 00010000:00000040:0.0:1788201273.056748:0:94463:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715299840 00000100:00000040:0.0:1788201273.056756:0:94463:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 64 to 0@lo 00000100:00000040:0.0:1788201273.056759:0:94463:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201273.056774:0:94463:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff8dc12ee2ea00 x1875060715299840/t0(0) o256->MGC192.168.201.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788201289 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201273.056787:0:94463:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 63 to 0@lo 00000100:00000040:0.0:1788201273.056792:0:94463:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc007116c50 x1875060715299840/t0(0) o256->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:394/0 lens 304/240 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201273.056799:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715299840:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 159us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201273.056805:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00000040:0.0:1788201273.056808:0:94463:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:0.0:1788201273.056817:0:94463:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 23 00000100:00000040:1.0:1788201273.059171:0:6529:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff8dc12ee2ea00 x1875060715299840/t0(0) o256->MGC192.168.201.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788201289 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201273.059185:0:6529:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff8dc12ee2ea00 x1875060715299840/t0(0) o256->MGC192.168.201.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788201289 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201273.059254:0:6529:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12ee2ea00 x1875060715299840/t0(0) o256->MGC192.168.201.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788201289 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.059262:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715299840:0@lo:256:ll_cfg_requeue.0 00000100:00000040:1.0:1788201273.059281:0:6529:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc12ee2ea00 x1875060715299840/t0(0) o256->MGC192.168.201.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788201289 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:1.0:1788201273.059293:0:6529:0:(mgc_request.c:1600:mgc_process_recover_log()) Latest version 128, more 0. 10000000:00000040:1.0:1788201273.059308:0:6529:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0001 00000100:00000040:1.0:1788201273.059322:0:6529:0:(lustre_peer.c:232:class_check_uuid()) check if uuid 192.168.201.120@tcp has 192.168.201.120@tcp. 10000000:00000040:1.0:1788201273.059337:0:6529:0:(mgc_request.c:1470:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0001 target is obsoleted(1/2), reconnect 00000100:00080000:1.0:1788201273.059341:0:6529:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8dc006d84000 already not connected (conn 6, was 0): DISCONN 00000100:00000040:1.0:1788201273.059351:0:6529:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 64 to 0@lo 00000100:00000040:1.0:1788201273.059366:0:6529:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8dc125a970c0 refcount 64 to 0@lo 00000100:00000040:1.0:1788201273.059369:0:6529:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.201.120@tcp -> ffff8dc125a970c0 00010000:00080000:1.0:1788201273.059372:0:6529:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8dc006d84000@lustre-OST0000-osc-MDT0001: found existing conn 192.168.201.120@tcp, moved to head 00010000:00000040:1.0:1788201273.059376:0:6529:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 63 to 0@lo 00000100:00080000:1.0:1788201273.059380:0:6529:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:1.0:1788201273.059385:0:6529:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 62 to 0@lo 00000100:00000040:1.0:1788201273.059387:0:6529:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 63 to 0@lo 00000020:00000040:1.0:1788201273.059390:0:6529:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a163b3 00000020:00000040:1.0:1788201273.059394:0:6529:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc12f3a2800 refcount=4 00000100:00000040:1.0:1788201273.059397:0:6529:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 62 to 0@lo 00000100:00000040:1.0:1788201273.059399:0:6529:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 63 to 0@lo 00000020:00000040:1.0:1788201273.059402:0:6529:0:(genops.c:879:class_export_put()) PUTting export ffff8dc12f3a2800 : new refcount 3 00000100:00080000:1.0:1788201273.059405:0:6529:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8dc006d84000 using connection 192.168.201.120@tcp/0@lo 00000020:00000040:1.0:1788201273.059419:0:6529:0:(genops.c:1210:class_import_get()) import ffff8dc006d84000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:1.0:1788201273.059441:0:6529:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12ee2ca80 x1875060715299968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788201273.059456:0:6529:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ed328feb] to pc [ptlrpcd_rcv+-1] req@ffff8dc12ee2ca80 x1875060715299968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:1.0:1788201273.059473:0:6529:0:(mgc_request.c:1487:mgc_apply_recover_logs()) ir apply logs 128/128 for lustre-OST0000-osc-MDT0001 00000100:00000040:1.0:1788201273.059480:0:6529:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc12ee2ea00 x1875060715299840/t0(0) o256->MGC192.168.201.120@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1788201289 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201273.059489:0:6529:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000020:00000040:1.0:1788201273.059492:0:6529:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 10000000:01000000:1.0:1788201273.059515:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:1.0:1788201273.059521:0:6529:0:(lustre_handles.c:148:class_handle2object()) GET ldlm ffff8dc1064ede00 refcount=3 00010000:00010000:1.0:1788201273.059526:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1d53b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d542 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201273.059535:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1d53b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d542 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:1.0:1788201273.059551:0:6529:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff8dc13a9a6200) refs 3 00000100:00000040:1.0:1788201273.065206:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12ee2df80 x1875060715299584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201298 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.065222:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715299584:0@lo:8:ll_cfg_requeue.0 00000100:00000040:1.0:1788201273.065233:0:3654:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc12ee2df80 x1875060715299584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201298 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201273.065248:0:3654:0:(genops.c:1223:class_import_put()) import ffff8dc109815000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1788201273.065279:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc12ee2ca80 x1875060715299968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.065293:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715299968:0@lo:8:ll_cfg_requeue.0 00000100:00000040:1.0:1788201273.065325:0:3654:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc12ee2ca80 x1875060715299968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788201298 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201273.065336:0:3654:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201273.065379:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8dc12ee2df80 x1875060715299968 msgsize 520 00000100:00100000:1.0:1788201273.065385:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788201273.065411:0:3654:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc12ee2ca80 x1875060715299968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788201298 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201273.065425:0:3654:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 6062 usecs (7 jiffies) 00010000:00080000:1.0:1788201273.065447:0:97104:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:1.0:1788201273.065452:0:97104:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:1.0:1788201273.065457:0:97104:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:1.0:1788201273.065495:0:97104:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:1.0:1788201273.065502:0:97104:0:(genops.c:1210:class_import_get()) import ffff8dc109815000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1788201273.065526:0:97104:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c5490506] to pc [ptlrpcd_rcv+-1] req@ffff8dc12ee2ea00 x1875060715300096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201273.065548:0:97104:0:(genops.c:1223:class_import_put()) import ffff8dc109815000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1788201273.065559:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc12ee2ea00 x1875060715300096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.065568:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715300096:0@lo:400:ldlm_lock_repla.0 00000100:00000040:1.0:1788201273.065583:0:3654:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff8dc12ee2ea00 x1875060715300096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201289 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201273.065601:0:3654:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201273.065616:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8dc12ee2d880 x1875060715300096 msgsize 224 00000100:00100000:1.0:1788201273.065621:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788201273.065637:0:3654:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc12ee2ea00 x1875060715300096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201289 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201273.065646:0:3654:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 7508 usecs (8 jiffies) 00000100:00100000:1.0:1788201273.066256:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715299968 00000100:00100000:1.0:1788201273.066275:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715299968 00000020:00000040:1.0:1788201273.066278:0:26201:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a163c8 00000100:00100000:1.0:1788201273.066320:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715300096 00000100:00100000:1.0:1788201273.066324:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715300096 00000020:00000040:1.0:1788201273.066325:0:26201:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d2 00000020:00000040:1.0:1788201273.066329:0:26201:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc002a56800 refcount=5 00000100:00000040:1.0:1788201273.066347:0:26201:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1788201273.066368:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2925 00000100:00000040:1.0:1788201273.066374:0:26201:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc002a56800 : new rpc_count 1 00000100:00000040:1.0:1788201273.066379:0:26201:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc12ee2d880 x1875060715300096/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:394/0 lens 224/0 e 0 to 0 dl 1788201284 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.066391:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715300096:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:1.0:1788201273.066403:0:26201:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc12ee2d880 x1875060715300096/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:394/0 lens 224/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1788201273.066425:0:26201:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc002a56800 : new rpc_count 2 00010000:00080000:1.0:1788201273.066429:0:26201:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc12ee2d880 x1875060715300096/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:394/0 lens 224/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201273.066443:0:26201:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12ee2d880 x1875060715300096/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:394/0 lens 224/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.066451:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715300096:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 62us (832us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201273.066458:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2925 00000100:00000040:1.0:1788201273.066461:0:26201:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc002a56800 : new rpc_count 1 00000100:00100000:1.0:1788201273.066470:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5990 00000100:00000040:1.0:1788201273.066474:0:26201:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc12ee2df80 x1875060715299968/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788201293 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.066483:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3654:x1875060715299968:12345-0@lo:8:ll_cfg_requeue.0 00000020:00000040:1.0:1788201273.066500:0:26201:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8dc004fd4d28) now 8 - find 00010000:00000040:1.0:1788201273.066512:0:26201:0:(ldlm_lib.c:1263:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:1.0:1788201273.066519:0:26201:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8dc001e28800, cookie 0x96d0c9b8c9a1d4cb 00010000:00080000:1.0:1788201273.066524:0:26201:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8dc001e28800 cur 4124 last 1788201271 00000001:00000040:1.0:1788201273.066539:0:26201:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.201.120@tcp 00000001:00000040:1.0:1788201273.066544:0:26201:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8dc1330c8800) : new refcount 20 00000020:00000040:1.0:1788201273.066548:0:26201:0:(genops.c:868:class_export_get()) GET export ffff8dc001e28800 refcount=4 00000001:00000040:1.0:1788201273.066549:0:26201:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8dc1330c8800) : new refcount 21 00000001:00000040:1.0:1788201273.066553:0:26201:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff8dc1330c8800) : new refcount 20 00002000:00100000:1.0:1788201273.066556:0:26201:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8dc001e28800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788201273.066560:0:26201:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1788201273.066568:0:26201:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:1.0:1788201273.066577:0:26201:0:(lprocfs_status_server.c:748:lprocfs_exp_setup()) Found stats ffff8dc00532fd80 for nid 0@lo - ref 3 00000020:00000040:1.0:1788201273.066585:0:26201:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8dc004fd4d28) now 9 - import 00000020:00000040:1.0:1788201273.067936:0:26201:0:(genops.c:1223:class_import_put()) import ffff8dc13aa9a000 refcount=1 obd=lustre-OST0000 00000020:00000040:1.0:1788201273.067955:0:26201:0:(genops.c:868:class_export_get()) GET export ffff8dc001e28800 refcount=5 00000100:00000040:1.0:1788201273.067958:0:26201:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff8dc001e28800 : new rpc_count 1 00000100:00000040:1.0:1788201273.067967:0:26201:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 64 to 0@lo 00000100:00000040:1.0:1788201273.067970:0:26201:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8dc125a970c0 refcount 64 to 0@lo 00000020:00000040:1.0:1788201273.067973:0:26201:0:(genops.c:868:class_export_get()) GET export ffff8dc001e28800 refcount=6 00000100:00000040:1.0:1788201273.067981:0:26201:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00080000:1.0:1788201273.067991:0:26201:0:(import.c:65:import_set_state_nolock()) ffff8dc13aa9a000 : changing import state from RECOVER to FULL 00000020:00000040:1.0:1788201273.068009:0:26201:0:(genops.c:879:class_export_put()) PUTting export ffff8dc001e28800 : new refcount 5 00000020:00000040:1.0:1788201273.068089:0:26201:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0000 (ffff8dc004fd4d28) now 9 - find 00010000:00000040:1.0:1788201273.068107:0:26201:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969456, transno 0, xid 1875060715299968 00000100:00000040:1.0:1788201273.068117:0:26201:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00000040:1.0:1788201273.068122:0:26201:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201273.068164:0:26201:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff8dc12ee2ca80 x1875060715299968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1788201298 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201273.068638:0:26201:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00000040:1.0:1788201273.068646:0:26201:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12ee2df80 x1875060715299968/t0(0) o8->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1788201293 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.068656:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3654:x1875060715299968:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 2172us (3275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201273.068665:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5990 00000100:00000040:1.0:1788201273.068668:0:26201:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc001e28800 : new rpc_count 0 00000020:00000040:1.0:1788201273.068680:0:26201:0:(genops.c:879:class_export_put()) PUTting export ffff8dc001e28800 : new refcount 4 00010000:00080000:1.0:1788201273.068705:0:97051:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:3.0:1788201273.068963:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc12ee2ca80 x1875060715299968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201273.068974:0:3654:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294969456 00000100:00000040:3.0:1788201273.068980:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc12ee2ca80 x1875060715299968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201273.068991:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000020:00000040:3.0:1788201273.069003:0:3654:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a163b3 00000020:00000040:3.0:1788201273.069008:0:3654:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc12f3a2800 refcount=4 00000020:00000040:3.0:1788201273.070609:0:3654:0:(genops.c:879:class_export_put()) PUTting export ffff8dc12f3a2800 : new refcount 3 00000100:00080000:3.0:1788201273.070620:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1788201273.070626:0:3654:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788201273.070630:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294969456 gen 2 00000100:00000040:3.0:1788201273.070634:0:3654:0:(client.c:3235:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:3.0:1788201273.070647:0:3654:0:(recover.c:53:ptlrpc_replay_next()) import ffff8dc006d84000 from lustre-OST0000_UUID committed 4294969456 last 0 00000100:00080000:3.0:1788201273.070651:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:3.0:1788201273.070655:0:3654:0:(genops.c:1210:class_import_get()) import ffff8dc006d84000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:1.0:1788201273.071679:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12ee2ca80 x1875060715299968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201298 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.071706:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715299968:0@lo:8:ll_cfg_requeue.0 00000100:00000040:1.0:1788201273.071715:0:3654:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc12ee2ca80 x1875060715299968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201298 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201273.071728:0:3654:0:(genops.c:1223:class_import_put()) import ffff8dc006d84000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00010000:00080000:3.0:1788201273.071786:0:97105:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:3.0:1788201273.071791:0:97105:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:3.0:1788201273.071796:0:97105:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00080000:3.0:1788201273.074205:0:97105:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:3.0:1788201273.074224:0:97105:0:(genops.c:1210:class_import_get()) import ffff8dc006d84000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1788201273.074254:0:97105:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e0edd50b] to pc [ptlrpcd_rcv+-1] req@ffff8dc125641c00 x1875060715300224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201273.074286:0:97105:0:(genops.c:1223:class_import_put()) import ffff8dc006d84000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:1.0:1788201273.074541:0:3654:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc125641c00 x1875060715300224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.074555:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715300224:0@lo:400:ldlm_lock_repla.0 00000100:00000040:1.0:1788201273.074583:0:3654:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff8dc125641c00 x1875060715300224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201289 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201273.074603:0:3654:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201273.074645:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8dc12ee2ca80 x1875060715300224 msgsize 224 00000100:00100000:1.0:1788201273.074650:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788201273.074678:0:3654:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc125641c00 x1875060715300224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201289 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201273.074692:0:3654:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 6078 usecs (7 jiffies) 00000100:00100000:3.0:1788201273.076959:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715300224 00000100:00100000:3.0:1788201273.076979:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715300224 00000020:00000040:3.0:1788201273.076982:0:26210:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4cb 00000020:00000040:3.0:1788201273.076987:0:26210:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc001e28800 refcount=5 00000100:00100000:3.0:1788201273.077091:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2926 00000100:00000040:3.0:1788201273.077097:0:26210:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc001e28800 : new rpc_count 1 00000100:00000040:3.0:1788201273.077104:0:26210:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc12ee2ca80 x1875060715300224/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:394/0 lens 224/0 e 0 to 0 dl 1788201284 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201273.077118:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3654:x1875060715300224:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:3.0:1788201273.077131:0:26210:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc12ee2ca80 x1875060715300224/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:394/0 lens 224/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1788201273.077141:0:26210:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc001e28800 : new rpc_count 2 00010000:00080000:3.0:1788201273.077145:0:26210:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc12ee2ca80 x1875060715300224/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:394/0 lens 224/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201273.077162:0:26210:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12ee2ca80 x1875060715300224/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:394/0 lens 224/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201273.077177:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3654:x1875060715300224:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 61us (2530us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201273.077185:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2926 00000100:00000040:3.0:1788201273.077188:0:26210:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc001e28800 : new rpc_count 1 00010000:00080000:3.0:1788201273.077204:0:97051:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00010000:2.0:1788201273.104169:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:0.0:1788201273.168521:0:75746:0:(genops.c:1210:class_import_get()) import ffff8dc109813800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1788201273.168562:0:75746:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000074e99067] to pc [ptlrpcd_00_02+2] req@ffff8dc120091500 x1875060715300352/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201273.168595:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:0.0:1788201273.168611:0:3658:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc120091500 x1875060715300352/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201273.168654:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715300352:0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1788201273.168684:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc120091500 x1875060715300352/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201289 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201273.168693:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201273.168771:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff8dc120091180 x1875060715300352 msgsize 224 00000100:00100000:0.0:1788201273.168777:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788201273.168815:0:3658:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc120091500 x1875060715300352/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201289 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201273.168830:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1317006 usecs (1318 jiffies) 00000100:00100000:0.0:1788201273.168857:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715300352 00000100:00100000:0.0:1788201273.168864:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715300352 00000020:00000040:0.0:1788201273.168867:0:8457:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c54a 00000020:00000040:0.0:1788201273.168871:0:8457:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc103486000 refcount=7 00000100:00000040:0.0:1788201273.168895:0:8457:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:0.0:1788201273.168921:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4119 00000100:00000040:0.0:1788201273.168926:0:8457:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc103486000 : new rpc_count 1 00000100:00000040:0.0:1788201273.168932:0:8457:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc120091180 x1875060715300352/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:394/0 lens 224/0 e 0 to 0 dl 1788201284 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201273.168945:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715300352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201273.168981:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00010000:00000040:0.0:1788201273.168993:0:8457:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1875060715300352 00000100:00000040:0.0:1788201273.169003:0:8457:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00000040:0.0:1788201273.169008:0:8457:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201273.169050:0:8457:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8dc120091500 x1875060715300352/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201289 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201273.169069:0:8457:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00000040:0.0:1788201273.169074:0:8457:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc120091180 x1875060715300352/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:394/0 lens 224/368 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201273.169088:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715300352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201273.169095:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4119 00000100:00000040:0.0:1788201273.169099:0:8457:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc103486000 : new rpc_count 0 00000020:00000040:0.0:1788201273.169109:0:8457:0:(genops.c:879:class_export_put()) PUTting export ffff8dc103486000 : new refcount 6 00000100:00000040:0.0:1788201273.169142:0:3658:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:0.0:1788201273.169148:0:3658:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc120091500 x1875060715300352/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1788201273.169157:0:3658:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352767 avail=317064 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023575 state=0: rc = 0 00000100:00000040:0.0:1788201273.169164:0:3658:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc120091500 x1875060715300352/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201289 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201273.169172:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715300352:0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1788201273.169178:0:3658:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc120091500 x1875060715300352/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201289 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788201273.169314:0:3658:0:(genops.c:1223:class_import_put()) import ffff8dc109813800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000020:00000040:3.0:1788201273.169412:0:94477:0:(genops.c:1210:class_import_get()) import ffff8dc1257f0800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1788201273.169428:0:94477:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e7cf9cfd] to pc [ptlrpcd_00_03+3] req@ffff8dc125642d80 x1875060715300480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201273.169447:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:3.0:1788201273.169455:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc125642d80 x1875060715300480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201273.169464:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715300480:0@lo:13:osp-pre-1-0.0 00000100:00000040:3.0:1788201273.169479:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc125642d80 x1875060715300480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201289 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201273.169486:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201273.169502:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff8dc125640a80 x1875060715300480 msgsize 224 00000100:00100000:3.0:1788201273.169505:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201273.169520:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc125642d80 x1875060715300480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201289 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201273.169530:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 7001 usecs (8 jiffies) 00000100:00100000:3.0:1788201273.169545:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715300480 00000100:00100000:3.0:1788201273.169548:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715300480 00000020:00000040:3.0:1788201273.169550:0:8450:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c5ba 00000020:00000040:3.0:1788201273.169553:0:8450:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc0059d1800 refcount=5 00000020:00000040:3.0:1788201273.169564:0:8450:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff8dc139bbcd28) now 10 - evictor 00000100:00000040:3.0:1788201273.169580:0:8450:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:3.0:1788201273.169596:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2372 00000100:00000040:3.0:1788201273.169604:0:8450:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc0059d1800 : new rpc_count 1 00000100:00000040:3.0:1788201273.169608:0:8450:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc125640a80 x1875060715300480/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:394/0 lens 224/0 e 0 to 0 dl 1788201284 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201273.169620:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715300480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201273.169641:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00010000:00000040:3.0:1788201273.169648:0:8450:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969457, transno 0, xid 1875060715300480 00000100:00000040:3.0:1788201273.169653:0:8450:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00000040:3.0:1788201273.169657:0:8450:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201273.169673:0:8450:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8dc125642d80 x1875060715300480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201289 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201273.169690:0:8450:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00000040:3.0:1788201273.169694:0:8450:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc125640a80 x1875060715300480/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:394/0 lens 224/368 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201273.169702:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715300480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201273.169707:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2372 00000100:00000040:3.0:1788201273.169709:0:8450:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc0059d1800 : new rpc_count 0 00000020:00000040:3.0:1788201273.169716:0:8450:0:(genops.c:879:class_export_put()) PUTting export ffff8dc0059d1800 : new refcount 4 00000100:00080000:3.0:1788201273.169729:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1788201273.169733:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff8dc139bbcd28) now 10 - evictor 00000100:00000040:3.0:1788201273.169753:0:3657:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969457 00000100:00000040:3.0:1788201273.169758:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc125642d80 x1875060715300480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1788201273.169766:0:3657:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:3.0:1788201273.169769:0:3657:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261731 state=0: rc = 0 00000100:00000040:3.0:1788201273.169776:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc125642d80 x1875060715300480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201289 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201273.169788:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715300480:0@lo:13:osp-pre-1-0.0 00000100:00000040:3.0:1788201273.169795:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc125642d80 x1875060715300480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201289 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201273.169802:0:3657:0:(genops.c:1223:class_import_put()) import ffff8dc1257f0800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1788201273.301725:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff8dc007114850 x1875060695488512 msgsize 224 00000100:00100000:3.0:1788201273.301742:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00000040:3.0:1788201273.301744:0:3648:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:1.0:1788201273.301859:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695488512 00000100:00100000:1.0:1788201273.301869:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695488512 00000020:00000040:1.0:1788201273.301872:0:94461:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4cc 00000020:00000040:1.0:1788201273.301878:0:94461:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc13aa9c000 refcount=9 00000100:00000040:1.0:1788201273.301904:0:94461:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788201273.301941:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 214 00000100:00000040:1.0:1788201273.301946:0:94461:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc13aa9c000 : new rpc_count 1 00000100:00000040:1.0:1788201273.301954:0:94461:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc007114850 x1875060695488512/t0(0) o400->93ba7067-43b5-4e46-8db7-27c040fa03d9@192.168.201.20@tcp:394/0 lens 224/0 e 0 to 0 dl 1788201284 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.301968:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:2400:x1875060695488512:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000040:1.0:1788201273.302005:0:94461:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060695488512 00000100:00000040:1.0:1788201273.302040:0:94461:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 9 to 192.168.201.20@tcp 00000100:00000040:1.0:1788201273.302047:0:94461:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:1.0:1788201273.302087:0:94461:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 8 to 192.168.201.20@tcp 00000100:00000040:1.0:1788201273.302092:0:94461:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc007114850 x1875060695488512/t0(0) o400->93ba7067-43b5-4e46-8db7-27c040fa03d9@192.168.201.20@tcp:394/0 lens 224/224 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.302102:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:2400:x1875060695488512:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 135us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201273.302109:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 214 00000100:00000040:1.0:1788201273.302112:0:94461:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc13aa9c000 : new rpc_count 0 00000020:00000040:1.0:1788201273.302123:0:94461:0:(genops.c:879:class_export_put()) PUTting export ffff8dc13aa9c000 : new refcount 8 00000100:00000040:1.0:1788201273.309170:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff8dc12ee2c700 x1875060695488896 msgsize 520 00000100:00100000:1.0:1788201273.309188:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201273.309472:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695488896 00000100:00100000:3.0:1788201273.309483:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695488896 00000020:00000040:3.0:1788201273.309487:0:8448:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c8df 00000100:00100000:3.0:1788201273.309565:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5991 00000100:00000040:3.0:1788201273.309574:0:8448:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc12ee2c700 x1875060695488896/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1788201293 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201273.309601:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2399:x1875060695488896:12345-192.168.201.20@tcp:8:kworker.0 00000020:00000040:3.0:1788201273.309621:0:8448:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8dc004fd4d28) now 9 - find 00010000:00000040:3.0:1788201273.309634:0:8448:0:(ldlm_lib.c:1263:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa0467af2e3640038 tmp_exp_old_falloc: 0 00010000:00080000:3.0:1788201273.309641:0:8448:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '6e293f14-c501-4bc5-9dd4-a18ef02756b4' at ffff8dc1401c7000, cookie 0x96d0c9b8c9a1d4d9 00010000:00080000:3.0:1788201273.309646:0:8448:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp recovering/t4294969479 exp ffff8dc1401c7000 cur 4124 last 1788201271 00000001:00000040:3.0:1788201273.309665:0:8448:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8dc1330c8800) : new refcount 21 00000020:00000040:3.0:1788201273.309669:0:8448:0:(genops.c:868:class_export_get()) GET export ffff8dc1401c7000 refcount=4 00000001:00000040:3.0:1788201273.309671:0:8448:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8dc1330c8800) : new refcount 22 00000001:00000040:3.0:1788201273.309675:0:8448:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff8dc1330c8800) : new refcount 21 00002000:00100000:3.0:1788201273.309678:0:8448:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6e293f14-c501-4bc5-9dd4-a18ef02756b4/ffff8dc1401c7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 573440 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788201273.309689:0:8448:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000040:3.0:1788201273.309711:0:8448:0:(lprocfs_status_server.c:748:lprocfs_exp_setup()) Found stats ffff8dc007b82ea0 for nid 192.168.201.20@tcp - ref 2 00000020:00000040:3.0:1788201273.309806:0:8448:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8dc004fd4d28) now 10 - import 00000020:00000040:3.0:1788201273.309822:0:8448:0:(genops.c:1223:class_import_put()) import ffff8dc0059d2800 refcount=1 obd=lustre-OST0000 00000020:00000040:3.0:1788201273.309839:0:8448:0:(genops.c:868:class_export_get()) GET export ffff8dc1401c7000 refcount=5 00000100:00000040:3.0:1788201273.309842:0:8448:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff8dc1401c7000 : new rpc_count 1 00000100:00000040:3.0:1788201273.309850:0:8448:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 9 to 192.168.201.20@tcp 00000100:00000040:3.0:1788201273.309853:0:8448:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8dc140da5c80 refcount 9 to 192.168.201.20@tcp 00000020:00000040:3.0:1788201273.309856:0:8448:0:(genops.c:868:class_export_get()) GET export ffff8dc1401c7000 refcount=6 00000100:00000040:3.0:1788201273.309861:0:8448:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00000100:00080000:3.0:1788201273.309869:0:8448:0:(import.c:65:import_set_state_nolock()) ffff8dc0059d2800 : changing import state from RECOVER to FULL 00000020:00000040:3.0:1788201273.309881:0:8448:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 5 00000020:00000040:3.0:1788201273.309883:0:8448:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0000 (ffff8dc004fd4d28) now 10 - find 00010000:00000040:3.0:1788201273.309894:0:8448:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969478, transno 0, xid 1875060695488896 00000100:00000040:3.0:1788201273.309901:0:8448:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:3.0:1788201273.309907:0:8448:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:3.0:1788201273.310512:0:8448:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00000100:00000040:3.0:1788201273.310520:0:8448:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12ee2c700 x1875060695488896/t0(0) o8->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:0/0 lens 520/416 e 0 to 0 dl 1788201293 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201273.310531:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2399:x1875060695488896:12345-192.168.201.20@tcp:8:kworker.0 Request processed in 944us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201273.310539:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5991 00000100:00000040:3.0:1788201273.310542:0:8448:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 0 00000020:00000040:3.0:1788201273.310553:0:8448:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 4 00010000:00080000:3.0:1788201273.310572:0:97051:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00000040:3.0:1788201273.310576:0:97051:0:(ldlm_lib.c:2900:target_recovery_thread()) 1: request replay stage - 1 clients from t4294969479 00010000:00080000:3.0:1788201273.310579:0:97051:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 4294969479 00010000:00080000:3.0:1788201273.310592:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969479 00010000:00080000:3.0:1788201273.310605:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969479 00000100:00000040:1.0:1788201273.310740:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff8dc12ee2c380 x1875060695488768 msgsize 224 00000100:00100000:1.0:1788201273.310746:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00000040:1.0:1788201273.310880:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005abc380 x1875060695488640 msgsize 224 00000100:00100000:1.0:1788201273.310886:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00000040:1.0:1788201273.311073:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005abf100 x1875060695489024 msgsize 224 00000100:00100000:1.0:1788201273.311079:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201273.311110:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695488768 00000100:00100000:3.0:1788201273.311116:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695488768 00000020:00000040:3.0:1788201273.311118:0:66312:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1bb4f 00000020:00000040:3.0:1788201273.311122:0:66312:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc12e647000 refcount=11 00000020:00000040:3.0:1788201273.311135:0:66312:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff8dc1060e4d28) now 12 - evictor 00000100:00000040:3.0:1788201273.311151:0:66312:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:3.0:1788201273.311169:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695488640 00000100:00100000:3.0:1788201273.311171:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695488640 00000020:00000040:3.0:1788201273.311173:0:66312:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c551 00000020:00000040:3.0:1788201273.311175:0:66312:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc103483800 refcount=51 00000020:00000040:3.0:1788201273.311181:0:66312:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff8dc13f870000) now 16 - evictor 00000100:00100000:3.0:1788201273.311196:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1545 00000100:00000040:3.0:1788201273.311200:0:66312:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc12e647000 : new rpc_count 1 00000100:00000040:3.0:1788201273.311205:0:66312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc12ee2c380 x1875060695488768/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 224/0 e 0 to 0 dl 1788201284 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201273.311217:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2400:x1875060695488768:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000040:3.0:1788201273.311233:0:66312:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 77309411473, transno 0, xid 1875060695488768 00000100:00000040:3.0:1788201273.311240:0:66312:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:3.0:1788201273.311244:0:66312:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:3.0:1788201273.311279:0:66312:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00000100:00000040:3.0:1788201273.311284:0:66312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc12ee2c380 x1875060695488768/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 224/224 e 0 to 0 dl 1788201284 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201273.311292:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2400:x1875060695488768:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 77us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201273.311363:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1545 00000100:00000040:3.0:1788201273.311366:0:66312:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc12e647000 : new rpc_count 0 00000020:00000040:3.0:1788201273.311374:0:66312:0:(genops.c:879:class_export_put()) PUTting export ffff8dc12e647000 : new refcount 10 00000100:00100000:3.0:1788201273.311383:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1546 00000100:00000040:3.0:1788201273.311392:0:66312:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc103483800 : new rpc_count 1 00000100:00000040:3.0:1788201273.311397:0:66312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005abc380 x1875060695488640/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 224/0 e 0 to 0 dl 1788201284 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201273.311407:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2400:x1875060695488640:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000040:3.0:1788201273.311417:0:66312:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 124554051730, transno 0, xid 1875060695488640 00000100:00000040:3.0:1788201273.311421:0:66312:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:3.0:1788201273.311425:0:66312:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:3.0:1788201273.311437:0:66312:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00000100:00000040:3.0:1788201273.311441:0:66312:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005abc380 x1875060695488640/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 224/224 e 0 to 0 dl 1788201284 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201273.311450:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2400:x1875060695488640:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 44us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201273.311456:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1546 00000100:00000040:3.0:1788201273.311458:0:66312:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc103483800 : new rpc_count 0 00000020:00000040:3.0:1788201273.311462:0:66312:0:(genops.c:879:class_export_put()) PUTting export ffff8dc103483800 : new refcount 50 00000100:00080000:3.0:1788201273.311475:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:3.0:1788201273.311478:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (ffff8dc13f870000) now 16 - evictor 00000100:00080000:3.0:1788201273.311480:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:3.0:1788201273.311482:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001 (ffff8dc1060e4d28) now 12 - evictor 00000100:00100000:1.0:1788201273.311527:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695489024 00000100:00100000:1.0:1788201273.311531:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695489024 00000020:00000040:1.0:1788201273.311533:0:26208:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c8e6 00000020:00000040:1.0:1788201273.311535:0:26208:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c6800 refcount=7 00000020:00000040:1.0:1788201273.311543:0:26208:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff8dc139bbcd28) now 10 - evictor 00000100:00100000:1.0:1788201273.311616:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2927 00000100:00000040:1.0:1788201273.311619:0:26208:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c6800 : new rpc_count 1 00000100:00000040:1.0:1788201273.311623:0:26208:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005abf100 x1875060695489024/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 224/0 e 0 to 0 dl 1788201284 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.311645:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2400:x1875060695489024:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000040:1.0:1788201273.311654:0:26208:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060695489024 00000100:00000040:1.0:1788201273.311658:0:26208:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:1.0:1788201273.311662:0:26208:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:1.0:1788201273.311674:0:26208:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00000100:00000040:1.0:1788201273.311678:0:26208:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005abf100 x1875060695489024/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 224/224 e 0 to 0 dl 1788201284 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.311687:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2400:x1875060695489024:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 44us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201273.311693:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2927 00000100:00000040:1.0:1788201273.311695:0:26208:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c6800 : new rpc_count 0 00000020:00000040:1.0:1788201273.311702:0:26208:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c6800 : new refcount 6 00000100:00080000:3.0:1788201273.311929:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1788201273.311932:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff8dc139bbcd28) now 10 - evictor 00000100:00000040:3.0:1788201273.317465:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff8dc125642d80 x1875060695464960 msgsize 440 00000100:00100000:3.0:1788201273.317482:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201273.317756:0:24857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695464960 00000100:00100000:2.0:1788201273.317768:0:24857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695464960 00000020:00000040:2.0:1788201273.317771:0:24857:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:2.0:1788201273.317776:0:24857:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=5 00000100:00000040:2.0:1788201273.317805:0:24857:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788201273.317856:0:24857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1028 00000100:00000040:2.0:1788201273.317860:0:24857:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 1 00000100:00000040:2.0:1788201273.317869:0:24857:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc125642d80 x1875060695464960/t0(4294969479) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201273.317882:0:24857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2399:x1875060695464960:12345-192.168.201.20@tcp:10:dd.0 00000020:00000040:2.0:1788201273.317892:0:24857:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc125642d80 x1875060695464960/t0(4294969479) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788201273.317901:0:24857:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969479, current: 4294969479, replaying 00010000:00000040:2.0:1788201273.317916:0:24857:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 2 00000100:00000040:2.0:1788201273.318007:0:24857:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc125642d80 x1875060695464960/t0(4294969479) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201273.318044:0:24857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2399:x1875060695464960:12345-192.168.201.20@tcp:10:dd.0 Request processed in 163us (580us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201273.318052:0:24857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1028 00000100:00000040:2.0:1788201273.318056:0:24857:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 1 00010000:00080000:3.0:1788201273.318230:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969479, next_transno: 4294969479 00010000:00080000:3.0:1788201273.318235:0:97051:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969479) 00010000:00080000:3.0:1788201273.318243:0:97051:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695464960 t4294969479 from 192.168.201.20@tcp req@ffff8dc125642d80 x1875060695464960/t0(4294969479) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788201273.318282:0:97051:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc125642d80 x1875060695464960/t0(4294969479) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788201273.318320:0:97051:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x382:0x0] 00000001:00000040:3.0:1788201273.318952:0:97051:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8dc1401c7000 : new cb_count 1 00000020:00000040:3.0:1788201273.318956:0:97051:0:(genops.c:868:class_export_get()) GET export ffff8dc1401c7000 refcount=6 00010000:00000040:3.0:1788201273.319007:0:97051:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969478, transno 4294969479, xid 1875060695464960 00000100:00000040:3.0:1788201273.319053:0:97051:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:3.0:1788201273.319060:0:97051:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:3.0:1788201273.319109:0:97051:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00010000:00080000:3.0:1788201273.319121:0:97051:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 101 seconds 00010000:00000040:3.0:1788201273.319128:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 0 00000020:00000040:3.0:1788201273.319137:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 5 00010000:00080000:3.0:1788201273.319141:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969480 00010000:00080000:3.0:1788201273.319145:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969480 00000100:00000040:1.0:1788201273.322000:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005abfb80 x1875060695466112 msgsize 440 00000100:00100000:1.0:1788201273.322140:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201273.322554:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695466112 00000100:00100000:3.0:1788201273.322565:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695466112 00000020:00000040:3.0:1788201273.322629:0:8452:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:3.0:1788201273.322635:0:8452:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=6 00000100:00000040:3.0:1788201273.322665:0:8452:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788201273.322744:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1029 00000100:00000040:3.0:1788201273.322748:0:8452:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 1 00000100:00000040:3.0:1788201273.322756:0:8452:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005abfb80 x1875060695466112/t0(4294969480) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201273.322770:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695466112:12345-192.168.201.20@tcp:10:dd.0 00000020:00000040:3.0:1788201273.322781:0:8452:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc005abfb80 x1875060695466112/t0(4294969480) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788201273.322808:0:8452:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969480, current: 4294969480, replaying 00010000:00000040:3.0:1788201273.322811:0:8452:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 2 00000100:00000040:3.0:1788201273.322830:0:8452:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005abfb80 x1875060695466112/t0(4294969480) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201273.322839:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695466112:12345-192.168.201.20@tcp:10:dd.0 Request processed in 72us (841us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201273.322846:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1029 00000100:00000040:3.0:1788201273.322849:0:8452:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 1 00010000:00080000:0.0:1788201273.322882:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969480, next_transno: 4294969480 00010000:00080000:0.0:1788201273.322886:0:97051:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969480) 00010000:00080000:0.0:1788201273.322894:0:97051:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695466112 t4294969480 from 192.168.201.20@tcp req@ffff8dc005abfb80 x1875060695466112/t0(4294969480) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788201273.322910:0:97051:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc005abfb80 x1875060695466112/t0(4294969480) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1788201273.322937:0:97051:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x383:0x0] 00000001:00000040:0.0:1788201273.323133:0:97051:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8dc1401c7000 : new cb_count 2 00000020:00000040:0.0:1788201273.323137:0:97051:0:(genops.c:868:class_export_get()) GET export ffff8dc1401c7000 refcount=7 00010000:00000040:0.0:1788201273.323182:0:97051:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969478, transno 4294969480, xid 1875060695466112 00000100:00000040:0.0:1788201273.323192:0:97051:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:0.0:1788201273.323197:0:97051:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:0.0:1788201273.323255:0:97051:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00010000:00080000:0.0:1788201273.323273:0:97051:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1788201273.323279:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 0 00000020:00000040:0.0:1788201273.323291:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 6 00010000:00080000:0.0:1788201273.323294:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969481 00010000:00080000:0.0:1788201273.323298:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969481 00000100:00000040:3.0:1788201273.331573:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff8dc125641f80 x1875060695467264 msgsize 440 00000100:00100000:3.0:1788201273.331591:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201273.331848:0:25502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695467264 00000100:00100000:0.0:1788201273.331858:0:25502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695467264 00000020:00000040:0.0:1788201273.331861:0:25502:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:0.0:1788201273.331866:0:25502:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=7 00000100:00000040:0.0:1788201273.331889:0:25502:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788201273.331930:0:25502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1030 00000100:00000040:0.0:1788201273.331935:0:25502:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 1 00000100:00000040:0.0:1788201273.331941:0:25502:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc125641f80 x1875060695467264/t0(4294969481) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201273.331952:0:25502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2399:x1875060695467264:12345-192.168.201.20@tcp:10:dd.0 00000020:00000040:0.0:1788201273.331962:0:25502:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc125641f80 x1875060695467264/t0(4294969481) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788201273.331969:0:25502:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969481, current: 4294969481, replaying 00010000:00000040:0.0:1788201273.331972:0:25502:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 2 00000100:00000040:0.0:1788201273.331980:0:25502:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc125641f80 x1875060695467264/t0(4294969481) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201273.331986:0:25502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2399:x1875060695467264:12345-192.168.201.20@tcp:10:dd.0 Request processed in 36us (415us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201273.332000:0:25502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1030 00000100:00000040:0.0:1788201273.332002:0:25502:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 1 00010000:00080000:0.0:1788201273.332032:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969481, next_transno: 4294969481 00010000:00080000:0.0:1788201273.332037:0:97051:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969481) 00010000:00080000:0.0:1788201273.332045:0:97051:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695467264 t4294969481 from 192.168.201.20@tcp req@ffff8dc125641f80 x1875060695467264/t0(4294969481) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788201273.332061:0:97051:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc125641f80 x1875060695467264/t0(4294969481) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1788201273.332091:0:97051:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x388:0x0] 00000001:00000040:0.0:1788201273.332280:0:97051:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8dc1401c7000 : new cb_count 3 00000020:00000040:0.0:1788201273.332283:0:97051:0:(genops.c:868:class_export_get()) GET export ffff8dc1401c7000 refcount=8 00010000:00000040:0.0:1788201273.332320:0:97051:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969478, transno 4294969481, xid 1875060695467264 00000100:00000040:0.0:1788201273.332331:0:97051:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:0.0:1788201273.332338:0:97051:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:0.0:1788201273.332384:0:97051:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00010000:00080000:0.0:1788201273.332391:0:97051:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1788201273.332396:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 0 00000020:00000040:0.0:1788201273.332405:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 7 00010000:00080000:0.0:1788201273.332408:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969482 00010000:00080000:0.0:1788201273.332411:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969482 00000100:00000040:2.0:1788201273.335556:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff8dc004be6a00 x1875060695467776 msgsize 440 00000100:00100000:2.0:1788201273.335571:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201273.335694:0:25936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695467776 00000100:00100000:0.0:1788201273.335704:0:25936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695467776 00000020:00000040:0.0:1788201273.335708:0:25936:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:0.0:1788201273.335714:0:25936:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=8 00000100:00000040:0.0:1788201273.335739:0:25936:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788201273.335828:0:25936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1031 00000100:00000040:0.0:1788201273.335833:0:25936:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 1 00000100:00000040:0.0:1788201273.335852:0:25936:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc004be6a00 x1875060695467776/t0(4294969482) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201273.335866:0:25936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2399:x1875060695467776:12345-192.168.201.20@tcp:10:dd.0 00000020:00000040:0.0:1788201273.335878:0:25936:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc004be6a00 x1875060695467776/t0(4294969482) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788201273.335886:0:25936:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969482, current: 4294969482, replaying 00010000:00000040:0.0:1788201273.335889:0:25936:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 2 00000100:00000040:0.0:1788201273.335911:0:25936:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc004be6a00 x1875060695467776/t0(4294969482) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201273.335919:0:25936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2399:x1875060695467776:12345-192.168.201.20@tcp:10:dd.0 Request processed in 56us (364us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201273.335926:0:25936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1031 00000100:00000040:0.0:1788201273.335929:0:25936:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 1 00010000:00080000:1.0:1788201273.335984:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969482, next_transno: 4294969482 00010000:00080000:1.0:1788201273.335988:0:97051:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969482) 00010000:00080000:1.0:1788201273.335997:0:97051:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695467776 t4294969482 from 192.168.201.20@tcp req@ffff8dc004be6a00 x1875060695467776/t0(4294969482) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788201273.336012:0:97051:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc004be6a00 x1875060695467776/t0(4294969482) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1788201273.336068:0:97051:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x387:0x0] 00000001:00000040:1.0:1788201273.336250:0:97051:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8dc1401c7000 : new cb_count 4 00000020:00000040:1.0:1788201273.336254:0:97051:0:(genops.c:868:class_export_get()) GET export ffff8dc1401c7000 refcount=9 00010000:00000040:1.0:1788201273.336306:0:97051:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969478, transno 4294969482, xid 1875060695467776 00000100:00000040:1.0:1788201273.336319:0:97051:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:1.0:1788201273.336334:0:97051:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:1.0:1788201273.336380:0:97051:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00010000:00080000:1.0:1788201273.336390:0:97051:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788201273.336401:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 0 00000020:00000040:1.0:1788201273.336412:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 8 00010000:00080000:1.0:1788201273.336416:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969483 00010000:00080000:1.0:1788201273.336420:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969483 00000100:00000040:2.0:1788201273.338278:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff8dc004be4380 x1875060695468672 msgsize 440 00000100:00100000:2.0:1788201273.338293:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201273.338400:0:24873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695468672 00000100:00100000:3.0:1788201273.338409:0:24873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695468672 00000020:00000040:3.0:1788201273.338412:0:24873:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:3.0:1788201273.338416:0:24873:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=9 00000100:00000040:3.0:1788201273.338435:0:24873:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788201273.338478:0:24873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1032 00000100:00000040:3.0:1788201273.338482:0:24873:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 1 00000100:00000040:3.0:1788201273.338488:0:24873:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc004be4380 x1875060695468672/t0(4294969483) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201273.338501:0:24873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2399:x1875060695468672:12345-192.168.201.20@tcp:10:dd.0 00000020:00000040:3.0:1788201273.338511:0:24873:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc004be4380 x1875060695468672/t0(4294969483) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788201273.338518:0:24873:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969483, current: 4294969483, replaying 00010000:00000040:3.0:1788201273.338522:0:24873:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 2 00000100:00000040:3.0:1788201273.338541:0:24873:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc004be4380 x1875060695468672/t0(4294969483) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201273.338563:0:24873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2399:x1875060695468672:12345-192.168.201.20@tcp:10:dd.0 Request processed in 65us (286us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201273.338579:0:24873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1032 00000100:00000040:3.0:1788201273.338582:0:24873:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 1 00010000:00080000:2.0:1788201273.338742:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969483, next_transno: 4294969483 00010000:00080000:2.0:1788201273.338747:0:97051:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969483) 00010000:00080000:2.0:1788201273.338755:0:97051:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695468672 t4294969483 from 192.168.201.20@tcp req@ffff8dc004be4380 x1875060695468672/t0(4294969483) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788201273.338771:0:97051:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc004be4380 x1875060695468672/t0(4294969483) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1788201273.338799:0:97051:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x38a:0x0] 00000001:00000040:2.0:1788201273.338967:0:97051:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8dc1401c7000 : new cb_count 5 00000020:00000040:2.0:1788201273.338971:0:97051:0:(genops.c:868:class_export_get()) GET export ffff8dc1401c7000 refcount=10 00010000:00000040:2.0:1788201273.339012:0:97051:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969478, transno 4294969483, xid 1875060695468672 00000100:00000040:2.0:1788201273.339148:0:97051:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:2.0:1788201273.339154:0:97051:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:2.0:1788201273.339209:0:97051:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00010000:00080000:2.0:1788201273.339218:0:97051:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1788201273.339224:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 0 00000020:00000040:2.0:1788201273.339235:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 9 00010000:00080000:2.0:1788201273.339247:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969484 00010000:00080000:2.0:1788201273.339250:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969484 00000100:00000040:2.0:1788201273.342182:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff8dc13ab57480 x1875060695470208 msgsize 440 00000100:00100000:2.0:1788201273.342198:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201273.342313:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695470208 00000100:00100000:0.0:1788201273.342326:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695470208 00000020:00000040:0.0:1788201273.342328:0:8453:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:0.0:1788201273.342334:0:8453:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=10 00000100:00000040:0.0:1788201273.342366:0:8453:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788201273.342470:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1033 00000100:00000040:0.0:1788201273.342475:0:8453:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 1 00000100:00000040:0.0:1788201273.342484:0:8453:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc13ab57480 x1875060695470208/t0(4294969484) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201273.342497:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2399:x1875060695470208:12345-192.168.201.20@tcp:10:dd.0 00000020:00000040:0.0:1788201273.342508:0:8453:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc13ab57480 x1875060695470208/t0(4294969484) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788201273.342533:0:8453:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969484, current: 4294969484, replaying 00010000:00000040:0.0:1788201273.342537:0:8453:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 2 00000100:00000040:0.0:1788201273.342556:0:8453:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc13ab57480 x1875060695470208/t0(4294969484) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201273.342564:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2399:x1875060695470208:12345-192.168.201.20@tcp:10:dd.0 Request processed in 70us (383us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201273.342570:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1033 00000100:00000040:0.0:1788201273.342573:0:8453:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 1 00010000:00080000:2.0:1788201273.342614:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969484, next_transno: 4294969484 00010000:00080000:2.0:1788201273.342618:0:97051:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969484) 00010000:00080000:2.0:1788201273.342625:0:97051:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695470208 t4294969484 from 192.168.201.20@tcp req@ffff8dc13ab57480 x1875060695470208/t0(4294969484) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788201273.342641:0:97051:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc13ab57480 x1875060695470208/t0(4294969484) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1788201273.342671:0:97051:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x385:0x0] 00000001:00000040:2.0:1788201273.342884:0:97051:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8dc1401c7000 : new cb_count 6 00000020:00000040:2.0:1788201273.342888:0:97051:0:(genops.c:868:class_export_get()) GET export ffff8dc1401c7000 refcount=11 00010000:00000040:2.0:1788201273.342923:0:97051:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969478, transno 4294969484, xid 1875060695470208 00000100:00000040:2.0:1788201273.342932:0:97051:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:2.0:1788201273.342938:0:97051:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:2.0:1788201273.342994:0:97051:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00010000:00080000:2.0:1788201273.343002:0:97051:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1788201273.343008:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 0 00000020:00000040:2.0:1788201273.343053:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 10 00010000:00080000:2.0:1788201273.343058:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969485 00010000:00080000:2.0:1788201273.343062:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969485 00000100:00000040:1.0:1788201273.347631:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005abdc00 x1875060695471232 msgsize 440 00000100:00100000:1.0:1788201273.347648:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201273.347758:0:24875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695471232 00000100:00100000:2.0:1788201273.347768:0:24875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695471232 00000020:00000040:2.0:1788201273.347771:0:24875:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:2.0:1788201273.347776:0:24875:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=11 00000100:00000040:2.0:1788201273.347801:0:24875:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788201273.347886:0:24875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1034 00000100:00000040:2.0:1788201273.347904:0:24875:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 1 00000100:00000040:2.0:1788201273.347911:0:24875:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005abdc00 x1875060695471232/t0(4294969485) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201273.347927:0:24875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2399:x1875060695471232:12345-192.168.201.20@tcp:10:dd.0 00000020:00000040:2.0:1788201273.347939:0:24875:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc005abdc00 x1875060695471232/t0(4294969485) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788201273.347948:0:24875:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969485, current: 4294969485, replaying 00010000:00000040:2.0:1788201273.347952:0:24875:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 2 00000100:00000040:2.0:1788201273.348079:0:24875:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005abdc00 x1875060695471232/t0(4294969485) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201273.348090:0:24875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2399:x1875060695471232:12345-192.168.201.20@tcp:10:dd.0 Request processed in 166us (459us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201273.348096:0:24875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1034 00000100:00000040:2.0:1788201273.348099:0:24875:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 1 00010000:00080000:3.0:1788201273.348226:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969485, next_transno: 4294969485 00010000:00080000:3.0:1788201273.348341:0:97051:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969485) 00010000:00080000:3.0:1788201273.348351:0:97051:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695471232 t4294969485 from 192.168.201.20@tcp req@ffff8dc005abdc00 x1875060695471232/t0(4294969485) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788201273.348368:0:97051:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc005abdc00 x1875060695471232/t0(4294969485) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788201273.348398:0:97051:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x386:0x0] 00000001:00000040:3.0:1788201273.348567:0:97051:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8dc1401c7000 : new cb_count 7 00000020:00000040:3.0:1788201273.348571:0:97051:0:(genops.c:868:class_export_get()) GET export ffff8dc1401c7000 refcount=12 00010000:00000040:3.0:1788201273.348603:0:97051:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969478, transno 4294969485, xid 1875060695471232 00000100:00000040:3.0:1788201273.348612:0:97051:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:3.0:1788201273.348617:0:97051:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:3.0:1788201273.348715:0:97051:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00010000:00080000:3.0:1788201273.348725:0:97051:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788201273.348731:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 0 00000020:00000040:3.0:1788201273.348742:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 11 00010000:00080000:3.0:1788201273.348746:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969486 00010000:00080000:3.0:1788201273.348750:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969486 00000100:00000040:3.0:1788201273.350625:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff8dc11d29d180 x1875060695472000 msgsize 440 00000100:00100000:3.0:1788201273.350640:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201273.350729:0:25933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695472000 00000100:00100000:1.0:1788201273.350737:0:25933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695472000 00000020:00000040:1.0:1788201273.350740:0:25933:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:1.0:1788201273.350745:0:25933:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=12 00000100:00000040:1.0:1788201273.350766:0:25933:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788201273.350848:0:25933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1035 00000100:00000040:1.0:1788201273.350853:0:25933:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 1 00000100:00000040:1.0:1788201273.350860:0:25933:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc11d29d180 x1875060695472000/t0(4294969486) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201273.350873:0:25933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695472000:12345-192.168.201.20@tcp:10:dd.0 00000020:00000040:1.0:1788201273.350884:0:25933:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc11d29d180 x1875060695472000/t0(4294969486) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788201273.350892:0:25933:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969486, current: 4294969486, replaying 00010000:00000040:1.0:1788201273.350895:0:25933:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 2 00000100:00000040:1.0:1788201273.350916:0:25933:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29d180 x1875060695472000/t0(4294969486) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201273.350925:0:25933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695472000:12345-192.168.201.20@tcp:10:dd.0 Request processed in 54us (300us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201273.350948:0:25933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1035 00000100:00000040:1.0:1788201273.350952:0:25933:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 1 00010000:00080000:2.0:1788201273.351057:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969486, next_transno: 4294969486 00010000:00080000:2.0:1788201273.351062:0:97051:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969486) 00010000:00080000:2.0:1788201273.351071:0:97051:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695472000 t4294969486 from 192.168.201.20@tcp req@ffff8dc11d29d180 x1875060695472000/t0(4294969486) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788201273.351087:0:97051:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc11d29d180 x1875060695472000/t0(4294969486) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1788201273.351114:0:97051:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x394:0x0] 00000001:00000040:2.0:1788201273.351466:0:97051:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8dc1401c7000 : new cb_count 8 00000020:00000040:2.0:1788201273.351470:0:97051:0:(genops.c:868:class_export_get()) GET export ffff8dc1401c7000 refcount=13 00010000:00000040:2.0:1788201273.351503:0:97051:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969478, transno 4294969486, xid 1875060695472000 00000100:00000040:2.0:1788201273.351512:0:97051:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:2.0:1788201273.351524:0:97051:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:2.0:1788201273.351614:0:97051:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00010000:00080000:2.0:1788201273.351624:0:97051:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1788201273.351630:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 0 00000020:00000040:2.0:1788201273.351642:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 12 00010000:00080000:2.0:1788201273.351647:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969487 00010000:00080000:2.0:1788201273.351651:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969487 00000100:00000040:2.0:1788201273.354102:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff8dc13ab54e00 x1875060695474176 msgsize 440 00000100:00100000:2.0:1788201273.354116:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201273.354559:0:25502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695474176 00000100:00100000:0.0:1788201273.354574:0:25502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695474176 00000020:00000040:0.0:1788201273.354577:0:25502:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:0.0:1788201273.354583:0:25502:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=13 00000100:00000040:0.0:1788201273.354610:0:25502:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788201273.354877:0:25502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1036 00000100:00000040:0.0:1788201273.354880:0:25502:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 1 00000100:00000040:0.0:1788201273.354886:0:25502:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc13ab54e00 x1875060695474176/t0(4294969487) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201273.354896:0:25502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:2399:x1875060695474176:12345-192.168.201.20@tcp:10:dd.0 00000020:00000040:0.0:1788201273.354905:0:25502:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc13ab54e00 x1875060695474176/t0(4294969487) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788201273.354912:0:25502:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969487, current: 4294969487, replaying 00010000:00000040:0.0:1788201273.354915:0:25502:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 2 00000100:00000040:0.0:1788201273.354928:0:25502:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc13ab54e00 x1875060695474176/t0(4294969487) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201273.354934:0:25502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:2399:x1875060695474176:12345-192.168.201.20@tcp:10:dd.0 Request processed in 40us (833us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201273.354953:0:25502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1036 00000100:00000040:0.0:1788201273.354956:0:25502:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 1 00010000:00080000:2.0:1788201273.354991:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969487, next_transno: 4294969487 00010000:00080000:2.0:1788201273.354994:0:97051:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969487) 00010000:00080000:2.0:1788201273.355000:0:97051:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695474176 t4294969487 from 192.168.201.20@tcp req@ffff8dc13ab54e00 x1875060695474176/t0(4294969487) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788201273.355011:0:97051:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc13ab54e00 x1875060695474176/t0(4294969487) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1788201273.355061:0:97051:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x384:0x0] 00000001:00000040:2.0:1788201273.355192:0:97051:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8dc1401c7000 : new cb_count 9 00000020:00000040:2.0:1788201273.355194:0:97051:0:(genops.c:868:class_export_get()) GET export ffff8dc1401c7000 refcount=14 00010000:00000040:2.0:1788201273.355228:0:97051:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969478, transno 4294969487, xid 1875060695474176 00000100:00000040:2.0:1788201273.355247:0:97051:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:2.0:1788201273.355253:0:97051:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:2.0:1788201273.355308:0:97051:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00010000:00080000:2.0:1788201273.355317:0:97051:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1788201273.355323:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 0 00000020:00000040:2.0:1788201273.355333:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 13 00010000:00080000:2.0:1788201273.355337:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969488 00010000:00080000:2.0:1788201273.355340:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969488 00000100:00000040:1.0:1788201273.358827:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005abc000 x1875060695475072 msgsize 440 00000100:00100000:1.0:1788201273.358840:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201273.358883:0:24876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695475072 00000100:00100000:3.0:1788201273.358894:0:24876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695475072 00000020:00000040:3.0:1788201273.358909:0:24876:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:3.0:1788201273.358915:0:24876:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=14 00000100:00000040:3.0:1788201273.358942:0:24876:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788201273.358997:0:24876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1037 00000100:00000040:3.0:1788201273.359002:0:24876:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 1 00000100:00000040:3.0:1788201273.359012:0:24876:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005abc000 x1875060695475072/t0(4294969488) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201273.359043:0:24876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2399:x1875060695475072:12345-192.168.201.20@tcp:10:dd.0 00000020:00000040:3.0:1788201273.359056:0:24876:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc005abc000 x1875060695475072/t0(4294969488) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788201273.359066:0:24876:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969488, current: 4294969488, replaying 00010000:00000040:3.0:1788201273.359070:0:24876:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 2 00000100:00000040:3.0:1788201273.359085:0:24876:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005abc000 x1875060695475072/t0(4294969488) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201273.359096:0:24876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2399:x1875060695475072:12345-192.168.201.20@tcp:10:dd.0 Request processed in 55us (268us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201273.359102:0:24876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1037 00000100:00000040:3.0:1788201273.359106:0:24876:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 1 00010000:00080000:3.0:1788201273.359123:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969488, next_transno: 4294969488 00010000:00080000:3.0:1788201273.359127:0:97051:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969488) 00010000:00080000:3.0:1788201273.359134:0:97051:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695475072 t4294969488 from 192.168.201.20@tcp req@ffff8dc005abc000 x1875060695475072/t0(4294969488) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788201273.359149:0:97051:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc005abc000 x1875060695475072/t0(4294969488) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788201273.359175:0:97051:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x389:0x0] 00000001:00000040:3.0:1788201273.359432:0:97051:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8dc1401c7000 : new cb_count 10 00000020:00000040:3.0:1788201273.359437:0:97051:0:(genops.c:868:class_export_get()) GET export ffff8dc1401c7000 refcount=15 00010000:00000040:3.0:1788201273.359471:0:97051:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969478, transno 4294969488, xid 1875060695475072 00000100:00000040:3.0:1788201273.359482:0:97051:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:3.0:1788201273.359489:0:97051:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:3.0:1788201273.359533:0:97051:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00010000:00080000:3.0:1788201273.359541:0:97051:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788201273.359546:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 0 00000020:00000040:3.0:1788201273.359558:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 14 00010000:00080000:3.0:1788201273.359562:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969489 00010000:00080000:3.0:1788201273.359566:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969489 00000100:00000040:3.0:1788201273.361946:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff8dc11d29ce00 x1875060695476096 msgsize 440 00000100:00100000:3.0:1788201273.361958:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201273.362006:0:24874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695476096 00000100:00100000:2.0:1788201273.362053:0:24874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695476096 00000020:00000040:2.0:1788201273.362056:0:24874:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:2.0:1788201273.362061:0:24874:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=15 00000100:00000040:2.0:1788201273.362086:0:24874:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1788201273.362134:0:24874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1038 00000100:00000040:2.0:1788201273.362139:0:24874:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 1 00000100:00000040:2.0:1788201273.362146:0:24874:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc11d29ce00 x1875060695476096/t0(4294969489) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201273.362160:0:24874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:2399:x1875060695476096:12345-192.168.201.20@tcp:10:dd.0 00000020:00000040:2.0:1788201273.362171:0:24874:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc11d29ce00 x1875060695476096/t0(4294969489) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1788201273.362180:0:24874:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969489, current: 4294969489, replaying 00010000:00000040:2.0:1788201273.362184:0:24874:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 2 00000100:00000040:2.0:1788201273.362202:0:24874:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29ce00 x1875060695476096/t0(4294969489) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201273.362211:0:24874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:2399:x1875060695476096:12345-192.168.201.20@tcp:10:dd.0 Request processed in 54us (265us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201273.362218:0:24874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1038 00000100:00000040:2.0:1788201273.362221:0:24874:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 1 00010000:00080000:0.0:1788201273.362358:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969489, next_transno: 4294969489 00010000:00080000:0.0:1788201273.362363:0:97051:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969489) 00010000:00080000:0.0:1788201273.362370:0:97051:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695476096 t4294969489 from 192.168.201.20@tcp req@ffff8dc11d29ce00 x1875060695476096/t0(4294969489) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788201273.362383:0:97051:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc11d29ce00 x1875060695476096/t0(4294969489) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1788201273.362408:0:97051:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x38b:0x0] 00000001:00000040:0.0:1788201273.362554:0:97051:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8dc1401c7000 : new cb_count 11 00000020:00000040:0.0:1788201273.362557:0:97051:0:(genops.c:868:class_export_get()) GET export ffff8dc1401c7000 refcount=16 00010000:00000040:0.0:1788201273.362599:0:97051:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969478, transno 4294969489, xid 1875060695476096 00000100:00000040:0.0:1788201273.362608:0:97051:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:0.0:1788201273.362614:0:97051:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:0.0:1788201273.362662:0:97051:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00010000:00080000:0.0:1788201273.362670:0:97051:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1788201273.362675:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 0 00000020:00000040:0.0:1788201273.362684:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 15 00010000:00080000:0.0:1788201273.362688:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969490 00010000:00080000:0.0:1788201273.362692:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969490 00000100:00000040:3.0:1788201273.366797:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff8dc11d29d880 x1875060695476864 msgsize 440 00000100:00100000:3.0:1788201273.366815:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201273.367233:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695476864 00000100:00100000:1.0:1788201273.367244:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695476864 00000020:00000040:1.0:1788201273.367247:0:25729:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:1.0:1788201273.367253:0:25729:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=16 00000100:00000040:1.0:1788201273.367287:0:25729:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788201273.367343:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1039 00000100:00000040:1.0:1788201273.367348:0:25729:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 1 00000100:00000040:1.0:1788201273.367356:0:25729:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc11d29d880 x1875060695476864/t0(4294969490) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201273.367368:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:2399:x1875060695476864:12345-192.168.201.20@tcp:10:dd.0 00000020:00000040:1.0:1788201273.367380:0:25729:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc11d29d880 x1875060695476864/t0(4294969490) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788201273.367390:0:25729:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969490, current: 4294969490, replaying 00010000:00000040:1.0:1788201273.367393:0:25729:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 2 00000100:00000040:1.0:1788201273.367404:0:25729:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc11d29d880 x1875060695476864/t0(4294969490) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201273.367413:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:2399:x1875060695476864:12345-192.168.201.20@tcp:10:dd.0 Request processed in 46us (616us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201273.367419:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1039 00000100:00000040:1.0:1788201273.367422:0:25729:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 1 00010000:00080000:1.0:1788201273.367440:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969490, next_transno: 4294969490 00010000:00080000:1.0:1788201273.367449:0:97051:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969490) 00010000:00080000:1.0:1788201273.367456:0:97051:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695476864 t4294969490 from 192.168.201.20@tcp req@ffff8dc11d29d880 x1875060695476864/t0(4294969490) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788201273.367470:0:97051:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc11d29d880 x1875060695476864/t0(4294969490) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1788201273.367500:0:97051:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x38d:0x0] 00000001:00000040:1.0:1788201273.367706:0:97051:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8dc1401c7000 : new cb_count 12 00000020:00000040:1.0:1788201273.367710:0:97051:0:(genops.c:868:class_export_get()) GET export ffff8dc1401c7000 refcount=17 00010000:00000040:1.0:1788201273.367745:0:97051:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969478, transno 4294969490, xid 1875060695476864 00000100:00000040:1.0:1788201273.367756:0:97051:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:1.0:1788201273.367762:0:97051:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:1.0:1788201273.367811:0:97051:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00010000:00080000:1.0:1788201273.367819:0:97051:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788201273.367931:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 0 00000020:00000040:1.0:1788201273.367944:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 16 00010000:00080000:1.0:1788201273.367949:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969491 00010000:00080000:1.0:1788201273.367953:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969491 00000100:00000040:1.0:1788201273.372714:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005abea00 x1875060695478016 msgsize 440 00000100:00100000:1.0:1788201273.372730:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201273.372815:0:24857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695478016 00000100:00100000:3.0:1788201273.372826:0:24857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695478016 00000020:00000040:3.0:1788201273.372829:0:24857:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:3.0:1788201273.372833:0:24857:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=17 00000100:00000040:3.0:1788201273.372857:0:24857:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788201273.373674:0:24857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1040 00000100:00000040:3.0:1788201273.373679:0:24857:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 1 00000100:00000040:3.0:1788201273.373687:0:24857:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005abea00 x1875060695478016/t0(4294969491) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201273.373703:0:24857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+17:2399:x1875060695478016:12345-192.168.201.20@tcp:10:dd.0 00000020:00000040:3.0:1788201273.373715:0:24857:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc005abea00 x1875060695478016/t0(4294969491) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788201273.373724:0:24857:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969491, current: 4294969491, replaying 00010000:00000040:3.0:1788201273.373734:0:24857:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 2 00000100:00000040:3.0:1788201273.373750:0:24857:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005abea00 x1875060695478016/t0(4294969491) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201273.373756:0:24857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+17:2399:x1875060695478016:12345-192.168.201.20@tcp:10:dd.0 Request processed in 58us (1043us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201273.373761:0:24857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1040 00000100:00000040:3.0:1788201273.373763:0:24857:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 1 00010000:00080000:0.0:1788201273.373796:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969491, next_transno: 4294969491 00010000:00080000:0.0:1788201273.373800:0:97051:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969491) 00010000:00080000:0.0:1788201273.373806:0:97051:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695478016 t4294969491 from 192.168.201.20@tcp req@ffff8dc005abea00 x1875060695478016/t0(4294969491) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1788201273.373817:0:97051:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc005abea00 x1875060695478016/t0(4294969491) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1788201273.373846:0:97051:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x38c:0x0] 00000001:00000040:0.0:1788201273.373982:0:97051:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8dc1401c7000 : new cb_count 13 00000020:00000040:0.0:1788201273.373985:0:97051:0:(genops.c:868:class_export_get()) GET export ffff8dc1401c7000 refcount=18 00010000:00000040:0.0:1788201273.374042:0:97051:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969478, transno 4294969491, xid 1875060695478016 00000100:00000040:0.0:1788201273.374053:0:97051:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:0.0:1788201273.374060:0:97051:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:2.0:1788201273.374140:0:97051:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00010000:00080000:2.0:1788201273.374151:0:97051:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1788201273.374157:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 0 00000020:00000040:2.0:1788201273.374169:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 17 00010000:00080000:2.0:1788201273.374173:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969492 00010000:00080000:2.0:1788201273.374177:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969492 00000100:00000040:1.0:1788201273.377993:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005abdf80 x1875060695479424 msgsize 440 00000100:00100000:1.0:1788201273.378006:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201273.378204:0:25933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695479424 00000100:00100000:3.0:1788201273.378215:0:25933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695479424 00000020:00000040:3.0:1788201273.378217:0:25933:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:3.0:1788201273.378222:0:25933:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=18 00000100:00000040:3.0:1788201273.378254:0:25933:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788201273.378316:0:25933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1041 00000100:00000040:3.0:1788201273.378320:0:25933:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 1 00000100:00000040:3.0:1788201273.378329:0:25933:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005abdf80 x1875060695479424/t0(4294969492) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201273.378344:0:25933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+18:2399:x1875060695479424:12345-192.168.201.20@tcp:10:dd.0 00000020:00000040:3.0:1788201273.378356:0:25933:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc005abdf80 x1875060695479424/t0(4294969492) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788201273.378367:0:25933:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969492, current: 4294969492, replaying 00010000:00000040:3.0:1788201273.378371:0:25933:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 2 00000100:00000040:3.0:1788201273.378389:0:25933:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005abdf80 x1875060695479424/t0(4294969492) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201273.378398:0:25933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+18:2399:x1875060695479424:12345-192.168.201.20@tcp:10:dd.0 Request processed in 57us (406us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201273.378404:0:25933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1041 00000100:00000040:3.0:1788201273.378413:0:25933:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 1 00010000:00080000:2.0:1788201273.378578:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969492, next_transno: 4294969492 00010000:00080000:2.0:1788201273.378660:0:97051:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969492) 00010000:00080000:2.0:1788201273.378670:0:97051:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695479424 t4294969492 from 192.168.201.20@tcp req@ffff8dc005abdf80 x1875060695479424/t0(4294969492) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788201273.378687:0:97051:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc005abdf80 x1875060695479424/t0(4294969492) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1788201273.378721:0:97051:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x38e:0x0] 00000001:00000040:2.0:1788201273.378875:0:97051:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8dc1401c7000 : new cb_count 14 00000020:00000040:2.0:1788201273.378878:0:97051:0:(genops.c:868:class_export_get()) GET export ffff8dc1401c7000 refcount=19 00010000:00000040:2.0:1788201273.378905:0:97051:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969478, transno 4294969492, xid 1875060695479424 00000100:00000040:2.0:1788201273.378913:0:97051:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:2.0:1788201273.378917:0:97051:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:2.0:1788201273.378956:0:97051:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00010000:00080000:2.0:1788201273.378965:0:97051:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1788201273.378971:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 0 00000020:00000040:2.0:1788201273.378984:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 18 00010000:00080000:2.0:1788201273.378988:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969493 00010000:00080000:2.0:1788201273.378991:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969493 00000100:00000040:3.0:1788201273.385927:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff8dc133701880 x1875060695480704 msgsize 440 00000100:00100000:3.0:1788201273.385947:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201273.386096:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695480704 00000100:00100000:0.0:1788201273.386106:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695480704 00000020:00000040:0.0:1788201273.386109:0:8454:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:0.0:1788201273.386114:0:8454:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=19 00000100:00000040:0.0:1788201273.386136:0:8454:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788201273.386181:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1042 00000100:00000040:0.0:1788201273.386186:0:8454:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 1 00000100:00000040:0.0:1788201273.386194:0:8454:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc133701880 x1875060695480704/t0(4294969493) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201273.386207:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+19:2399:x1875060695480704:12345-192.168.201.20@tcp:10:dd.0 00000020:00000040:0.0:1788201273.386218:0:8454:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc133701880 x1875060695480704/t0(4294969493) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788201273.386227:0:8454:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969493, current: 4294969493, replaying 00010000:00000040:0.0:1788201273.386240:0:8454:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 2 00000100:00000040:0.0:1788201273.386255:0:8454:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc133701880 x1875060695480704/t0(4294969493) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201273.386275:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+19:2399:x1875060695480704:12345-192.168.201.20@tcp:10:dd.0 Request processed in 70us (349us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201273.386282:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1042 00000100:00000040:0.0:1788201273.386285:0:8454:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 1 00010000:00080000:3.0:1788201273.386457:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969493, next_transno: 4294969493 00010000:00080000:3.0:1788201273.386462:0:97051:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969493) 00010000:00080000:3.0:1788201273.386469:0:97051:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695480704 t4294969493 from 192.168.201.20@tcp req@ffff8dc133701880 x1875060695480704/t0(4294969493) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788201273.386484:0:97051:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc133701880 x1875060695480704/t0(4294969493) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788201273.386512:0:97051:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x38f:0x0] 00000001:00000040:3.0:1788201273.386706:0:97051:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8dc1401c7000 : new cb_count 15 00000020:00000040:3.0:1788201273.386711:0:97051:0:(genops.c:868:class_export_get()) GET export ffff8dc1401c7000 refcount=20 00010000:00000040:3.0:1788201273.386743:0:97051:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969478, transno 4294969493, xid 1875060695480704 00000100:00000040:3.0:1788201273.386752:0:97051:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:3.0:1788201273.386758:0:97051:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:3.0:1788201273.386804:0:97051:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00010000:00080000:3.0:1788201273.386812:0:97051:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788201273.386817:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 0 00000020:00000040:3.0:1788201273.386827:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 19 00010000:00080000:3.0:1788201273.386831:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969494 00010000:00080000:3.0:1788201273.386835:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969494 00000100:00000040:1.0:1788201273.388851:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005abd500 x1875060695481088 msgsize 440 00000100:00100000:1.0:1788201273.388864:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201273.396709:0:24876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695481088 00000100:00100000:3.0:1788201273.396725:0:24876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695481088 00000020:00000040:3.0:1788201273.396729:0:24876:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:3.0:1788201273.396734:0:24876:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=20 00000100:00000040:3.0:1788201273.396766:0:24876:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788201273.396819:0:24876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1043 00000100:00000040:3.0:1788201273.396825:0:24876:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 1 00000100:00000040:3.0:1788201273.396842:0:24876:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005abd500 x1875060695481088/t0(4294969494) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201273.396858:0:24876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:2399:x1875060695481088:12345-192.168.201.20@tcp:10:dd.0 00000020:00000040:3.0:1788201273.396869:0:24876:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc005abd500 x1875060695481088/t0(4294969494) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788201273.396878:0:24876:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969494, current: 4294969494, replaying 00010000:00000040:3.0:1788201273.396881:0:24876:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 2 00000100:00000040:3.0:1788201273.396895:0:24876:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005abd500 x1875060695481088/t0(4294969494) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201273.396903:0:24876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:2399:x1875060695481088:12345-192.168.201.20@tcp:10:dd.0 Request processed in 49us (8053us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201273.396911:0:24876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1043 00000100:00000040:3.0:1788201273.396914:0:24876:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 1 00010000:00080000:3.0:1788201273.396937:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969494, next_transno: 4294969494 00010000:00080000:3.0:1788201273.396941:0:97051:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969494) 00010000:00080000:3.0:1788201273.396949:0:97051:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695481088 t4294969494 from 192.168.201.20@tcp req@ffff8dc005abd500 x1875060695481088/t0(4294969494) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1788201273.396963:0:97051:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc005abd500 x1875060695481088/t0(4294969494) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1788201273.396992:0:97051:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x390:0x0] 00000001:00000040:3.0:1788201273.397449:0:97051:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8dc1401c7000 : new cb_count 16 00000020:00000040:3.0:1788201273.397455:0:97051:0:(genops.c:868:class_export_get()) GET export ffff8dc1401c7000 refcount=21 00010000:00000040:3.0:1788201273.397486:0:97051:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969478, transno 4294969494, xid 1875060695481088 00000100:00000040:3.0:1788201273.397498:0:97051:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:3.0:1788201273.397503:0:97051:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:3.0:1788201273.397601:0:97051:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00010000:00080000:3.0:1788201273.397611:0:97051:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1788201273.397617:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 0 00000020:00000040:3.0:1788201273.397628:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 20 00010000:00080000:3.0:1788201273.397632:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969495 00010000:00080000:3.0:1788201273.397636:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969495 00000100:00000040:1.0:1788201273.404499:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005abe300 x1875060695483520 msgsize 440 00000100:00100000:1.0:1788201273.404515:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201273.404767:0:25936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695483520 00000100:00100000:0.0:1788201273.404777:0:25936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695483520 00000020:00000040:0.0:1788201273.404780:0:25936:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:0.0:1788201273.404785:0:25936:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=21 00000100:00000040:0.0:1788201273.404810:0:25936:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1788201273.404887:0:25936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1044 00000100:00000040:0.0:1788201273.404892:0:25936:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 1 00000100:00000040:0.0:1788201273.404900:0:25936:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005abe300 x1875060695483520/t0(4294969495) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201273.404914:0:25936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+21:2399:x1875060695483520:12345-192.168.201.20@tcp:10:dd.0 00000020:00000040:0.0:1788201273.404926:0:25936:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc005abe300 x1875060695483520/t0(4294969495) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1788201273.404934:0:25936:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969495, current: 4294969495, replaying 00010000:00000040:0.0:1788201273.404938:0:25936:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 2 00000100:00000040:0.0:1788201273.404951:0:25936:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005abe300 x1875060695483520/t0(4294969495) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201273.404960:0:25936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+21:2399:x1875060695483520:12345-192.168.201.20@tcp:10:dd.0 Request processed in 49us (461us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201273.404967:0:25936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1044 00000100:00000040:0.0:1788201273.404970:0:25936:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 1 00010000:00080000:0.0:1788201273.405083:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969495, next_transno: 4294969495 00010000:00080000:0.0:1788201273.405088:0:97051:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969495) 00010000:00080000:0.0:1788201273.405096:0:97051:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695483520 t4294969495 from 192.168.201.20@tcp req@ffff8dc005abe300 x1875060695483520/t0(4294969495) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788201273.405180:0:97051:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc005abe300 x1875060695483520/t0(4294969495) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1788201273.405231:0:97051:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x391:0x0] 00000001:00000040:1.0:1788201273.405542:0:97051:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8dc1401c7000 : new cb_count 17 00000020:00000040:1.0:1788201273.405546:0:97051:0:(genops.c:868:class_export_get()) GET export ffff8dc1401c7000 refcount=22 00010000:00000040:1.0:1788201273.405765:0:97051:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969478, transno 4294969495, xid 1875060695483520 00000100:00000040:1.0:1788201273.405775:0:97051:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:1.0:1788201273.405780:0:97051:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:1.0:1788201273.405827:0:97051:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00010000:00080000:1.0:1788201273.405836:0:97051:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788201273.405842:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 0 00000020:00000040:1.0:1788201273.405852:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 21 00010000:00080000:1.0:1788201273.405856:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969496 00010000:00080000:1.0:1788201273.405859:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969496 00000100:00000040:0.0:1788201273.413189:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff8dc120091500 x1875060695483648 msgsize 440 00000100:00100000:0.0:1788201273.413206:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201273.414378:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695483648 00000100:00100000:1.0:1788201273.414388:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695483648 00000020:00000040:1.0:1788201273.414391:0:25729:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:1.0:1788201273.414396:0:25729:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=22 00000100:00000040:1.0:1788201273.414422:0:25729:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788201273.414464:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1045 00000100:00000040:1.0:1788201273.414469:0:25729:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 1 00000100:00000040:1.0:1788201273.414477:0:25729:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc120091500 x1875060695483648/t0(4294969496) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201273.414491:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:2399:x1875060695483648:12345-192.168.201.20@tcp:10:dd.0 00000020:00000040:1.0:1788201273.414501:0:25729:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc120091500 x1875060695483648/t0(4294969496) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788201273.414511:0:25729:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969496, current: 4294969496, replaying 00010000:00000040:1.0:1788201273.414514:0:25729:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 2 00000100:00000040:1.0:1788201273.414530:0:25729:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc120091500 x1875060695483648/t0(4294969496) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201273.414539:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:2399:x1875060695483648:12345-192.168.201.20@tcp:10:dd.0 Request processed in 51us (1351us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201273.414547:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1045 00000100:00000040:1.0:1788201273.414550:0:25729:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 1 00010000:00080000:1.0:1788201273.414580:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969496, next_transno: 4294969496 00010000:00080000:1.0:1788201273.414590:0:97051:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969496) 00010000:00080000:1.0:1788201273.414603:0:97051:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695483648 t4294969496 from 192.168.201.20@tcp req@ffff8dc120091500 x1875060695483648/t0(4294969496) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788201273.414618:0:97051:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc120091500 x1875060695483648/t0(4294969496) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1788201273.414647:0:97051:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x393:0x0] 00000001:00000040:1.0:1788201273.414810:0:97051:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8dc1401c7000 : new cb_count 18 00000020:00000040:1.0:1788201273.414814:0:97051:0:(genops.c:868:class_export_get()) GET export ffff8dc1401c7000 refcount=23 00010000:00000040:1.0:1788201273.414847:0:97051:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969478, transno 4294969496, xid 1875060695483648 00000100:00000040:1.0:1788201273.414858:0:97051:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:1.0:1788201273.414863:0:97051:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:1.0:1788201273.414906:0:97051:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00010000:00080000:1.0:1788201273.414915:0:97051:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788201273.414921:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 0 00000020:00000040:1.0:1788201273.414933:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 22 00010000:00080000:1.0:1788201273.414937:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969497 00010000:00080000:1.0:1788201273.414941:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969497 00000100:00000040:2.0:1788201273.425190:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff8dc13ab56d80 x1875060695483776 msgsize 440 00000100:00100000:2.0:1788201273.425205:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201273.425238:0:24875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695483776 00000100:00100000:1.0:1788201273.425373:0:24875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695483776 00000020:00000040:1.0:1788201273.425378:0:24875:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:1.0:1788201273.425390:0:24875:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=23 00000100:00000040:1.0:1788201273.425418:0:24875:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1788201273.425467:0:24875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1046 00000100:00000040:1.0:1788201273.425472:0:24875:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 1 00000100:00000040:1.0:1788201273.425480:0:24875:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc13ab56d80 x1875060695483776/t0(4294969497) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201273.425493:0:24875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+23:2399:x1875060695483776:12345-192.168.201.20@tcp:10:dd.0 00000020:00000040:1.0:1788201273.425503:0:24875:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc13ab56d80 x1875060695483776/t0(4294969497) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1788201273.425512:0:24875:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969497, current: 4294969497, replaying 00010000:00000040:1.0:1788201273.425515:0:24875:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 2 00000100:00000040:1.0:1788201273.425526:0:24875:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc13ab56d80 x1875060695483776/t0(4294969497) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201273.425534:0:24875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+23:2399:x1875060695483776:12345-192.168.201.20@tcp:10:dd.0 Request processed in 43us (345us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201273.425541:0:24875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1046 00000100:00000040:1.0:1788201273.425544:0:24875:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 1 00010000:00080000:1.0:1788201273.425558:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969497, next_transno: 4294969497 00010000:00080000:1.0:1788201273.425561:0:97051:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969497) 00010000:00080000:1.0:1788201273.425580:0:97051:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695483776 t4294969497 from 192.168.201.20@tcp req@ffff8dc13ab56d80 x1875060695483776/t0(4294969497) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1788201273.425764:0:97051:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc13ab56d80 x1875060695483776/t0(4294969497) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1788201273.425794:0:97051:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x392:0x0] 00000001:00000040:1.0:1788201273.425972:0:97051:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8dc1401c7000 : new cb_count 19 00000020:00000040:1.0:1788201273.425980:0:97051:0:(genops.c:868:class_export_get()) GET export ffff8dc1401c7000 refcount=24 00010000:00000040:1.0:1788201273.426041:0:97051:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969478, transno 4294969497, xid 1875060695483776 00000100:00000040:1.0:1788201273.426051:0:97051:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:1.0:1788201273.426057:0:97051:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:1.0:1788201273.426096:0:97051:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00010000:00080000:1.0:1788201273.426105:0:97051:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1788201273.426111:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 0 00000020:00000040:1.0:1788201273.426124:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 23 00010000:00080000:1.0:1788201273.426128:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969498 00010000:00080000:1.0:1788201273.426131:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969498 00000100:00000040:2.0:1788201273.435148:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff8dc140d90700 x1875060695485056 msgsize 440 00000100:00100000:2.0:1788201273.435162:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201273.435200:0:25933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695485056 00000100:00100000:3.0:1788201273.435210:0:25933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695485056 00000020:00000040:3.0:1788201273.435213:0:25933:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:3.0:1788201273.435219:0:25933:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=24 00000100:00000040:3.0:1788201273.435244:0:25933:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1788201273.435409:0:25933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1047 00000100:00000040:3.0:1788201273.435414:0:25933:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 1 00000100:00000040:3.0:1788201273.435423:0:25933:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc140d90700 x1875060695485056/t0(4294969498) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201273.435438:0:25933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+24:2399:x1875060695485056:12345-192.168.201.20@tcp:10:dd.0 00000020:00000040:3.0:1788201273.435451:0:25933:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc140d90700 x1875060695485056/t0(4294969498) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1788201273.435462:0:25933:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 4294969498, current: 4294969498, replaying 00010000:00000040:3.0:1788201273.435466:0:25933:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 2 00000100:00000040:3.0:1788201273.435486:0:25933:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc140d90700 x1875060695485056/t0(4294969498) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201273.435494:0:25933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+24:2399:x1875060695485056:12345-192.168.201.20@tcp:10:dd.0 Request processed in 59us (347us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201273.435502:0:25933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1047 00000100:00000040:3.0:1788201273.435505:0:25933:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 1 00010000:00080000:2.0:1788201273.436110:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969498, next_transno: 4294969498 00010000:00080000:2.0:1788201273.436115:0:97051:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (4294969498) 00010000:00080000:2.0:1788201273.436122:0:97051:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695485056 t4294969498 from 192.168.201.20@tcp req@ffff8dc140d90700 x1875060695485056/t0(4294969498) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1788201273.436134:0:97051:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc140d90700 x1875060695485056/t0(4294969498) o10->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 440/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1788201273.436167:0:97051:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x395:0x0] 00000001:00000040:2.0:1788201273.436333:0:97051:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff8dc1401c7000 : new cb_count 20 00000020:00000040:2.0:1788201273.436337:0:97051:0:(genops.c:868:class_export_get()) GET export ffff8dc1401c7000 refcount=25 00010000:00000040:2.0:1788201273.436371:0:97051:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969478, transno 4294969498, xid 1875060695485056 00000100:00000040:2.0:1788201273.436379:0:97051:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:2.0:1788201273.436383:0:97051:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:2.0:1788201273.436423:0:97051:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00010000:00080000:2.0:1788201273.436433:0:97051:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1788201273.436439:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 0 00000020:00000040:2.0:1788201273.436451:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 24 00010000:00080000:2.0:1788201273.436455:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969499 00010000:00080000:2.0:1788201273.436458:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969499 00000100:00000040:0.0:1788201273.440751:0:3648:0:(events.c:337:request_in_callback()) incoming req@ffff8dc120093100 x1875060695489152 msgsize 328 00000100:00100000:0.0:1788201273.440770:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201273.440842:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695489152 00000100:00100000:2.0:1788201273.440851:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695489152 00000020:00000040:2.0:1788201273.440855:0:26212:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:2.0:1788201273.440860:0:26212:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=25 00000100:00100000:2.0:1788201273.440921:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5992 00000100:00000040:2.0:1788201273.440927:0:26212:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 1 00000100:00000040:2.0:1788201273.440935:0:26212:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc120093100 x1875060695489152/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201273.440950:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6e293f14-c501-4bc5-9dd4-a18ef02756b4+25:2399:x1875060695489152:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1788201273.440963:0:26212:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc120093100 x1875060695489152/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1788201273.440972:0:26212:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 2 00010000:00080000:2.0:1788201273.440977:0:26212:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc120093100 x1875060695489152/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201273.441041:0:26212:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc120093100 x1875060695489152/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201273.441052:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6e293f14-c501-4bc5-9dd4-a18ef02756b4+25:2399:x1875060695489152:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 104us (301us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201273.441059:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5992 00000100:00000040:2.0:1788201273.441062:0:26212:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 1 00010000:00080000:0.0:1788201273.441217:0:97051:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 4294969499 00010000:00080000:0.0:1788201273.441222:0:97051:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00010000:00000040:0.0:1788201273.441238:0:97051:0:(ldlm_lib.c:2907:target_recovery_thread()) 2: lock replay stage - 1 clients 00010000:00080000:0.0:1788201273.441240:0:97051:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788201273.441243:0:97051:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788201273.441249:0:97051:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc120093100 x1875060695489152/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1788201273.441267:0:97051:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00000100:00000040:2.0:1788201273.443209:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff8dc13a480a80 x1875060695489280 msgsize 328 00000100:00100000:2.0:1788201273.443225:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00000040:2.0:1788201273.443268:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff8dc13a481c00 x1875060695489408 msgsize 328 00000100:00100000:2.0:1788201273.443273:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00000040:2.0:1788201273.443295:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff8dc13a482300 x1875060695489536 msgsize 328 00000100:00100000:2.0:1788201273.443300:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00000040:2.0:1788201273.443316:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff8dc13a482a00 x1875060695489664 msgsize 328 00000100:00100000:2.0:1788201273.443320:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00000040:2.0:1788201273.443337:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff8dc13a483b80 x1875060695489792 msgsize 328 00000100:00100000:2.0:1788201273.443341:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00000040:2.0:1788201273.443357:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff8dc13a481500 x1875060695489920 msgsize 328 00000100:00100000:2.0:1788201273.443362:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00000040:2.0:1788201273.443388:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff8dc13a480380 x1875060695490048 msgsize 328 00000100:00100000:2.0:1788201273.443393:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201273.443417:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695489280 00000100:00100000:2.0:1788201273.443426:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695489280 00000020:00000040:2.0:1788201273.443429:0:26204:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:2.0:1788201273.443433:0:26204:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=26 00000100:00100000:2.0:1788201273.443473:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695489408 00000100:00100000:2.0:1788201273.443476:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695489408 00000020:00000040:2.0:1788201273.443477:0:26204:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:2.0:1788201273.443491:0:26204:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=27 00000100:00100000:2.0:1788201273.443513:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695489536 00000100:00100000:2.0:1788201273.443516:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695489536 00000020:00000040:2.0:1788201273.443518:0:26204:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:2.0:1788201273.443519:0:26204:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=28 00000100:00100000:2.0:1788201273.443534:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695489664 00000100:00100000:2.0:1788201273.443537:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695489664 00000020:00000040:2.0:1788201273.443538:0:26204:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:2.0:1788201273.443539:0:26204:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=29 00000100:00100000:2.0:1788201273.443554:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695489792 00000100:00100000:2.0:1788201273.443556:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695489792 00000020:00000040:2.0:1788201273.443558:0:26204:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:2.0:1788201273.443560:0:26204:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=30 00000100:00100000:2.0:1788201273.443574:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695489920 00000100:00100000:2.0:1788201273.443577:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695489920 00000020:00000040:2.0:1788201273.443578:0:26204:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:2.0:1788201273.443580:0:26204:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=31 00000100:00100000:2.0:1788201273.443596:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695490048 00000100:00100000:2.0:1788201273.443599:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695490048 00000020:00000040:2.0:1788201273.443600:0:26204:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d4d9 00000020:00000040:2.0:1788201273.443602:0:26204:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c7000 refcount=32 00000100:00100000:2.0:1788201273.443622:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5993 00000100:00000040:2.0:1788201273.443627:0:26204:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 2 00000100:00000040:2.0:1788201273.443633:0:26204:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc13a480a80 x1875060695489280/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201273.443646:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+32:2399:x1875060695489280:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1788201273.443657:0:26204:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc13a480a80 x1875060695489280/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1788201273.443666:0:26204:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 3 00010000:00080000:2.0:1788201273.443670:0:26204:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc13a480a80 x1875060695489280/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201273.443686:0:26204:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc13a480a80 x1875060695489280/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201273.443694:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+32:2399:x1875060695489280:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 50us (486us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201273.443701:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5993 00000100:00000040:2.0:1788201273.443703:0:26204:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 2 00000100:00100000:2.0:1788201273.443714:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5994 00000100:00000040:2.0:1788201273.443717:0:26204:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 3 00000100:00000040:2.0:1788201273.443721:0:26204:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc13a481c00 x1875060695489408/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201273.443731:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+32:2399:x1875060695489408:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1788201273.443738:0:26204:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc13a481c00 x1875060695489408/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1788201273.443745:0:26204:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 4 00010000:00080000:2.0:1788201273.443748:0:26204:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc13a481c00 x1875060695489408/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201273.443757:0:26204:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc13a481c00 x1875060695489408/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201273.443764:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+32:2399:x1875060695489408:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 36us (495us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201273.443768:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5994 00000100:00000040:2.0:1788201273.443770:0:26204:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 3 00000100:00100000:2.0:1788201273.443781:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5995 00000100:00000040:2.0:1788201273.443783:0:26204:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 4 00000100:00000040:2.0:1788201273.443785:0:26204:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc13a482300 x1875060695489536/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201273.443791:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+32:2399:x1875060695489536:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1788201273.443795:0:26204:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc13a482300 x1875060695489536/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1788201273.443800:0:26204:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 5 00010000:00080000:2.0:1788201273.443802:0:26204:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc13a482300 x1875060695489536/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201273.443807:0:26204:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc13a482300 x1875060695489536/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201273.443811:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+32:2399:x1875060695489536:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 20us (515us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201273.443814:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5995 00000100:00000040:2.0:1788201273.443815:0:26204:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 4 00000100:00100000:2.0:1788201273.443818:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5996 00000100:00000040:2.0:1788201273.443819:0:26204:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 5 00000100:00000040:2.0:1788201273.443821:0:26204:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc13a482a00 x1875060695489664/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201273.443826:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+32:2399:x1875060695489664:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1788201273.443829:0:26204:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc13a482a00 x1875060695489664/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1788201273.443839:0:26204:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 6 00010000:00080000:2.0:1788201273.443842:0:26204:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc13a482a00 x1875060695489664/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201273.443846:0:26204:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc13a482a00 x1875060695489664/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201273.443851:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+32:2399:x1875060695489664:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 25us (534us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201273.443854:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5996 00000100:00000040:2.0:1788201273.443855:0:26204:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 5 00000100:00100000:2.0:1788201273.443859:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5997 00000100:00000040:2.0:1788201273.443860:0:26204:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 6 00000100:00000040:2.0:1788201273.443862:0:26204:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc13a483b80 x1875060695489792/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201273.443867:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+32:2399:x1875060695489792:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1788201273.443870:0:26204:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc13a483b80 x1875060695489792/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1788201273.443873:0:26204:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 7 00010000:00080000:2.0:1788201273.443875:0:26204:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc13a483b80 x1875060695489792/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201273.443880:0:26204:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc13a483b80 x1875060695489792/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201273.443884:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+32:2399:x1875060695489792:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 18us (547us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201273.443891:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5997 00000100:00000040:2.0:1788201273.443892:0:26204:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 6 00000100:00100000:2.0:1788201273.443896:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5998 00000100:00000040:2.0:1788201273.443898:0:26204:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 7 00000100:00000040:2.0:1788201273.443900:0:26204:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc13a481500 x1875060695489920/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201273.443905:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+32:2399:x1875060695489920:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1788201273.443908:0:26204:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc13a481500 x1875060695489920/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1788201273.443912:0:26204:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 8 00010000:00080000:2.0:1788201273.443914:0:26204:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc13a481500 x1875060695489920/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201273.443919:0:26204:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc13a481500 x1875060695489920/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201273.443923:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+32:2399:x1875060695489920:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 19us (564us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201273.443926:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5998 00000100:00000040:2.0:1788201273.443927:0:26204:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 7 00000100:00100000:2.0:1788201273.443930:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5999 00000100:00000040:2.0:1788201273.443931:0:26204:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 8 00000100:00000040:2.0:1788201273.443933:0:26204:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc13a480380 x1875060695490048/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201273.443938:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+32:2399:x1875060695490048:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1788201273.443944:0:26204:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff8dc13a480380 x1875060695490048/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1788201273.443948:0:26204:0:(ldlm_lib.c:1800:target_request_copy_get()) RPC GETting export ffff8dc1401c7000 : new rpc_count 9 00010000:00080000:2.0:1788201273.443950:0:26204:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc13a480380 x1875060695490048/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201273.443954:0:26204:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc13a480380 x1875060695490048/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201273.443959:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+32:2399:x1875060695490048:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 21us (569us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201273.443961:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5999 00000100:00000040:2.0:1788201273.443962:0:26204:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 8 00010000:00000040:0.0:1788201273.447846:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 7 00000020:00000040:0.0:1788201273.447869:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 31 00010000:00080000:0.0:1788201273.447874:0:97051:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788201273.447878:0:97051:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788201273.447891:0:97051:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc13a480a80 x1875060695489280/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1788201273.447902:0:97051:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:0.0:1788201273.447904:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 6 00000020:00000040:0.0:1788201273.447910:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 30 00010000:00080000:0.0:1788201273.447911:0:97051:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788201273.447913:0:97051:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788201273.447918:0:97051:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc13a481c00 x1875060695489408/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1788201273.447924:0:97051:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:0.0:1788201273.447926:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 5 00000020:00000040:0.0:1788201273.447931:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 29 00010000:00080000:0.0:1788201273.447933:0:97051:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788201273.447934:0:97051:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788201273.447938:0:97051:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc13a482300 x1875060695489536/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1788201273.447956:0:97051:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:0.0:1788201273.447959:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 4 00000020:00000040:0.0:1788201273.447965:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 28 00010000:00080000:0.0:1788201273.447967:0:97051:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788201273.447968:0:97051:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788201273.447974:0:97051:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc13a482a00 x1875060695489664/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1788201273.447981:0:97051:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:0.0:1788201273.447983:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 3 00000020:00000040:0.0:1788201273.447987:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 27 00010000:00080000:0.0:1788201273.447989:0:97051:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788201273.447990:0:97051:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788201273.447995:0:97051:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc13a483b80 x1875060695489792/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1788201273.448002:0:97051:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:0.0:1788201273.448004:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 2 00000020:00000040:0.0:1788201273.448008:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 26 00010000:00080000:0.0:1788201273.448010:0:97051:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788201273.448011:0:97051:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788201273.449083:0:97051:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc13a481500 x1875060695489920/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1788201273.449093:0:97051:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:0.0:1788201273.449095:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 1 00000020:00000040:0.0:1788201273.449104:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 25 00010000:00080000:0.0:1788201273.449106:0:97051:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788201273.449119:0:97051:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788201273.449125:0:97051:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc13a480380 x1875060695490048/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1788201273.449143:0:97051:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:0.0:1788201273.449145:0:97051:0:(ldlm_lib.c:1816:target_request_copy_put()) RPC PUTting export ffff8dc1401c7000 : new rpc_count 0 00000020:00000040:0.0:1788201273.449151:0:97051:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 24 00010000:00080000:0.0:1788201273.449152:0:97051:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00000100:00000040:2.0:1788201273.558660:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff8dc007115450 x1875060695490176 msgsize 328 00000100:00100000:2.0:1788201273.558676:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00000040:2.0:1788201273.558678:0:3650:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:1.0:1788201273.558745:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695490176 00000100:00100000:1.0:1788201273.558754:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695490176 00000020:00000040:1.0:1788201273.558756:0:94467:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4cc 00000020:00000040:1.0:1788201273.558761:0:94467:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc13aa9c000 refcount=9 00000100:00000040:1.0:1788201273.558782:0:94467:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788201273.558809:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 215 00000100:00000040:1.0:1788201273.558813:0:94467:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc13aa9c000 : new rpc_count 1 00000100:00000040:1.0:1788201273.558819:0:94467:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc007115450 x1875060695490176/t0(0) o101->93ba7067-43b5-4e46-8db7-27c040fa03d9@192.168.201.20@tcp:394/0 lens 328/0 e 0 to 0 dl 1788201284 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.558827:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695490176:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201273.558840:0:94467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:1.0:1788201273.558850:0:94467:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff8dc103b47100 count: 3 00000020:00000040:1.0:1788201273.558855:0:94467:0:(lustre_handles.c:93:class_handle_hash()) added object ffff8dc1064ec200 with handle 0x96d0c9b8c9a1d549 to hash 00010000:00010000:1.0:1788201273.558858:0:94467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1d549 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c9a expref: -99 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788201273.558865:0:94467:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff8dc13aa9c000 : new locks_count 4 00000020:00000040:1.0:1788201273.558867:0:94467:0:(genops.c:868:class_export_get()) GET export ffff8dc13aa9c000 refcount=10 00010000:00000040:1.0:1788201273.558889:0:94467:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff8dc103b47100) refcount = 3 00010000:00000040:1.0:1788201273.558891:0:94467:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1788201273.558895:0:94467:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc006dbd200/0x96d0c9b8c9a1d542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d53b expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1788201273.558900:0:94467:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1d534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d52d expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201273.558905:0:94467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1d549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c9a expref: 10 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201273.558912:0:94467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1d549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c9a expref: 10 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201273.558919:0:94467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ec200, rc 0) 00010000:00000040:1.0:1788201273.558921:0:94467:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060695490176 00000100:00000040:1.0:1788201273.558931:0:94467:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:1.0:1788201273.558935:0:94467:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:1.0:1788201273.558977:0:94467:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00000100:00000040:1.0:1788201273.558981:0:94467:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc007115450 x1875060695490176/t0(0) o101->93ba7067-43b5-4e46-8db7-27c040fa03d9@192.168.201.20@tcp:394/0 lens 328/344 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.558988:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695490176:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 161us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201273.558992:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 215 00000100:00000040:1.0:1788201273.558994:0:94467:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc13aa9c000 : new rpc_count 0 00000020:00000040:1.0:1788201273.559005:0:94467:0:(genops.c:879:class_export_put()) PUTting export ffff8dc13aa9c000 : new refcount 9 00000100:00000040:2.0:1788201273.565223:0:3649:0:(events.c:337:request_in_callback()) incoming req@ffff8dc007117450 x1875060695490304 msgsize 304 00000100:00100000:2.0:1788201273.565247:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00000040:2.0:1788201273.565250:0:3649:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:1.0:1788201273.567962:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695490304 00000100:00100000:1.0:1788201273.567977:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695490304 00000020:00000040:1.0:1788201273.567979:0:94461:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4cc 00000020:00000040:1.0:1788201273.567984:0:94461:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc13aa9c000 refcount=10 00000100:00000040:1.0:1788201273.568037:0:94461:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788201273.568086:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 216 00000100:00000040:1.0:1788201273.568091:0:94461:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc13aa9c000 : new rpc_count 1 00000100:00000040:1.0:1788201273.568099:0:94461:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc007117450 x1875060695490304/t0(0) o256->93ba7067-43b5-4e46-8db7-27c040fa03d9@192.168.201.20@tcp:394/0 lens 304/0 e 0 to 0 dl 1788201284 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201273.568113:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695490304:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788201273.568140:0:94461:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:00000040:1.0:1788201273.568151:0:94461:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:1.0:1788201273.568157:0:94461:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788201273.568158:0:94461:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 128 00000020:00000040:1.0:1788201273.568165:0:94461:0:(genops.c:868:class_export_get()) GET export ffff8dc13aa9c000 refcount=11 00000020:00000040:3.0:1788201273.573111:0:94461:0:(genops.c:879:class_export_put()) PUTting export ffff8dc13aa9c000 : new refcount 10 00010000:00000040:3.0:1788201273.573148:0:94461:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060695490304 00000100:00000040:3.0:1788201273.573163:0:94461:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:3.0:1788201273.573170:0:94461:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:3.0:1788201273.573213:0:94461:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00000100:00000040:3.0:1788201273.573222:0:94461:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc007117450 x1875060695490304/t0(0) o256->93ba7067-43b5-4e46-8db7-27c040fa03d9@192.168.201.20@tcp:394/0 lens 304/240 e 0 to 0 dl 1788201284 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201273.573250:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695490304:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 Request processed in 5133us (8020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201273.573267:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 216 00000100:00000040:3.0:1788201273.573271:0:94461:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc13aa9c000 : new rpc_count 0 00000020:00000040:3.0:1788201273.573285:0:94461:0:(genops.c:879:class_export_put()) PUTting export ffff8dc13aa9c000 : new refcount 9 40000000:00000040:1.0:1788201273.659979:0:97150:0:(lproc_fid.c:547:ldebugfs_client_fid_width_seq_write()) cli-lustre-OST0000-super: Sequence size: 65536 00010000:00010000:1.0:1788201274.127680:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:0.0:1788201274.496981:0:97199:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001-osd (ffff8dc12563b370) now 10 - health_check_show 00000020:00000040:0.0:1788201274.496996:0:97199:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001-osd (ffff8dc12563b370) now 10 - health_check_show 00000020:00000040:0.0:1788201274.497616:0:97199:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000-osd (ffff8dc0040419b8) now 12 - health_check_show 00000020:00000040:0.0:1788201274.497620:0:97199:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000-osd (ffff8dc0040419b8) now 12 - health_check_show 00000020:00000040:0.0:1788201274.497622:0:97199:0:(obd_config.c:995:class_incref()) incref MGC192.168.201.120@tcp (ffff8dc12563cd28) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497625:0:97199:0:(obd_config.c:1023:class_decref()) Decref MGC192.168.201.120@tcp (ffff8dc12563cd28) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497627:0:97199:0:(obd_config.c:995:class_incref()) incref MGS (ffff8dc1060e3370) now 8 - health_check_show 00000020:00000040:0.0:1788201274.497632:0:97199:0:(obd_config.c:1023:class_decref()) Decref MGS (ffff8dc1060e3370) now 8 - health_check_show 00000020:00000040:0.0:1788201274.497635:0:97199:0:(obd_config.c:995:class_incref()) incref MDS (ffff8dc13f873370) now 4 - health_check_show 00000020:00000040:0.0:1788201274.497645:0:97199:0:(obd_config.c:1023:class_decref()) Decref MDS (ffff8dc13f873370) now 4 - health_check_show 00000020:00000040:0.0:1788201274.497648:0:97199:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001-mdtlov (ffff8dc1060e19b8) now 5 - health_check_show 00000020:00000040:0.0:1788201274.497651:0:97199:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001-mdtlov (ffff8dc1060e19b8) now 5 - health_check_show 00000020:00000040:0.0:1788201274.497653:0:97199:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff8dc1060e4d28) now 12 - health_check_show 00000020:00000040:0.0:1788201274.497655:0:97199:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001 (ffff8dc1060e4d28) now 12 - health_check_show 00000020:00000040:0.0:1788201274.497658:0:97199:0:(obd_config.c:995:class_incref()) incref lustre-MDD0001 (ffff8dc1060e0000) now 5 - health_check_show 00000020:00000040:0.0:1788201274.497660:0:97199:0:(obd_config.c:1023:class_decref()) Decref lustre-MDD0001 (ffff8dc1060e0000) now 5 - health_check_show 00000020:00000040:0.0:1788201274.497662:0:97199:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000-osp-MDT0001 (ffff8dc12ef64d28) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497664:0:97199:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000-osp-MDT0001 (ffff8dc12ef64d28) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497667:0:97199:0:(obd_config.c:995:class_incref()) incref lustre-OST0000-osc-MDT0001 (ffff8dc0027d4d28) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497669:0:97199:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0000-osc-MDT0001 (ffff8dc0027d4d28) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497671:0:97199:0:(obd_config.c:995:class_incref()) incref lustre-OST0001-osc-MDT0001 (ffff8dc004043370) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497673:0:97199:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001-osc-MDT0001 (ffff8dc004043370) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497675:0:97199:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000-lwp-MDT0001 (ffff8dc0027d3370) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497688:0:97199:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000-lwp-MDT0001 (ffff8dc0027d3370) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497690:0:97199:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000-mdtlov (ffff8dc13f874d28) now 5 - health_check_show 00000020:00000040:0.0:1788201274.497693:0:97199:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000-mdtlov (ffff8dc13f874d28) now 5 - health_check_show 00000020:00000040:0.0:1788201274.497695:0:97199:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff8dc13f870000) now 16 - health_check_show 00000020:00000040:0.0:1788201274.497697:0:97199:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (ffff8dc13f870000) now 16 - health_check_show 00000020:00000040:0.0:1788201274.497699:0:97199:0:(obd_config.c:995:class_incref()) incref lustre-MDD0000 (ffff8dc13f8719b8) now 5 - health_check_show 00000020:00000040:0.0:1788201274.497702:0:97199:0:(obd_config.c:1023:class_decref()) Decref lustre-MDD0000 (ffff8dc13f8719b8) now 5 - health_check_show 00000020:00000040:0.0:1788201274.497704:0:97199:0:(obd_config.c:995:class_incref()) incref lustre-QMT0000 (ffff8dc004044d28) now 5 - health_check_show 00000020:00000040:0.0:1788201274.497706:0:97199:0:(obd_config.c:1023:class_decref()) Decref lustre-QMT0000 (ffff8dc004044d28) now 5 - health_check_show 00000020:00000040:0.0:1788201274.497709:0:97199:0:(obd_config.c:995:class_incref()) incref lustre-OST0000-osd (ffff8dc12f0c4d28) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497712:0:97199:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0000-osd (ffff8dc12f0c4d28) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497714:0:97199:0:(obd_config.c:995:class_incref()) incref OSS (ffff8dc12f0c3370) now 4 - health_check_show 00000020:00000040:0.0:1788201274.497720:0:97199:0:(obd_config.c:1023:class_decref()) Decref OSS (ffff8dc12f0c3370) now 4 - health_check_show 00000020:00000040:0.0:1788201274.497722:0:97199:0:(obd_config.c:995:class_incref()) incref lustre-OST0000 (ffff8dc004fd4d28) now 10 - health_check_show 00000020:00000040:0.0:1788201274.497800:0:97199:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0000 (ffff8dc004fd4d28) now 10 - health_check_show 00000020:00000040:0.0:1788201274.497803:0:97199:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff8dc12f30b370) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497805:0:97199:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000-lwp-OST0000 (ffff8dc12f30b370) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497808:0:97199:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff8dc12ef60000) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497810:0:97199:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001-lwp-OST0000 (ffff8dc12ef60000) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497812:0:97199:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001-osp-MDT0000 (ffff8dc004040000) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497814:0:97199:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001-osp-MDT0000 (ffff8dc004040000) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497816:0:97199:0:(obd_config.c:995:class_incref()) incref lustre-OST0000-osc-MDT0000 (ffff8dc12f0c0000) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497818:0:97199:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0000-osc-MDT0000 (ffff8dc12f0c0000) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497820:0:97199:0:(obd_config.c:995:class_incref()) incref lustre-OST0001-osd (ffff8dc0027d19b8) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497824:0:97199:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001-osd (ffff8dc0027d19b8) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497827:0:97199:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff8dc139bbcd28) now 10 - health_check_show 00000020:00000040:0.0:1788201274.497852:0:97199:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff8dc139bbcd28) now 10 - health_check_show 00000020:00000040:0.0:1788201274.497860:0:97199:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000-lwp-OST0001 (ffff8dc002643370) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497862:0:97199:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000-lwp-OST0001 (ffff8dc002643370) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497864:0:97199:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001-lwp-OST0001 (ffff8dc0026419b8) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497866:0:97199:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001-lwp-OST0001 (ffff8dc0026419b8) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497868:0:97199:0:(obd_config.c:995:class_incref()) incref lustre-OST0001-osc-MDT0000 (ffff8dc12ef63370) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497870:0:97199:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001-osc-MDT0000 (ffff8dc12ef63370) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497872:0:97199:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000-lwp-MDT0000 (ffff8dc12f0c19b8) now 6 - health_check_show 00000020:00000040:0.0:1788201274.497875:0:97199:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000-lwp-MDT0000 (ffff8dc12f0c19b8) now 6 - health_check_show 00010000:00010000:3.0:1788201275.152448:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:3.0:1788201275.727347:0:75750:0:(genops.c:1210:class_import_get()) import ffff8dc1031f8800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:3.0:1788201275.727387:0:75750:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007931264f] to pc [ptlrpcd_00_00+0] req@ffff8dc133703800 x1875060715300608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201275.727466:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc133703800 x1875060715300608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201275.727480:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715300608:0@lo:13:osp-pre-1-1.0 00000100:00000040:1.0:1788201275.727509:0:3655:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc133703800 x1875060715300608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201291 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201275.727517:0:3655:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201275.727556:0:3655:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005abce00 x1875060715300608 msgsize 224 00000100:00100000:1.0:1788201275.727560:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788201275.727589:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc133703800 x1875060715300608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201291 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201275.727603:0:3655:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5631 usecs (6 jiffies) 00000100:00100000:3.0:1788201275.727733:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715300608 00000100:00100000:3.0:1788201275.727741:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715300608 00000020:00000040:3.0:1788201275.727744:0:10112:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a163d6 00000020:00000040:3.0:1788201275.727748:0:10112:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1201ce800 refcount=5 00000020:00000040:3.0:1788201275.727761:0:10112:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff8dc139bbcd28) now 10 - evictor 00000100:00000040:3.0:1788201275.727790:0:10112:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:3.0:1788201275.727824:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2373 00000100:00000040:3.0:1788201275.727828:0:10112:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1201ce800 : new rpc_count 1 00000100:00000040:3.0:1788201275.727834:0:10112:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005abce00 x1875060715300608/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:396/0 lens 224/0 e 0 to 0 dl 1788201286 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201275.727847:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715300608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201275.727876:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00010000:00000040:3.0:1788201275.727887:0:10112:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969442, transno 0, xid 1875060715300608 00000100:00000040:3.0:1788201275.727909:0:10112:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00000040:3.0:1788201275.727913:0:10112:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201275.727934:0:10112:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8dc133703800 x1875060715300608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201291 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201275.727952:0:10112:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00000040:3.0:1788201275.727958:0:10112:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005abce00 x1875060715300608/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:396/0 lens 224/368 e 0 to 0 dl 1788201286 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201275.727966:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715300608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201275.727973:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2373 00000100:00000040:3.0:1788201275.727977:0:10112:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1201ce800 : new rpc_count 0 00000020:00000040:3.0:1788201275.727988:0:10112:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1201ce800 : new refcount 4 00000100:00080000:1.0:1788201275.728160:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1788201275.728165:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff8dc139bbcd28) now 10 - evictor 00000100:00000040:1.0:1788201275.728192:0:3655:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969442 00000100:00000040:1.0:1788201275.728199:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc133703800 x1875060715300608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1788201275.728215:0:3655:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:1.0:1788201275.728232:0:3655:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261731 state=0: rc = 0 00000100:00000040:1.0:1788201275.728240:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc133703800 x1875060715300608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201291 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201275.728248:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715300608:0@lo:13:osp-pre-1-1.0 00000100:00000040:1.0:1788201275.728255:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc133703800 x1875060715300608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201291 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201275.728265:0:3655:0:(genops.c:1223:class_import_put()) import ffff8dc1031f8800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00010000:00010000:2.0:1788201276.175266:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201277.199216:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1788201277.264072:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201277.264088:0:93109:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000100:00000040:2.0:1788201277.264113:0:93109:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging c9b18af6-fecc-4172-82c2-66531890fe11->MGS req@ffff8dc13a480000 x1875060715300736/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201277.264129:0:93109:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000025dcd650] to pc [ptlrpcd_00_01+1] req@ffff8dc13a480000 x1875060715300736/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.264161:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201277.264168:0:93109:0:(genops.c:1210:class_import_get()) import ffff8dc0034f0000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1788201277.264187:0:93109:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff8dc0078e2d80 x1875060715300864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201277.264205:0:93109:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005d111e12] to pc [ptlrpcd_00_02+2] req@ffff8dc0078e2d80 x1875060715300864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.264223:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201277.264228:0:93109:0:(genops.c:1210:class_import_get()) import ffff8dc0034f2000 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1788201277.264235:0:93109:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff8dc0078e1f80 x1875060715300992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201277.264244:0:93109:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000fe5d5813] to pc [ptlrpcd_00_03+3] req@ffff8dc0078e1f80 x1875060715300992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.264251:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201277.264255:0:93109:0:(genops.c:1210:class_import_get()) import ffff8dc109813800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1788201277.264260:0:93109:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff8dc0078e2a00 x1875060715301120/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201277.264267:0:93109:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000c2ca8e9] to pc [ptlrpcd_00_00+0] req@ffff8dc0078e2a00 x1875060715301120/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201277.264274:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201277.264276:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:2.0:1788201277.264279:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201277.264283:0:93109:0:(genops.c:1210:class_import_get()) import ffff8dc1031f8800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1788201277.264297:0:93109:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff8dc0078e3480 x1875060715301248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201277.264305:0:93109:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000cf04d458] to pc [ptlrpcd_00_01+1] req@ffff8dc0078e3480 x1875060715301248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.264312:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201277.264316:0:93109:0:(genops.c:1210:class_import_get()) import ffff8dc001db0000 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1788201277.264323:0:93109:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff8dc0078e0e00 x1875060715301376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201277.264330:0:93109:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000096aaa8d2] to pc [ptlrpcd_00_02+2] req@ffff8dc0078e0e00 x1875060715301376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.264336:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201277.264340:0:93109:0:(genops.c:1210:class_import_get()) import ffff8dc104281000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1788201277.264346:0:93109:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff8dc0078e2680 x1875060715301504/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201277.264353:0:93109:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004d84ebe9] to pc [ptlrpcd_00_03+3] req@ffff8dc0078e2680 x1875060715301504/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201277.264360:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201277.264363:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:2.0:1788201277.264365:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201277.264370:0:93109:0:(genops.c:1210:class_import_get()) import ffff8dc1257f0800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1788201277.264517:0:93109:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff8dc0078e1180 x1875060715301632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201277.264526:0:93109:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000941d59a4] to pc [ptlrpcd_00_00+0] req@ffff8dc0078e1180 x1875060715301632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.264544:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201277.264549:0:93109:0:(genops.c:1210:class_import_get()) import ffff8dc137d33000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1788201277.264561:0:93109:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff8dc0078e3b80 x1875060715301760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201277.264570:0:93109:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000089068776] to pc [ptlrpcd_00_01+1] req@ffff8dc0078e3b80 x1875060715301760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.264576:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201277.264581:0:93109:0:(genops.c:1210:class_import_get()) import ffff8dc004014000 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:2.0:1788201277.264587:0:93109:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID req@ffff8dc0078e0000 x1875060715301888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201277.264595:0:93109:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000087f70991] to pc [ptlrpcd_00_02+2] req@ffff8dc0078e0000 x1875060715301888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.264603:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1788201277.264607:0:93109:0:(genops.c:1210:class_import_get()) import ffff8dc13f869000 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:2.0:1788201277.264611:0:93109:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID req@ffff8dc0078e3100 x1875060715302016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1788201277.264619:0:93109:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000074ab302a] to pc [ptlrpcd_00_03+3] req@ffff8dc0078e3100 x1875060715302016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.264627:0:93109:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 1 (4133) 00000100:00000040:2.0:1788201277.264655:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc13a480000 x1875060715300736/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.264666:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715300736:0@lo:400:kworker.0 00000100:00000040:2.0:1788201277.264692:0:3656:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc13a480000 x1875060715300736/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201293 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.264705:0:3656:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201277.264752:0:3656:0:(events.c:337:request_in_callback()) incoming req@ffff8dc007114050 x1875060715300736 msgsize 224 00000100:00100000:2.0:1788201277.264756:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201277.264758:0:3656:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1788201277.264778:0:3656:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc13a480000 x1875060715300736/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201293 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.264808:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc0078e3480 x1875060715301248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.264816:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715301248:0@lo:400:kworker.0 00000100:00000040:2.0:1788201277.264909:0:3656:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc0078e3480 x1875060715301248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201293 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.264918:0:3656:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201277.264934:0:3656:0:(events.c:337:request_in_callback()) incoming req@ffff8dc0078e0700 x1875060715301248 msgsize 224 00000100:00100000:2.0:1788201277.264938:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201277.264954:0:3656:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc0078e3480 x1875060715301248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201293 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.264964:0:3656:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5618 usecs (6 jiffies) 00000100:00000040:2.0:1788201277.264971:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc0078e3b80 x1875060715301760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.264980:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715301760:0@lo:400:kworker.0 00000100:00000040:2.0:1788201277.264993:0:3656:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc0078e3b80 x1875060715301760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.265000:0:3656:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201277.265034:0:3656:0:(events.c:337:request_in_callback()) incoming req@ffff8dc0078e1880 x1875060715301760 msgsize 224 00000100:00100000:2.0:1788201277.265038:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201277.265052:0:3656:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc0078e3b80 x1875060715301760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.265074:0:3656:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 5595 usecs (6 jiffies) 00000100:00100000:2.0:1788201277.265089:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00000040:2.0:1788201277.265094:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc0078e2a00 x1875060715301120/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.265103:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715301120:0@lo:400:kworker.0 00000100:00000040:2.0:1788201277.265116:0:3656:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc0078e2a00 x1875060715301120/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201293 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.265123:0:3656:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201277.265138:0:3656:0:(events.c:337:request_in_callback()) incoming req@ffff8dc0078e3800 x1875060715301120 msgsize 224 00000100:00100000:2.0:1788201277.265141:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201277.265157:0:3656:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc0078e2a00 x1875060715301120/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201293 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.265166:0:3656:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1313380 usecs (1314 jiffies) 00000100:00000040:2.0:1788201277.265171:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc0078e1180 x1875060715301632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.267656:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715301632:0@lo:400:kworker.0 00000100:00000040:2.0:1788201277.267689:0:3656:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc0078e1180 x1875060715301632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201293 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.267699:0:3656:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201277.267739:0:3656:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005d53480 x1875060715301632 msgsize 224 00000100:00100000:2.0:1788201277.267744:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201277.267772:0:3656:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc0078e1180 x1875060715301632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201293 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.267784:0:3656:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 6795 usecs (7 jiffies) 00000100:00000040:2.0:1788201277.267817:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc0078e2d80 x1875060715300864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201277.268591:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715301248 00000100:00100000:0.0:1788201277.268603:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715301248 00000020:00000040:0.0:1788201277.268606:0:26208:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a163d6 00000020:00000040:0.0:1788201277.268611:0:26208:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1201ce800 refcount=5 00000020:00000040:0.0:1788201277.268626:0:26208:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff8dc139bbcd28) now 10 - evictor 00000100:00100000:0.0:1788201277.268665:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715301632 00000100:00100000:0.0:1788201277.268668:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715301632 00000020:00000040:0.0:1788201277.268670:0:26208:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c5ba 00000020:00000040:0.0:1788201277.268672:0:26208:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc0059d1800 refcount=5 00000100:00100000:0.0:1788201277.268694:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2928 00000100:00000040:0.0:1788201277.268699:0:26208:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1201ce800 : new rpc_count 1 00000100:00000040:0.0:1788201277.268704:0:26208:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc0078e0700 x1875060715301248/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:398/0 lens 224/0 e 0 to 0 dl 1788201288 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201277.268717:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715301248:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1788201277.268736:0:26208:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969442, transno 0, xid 1875060715301248 00000100:00000040:0.0:1788201277.268747:0:26208:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00000040:0.0:1788201277.268751:0:26208:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201277.268778:0:26208:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc0078e3480 x1875060715301248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201277.268801:0:26208:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00000040:0.0:1788201277.268812:0:26208:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc0078e0700 x1875060715301248/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:398/0 lens 224/224 e 0 to 0 dl 1788201288 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201277.268820:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715301248:12345-0@lo:400:kworker.0 Request processed in 105us (3884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201277.268826:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2928 00000100:00100000:2.0:1788201277.269296:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715300864:0@lo:400:kworker.0 00000100:00000040:2.0:1788201277.269318:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc0078e2d80 x1875060715300864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.269326:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201277.269348:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005d51c00 x1875060715300864 msgsize 224 00000100:00100000:2.0:1788201277.269353:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201277.269912:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc0078e2d80 x1875060715300864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.269930:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8487 usecs (9 jiffies) 00000100:00000040:2.0:1788201277.269942:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc0078e0e00 x1875060715301376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.269950:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715301376:0@lo:400:kworker.0 00000100:00000040:2.0:1788201277.269967:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc0078e0e00 x1875060715301376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.269973:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201277.269988:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005d50000 x1875060715301376 msgsize 224 00000100:00100000:2.0:1788201277.269991:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201277.270006:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc0078e0e00 x1875060715301376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.270031:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 83985 usecs (84 jiffies) 00000100:00000040:2.0:1788201277.270039:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc0078e0000 x1875060715301888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.270047:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715301888:0@lo:400:kworker.0 00000100:00000040:2.0:1788201277.270062:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc0078e0000 x1875060715301888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.270080:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201277.270096:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005d51880 x1875060715301888 msgsize 224 00000100:00100000:2.0:1788201277.270100:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201277.270117:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc0078e0000 x1875060715301888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.270125:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 16502 usecs (17 jiffies) 00000100:00100000:2.0:1788201277.270140:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00000040:2.0:1788201277.270145:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc0078e1f80 x1875060715300992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.270153:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715300992:0@lo:400:kworker.0 00000100:00000040:2.0:1788201277.270164:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc0078e1f80 x1875060715300992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.270170:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201277.270911:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005d50380 x1875060715300992 msgsize 224 00000100:00100000:2.0:1788201277.270918:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201277.270936:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc0078e1f80 x1875060715300992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.270947:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 8656 usecs (9 jiffies) 00000100:00000040:2.0:1788201277.270954:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc0078e2680 x1875060715301504/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.270965:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715301504:0@lo:400:kworker.0 00000100:00000040:2.0:1788201277.270978:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc0078e2680 x1875060715301504/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201293 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.270986:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201277.270998:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005d51180 x1875060715301504 msgsize 224 00000100:00100000:2.0:1788201277.271002:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201277.271012:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc0078e2680 x1875060715301504/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201293 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.271043:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 4200 usecs (5 jiffies) 00000100:00000040:2.0:1788201277.271050:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc0078e3100 x1875060715302016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.271059:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715302016:0@lo:400:kworker.0 00000100:00000040:2.0:1788201277.271073:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc0078e3100 x1875060715302016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.271080:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201277.271090:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005d53100 x1875060715302016 msgsize 224 00000100:00100000:2.0:1788201277.271093:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1788201277.271099:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc0078e3100 x1875060715302016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.271107:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 10785 usecs (11 jiffies) 00000100:00100000:2.0:1788201277.271134:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715300736 00000100:00100000:2.0:1788201277.271140:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715300736 00000020:00000040:2.0:1788201277.271143:0:94467:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:2.0:1788201277.271147:0:94467:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=24 00000100:00000040:2.0:1788201277.271166:0:94467:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000040:0.0:1788201277.271296:0:26208:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1201ce800 : new rpc_count 0 00000020:00000040:0.0:1788201277.271307:0:26208:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1201ce800 : new refcount 4 00000100:00100000:0.0:1788201277.271322:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2929 00000100:00000040:0.0:1788201277.271325:0:26208:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc0059d1800 : new rpc_count 1 00000100:00000040:0.0:1788201277.271331:0:26208:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005d53480 x1875060715301632/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:398/0 lens 224/0 e 0 to 0 dl 1788201288 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201277.271345:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715301632:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1788201277.271364:0:26208:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969457, transno 0, xid 1875060715301632 00000100:00000040:0.0:1788201277.271440:0:26208:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00000040:0.0:1788201277.271444:0:26208:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201277.271463:0:26208:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc0078e1180 x1875060715301632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201277.271479:0:26208:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00000040:0.0:1788201277.271483:0:26208:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005d53480 x1875060715301632/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:398/0 lens 224/224 e 0 to 0 dl 1788201288 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201277.271491:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715301632:12345-0@lo:400:kworker.0 Request processed in 151us (3751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201277.271497:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2929 00000100:00000040:0.0:1788201277.271499:0:26208:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc0059d1800 : new rpc_count 0 00000020:00000040:0.0:1788201277.271505:0:26208:0:(genops.c:879:class_export_put()) PUTting export ffff8dc0059d1800 : new refcount 4 00000100:00080000:0.0:1788201277.271520:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1788201277.271525:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff8dc139bbcd28) now 10 - evictor 00000100:00000040:0.0:1788201277.271787:0:3656:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969457 00000100:00000040:0.0:1788201277.271795:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc0078e1180 x1875060715301632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201277.271804:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc0078e1180 x1875060715301632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201277.271810:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715301632:0@lo:400:kworker.0 00000100:00000040:0.0:1788201277.271823:0:3656:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969442 00000100:00100000:2.0:1788201277.272598:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00000040:2.0:1788201277.272602:0:94467:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:2.0:1788201277.272608:0:94467:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc007114050 x1875060715300736/t0(0) o400->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:398/0 lens 224/0 e 0 to 0 dl 1788201288 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.272621:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715300736:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788201277.272637:0:94467:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715300736 00000100:00000040:2.0:1788201277.272643:0:94467:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00000040:2.0:1788201277.272647:0:94467:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201277.272674:0:94467:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc13a480000 x1875060715300736/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.272701:0:94467:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00000040:2.0:1788201277.272705:0:94467:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc007114050 x1875060715300736/t0(0) o400->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:398/0 lens 224/224 e 0 to 0 dl 1788201288 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.272712:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715300736:12345-0@lo:400:kworker.0 Request processed in 95us (7959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201277.272718:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00000040:2.0:1788201277.272720:0:94467:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000020:00000040:2.0:1788201277.272729:0:94467:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 23 00000100:00100000:2.0:1788201277.272762:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715301760 00000100:00100000:2.0:1788201277.272768:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715301760 00000020:00000040:2.0:1788201277.272770:0:66313:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c6e0 00000020:00000040:2.0:1788201277.272773:0:66313:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc137d37000 refcount=5 00000100:00000040:2.0:1788201277.272786:0:66313:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1788201277.272798:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715300864 00000100:00000040:0.0:1788201277.273943:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc0078e3480 x1875060715301248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201277.273963:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc0078e3480 x1875060715301248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201277.273969:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715301248:0@lo:400:kworker.0 00000100:00000040:0.0:1788201277.274032:0:3656:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc0078e1180 x1875060715301632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788201277.274043:0:3656:0:(genops.c:1223:class_import_put()) import ffff8dc1257f0800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1788201277.274053:0:3656:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc0078e3480 x1875060715301248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788201277.274059:0:3656:0:(genops.c:1223:class_import_put()) import ffff8dc1031f8800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1788201277.274085:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc13a480000 x1875060715300736/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201277.274093:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc13a480000 x1875060715300736/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201277.274099:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715300736:0@lo:400:kworker.0 00000100:00000040:0.0:1788201277.274104:0:3656:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc13a480000 x1875060715300736/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788201277.274118:0:3656:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 00000100:00100000:2.0:1788201277.274474:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715300864 00000020:00000040:2.0:1788201277.274478:0:66313:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c6d2 00000020:00000040:2.0:1788201277.274482:0:66313:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc11cdda800 refcount=5 00000020:00000040:2.0:1788201277.274498:0:66313:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff8dc13f870000) now 16 - evictor 00000100:00100000:2.0:1788201277.274538:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715301376 00000100:00100000:2.0:1788201277.274541:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715301376 00000020:00000040:2.0:1788201277.274543:0:66313:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c6d9 00000020:00000040:2.0:1788201277.274546:0:66313:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc11d63e800 refcount=5 00000100:00100000:2.0:1788201277.274559:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715301888 00000100:00100000:2.0:1788201277.274563:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715301888 00000020:00000040:2.0:1788201277.274564:0:66313:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d50a 00000020:00000040:2.0:1788201277.274566:0:66313:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc13aa99000 refcount=5 00000100:00100000:2.0:1788201277.274579:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715300992 00000100:00100000:2.0:1788201277.274582:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715300992 00000020:00000040:2.0:1788201277.274583:0:66313:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1644d 00000020:00000040:2.0:1788201277.274586:0:66313:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc10558f000 refcount=5 00000020:00000040:2.0:1788201277.274600:0:66313:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff8dc1060e4d28) now 12 - evictor 00000100:00100000:2.0:1788201277.274614:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715302016 00000100:00100000:2.0:1788201277.274618:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715302016 00000020:00000040:2.0:1788201277.274620:0:66313:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d51f 00000020:00000040:2.0:1788201277.274622:0:66313:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc11cdde000 refcount=5 00000100:00100000:2.0:1788201277.274639:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1547 00000100:00000040:2.0:1788201277.274644:0:66313:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc137d37000 : new rpc_count 1 00000100:00000040:2.0:1788201277.274649:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc0078e1880 x1875060715301760/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:398/0 lens 224/0 e 0 to 0 dl 1788201288 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.274660:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715301760:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788201277.274679:0:66313:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715301760 00000100:00000040:2.0:1788201277.274687:0:66313:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00000040:2.0:1788201277.274692:0:66313:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201277.274727:0:66313:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc0078e3b80 x1875060715301760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.274750:0:66313:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00000040:2.0:1788201277.274755:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc0078e1880 x1875060715301760/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:398/0 lens 224/224 e 0 to 0 dl 1788201288 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.274762:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715301760:12345-0@lo:400:kworker.0 Request processed in 103us (9746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201277.274769:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1547 00000100:00000040:2.0:1788201277.274771:0:66313:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc137d37000 : new rpc_count 0 00000020:00000040:2.0:1788201277.274780:0:66313:0:(genops.c:879:class_export_put()) PUTting export ffff8dc137d37000 : new refcount 4 00000100:00100000:2.0:1788201277.274790:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1548 00000100:00000040:2.0:1788201277.274792:0:66313:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc11cdda800 : new rpc_count 1 00000100:00000040:2.0:1788201277.274796:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005d51c00 x1875060715300864/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:398/0 lens 224/0 e 0 to 0 dl 1788201288 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.274806:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715300864:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788201277.274821:0:66313:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715300864 00000100:00000040:2.0:1788201277.274827:0:66313:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00080000:0.0:1788201277.275332:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1788201277.275336:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001 (ffff8dc1060e4d28) now 12 - evictor 00000100:00080000:0.0:1788201277.275340:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1788201277.275341:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (ffff8dc13f870000) now 16 - evictor 00000100:00000040:0.0:1788201277.275735:0:3656:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1788201277.275743:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc0078e3b80 x1875060715301760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201277.275754:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc0078e3b80 x1875060715301760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201277.275761:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715301760:0@lo:400:kworker.0 00000100:00000040:0.0:1788201277.275768:0:3656:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc0078e3b80 x1875060715301760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788201277.275776:0:3656:0:(genops.c:1223:class_import_put()) import ffff8dc137d33000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1788201277.276582:0:66313:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201277.276619:0:66313:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc0078e2d80 x1875060715300864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.276712:0:66313:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00000040:2.0:1788201277.276719:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005d51c00 x1875060715300864/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:398/0 lens 224/224 e 0 to 0 dl 1788201288 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.276726:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715300864:12345-0@lo:400:kworker.0 Request processed in 1921us (7376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201277.276734:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1548 00000100:00000040:2.0:1788201277.276737:0:66313:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc11cdda800 : new rpc_count 0 00000020:00000040:2.0:1788201277.276748:0:66313:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11cdda800 : new refcount 4 00000100:00100000:2.0:1788201277.276765:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1549 00000100:00000040:2.0:1788201277.276768:0:66313:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc11d63e800 : new rpc_count 1 00000100:00000040:2.0:1788201277.276773:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005d50000 x1875060715301376/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:398/0 lens 224/0 e 0 to 0 dl 1788201288 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.276785:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715301376:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788201277.276802:0:66313:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715301376 00000100:00000040:2.0:1788201277.276808:0:66313:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00000040:2.0:1788201277.276812:0:66313:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201277.276839:0:66313:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc0078e0e00 x1875060715301376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.276852:0:66313:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00000040:2.0:1788201277.276856:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005d50000 x1875060715301376/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:398/0 lens 224/224 e 0 to 0 dl 1788201288 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.276878:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715301376:12345-0@lo:400:kworker.0 Request processed in 97us (6888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201277.276884:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1549 00000100:00000040:2.0:1788201277.276886:0:66313:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc11d63e800 : new rpc_count 0 00000020:00000040:2.0:1788201277.276893:0:66313:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11d63e800 : new refcount 4 00000100:00100000:2.0:1788201277.276904:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1550 00000100:00000040:2.0:1788201277.276906:0:66313:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc13aa99000 : new rpc_count 1 00000100:00000040:2.0:1788201277.276910:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005d51880 x1875060715301888/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:398/0 lens 224/0 e 0 to 0 dl 1788201288 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.276919:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715301888:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788201277.276928:0:66313:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715301888 00000100:00000040:2.0:1788201277.276933:0:66313:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00000040:2.0:1788201277.276936:0:66313:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201277.276956:0:66313:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc0078e0000 x1875060715301888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.276967:0:66313:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00000040:2.0:1788201277.276970:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005d51880 x1875060715301888/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:398/0 lens 224/224 e 0 to 0 dl 1788201288 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.276976:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715301888:12345-0@lo:400:kworker.0 Request processed in 59us (6879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201277.276980:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1550 00000100:00000040:2.0:1788201277.276982:0:66313:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc13aa99000 : new rpc_count 0 00000020:00000040:2.0:1788201277.276987:0:66313:0:(genops.c:879:class_export_put()) PUTting export ffff8dc13aa99000 : new refcount 4 00000100:00100000:2.0:1788201277.276994:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1551 00000100:00000040:2.0:1788201277.276996:0:66313:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc10558f000 : new rpc_count 1 00000100:00000040:2.0:1788201277.277000:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005d50380 x1875060715300992/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:398/0 lens 224/0 e 0 to 0 dl 1788201288 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.277034:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715300992:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788201277.277047:0:66313:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715300992 00000100:00000040:2.0:1788201277.277051:0:66313:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00000040:2.0:1788201277.277055:0:66313:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000001:00080000:0.0:1788201277.278336:0:97035:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969498 is committed 00000001:00000040:0.0:1788201277.278343:0:97035:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8dc1401c7000 : new cb_count 19 00000020:00000040:0.0:1788201277.278347:0:97035:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 23 00000001:00000040:0.0:1788201277.278354:0:97035:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8dc1401c7000 : new cb_count 18 00000020:00000040:0.0:1788201277.278356:0:97035:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 22 00000001:00000040:0.0:1788201277.278361:0:97035:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8dc1401c7000 : new cb_count 17 00000020:00000040:0.0:1788201277.278362:0:97035:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 21 00000001:00000040:0.0:1788201277.278366:0:97035:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8dc1401c7000 : new cb_count 16 00000020:00000040:0.0:1788201277.278839:0:97035:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 20 00000001:00000040:0.0:1788201277.278847:0:97035:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8dc1401c7000 : new cb_count 15 00000020:00000040:0.0:1788201277.278850:0:97035:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 19 00000001:00000040:0.0:1788201277.278854:0:97035:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8dc1401c7000 : new cb_count 14 00000020:00000040:0.0:1788201277.278856:0:97035:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 18 00000001:00000040:0.0:1788201277.278870:0:97035:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8dc1401c7000 : new cb_count 13 00000020:00000040:0.0:1788201277.278873:0:97035:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 17 00000001:00000040:0.0:1788201277.278876:0:97035:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8dc1401c7000 : new cb_count 12 00000020:00000040:0.0:1788201277.278878:0:97035:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 16 00000001:00000040:0.0:1788201277.278885:0:97035:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8dc1401c7000 : new cb_count 11 00000020:00000040:0.0:1788201277.278886:0:97035:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 15 00000001:00000040:0.0:1788201277.278890:0:97035:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8dc1401c7000 : new cb_count 10 00000020:00000040:0.0:1788201277.278891:0:97035:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 14 00000001:00000040:0.0:1788201277.278895:0:97035:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8dc1401c7000 : new cb_count 9 00000020:00000040:0.0:1788201277.278896:0:97035:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 13 00000001:00000040:0.0:1788201277.278901:0:97035:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8dc1401c7000 : new cb_count 8 00000020:00000040:0.0:1788201277.278903:0:97035:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 12 00000001:00000040:0.0:1788201277.278907:0:97035:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8dc1401c7000 : new cb_count 7 00000020:00000040:0.0:1788201277.278908:0:97035:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 11 00000001:00000040:0.0:1788201277.278912:0:97035:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8dc1401c7000 : new cb_count 6 00000020:00000040:0.0:1788201277.278914:0:97035:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 10 00000001:00000040:0.0:1788201277.278917:0:97035:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8dc1401c7000 : new cb_count 5 00000020:00000040:0.0:1788201277.278918:0:97035:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 9 00000001:00000040:0.0:1788201277.278920:0:97035:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8dc1401c7000 : new cb_count 4 00000020:00000040:0.0:1788201277.278922:0:97035:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 8 00000001:00000040:0.0:1788201277.278925:0:97035:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8dc1401c7000 : new cb_count 3 00000020:00000040:0.0:1788201277.278927:0:97035:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 7 00000001:00000040:0.0:1788201277.278930:0:97035:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8dc1401c7000 : new cb_count 2 00000020:00000040:0.0:1788201277.278931:0:97035:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 6 00000001:00000040:0.0:1788201277.278935:0:97035:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8dc1401c7000 : new cb_count 1 00000020:00000040:0.0:1788201277.278937:0:97035:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 5 00000001:00000040:0.0:1788201277.278940:0:97035:0:(tgt_lastrcvd.c:986:tgt_cb_last_committed()) callback PUTting export ffff8dc1401c7000 : new cb_count 0 00000020:00000040:0.0:1788201277.278942:0:97035:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c7000 : new refcount 4 00000100:00000040:2.0:1788201277.279330:0:66313:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc0078e1f80 x1875060715300992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.279361:0:66313:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00000040:2.0:1788201277.279368:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005d50380 x1875060715300992/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:398/0 lens 224/224 e 0 to 0 dl 1788201288 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.279554:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715300992:12345-0@lo:400:kworker.0 Request processed in 2538us (8640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201277.279564:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1551 00000100:00000040:2.0:1788201277.279567:0:66313:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc10558f000 : new rpc_count 0 00000020:00000040:2.0:1788201277.279579:0:66313:0:(genops.c:879:class_export_put()) PUTting export ffff8dc10558f000 : new refcount 4 00000100:00100000:2.0:1788201277.279602:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1552 00000100:00000040:2.0:1788201277.279606:0:66313:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc11cdde000 : new rpc_count 1 00000100:00000040:2.0:1788201277.279611:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005d53100 x1875060715302016/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:398/0 lens 224/0 e 0 to 0 dl 1788201288 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.279626:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715302016:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788201277.279644:0:66313:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715302016 00000100:00000040:2.0:1788201277.279653:0:66313:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00000040:2.0:1788201277.279657:0:66313:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201277.279686:0:66313:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc0078e3100 x1875060715302016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.279698:0:66313:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00000040:2.0:1788201277.279710:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005d53100 x1875060715302016/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:398/0 lens 224/224 e 0 to 0 dl 1788201288 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.279717:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715302016:12345-0@lo:400:kworker.0 Request processed in 97us (8626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201277.279723:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1552 00000100:00000040:2.0:1788201277.279726:0:66313:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc11cdde000 : new rpc_count 0 00000020:00000040:2.0:1788201277.279731:0:66313:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11cdde000 : new refcount 4 00000100:00100000:2.0:1788201277.279753:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715301120 00000100:00100000:2.0:1788201277.279762:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715301120 00000020:00000040:2.0:1788201277.279764:0:8458:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c54a 00000020:00000040:2.0:1788201277.279768:0:8458:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc103486000 refcount=7 00000100:00000040:2.0:1788201277.279784:0:8458:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1788201277.279921:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715301504 00000100:00100000:2.0:1788201277.279926:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715301504 00000020:00000040:2.0:1788201277.279927:0:8458:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c582 00000020:00000040:2.0:1788201277.279930:0:8458:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc11d63c000 refcount=5 00000100:00100000:0.0:1788201277.279970:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4120 00000100:00000040:0.0:1788201277.279973:0:8457:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc103486000 : new rpc_count 1 00000100:00000040:0.0:1788201277.279984:0:8457:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc0078e3800 x1875060715301120/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:398/0 lens 224/0 e 0 to 0 dl 1788201288 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201277.279996:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715301120:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1788201277.280009:0:8457:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1875060715301120 00000100:00000040:0.0:1788201277.280013:0:8457:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00000040:0.0:1788201277.280037:0:8457:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201277.280061:0:8457:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc0078e2a00 x1875060715301120/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201277.280086:0:8457:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00000040:0.0:1788201277.280090:0:8457:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc0078e3800 x1875060715301120/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:398/0 lens 224/224 e 0 to 0 dl 1788201288 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.280545:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4121 00000100:00000040:2.0:1788201277.280549:0:8458:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc11d63c000 : new rpc_count 1 00000100:00000040:2.0:1788201277.280554:0:8458:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005d51180 x1875060715301504/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:398/0 lens 224/0 e 0 to 0 dl 1788201288 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.280565:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715301504:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788201277.280575:0:8458:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715301504 00000100:00000040:2.0:1788201277.280579:0:8458:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00000040:2.0:1788201277.280582:0:8458:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201277.280601:0:8458:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc0078e2680 x1875060715301504/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.280614:0:8458:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00000040:2.0:1788201277.280617:0:8458:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005d51180 x1875060715301504/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:398/0 lens 224/224 e 0 to 0 dl 1788201288 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.280636:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715301504:12345-0@lo:400:kworker.0 Request processed in 73us (9635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201277.280642:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4121 00000100:00000040:2.0:1788201277.280644:0:8458:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc11d63c000 : new rpc_count 0 00000020:00000040:2.0:1788201277.280650:0:8458:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11d63c000 : new refcount 4 00000100:00100000:0.0:1788201277.281170:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715301120:12345-0@lo:400:kworker.0 Request processed in 1173us (16026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201277.281251:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4120 00000100:00000040:0.0:1788201277.281254:0:8457:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc103486000 : new rpc_count 0 00000020:00000040:0.0:1788201277.281261:0:8457:0:(genops.c:879:class_export_put()) PUTting export ffff8dc103486000 : new refcount 6 00000100:00000040:0.0:1788201277.281303:0:3656:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:0.0:1788201277.281310:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc0078e2a00 x1875060715301120/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201277.281320:0:3656:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc0078e2a00 x1875060715301120/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201277.281328:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715301120:0@lo:400:kworker.0 00000100:00000040:0.0:1788201277.281335:0:3656:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc0078e2a00 x1875060715301120/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788201277.281344:0:3656:0:(genops.c:1223:class_import_put()) import ffff8dc109813800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1788201277.285859:0:3657:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:3.0:1788201277.285877:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc0078e2d80 x1875060715300864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201277.285891:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc0078e2d80 x1875060715300864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201277.285899:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715300864:0@lo:400:kworker.0 00000100:00000040:3.0:1788201277.285915:0:3657:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:3.0:1788201277.285920:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc0078e0e00 x1875060715301376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201277.285928:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc0078e0e00 x1875060715301376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201277.285934:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715301376:0@lo:400:kworker.0 00000100:00000040:3.0:1788201277.285945:0:3657:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:3.0:1788201277.285960:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc0078e0000 x1875060715301888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201277.285967:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc0078e0000 x1875060715301888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201277.285973:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715301888:0@lo:400:kworker.0 00000100:00000040:3.0:1788201277.285980:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc0078e2d80 x1875060715300864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201277.285993:0:3657:0:(genops.c:1223:class_import_put()) import ffff8dc0034f0000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:3.0:1788201277.286003:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc0078e0e00 x1875060715301376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201277.286010:0:3657:0:(genops.c:1223:class_import_put()) import ffff8dc001db0000 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:3.0:1788201277.286032:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc0078e0000 x1875060715301888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201277.286040:0:3657:0:(genops.c:1223:class_import_put()) import ffff8dc004014000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:3.0:1788201277.286056:0:3657:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:3.0:1788201277.286060:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc0078e1f80 x1875060715300992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201277.286069:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc0078e1f80 x1875060715300992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201277.286075:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715300992:0@lo:400:kworker.0 00000100:00000040:3.0:1788201277.286086:0:3657:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:3.0:1788201277.286090:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc0078e2680 x1875060715301504/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201277.286098:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc0078e2680 x1875060715301504/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201277.286116:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715301504:0@lo:400:kworker.0 00000100:00000040:3.0:1788201277.286131:0:3657:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:3.0:1788201277.286134:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc0078e3100 x1875060715302016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201277.286142:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc0078e3100 x1875060715302016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201277.286149:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715302016:0@lo:400:kworker.0 00000100:00000040:3.0:1788201277.286154:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc0078e1f80 x1875060715300992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201277.286162:0:3657:0:(genops.c:1223:class_import_put()) import ffff8dc0034f2000 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:3.0:1788201277.286168:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc0078e2680 x1875060715301504/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201277.286174:0:3657:0:(genops.c:1223:class_import_put()) import ffff8dc104281000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1788201277.286178:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc0078e3100 x1875060715302016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201293 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201277.286184:0:3657:0:(genops.c:1223:class_import_put()) import ffff8dc13f869000 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000020:00000040:2.0:1788201277.776218:0:94473:0:(genops.c:1210:class_import_get()) import ffff8dc104281000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1788201277.776258:0:94473:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000aad06a13] to pc [ptlrpcd_00_00+0] req@ffff8dc005d50a80 x1875060715302144/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201277.776385:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc005d50a80 x1875060715302144/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201277.776399:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715302144:0@lo:41:osp-pre-1-0.0 00000100:00000040:1.0:1788201277.776432:0:3655:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc005d50a80 x1875060715302144/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201293 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201277.776453:0:3655:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201277.776496:0:3655:0:(events.c:337:request_in_callback()) incoming req@ffff8dc004eb5880 x1875060715302144 msgsize 224 00000100:00100000:1.0:1788201277.776501:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788201277.776521:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc005d50a80 x1875060715302144/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201293 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201277.776536:0:3655:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 4917 usecs (5 jiffies) 00000100:00100000:2.0:1788201277.776664:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715302144 00000100:00100000:2.0:1788201277.776671:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715302144 00000020:00000040:2.0:1788201277.776673:0:8458:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c582 00000020:00000040:2.0:1788201277.776677:0:8458:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc11d63c000 refcount=5 00000100:00000040:2.0:1788201277.776700:0:8458:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1788201277.776734:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4122 00000100:00000040:2.0:1788201277.776738:0:8458:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc11d63c000 : new rpc_count 1 00000100:00000040:2.0:1788201277.776745:0:8458:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc004eb5880 x1875060715302144/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:398/0 lens 224/0 e 0 to 0 dl 1788201288 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.776758:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715302144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201277.776800:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00010000:00000040:2.0:1788201277.776811:0:8458:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715302144 00000100:00000040:2.0:1788201277.776819:0:8458:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00000040:2.0:1788201277.776824:0:8458:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201277.776843:0:8458:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8dc005d50a80 x1875060715302144/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201277.776860:0:8458:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00000040:2.0:1788201277.776865:0:8458:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc004eb5880 x1875060715302144/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:398/0 lens 224/368 e 0 to 0 dl 1788201288 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201277.776887:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715302144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201277.776894:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4122 00000100:00000040:2.0:1788201277.776897:0:8458:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc11d63c000 : new rpc_count 0 00000020:00000040:2.0:1788201277.776908:0:8458:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11d63c000 : new refcount 4 00000100:00000040:1.0:1788201277.777256:0:3655:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1788201277.777263:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc005d50a80 x1875060715302144/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1788201277.777275:0:3655:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352879 avail=317176 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023680 state=0: rc = 0 00000100:00000040:1.0:1788201277.777283:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005d50a80 x1875060715302144/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201293 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201277.777298:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715302144:0@lo:41:osp-pre-1-0.0 00000100:00000040:1.0:1788201277.777306:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc005d50a80 x1875060715302144/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201293 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201277.777316:0:3655:0:(genops.c:1223:class_import_put()) import ffff8dc104281000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00010000:00010000:2.0:1788201278.223917:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:1.0:1788201278.288842:0:94477:0:(genops.c:1210:class_import_get()) import ffff8dc1257f0800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1788201278.288887:0:94477:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004c0ed2fc] to pc [ptlrpcd_00_01+1] req@ffff8dc004eb5c00 x1875060715302272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201278.288941:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:3.0:1788201278.288944:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788201278.288955:0:76267:0:(genops.c:1210:class_import_get()) import ffff8dc104280800 refcount=4 obd=MGC192.168.201.120@tcp 00000100:00000040:1.0:1788201278.288965:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc004eb5c00 x1875060715302272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.288965:0:76267:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging c9b18af6-fecc-4172-82c2-66531890fe11->MGS req@ffff8dc133701180 x1875060715302400/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201278.288978:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715302272:0@lo:13:osp-pre-1-0.0 00000100:00000040:3.0:1788201278.288978:0:76267:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006f21531a] to pc [ptlrpcd_00_02+2] req@ffff8dc133701180 x1875060715302400/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.288995:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:1.0:1788201278.289006:0:3655:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc004eb5c00 x1875060715302272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201294 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201278.289011:0:76267:0:(genops.c:1210:class_import_get()) import ffff8dc0034f0000 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:3.0:1788201278.289039:0:76267:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff8dc133703800 x1875060715302528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788201278.289048:0:3655:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201278.289049:0:76267:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007931264f] to pc [ptlrpcd_00_03+3] req@ffff8dc133703800 x1875060715302528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.289057:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788201278.289064:0:76267:0:(genops.c:1210:class_import_get()) import ffff8dc0034f2000 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:3.0:1788201278.289070:0:76267:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff8dc005d55880 x1875060715302656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788201278.289078:0:76267:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f0b7cfbd] to pc [ptlrpcd_00_00+0] req@ffff8dc005d55880 x1875060715302656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.289085:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788201278.289088:0:76267:0:(genops.c:1210:class_import_get()) import ffff8dc109813800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1788201278.289094:0:76267:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff8dc005d57800 x1875060715302784/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788201278.289100:0:3655:0:(events.c:337:request_in_callback()) incoming req@ffff8dc004eb6680 x1875060715302272 msgsize 224 00000100:00000040:3.0:1788201278.289102:0:76267:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000068f4c8f3] to pc [ptlrpcd_00_01+1] req@ffff8dc005d57800 x1875060715302784/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201278.289105:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788201278.289110:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201278.289113:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:3.0:1788201278.289116:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788201278.289120:0:76267:0:(genops.c:1210:class_import_get()) import ffff8dc1031f8800 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:1.0:1788201278.289125:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc004eb5c00 x1875060715302272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201294 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.289126:0:76267:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff8dc005d57b80 x1875060715302912/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788201278.289140:0:3655:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 6862 usecs (7 jiffies) 00000100:00000040:3.0:1788201278.289145:0:76267:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000761f2ae4] to pc [ptlrpcd_00_02+2] req@ffff8dc005d57b80 x1875060715302912/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201278.289152:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc005d55880 x1875060715302656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.289152:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788201278.289156:0:76267:0:(genops.c:1210:class_import_get()) import ffff8dc001db0000 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00100000:1.0:1788201278.289160:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715302656:0@lo:400:kworker.0 00000100:00000040:3.0:1788201278.289163:0:76267:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff8dc005d55500 x1875060715303040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788201278.289184:0:3655:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc005d55880 x1875060715302656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.289184:0:76267:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000008c8f1aa] to pc [ptlrpcd_00_03+3] req@ffff8dc005d55500 x1875060715303040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201278.289192:0:3655:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00080000:3.0:1788201278.289193:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201278.289196:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:3.0:1788201278.289199:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788201278.289204:0:76267:0:(genops.c:1210:class_import_get()) import ffff8dc137d33000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:3.0:1788201278.289211:0:76267:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff8dc005d55f80 x1875060715303168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788201278.289214:0:3655:0:(events.c:337:request_in_callback()) incoming req@ffff8dc004eb4e00 x1875060715302656 msgsize 224 00000100:00100000:1.0:1788201278.289218:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201278.289221:0:76267:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005b52722f] to pc [ptlrpcd_00_00+0] req@ffff8dc005d55f80 x1875060715303168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201278.289228:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc005d55880 x1875060715302656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.289229:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788201278.289233:0:76267:0:(genops.c:1210:class_import_get()) import ffff8dc004014000 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:1.0:1788201278.289237:0:3655:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 8681 usecs (9 jiffies) 00000100:00000040:3.0:1788201278.289239:0:76267:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID req@ffff8dc005d55180 x1875060715303296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1788201278.289245:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc005d55f80 x1875060715303168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.289248:0:76267:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002322747d] to pc [ptlrpcd_00_01+1] req@ffff8dc005d55180 x1875060715303296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201278.289254:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715303168:0@lo:400:kworker.0 00000100:00000040:1.0:1788201278.289265:0:3655:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc005d55f80 x1875060715303168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.289265:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1788201278.289270:0:76267:0:(genops.c:1210:class_import_get()) import ffff8dc13f869000 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:1.0:1788201278.289272:0:3655:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201278.289278:0:76267:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID req@ffff8dc005d57480 x1875060715303424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1788201278.289286:0:76267:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000009652586e] to pc [ptlrpcd_00_02+2] req@ffff8dc005d57480 x1875060715303424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201278.289288:0:3655:0:(events.c:337:request_in_callback()) incoming req@ffff8dc106048a80 x1875060715303168 msgsize 224 00000100:00100000:1.0:1788201278.289295:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201278.289296:0:76267:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (4134) 00000100:00000040:1.0:1788201278.289308:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc005d55f80 x1875060715303168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.289312:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc133701180 x1875060715302400/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201278.289318:0:3655:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 6116 usecs (7 jiffies) 00000100:00100000:3.0:1788201278.289320:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715302400:0@lo:400:kworker.0 00000100:00100000:1.0:1788201278.289323:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00000040:1.0:1788201278.289327:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc005d57800 x1875060715302784/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.289333:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc133701180 x1875060715302400/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201294 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201278.289334:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715302784:0@lo:400:kworker.0 00000100:00000040:3.0:1788201278.289341:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201278.289344:0:3655:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc005d57800 x1875060715302784/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201294 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201278.289351:0:3655:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201278.289358:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff8dc007116050 x1875060715302400 msgsize 224 00000100:00100000:3.0:1788201278.289362:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201278.289364:0:3657:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1788201278.289367:0:3655:0:(events.c:337:request_in_callback()) incoming req@ffff8dc106048380 x1875060715302784 msgsize 224 00000100:00100000:1.0:1788201278.289373:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201278.289376:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc133701180 x1875060715302400/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201294 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201278.289391:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc005d57800 x1875060715302784/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201294 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.289397:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc005d57b80 x1875060715302912/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201278.289405:0:3655:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1309830 usecs (1310 jiffies) 00000100:00100000:3.0:1788201278.289405:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715302912:0@lo:400:kworker.0 00000100:00000040:1.0:1788201278.289416:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc005d55180 x1875060715303296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.289416:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc005d57b80 x1875060715302912/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201294 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.289423:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201278.289435:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005d57100 x1875060715302912 msgsize 224 00000100:00100000:3.0:1788201278.289443:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201278.289457:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715303296:0@lo:400:kworker.0 00000100:00000040:3.0:1788201278.289458:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc005d57b80 x1875060715302912/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201294 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.289467:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5628 usecs (6 jiffies) 00000100:00000040:3.0:1788201278.289473:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc005d57480 x1875060715303424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201278.289480:0:3655:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc005d55180 x1875060715303296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201278.289480:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715303424:0@lo:400:kworker.0 00000100:00000040:1.0:1788201278.289490:0:3655:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201278.289491:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc005d57480 x1875060715303424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.289498:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201278.289508:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005d56300 x1875060715303424 msgsize 224 00000100:00100000:3.0:1788201278.289511:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201278.289524:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc005d57480 x1875060715303424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.289532:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 18828 usecs (19 jiffies) 00000100:00100000:1.0:1788201278.289534:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715302272 00000100:00100000:3.0:1788201278.289539:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00000040:3.0:1788201278.289544:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc133703800 x1875060715302528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201278.289548:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715302272 00000020:00000040:1.0:1788201278.289550:0:8451:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c5ba 00000100:00100000:3.0:1788201278.289552:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715302528:0@lo:400:kworker.0 00000020:00000040:1.0:1788201278.289557:0:8451:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc0059d1800 refcount=5 00000100:00000040:3.0:1788201278.289563:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc133703800 x1875060715302528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.289569:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201278.289578:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005d54e00 x1875060715302528 msgsize 224 00000100:00100000:3.0:1788201278.289582:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788201278.289586:0:8451:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00000040:3.0:1788201278.289591:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc133703800 x1875060715302528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.289599:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8512 usecs (9 jiffies) 00000100:00000040:3.0:1788201278.289604:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc005d55500 x1875060715303040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201278.289617:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715303040:0@lo:400:kworker.0 00000100:00100000:1.0:1788201278.289619:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2374 00000100:00000040:1.0:1788201278.289623:0:8451:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc0059d1800 : new rpc_count 1 00000100:00000040:3.0:1788201278.289629:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc005d55500 x1875060715303040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201278.289631:0:8451:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc004eb6680 x1875060715302272/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:399/0 lens 224/0 e 0 to 0 dl 1788201289 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.289636:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201278.289647:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005d56a00 x1875060715303040 msgsize 224 00000100:00100000:1.0:1788201278.289649:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715302272:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201278.289650:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1788201278.289659:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc005d55500 x1875060715303040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.289666:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 83713 usecs (84 jiffies) 00000100:00100000:3.0:1788201278.289684:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715302400 00002000:00000024:1.0:1788201278.289687:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201278.289687:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715302400 00000020:00000040:3.0:1788201278.289689:0:94464:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4ef 00000020:00000040:3.0:1788201278.289691:0:94464:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc110735800 refcount=24 00010000:00000040:1.0:1788201278.289700:0:8451:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969457, transno 0, xid 1875060715302272 00000100:00000040:3.0:1788201278.289703:0:94464:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000040:1.0:1788201278.289712:0:8451:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00000040:1.0:1788201278.289717:0:8451:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:3.0:1788201278.289718:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00000040:3.0:1788201278.289721:0:94464:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc110735800 : new rpc_count 1 00000100:00000040:3.0:1788201278.289725:0:94464:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc007116050 x1875060715302400/t0(0) o400->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:399/0 lens 224/0 e 0 to 0 dl 1788201289 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201278.289733:0:8451:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8dc004eb5c00 x1875060715302272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201294 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201278.289735:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715302400:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1788201278.289744:0:94464:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715302400 00000100:00000040:1.0:1788201278.289746:0:8451:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00000040:3.0:1788201278.289748:0:94464:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00000040:1.0:1788201278.289750:0:8451:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc004eb6680 x1875060715302272/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:399/0 lens 224/368 e 0 to 0 dl 1788201289 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.289752:0:94464:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:1.0:1788201278.289758:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715302272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (656us total) trans 0 rc 0/0 00000100:00000040:3.0:1788201278.289763:0:94464:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc133701180 x1875060715302400/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.289777:0:94464:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00100000:1.0:1788201278.289781:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2374 00000100:00000040:3.0:1788201278.289781:0:94464:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc007116050 x1875060715302400/t0(0) o400->c9b18af6-fecc-4172-82c2-66531890fe11@0@lo:399/0 lens 224/224 e 0 to 0 dl 1788201289 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201278.289787:0:8451:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc0059d1800 : new rpc_count 0 00000100:00100000:3.0:1788201278.289798:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715302400:12345-0@lo:400:kworker.0 Request processed in 64us (438us total) trans 0 rc 0/0 00000020:00000040:1.0:1788201278.289801:0:8451:0:(genops.c:879:class_export_put()) PUTting export ffff8dc0059d1800 : new refcount 4 00000100:00100000:3.0:1788201278.289804:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00000040:3.0:1788201278.289806:0:94464:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc110735800 : new rpc_count 0 00000100:00100000:1.0:1788201278.289818:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715302784 00000100:00100000:1.0:1788201278.289821:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715302784 00000020:00000040:1.0:1788201278.289827:0:23728:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c54a 00000020:00000040:1.0:1788201278.289829:0:23728:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc103486000 refcount=7 00000100:00000040:1.0:1788201278.289846:0:23728:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:1.0:1788201278.289872:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4123 00000100:00000040:1.0:1788201278.289874:0:23728:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc103486000 : new rpc_count 1 00000100:00000040:1.0:1788201278.289879:0:23728:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc106048380 x1875060715302784/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:399/0 lens 224/0 e 0 to 0 dl 1788201289 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201278.289896:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715302784:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1788201278.289921:0:23728:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1875060715302784 00000100:00000040:1.0:1788201278.289926:0:23728:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00000040:1.0:1788201278.289928:0:23728:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201278.289954:0:23728:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc005d57800 x1875060715302784/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201278.289983:0:23728:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00000040:1.0:1788201278.289987:0:23728:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc106048380 x1875060715302784/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:399/0 lens 224/224 e 0 to 0 dl 1788201289 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201278.289995:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715302784:12345-0@lo:400:kworker.0 Request processed in 101us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201278.289999:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4123 00000100:00000040:1.0:1788201278.290002:0:23728:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc103486000 : new rpc_count 0 00000020:00000040:1.0:1788201278.290007:0:23728:0:(genops.c:879:class_export_put()) PUTting export ffff8dc103486000 : new refcount 6 00000100:00000040:1.0:1788201278.290053:0:3655:0:(events.c:337:request_in_callback()) incoming req@ffff8dc106049f80 x1875060715303296 msgsize 224 00000100:00100000:1.0:1788201278.290062:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1788201278.290071:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc005d55180 x1875060715303296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201278.290079:0:3655:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 21586 usecs (22 jiffies) 00000100:00000040:1.0:1788201278.290098:0:3655:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969457 00000100:00000040:1.0:1788201278.290103:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc004eb5c00 x1875060715302272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1788201278.290111:0:3655:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:1.0:1788201278.290114:0:3655:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261731 state=0: rc = 0 00000100:00000040:1.0:1788201278.290121:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc004eb5c00 x1875060715302272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201294 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201278.290127:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715302272:0@lo:13:osp-pre-1-0.0 00000100:00000040:1.0:1788201278.290132:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc004eb5c00 x1875060715302272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201294 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201278.290141:0:3655:0:(genops.c:1223:class_import_put()) import ffff8dc1257f0800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1788201278.290152:0:3655:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:1.0:1788201278.290156:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc005d57800 x1875060715302784/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201278.290162:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005d57800 x1875060715302784/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201278.290168:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715302784:0@lo:400:kworker.0 00000100:00000040:1.0:1788201278.290186:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc005d57800 x1875060715302784/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201278.290195:0:3655:0:(genops.c:1223:class_import_put()) import ffff8dc109813800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00100000:2.0:1788201278.291964:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715302656 00000100:00100000:2.0:1788201278.291974:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715302656 00000020:00000040:2.0:1788201278.291977:0:66313:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1644d 00000020:00000040:2.0:1788201278.291981:0:66313:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc10558f000 refcount=5 00000100:00000040:2.0:1788201278.292001:0:66313:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1788201278.292029:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715303168 00000100:00100000:2.0:1788201278.292032:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715303168 00000020:00000040:2.0:1788201278.292034:0:66313:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c6e0 00000020:00000040:2.0:1788201278.292037:0:66313:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc137d37000 refcount=5 00000100:00100000:2.0:1788201278.292047:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715303424 00000100:00100000:2.0:1788201278.292050:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715303424 00000020:00000040:2.0:1788201278.292051:0:66313:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d51f 00000020:00000040:2.0:1788201278.292054:0:66313:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc11cdde000 refcount=5 00000100:00100000:2.0:1788201278.292063:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715302528 00000100:00100000:2.0:1788201278.292065:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715302528 00000020:00000040:2.0:1788201278.292067:0:66313:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c6d2 00000020:00000040:2.0:1788201278.292068:0:66313:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc11cdda800 refcount=5 00000100:00100000:2.0:1788201278.292077:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715303040 00000100:00100000:2.0:1788201278.292079:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715303040 00000020:00000040:2.0:1788201278.292080:0:66313:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c6d9 00000020:00000040:2.0:1788201278.292081:0:66313:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc11d63e800 refcount=5 00000100:00100000:2.0:1788201278.292088:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715303296 00000100:00100000:2.0:1788201278.292090:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715303296 00000020:00000040:2.0:1788201278.292092:0:66313:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1d50a 00000020:00000040:2.0:1788201278.292094:0:66313:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc13aa99000 refcount=5 00000100:00100000:2.0:1788201278.292116:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1553 00000100:00000040:2.0:1788201278.292119:0:66313:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc10558f000 : new rpc_count 1 00000100:00000040:2.0:1788201278.292124:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc004eb4e00 x1875060715302656/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:399/0 lens 224/0 e 0 to 0 dl 1788201289 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201278.292136:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715302656:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788201278.292154:0:66313:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715302656 00000100:00000040:2.0:1788201278.292163:0:66313:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00000040:2.0:1788201278.292168:0:66313:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201278.292216:0:66313:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc005d55880 x1875060715302656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201278.292239:0:66313:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00000040:2.0:1788201278.292243:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc004eb4e00 x1875060715302656/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:399/0 lens 224/224 e 0 to 0 dl 1788201289 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201278.292251:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715302656:12345-0@lo:400:kworker.0 Request processed in 117us (3036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201278.292258:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1553 00000100:00000040:2.0:1788201278.292260:0:66313:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc10558f000 : new rpc_count 0 00000020:00000040:2.0:1788201278.292268:0:66313:0:(genops.c:879:class_export_put()) PUTting export ffff8dc10558f000 : new refcount 4 00000100:00100000:2.0:1788201278.292276:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1554 00000100:00000040:2.0:1788201278.292278:0:66313:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc137d37000 : new rpc_count 1 00000100:00000040:2.0:1788201278.292282:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc106048a80 x1875060715303168/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:399/0 lens 224/0 e 0 to 0 dl 1788201289 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201278.292291:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715303168:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788201278.292301:0:66313:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715303168 00000100:00000040:2.0:1788201278.292305:0:66313:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00000040:2.0:1788201278.292308:0:66313:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201278.292329:0:66313:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc005d55f80 x1875060715303168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201278.292340:0:66313:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00000040:2.0:1788201278.292344:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc106048a80 x1875060715303168/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:399/0 lens 224/224 e 0 to 0 dl 1788201289 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201278.292352:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715303168:12345-0@lo:400:kworker.0 Request processed in 62us (3062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201278.292359:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1554 00000100:00000040:2.0:1788201278.292361:0:66313:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc137d37000 : new rpc_count 0 00000020:00000040:2.0:1788201278.292367:0:66313:0:(genops.c:879:class_export_put()) PUTting export ffff8dc137d37000 : new refcount 4 00000100:00100000:2.0:1788201278.292376:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1555 00000100:00000040:2.0:1788201278.292378:0:66313:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc11cdde000 : new rpc_count 1 00000100:00000040:2.0:1788201278.292382:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005d56300 x1875060715303424/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:399/0 lens 224/0 e 0 to 0 dl 1788201289 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201278.292391:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715303424:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788201278.292399:0:66313:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715303424 00000100:00000040:2.0:1788201278.292403:0:66313:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00000040:2.0:1788201278.292406:0:66313:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201278.292420:0:66313:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc005d57480 x1875060715303424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201278.292433:0:66313:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00000040:2.0:1788201278.292437:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005d56300 x1875060715303424/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:399/0 lens 224/224 e 0 to 0 dl 1788201289 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201278.292444:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715303424:12345-0@lo:400:kworker.0 Request processed in 55us (2935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201278.292449:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1555 00000100:00000040:2.0:1788201278.292452:0:66313:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc11cdde000 : new rpc_count 0 00000020:00000040:2.0:1788201278.292461:0:66313:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11cdde000 : new refcount 4 00000100:00100000:2.0:1788201278.292471:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1556 00000100:00000040:2.0:1788201278.292473:0:66313:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc11cdda800 : new rpc_count 1 00000100:00000040:2.0:1788201278.292477:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005d54e00 x1875060715302528/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:399/0 lens 224/0 e 0 to 0 dl 1788201289 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201278.292487:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715302528:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788201278.292495:0:66313:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715302528 00000100:00000040:2.0:1788201278.292499:0:66313:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00000040:2.0:1788201278.292502:0:66313:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201278.292517:0:66313:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc133703800 x1875060715302528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201278.292529:0:66313:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00000040:2.0:1788201278.292533:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005d54e00 x1875060715302528/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:399/0 lens 224/224 e 0 to 0 dl 1788201289 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201278.292541:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715302528:12345-0@lo:400:kworker.0 Request processed in 56us (2961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201278.292546:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1556 00000100:00000040:2.0:1788201278.292548:0:66313:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc11cdda800 : new rpc_count 0 00000020:00000040:2.0:1788201278.292553:0:66313:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11cdda800 : new refcount 4 00000100:00100000:2.0:1788201278.292561:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1557 00000100:00000040:2.0:1788201278.292563:0:66313:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc11d63e800 : new rpc_count 1 00000100:00000040:2.0:1788201278.292567:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005d56a00 x1875060715303040/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:399/0 lens 224/0 e 0 to 0 dl 1788201289 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201278.292577:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715303040:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788201278.292584:0:66313:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715303040 00000100:00000040:2.0:1788201278.292587:0:66313:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00000040:2.0:1788201278.292595:0:66313:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201278.292609:0:66313:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc005d55500 x1875060715303040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201278.292621:0:66313:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00000040:2.0:1788201278.292624:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005d56a00 x1875060715303040/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:399/0 lens 224/224 e 0 to 0 dl 1788201289 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201278.292632:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715303040:12345-0@lo:400:kworker.0 Request processed in 57us (2983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201278.292637:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1557 00000100:00000040:2.0:1788201278.292639:0:66313:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc11d63e800 : new rpc_count 0 00000020:00000040:2.0:1788201278.292645:0:66313:0:(genops.c:879:class_export_put()) PUTting export ffff8dc11d63e800 : new refcount 4 00000100:00100000:2.0:1788201278.292653:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1558 00000100:00000040:2.0:1788201278.292655:0:66313:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc13aa99000 : new rpc_count 1 00000100:00000040:2.0:1788201278.292659:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc106049f80 x1875060715303296/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:399/0 lens 224/0 e 0 to 0 dl 1788201289 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201278.292668:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715303296:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1788201278.292677:0:66313:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060715303296 00000100:00000040:2.0:1788201278.292681:0:66313:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00000040:2.0:1788201278.292684:0:66313:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1788201278.292699:0:66313:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc005d55180 x1875060715303296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1788201278.292710:0:66313:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00000040:2.0:1788201278.292714:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc106049f80 x1875060715303296/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:399/0 lens 224/224 e 0 to 0 dl 1788201289 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201278.292722:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715303296:12345-0@lo:400:kworker.0 Request processed in 55us (2667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201278.292727:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1558 00000100:00000040:2.0:1788201278.292734:0:66313:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc13aa99000 : new rpc_count 0 00000020:00000040:2.0:1788201278.292740:0:66313:0:(genops.c:879:class_export_put()) PUTting export ffff8dc13aa99000 : new refcount 4 00000020:00000040:3.0:1788201278.293233:0:94464:0:(genops.c:879:class_export_put()) PUTting export ffff8dc110735800 : new refcount 23 00000100:00100000:3.0:1788201278.293278:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715302912 00000100:00100000:3.0:1788201278.293284:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715302912 00000020:00000040:3.0:1788201278.293286:0:26209:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a163d6 00000020:00000040:3.0:1788201278.293288:0:26209:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1201ce800 refcount=5 00000100:00100000:3.0:1788201278.293319:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2930 00000100:00000040:3.0:1788201278.293323:0:26209:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1201ce800 : new rpc_count 1 00000100:00000040:3.0:1788201278.293328:0:26209:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005d57100 x1875060715302912/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:399/0 lens 224/0 e 0 to 0 dl 1788201289 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201278.293339:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715302912:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1788201278.293348:0:26209:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 4294969442, transno 0, xid 1875060715302912 00000100:00000040:3.0:1788201278.293353:0:26209:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00000040:3.0:1788201278.293356:0:26209:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1788201278.293375:0:26209:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8dc005d57b80 x1875060715302912/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.293389:0:26209:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00000040:3.0:1788201278.293392:0:26209:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005d57100 x1875060715302912/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:399/0 lens 224/224 e 0 to 0 dl 1788201289 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201278.293400:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715302912:12345-0@lo:400:kworker.0 Request processed in 63us (3963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201278.293405:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2930 00000100:00000040:3.0:1788201278.293407:0:26209:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1201ce800 : new rpc_count 0 00000020:00000040:3.0:1788201278.293417:0:26209:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1201ce800 : new refcount 4 00000100:00000040:3.0:1788201278.293453:0:3657:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:3.0:1788201278.293458:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc133703800 x1875060715302528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.293468:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc133703800 x1875060715302528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201278.293475:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715302528:0@lo:400:kworker.0 00000100:00000040:3.0:1788201278.293484:0:3657:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:3.0:1788201278.293488:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc005d55500 x1875060715303040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.293496:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005d55500 x1875060715303040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201278.293503:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715303040:0@lo:400:kworker.0 00000100:00000040:3.0:1788201278.293512:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc133701180 x1875060715302400/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.293519:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc133701180 x1875060715302400/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201278.293526:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715302400:0@lo:400:kworker.0 00000100:00000040:3.0:1788201278.293533:0:3657:0:(client.c:3121:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969442 00000100:00000040:3.0:1788201278.293536:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc005d57b80 x1875060715302912/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.293544:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005d57b80 x1875060715302912/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201278.293550:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715302912:0@lo:400:kworker.0 00000100:00000040:3.0:1788201278.293566:0:3657:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:3.0:1788201278.293570:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc005d57480 x1875060715303424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1788201278.293578:0:3657:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005d57480 x1875060715303424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201278.293585:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715303424:0@lo:400:kworker.0 00000100:00000040:3.0:1788201278.293591:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc133703800 x1875060715302528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201278.293600:0:3657:0:(genops.c:1223:class_import_put()) import ffff8dc0034f0000 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:3.0:1788201278.293608:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc005d55500 x1875060715303040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201278.293615:0:3657:0:(genops.c:1223:class_import_put()) import ffff8dc001db0000 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:3.0:1788201278.293620:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc133701180 x1875060715302400/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201278.293627:0:3657:0:(genops.c:1223:class_import_put()) import ffff8dc104280800 refcount=3 obd=MGC192.168.201.120@tcp 00000100:00000040:3.0:1788201278.293631:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc005d57b80 x1875060715302912/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201278.293637:0:3657:0:(genops.c:1223:class_import_put()) import ffff8dc1031f8800 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:3.0:1788201278.293642:0:3657:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc005d57480 x1875060715303424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1788201278.293647:0:3657:0:(genops.c:1223:class_import_put()) import ffff8dc13f869000 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000020:00000040:1.0:1788201278.294957:0:75746:0:(genops.c:1210:class_import_get()) import ffff8dc109813800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1788201278.295001:0:75746:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000bd8a9278] to pc [ptlrpcd_00_03+3] req@ffff8dc106049c00 x1875060715303552/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201278.295087:0:3655:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:1.0:1788201278.295093:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc005d55180 x1875060715303296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201278.295103:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005d55180 x1875060715303296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201278.295110:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715303296:0@lo:400:kworker.0 00000100:00000040:1.0:1788201278.295134:0:3655:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1788201278.295138:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc005d55f80 x1875060715303168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201278.295145:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005d55f80 x1875060715303168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201278.295150:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715303168:0@lo:400:kworker.0 00000100:00000040:1.0:1788201278.295160:0:3655:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:1.0:1788201278.295163:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc005d55880 x1875060715302656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201278.295170:0:3655:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005d55880 x1875060715302656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201278.295188:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715302656:0@lo:400:kworker.0 00000100:00000040:1.0:1788201278.295194:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc005d55180 x1875060715303296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201278.295202:0:3655:0:(genops.c:1223:class_import_put()) import ffff8dc004014000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:1.0:1788201278.295211:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc005d55f80 x1875060715303168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201278.295225:0:3655:0:(genops.c:1223:class_import_put()) import ffff8dc137d33000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:1.0:1788201278.295232:0:3655:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc005d55880 x1875060715302656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201294 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1788201278.295238:0:3655:0:(genops.c:1223:class_import_put()) import ffff8dc0034f2000 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:0.0:1788201278.295619:0:3658:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8dc106049c00 x1875060715303552/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201278.295637:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715303552:0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1788201278.295659:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8dc106049c00 x1875060715303552/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201294 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201278.295666:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1788201278.295697:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff8dc13a480000 x1875060715303552 msgsize 224 00000100:00100000:0.0:1788201278.295702:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1788201278.295720:0:3658:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8dc106049c00 x1875060715303552/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201294 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1788201278.295733:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1306245 usecs (1307 jiffies) 00000100:00100000:1.0:1788201278.299090:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715303552 00000100:00100000:1.0:1788201278.299106:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715303552 00000020:00000040:1.0:1788201278.299109:0:8458:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c54a 00000020:00000040:1.0:1788201278.299114:0:8458:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc103486000 refcount=7 00000100:00000040:1.0:1788201278.299141:0:8458:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:1.0:1788201278.299184:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4124 00000100:00000040:1.0:1788201278.299189:0:8458:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc103486000 : new rpc_count 1 00000100:00000040:1.0:1788201278.299197:0:8458:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc13a480000 x1875060715303552/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:399/0 lens 224/0 e 0 to 0 dl 1788201289 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201278.299210:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715303552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201278.299245:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00010000:00000040:1.0:1788201278.299259:0:8458:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 120259084300, transno 0, xid 1875060715303552 00000100:00000040:1.0:1788201278.299268:0:8458:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc125a970c0 refcount 66 to 0@lo 00000100:00000040:1.0:1788201278.299273:0:8458:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1788201278.299317:0:8458:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8dc106049c00 x1875060715303552/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201294 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1788201278.299345:0:8458:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc125a970c0 refcount 65 to 0@lo 00000100:00000040:1.0:1788201278.299350:0:8458:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc13a480000 x1875060715303552/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:399/0 lens 224/368 e 0 to 0 dl 1788201289 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201278.299358:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715303552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (3659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201278.299365:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4124 00000100:00000040:1.0:1788201278.299368:0:8458:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc103486000 : new rpc_count 0 00000020:00000040:1.0:1788201278.299386:0:8458:0:(genops.c:879:class_export_put()) PUTting export ffff8dc103486000 : new refcount 6 00000100:00000040:0.0:1788201278.299933:0:3658:0:(client.c:3121:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084300 00000100:00000040:0.0:1788201278.299942:0:3658:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8dc106049c00 x1875060715303552/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1788201278.299959:0:3658:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352767 avail=317064 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023575 state=0: rc = 0 00000100:00000040:0.0:1788201278.299966:0:3658:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc106049c00 x1875060715303552/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201294 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201278.299972:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715303552:0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1788201278.299980:0:3658:0:(client.c:2875:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8dc106049c00 x1875060715303552/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1788201294 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1788201278.299989:0:3658:0:(genops.c:1223:class_import_put()) import ffff8dc109813800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1788201278.419712:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff8dc007115c50 x1875060695490432 msgsize 224 00000100:00100000:3.0:1788201278.419725:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00000040:3.0:1788201278.419728:0:3650:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1788201278.419767:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005d57480 x1875060695490688 msgsize 224 00000100:00100000:3.0:1788201278.419773:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00000040:3.0:1788201278.419820:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005d57b80 x1875060695490560 msgsize 224 00000100:00100000:3.0:1788201278.419826:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00000040:3.0:1788201278.419850:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff8dc005d55500 x1875060695490816 msgsize 224 00000100:00100000:3.0:1788201278.419855:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201278.419995:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695490688 00000100:00100000:2.0:1788201278.420005:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695490688 00000020:00000040:2.0:1788201278.420009:0:66313:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1bb4f 00000100:00100000:1.0:1788201278.420056:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695490432 00000100:00100000:1.0:1788201278.420061:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695490432 00000020:00000040:1.0:1788201278.420063:0:94467:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c4cc 00000020:00000040:1.0:1788201278.420066:0:94467:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc13aa9c000 refcount=10 00000100:00000040:1.0:1788201278.420086:0:94467:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1788201278.420119:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 219 00000100:00000040:1.0:1788201278.420123:0:94467:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc13aa9c000 : new rpc_count 1 00000100:00000040:1.0:1788201278.420131:0:94467:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc007115c50 x1875060695490432/t0(0) o400->93ba7067-43b5-4e46-8db7-27c040fa03d9@192.168.201.20@tcp:399/0 lens 224/0 e 0 to 0 dl 1788201289 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201278.420144:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695490432:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000040:1.0:1788201278.420162:0:94467:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060695490432 00000100:00000040:1.0:1788201278.420181:0:94467:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:1.0:1788201278.420186:0:94467:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:1.0:1788201278.420230:0:94467:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00000100:00000040:1.0:1788201278.420235:0:94467:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc007115c50 x1875060695490432/t0(0) o400->93ba7067-43b5-4e46-8db7-27c040fa03d9@192.168.201.20@tcp:399/0 lens 224/224 e 0 to 0 dl 1788201289 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201278.420245:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695490432:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 102us (533us total) trans 0 rc 0/0 00000020:00000040:2.0:1788201278.420246:0:66313:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc12e647000 refcount=11 00000100:00100000:1.0:1788201278.420252:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 219 00000100:00000040:1.0:1788201278.420254:0:94467:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc13aa9c000 : new rpc_count 0 00000020:00000040:2.0:1788201278.420258:0:66313:0:(obd_config.c:995:class_incref()) incref lustre-MDT0001 (ffff8dc1060e4d28) now 12 - evictor 00000020:00000040:1.0:1788201278.420265:0:94467:0:(genops.c:879:class_export_put()) PUTting export ffff8dc13aa9c000 : new refcount 9 00000100:00000040:2.0:1788201278.420274:0:66313:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1788201278.420290:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695490560 00000100:00100000:2.0:1788201278.420293:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695490560 00000020:00000040:2.0:1788201278.420294:0:66313:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c551 00000020:00000040:2.0:1788201278.420297:0:66313:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc103483800 refcount=51 00000020:00000040:2.0:1788201278.420304:0:66313:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (ffff8dc13f870000) now 16 - evictor 00000100:00100000:2.0:1788201278.420897:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1559 00000100:00000040:2.0:1788201278.420901:0:66313:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc12e647000 : new rpc_count 1 00000100:00000040:2.0:1788201278.420906:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005d57480 x1875060695490688/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:399/0 lens 224/0 e 0 to 0 dl 1788201289 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201278.420920:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695490688:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000040:2.0:1788201278.420935:0:66313:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 77309411473, transno 0, xid 1875060695490688 00000100:00000040:2.0:1788201278.420941:0:66313:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:2.0:1788201278.420945:0:66313:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:2.0:1788201278.421011:0:66313:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00000100:00000040:2.0:1788201278.421035:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005d57480 x1875060695490688/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:399/0 lens 224/224 e 0 to 0 dl 1788201289 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201278.421044:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695490688:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 127us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201278.421051:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1559 00000100:00000040:2.0:1788201278.421053:0:66313:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc12e647000 : new rpc_count 0 00000020:00000040:2.0:1788201278.421068:0:66313:0:(genops.c:879:class_export_put()) PUTting export ffff8dc12e647000 : new refcount 10 00000100:00100000:2.0:1788201278.421079:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1560 00000100:00000040:2.0:1788201278.421082:0:66313:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc103483800 : new rpc_count 1 00000100:00000040:2.0:1788201278.421086:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005d57b80 x1875060695490560/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:399/0 lens 224/0 e 0 to 0 dl 1788201289 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201278.421097:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2403:x1875060695490560:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000040:2.0:1788201278.421108:0:66313:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 124554051730, transno 0, xid 1875060695490560 00000100:00000040:2.0:1788201278.421113:0:66313:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:2.0:1788201278.421116:0:66313:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:2.0:1788201278.421130:0:66313:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00000100:00000040:2.0:1788201278.421135:0:66313:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005d57b80 x1875060695490560/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:399/0 lens 224/224 e 0 to 0 dl 1788201289 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201278.421143:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2403:x1875060695490560:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 47us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201278.421150:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1560 00000100:00000040:2.0:1788201278.421153:0:66313:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc103483800 : new rpc_count 0 00000020:00000040:2.0:1788201278.421158:0:66313:0:(genops.c:879:class_export_put()) PUTting export ffff8dc103483800 : new refcount 50 00000100:00080000:1.0:1788201278.428322:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:1.0:1788201278.428331:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (ffff8dc13f870000) now 16 - evictor 00000100:00080000:1.0:1788201278.428336:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1788201278.428338:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0001 (ffff8dc1060e4d28) now 12 - evictor 00000100:00100000:1.0:1788201278.428358:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695490816 00000100:00100000:1.0:1788201278.428368:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695490816 00000020:00000040:1.0:1788201278.428379:0:8491:0:(genops.c:804:class_conn2export()) looking for export cookie 0x96d0c9b8c9a1c8e6 00000020:00000040:1.0:1788201278.428382:0:8491:0:(lustre_handles.c:148:class_handle2object()) GET export ffff8dc1401c6800 refcount=7 00000020:00000040:1.0:1788201278.428397:0:8491:0:(obd_config.c:995:class_incref()) incref lustre-OST0001 (ffff8dc139bbcd28) now 10 - evictor 00000100:00100000:1.0:1788201278.428460:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2931 00000100:00000040:1.0:1788201278.428465:0:8491:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff8dc1401c6800 : new rpc_count 1 00000100:00000040:1.0:1788201278.428474:0:8491:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8dc005d55500 x1875060695490816/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:399/0 lens 224/0 e 0 to 0 dl 1788201289 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201278.428489:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695490816:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000040:1.0:1788201278.428510:0:8491:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1875060695490816 00000100:00000040:1.0:1788201278.428521:0:8491:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8dc140da5c80 refcount 11 to 192.168.201.20@tcp 00000100:00000040:1.0:1788201278.428527:0:8491:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.201.20@tcp 00000100:00000040:1.0:1788201278.428571:0:8491:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=ffff8dc140da5c80 refcount 10 to 192.168.201.20@tcp 00000100:00000040:1.0:1788201278.428577:0:8491:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8dc005d55500 x1875060695490816/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:399/0 lens 224/224 e 0 to 0 dl 1788201289 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201278.428585:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695490816:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 100us (8733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201278.428591:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2931 00000100:00000040:1.0:1788201278.428594:0:8491:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8dc1401c6800 : new rpc_count 0 00000020:00000040:1.0:1788201278.428605:0:8491:0:(genops.c:879:class_export_put()) PUTting export ffff8dc1401c6800 : new refcount 6 00000100:00080000:1.0:1788201278.428621:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1788201278.428623:0:6528:0:(obd_config.c:1023:class_decref()) Decref lustre-OST0001 (ffff8dc139bbcd28) now 10 - evictor 00000001:02000400:0.0:1788201278.562463:0:97392:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788201279.247256:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788201279.819918:0:97444:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788201279.820176:0:97444:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788201280.274477:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201280.849937:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201280.849963:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715303680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201280.850086:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201280.850366:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715303680 00000100:00100000:3.0:1788201280.850375:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715303680 00000100:00100000:3.0:1788201280.850445:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2375 00000100:00100000:3.0:1788201280.850454:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715303680:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788201280.850488:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1788201280.850488:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201280.850549:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715303680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201280.850557:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2375 00000100:00100000:1.0:1788201280.850637:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715303680:0@lo:13:osp-pre-1-1.0 00000020:00000004:1.0:1788201281.001138:0:97495:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788201281.001401:0:97495:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788201281.308183:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201282.324339:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201282.898792:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201282.898817:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715303808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201282.898881:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201282.898967:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715303808 00000100:00100000:2.0:1788201282.898974:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715303808 00000100:00100000:2.0:1788201282.899061:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4125 00000100:00100000:2.0:1788201282.899070:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715303808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201282.899129:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:2.0:1788201282.899172:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715303808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201282.899179:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4125 00000100:00100000:3.0:1788201282.899319:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715303808:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788201283.347610:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201283.407425:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715303936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201283.407519:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201283.407636:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715303936 00000100:00100000:1.0:1788201283.407646:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715303936 00000100:00100000:1.0:1788201283.407735:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2376 00000100:00100000:1.0:1788201283.407746:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715303936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201283.407775:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201283.407825:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715303936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201283.407855:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2376 00000100:00100000:1.0:1788201283.407908:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715303936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201283.408279:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201283.408288:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715304064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201283.408320:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201283.408350:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715304064 00000100:00100000:1.0:1788201283.408353:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715304064 00000100:00100000:1.0:1788201283.408383:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4126 00000100:00100000:1.0:1788201283.408391:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715304064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201283.408417:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:1.0:1788201283.408454:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715304064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201283.408461:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4126 00000100:00100000:1.0:1788201283.408490:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715304064:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788201283.408663:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201283.413194:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715304192:0@lo:400:kworker.0 00000100:00100000:3.0:1788201283.413271:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201283.413409:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715304320:0@lo:400:kworker.0 00000100:00100000:1.0:1788201283.413444:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201283.415248:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715304192 00000100:00100000:0.0:1788201283.415261:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715304192 00000100:00100000:0.0:1788201283.415333:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788201283.415342:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715304192:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788201283.419119:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201283.419125:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:2.0:1788201283.419151:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201283.419155:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:2.0:1788201283.419205:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715304320 00000100:00100000:2.0:1788201283.419214:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715304320 00000100:00100000:2.0:1788201283.419277:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1561 00000100:00100000:2.0:1788201283.419289:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715304320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201283.419378:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715304320:12345-0@lo:400:kworker.0 Request processed in 93us (5933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201283.419385:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1561 00000100:00100000:2.0:1788201283.419426:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715304576:0@lo:400:kworker.0 00000100:00100000:2.0:1788201283.419460:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201283.419484:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715305088:0@lo:400:kworker.0 00000100:00100000:2.0:1788201283.419503:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201283.419519:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788201283.419524:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715304448:0@lo:400:kworker.0 00000100:00100000:2.0:1788201283.419542:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201283.419553:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715304960:0@lo:400:kworker.0 00000100:00100000:2.0:1788201283.419586:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201283.419608:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715304576 00000100:00100000:2.0:1788201283.419611:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715304576 00000100:00100000:2.0:1788201283.419637:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2932 00000100:00100000:2.0:1788201283.419643:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715304576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201283.419670:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715304576:12345-0@lo:400:kworker.0 Request processed in 28us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201283.419676:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2932 00000100:00100000:2.0:1788201283.419690:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715305088 00000100:00100000:2.0:1788201283.419693:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715305088 00000100:00100000:2.0:1788201283.419709:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715304448 00000100:00100000:2.0:1788201283.419711:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715304448 00000100:00100000:2.0:1788201283.419722:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715304960 00000100:00100000:2.0:1788201283.419724:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715304960 00000100:00100000:2.0:1788201283.419735:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1562 00000100:00100000:2.0:1788201283.419740:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715305088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201283.419764:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715305088:12345-0@lo:400:kworker.0 Request processed in 23us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201283.419769:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1562 00000100:00100000:2.0:1788201283.419778:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1563 00000100:00100000:2.0:1788201283.419783:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715304448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201283.419801:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715304448:12345-0@lo:400:kworker.0 Request processed in 18us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201283.419806:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1563 00000100:00100000:2.0:1788201283.419814:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1564 00000100:00100000:2.0:1788201283.419820:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715304960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201283.423215:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715304960:12345-0@lo:400:kworker.0 Request processed in 3384us (3616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201283.423247:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1564 00000100:00100000:2.0:1788201283.423341:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715304448:0@lo:400:kworker.0 00000100:00100000:2.0:1788201283.423354:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715304960:0@lo:400:kworker.0 00000100:00100000:2.0:1788201283.423367:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715304576:0@lo:400:kworker.0 00000100:00100000:2.0:1788201283.423379:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715305088:0@lo:400:kworker.0 00000100:00080000:2.0:1788201283.423545:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201283.423552:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201283.423555:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201283.423571:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715304832:0@lo:400:kworker.0 00000100:00100000:2.0:1788201283.423610:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201283.423658:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715304320:0@lo:400:kworker.0 00000100:00100000:2.0:1788201283.423675:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201283.423682:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715304704:0@lo:400:kworker.0 00000100:00100000:2.0:1788201283.423708:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201283.423740:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715304832 00000100:00100000:2.0:1788201283.423746:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715304832 00000100:00100000:2.0:1788201283.423779:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715304704 00000100:00100000:2.0:1788201283.423782:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715304704 00000100:00100000:2.0:1788201283.423802:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1565 00000100:00100000:2.0:1788201283.423811:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715304832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201283.424147:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1566 00000100:00100000:1.0:1788201283.424157:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715304704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201283.426467:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715304704:12345-0@lo:400:kworker.0 Request processed in 2302us (2748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201283.426495:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1566 00000100:00100000:1.0:1788201283.426564:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715304704:0@lo:400:kworker.0 00000100:00100000:2.0:1788201283.432742:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715304832:12345-0@lo:400:kworker.0 Request processed in 8922us (9121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201283.432759:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1565 00000100:00100000:1.0:1788201283.432893:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715304832:0@lo:400:kworker.0 00000100:00100000:3.0:1788201283.440148:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715304192:0@lo:400:kworker.0 00000100:00100000:0.0:1788201283.444585:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715304192:12345-0@lo:400:kworker.0 Request processed in 29234us (31304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201283.444600:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788201283.542262:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201283.542316:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201283.542346:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201283.542373:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201283.542409:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695491200 00000100:00100000:3.0:1788201283.542419:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695491200 00000100:00100000:2.0:1788201283.542446:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695490944 00000100:00100000:2.0:1788201283.542456:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695490944 00000100:00100000:3.0:1788201283.542476:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695491072 00000100:00100000:3.0:1788201283.542478:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695491072 00000100:00100000:2.0:1788201283.542483:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 221 00000100:00100000:2.0:1788201283.542492:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12e6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695490944:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201283.542498:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1567 00000100:00100000:3.0:1788201283.542503:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695491200:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201283.542556:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12e6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695490944:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 64us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201283.542564:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 221 00000100:00100000:0.0:1788201283.542577:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1568 00000100:00100000:0.0:1788201283.542587:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2403:x1875060695491072:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201283.542593:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695491328 00000100:00100000:2.0:1788201283.542596:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695491328 00000100:00100000:2.0:1788201283.542622:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2933 00000100:00100000:2.0:1788201283.542628:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695491328:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201283.547057:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695491200:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 4535us (4722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201283.547074:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1567 00000100:00100000:0.0:1788201283.548004:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2403:x1875060695491072:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 5413us (5650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201283.548041:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1568 00000100:00080000:3.0:1788201283.548542:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201283.548549:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201283.548552:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201283.548625:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695491328:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 5993us (6246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201283.548636:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2933 00010000:00010000:2.0:1788201284.370171:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201285.391493:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201285.969052:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715305216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201285.969124:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201285.969219:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715305216 00000100:00100000:3.0:1788201285.969228:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715305216 00000100:00100000:3.0:1788201285.969293:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2377 00000100:00100000:3.0:1788201285.969304:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715305216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201285.969343:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201285.969419:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715305216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201285.969426:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2377 00000100:00100000:0.0:1788201285.969775:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715305216:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788201285.969941:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788201286.421109:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201287.253635:0:97687:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-client.virtnet: executing wait_import_state_mount REPLAY_LOCKS osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 00010000:00010000:0.0:1788201287.440699:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201288.015671:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715305344:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201288.015748:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201288.015841:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715305344 00000100:00100000:0.0:1788201288.015850:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715305344 00000100:00100000:0.0:1788201288.015905:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4127 00000100:00100000:0.0:1788201288.015915:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715305344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201288.015949:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:0.0:1788201288.020209:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715305344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4286us (4451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201288.020224:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4127 00000100:00100000:1.0:1788201288.021703:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715305344:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788201288.464849:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201288.527483:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201288.527490:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:3.0:1788201288.527514:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201288.527517:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:3.0:1788201288.527570:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715305472:0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.527638:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201288.527695:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715305984:0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.527720:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201288.527740:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715306496:0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.527774:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201288.527799:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788201288.527806:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715305600:0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.527826:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201288.527841:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715306112:0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.527859:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201288.527875:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715306624:0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.527894:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201288.527920:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715305728:0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.527940:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201288.527954:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715306240:0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.527972:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201288.527989:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788201288.528004:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715305856:0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.528051:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201288.528070:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715306368:0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.528101:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201288.528128:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715305984 00000100:00100000:3.0:1788201288.528135:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715305984 00000100:00100000:3.0:1788201288.528180:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715306240 00000100:00100000:3.0:1788201288.528183:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715306240 00000100:00100000:3.0:1788201288.528201:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2934 00000100:00100000:3.0:1788201288.528210:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715305984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.528259:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715305984:12345-0@lo:400:kworker.0 Request processed in 50us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201288.528265:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2934 00000100:00100000:3.0:1788201288.528280:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2935 00000100:00100000:3.0:1788201288.528285:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715306240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.528324:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715306240:12345-0@lo:400:kworker.0 Request processed in 38us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201288.528330:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2935 00000100:00100000:3.0:1788201288.528347:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715306496 00000100:00100000:3.0:1788201288.528351:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715306496 00000100:00100000:3.0:1788201288.528372:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715305600 00000100:00100000:3.0:1788201288.528374:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715305600 00000100:00100000:3.0:1788201288.528385:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715306112 00000100:00100000:3.0:1788201288.528388:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715306112 00000100:00100000:3.0:1788201288.528397:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715306624 00000100:00100000:3.0:1788201288.528399:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715306624 00000100:00100000:3.0:1788201288.528409:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715305728 00000100:00100000:3.0:1788201288.528412:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715305728 00000100:00100000:3.0:1788201288.528423:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715306368 00000100:00100000:3.0:1788201288.528425:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715306368 00000100:00100000:3.0:1788201288.528435:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1569 00000100:00100000:3.0:1788201288.528441:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715306496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.528480:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715306496:12345-0@lo:400:kworker.0 Request processed in 39us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201288.528486:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1569 00000100:00100000:3.0:1788201288.528499:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1570 00000100:00100000:3.0:1788201288.528504:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715305600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.528530:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715305600:12345-0@lo:400:kworker.0 Request processed in 25us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201288.528535:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1570 00000100:00100000:3.0:1788201288.528546:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1571 00000100:00100000:3.0:1788201288.528551:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715306112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.528576:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715306112:12345-0@lo:400:kworker.0 Request processed in 24us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201288.528581:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1571 00000100:00100000:3.0:1788201288.528591:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1572 00000100:00100000:3.0:1788201288.528596:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715306624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.528619:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715306624:12345-0@lo:400:kworker.0 Request processed in 23us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201288.528624:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1572 00000100:00100000:3.0:1788201288.528633:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1573 00000100:00100000:3.0:1788201288.528638:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715305728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.528658:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715305728:12345-0@lo:400:kworker.0 Request processed in 20us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201288.528663:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1573 00000100:00100000:3.0:1788201288.528672:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1574 00000100:00100000:3.0:1788201288.528676:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715306368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.528703:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715306368:12345-0@lo:400:kworker.0 Request processed in 26us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201288.528708:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1574 00000100:00100000:3.0:1788201288.528740:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715305856 00000100:00100000:3.0:1788201288.528744:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715305856 00000100:00100000:3.0:1788201288.528765:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4128 00000100:00100000:3.0:1788201288.528771:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715305856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.528797:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715305856:12345-0@lo:400:kworker.0 Request processed in 26us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201288.528802:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4128 00000100:00080000:3.0:1788201288.528815:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201288.528819:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201288.528822:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201288.528856:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715305856:0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.528866:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715306368:0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.528874:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715305728:0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.528882:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715306240:0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.528916:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715305600:0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.528926:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715306112:0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.528934:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715306624:0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.528943:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715305984:0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.528951:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715306496:0@lo:400:kworker.0 00000100:00100000:1.0:1788201288.530464:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715305472 00000100:00100000:1.0:1788201288.530474:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715305472 00000100:00100000:1.0:1788201288.530519:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788201288.530528:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12e6ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715305472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201288.530598:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12e6ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715305472:12345-0@lo:400:kworker.0 Request processed in 72us (2960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201288.530605:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788201288.530741:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201288.530753:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715306752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201288.531604:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201288.531645:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715306752 00000100:00100000:3.0:1788201288.531649:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715306752 00000100:00100000:3.0:1788201288.531680:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2378 00000100:00100000:3.0:1788201288.531687:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715306752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201288.531711:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201288.531744:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715306752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201288.531750:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2378 00000100:00100000:3.0:1788201288.531931:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715306752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201288.531958:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715305472:0@lo:400:kworker.0 00000100:00100000:3.0:1788201288.534972:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715306880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201288.535071:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201288.535298:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715306880 00000100:00100000:2.0:1788201288.535316:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715306880 00000100:00100000:2.0:1788201288.535370:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4129 00000100:00100000:2.0:1788201288.535379:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715306880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201288.535412:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:2.0:1788201288.539366:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715306880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3975us (4284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201288.539382:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4129 00000100:00100000:3.0:1788201288.543547:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715306880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201288.663483:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201288.663531:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201288.663561:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201288.663603:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201288.663634:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695491840 00000100:00100000:0.0:1788201288.663644:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695491840 00000100:00100000:0.0:1788201288.663718:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2936 00000100:00100000:0.0:1788201288.663727:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695491840:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201288.663848:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695491712 00000100:00100000:1.0:1788201288.663853:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695491712 00000100:00100000:1.0:1788201288.663887:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695491584 00000100:00100000:1.0:1788201288.663892:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695491584 00000100:00100000:1.0:1788201288.663913:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1575 00000100:00100000:1.0:1788201288.663919:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695491712:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201288.664051:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695491712:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 97us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201288.664059:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1575 00000100:00100000:1.0:1788201288.664086:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1576 00000100:00100000:1.0:1788201288.664093:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2403:x1875060695491584:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201288.664126:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2403:x1875060695491584:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 33us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201288.664134:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1576 00000100:00100000:2.0:1788201288.664785:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695491456 00000100:00100000:2.0:1788201288.664792:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695491456 00000100:00100000:2.0:1788201288.664838:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 223 00000100:00100000:2.0:1788201288.664846:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134207c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695491456:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201288.664895:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134207c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695491456:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 50us (1424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201288.664901:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 223 00000100:00080000:2.0:1788201288.664947:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201288.664951:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201288.664965:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201288.665264:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695491840:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 1536us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201288.665272:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2936 00000001:02000400:1.0:1788201289.275215:0:97736:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in REPLAY_LOCKS state after 0 sec 00010000:00010000:3.0:1788201289.493133:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201289.708658:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201289.708744:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695491968 00000100:00100000:2.0:1788201289.708755:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695491968 00000100:00100000:2.0:1788201289.708807:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2937 00000100:00100000:2.0:1788201289.708818:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2399:x1875060695491968:12345-192.168.201.20@tcp:8:ptlrpcd_rcv.0 00010000:02000400:2.0:1788201289.708849:0:26199:0:(ldlm_lib.c:974:target_handle_reconnect()) lustre-OST0000: Client 6e293f14-c501-4bc5-9dd4-a18ef02756b4 (at 192.168.201.20@tcp) reconnected, waiting for 3 clients in recovery for 1:24 00010000:00080000:2.0:1788201289.729257:0:26199:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp recovering/t4294969479 exp ffff8dc1401c7000 cur 4141 last 1788201289 00002000:00100000:2.0:1788201289.729292:0:26199:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6e293f14-c501-4bc5-9dd4-a18ef02756b4/ffff8dc1401c7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 573440 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788201289.729313:0:26199:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli 192.168.201.20@tcp supports cksum type f7, return f7 00000100:00080000:2.0:1788201289.729340:0:26199:0:(import.c:65:import_set_state_nolock()) ffff8dc0059d2800 : changing import state from FULL to RECOVER 00000100:00080000:2.0:1788201289.729350:0:26199:0:(import.c:65:import_set_state_nolock()) ffff8dc0059d2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201289.729434:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2399:x1875060695491968:12345-192.168.201.20@tcp:8:ptlrpcd_rcv.0 Request processed in 20617us (20784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201289.729445:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2937 00000100:00100000:2.0:1788201289.740096:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201289.740126:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201289.740143:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201289.740158:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201289.740180:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201289.740195:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201289.740209:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201289.740228:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201289.740251:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695492096 00000100:00100000:2.0:1788201289.740259:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695492096 00000100:00100000:2.0:1788201289.740308:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695492224 00000100:00100000:2.0:1788201289.740311:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695492224 00000100:00100000:2.0:1788201289.740323:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695492352 00000100:00100000:2.0:1788201289.740326:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695492352 00000100:00100000:2.0:1788201289.740339:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695492480 00000100:00100000:2.0:1788201289.740341:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695492480 00000100:00100000:2.0:1788201289.740353:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695492608 00000100:00100000:2.0:1788201289.740355:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695492608 00000100:00100000:2.0:1788201289.740365:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695492736 00000100:00100000:2.0:1788201289.740367:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695492736 00000100:00100000:2.0:1788201289.740378:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695492864 00000100:00100000:2.0:1788201289.740380:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695492864 00000100:00100000:2.0:1788201289.740391:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695492992 00000100:00100000:2.0:1788201289.740393:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695492992 00000100:00100000:2.0:1788201289.740409:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6000 00000100:00100000:2.0:1788201289.740418:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695492096:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1788201289.740436:0:26209:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc007158000 x1875060695492096/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:410/0 lens 328/0 e 0 to 0 dl 1788201300 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201289.740453:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695492096:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 37us (367us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201289.740460:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6000 00000100:00100000:2.0:1788201289.740468:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6001 00000100:00100000:2.0:1788201289.740473:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695492224:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1788201289.740485:0:26209:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc007159f80 x1875060695492224/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:410/0 lens 328/0 e 0 to 0 dl 1788201300 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201289.740494:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695492224:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 22us (369us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201289.740501:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6001 00000100:00100000:2.0:1788201289.740507:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6002 00000100:00100000:2.0:1788201289.740512:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695492352:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1788201289.740517:0:26209:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc007158700 x1875060695492352/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:410/0 lens 328/0 e 0 to 0 dl 1788201300 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201289.740525:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695492352:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 14us (383us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201289.740530:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6002 00000100:00100000:2.0:1788201289.740536:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6003 00000100:00100000:2.0:1788201289.740540:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695492480:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1788201289.740545:0:26209:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc00715b100 x1875060695492480/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:410/0 lens 328/0 e 0 to 0 dl 1788201300 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201289.740553:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695492480:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 13us (395us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201289.740558:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6003 00000100:00100000:2.0:1788201289.740563:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6004 00000100:00100000:2.0:1788201289.740567:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695492608:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1788201289.740573:0:26209:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc00715b480 x1875060695492608/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:410/0 lens 328/0 e 0 to 0 dl 1788201300 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201289.740586:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695492608:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 18us (405us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201289.740591:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6004 00000100:00100000:2.0:1788201289.740597:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6005 00000100:00100000:2.0:1788201289.740601:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695492736:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1788201289.740607:0:26209:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc00715ad80 x1875060695492736/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:410/0 lens 328/0 e 0 to 0 dl 1788201300 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201289.740616:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695492736:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 15us (420us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201289.740621:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6005 00000100:00100000:2.0:1788201289.740626:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6006 00000100:00100000:2.0:1788201289.740630:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695492864:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1788201289.740636:0:26209:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc007158e00 x1875060695492864/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:410/0 lens 328/0 e 0 to 0 dl 1788201300 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201289.740643:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695492864:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 13us (434us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201289.740649:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6006 00000100:00100000:2.0:1788201289.740653:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6007 00000100:00100000:2.0:1788201289.740658:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695492992:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1788201289.740663:0:26209:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc12f6b1880 x1875060695492992/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:410/0 lens 328/0 e 0 to 0 dl 1788201300 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201289.740680:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695492992:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 22us (452us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201289.740685:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6007 00010000:00080000:2.0:1788201289.741478:0:97051:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788201289.741488:0:97051:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc007158000 x1875060695492096/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:410/0 lens 328/0 e 0 to 0 dl 1788201300 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788201289.741498:0:97051:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1788201289.741508:0:97051:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788201289.741510:0:97051:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788201289.741514:0:97051:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc007159f80 x1875060695492224/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:410/0 lens 328/0 e 0 to 0 dl 1788201300 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788201289.741521:0:97051:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1788201289.741524:0:97051:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788201289.741525:0:97051:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788201289.741528:0:97051:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc007158700 x1875060695492352/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:410/0 lens 328/0 e 0 to 0 dl 1788201300 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788201289.741534:0:97051:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1788201289.741537:0:97051:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788201289.741538:0:97051:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788201289.741541:0:97051:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc00715b100 x1875060695492480/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:410/0 lens 328/0 e 0 to 0 dl 1788201300 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788201289.741547:0:97051:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1788201289.741550:0:97051:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788201289.741551:0:97051:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788201289.741554:0:97051:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc00715b480 x1875060695492608/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:410/0 lens 328/0 e 0 to 0 dl 1788201300 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788201289.741561:0:97051:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1788201289.741571:0:97051:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788201289.741572:0:97051:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788201289.741576:0:97051:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc00715ad80 x1875060695492736/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:410/0 lens 328/0 e 0 to 0 dl 1788201300 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788201289.741583:0:97051:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1788201289.741586:0:97051:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788201289.741587:0:97051:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788201289.741590:0:97051:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc007158e00 x1875060695492864/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:410/0 lens 328/0 e 0 to 0 dl 1788201300 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788201289.741596:0:97051:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1788201289.741600:0:97051:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788201289.741601:0:97051:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788201289.741605:0:97051:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc12f6b1880 x1875060695492992/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:410/0 lens 328/0 e 0 to 0 dl 1788201300 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788201289.741611:0:97051:0:(ldlm_lib.c:2915:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1788201289.741614:0:97051:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00010000:2.0:1788201290.520463:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201291.090610:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201291.090630:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715307008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201291.090692:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201291.090737:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715307008 00000100:00100000:2.0:1788201291.090745:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715307008 00000100:00100000:2.0:1788201291.090799:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2379 00000100:00100000:2.0:1788201291.090809:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715307008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201291.090836:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201291.090871:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715307008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201291.090876:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2379 00000100:00080000:2.0:1788201291.090892:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201291.090924:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715307008:0@lo:13:osp-pre-1-1.0 00000020:01000004:3.0:1788201291.249685:0:97833:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788201291.249750:0:97833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbce00/0x96d0c9b8c9a1d4ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d4f5 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201291.249768:0:97833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbce00/0x96d0c9b8c9a1d4ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d4f5 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201291.249776:0:97833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbce00/0x96d0c9b8c9a1d4ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1d4f5 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201291.249804:0:97833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc006dbce00/0x96d0c9b8c9a1d4ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1d4f5 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201291.249826:0:97833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788201291.249831:0:97833:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788201291.249870:0:97833:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201291.249874:0:97833:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788201291.249881:0:97833:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788201291.249914:0:97833:0:(import.c:65:import_set_state_nolock()) ffff8dc004014000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788201291.250179:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201291.250186:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc006dbce00/0x96d0c9b8c9a1d4ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1d4f5 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201291.250196:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbce00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201291.250200:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc006dbce00/0x96d0c9b8c9a1d4ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1d4f5 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201291.250225:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc006dbce00/0x96d0c9b8c9a1d4ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1d4f5 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201291.250232:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc006dbce00/0x96d0c9b8c9a1d4ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1d4f5 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201291.250241:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201291.250244:0:24979:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788201291.250246:0:24979:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788201291.250653:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc006dbce00/0x96d0c9b8c9a1d4ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1d4f5 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201291.250661:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201291.250690:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc006dbce00/0x96d0c9b8c9a1d4ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1d4f5 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201291.250697:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc006dbce00/0x96d0c9b8c9a1d4ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1d4f5 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201291.250721:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201291.250723:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201291.250724:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201291.250741:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715307264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201291.250817:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201291.251093:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715307264 00000100:00100000:0.0:1788201291.251104:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715307264 00000100:00100000:0.0:1788201291.251167:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:0.0:1788201291.251645:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715307264:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201291.251723:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715307136:0@lo:39:umount.0 00000100:00100000:2.0:1788201291.251769:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201291.251817:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715307136 00000100:00100000:2.0:1788201291.251821:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715307136 00000100:00100000:2.0:1788201291.251869:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1605 00000100:00100000:2.0:1788201291.251879:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875060715307136:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788201291.251906:0:66313:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d50a 00000100:00080000:2.0:1788201291.251916:0:66313:0:(import.c:65:import_set_state_nolock()) ffff8dc13aa9e800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788201291.251988:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+1:3654:x1875060715307136:12345-0@lo:39:umount.0 Request processed in 112us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201291.251995:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1605 00000020:00000080:2.0:1788201291.252006:0:66313:0:(genops.c:885:class_export_put()) final put ffff8dc13aa99000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:0.0:1788201291.252241:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201291.252327:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140d59c00/0x96d0c9b8c9a1d4f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d4ee expref: 24 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201291.252343:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1788201291.252450:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788201291.252458:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201291.252489:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc004014000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788201291.252499:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715307136:0@lo:39:umount.0 00000100:00100000:0.0:1788201291.252641:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+23:3658:x1875060715307264:12345-0@lo:103:ldlm_bl.0 Request processed in 1204us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201291.252648:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:0.0:1788201291.252677:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715307264:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788201291.252769:0:97833:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201291.252773:0:97833:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788201291.252778:0:97833:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201291.253958:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13aa99000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788201291.254241:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc13aa9e800 for lustre-MDT0000 00000100:00080000:3.0:1788201291.254829:0:97833:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788201291.254835:0:97833:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788201291.254842:0:97833:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788201291.254864:0:97833:0:(import.c:65:import_set_state_nolock()) ffff8dc13f869000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788201291.255735:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715307392:0@lo:39:umount.0 00000100:00100000:2.0:1788201291.255802:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201291.256215:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715307392 00000100:00100000:1.0:1788201291.256224:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715307392 00000100:00080000:2.0:1788201291.256320:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201291.256408:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1606 00000100:00100000:1.0:1788201291.256419:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875060715307392:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788201291.256445:0:69485:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d51f 00000100:00080000:1.0:1788201291.256454:0:69485:0:(import.c:65:import_set_state_nolock()) ffff8dc001e29800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788201291.256533:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+1:3654:x1875060715307392:12345-0@lo:39:umount.0 Request processed in 116us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201291.256540:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1606 00000020:00000080:1.0:1788201291.256551:0:69485:0:(genops.c:885:class_export_put()) final put ffff8dc11cdde000/lustre-MDT0001-lwp-OST0000_UUID 00010000:00010000:2.0:1788201291.256593:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201291.258327:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f869000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788201291.258351:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715307392:0@lo:39:umount.0 00000100:00080000:3.0:1788201291.259373:0:97833:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788201291.259379:0:97833:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788201291.259386:0:97833:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788201291.260176:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11cdde000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00010000:00010000:3.0:1788201291.262898:0:97833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc600/0x96d0c9b8c9a1d4af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d4b6 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201291.262916:0:97833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc600/0x96d0c9b8c9a1d4af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d4b6 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201291.262923:0:97833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc600/0x96d0c9b8c9a1d4af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1d4b6 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201291.262959:0:97833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc600/0x96d0c9b8c9a1d4af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1d4b6 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201291.262984:0:97833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201291.262991:0:97833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1d4e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d4e7 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201291.262998:0:97833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1d4e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d4e7 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201291.263004:0:97833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1d4e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1d4e7 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201291.263010:0:97833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1d4e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1d4e7 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201291.263044:0:97833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788201291.263049:0:97833:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788201291.263096:0:97833:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788201291.263101:0:97833:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00000020:00000080:3.0:1788201291.263105:0:97833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1788201291.263111:0:97833:0:(obd_config.c:933:class_cleanup()) Failing over lustre-OST0000 00010000:00010000:1.0:1788201291.264387:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201291.264400:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc600/0x96d0c9b8c9a1d4af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1d4b6 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201291.264411:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc600 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201291.264416:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc600/0x96d0c9b8c9a1d4af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1d4b6 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201291.264426:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc600/0x96d0c9b8c9a1d4af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1d4b6 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201291.264448:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc600/0x96d0c9b8c9a1d4af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1d4b6 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201291.264454:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201291.264457:0:6521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788201291.264460:0:6521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788201291.264503:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc600/0x96d0c9b8c9a1d4af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1d4b6 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201291.264510:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201291.264537:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc600/0x96d0c9b8c9a1d4af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1d4b6 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201291.264544:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc600/0x96d0c9b8c9a1d4af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1d4b6 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201291.264562:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201291.264566:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1d4e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1d4e7 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201291.264572:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed400 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201291.264576:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1d4e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1d4e7 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201291.264583:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1d4e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1d4e7 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201291.264590:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1d4e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1d4e7 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201291.264606:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788201291.264608:0:6521:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788201291.264610:0:6521:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788201291.264625:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1d4e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1d4e7 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201291.264631:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201291.264638:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1d4e0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1d4e7 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201291.264644:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed400/0x96d0c9b8c9a1d4e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1d4e7 expref: -99 pid: 97034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201291.264655:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201291.264657:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201291.264658:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201291.264681:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715307520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201291.264831:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201291.264886:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201291.264893:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715307648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201291.264916:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201291.265139:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715307520 00000100:00100000:1.0:1788201291.265147:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715307520 00000100:00100000:1.0:1788201291.265190:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715307648 00000100:00100000:1.0:1788201291.265193:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715307648 00000100:00100000:1.0:1788201291.265214:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:1.0:1788201291.265222:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715307520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201291.265235:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201291.265329:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064eca00/0x96d0c9b8c9a1d4b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d4af expref: 24 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201291.265344:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201291.265378:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+23:3655:x1875060715307520:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201291.265386:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:1.0:1788201291.265405:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:1.0:1788201291.265412:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+22:3655:x1875060715307648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201291.265419:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201291.265428:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1d4e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d4e0 expref: 22 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201291.265438:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201291.265459:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+21:3655:x1875060715307648:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201291.265465:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:1.0:1788201291.265508:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715307648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201291.265517:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715307520:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201291.267392:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00000080:3.0:1788201291.268113:0:97833:0:(ofd_obd.c:1268:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:0.0:1788201291.269145:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc001e29800 for lustre-MDT0001 00002000:00100000:2.0:1788201291.272398:0:97833:0:(ofd_obd.c:1282:ofd_iocontrol()) syncing ost lustre-OST0000 00000020:00000080:2.0:1788201291.272977:0:97833:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:2.0:1788201291.272989:0:97833:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8dc1401c7000 6e293f14-c501-4bc5-9dd4-a18ef02756b4 192.168.201.20@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 4294969498 stale:0 00000020:00080000:2.0:1788201291.272997:0:97833:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8dc002a56800 lustre-MDT0000-mdtlov_UUID 0@lo 5 (1 0 0) 0 0 0 0: 0000000000000000 4294969474 stale:0 00000020:00080000:2.0:1788201291.273001:0:97833:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8dc001e28800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (1 0 0) 0 0 0 0: 0000000000000000 4294969456 stale:0 00000020:00080000:2.0:1788201291.273040:0:97833:0:(genops.c:1553:class_disconnect_exports()) OBD device 18 (ffff8dc004fd4d28) has exports, disconnecting them 00000020:00080000:2.0:1788201291.273046:0:97833:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.201.20@tcp (ffff8dc1401c7000), last request at 1788201289 00000020:00000080:2.0:1788201291.273058:0:97833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d4d9 00000100:00080000:2.0:1788201291.273070:0:97833:0:(import.c:65:import_set_state_nolock()) ffff8dc0059d2800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788201291.273130:0:97833:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.201.20@tcp (ffff8dc1401c7000): rc 0 00000020:00000080:2.0:1788201291.273133:0:97833:0:(genops.c:885:class_export_put()) final put ffff8dc1401c7000/6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00080000:2.0:1788201291.273142:0:97833:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8dc002a56800), last request at 1788201273 00000020:00000080:2.0:1788201291.273145:0:97833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d4d2 00000100:00080000:2.0:1788201291.273149:0:97833:0:(import.c:65:import_set_state_nolock()) ffff8dc005a4a000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788201291.273163:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788201291.273170:0:97833:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc002a56800): rc 0 00000020:00080000:2.0:1788201291.273173:0:97833:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8dc001e28800), last request at 1788201273 00000020:00000080:2.0:1788201291.273176:0:97833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d4cb 00000100:00080000:2.0:1788201291.273180:0:97833:0:(import.c:65:import_set_state_nolock()) ffff8dc13aa9a000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788201291.273190:0:97833:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc001e28800): rc 0 00000020:00080000:2.0:1788201291.273213:0:97833:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8dc004fd4d28) has no exports 00010000:00020000:2.0:1788201291.273216:0:97833:0:(ldlm_lib.c:3029:target_stop_recovery_thread()) lustre-OST0000: Aborting recovery 00010000:00010000:0.0:1788201291.274839:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788201291.274853:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1401c7000/6e293f14-c501-4bc5-9dd4-a18ef02756b4 for lustre-OST0000 00000020:00000080:0.0:1788201291.274921:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc0059d2800 for lustre-OST0000 00010000:00010000:0.0:1788201291.276954:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788201291.286574:0:97051:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00010000:00000400:0.0:1788201291.286580:0:97051:0:(ldlm_lib.c:2429:target_recovery_overseer()) recovery is aborted, evict exports in recovery 00002000:00000080:0.0:1788201291.295791:0:97051:0:(ofd_obd.c:1268:ofd_iocontrol()) lustre-OST0000: cmd=c00866c1 len=0 karg=ffff8dc004fd54a8 uarg=0000000000000000 00000020:00020000:1.0:1788201291.295988:0:97051:0:(ofd_obd.c:1325:ofd_iocontrol()) lustre-OST0000: iocontrol from 'tgt_recover_0' cmd=c00866c1 _IOWR('f', 193, 8) unrecognized: rc = -25 00010000:00080000:1.0:1788201291.303799:0:97051:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-OST0000: cancel recovery timer 00010000:00080000:1.0:1788201291.303819:0:97051:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8dc12ee2d880 x1875060715300096/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:414/0 lens 224/0 e 1 to 0 dl 1788201304 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000080:1.0:1788201291.303842:0:97051:0:(genops.c:885:class_export_put()) final put ffff8dc002a56800/lustre-MDT0000-mdtlov_UUID 00010000:00080000:1.0:1788201291.303914:0:97051:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8dc12ee2ca80 x1875060715300224/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:414/0 lens 224/0 e 1 to 0 dl 1788201304 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000080:1.0:1788201291.303955:0:97051:0:(genops.c:885:class_export_put()) final put ffff8dc001e28800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788201291.304007:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc002a56800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788201291.304090:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc005a4a000 for lustre-OST0000 00010000:02000000:1.0:1788201291.304241:0:97051:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-OST0000: Recovery over after 0:18, of 3 clients 0 recovered and 3 were evicted. 00000020:00000080:0.0:1788201291.304376:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc001e28800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788201291.304411:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc13aa9a000 for lustre-OST0000 00002000:00080000:1.0:1788201291.305603:0:97051:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788201291.305612:0:97051:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000000:3.0:1788201291.307955:0:97833:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc007b82ea0 - data ffff8dc11da92a20/ffff8dc006dd6c00 00000020:01000000:3.0:1788201291.308240:0:97833:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc00532fd80 - data ffff8dc11da640d8/ffff8dc12014a800 00100000:10000000:0.0:1788201291.329799:0:97833:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788201291.338215:0:97833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d4c4 00000020:00000080:0.0:1788201291.338233:0:97833:0:(genops.c:885:class_export_put()) final put ffff8dc001e2e000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788201291.338249:0:97833:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc120724000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788201291.338265:0:97833:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc120724000 2 00000020:01000004:0.0:1788201291.338269:0:97833:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dc120724000 from lustre-OST0000 00000020:00000080:0.0:1788201291.338297:0:97833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201291.338311:0:97833:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788201291.338314:0:97833:0:(genops.c:885:class_export_put()) final put ffff8dc003b6c800/lustre-OST0000_UUID 00000020:00000080:0.0:1788201291.338317:0:97833:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc003b6c800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788201291.338323:0:97833:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788201291.338390:0:97833:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:0.0:1788201291.338395:0:97833:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788201291.338398:0:97833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201291.338405:0:97833:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788201291.338411:0:97833:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8dc11077f800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201291.338416:0:97833:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8dc12f30b370) has exports, disconnecting them 00000020:00080000:0.0:1788201291.338421:0:97833:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8dc11077f800), last request at 1788201271 00000020:00000080:0.0:1788201291.338425:0:97833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d503 00000020:00080000:0.0:1788201291.338433:0:97833:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc11077f800): rc 0 00000020:00000080:0.0:1788201291.338438:0:97833:0:(genops.c:885:class_export_put()) final put ffff8dc11077f800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788201291.338991:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc001e2e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788201291.339037:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11077f800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788201291.354150:0:97833:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788201291.354159:0:97833:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201291.354164:0:97833:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788201291.354172:0:97833:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788201291.354390:0:97833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201291.354403:0:97833:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788201291.354410:0:97833:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788201291.354415:0:97833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201291.354420:0:97833:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788201291.354428:0:97833:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8dc00397e800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788201291.354434:0:97833:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8dc12ef60000) has exports, disconnecting them 00000020:00080000:2.0:1788201291.354449:0:97833:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8dc00397e800), last request at 1788201271 00000020:00000080:2.0:1788201291.354453:0:97833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d518 00000020:00080000:2.0:1788201291.354468:0:97833:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc00397e800): rc 0 00000020:00000080:2.0:1788201291.354472:0:97833:0:(genops.c:885:class_export_put()) final put ffff8dc00397e800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788201291.354654:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc004014000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788201291.354662:0:93109:0:(genops.c:885:class_export_put()) final put ffff8dc00520a000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788201291.354665:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc00520a000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788201291.354671:0:93109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788201291.355817:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc00397e800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788201291.357084:0:97833:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788201291.357090:0:97833:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788201291.357093:0:97833:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788201291.357100:0:97833:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788201291.357120:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc13f869000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788201291.357261:0:97833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201291.357272:0:97833:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788201291.357276:0:97833:0:(genops.c:885:class_export_put()) final put ffff8dc001e2d000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788201291.357279:0:97833:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc001e2d000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788201291.357283:0:97833:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788201291.357362:0:97833:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc120724000 1 00000020:00000080:3.0:1788201291.357368:0:97833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d4a8 00000020:00000080:3.0:1788201291.357374:0:97833:0:(genops.c:885:class_export_put()) final put ffff8dc1201ca000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788201291.357382:0:97833:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788201291.357389:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1201ca000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788201291.357397:0:97833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201291.357403:0:97833:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788201291.357407:0:97833:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8dc12f0c4d28) has no exports 00010000:00010000:1.0:1788201291.536169:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788201291.555897:0:97833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201291.555914:0:97833:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788201291.555920:0:97833:0:(genops.c:885:class_export_put()) final put ffff8dc120727000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788201291.555925:0:97833:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc120727000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788201291.555937:0:97833:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788201291.557400:0:97833:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dc120725800 00000020:02000400:3.0:1788201291.557473:0:97833:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788201292.559203:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201293.140082:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715307776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201293.140163:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201293.140214:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715307776 00000100:00100000:2.0:1788201293.140224:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715307776 00000100:00100000:2.0:1788201293.140285:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4130 00000100:00100000:2.0:1788201293.140300:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715307776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201293.140342:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:2.0:1788201293.140400:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715307776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201293.140407:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4130 00000100:00100000:2.0:1788201293.140449:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715307776:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788201293.589265:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201293.647437:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201293.647443:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:2.0:1788201293.647460:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201293.647464:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:2.0:1788201293.647497:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715308288:0@lo:400:kworker.0 00000100:00100000:2.0:1788201293.647565:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201293.647600:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715308800:0@lo:400:kworker.0 00000100:00100000:2.0:1788201293.647624:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201293.647650:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788201293.647657:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715307904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201293.647695:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201293.647730:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715308416:0@lo:400:kworker.0 00000100:00100000:2.0:1788201293.647752:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201293.647768:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715308928:0@lo:400:kworker.0 00000100:00100000:2.0:1788201293.647788:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201293.647827:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715308160:0@lo:400:kworker.0 00000100:00100000:2.0:1788201293.647849:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201293.647866:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715308672:0@lo:400:kworker.0 00000100:00100000:2.0:1788201293.647897:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201293.647928:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788201293.647934:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715308032:0@lo:400:kworker.0 00000100:00100000:2.0:1788201293.647962:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201293.647987:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715308544:0@lo:400:kworker.0 00000100:00100000:2.0:1788201293.648007:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201293.648052:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715309056:0@lo:400:kworker.0 00000100:00100000:2.0:1788201293.648073:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201293.648104:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715307904 00000100:00100000:2.0:1788201293.648111:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715307904 00000100:00100000:2.0:1788201293.648167:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2380 00000100:00100000:2.0:1788201293.648177:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715307904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201293.648209:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201293.648250:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715307904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201293.648257:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2380 00000100:00100000:2.0:1788201293.648278:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715308800 00000100:00100000:2.0:1788201293.648282:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715308800 00000100:00100000:2.0:1788201293.648300:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715308416 00000100:00100000:2.0:1788201293.648309:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715308416 00000100:00100000:2.0:1788201293.648332:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4131 00000100:00100000:2.0:1788201293.648338:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715308800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201293.648369:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715308800:12345-0@lo:400:kworker.0 Request processed in 31us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201293.648376:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4131 00000100:00100000:2.0:1788201293.648386:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4132 00000100:00100000:2.0:1788201293.648391:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715308416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201293.648413:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715308416:12345-0@lo:400:kworker.0 Request processed in 22us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201293.648420:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4132 00000100:00100000:2.0:1788201293.648435:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715308288 00000100:00100000:2.0:1788201293.648438:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715308288 00000100:00100000:2.0:1788201293.648463:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715308160 00000100:00100000:2.0:1788201293.648466:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715308160 00000100:00100000:2.0:1788201293.648477:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715308672 00000100:00100000:2.0:1788201293.648479:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715308672 00000100:00100000:2.0:1788201293.648488:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715309056 00000100:00100000:2.0:1788201293.648490:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715309056 00000100:00100000:2.0:1788201293.648501:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1577 00000100:00100000:2.0:1788201293.648507:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715308288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201293.648536:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715308288:12345-0@lo:400:kworker.0 Request processed in 29us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201293.648542:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1577 00000100:00100000:2.0:1788201293.648553:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1578 00000100:00100000:2.0:1788201293.648558:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715308160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201293.648586:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715308160:12345-0@lo:400:kworker.0 Request processed in 28us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201293.648598:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1578 00000100:00100000:2.0:1788201293.648611:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1579 00000100:00100000:2.0:1788201293.648617:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715308672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201293.648644:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715308672:12345-0@lo:400:kworker.0 Request processed in 27us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201293.648649:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1579 00000100:00100000:2.0:1788201293.648659:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1580 00000100:00100000:2.0:1788201293.648664:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715309056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201293.648688:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715309056:12345-0@lo:400:kworker.0 Request processed in 24us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201293.648693:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1580 00000100:00100000:2.0:1788201293.648712:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715308032 00000100:00100000:2.0:1788201293.648715:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715308032 00000100:00100000:2.0:1788201293.648740:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788201293.648745:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134204850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:3656:x1875060715308032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201293.648765:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134204850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:3656:x1875060715308032:12345-0@lo:400:kworker.0 Request processed in 21us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201293.648768:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:2.0:1788201293.648788:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201293.648790:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201293.648792:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201293.648821:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715308032:0@lo:400:kworker.0 00000100:00100000:2.0:1788201293.648830:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715309056:0@lo:400:kworker.0 00000100:00100000:2.0:1788201293.648835:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715308160:0@lo:400:kworker.0 00000100:00100000:2.0:1788201293.648849:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715308672:0@lo:400:kworker.0 00000100:00100000:2.0:1788201293.648878:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715307904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201293.648883:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715308416:0@lo:400:kworker.0 00000100:00100000:2.0:1788201293.648889:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715308288:0@lo:400:kworker.0 00000100:00100000:2.0:1788201293.648894:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715308800:0@lo:400:kworker.0 00000100:00100000:2.0:1788201293.648941:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715308928 00000100:00100000:2.0:1788201293.648945:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715308928 00000100:00100000:2.0:1788201293.648967:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715308544 00000100:00100000:2.0:1788201293.648969:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715308544 00000100:00100000:2.0:1788201293.648989:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2938 00000100:00100000:2.0:1788201293.648994:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715308928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201293.649055:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715308928:12345-0@lo:400:kworker.0 Request processed in 61us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201293.649061:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2938 00000100:00100000:2.0:1788201293.649073:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2939 00000100:00100000:2.0:1788201293.649079:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715308544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201293.649114:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715308544:12345-0@lo:400:kworker.0 Request processed in 35us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201293.649119:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2939 00000100:00080000:2.0:1788201293.649140:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201293.649156:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715308544:0@lo:400:kworker.0 00000100:00100000:2.0:1788201293.649181:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715308928:0@lo:400:kworker.0 00000100:00100000:0.0:1788201293.651488:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715309184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201293.651566:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201293.651953:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715309184 00000100:00100000:2.0:1788201293.651968:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715309184 00000100:00100000:2.0:1788201293.652085:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4133 00000100:00100000:2.0:1788201293.652096:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715309184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201293.652128:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:2.0:1788201293.652174:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715309184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201293.652181:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4133 00000100:00100000:1.0:1788201293.652268:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715309184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201293.784449:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201293.784497:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201293.784532:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201293.784552:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695493504 00000100:00100000:3.0:1788201293.784562:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695493504 00000100:00100000:0.0:1788201293.784629:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201293.784629:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2940 00000100:00100000:3.0:1788201293.784639:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695493504:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201293.784651:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695493248 00000100:00100000:0.0:1788201293.784655:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695493248 00000100:00100000:0.0:1788201293.784688:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695493376 00000100:00100000:0.0:1788201293.784691:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695493376 00000100:00100000:0.0:1788201293.784711:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1581 00000100:00100000:0.0:1788201293.784718:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2401:x1875060695493248:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201293.784722:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695493504:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 85us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201293.784729:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2940 00000100:00080000:3.0:1788201293.784754:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201293.784759:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2401:x1875060695493248:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 42us (322us total) trans 0 rc 0/0 00000100:00080000:3.0:1788201293.784759:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201293.784761:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201293.784765:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1581 00000100:00100000:0.0:1788201293.784778:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1582 00000100:00100000:0.0:1788201293.784784:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2401:x1875060695493376:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201293.784817:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2401:x1875060695493376:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 32us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201293.784823:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1582 00000100:00100000:1.0:1788201293.787469:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695493120 00000100:00100000:1.0:1788201293.787482:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695493120 00000100:00100000:1.0:1788201293.787758:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 225 00000100:00100000:1.0:1788201293.787769:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134207450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695493120:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201293.787847:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134207450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695493120:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 80us (3314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201293.787856:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 225 00010000:00010000:0.0:1788201294.607202:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201294.806754:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201294.806791:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201294.806827:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201294.806963:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695493760 00000100:00100000:3.0:1788201294.806974:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695493760 00000100:00100000:3.0:1788201294.807064:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1583 00000100:00100000:3.0:1788201294.807074:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2402:x1875060695493760:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201294.807137:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2402:x1875060695493760:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 66us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201294.807144:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1583 00000100:00100000:1.0:1788201294.807313:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695493632 00000100:00100000:1.0:1788201294.807319:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695493632 00000100:00100000:1.0:1788201294.807360:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 226 00000100:00100000:1.0:1788201294.807367:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695493632:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201294.807392:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695493632:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201294.807398:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 226 00000100:00100000:0.0:1788201294.807540:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201294.808034:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695493888 00000100:00100000:3.0:1788201294.808040:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695493888 00000100:00100000:3.0:1788201294.808080:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1584 00000100:00100000:3.0:1788201294.808087:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2402:x1875060695493888:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201294.808132:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2402:x1875060695493888:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 45us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201294.808138:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1584 00000100:00100000:2.0:1788201294.808211:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695494016 00000100:00100000:2.0:1788201294.808215:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695494016 00000100:00100000:2.0:1788201294.808249:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2941 00000100:00100000:2.0:1788201294.808256:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2402:x1875060695494016:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201294.808281:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2402:x1875060695494016:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201294.808287:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2941 00010000:00010000:1.0:1788201295.631268:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201296.210650:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201296.210698:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715309312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201296.210773:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201296.210968:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715309312 00000100:00100000:2.0:1788201296.210976:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715309312 00000100:00100000:2.0:1788201296.211057:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2381 00000100:00100000:2.0:1788201296.211067:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715309312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201296.211098:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201296.211150:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715309312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201296.211157:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2381 00000100:00100000:1.0:1788201296.215119:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715309312:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788201296.215224:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788201296.655635:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201297.679542:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201298.255342:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201298.256883:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715309440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201298.256985:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201298.257161:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715309440 00000100:00100000:2.0:1788201298.257171:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715309440 00000100:00100000:2.0:1788201298.257231:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4134 00000100:00100000:2.0:1788201298.257246:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715309440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201298.257288:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:2.0:1788201298.257520:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715309440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 275us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201298.257528:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4134 00000100:00100000:1.0:1788201298.257707:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715309440:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788201298.703673:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201298.768323:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715309568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201298.768394:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201298.768443:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201298.768449:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137ceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715309696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201298.768474:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788201298.768657:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201298.768661:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:0.0:1788201298.768679:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201298.768683:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:3.0:1788201298.768752:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715309696 00000100:00100000:3.0:1788201298.768761:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715309696 00000100:00100000:3.0:1788201298.768840:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2382 00000100:00100000:3.0:1788201298.768851:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715309696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201298.768881:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201298.768927:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715309696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201298.768933:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2382 00000100:00100000:2.0:1788201298.769241:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715309568 00000100:00100000:2.0:1788201298.769247:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715309568 00000100:00100000:2.0:1788201298.769292:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4135 00000100:00100000:2.0:1788201298.769299:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715309568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201298.769337:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:2.0:1788201298.769373:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715309568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201298.769379:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4135 00000100:00080000:0.0:1788201298.769580:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201298.769647:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715309824:0@lo:400:kworker.0 00000100:00100000:1.0:1788201298.769685:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201298.769723:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715310336:0@lo:400:kworker.0 00000100:00100000:1.0:1788201298.769748:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201298.769780:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788201298.769786:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715309952:0@lo:400:kworker.0 00000100:00100000:1.0:1788201298.769827:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201298.769845:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715310464:0@lo:400:kworker.0 00000100:00100000:1.0:1788201298.769867:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201298.769898:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715310208:0@lo:400:kworker.0 00000100:00100000:1.0:1788201298.769922:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201298.769941:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788201298.769947:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715310080:0@lo:400:kworker.0 00000100:00100000:1.0:1788201298.769967:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201298.769998:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715310592:0@lo:400:kworker.0 00000100:00100000:1.0:1788201298.770042:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201298.770069:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715310208 00000100:00100000:1.0:1788201298.770087:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715310208 00000100:00100000:1.0:1788201298.770129:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2942 00000100:00100000:1.0:1788201298.770138:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715310208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201298.770176:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715310208:12345-0@lo:400:kworker.0 Request processed in 40us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201298.770182:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2942 00000100:00080000:1.0:1788201298.770203:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201298.770230:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715310208:0@lo:400:kworker.0 00000100:00100000:1.0:1788201298.770268:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137ceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715309696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201298.770281:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715309568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201298.770302:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715310464 00000100:00100000:1.0:1788201298.770305:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715310464 00000100:00100000:1.0:1788201298.770341:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4136 00000100:00100000:1.0:1788201298.770348:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715310464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201298.770383:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715310464:12345-0@lo:400:kworker.0 Request processed in 36us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201298.770389:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4136 00000100:00100000:1.0:1788201298.770412:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715310464:0@lo:400:kworker.0 00000100:00100000:0.0:1788201298.770636:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715310336 00000100:00100000:0.0:1788201298.770641:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715310336 00000100:00100000:0.0:1788201298.770677:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715309952 00000100:00100000:0.0:1788201298.770680:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715309952 00000100:00100000:0.0:1788201298.770700:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715310080 00000100:00100000:0.0:1788201298.770703:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715310080 00000100:00100000:0.0:1788201298.770715:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715310592 00000100:00100000:0.0:1788201298.770718:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715310592 00000100:00100000:0.0:1788201298.770731:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1585 00000100:00100000:0.0:1788201298.770737:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715310336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201298.770778:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715310336:12345-0@lo:400:kworker.0 Request processed in 41us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201298.770784:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1585 00000100:00100000:0.0:1788201298.770811:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1586 00000100:00100000:0.0:1788201298.770826:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715309952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201298.770854:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715309952:12345-0@lo:400:kworker.0 Request processed in 37us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201298.770859:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1586 00000100:00100000:0.0:1788201298.770871:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1587 00000100:00100000:0.0:1788201298.770877:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715310080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201298.770918:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715310080:12345-0@lo:400:kworker.0 Request processed in 42us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201298.770925:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1587 00000100:00100000:0.0:1788201298.770938:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1588 00000100:00100000:0.0:1788201298.770945:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715310592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201298.770971:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715310592:12345-0@lo:400:kworker.0 Request processed in 27us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201298.770977:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1588 00000100:00080000:0.0:1788201298.770995:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201298.770998:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201298.771044:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715310080:0@lo:400:kworker.0 00000100:00100000:0.0:1788201298.771058:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715310592:0@lo:400:kworker.0 00000100:00100000:0.0:1788201298.771100:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715309952:0@lo:400:kworker.0 00000100:00100000:0.0:1788201298.771111:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715310336:0@lo:400:kworker.0 00000100:00100000:2.0:1788201298.772240:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715309824 00000100:00100000:2.0:1788201298.772250:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715309824 00000100:00100000:2.0:1788201298.772322:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788201298.772331:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:3657:x1875060715309824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201298.772406:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:3657:x1875060715309824:12345-0@lo:400:kworker.0 Request processed in 76us (2720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201298.772412:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788201298.773750:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715309824:0@lo:400:kworker.0 00010000:00010000:1.0:1788201299.727679:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201299.925253:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201299.925320:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201299.925507:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695494528 00000100:00100000:3.0:1788201299.925522:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695494528 00000100:00100000:3.0:1788201299.925610:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2943 00000100:00100000:3.0:1788201299.925624:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695494528:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201299.925727:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695494272 00000100:00100000:2.0:1788201299.925731:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695494272 00000100:00100000:2.0:1788201299.925763:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1589 00000100:00100000:2.0:1788201299.925768:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2401:x1875060695494272:12345-192.168.201.20@tcp:400:kworker.0 00000100:00080000:1.0:1788201299.925891:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201299.925896:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201299.929840:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695494528:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 4202us (4502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201299.929861:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2943 00000100:00100000:0.0:1788201299.930546:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201299.930606:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695494144 00000100:00100000:3.0:1788201299.930624:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695494144 00000100:00100000:3.0:1788201299.930680:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 228 00000100:00100000:3.0:1788201299.930691:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134205850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695494144:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201299.931191:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2401:x1875060695494272:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 5417us (5950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201299.931204:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1589 00000100:00100000:0.0:1788201299.931711:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201299.931789:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695494400 00000100:00100000:2.0:1788201299.931804:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695494400 00000100:00100000:2.0:1788201299.931925:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1590 00000100:00100000:2.0:1788201299.931934:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2401:x1875060695494400:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201299.932000:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2401:x1875060695494400:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 67us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201299.932008:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1590 00000100:00080000:1.0:1788201299.935933:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201299.936521:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134205850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695494144:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 5818us (5964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201299.936539:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 228 00010000:00010000:1.0:1788201300.762286:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201301.327480:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715310720:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201301.327600:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201301.328047:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715310720 00000100:00100000:2.0:1788201301.328059:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715310720 00000100:00100000:2.0:1788201301.328158:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2383 00000100:00100000:2.0:1788201301.328172:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715310720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201301.328214:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201301.328287:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715310720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201301.328295:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2383 00000100:00100000:2.0:1788201301.328361:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715310720:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788201301.328562:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788201301.776670:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201302.800177:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201303.375675:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715310848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201303.375796:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201303.376226:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715310848 00000100:00100000:3.0:1788201303.376236:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715310848 00000100:00100000:3.0:1788201303.376309:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4137 00000100:00100000:3.0:1788201303.376320:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715310848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788201303.376389:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:3.0:1788201303.376463:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715310848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 144us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201303.376472:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4137 00000100:00100000:0.0:1788201303.376513:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715310848:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788201303.824261:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201303.888309:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715310976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201303.888573:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715311104:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201303.888651:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201303.888719:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715311104 00000100:00100000:1.0:1788201303.888737:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715311104 00000100:00100000:1.0:1788201303.888787:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4138 00000100:00100000:1.0:1788201303.888795:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715311104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201303.888837:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:1.0:1788201303.888878:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715311104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201303.888883:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4138 00000100:00100000:1.0:1788201303.888929:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715311104:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201303.889083:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201303.889113:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715310976 00000100:00100000:3.0:1788201303.889116:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715310976 00000100:00100000:3.0:1788201303.889221:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2384 00000100:00100000:3.0:1788201303.889227:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715310976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201303.889250:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201303.889278:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715310976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201303.889282:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2384 00000100:00080000:3.0:1788201303.889296:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201303.889315:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715310976:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788201303.890588:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201303.890594:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:2.0:1788201303.890619:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201303.890623:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:3.0:1788201303.890771:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715311616:0@lo:400:kworker.0 00000100:00100000:1.0:1788201303.890779:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715311360:0@lo:400:kworker.0 00000100:00100000:3.0:1788201303.890854:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201303.890855:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201303.890941:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715311872:0@lo:400:kworker.0 00000100:00100000:3.0:1788201303.890945:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788201303.890956:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715311232:0@lo:400:kworker.0 00000100:00100000:1.0:1788201303.890976:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201303.890998:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201303.891050:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715311744:0@lo:400:kworker.0 00000100:00100000:3.0:1788201303.891075:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201303.891106:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715311232 00000100:00100000:3.0:1788201303.891113:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715311232 00000100:00100000:1.0:1788201303.891173:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788201303.891175:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788201303.891184:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715311488:0@lo:400:kworker.0 00000100:00100000:3.0:1788201303.891190:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134206450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:3655:x1875060715311232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201303.891242:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134206450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:3655:x1875060715311232:12345-0@lo:400:kworker.0 Request processed in 57us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201303.891250:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788201303.891300:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715311232:0@lo:400:kworker.0 00000100:00100000:2.0:1788201303.891320:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715311616 00000100:00100000:2.0:1788201303.891324:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715311616 00000100:00100000:1.0:1788201303.891351:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201303.891366:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2944 00000100:00100000:2.0:1788201303.891373:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715311616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201303.891381:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715312000:0@lo:400:kworker.0 00000100:00100000:2.0:1788201303.891415:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715311616:12345-0@lo:400:kworker.0 Request processed in 43us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201303.891422:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201303.891431:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2944 00000100:00100000:1.0:1788201303.891461:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715311360 00000100:00100000:1.0:1788201303.891466:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715311360 00000100:00100000:1.0:1788201303.891512:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715311744 00000100:00100000:1.0:1788201303.891516:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715311744 00000100:00100000:2.0:1788201303.891524:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715311488 00000100:00100000:2.0:1788201303.891530:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715311488 00000100:00100000:1.0:1788201303.891533:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715312000 00000100:00100000:1.0:1788201303.891545:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715312000 00000100:00100000:2.0:1788201303.891561:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1591 00000100:00100000:2.0:1788201303.891570:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715311360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201303.891583:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1592 00000100:00100000:1.0:1788201303.891593:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715311744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201303.891607:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715311360:12345-0@lo:400:kworker.0 Request processed in 40us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201303.891613:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1591 00000100:00100000:2.0:1788201303.891630:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1593 00000100:00100000:1.0:1788201303.891641:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715311744:12345-0@lo:400:kworker.0 Request processed in 47us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201303.891646:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715311488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201303.891651:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1592 00000100:00100000:1.0:1788201303.891671:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1594 00000100:00100000:1.0:1788201303.891681:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715312000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201303.891688:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715311488:12345-0@lo:400:kworker.0 Request processed in 51us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201303.891695:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1593 00000100:00100000:1.0:1788201303.891719:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715312000:12345-0@lo:400:kworker.0 Request processed in 41us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201303.891726:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1594 00000100:00100000:1.0:1788201303.891760:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715311872 00000100:00100000:1.0:1788201303.891764:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715311872 00000100:00100000:1.0:1788201303.891798:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4139 00000100:00100000:1.0:1788201303.891807:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715311872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201303.891840:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715311872:12345-0@lo:400:kworker.0 Request processed in 36us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201303.891847:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4139 00000100:00100000:1.0:1788201303.891908:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715311488:0@lo:400:kworker.0 00000100:00100000:1.0:1788201303.891919:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715312000:0@lo:400:kworker.0 00000100:00100000:1.0:1788201303.891928:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715311360:0@lo:400:kworker.0 00000100:00100000:1.0:1788201303.891937:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715311872:0@lo:400:kworker.0 00000100:00100000:3.0:1788201303.894834:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715311744:0@lo:400:kworker.0 00000100:00100000:3.0:1788201303.894861:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715311616:0@lo:400:kworker.0 00000100:00080000:3.0:1788201303.894900:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201303.894907:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201303.894911:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788201304.847863:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201305.054431:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201305.054593:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695494912 00000100:00100000:2.0:1788201305.054604:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695494912 00000100:00100000:2.0:1788201305.054699:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1595 00000100:00100000:2.0:1788201305.054721:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2401:x1875060695494912:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201305.054799:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2401:x1875060695494912:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 91us (1329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201305.054807:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1595 00000100:00080000:1.0:1788201305.054912:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201305.055151:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201305.055225:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201305.055248:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201305.055290:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201305.055330:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695494784 00000100:00100000:2.0:1788201305.055335:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695494784 00000100:00100000:2.0:1788201305.055366:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 230 00000100:00100000:2.0:1788201305.055374:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134207850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695494784:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201305.055405:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134207850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695494784:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 32us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201305.055424:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 230 00000100:00100000:3.0:1788201305.064564:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695495040 00000100:00100000:3.0:1788201305.064582:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695495040 00000100:00100000:3.0:1788201305.064654:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1596 00000100:00100000:3.0:1788201305.064665:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2401:x1875060695495040:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201305.064779:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2401:x1875060695495040:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 116us (9529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201305.064786:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1596 00000100:00080000:0.0:1788201305.066962:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201305.071573:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695495168 00000100:00100000:1.0:1788201305.071601:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695495168 00000100:00100000:1.0:1788201305.071678:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695494656 00000100:00100000:1.0:1788201305.071681:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695494656 00000100:00100000:1.0:1788201305.071717:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2945 00000100:00100000:1.0:1788201305.071729:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695495168:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201305.071809:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695495168:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 83us (16659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201305.071817:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2945 00000100:00100000:1.0:1788201305.071837:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6008 00000100:00100000:1.0:1788201305.071842:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:2399:x1875060695494656:12345-192.168.201.20@tcp:8:ptlrpcd_rcv.0 00010000:00020000:1.0:1788201305.071865:0:26202:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201305.071890:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:2399:x1875060695494656:12345-192.168.201.20@tcp:8:ptlrpcd_rcv.0 Request processed in 46us (16613us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201305.071896:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6008 00000100:00080000:0.0:1788201305.075418:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788201305.878549:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201306.449263:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715312128:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201306.449334:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201306.449555:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715312128 00000100:00100000:2.0:1788201306.449564:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715312128 00000100:00100000:2.0:1788201306.449628:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2385 00000100:00100000:2.0:1788201306.449640:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715312128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201306.449668:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201306.449727:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715312128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201306.449735:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2385 00000100:00080000:0.0:1788201306.449795:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201306.449833:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715312128:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788201306.898271:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201307.920543:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201308.496200:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201308.496334:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715312256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201308.496485:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201308.506792:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715312256 00000100:00100000:3.0:1788201308.506810:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715312256 00000100:00100000:2.0:1788201308.512543:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4140 00000100:00100000:2.0:1788201308.512558:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715312256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201308.512597:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:2.0:1788201308.512698:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715312256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (16289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201308.512705:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4140 00000100:00100000:1.0:1788201308.512779:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715312256:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788201308.953975:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201309.007256:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201309.007278:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715312384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201309.007351:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201309.007406:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715312384 00000100:00100000:1.0:1788201309.007413:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715312384 00000100:00100000:1.0:1788201309.007472:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2386 00000100:00100000:1.0:1788201309.007482:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715312384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201309.007513:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201309.007557:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715312384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201309.007576:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2386 00000100:00080000:1.0:1788201309.007600:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201309.007651:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715312384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201309.007985:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715312512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201309.008046:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201309.008114:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715312512 00000100:00100000:3.0:1788201309.008119:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715312512 00000100:00100000:3.0:1788201309.008157:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4141 00000100:00100000:3.0:1788201309.008164:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715312512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201309.008190:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:3.0:1788201309.008226:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715312512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201309.008239:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4141 00000100:00100000:1.0:1788201309.008326:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715312512:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788201309.008675:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201309.008680:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:3.0:1788201309.008700:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201309.008703:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:3.0:1788201309.008725:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715312768:0@lo:400:kworker.0 00000100:00100000:3.0:1788201309.008758:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201309.008776:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715313280:0@lo:400:kworker.0 00000100:00100000:3.0:1788201309.008798:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201309.008818:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788201309.008824:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715312640:0@lo:400:kworker.0 00000100:00100000:3.0:1788201309.008849:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201309.008873:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715313152:0@lo:400:kworker.0 00000100:00100000:3.0:1788201309.008892:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201309.008916:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715312896:0@lo:400:kworker.0 00000100:00100000:3.0:1788201309.008938:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201309.008953:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715313408:0@lo:400:kworker.0 00000100:00100000:3.0:1788201309.008971:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201309.008987:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201309.008992:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715313024:0@lo:400:kworker.0 00000100:00100000:3.0:1788201309.009036:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201309.009062:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715313280 00000100:00100000:3.0:1788201309.009066:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715313280 00000100:00100000:3.0:1788201309.009107:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4142 00000100:00100000:3.0:1788201309.009114:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715313280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201309.009170:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715313280:12345-0@lo:400:kworker.0 Request processed in 56us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201309.009178:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4142 00000100:00100000:3.0:1788201309.009199:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715312640 00000100:00100000:3.0:1788201309.009203:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715312640 00000100:00100000:3.0:1788201309.009225:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788201309.009232:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134204c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:3656:x1875060715312640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201309.009262:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134204c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:3656:x1875060715312640:12345-0@lo:400:kworker.0 Request processed in 30us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201309.009268:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788201309.009295:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715312768 00000100:00100000:3.0:1788201309.009299:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715312768 00000100:00100000:3.0:1788201309.009330:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715313152 00000100:00100000:3.0:1788201309.009333:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715313152 00000100:00100000:3.0:1788201309.009343:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715312896 00000100:00100000:3.0:1788201309.009346:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715312896 00000100:00100000:3.0:1788201309.009358:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715313408 00000100:00100000:3.0:1788201309.009360:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715313408 00000100:00100000:3.0:1788201309.009371:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1597 00000100:00100000:3.0:1788201309.009377:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715312768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201309.009408:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715312768:12345-0@lo:400:kworker.0 Request processed in 31us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201309.009414:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1597 00000100:00100000:3.0:1788201309.009428:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1598 00000100:00100000:3.0:1788201309.009434:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715313152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201309.009460:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715313152:12345-0@lo:400:kworker.0 Request processed in 26us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201309.009472:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1598 00000100:00100000:3.0:1788201309.009487:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1599 00000100:00100000:3.0:1788201309.009493:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715312896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201309.009527:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715312896:12345-0@lo:400:kworker.0 Request processed in 34us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201309.009533:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1599 00000100:00100000:3.0:1788201309.009547:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1600 00000100:00100000:3.0:1788201309.009553:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715313408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201309.009579:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715313408:12345-0@lo:400:kworker.0 Request processed in 27us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201309.009585:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1600 00000100:00100000:3.0:1788201309.009629:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715312896:0@lo:400:kworker.0 00000100:00100000:3.0:1788201309.009653:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715313408:0@lo:400:kworker.0 00000100:00100000:3.0:1788201309.009680:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715312640:0@lo:400:kworker.0 00000100:00100000:3.0:1788201309.009689:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715313152:0@lo:400:kworker.0 00000100:00100000:3.0:1788201309.009699:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715312768:0@lo:400:kworker.0 00000100:00100000:3.0:1788201309.009707:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715313280:0@lo:400:kworker.0 00000100:00000400:1.0:1788201309.009896:0:3654:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201273/real 1788201273] req@ffff8dc125641c00 x1875060715300224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 1 to 1 dl 1788201309 ref 1 fl Rpc:XQr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201309.009915:0:3654:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=REPLAY_WAIT (now=REPLAY_WAIT) req@ffff8dc125641c00 x1875060715300224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 1 to 1 dl 1788201309 ref 1 fl Rpc:XQU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000400:1.0:1788201309.009926:0:3654:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201273/real 1788201273] req@ffff8dc12ee2ea00 x1875060715300096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 1 to 1 dl 1788201309 ref 1 fl Rpc:XQr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201309.009938:0:3654:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=REPLAY_WAIT (now=REPLAY_WAIT) req@ffff8dc12ee2ea00 x1875060715300096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 1 to 1 dl 1788201309 ref 1 fl Rpc:XQU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201309.009950:0:3654:0:(import.c:1541:completed_replay_interpret()) lustre-OST0000-osc-MDT0001: LAST_REPLAY message error: -110, reconnecting 00000100:00080000:1.0:1788201309.009954:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to CONNECTING 00000100:00080000:1.0:1788201309.009959:0:3654:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 4124 00000100:00080000:1.0:1788201309.009965:0:3654:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8dc006d84000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201309.009986:0:3654:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13a440a80 x1875060715313536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201309.009999:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715300224:0@lo:400:ldlm_lock_repla.0 00000100:00080000:1.0:1788201309.010004:0:3654:0:(import.c:1541:completed_replay_interpret()) lustre-OST0000-osc-MDT0000: LAST_REPLAY message error: -110, reconnecting 00000100:00080000:1.0:1788201309.010012:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to CONNECTING 00000100:00080000:1.0:1788201309.010050:0:3654:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 4124 00000100:00080000:1.0:1788201309.010055:0:3654:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dc109815000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201309.010069:0:3654:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13a440000 x1875060715313664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201309.010079:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715300096:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1788201309.010095:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715313536:0@lo:8:ptlrpcd_rcv.0 00000100:00100000:1.0:1788201309.010127:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201309.010148:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715313664:0@lo:8:ptlrpcd_rcv.0 00000100:00100000:1.0:1788201309.010169:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201309.010202:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715313024 00000100:00100000:1.0:1788201309.010207:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715313024 00000100:00100000:1.0:1788201309.010239:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715313536 00000100:00100000:1.0:1788201309.010243:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715313536 00000100:00100000:1.0:1788201309.010256:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715313664 00000100:00100000:1.0:1788201309.010258:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715313664 00000100:00100000:1.0:1788201309.010274:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2946 00000100:00100000:1.0:1788201309.010281:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715313024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201309.010322:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715313024:12345-0@lo:400:kworker.0 Request processed in 41us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201309.010329:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2946 00000100:00100000:1.0:1788201309.010344:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6009 00000100:00100000:1.0:1788201309.010348:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140e9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3654:x1875060715313536:12345-0@lo:8:ptlrpcd_rcv.0 00010000:00020000:1.0:1788201309.010368:0:8491:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201309.010399:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140e9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3654:x1875060715313536:12345-0@lo:8:ptlrpcd_rcv.0 Request processed in 50us (271us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201309.010412:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6009 00000100:00100000:1.0:1788201309.010551:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6010 00000100:00100000:1.0:1788201309.010555:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3654:x1875060715313664:12345-0@lo:8:ptlrpcd_rcv.0 00010000:00020000:1.0:1788201309.010565:0:8491:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201309.010589:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3654:x1875060715313664:12345-0@lo:8:ptlrpcd_rcv.0 Request processed in 33us (420us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201309.010595:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6010 00000100:00080000:1.0:1788201309.010627:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201309.010631:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201309.010633:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201309.010667:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715313024:0@lo:400:kworker.0 00000100:00080000:1.0:1788201309.010690:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201309.010705:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201309.010707:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715313536:0@lo:8:ptlrpcd_rcv.0 00000100:00080000:1.0:1788201309.010715:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201309.010719:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201309.010722:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715313664:0@lo:8:ptlrpcd_rcv.0 00010000:00010000:1.0:1788201309.968154:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201310.173369:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201310.173481:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201310.173508:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201310.173534:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201310.173558:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201310.173586:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695495296 00000100:00100000:0.0:1788201310.173596:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695495296 00000100:00100000:0.0:1788201310.173664:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 232 00000100:00100000:0.0:1788201310.173674:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695495296:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201310.173844:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695495680 00000100:00100000:2.0:1788201310.173849:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695495680 00000100:00100000:2.0:1788201310.173873:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695495808 00000100:00100000:2.0:1788201310.173876:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695495808 00000100:00100000:2.0:1788201310.173919:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2947 00000100:00100000:2.0:1788201310.173927:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2400:x1875060695495808:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201310.173969:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2400:x1875060695495808:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 42us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201310.173976:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2947 00000100:00100000:2.0:1788201310.174001:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6011 00000100:00100000:2.0:1788201310.174006:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2399:x1875060695495680:12345-192.168.201.20@tcp:8:kworker.0 00010000:00020000:2.0:1788201310.174246:0:23974:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201310.174276:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2399:x1875060695495680:12345-192.168.201.20@tcp:8:kworker.0 Request processed in 269us (920us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201310.174283:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6011 00000100:00100000:0.0:1788201310.174464:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695495296:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 790us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201310.174472:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 232 00000100:00100000:0.0:1788201310.174508:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695495552 00000100:00100000:0.0:1788201310.174512:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695495552 00000100:00100000:0.0:1788201310.174544:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695495424 00000100:00100000:0.0:1788201310.174547:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695495424 00000100:00100000:0.0:1788201310.174573:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1601 00000100:00100000:0.0:1788201310.174580:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2400:x1875060695495552:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201310.174614:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2400:x1875060695495552:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 34us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201310.174634:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1601 00000100:00100000:0.0:1788201310.174647:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1602 00000100:00100000:0.0:1788201310.174654:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13336bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2400:x1875060695495424:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201310.174680:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13336bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2400:x1875060695495424:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201310.174686:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1602 00000100:00080000:1.0:1788201310.176502:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201310.176510:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201310.176513:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:2.0:1788201310.397443:0:98202:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing load_module ../libcfs/libcfs/libcfs 00010000:00010000:1.0:1788201310.999143:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201311.570950:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201311.570975:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715313792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201311.571059:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201311.571105:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715313792 00000100:00100000:2.0:1788201311.571112:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715313792 00000100:00100000:2.0:1788201311.571163:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2387 00000100:00100000:2.0:1788201311.571173:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715313792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201311.571204:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201311.571247:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715313792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201311.571253:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2387 00000100:00080000:2.0:1788201311.571274:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201311.571306:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715313792:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788201312.015196:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201313.043467:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201313.615917:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715313920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201313.616049:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201313.616225:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715313920 00000100:00100000:0.0:1788201313.616236:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715313920 00000100:00100000:0.0:1788201313.616305:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4143 00000100:00100000:0.0:1788201313.616317:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715313920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201313.616371:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:0.0:1788201313.616441:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715313920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201313.616450:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4143 00000100:00100000:2.0:1788201313.616681:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715313920:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788201314.063292:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201314.127217:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715314048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201314.127324:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201314.127417:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715314048 00000100:00100000:1.0:1788201314.127426:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715314048 00000100:00100000:1.0:1788201314.127499:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2388 00000100:00100000:1.0:1788201314.127511:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715314048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201314.127563:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201314.127619:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715314048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201314.127627:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2388 00000100:00080000:1.0:1788201314.127653:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201314.127697:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715314048:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788201314.128802:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201314.128820:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788201314.128825:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201314.128833:0:93109:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 4160 00000100:00080000:2.0:1788201314.128840:0:93109:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788201314.128846:0:93109:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8dc006d84000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201314.128873:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d5b480 x1875060715314688/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201314.128900:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201314.128904:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788201314.128906:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201314.128910:0:93109:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 4160 00000100:00080000:2.0:1788201314.128912:0:93109:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788201314.128915:0:93109:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dc109815000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201314.128927:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d5aa00 x1875060715315072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201314.129113:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715314304:0@lo:400:kworker.0 00000100:00100000:2.0:1788201314.129180:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201314.129211:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715314944:0@lo:400:kworker.0 00000100:00100000:2.0:1788201314.129231:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201314.129391:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788201314.129398:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715314176:0@lo:400:kworker.0 00000100:00100000:2.0:1788201314.129429:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201314.129458:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715314816:0@lo:400:kworker.0 00000100:00100000:2.0:1788201314.129485:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201314.131567:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715314304 00000100:00100000:0.0:1788201314.131580:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715314304 00000100:00100000:0.0:1788201314.131661:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715314944 00000100:00100000:0.0:1788201314.131664:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715314944 00000100:00100000:0.0:1788201314.131690:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1603 00000100:00100000:0.0:1788201314.131701:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715314304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201314.131809:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715314304:12345-0@lo:400:kworker.0 Request processed in 110us (2628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201314.131818:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1603 00000100:00100000:0.0:1788201314.131840:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1604 00000100:00100000:0.0:1788201314.131846:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715314944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201314.131877:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715314944:12345-0@lo:400:kworker.0 Request processed in 32us (2645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201314.131883:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1604 00000100:00100000:0.0:1788201314.131944:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715314304:0@lo:400:kworker.0 00000100:00100000:0.0:1788201314.131960:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715314944:0@lo:400:kworker.0 00000100:00100000:1.0:1788201314.132371:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715314688:0@lo:8:kworker.0 00000100:00100000:1.0:1788201314.132421:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201314.132460:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715315072:0@lo:8:kworker.0 00000100:00100000:1.0:1788201314.132487:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201314.132533:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715314816 00000100:00100000:1.0:1788201314.132537:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715314816 00000100:00100000:1.0:1788201314.132591:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715314688 00000100:00100000:1.0:1788201314.132594:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715314688 00000100:00100000:1.0:1788201314.132609:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715315072 00000100:00100000:1.0:1788201314.132611:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715315072 00000100:00100000:1.0:1788201314.132625:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2948 00000100:00100000:1.0:1788201314.132633:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715314816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201314.132675:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715314816:12345-0@lo:400:kworker.0 Request processed in 43us (3189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201314.132682:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2948 00000100:00100000:1.0:1788201314.132699:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6012 00000100:00100000:1.0:1788201314.132704:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3654:x1875060715314688:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788201314.132743:0:26201:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201314.132775:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3654:x1875060715314688:12345-0@lo:8:kworker.0 Request processed in 69us (354us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201314.132782:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6012 00000100:00100000:1.0:1788201314.132793:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6013 00000100:00100000:1.0:1788201314.132797:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3654:x1875060715315072:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788201314.132807:0:26201:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201314.132827:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3654:x1875060715315072:12345-0@lo:8:kworker.0 Request processed in 28us (339us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201314.132833:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6013 00000100:00100000:1.0:1788201314.132869:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715314432:0@lo:400:kworker.0 00000100:00100000:1.0:1788201314.132899:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201314.132921:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715315200:0@lo:400:kworker.0 00000100:00100000:1.0:1788201314.132942:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201314.132964:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201314.132970:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715314560:0@lo:400:kworker.0 00000100:00100000:1.0:1788201314.133000:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201314.133051:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13336aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715315328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201314.133071:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201314.133099:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715314432 00000100:00100000:1.0:1788201314.133103:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715314432 00000100:00100000:1.0:1788201314.133132:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715315200 00000100:00100000:1.0:1788201314.133135:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715315200 00000100:00100000:1.0:1788201314.133150:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1605 00000100:00100000:1.0:1788201314.133157:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715314432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201314.133203:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715314432:12345-0@lo:400:kworker.0 Request processed in 46us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201314.133210:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1605 00000100:00100000:1.0:1788201314.133222:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1606 00000100:00100000:1.0:1788201314.133228:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715315200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201314.133269:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715315200:12345-0@lo:400:kworker.0 Request processed in 41us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201314.133275:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1606 00000100:00100000:1.0:1788201314.133294:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715314560 00000100:00100000:1.0:1788201314.133298:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715314560 00000100:00100000:1.0:1788201314.133319:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715315328 00000100:00100000:1.0:1788201314.133322:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715315328 00000100:00100000:1.0:1788201314.133340:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4144 00000100:00100000:1.0:1788201314.133346:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3655:x1875060715314560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201314.133378:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3655:x1875060715314560:12345-0@lo:400:kworker.0 Request processed in 32us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201314.133385:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4144 00000100:00100000:1.0:1788201314.133395:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4145 00000100:00100000:1.0:1788201314.133401:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715315328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201314.133430:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:1.0:1788201314.133462:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715315328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201314.133468:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4145 00000100:00080000:1.0:1788201314.133493:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201314.133498:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201314.133501:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201314.133541:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715314816:0@lo:400:kworker.0 00000100:00080000:1.0:1788201314.133584:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201314.133590:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201314.133594:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715314688:0@lo:8:kworker.0 00000100:00080000:1.0:1788201314.133603:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201314.133607:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201314.133610:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715315072:0@lo:8:kworker.0 00000100:00100000:1.0:1788201314.133635:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715314560:0@lo:400:kworker.0 00000100:00100000:1.0:1788201314.133648:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13336aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715315328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201314.133659:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715314432:0@lo:400:kworker.0 00000100:00100000:1.0:1788201314.133668:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715315200:0@lo:400:kworker.0 00000100:00100000:3.0:1788201314.134374:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715314176 00000100:00100000:3.0:1788201314.134384:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715314176 00000100:00100000:3.0:1788201314.134436:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788201314.134445:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:3658:x1875060715314176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201314.134528:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:3658:x1875060715314176:12345-0@lo:400:kworker.0 Request processed in 84us (5097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201314.134535:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788201314.139927:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715314176:0@lo:400:kworker.0 00010000:00010000:1.0:1788201315.091731:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201315.291676:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201315.291737:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201315.291765:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201315.291785:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201315.291813:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201315.291851:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695496320 00000100:00100000:1.0:1788201315.291864:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695496320 00000100:00100000:1.0:1788201315.291910:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695496448 00000100:00100000:1.0:1788201315.291913:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695496448 00000100:00100000:1.0:1788201315.291977:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2949 00000100:00100000:1.0:1788201315.291991:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2402:x1875060695496448:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201315.292197:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2402:x1875060695496448:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 207us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201315.292206:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2949 00000100:00100000:1.0:1788201315.292231:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6014 00000100:00100000:1.0:1788201315.292236:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2399:x1875060695496320:12345-192.168.201.20@tcp:8:kworker.0 00010000:00020000:1.0:1788201315.292264:0:8446:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201315.292362:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2399:x1875060695496320:12345-192.168.201.20@tcp:8:kworker.0 Request processed in 53us (1010us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201315.292370:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6014 00000100:00100000:1.0:1788201315.292392:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695495936 00000100:00100000:1.0:1788201315.292396:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695495936 00000100:00100000:1.0:1788201315.292428:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 234 00000100:00100000:1.0:1788201315.292435:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695495936:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201315.292464:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695495936:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 30us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201315.292471:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 234 00000100:00100000:1.0:1788201315.292504:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695496192 00000100:00100000:1.0:1788201315.292508:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695496192 00000100:00100000:1.0:1788201315.292551:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695496064 00000100:00100000:1.0:1788201315.292555:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695496064 00000100:00100000:1.0:1788201315.292580:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1607 00000100:00100000:1.0:1788201315.292586:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695496192:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201315.292615:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695496192:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 30us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201315.292622:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1607 00000100:00100000:1.0:1788201315.292644:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1608 00000100:00100000:1.0:1788201315.292650:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2403:x1875060695496064:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201315.292676:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2403:x1875060695496064:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201315.292682:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1608 00000100:00080000:1.0:1788201315.292713:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201315.292717:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201315.292719:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788201316.111338:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201316.693799:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715315456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201316.693902:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201316.694877:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715315456 00000100:00100000:2.0:1788201316.694891:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715315456 00000100:00100000:2.0:1788201316.694980:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2389 00000100:00100000:2.0:1788201316.694993:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715315456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201316.695069:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201316.695149:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715315456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 158us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201316.695157:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2389 00000100:00100000:2.0:1788201316.695223:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715315456:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788201316.695470:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788201317.138811:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201318.161366:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201318.735787:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201318.735819:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715315584:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201318.735920:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201318.740697:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715315584 00000100:00100000:0.0:1788201318.740721:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715315584 00000100:00100000:0.0:1788201318.740825:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4146 00000100:00100000:0.0:1788201318.740838:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715315584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201318.740892:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:0.0:1788201318.741010:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715315584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 174us (5089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201318.741042:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4146 00000100:00100000:2.0:1788201318.741410:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715315584:0@lo:41:osp-pre-1-0.0 00000020:01000004:1.0:1788201318.797728:0:98552:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788201318.797734:0:98552:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788201318.797735:0:98552:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788201318.797938:0:98552:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dc12b6b8000 00000020:01000004:1.0:1788201318.797956:0:98552:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788201318.797974:0:98552:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788201318.797990:0:98552:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8dc139bb8000) 00000020:00000080:1.0:1788201318.798008:0:98552:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788201318.834606:0:98552:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788201318.837289:0:98552:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788201318.837637:0:98552:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788201318.838157:0:98552:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788201318.838408:0:98552:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788201318.838641:0:98552:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788201318.838923:0:98552:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:1.0:1788201318.840692:0:98552:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788201318.841170:0:98552:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788201318.841188:0:98552:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788201318.841206:0:98552:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x96d0c9b8c9a1d557 00000020:01000004:1.0:1788201318.841215:0:98552:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788201318.841260:0:98552:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.120@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788201318.841265:0:98552:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788201318.841274:0:98552:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788201318.841312:0:98552:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788201318.841317:0:98552:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788201318.852374:0:98552:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788201318.852426:0:98552:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.120@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788201318.852459:0:98552:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788201318.852461:0:98552:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788201318.852463:0:98552:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201318.852464:0:98552:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201318.852464:0:98552:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201318.852474:0:98552:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201318.852476:0:98552:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201318.852478:0:98552:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201318.852480:0:98552:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788201318.852484:0:98552:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788201318.852486:0:98552:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788201318.852487:0:98552:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788201318.852488:0:98552:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201318.852489:0:98552:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201318.852490:0:98552:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201318.852491:0:98552:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201318.852492:0:98552:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201318.852493:0:98552:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201318.852494:0:98552:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788201318.852533:0:98552:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788201318.852560:0:98552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13336ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715315712:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788201318.852660:0:98552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201318.852722:0:98552:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1011ca300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201318.853053:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715315712 00000100:00100000:3.0:1788201318.853065:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715315712 00000100:00100000:3.0:1788201318.853139:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788201318.853151:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:98552:x1875060715315712:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788201318.853190:0:94467:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788201318.853193:0:94467:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788201318.853198:0:94467:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788201318.853574:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:98552:x1875060715315712:12345-0@lo:253:mount.lustre.0 Request processed in 424us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.853583:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788201318.853698:0:98552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13336ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715315712:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788201318.853713:0:98552:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788201318.853716:0:98552:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788201318.853717:0:98552:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788201318.853718:0:98552:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201318.853720:0:98552:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201318.853721:0:98552:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201318.853722:0:98552:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201318.853723:0:98552:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201318.853724:0:98552:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201318.853725:0:98552:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788201318.853757:0:98552:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dc12b6b8000 from lustre-OST0000 10000000:01000000:0.0:1788201318.853899:0:98552:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788201318.853903:0:98552:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788201318.853925:0:98552:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8dc12563cd28 local copy 00010000:00010000:0.0:1788201318.853938:0:98552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1cabb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1cac2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201318.854178:0:98552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13336ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715315840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201318.854219:0:98552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201318.854301:0:98552:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a86e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201318.854383:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715315840 00000100:00100000:1.0:1788201318.854390:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715315840 00000100:00100000:1.0:1788201318.854465:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788201318.854485:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:98552:x1875060715315840:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201318.854579:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:98552:x1875060715315840:12345-0@lo:501:mount.lustre.0 Request processed in 97us (359us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201318.854587:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788201318.854674:0:98552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13336ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715315840:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788201318.854691:0:98552:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788201318.854714:0:98552:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788201318.854722:0:98552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1cabb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1cac2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201318.854731:0:98552:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1cabb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1cac2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201318.854762:0:98552:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dc12b6b8000 10000000:01000000:2.0:1788201318.854768:0:98552:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788201318.854784:0:98552:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788201318.854788:0:98552:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788201318.854802:0:98552:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788201318.854805:0:98552:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788201318.854832:0:98552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc200/0x96d0c9b8c9a1d55e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201318.854840:0:98552:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc200/0x96d0c9b8c9a1d55e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201318.854850:0:98552:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc200/0x96d0c9b8c9a1d55e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201318.854864:0:98552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715315968:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201318.854900:0:98552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201318.855064:0:98552:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006d03cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201318.855192:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715315968 00000100:00100000:0.0:1788201318.855198:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715315968 00000100:00100000:0.0:1788201318.855238:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788201318.855246:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:98552:x1875060715315968:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201318.855256:0:94461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201318.855270:0:94461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140d58c00/0x96d0c9b8c9a1d565 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1d55e expref: -99 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201318.855293:0:94461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140d58c00/0x96d0c9b8c9a1d565 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d55e expref: 22 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201318.855305:0:94461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140d58c00/0x96d0c9b8c9a1d565 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d55e expref: 22 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201318.855316:0:94461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58c00, rc 0) 00000100:00100000:0.0:1788201318.855348:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:98552:x1875060715315968:12345-0@lo:101:mount.lustre.0 Request processed in 103us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201318.855354:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788201318.855432:0:98552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715315968:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201318.855446:0:98552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc200/0x96d0c9b8c9a1d55e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d565 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201318.855455:0:98552:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc200/0x96d0c9b8c9a1d55e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d565 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201318.856609:0:98552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1788201318.857403:0:98552:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201318.859705:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788201318.859869:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788201318.859889:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788201318.859903:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788201318.859919:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788201318.859934:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788201318.859948:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788201318.859976:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788201318.859991:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1788201318.860006:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1788201318.860489:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1788201318.860511:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1788201318.860542:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1788201318.860549:0:98552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1788201318.860702:0:98552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715316096:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201318.860995:0:98552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201318.861088:0:98552:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1259ae9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201318.861203:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715316096 00000100:00100000:0.0:1788201318.861214:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715316096 00000100:00100000:0.0:1788201318.861383:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788201318.861395:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:98552:x1875060715316096:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201318.861607:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:98552:x1875060715316096:12345-0@lo:501:mount.lustre.0 Request processed in 213us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201318.861616:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788201318.861726:0:98552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715316096:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201318.861790:0:98552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715316224:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201318.861843:0:98552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201318.861875:0:98552:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0072ff600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201318.862047:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715316224 00000100:00100000:3.0:1788201318.862053:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715316224 00000100:00100000:3.0:1788201318.862089:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788201318.862097:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:98552:x1875060715316224:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201318.862196:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:98552:x1875060715316224:12345-0@lo:503:mount.lustre.0 Request processed in 98us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.862204:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788201318.862445:0:98552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715316224:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788201318.863722:0:98552:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788201318.863930:0:98552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715316352:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201318.864199:0:98552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201318.864352:0:98552:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1011ca300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201318.864410:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715316352 00000100:00100000:3.0:1788201318.864418:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715316352 00000100:00100000:3.0:1788201318.864518:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788201318.864529:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:98552:x1875060715316352:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201318.864685:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:98552:x1875060715316352:12345-0@lo:502:mount.lustre.0 Request processed in 158us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.864704:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788201318.864811:0:98552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715316352:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201318.865147:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788201318.865181:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788201318.865194:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788201318.865209:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788201318.865222:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788201318.865428:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788201318.865443:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788201318.865457:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788201318.865484:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1788201318.865499:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1788201318.865510:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1788201318.865522:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1788201318.865561:0:98552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715316480:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201318.865625:0:98552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201318.865977:0:98552:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0072ff600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201318.866103:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715316480 00000100:00100000:0.0:1788201318.866112:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715316480 00000100:00100000:0.0:1788201318.866172:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788201318.866183:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:98552:x1875060715316480:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201318.866689:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:98552:x1875060715316480:12345-0@lo:502:mount.lustre.0 Request processed in 507us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201318.866698:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788201318.866816:0:98552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715316480:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201318.866893:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1788201318.866906:0:98552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788201318.868091:0:98556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788201318.868104:0:98556:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788201318.868112:0:98556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201318.868115:0:98556:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788201318.868121:0:98556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201318.868142:0:98556:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8dc139bbb370) 00000020:00000080:1.0:1788201318.868178:0:98556:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788201318.868185:0:98556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788201318.868348:0:98556:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc12b6b8000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788201318.868357:0:98556:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788201318.868369:0:98556:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x96d0c9b8c9a1d573 00010000:00010000:1.0:1788201318.873446:0:98556:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00080000:1.0:1788201318.874223:0:98556:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294969456 srv lr: 4294969478 lx: 1875060715197312 gen 0 00000001:00080000:1.0:1788201318.874332:0:98556:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 1 lr: 4294969474 srv lr: 4294969478 lx: 1875060715280896 gen 0 00000001:00080000:1.0:1788201318.874348:0:98556:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 6e293f14-c501-4bc5-9dd4-a18ef02756b4 idx: 2 lr: 4294969498 srv lr: 4294969478 lx: 1875060695485056 gen 0 00000001:00000004:1.0:1788201318.874368:0:98556:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 4294969498 00080000:10000000:1.0:1788201318.876727:0:98556:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1788201318.878706:0:98556:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788201318.878722:0:98556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201318.878731:0:98556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201318.878733:0:98556:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788201318.878737:0:98556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788201318.878740:0:98556:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1788201318.878742:0:98556:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201318.878743:0:98556:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201318.878745:0:98556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788201318.878747:0:98556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201318.878749:0:98556:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788201318.878751:0:98556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201318.878755:0:98556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201318.878756:0:98556:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788201318.878759:0:98556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788201318.878761:0:98556:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788201318.878764:0:98556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201318.878766:0:98556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201318.878767:0:98556:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788201318.878769:0:98556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201318.878772:0:98556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201318.878848:0:98556:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788201318.878854:0:98556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788201318.878892:0:98556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201318.878895:0:98556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201318.878896:0:98556:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788201318.878900:0:98556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1788201318.881173:0:98552:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788201318.881309:0:98552:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788201318.881340:0:98552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc200/0x96d0c9b8c9a1d55e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d565 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201318.881356:0:98552:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc200/0x96d0c9b8c9a1d55e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d565 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201318.881366:0:98552:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc12b6b8000 from 1 10000000:01000000:2.0:1788201318.881369:0:98552:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201318.881422:0:98552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbde00/0x96d0c9b8c9a1d58f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201318.881432:0:98552:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc006dbde00/0x96d0c9b8c9a1d58f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201318.881445:0:98552:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc006dbde00/0x96d0c9b8c9a1d58f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201318.881486:0:98552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715316608:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201318.881587:0:98552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201318.883743:0:98552:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1259ae000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201318.884155:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715316608 00000100:00100000:3.0:1788201318.884169:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715316608 00000100:00100000:3.0:1788201318.884315:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788201318.884328:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+22:98552:x1875060715316608:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201318.884351:0:94467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201318.884374:0:94467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc108c75200/0x96d0c9b8c9a1d596 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1d58f expref: -99 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201318.884409:0:94467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc108c75200/0x96d0c9b8c9a1d596 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d58f expref: 23 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201318.884423:0:94467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc108c75200/0x96d0c9b8c9a1d596 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d58f expref: 23 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201318.884434:0:94467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c75200, rc 0) 00000100:00100000:3.0:1788201318.884528:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+23:98552:x1875060715316608:12345-0@lo:101:mount.lustre.0 Request processed in 203us (2940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.884535:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788201318.885984:0:98552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715316608:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201318.886038:0:98552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc006dbde00/0x96d0c9b8c9a1d58f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d596 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201318.886053:0:98552:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc006dbde00/0x96d0c9b8c9a1d58f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d596 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201318.887897:0:98552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 7 00000040:00080000:2.0:1788201318.888735:0:98552:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201318.889549:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788201318.889580:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788201318.889594:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788201318.889605:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788201318.889616:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788201318.889631:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788201318.889637:0:98552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 6 count 7 00000100:00100000:2.0:1788201318.889759:0:98552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715316736:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201318.890273:0:98552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201318.890334:0:98552:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1259ae9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201318.890401:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715316736 00000100:00100000:3.0:1788201318.890412:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715316736 00000100:00100000:3.0:1788201318.890483:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788201318.890495:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+23:98552:x1875060715316736:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201318.890662:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+23:98552:x1875060715316736:12345-0@lo:501:mount.lustre.0 Request processed in 168us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.890670:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788201318.890765:0:98552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715316736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201318.890825:0:98552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715316864:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201318.890879:0:98552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201318.890907:0:98552:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ce69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201318.891047:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715316864 00000100:00100000:3.0:1788201318.891060:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715316864 00000100:00100000:3.0:1788201318.891093:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788201318.891099:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+23:98552:x1875060715316864:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201318.891193:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+23:98552:x1875060715316864:12345-0@lo:503:mount.lustre.0 Request processed in 93us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.891200:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788201318.891367:0:98552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715316864:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788201318.891827:0:98552:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788201318.891913:0:98552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715316992:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201318.891965:0:98552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201318.891992:0:98552:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ce69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201318.892156:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715316992 00000100:00100000:3.0:1788201318.892162:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715316992 00000100:00100000:3.0:1788201318.892198:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788201318.892206:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+23:98552:x1875060715316992:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201318.892301:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+23:98552:x1875060715316992:12345-0@lo:502:mount.lustre.0 Request processed in 95us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.892308:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788201318.892439:0:98552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715316992:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201318.892668:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788201318.892692:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1788201318.892703:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1788201318.892714:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1788201318.892725:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000100:00100000:0.0:1788201318.892745:0:98552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715317120:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201318.892844:0:98552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201318.892872:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715317120 00000100:00100000:0.0:1788201318.892876:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715317120 00000100:00100000:0.0:1788201318.892910:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788201318.892917:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003bfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:98552:x1875060715317120:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201318.892982:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003bfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:98552:x1875060715317120:12345-0@lo:502:mount.lustre.0 Request processed in 65us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201318.892989:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788201318.893051:0:98552:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ce69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201318.893063:0:98552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715317120:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201318.893094:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1788201318.893101:0:98552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:3.0:1788201318.895500:0:98560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201318.895519:0:98560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201318.895523:0:98560:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788201318.895533:0:98560:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc12b6b8000 00000020:00000080:3.0:1788201318.895537:0:98560:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788201318.895546:0:98560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201318.895549:0:98560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201318.895550:0:98560:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788201318.895553:0:98560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201318.895555:0:98560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201318.895556:0:98560:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788201318.895559:0:98560:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc12b6b8000 00000020:00000080:3.0:1788201318.895561:0:98560:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788201318.895635:0:98560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201318.895638:0:98560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201318.895640:0:98560:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788201318.895643:0:98560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 7 count 7 00000020:01000000:2.0:1788201318.895963:0:98552:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1788201318.896006:0:98552:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788201318.896061:0:98552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbde00/0x96d0c9b8c9a1d58f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d596 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201318.896076:0:98552:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc006dbde00/0x96d0c9b8c9a1d58f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d596 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201318.896162:0:98552:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788201318.896165:0:98552:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dc12b6b8000 10000000:01000000:2.0:1788201318.896169:0:98552:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dc12b6b8000 10000000:01000000:2.0:1788201318.896175:0:98552:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788201318.896182:0:98552:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc12b6b8000 from 1 10000000:01000000:2.0:1788201318.896185:0:98552:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788201318.896242:0:98552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc000/0x96d0c9b8c9a1d59d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201318.896251:0:98552:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc000/0x96d0c9b8c9a1d59d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201318.896262:0:98552:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc000/0x96d0c9b8c9a1d59d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201318.896293:0:98552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715317248:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201318.896381:0:98552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201318.896721:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715317248 00000100:00100000:0.0:1788201318.896730:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715317248 00000100:00100000:0.0:1788201318.896886:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788201318.896900:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003bfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+23:98552:x1875060715317248:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201318.896917:0:94467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201318.896934:0:94467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140d58600/0x96d0c9b8c9a1d5a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1d59d expref: -99 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201318.896966:0:94467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140d58600/0x96d0c9b8c9a1d5a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d59d expref: 24 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201318.896990:0:94467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140d58600/0x96d0c9b8c9a1d5a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d59d expref: 24 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201318.897000:0:94467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58600, rc 0) 00000100:00100000:0.0:1788201318.897082:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003bfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:98552:x1875060715317248:12345-0@lo:101:mount.lustre.0 Request processed in 185us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201318.897090:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788201318.898366:0:98552:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1259ae9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201318.898409:0:98552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715317248:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201318.898439:0:98552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc000/0x96d0c9b8c9a1d59d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d5a4 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201318.898453:0:98552:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc000/0x96d0c9b8c9a1d59d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d5a4 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201318.902379:0:98552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64 count 63 00000040:00080000:3.0:1788201318.902855:0:98552:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201318.903172:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788201318.903200:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788201318.903217:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788201318.903246:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788201318.903264:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788201318.903276:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788201318.903289:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788201318.903303:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788201318.903316:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788201318.903330:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788201318.903344:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788201318.903357:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788201318.903371:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788201318.903385:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788201318.903397:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788201318.903409:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788201318.903422:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788201318.903436:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788201318.903449:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788201318.903462:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788201318.903489:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788201318.903504:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788201318.903519:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788201318.903533:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788201318.903546:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1788201318.903561:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1788201318.903576:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1788201318.903588:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1788201318.903601:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1788201318.903611:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1788201318.903621:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1788201318.903645:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1788201318.903657:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1788201318.903671:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1788201318.903683:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1788201318.903696:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1788201318.903710:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1788201318.903723:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1788201318.903736:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1788201318.903749:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1788201318.903762:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1788201318.903774:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1788201318.903786:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1788201318.903798:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1788201318.903812:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1788201318.903824:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1788201318.903836:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1788201318.903849:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1788201318.903971:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1788201318.903990:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1788201318.904002:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1788201318.904013:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].52, 224 off17176 00000040:00080000:3.0:1788201318.904057:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].53, 112 off17288 00000040:00080000:3.0:1788201318.904070:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].54, 224 off17512 00000040:00080000:3.0:1788201318.904082:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].55, 224 off17736 00000040:00080000:3.0:1788201318.904093:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].56, 136 off17872 00000040:00080000:3.0:1788201318.904106:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].57, 224 off18096 00000040:00080000:3.0:1788201318.904118:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].58, 224 off18320 00000040:00080000:3.0:1788201318.904129:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].59, 136 off18456 00000040:00080000:3.0:1788201318.904142:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].60, 224 off18680 00000040:00080000:3.0:1788201318.904156:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].61, 224 off18904 00000040:00080000:3.0:1788201318.904170:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].62, 112 off19016 00000040:00080000:3.0:1788201318.904189:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].63, 224 off19240 00000040:00080000:3.0:1788201318.904195:0:98552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 63 count 63 00000100:00100000:3.0:1788201318.904333:0:98552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715317376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201318.904423:0:98552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201318.904486:0:98552:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc106470a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201318.905404:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715317376 00000100:00100000:2.0:1788201318.905419:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715317376 00000100:00100000:2.0:1788201318.905505:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788201318.905525:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:98552:x1875060715317376:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201318.905723:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:98552:x1875060715317376:12345-0@lo:501:mount.lustre.0 Request processed in 200us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201318.905732:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788201318.906711:0:98552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715317376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201318.906795:0:98552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715317504:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201318.906869:0:98552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201318.906918:0:98552:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc106470a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201318.907429:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715317504 00000100:00100000:1.0:1788201318.907438:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715317504 00000100:00100000:1.0:1788201318.907509:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788201318.907521:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:98552:x1875060715317504:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201318.907676:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:98552:x1875060715317504:12345-0@lo:503:mount.lustre.0 Request processed in 156us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201318.907689:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788201318.909445:0:98552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715317504:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788201318.910207:0:98552:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201318.910407:0:98552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715317632:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201318.910518:0:98552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201318.910572:0:98552:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc106470a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201318.910666:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715317632 00000100:00100000:2.0:1788201318.910675:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715317632 00000100:00100000:2.0:1788201318.910739:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788201318.910750:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:98552:x1875060715317632:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201318.910988:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:98552:x1875060715317632:12345-0@lo:502:mount.lustre.0 Request processed in 239us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201318.910996:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788201318.911147:0:98552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715317632:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201318.911435:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788201318.911481:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788201318.911498:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788201318.911514:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788201318.911530:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788201318.911545:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788201318.911560:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788201318.911573:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788201318.911586:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788201318.911600:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788201318.911612:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788201318.911626:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788201318.911638:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788201318.911652:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788201318.911672:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788201318.911686:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788201318.911699:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788201318.911712:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788201318.911725:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788201318.911737:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788201318.911750:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788201318.911761:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788201318.911905:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788201318.911931:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788201318.911945:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1788201318.911958:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1788201318.911970:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1788201318.911983:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1788201318.912011:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1788201318.912072:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1788201318.912085:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1788201318.912096:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1788201318.912105:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1788201318.912116:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1788201318.912128:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1788201318.912140:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1788201318.912151:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1788201318.912164:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1788201318.912178:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1788201318.912191:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1788201318.912205:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1788201318.912217:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1788201318.912285:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1788201318.912302:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1788201318.912315:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1788201318.912327:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1788201318.912339:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1788201318.912351:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1788201318.912407:0:98552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715317760:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201318.912491:0:98552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201318.912545:0:98552:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125ae4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201318.912643:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715317760 00000100:00100000:2.0:1788201318.912651:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715317760 00000100:00100000:2.0:1788201318.912709:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788201318.912720:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:98552:x1875060715317760:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201318.912990:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:98552:x1875060715317760:12345-0@lo:502:mount.lustre.0 Request processed in 270us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201318.912998:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788201318.913128:0:98552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715317760:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201318.913973:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1788201318.914340:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000040:00080000:3.0:1788201318.914363:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1788201318.914378:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].52, 224 off17176 00000040:00080000:3.0:1788201318.914392:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].53, 112 off17288 00000040:00080000:3.0:1788201318.914405:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].54, 224 off17512 00000040:00080000:3.0:1788201318.914421:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].55, 224 off17736 00000040:00080000:3.0:1788201318.914435:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].56, 136 off17872 00000040:00080000:3.0:1788201318.914448:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].57, 224 off18096 00000040:00080000:3.0:1788201318.914460:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].58, 224 off18320 00000040:00080000:3.0:1788201318.914485:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].59, 136 off18456 00000040:00080000:3.0:1788201318.914499:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].60, 224 off18680 00000040:00080000:3.0:1788201318.914512:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].61, 224 off18904 00000040:00080000:3.0:1788201318.914522:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].62, 112 off19016 00000100:00100000:3.0:1788201318.914584:0:98552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715317888:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201318.914670:0:98552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201318.914711:0:98552:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc106470000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201318.915360:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715317888 00000100:00100000:2.0:1788201318.915371:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715317888 00000100:00100000:2.0:1788201318.915437:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788201318.915452:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:98552:x1875060715317888:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201318.915629:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:98552:x1875060715317888:12345-0@lo:502:mount.lustre.0 Request processed in 178us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201318.915637:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788201318.915863:0:98552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715317888:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201318.915954:0:98552:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].63, 224 off19240 00000040:00080000:1.0:1788201318.915969:0:98552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 00000020:01000004:3.0:1788201318.918167:0:98562:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788201318.918191:0:98562:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8dc12ef60000) 00000020:00000080:3.0:1788201318.918226:0:98562:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788201318.918914:0:98562:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc12b6b8000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788201318.918919:0:98562:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc12b6b8000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788201318.918921:0:98562:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc12b6b8000 3 00010000:00080000:3.0:1788201318.918959:0:98562:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc11077f800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.120@tcp at head 00010000:00010000:3.0:1788201318.923153:0:98562:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000080:3.0:1788201318.924611:0:98562:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788201318.924671:0:98562:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788201318.924690:0:98562:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x96d0c9b8c9a1d5b2 00000100:00080000:3.0:1788201318.924704:0:98562:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201318.924711:0:98562:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc11077f800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201318.924760:0:98562:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efc9500 x1875060715318016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201318.927766:0:98562:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788201318.927888:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201318.927893:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788201318.927897:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201318.927908:0:57134:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 4165 00000100:00080000:3.0:1788201318.927915:0:57134:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788201318.927925:0:57134:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8dc006d84000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201318.927951:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efc8700 x1875060715318528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201318.927996:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201318.927999:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788201318.928001:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201318.928004:0:57134:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 4165 00000100:00080000:3.0:1788201318.928007:0:57134:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788201318.928011:0:57134:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dc109815000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201318.928044:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efcb100 x1875060715318912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201318.928925:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715318016:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788201318.929059:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201318.929120:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715318528:0@lo:8:kworker.0 00000100:00100000:1.0:1788201318.929163:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201318.929183:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715318912:0@lo:8:kworker.0 00000100:00100000:1.0:1788201318.929208:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201318.929573:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715318400:0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.929613:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201318.929638:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715319168:0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.929663:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201318.929689:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201318.929697:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715318656:0@lo:400:kworker.0 00000100:00100000:3.0:1788201318.929721:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201318.930942:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715318144:0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.931011:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201318.931075:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715318784:0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.931102:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201318.931132:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201318.931138:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715318272:0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.931164:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201318.931181:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715319040:0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.931208:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201318.931889:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715318016 00000100:00100000:1.0:1788201318.931902:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715318016 00000100:00100000:1.0:1788201318.931940:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715319168 00000100:00100000:1.0:1788201318.931943:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715319168 00000100:00100000:1.0:1788201318.931973:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715318144 00000100:00100000:1.0:1788201318.931975:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715318144 00000100:00100000:1.0:1788201318.932011:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715318784 00000100:00100000:1.0:1788201318.932042:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715318784 00000100:00100000:1.0:1788201318.932058:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715318272 00000100:00100000:1.0:1788201318.932061:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715318272 00000100:00100000:1.0:1788201318.932087:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1609 00000100:00100000:1.0:1788201318.932098:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715319168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.932188:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715319168:12345-0@lo:400:kworker.0 Request processed in 90us (2523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201318.932195:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1609 00000100:00100000:1.0:1788201318.936190:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1610 00000100:00100000:1.0:1788201318.936257:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715318528 00000100:00100000:1.0:1788201318.936270:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715318528 00000100:00100000:1.0:1788201318.936322:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715318912 00000100:00100000:1.0:1788201318.936326:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715318912 00000100:00100000:1.0:1788201318.936342:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715318656 00000100:00100000:1.0:1788201318.936345:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715318656 00000100:00100000:1.0:1788201318.936383:0:26199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715319040 00000100:00100000:1.0:1788201318.936386:0:26199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715319040 00000100:00100000:1.0:1788201318.936413:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2950 00000100:00100000:1.0:1788201318.936421:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715318656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.936549:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715318656:12345-0@lo:400:kworker.0 Request processed in 129us (6826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201318.936557:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2950 00000100:00100000:1.0:1788201318.936577:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2951 00000100:00100000:1.0:1788201318.936584:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715319040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.936618:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715319040:12345-0@lo:400:kworker.0 Request processed in 36us (5409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201318.936624:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2951 00000100:00100000:1.0:1788201318.936634:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6015 00000100:00100000:1.0:1788201318.936639:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3654:x1875060715318528:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788201318.936754:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3654:x1875060715318528:12345-0@lo:8:kworker.0 Request processed in 113us (7589us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788201318.936761:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6015 00000100:00100000:1.0:1788201318.936773:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6016 00000100:00100000:1.0:1788201318.936777:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3654:x1875060715318912:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788201318.936809:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3654:x1875060715318912:12345-0@lo:8:kworker.0 Request processed in 30us (7601us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788201318.936827:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6016 00000100:00100000:1.0:1788201318.936856:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715318400 00000100:00100000:1.0:1788201318.936861:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715318400 00000100:00100000:1.0:1788201318.936893:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4147 00000100:00100000:1.0:1788201318.936899:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715318400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.936934:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715318400:12345-0@lo:400:kworker.0 Request processed in 35us (7321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201318.936940:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4147 00000020:01000004:0.0:1788201318.938234:0:98562:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788201318.938256:0:98562:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8dc12f308000) 00000020:00000080:0.0:1788201318.938289:0:98562:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1788201318.938398:0:98562:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc12b6b8000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788201318.938403:0:98562:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc12b6b8000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788201318.938406:0:98562:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc12b6b8000 3 00010000:00080000:0.0:1788201318.938445:0:98562:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc001db5800@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.120@tcp at head 00000100:00100000:2.0:1788201318.939909:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1607 00000100:00100000:2.0:1788201318.939937:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715318016:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788201318.939984:0:66313:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 4170 last 0 00000020:00000080:2.0:1788201318.940067:0:66313:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x96d0c9b8c9a1d5c0 00000004:00100000:2.0:1788201318.940093:0:66313:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201318.940139:0:66313:0:(import.c:65:import_set_state_nolock()) ffff8dc00520b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201318.940260:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875060715318016:12345-0@lo:38:llog_process_th.0 Request processed in 328us (11201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201318.940269:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1607 00000100:00100000:2.0:1788201318.940316:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1611 00000100:00100000:2.0:1788201318.940327:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715318784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201318.940364:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715318784:12345-0@lo:400:kworker.0 Request processed in 40us (9261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201318.940370:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1611 00000100:00100000:2.0:1788201318.940385:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1612 00000100:00100000:2.0:1788201318.940392:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715318272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201318.940425:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715318272:12345-0@lo:400:kworker.0 Request processed in 34us (9261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201318.940431:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1612 00000100:00080000:1.0:1788201318.940724:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201318.940731:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201318.940734:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201318.940861:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715318656:0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.940881:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715318400:0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.940895:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715319168:0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.940956:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715318272:0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.940971:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715319040:0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.940984:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715318784:0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.941062:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788201318.941072:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 29 00000100:00080000:1.0:1788201318.941082:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788201318.941088:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788201318.941091:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11077f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788201318.941098:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715318016:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788201318.941131:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201318.941135:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788201318.941138:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715318528:0@lo:8:kworker.0 00000100:00080000:1.0:1788201318.941149:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201318.941152:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788201318.941155:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715318912:0@lo:8:kworker.0 00000100:00100000:1.0:1788201318.942443:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715318144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201318.942564:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715318144:12345-0@lo:400:kworker.0 Request processed in 6354us (11552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201318.942575:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1610 00000100:00100000:1.0:1788201318.942634:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715318144:0@lo:400:kworker.0 00010000:00010000:0.0:1788201318.945613:0:98562:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000020:00000080:0.0:1788201318.945967:0:98562:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788201318.946065:0:98562:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788201318.946084:0:98562:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x96d0c9b8c9a1d5c7 00000100:00080000:0.0:1788201318.946099:0:98562:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788201318.946108:0:98562:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8dc001db5800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201318.946154:0:98562:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc133368a80 x1875060715319296/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201318.946188:0:98562:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788201318.947549:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715319296:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788201318.947655:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201318.947853:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715319296 00000100:00100000:2.0:1788201318.947863:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715319296 00000100:00100000:2.0:1788201318.947914:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1608 00000100:00100000:2.0:1788201318.947923:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13336ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715319296:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788201318.947957:0:66313:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 4170 last 0 00000020:00000080:2.0:1788201318.948001:0:66313:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x96d0c9b8c9a1d5ce 00000004:00100000:2.0:1788201318.948040:0:66313:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201318.948093:0:66313:0:(import.c:65:import_set_state_nolock()) ffff8dc005208000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201318.948165:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13336ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875060715319296:12345-0@lo:38:llog_process_th.0 Request processed in 241us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201318.948173:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1608 00000100:00100000:2.0:1788201318.950341:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788201318.950363:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 18 00000100:00080000:2.0:1788201318.950378:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788201318.950385:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788201318.950390:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db5800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788201318.950405:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715319296:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788201318.953653:0:98562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 64 count 63 00000020:01000000:1.0:1788201318.957700:0:98552:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:1.0:1788201318.961571:0:98552:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201318.961604:0:98552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc000/0x96d0c9b8c9a1d59d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d5a4 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201318.961620:0:98552:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc000/0x96d0c9b8c9a1d59d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d5a4 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788201318.961713:0:98552:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788201318.961716:0:98552:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201318.961718:0:98552:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201318.961719:0:98552:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201318.961721:0:98552:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201318.961723:0:98552:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201318.961725:0:98552:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201318.961727:0:98552:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201318.961729:0:98552:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201318.961740:0:98552:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788201318.961743:0:98552:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788201318.961744:0:98552:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201318.961745:0:98552:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201318.961746:0:98552:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201318.961747:0:98552:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201318.961748:0:98552:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201318.961749:0:98552:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201318.961750:0:98552:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201318.961751:0:98552:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201318.961805:0:98552:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788201318.961834:0:98552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715319424:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788201318.961932:0:98552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201318.961990:0:98552:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12580ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201318.962073:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715319424 00000100:00100000:1.0:1788201318.962082:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715319424 00000100:00100000:1.0:1788201318.962140:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788201318.962150:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:98552:x1875060715319424:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788201318.962186:0:94464:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788201318.962200:0:94464:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788201318.970062:0:94464:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788201318.970084:0:94464:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788201318.970497:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:98552:x1875060715319424:12345-0@lo:253:mount.lustre.0 Request processed in 8340us (8557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201318.970514:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 20000000:01000000:3.0:1788201318.970617:0:94465:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788201318.970624:0:94465:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788201318.970652:0:94465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc108c75600/0x96d0c9b8c9a1d5d5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201318.970671:0:94465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1d534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d52d expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201318.970680:0:94465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc006dbd200/0x96d0c9b8c9a1d542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d53b expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201318.970709:0:94465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1d549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c9a expref: 9 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201318.970717:0:94465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dc108c75600/0x96d0c9b8c9a1d5d5 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201318.970766:0:94465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1d549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c9a expref: 9 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201318.970796:0:94465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1d549 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c9a expref: 9 pid: 94467 timeout: 4270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201318.970814:0:94465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d57100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715319552:192.168.201.20@tcp:104: 00010000:00010000:3.0:1788201318.970922:0:94465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc006dbd200/0x96d0c9b8c9a1d542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1d53b expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201318.970931:0:94465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc006dbd200/0x96d0c9b8c9a1d542 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d53b expref: 23 pid: 94461 timeout: 4270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201318.970942:0:94465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d55500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715319680:0@lo:104: 00000100:00100000:3.0:1788201318.970973:0:94465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201318.971008:0:94465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1d534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1d52d expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201318.971042:0:94465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1d534 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d52d expref: 23 pid: 94461 timeout: 4270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201318.971052:0:94465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d55180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715319808:0@lo:104: 00000100:00100000:3.0:1788201318.971086:0:94465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201318.971104:0:94465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1064709c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201318.971135:0:19665:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788201318.971148:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715319680 00000100:00100000:3.0:1788201318.971157:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715319680 00000100:00100000:3.0:1788201318.972559:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715319808 00000100:00100000:3.0:1788201318.972575:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715319808 00000100:00100000:3.0:1788201318.972615:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788201318.972626:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+4:94465:x1875060715319680:12345-0@lo:104: 00010000:00010000:3.0:1788201318.972646:0:19665:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1d53b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1d542 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201318.972739:0:19665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201318.972746:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+4:94465:x1875060715319680:12345-0@lo:104: Request processed in 122us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201318.972752:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788201318.972770:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1788201318.973392:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+3:94465:x1875060715319808:12345-0@lo:104: 00010000:00010000:3.0:1788201318.973403:0:19665:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1d52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1d534 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201318.973458:0:19665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788201318.973473:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+3:94465:x1875060715319808:12345-0@lo:104: Request processed in 79us (2378us total) trans 0 rc 0/0 00010000:00010000:1.0:1788201318.974366:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201318.974377:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1d53b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1d542 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201318.974387:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ede00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201318.974392:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1d53b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1d542 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201318.974402:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1d53b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1d542 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201318.974410:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1d53b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1d542 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201318.974431:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201318.974492:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1d53b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1d542 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201318.974498:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201318.974522:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1d53b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1d542 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201318.974529:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1d53b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1d542 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201318.974544:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201318.974548:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1d52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1d534 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201318.974554:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74000 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201318.974557:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1d52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1d534 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201318.974563:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1d52d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1d534 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201318.974569:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1d52d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1d534 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201318.974574:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201318.974589:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1d52d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1d534 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201318.974595:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201318.974624:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1d52d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1d534 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201318.974631:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1d52d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1d534 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201318.974647:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201318.974649:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201318.974651:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201318.974660:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201318.974694:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715319936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201318.974764:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201318.974839:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715320064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201318.974867:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201318.974927:0:98552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:98552:1875060715319424:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788201318.974941:0:98552:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788201318.974945:0:98552:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788201318.974947:0:98552:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201318.974949:0:98552:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201318.974950:0:98552:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201318.974952:0:98552:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201318.974953:0:98552:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201318.974954:0:98552:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201318.974957:0:98552:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201318.974959:0:98552:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788201318.974976:0:98552:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788201318.983713:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715319936 00000100:00100000:0.0:1788201318.983739:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715319936 00010000:00010000:0.0:1788201318.983810:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc006dbd200/0x96d0c9b8c9a1d542 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d53b expref: 24 pid: 94461 timeout: 4270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201318.983856:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2615 00000100:00100000:0.0:1788201318.983868:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715319936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201318.983888:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201318.983895:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc006dbd200/0x96d0c9b8c9a1d542 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d53b expref: 24 pid: 94461 timeout: 4270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201318.983909:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc006dbd200/0x96d0c9b8c9a1d542 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d53b expref: 24 pid: 94461 timeout: 4270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201318.983936:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201318.984071:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715319936:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (9306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201318.984081:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2615 00000100:00100000:0.0:1788201318.984099:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715320064 00000100:00100000:0.0:1788201318.984103:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715320064 00010000:00010000:0.0:1788201318.984117:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1d534 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d52d expref: 24 pid: 94461 timeout: 4270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201318.984143:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2616 00000100:00100000:0.0:1788201318.984149:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10a227c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715320064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201318.984178:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201318.984182:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1d534 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d52d expref: 24 pid: 94461 timeout: 4270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201318.984191:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1d534 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d52d expref: 24 pid: 94461 timeout: 4270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201318.984201:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201318.984247:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10a227c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715320064:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (9379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201318.984254:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2616 00000100:00100000:0.0:1788201318.984360:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715320064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201318.984764:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715319936:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201318.985439:0:94465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006dbd200/0x96d0c9b8c9a1d542 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d53b expref: 23 pid: 94461 timeout: 4270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201318.985457:0:94465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d55500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715319680:0@lo:104: 00010000:00010000:1.0:1788201318.985484:0:94465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1d534 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d52d expref: 22 pid: 94461 timeout: 4270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201318.985504:0:94465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d55180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715319808:0@lo:104: 00010000:00080000:0.0:1788201318.985613:0:98552:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 4294969498 00010000:00080000:0.0:1788201318.987556:0:98568:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-OST0000: started recovery thread pid 98568 00010000:02000000:0.0:1788201318.987622:0:98568:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-OST0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1788201318.987628:0:98568:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:0.0:1788201318.987633:0:98568:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:3.0:1788201318.989300:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788201318.989718:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201318.989909:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695496576 00000100:00100000:0.0:1788201318.989922:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695496576 00010000:00010000:0.0:1788201318.989972:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1d549 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c9a expref: 10 pid: 94467 timeout: 4270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201318.990045:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2617 00000100:00100000:0.0:1788201318.990056:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695496576:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201318.990075:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201318.990082:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1d549 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c9a expref: 10 pid: 94467 timeout: 4270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201318.990122:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1d549 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c9a expref: 10 pid: 94467 timeout: 4270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201318.990152:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dc108c75600/0x96d0c9b8c9a1d5d5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201318.990162:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc108c75600/0x96d0c9b8c9a1d5d5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788201318.990183:0:6517:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.036317302s 00010000:00010000:0.0:1788201318.990189:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc108c75600/0x96d0c9b8c9a1d5d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201318.990197:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc108c75600/0x96d0c9b8c9a1d5d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201318.990205:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc108c75600/0x96d0c9b8c9a1d5d5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201318.990211:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc108c75600/0x96d0c9b8c9a1d5d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201318.990217:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201318.990223:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc108c75600/0x96d0c9b8c9a1d5d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201318.990242:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc108c75600/0x96d0c9b8c9a1d5d5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201318.990252:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc108c75600/0x96d0c9b8c9a1d5d5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201318.990273:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201318.990350:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695496576:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 295us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201318.990358:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2617 00010000:00010000:3.0:1788201318.991955:0:94465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ec200/0x96d0c9b8c9a1d549 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c9a expref: 9 pid: 94467 timeout: 4270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201318.991979:0:94465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d57100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715319552:192.168.201.20@tcp:104: 00010000:00010000:3.0:1788201318.992055:0:94465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dc108c75600/0x96d0c9b8c9a1d5d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201318.992066:0:94465:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dc108c75600/0x96d0c9b8c9a1d5d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201318.992073:0:94465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc108c75600/0x96d0c9b8c9a1d5d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201318.992079:0:94465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc108c75600/0x96d0c9b8c9a1d5d5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788201318.992642:0:98552:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788201318.992703:0:98552:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788201318.992728:0:98552:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788201318.992752:0:98552:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788201318.993966:0:98552:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788201318.994316:0:98552:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788201319.183528:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201319.247740:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201319.247865:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715320192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201319.247965:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201319.248388:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715320320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201319.248432:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201319.248507:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715320320 00000100:00100000:2.0:1788201319.248517:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715320320 00000100:00100000:2.0:1788201319.248579:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4148 00000100:00100000:2.0:1788201319.248589:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715320320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201319.248638:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:2.0:1788201319.248689:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715320320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201319.248696:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4148 00000100:00100000:2.0:1788201319.248751:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715320320:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201319.249915:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715320192 00000100:00100000:0.0:1788201319.249927:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715320192 00000100:00100000:0.0:1788201319.249981:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2390 00000100:00100000:0.0:1788201319.249992:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715320192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201319.250038:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201319.250134:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715320192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (2170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201319.250141:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2390 00000100:00100000:1.0:1788201319.250680:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715320192:0@lo:13:osp-pre-1-0.0 00000020:00000004:0.0:1788201319.913171:0:98617:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788201319.913401:0:98617:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788201320.208915:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201320.340673:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201320.340794:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695496704 00000100:00100000:2.0:1788201320.340803:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695496704 00000100:00100000:2.0:1788201320.340871:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 254 00000100:00100000:2.0:1788201320.340882:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695496704:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201320.340898:0:94461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201320.340917:0:94461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006dbda00/0x96d0c9b8c9a1d5dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ca1 expref: -99 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.340947:0:94461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006dbda00/0x96d0c9b8c9a1d5dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ca1 expref: 10 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.340959:0:94461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006dbda00/0x96d0c9b8c9a1d5dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ca1 expref: 10 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.340968:0:94461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbda00, rc 0) 00000100:00100000:2.0:1788201320.341133:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695496704:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 252us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201320.341141:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 254 00000100:00100000:0.0:1788201320.348279:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201320.349297:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695496832 00000100:00100000:1.0:1788201320.349311:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695496832 00000100:00100000:1.0:1788201320.349364:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 255 00000100:00100000:1.0:1788201320.349374:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695496832:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788201320.349399:0:94467:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1788201320.349422:0:94467:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788201320.349424:0:94467:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 129 00000100:00100000:1.0:1788201320.356404:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695496832:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 Request processed in 7021us (8124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201320.356419:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 255 00000100:00100000:3.0:1788201320.371978:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201320.372136:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695496960 00000100:00100000:0.0:1788201320.372147:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695496960 00000100:00100000:0.0:1788201320.372200:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6017 00000100:00100000:0.0:1788201320.372842:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1875060695496960:12345-192.168.201.20@tcp:8:ll_cfg_requeue.0 00010000:00080000:0.0:1788201320.372884:0:8449:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '6e293f14-c501-4bc5-9dd4-a18ef02756b4' at ffff8dc12e642000, cookie 0x96d0c9b8c9a1d588 00010000:00080000:0.0:1788201320.372891:0:8449:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp recovering/t4294969479 exp ffff8dc12e642000 cur 4171 last 1788201318 00010000:02000400:0.0:1788201320.372901:0:8449:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00010000:00080000:0.0:1788201320.372908:0:8449:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00002000:00100000:0.0:1788201320.372922:0:8449:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6e293f14-c501-4bc5-9dd4-a18ef02756b4/ffff8dc12e642000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 573440 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788201320.372950:0:8449:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788201320.374419:0:8449:0:(import.c:65:import_set_state_nolock()) ffff8dc120727000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201320.374519:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2399:x1875060695496960:12345-192.168.201.20@tcp:8:ll_cfg_requeue.0 Request processed in 1679us (2552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201320.374532:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6017 00000100:00100000:0.0:1788201320.385765:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201320.385804:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201320.385832:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201320.385855:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201320.385875:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201320.385894:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201320.385915:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201320.385933:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695497088 00000100:00100000:0.0:1788201320.385935:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201320.385944:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695497088 00000100:00100000:0.0:1788201320.385953:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695497216 00000100:00100000:0.0:1788201320.385957:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695497216 00000100:00100000:3.0:1788201320.386048:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695497344 00000100:00100000:3.0:1788201320.386053:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695497344 00000100:00100000:1.0:1788201320.386106:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695497472 00000100:00100000:1.0:1788201320.386110:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695497472 00000100:00100000:0.0:1788201320.386165:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695497600 00000100:00100000:0.0:1788201320.386170:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695497600 00000100:00100000:0.0:1788201320.386188:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695497728 00000100:00100000:0.0:1788201320.386191:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695497728 00000100:00100000:0.0:1788201320.386216:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695497856 00000100:00100000:0.0:1788201320.386219:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695497856 00000100:00100000:0.0:1788201320.386235:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695497984 00000100:00100000:0.0:1788201320.386237:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695497984 00000100:00100000:0.0:1788201320.386254:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6018 00000100:00100000:0.0:1788201320.386262:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695497088:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1788201320.386281:0:8448:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc133369f80 x1875060695497088/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201320.386295:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695497088:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 35us (553us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201320.386314:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6018 00000100:00100000:0.0:1788201320.386326:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6019 00000100:00100000:0.0:1788201320.386332:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13336aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695497216:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1788201320.386341:0:8448:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc13336aa00 x1875060695497216/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201320.386350:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13336aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695497216:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 19us (546us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201320.386355:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6019 00000100:00100000:0.0:1788201320.386362:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6020 00000100:00100000:0.0:1788201320.386369:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695497600:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1788201320.386375:0:8448:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc004eb5c00 x1875060695497600/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201320.386384:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695497600:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 17us (510us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201320.386390:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6020 00000100:00100000:0.0:1788201320.386397:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6021 00000100:00100000:0.0:1788201320.386403:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695497728:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1788201320.386411:0:8448:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc005d5a300 x1875060695497728/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201320.386419:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695497728:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 17us (525us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201320.386435:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6021 00000100:00100000:0.0:1788201320.386455:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6022 00000100:00100000:0.0:1788201320.386461:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695497856:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1788201320.386469:0:8448:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc005d58000 x1875060695497856/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201320.386478:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695497856:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 18us (564us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201320.386484:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6022 00000100:00100000:0.0:1788201320.386492:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6023 00000100:00100000:0.0:1788201320.386499:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695497984:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1788201320.386505:0:8448:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc005d5ad80 x1875060695497984/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201320.386513:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695497984:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 16us (578us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201320.386517:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6023 00010000:00080000:0.0:1788201320.386561:0:98568:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:3.0:1788201320.401966:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6024 00000100:00100000:3.0:1788201320.401990:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695497344:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1788201320.402035:0:26214:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc133368380 x1875060695497344/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201320.402053:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695497344:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 76us (16221us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201320.402060:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6024 00010000:00080000:0.0:1788201320.402091:0:98568:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:3.0:1788201320.413581:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201320.413628:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201320.413654:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201320.413721:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695498112 00000100:00100000:2.0:1788201320.413731:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695498112 00000100:00100000:2.0:1788201320.413803:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695498240 00000100:00100000:2.0:1788201320.413806:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695498240 00000100:00100000:2.0:1788201320.413830:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1613 00000100:00100000:2.0:1788201320.413850:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2403:x1875060695498112:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201320.413921:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2403:x1875060695498112:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 82us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201320.413928:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1613 00000100:00100000:2.0:1788201320.413953:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1614 00000100:00100000:2.0:1788201320.413960:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695498240:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201320.413985:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695498240:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201320.414003:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1614 00000100:00080000:3.0:1788201320.415049:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201320.415056:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201320.415155:0:26204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695498368 00000100:00100000:0.0:1788201320.415162:0:26204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695498368 00000100:00100000:0.0:1788201320.415226:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2952 00000100:00100000:0.0:1788201320.415235:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695498368:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201320.415282:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695498368:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 49us (1653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201320.415295:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2952 00000100:00080000:2.0:1788201320.415717:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201320.415836:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6025 00000100:00100000:1.0:1788201320.415857:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695497472:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1788201320.415888:0:26211:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc133368a80 x1875060695497472/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201320.415913:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695497472:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 61us (30057us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201320.415920:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6025 00010000:00080000:2.0:1788201320.415970:0:98568:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 10000000:01000000:2.0:1788201320.721209:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788201320.721222:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc11d438000 from 129 10000000:01000000:2.0:1788201320.721238:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788201320.721296:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d5e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.721311:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d5e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.721325:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d5e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201320.721368:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715320448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201320.721471:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201320.721533:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038e0480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201320.721660:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715320448 00000100:00100000:3.0:1788201320.721669:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715320448 00000100:00100000:3.0:1788201320.721739:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788201320.721752:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715320448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201320.721769:0:94461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201320.721786:0:94461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc108c75600/0x96d0c9b8c9a1d5ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1d5e3 expref: -99 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201320.721816:0:94461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc108c75600/0x96d0c9b8c9a1d5ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d5e3 expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201320.721828:0:94461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc108c75600/0x96d0c9b8c9a1d5ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d5e3 expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201320.721839:0:94461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c75600, rc 0) 00000100:00100000:3.0:1788201320.721890:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715320448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201320.721897:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788201320.722349:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715320448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201320.722380:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d5e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d5ea expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.722392:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d5e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d5ea expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201320.722474:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715320576:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788201320.722525:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201320.722569:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f2e7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201320.722682:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715320576 00000100:00100000:2.0:1788201320.722689:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715320576 00000100:00100000:2.0:1788201320.722736:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788201320.722745:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715320576:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201320.722764:0:94464:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788201320.722784:0:94464:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201320.722791:0:94464:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 129 00000100:00100000:2.0:1788201320.722894:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715320576:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 150us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201320.722902:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788201320.723096:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715320576:0@lo:256:ll_cfg_requeue.0 00000100:00080000:0.0:1788201320.723147:0:6529:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8dc109815000 already not connected (conn 10, was 0): DISCONN 00010000:00080000:0.0:1788201320.723161:0:6529:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8dc109815000@lustre-OST0000-osc-MDT0000: found existing conn 192.168.201.120@tcp, moved to head 00000100:00080000:0.0:1788201320.723168:0:6529:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201320.723175:0:6529:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dc109815000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201320.723201:0:6529:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d5aa00 x1875060715320704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:0.0:1788201320.723313:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788201320.723322:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d5e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d5ea expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.723331:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d5e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d5ea expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201320.723353:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788201320.723355:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc0053a4000 from 129 00000100:00100000:2.0:1788201320.723485:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715320704:0@lo:8:ll_cfg_requeue.0 00000100:00100000:2.0:1788201320.723537:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201320.723589:0:26201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715320704 00000100:00100000:2.0:1788201320.723595:0:26201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715320704 00000100:00100000:2.0:1788201320.723623:0:26201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6026 00000100:00100000:2.0:1788201320.723629:0:26201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3654:x1875060715320704:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:2.0:1788201320.723655:0:26201:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff8dc12e640000, cookie 0x96d0c9b8c9a1d581 00010000:00080000:2.0:1788201320.723660:0:26201:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff8dc12e640000 cur 4172 last 1788201318 00002000:00100000:2.0:1788201320.723681:0:26201:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8dc12e640000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788201320.723686:0:26201:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788201320.723689:0:26201:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:2.0:1788201320.723846:0:26201:0:(import.c:65:import_set_state_nolock()) ffff8dc005208800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201320.723893:0:26201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715320704:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 263us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201320.723900:0:26201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6026 00010000:00080000:2.0:1788201320.723936:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc005d5aa00 x1875060715320704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201320.723950:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788201320.723960:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1788201320.723964:0:3654:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788201320.723967:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969474 gen 2 00000100:00080000:2.0:1788201320.723971:0:3654:0:(recover.c:53:ptlrpc_replay_next()) import ffff8dc109815000 from lustre-OST0000_UUID committed 4294969474 last 0 00000100:00080000:2.0:1788201320.723981:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1788201320.724164:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715320704:0@lo:8:ll_cfg_requeue.0 00010000:00080000:2.0:1788201320.724187:0:98645:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:2.0:1788201320.724192:0:98645:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:2.0:1788201320.724199:0:98645:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 10000000:01000000:0.0:1788201320.725109:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788201320.725152:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1d5f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.725163:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1d5f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.725174:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1d5f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201320.725198:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715320832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201320.725332:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788201320.725505:0:98645:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1788201320.725547:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715320960:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788201320.725582:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201320.727529:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f2e7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201320.727573:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715320960 00000100:00100000:0.0:1788201320.727583:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715320960 00000100:00100000:0.0:1788201320.727664:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2953 00000100:00100000:0.0:1788201320.727675:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715320960:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1788201320.727697:0:26202:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc12f6b3800 x1875060715320960/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:441/0 lens 224/0 e 0 to 0 dl 1788201331 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201320.727724:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715320960:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 50us (2140us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201320.727730:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2953 00010000:00080000:0.0:1788201320.727750:0:98568:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:3.0:1788201320.729063:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715320832 00000100:00100000:3.0:1788201320.729076:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715320832 00000100:00100000:3.0:1788201320.729131:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788201320.729141:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715320832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201320.729160:0:94461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201320.729184:0:94461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc108c74e00/0x96d0c9b8c9a1d5f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1d5f1 expref: -99 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201320.729216:0:94461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc108c74e00/0x96d0c9b8c9a1d5f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d5f1 expref: 24 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201320.729430:0:94461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc108c74e00/0x96d0c9b8c9a1d5f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d5f1 expref: 24 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201320.729484:0:94461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c74e00, rc 0) 00000100:00100000:3.0:1788201320.730410:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715320832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1266us (5072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201320.730420:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788201320.733770:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715320832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201320.733812:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1d5f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d5f8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.733828:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1d5f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d5f8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201320.733946:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715321088:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788201320.734047:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201320.734111:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038e0480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201320.734152:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715321088 00000100:00100000:2.0:1788201320.734160:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715321088 00000100:00100000:2.0:1788201320.734213:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788201320.734222:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715321088:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201320.734259:0:94464:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788201320.734280:0:94464:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201320.734284:0:94464:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 129 00000100:00100000:2.0:1788201320.734495:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715321088:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 272us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201320.734504:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788201320.734550:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715321088:0@lo:256:ll_cfg_requeue.0 00000100:00080000:2.0:1788201320.734598:0:6529:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8dc006d84000 already not connected (conn 10, was 0): DISCONN 00010000:00080000:2.0:1788201320.734613:0:6529:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8dc006d84000@lustre-OST0000-osc-MDT0001: found existing conn 192.168.201.120@tcp, moved to head 00000100:00080000:2.0:1788201320.734619:0:6529:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201320.734626:0:6529:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8dc006d84000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201320.734653:0:6529:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13f8dad80 x1875060715321216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:2.0:1788201320.734690:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788201320.734698:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1d5f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d5f8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.734708:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1d5f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d5f8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201320.734734:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715321216:0@lo:8:ll_cfg_requeue.0 00000100:00100000:2.0:1788201320.734767:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201320.736248:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715321216 00000100:00100000:0.0:1788201320.736265:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715321216 00000100:00100000:0.0:1788201320.736330:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6027 00000100:00100000:0.0:1788201320.736339:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3654:x1875060715321216:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:0.0:1788201320.736510:0:8446:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8dc13f869000, cookie 0x96d0c9b8c9a1d57a 00010000:00080000:0.0:1788201320.736517:0:8446:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8dc13f869000 cur 4172 last 1788201318 00002000:00100000:0.0:1788201320.736542:0:8446:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8dc13f869000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788201320.736546:0:8446:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1788201320.736550:0:8446:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:0.0:1788201320.736591:0:8446:0:(import.c:65:import_set_state_nolock()) ffff8dc120723000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201320.737446:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875060715321216:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 1092us (2663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201320.737458:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6027 00010000:00080000:2.0:1788201320.737654:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc13f8dad80 x1875060715321216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201320.737675:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788201320.737689:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1788201320.737693:0:3654:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788201320.737696:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294969456 gen 2 00000100:00080000:2.0:1788201320.737701:0:3654:0:(recover.c:53:ptlrpc_replay_next()) import ffff8dc006d84000 from lustre-OST0000_UUID committed 4294969456 last 0 00000100:00080000:2.0:1788201320.737714:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1788201320.739559:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715321216:0@lo:8:ll_cfg_requeue.0 00010000:00080000:2.0:1788201320.739602:0:98647:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:2.0:1788201320.739608:0:98647:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:2.0:1788201320.739615:0:98647:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00080000:2.0:1788201320.739660:0:98647:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1788201320.739712:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715321344:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788201320.739794:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201320.740184:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715321344 00000100:00100000:0.0:1788201320.740195:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715321344 00000100:00100000:0.0:1788201320.740272:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2954 00000100:00100000:0.0:1788201320.740285:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3654:x1875060715321344:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1788201320.740306:0:26203:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc13f8d9f80 x1875060715321344/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:441/0 lens 224/0 e 0 to 0 dl 1788201331 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788201320.741136:0:98568:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:3.0:1788201320.741147:0:98568:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 4294969499 00010000:00080000:2.0:1788201320.741213:0:98568:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 4294969499 00010000:00080000:2.0:1788201320.741218:0:98568:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00010000:00080000:2.0:1788201320.741225:0:98568:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788201320.741237:0:98568:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788201320.741250:0:98568:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc133369f80 x1875060695497088/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788201320.741275:0:98568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201320.741311:0:98568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000279447c9/0x96d0c9b8c9a1d5ff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c2a expref: -99 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.741348:0:98568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000279447c9/0x96d0c9b8c9a1d5ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c2a expref: 13 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.741500:0:98568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000279447c9/0x96d0c9b8c9a1d5ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c2a expref: 13 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.741515:0:98568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbdc00, rc 0) 00010000:00080000:2.0:1788201320.741611:0:98568:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788201320.741628:0:98568:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788201320.741630:0:98568:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788201320.741637:0:98568:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc13336aa00 x1875060695497216/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788201320.741649:0:98568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201320.741662:0:98568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1d606 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c00 expref: -99 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.741678:0:98568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1d606 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c00 expref: 13 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.741688:0:98568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1d606 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c00 expref: 13 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.741697:0:98568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbc600, rc 0) 00010000:00080000:2.0:1788201320.741715:0:98568:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788201320.741724:0:98568:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788201320.741726:0:98568:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788201320.741732:0:98568:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc004eb5c00 x1875060695497600/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788201320.741743:0:98568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201320.741755:0:98568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1d60d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b6d expref: -99 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.741769:0:98568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1d60d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b6d expref: 13 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.741794:0:98568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1d60d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b6d expref: 13 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.741804:0:98568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbce00, rc 0) 00010000:00080000:2.0:1788201320.741824:0:98568:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788201320.741832:0:98568:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788201320.741833:0:98568:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788201320.741839:0:98568:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc005d5a300 x1875060695497728/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788201320.741850:0:98568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201320.741862:0:98568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1d614 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786bd6 expref: -99 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.741877:0:98568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1d614 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bd6 expref: 13 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.741888:0:98568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1d614 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bd6 expref: 13 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.741896:0:98568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbd200, rc 0) 00010000:00080000:2.0:1788201320.741913:0:98568:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788201320.741919:0:98568:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788201320.741921:0:98568:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788201320.741927:0:98568:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc005d58000 x1875060695497856/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788201320.741949:0:98568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201320.741963:0:98568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1d61b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b51 expref: -99 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.741977:0:98568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1d61b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b51 expref: 13 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.741987:0:98568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1d61b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b51 expref: 13 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.741995:0:98568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbc800, rc 0) 00010000:00080000:2.0:1788201320.742051:0:98568:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788201320.742061:0:98568:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788201320.742064:0:98568:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788201320.742070:0:98568:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc005d5ad80 x1875060695497984/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788201320.742081:0:98568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201320.742092:0:98568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b840617e/0x96d0c9b8c9a1d622 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b58 expref: -99 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.742108:0:98568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b840617e/0x96d0c9b8c9a1d622 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b58 expref: 13 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.742119:0:98568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b840617e/0x96d0c9b8c9a1d622 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b58 expref: 13 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.742142:0:98568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbd600, rc 0) 00010000:00080000:2.0:1788201320.742164:0:98568:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788201320.742171:0:98568:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788201320.742173:0:98568:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788201320.742179:0:98568:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc133368380 x1875060695497344/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788201320.742191:0:98568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201320.742202:0:98568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1d629 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c15 expref: -99 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.742220:0:98568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1d629 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c15 expref: 13 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.742955:0:98568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1d629 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c15 expref: 13 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.742970:0:98568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbd800, rc 0) 00010000:00080000:2.0:1788201320.744576:0:98568:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788201320.744605:0:98568:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788201320.744609:0:98568:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1788201320.744624:0:98568:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc133368a80 x1875060695497472/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788201320.744649:0:98568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201320.744685:0:98568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090d8cd0e/0x96d0c9b8c9a1d630 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786bf9 expref: -99 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.744732:0:98568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090d8cd0e/0x96d0c9b8c9a1d630 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bf9 expref: 13 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.744814:0:98568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000090d8cd0e/0x96d0c9b8c9a1d630 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bf9 expref: 13 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201320.744835:0:98568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fde00, rc 0) 00010000:00080000:2.0:1788201320.744890:0:98568:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788201320.744900:0:98568:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00000100:00100000:0.0:1788201320.746330:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3654:x1875060715321344:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 5936us (6424us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201320.746349:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2954 00000100:00100000:3.0:1788201320.759272:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201320.766123:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201320.776658:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695498496 00000100:00100000:0.0:1788201320.776680:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695498496 00000100:00100000:0.0:1788201320.776792:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6028 00000100:00100000:0.0:1788201320.776807:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:2399:x1875060695498496:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1788201320.776832:0:26200:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc137cef100 x1875060695498496/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201320.776864:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:2399:x1875060695498496:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 61us (17608us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201320.776871:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6028 00010000:00080000:0.0:1788201320.776896:0:98568:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788201320.776905:0:98568:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc137cef100 x1875060695498496/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201320.776927:0:98568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201320.776961:0:98568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008eb566b/0x96d0c9b8c9a1d637 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ba5 expref: -99 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.776998:0:98568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008eb566b/0x96d0c9b8c9a1d637 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ba5 expref: 14 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.777044:0:98568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000008eb566b/0x96d0c9b8c9a1d637 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ba5 expref: 14 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.777058:0:98568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58a00, rc 0) 00010000:00080000:0.0:1788201320.777141:0:98568:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788201320.777154:0:98568:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1788201320.777863:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201320.777898:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201320.777924:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201320.777944:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201320.777967:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201320.777994:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201320.778063:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695498624 00000100:00100000:3.0:1788201320.778072:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695498624 00000100:00100000:3.0:1788201320.778111:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695498752 00000100:00100000:3.0:1788201320.778114:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695498752 00000100:00100000:3.0:1788201320.778131:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695498880 00000100:00100000:3.0:1788201320.778133:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695498880 00000100:00100000:3.0:1788201320.778148:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695499008 00000100:00100000:3.0:1788201320.778150:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695499008 00000100:00100000:3.0:1788201320.778164:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695499136 00000100:00100000:3.0:1788201320.778167:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695499136 00000100:00100000:3.0:1788201320.778182:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695499264 00000100:00100000:3.0:1788201320.778185:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695499264 00000100:00100000:3.0:1788201320.781712:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695499392 00000100:00100000:3.0:1788201320.781735:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695499392 00000100:00100000:1.0:1788201320.784132:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6029 00000100:00100000:1.0:1788201320.784164:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:2399:x1875060695498624:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1788201320.784195:0:8491:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc137cee680 x1875060695498624/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201320.784240:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:2399:x1875060695498624:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 94us (18133us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201320.784248:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6029 00000100:00100000:1.0:1788201320.784268:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6030 00000100:00100000:1.0:1788201320.784289:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:2399:x1875060695498752:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1788201320.784299:0:8491:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc137cedf80 x1875060695498752/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201320.784309:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:2399:x1875060695498752:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 36us (6453us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201320.784315:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6030 00000100:00100000:1.0:1788201320.784324:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6031 00000100:00100000:1.0:1788201320.784331:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:2399:x1875060695498880:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1788201320.784341:0:8491:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc137cece00 x1875060695498880/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201320.790370:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:2399:x1875060695498880:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 6028us (12459us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201320.790385:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6031 00000100:00100000:1.0:1788201320.790425:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6032 00000100:00100000:1.0:1788201320.790454:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:2399:x1875060695499008:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1788201320.790477:0:8491:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc137ceea00 x1875060695499008/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201320.790488:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:2399:x1875060695499008:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 56us (12565us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201320.790495:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6032 00000100:00100000:1.0:1788201320.790505:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6033 00000100:00100000:1.0:1788201320.790512:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:2399:x1875060695499136:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1788201320.790522:0:8491:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc137cec000 x1875060695499136/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201320.790532:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:2399:x1875060695499136:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 21us (12588us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201320.790538:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6033 00000100:00100000:1.0:1788201320.790546:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6034 00000100:00100000:1.0:1788201320.790554:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:2399:x1875060695499264:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1788201320.790563:0:8491:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc118143b80 x1875060695499264/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201320.790585:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:2399:x1875060695499264:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 33us (12618us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201320.790591:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6034 00000100:00100000:1.0:1788201320.790601:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6035 00000100:00100000:1.0:1788201320.790609:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:2399:x1875060695499392:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1788201320.790618:0:8491:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc118140700 x1875060695499392/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201320.790627:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:2399:x1875060695499392:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 20us (12633us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201320.790633:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6035 00010000:00080000:0.0:1788201320.795366:0:98568:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788201320.795398:0:98568:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc137cee680 x1875060695498624/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201320.795446:0:98568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201320.795486:0:98568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5bab93d/0x96d0c9b8c9a1d63e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c93 expref: -99 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.795548:0:98568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5bab93d/0x96d0c9b8c9a1d63e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c93 expref: 21 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.795568:0:98568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b5bab93d/0x96d0c9b8c9a1d63e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c93 expref: 21 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.795581:0:98568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59000, rc 0) 00010000:00080000:0.0:1788201320.795663:0:98568:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788201320.795682:0:98568:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788201320.795684:0:98568:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788201320.795690:0:98568:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc137cedf80 x1875060695498752/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201320.795702:0:98568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201320.795714:0:98568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e365e6f9/0x96d0c9b8c9a1d645 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b74 expref: -99 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.795729:0:98568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e365e6f9/0x96d0c9b8c9a1d645 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b74 expref: 21 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.795741:0:98568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e365e6f9/0x96d0c9b8c9a1d645 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b74 expref: 21 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.795749:0:98568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59c00, rc 0) 00010000:00080000:0.0:1788201320.795766:0:98568:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788201320.795773:0:98568:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788201320.795780:0:98568:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788201320.795786:0:98568:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc137cece00 x1875060695498880/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201320.795797:0:98568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201320.795809:0:98568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cc1cd93/0x96d0c9b8c9a1d64c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786bac expref: -99 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.795823:0:98568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cc1cd93/0x96d0c9b8c9a1d64c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bac expref: 21 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.795834:0:98568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008cc1cd93/0x96d0c9b8c9a1d64c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bac expref: 21 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.795842:0:98568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58000, rc 0) 00010000:00080000:0.0:1788201320.795862:0:98568:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788201320.795870:0:98568:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788201320.795871:0:98568:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788201320.795877:0:98568:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc137ceea00 x1875060695499008/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201320.795888:0:98568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201320.795900:0:98568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ccd9d4f/0x96d0c9b8c9a1d653 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786bcf expref: -99 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.795913:0:98568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ccd9d4f/0x96d0c9b8c9a1d653 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bcf expref: 21 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.795923:0:98568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006ccd9d4f/0x96d0c9b8c9a1d653 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bcf expref: 21 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.795939:0:98568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3e00, rc 0) 00010000:00080000:0.0:1788201320.795964:0:98568:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788201320.795971:0:98568:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788201320.795972:0:98568:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788201320.795979:0:98568:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc137cec000 x1875060695499136/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201320.795989:0:98568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201320.795999:0:98568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094a83153/0x96d0c9b8c9a1d65a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c85 expref: -99 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.796012:0:98568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094a83153/0x96d0c9b8c9a1d65a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c85 expref: 21 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.796047:0:98568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000094a83153/0x96d0c9b8c9a1d65a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c85 expref: 21 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.796054:0:98568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3000, rc 0) 00010000:00080000:0.0:1788201320.796070:0:98568:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788201320.796076:0:98568:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788201320.796078:0:98568:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788201320.796083:0:98568:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc118143b80 x1875060695499264/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201320.796091:0:98568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201320.796102:0:98568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab39a76d/0x96d0c9b8c9a1d661 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b3c expref: -99 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.796124:0:98568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab39a76d/0x96d0c9b8c9a1d661 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b3c expref: 21 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.796134:0:98568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab39a76d/0x96d0c9b8c9a1d661 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b3c expref: 21 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.796141:0:98568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2c00, rc 0) 00010000:00080000:0.0:1788201320.796156:0:98568:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788201320.796162:0:98568:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788201320.796163:0:98568:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788201320.796169:0:98568:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc118140700 x1875060695499392/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201320.796177:0:98568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201320.796187:0:98568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1d668 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c8c expref: -99 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.796268:0:98568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1d668 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c8c expref: 21 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.796279:0:98568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1d668 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c8c expref: 21 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.796287:0:98568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2400, rc 0) 00010000:00080000:0.0:1788201320.796302:0:98568:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788201320.796308:0:98568:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00000100:00100000:0.0:1788201320.796459:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201320.796493:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695499520 00000100:00100000:0.0:1788201320.796502:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695499520 00000100:00100000:0.0:1788201320.796554:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6036 00000100:00100000:0.0:1788201320.796564:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+21:2399:x1875060695499520:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1788201320.796575:0:8446:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc005d5b480 x1875060695499520/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201320.796589:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+21:2399:x1875060695499520:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 26us (131us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201320.796596:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6036 00010000:00080000:0.0:1788201320.796607:0:98568:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788201320.796611:0:98568:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc005d5b480 x1875060695499520/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201320.796620:0:98568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201320.796632:0:98568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1d66f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786b19 expref: -99 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.796646:0:98568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1d66f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b19 expref: 22 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.796656:0:98568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1d66f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b19 expref: 22 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.796664:0:98568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2e00, rc 0) 00010000:00080000:0.0:1788201320.796681:0:98568:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788201320.796687:0:98568:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1788201320.814938:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201320.814998:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201320.815074:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201320.815581:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695499648 00000100:00100000:2.0:1788201320.815597:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695499648 00000100:00100000:2.0:1788201320.815662:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695499776 00000100:00100000:2.0:1788201320.815666:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695499776 00000100:00100000:2.0:1788201320.815681:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695499904 00000100:00100000:2.0:1788201320.815684:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695499904 00000100:00100000:2.0:1788201320.815710:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6037 00000100:00100000:2.0:1788201320.815727:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118142680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+24:2399:x1875060695499648:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1788201320.815753:0:23974:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc118142680 x1875060695499648/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201320.815770:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118142680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+24:2399:x1875060695499648:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 51us (849us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201320.815777:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6037 00000100:00100000:2.0:1788201320.815788:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6038 00000100:00100000:2.0:1788201320.815793:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+24:2399:x1875060695499776:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1788201320.815813:0:23974:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc118143100 x1875060695499776/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201320.815822:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+24:2399:x1875060695499776:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 30us (825us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201320.815828:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6038 00000100:00100000:2.0:1788201320.815836:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6039 00000100:00100000:2.0:1788201320.815841:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+24:2399:x1875060695499904:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1788201320.815848:0:23974:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc118141880 x1875060695499904/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201320.815856:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+24:2399:x1875060695499904:12345-192.168.201.20@tcp:101:ldlm_lock_repla.0 Request processed in 16us (784us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201320.815861:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6039 00010000:00080000:0.0:1788201320.816063:0:98568:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788201320.816074:0:98568:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc118142680 x1875060695499648/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201320.816095:0:98568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201320.816126:0:98568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f6d99c0/0x96d0c9b8c9a1d676 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c69 expref: -99 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.816162:0:98568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f6d99c0/0x96d0c9b8c9a1d676 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c69 expref: 25 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.816181:0:98568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f6d99c0/0x96d0c9b8c9a1d676 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c69 expref: 25 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.817208:0:98568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896ae00, rc 0) 00010000:00080000:0.0:1788201320.817312:0:98568:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788201320.817331:0:98568:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788201320.817334:0:98568:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788201320.817344:0:98568:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc118143100 x1875060695499776/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201320.817361:0:98568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201320.817383:0:98568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ab5e6bc/0x96d0c9b8c9a1d67d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c54 expref: -99 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.817406:0:98568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ab5e6bc/0x96d0c9b8c9a1d67d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c54 expref: 25 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.817420:0:98568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003ab5e6bc/0x96d0c9b8c9a1d67d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c54 expref: 25 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.817458:0:98568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896bc00, rc 0) 00010000:00080000:0.0:1788201320.817480:0:98568:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788201320.817487:0:98568:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788201320.817489:0:98568:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788201320.817495:0:98568:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 192.168.201.20@tcp: req@ffff8dc118141880 x1875060695499904/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 328/0 e 0 to 0 dl 1788201331 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201320.817506:0:98568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201320.817519:0:98568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7227628/0x96d0c9b8c9a1d684 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786c3f expref: -99 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.817532:0:98568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7227628/0x96d0c9b8c9a1d684 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c3f expref: 25 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.817544:0:98568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a7227628/0x96d0c9b8c9a1d684 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c3f expref: 25 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201320.817552:0:98568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896b600, rc 0) 00010000:00080000:0.0:1788201320.817570:0:98568:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788201320.817577:0:98568:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1788201320.828566:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201320.833651:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695500032 00000100:00100000:0.0:1788201320.833676:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695500032 00000100:00100000:0.0:1788201320.833777:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2955 00000100:00100000:0.0:1788201320.833791:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+25:2399:x1875060695500032:12345-192.168.201.20@tcp:400:ptlrpcd_rcv.0 00010000:00080000:0.0:1788201320.833817:0:26209:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc118141c00 x1875060695500032/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 224/0 e 0 to 0 dl 1788201331 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201320.833868:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6e293f14-c501-4bc5-9dd4-a18ef02756b4+25:2399:x1875060695500032:12345-192.168.201.20@tcp:400:ptlrpcd_rcv.0 Request processed in 81us (5319us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201320.833877:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2955 00010000:00080000:1.0:1788201320.833992:0:98568:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1788201320.834172:0:98568:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934592 00000001:00100000:0.0:1788201320.862362:0:98553:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000001:00100000:0.0:1788201320.862398:0:98553:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788201320.862403:0:98553:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:2.0:1788201320.862840:0:98568:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-OST0000: cancel recovery timer 00010000:00080000:2.0:1788201320.862864:0:98568:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8dc12f6b3800 x1875060715320960/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:441/0 lens 224/0 e 0 to 0 dl 1788201331 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788201320.863131:0:98568:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8dc13f8d9f80 x1875060715321344/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:441/0 lens 224/0 e 0 to 0 dl 1788201331 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788201320.863240:0:98568:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.201.20@tcp: req@ffff8dc118141c00 x1875060695500032/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 224/0 e 0 to 0 dl 1788201331 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788201320.863405:0:98568:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-OST0000: Recovery over after 0:01, of 3 clients 3 recovered and 0 were evicted. 00002000:00080000:2.0:1788201320.864712:0:98568:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788201320.864724:0:98568:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000100:00080000:3.0:1788201320.879208:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788201320.879235:0:3654:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8dc13f8dad80 x1875060715321344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201336 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201320.879248:0:3654:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8dc13f8dad80 x1875060715321344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201336 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201320.879255:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:3.0:1788201320.880217:0:3654:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:3.0:1788201320.880226:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788201320.880801:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201320.880856:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201320.880890:0:25502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695486208 00000100:00100000:2.0:1788201320.880901:0:25502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695486208 00002000:00100000:2.0:1788201320.880957:0:25502:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x382:0x0] (0->1023) req@ffff8dc13f8d8380 x1875060695486208/t0(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 1512/0 e 0 to 0 dl 1788201331 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201320.880970:0:25502:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc13f8d8380 with x1875060695486208 ext(0->1023) 00002000:00010000:2.0:1788201320.880986:0:25502:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc13f8d8380 00000100:00100000:2.0:1788201320.881037:0:25502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1048 00000100:00100000:2.0:1788201320.881048:0:25502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+25:0:x1875060695486208:12345-192.168.201.20@tcp:4:dd.0 00000100:00100000:2.0:1788201320.889568:0:25502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+27:0:x1875060695486208:12345-192.168.201.20@tcp:4:dd.0 Request processed in 8508us (8696us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788201320.889588:0:25502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1048 00002000:00100000:2.0:1788201320.889607:0:25502:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x382:0x0] (0->1023) req@ffff8dc13f8d8380 x1875060695486208/t8589934593(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 1512/448 e 0 to 0 dl 1788201331 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201320.889619:0:25502:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc13f8d8380 with x1875060695486208 ext(0->1023) 00002000:00010000:2.0:1788201320.889638:0:25502:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc13f8d8380 00000100:00100000:0.0:1788201320.890413:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201320.890449:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715321472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201320.890524:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201320.890606:0:75748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:75748:1875060715321600:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788201320.890633:0:75748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201320.890656:0:75748:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f2e7300 going to sleep for 11 seconds 00000100:00100000:0.0:1788201320.893539:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695486336 00000100:00100000:2.0:1788201320.895616:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715321472 00000100:00100000:2.0:1788201320.895641:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715321472 00000100:00100000:2.0:1788201320.895735:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2391 00000100:00100000:2.0:1788201320.896874:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715321472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201320.896913:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 544768 granted 9291200 pending 28672 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201320.897128:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715321472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 218us (6552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201320.897155:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2391 00000100:00100000:2.0:1788201320.897366:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715321472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201320.897527:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695486336 00000100:00100000:0.0:1788201320.897607:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715321600 00000100:00100000:0.0:1788201320.897611:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715321600 00000100:00100000:0.0:1788201320.897638:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6040 00000100:00100000:0.0:1788201320.897646:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+27:0:x1875060695486336:12345-192.168.201.20@tcp:16:kworker.0 00000100:00100000:0.0:1788201320.897730:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6041 00000100:00100000:0.0:1788201320.897753:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:75748:x1875060715321600:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:2.0:1788201320.908395:0:26199:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788201320.908411:0:26199:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x621:0x0] 00000100:00100000:2.0:1788201320.908551:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:75748:x1875060715321600:12345-0@lo:7:osp-pre-0-1.0 Request processed in 10806us (17909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201320.908566:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6041 00000100:00100000:0.0:1788201320.908916:0:75748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:75748:1875060715321600:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788201320.908935:0:75748:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x621:0x0] 00000001:00080000:0.0:1788201320.910667:0:98553:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000100:00100000:2.0:1788201320.911839:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+25:0:x1875060695486336:12345-192.168.201.20@tcp:16:kworker.0 Request processed in 14181us (31030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201320.911857:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6040 00000100:00100000:3.0:1788201320.912263:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715321344:0@lo:400:ldlm_lock_repla.0 00000100:00080000:3.0:1788201320.912315:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788201320.912326:0:3654:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8dc12f6b0380 x1875060715320960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201336 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201320.912338:0:3654:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8dc12f6b0380 x1875060715320960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201336 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201320.912346:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:3.0:1788201320.912367:0:3654:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:3.0:1788201320.912371:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788201320.912375:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715320960:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1788201320.912515:0:94475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94475:1875060715321856:0@lo:7:osp-pre-0-0.0 00000100:00100000:3.0:1788201320.912594:0:94475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201320.912630:0:94475:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006d03b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201320.912650:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715321728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201320.912702:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201320.913285:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715321856 00000100:00100000:3.0:1788201320.913295:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715321856 00000100:00100000:3.0:1788201320.913352:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6042 00000100:00100000:3.0:1788201320.913363:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:94475:x1875060715321856:12345-0@lo:7:osp-pre-0-0.0 00000100:00100000:3.0:1788201320.913713:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715321728 00000100:00100000:3.0:1788201320.913718:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715321728 00000100:00100000:3.0:1788201320.915700:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2392 00000100:00100000:3.0:1788201320.915721:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715321728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201320.915802:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 544768 granted 9262528 pending 0 free 3922464768 avail 3690913792 00000100:00100000:3.0:1788201320.915914:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715321728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 200us (3210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201320.915922:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2392 00000100:00100000:3.0:1788201320.916002:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715321728:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1788201320.916511:0:8446:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788201320.916519:0:8446:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000401:0x3c1:0x0] 00000100:00100000:3.0:1788201320.916574:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:94475:x1875060715321856:12345-0@lo:7:osp-pre-0-0.0 Request processed in 3211us (3978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201320.916582:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6042 00000100:00100000:3.0:1788201320.916619:0:94475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94475:1875060715321856:0@lo:7:osp-pre-0-0.0 00000004:00080000:3.0:1788201320.916634:0:94475:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x280000401:0x3c1:0x0] 00000100:00100000:2.0:1788201320.919478:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201320.920195:0:24873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695500160 00000100:00100000:3.0:1788201320.920209:0:24873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695500160 00002000:00100000:3.0:1788201320.920277:0:24873:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x383:0x0] (0->1023) req@ffff8dc13f8d9180 x1875060695500160/t0(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 1512/0 e 0 to 0 dl 1788201331 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201320.920290:0:24873:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc13f8d9180 with x1875060695500160 ext(0->1023) 00002000:00010000:3.0:1788201320.920741:0:24873:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc13f8d9180 00000100:00100000:3.0:1788201320.920781:0:24873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1049 00000100:00100000:3.0:1788201320.920792:0:24873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+25:2400:x1875060695500160:12345-192.168.201.20@tcp:4:dd.0 00000100:00100000:3.0:1788201320.924914:0:24873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+27:2400:x1875060695500160:12345-192.168.201.20@tcp:4:dd.0 Request processed in 4111us (5438us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788201320.924929:0:24873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1049 00002000:00100000:3.0:1788201320.924942:0:24873:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x383:0x0] (0->1023) req@ffff8dc13f8d9180 x1875060695500160/t8589934594(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 1512/448 e 0 to 0 dl 1788201331 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201320.924952:0:24873:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc13f8d9180 with x1875060695500160 ext(0->1023) 00002000:00010000:3.0:1788201320.924959:0:24873:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc13f8d9180 00000100:00100000:0.0:1788201320.928735:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201320.928863:0:25936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695500288 00000100:00100000:3.0:1788201320.928876:0:25936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695500288 00002000:00100000:3.0:1788201320.928942:0:25936:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x384:0x0] (0->1023) req@ffff8dc13ae4b850 x1875060695500288/t0(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 1512/0 e 0 to 0 dl 1788201331 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201320.928955:0:25936:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc13ae4b850 with x1875060695500288 ext(0->1023) 00002000:00010000:3.0:1788201320.928964:0:25936:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc13ae4b850 00000100:00100000:3.0:1788201320.929003:0:25936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1050 00000100:00100000:3.0:1788201320.929271:0:25936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ae4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+27:2402:x1875060695500288:12345-192.168.201.20@tcp:4:dd.0 00000100:00100000:2.0:1788201320.934894:0:25936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ae4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+29:2402:x1875060695500288:12345-192.168.201.20@tcp:4:dd.0 Request processed in 5869us (6163us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788201320.934910:0:25936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1050 00002000:00100000:2.0:1788201320.934923:0:25936:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x384:0x0] (0->1023) req@ffff8dc13ae4b850 x1875060695500288/t8589934595(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 1512/448 e 0 to 0 dl 1788201331 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201320.934935:0:25936:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc13ae4b850 with x1875060695500288 ext(0->1023) 00002000:00010000:2.0:1788201320.934942:0:25936:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc13ae4b850 00000100:00100000:0.0:1788201320.949447:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201320.949528:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695500416 00000100:00100000:2.0:1788201320.949544:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695500416 00002000:00100000:2.0:1788201320.949605:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x385:0x0] (0->1023) req@ffff8dc005d58700 x1875060695500416/t0(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 1512/0 e 0 to 0 dl 1788201331 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201320.949616:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc005d58700 with x1875060695500416 ext(0->1023) 00002000:00010000:2.0:1788201320.949622:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc005d58700 00000100:00100000:2.0:1788201320.949863:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1051 00000100:00100000:2.0:1788201320.949876:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+29:2400:x1875060695500416:12345-192.168.201.20@tcp:4:dd.0 00000100:00100000:1.0:1788201320.956733:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+31:2400:x1875060695500416:12345-192.168.201.20@tcp:4:dd.0 Request processed in 6842us (7296us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788201320.956753:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1051 00002000:00100000:1.0:1788201320.956771:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x385:0x0] (0->1023) req@ffff8dc005d58700 x1875060695500416/t8589934596(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 1512/448 e 0 to 0 dl 1788201331 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201320.956783:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc005d58700 with x1875060695500416 ext(0->1023) 00002000:00010000:1.0:1788201320.956791:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc005d58700 00000100:00100000:2.0:1788201320.963567:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201320.963633:0:24857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695500544 00000100:00100000:3.0:1788201320.963647:0:24857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695500544 00002000:00100000:3.0:1788201320.963710:0:24857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x386:0x0] (0->1023) req@ffff8dc13f8da300 x1875060695500544/t0(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 1512/0 e 0 to 0 dl 1788201331 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201320.963723:0:24857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc13f8da300 with x1875060695500544 ext(0->1023) 00002000:00010000:3.0:1788201320.963729:0:24857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc13f8da300 00000100:00100000:3.0:1788201320.963774:0:24857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1052 00000100:00100000:3.0:1788201320.963831:0:24857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+31:2401:x1875060695500544:12345-192.168.201.20@tcp:4:dd.0 00000100:00100000:3.0:1788201320.965782:0:24857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+33:2401:x1875060695500544:12345-192.168.201.20@tcp:4:dd.0 Request processed in 1942us (2220us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788201320.965797:0:24857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1052 00002000:00100000:3.0:1788201320.965809:0:24857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x386:0x0] (0->1023) req@ffff8dc13f8da300 x1875060695500544/t8589934597(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 1512/448 e 0 to 0 dl 1788201331 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201320.965819:0:24857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc13f8da300 with x1875060695500544 ext(0->1023) 00002000:00010000:3.0:1788201320.965826:0:24857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc13f8da300 00000100:00100000:3.0:1788201320.976490:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201320.976551:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695500672 00000100:00100000:0.0:1788201320.976565:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695500672 00002000:00100000:0.0:1788201320.976631:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x387:0x0] (0->1023) req@ffff8dc118141180 x1875060695500672/t0(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 1512/0 e 0 to 0 dl 1788201331 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201320.976644:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc118141180 with x1875060695500672 ext(0->1023) 00002000:00010000:0.0:1788201320.976652:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc118141180 00000100:00100000:0.0:1788201320.976689:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1053 00000100:00100000:0.0:1788201320.976701:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+33:2401:x1875060695500672:12345-192.168.201.20@tcp:4:dd.0 00000100:00100000:0.0:1788201320.984251:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+35:2401:x1875060695500672:12345-192.168.201.20@tcp:4:dd.0 Request processed in 7535us (7761us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788201320.984269:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1053 00002000:00100000:0.0:1788201320.984287:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x387:0x0] (0->1023) req@ffff8dc118141180 x1875060695500672/t8589934598(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:441/0 lens 1512/448 e 0 to 0 dl 1788201331 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201320.984300:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc118141180 with x1875060695500672 ext(0->1023) 00002000:00010000:0.0:1788201320.984308:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc118141180 00000100:00100000:1.0:1788201321.004577:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201321.005849:0:25502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695500800 00000100:00100000:2.0:1788201321.005870:0:25502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695500800 00002000:00100000:2.0:1788201321.005941:0:25502:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x388:0x0] (0->1023) req@ffff8dc12efcb100 x1875060695500800/t0(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/0 e 0 to 0 dl 1788201332 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201321.005954:0:25502:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc12efcb100 with x1875060695500800 ext(0->1023) 00002000:00010000:2.0:1788201321.005962:0:25502:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc12efcb100 00000100:00100000:2.0:1788201321.006028:0:25502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1054 00000100:00100000:2.0:1788201321.006040:0:25502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+35:2400:x1875060695500800:12345-192.168.201.20@tcp:4:dd.0 00000100:00100000:2.0:1788201321.014454:0:25502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+37:2400:x1875060695500800:12345-192.168.201.20@tcp:4:dd.0 Request processed in 8391us (9868us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788201321.014474:0:25502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1054 00002000:00100000:2.0:1788201321.014492:0:25502:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x388:0x0] (0->1023) req@ffff8dc12efcb100 x1875060695500800/t8589934599(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/448 e 0 to 0 dl 1788201332 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201321.014503:0:25502:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc12efcb100 with x1875060695500800 ext(0->1023) 00002000:00010000:2.0:1788201321.014510:0:25502:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc12efcb100 00000100:00100000:2.0:1788201321.024427:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201321.025176:0:24874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695500928 00000100:00100000:3.0:1788201321.025193:0:24874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695500928 00002000:00100000:3.0:1788201321.025533:0:24874:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x389:0x0] (0->1023) req@ffff8dc13f8db800 x1875060695500928/t0(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/0 e 0 to 0 dl 1788201332 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201321.025549:0:24874:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc13f8db800 with x1875060695500928 ext(0->1023) 00002000:00010000:3.0:1788201321.025557:0:24874:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc13f8db800 00000100:00100000:3.0:1788201321.025736:0:24874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1055 00000100:00100000:3.0:1788201321.025749:0:24874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+37:2401:x1875060695500928:12345-192.168.201.20@tcp:4:dd.0 00000100:00100000:3.0:1788201321.032141:0:24874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+39:2401:x1875060695500928:12345-192.168.201.20@tcp:4:dd.0 Request processed in 6384us (7718us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788201321.032157:0:24874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1055 00002000:00100000:3.0:1788201321.032171:0:24874:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x389:0x0] (0->1023) req@ffff8dc13f8db800 x1875060695500928/t8589934600(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/448 e 0 to 0 dl 1788201332 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201321.032182:0:24874:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc13f8db800 with x1875060695500928 ext(0->1023) 00002000:00010000:3.0:1788201321.032202:0:24874:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc13f8db800 00000100:00100000:3.0:1788201321.039964:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201321.040103:0:25729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695501056 00000100:00100000:1.0:1788201321.040121:0:25729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695501056 00002000:00100000:1.0:1788201321.040189:0:25729:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x38a:0x0] (0->1023) req@ffff8dc118142a00 x1875060695501056/t0(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/0 e 0 to 0 dl 1788201332 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201321.043759:0:25729:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc118142a00 with x1875060695501056 ext(0->1023) 00002000:00010000:1.0:1788201321.043786:0:25729:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc118142a00 00000100:00100000:1.0:1788201321.044168:0:25729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1056 00000100:00100000:1.0:1788201321.044190:0:25729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118142a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6e293f14-c501-4bc5-9dd4-a18ef02756b4+39:2402:x1875060695501056:12345-192.168.201.20@tcp:4:dd.0 00000100:00100000:1.0:1788201321.049423:0:25729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118142a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:6e293f14-c501-4bc5-9dd4-a18ef02756b4+41:2402:x1875060695501056:12345-192.168.201.20@tcp:4:dd.0 Request processed in 5226us (9452us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788201321.049449:0:25729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1056 00002000:00100000:1.0:1788201321.049466:0:25729:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x38a:0x0] (0->1023) req@ffff8dc118142a00 x1875060695501056/t8589934601(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/448 e 0 to 0 dl 1788201332 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201321.049478:0:25729:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc118142a00 with x1875060695501056 ext(0->1023) 00002000:00010000:1.0:1788201321.049486:0:25729:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc118142a00 00000100:00100000:0.0:1788201321.058878:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201321.059075:0:24875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695501184 00000100:00100000:2.0:1788201321.059089:0:24875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695501184 00002000:00100000:2.0:1788201321.059157:0:24875:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x38b:0x0] (0->1023) req@ffff8dc005d5aa00 x1875060695501184/t0(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/0 e 0 to 0 dl 1788201332 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201321.059169:0:24875:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc005d5aa00 with x1875060695501184 ext(0->1023) 00002000:00010000:2.0:1788201321.059176:0:24875:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc005d5aa00 00000100:00100000:2.0:1788201321.059220:0:24875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1057 00000100:00100000:2.0:1788201321.059241:0:24875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+41:2400:x1875060695501184:12345-192.168.201.20@tcp:4:dd.0 00000100:00100000:2.0:1788201321.060723:0:24875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+43:2400:x1875060695501184:12345-192.168.201.20@tcp:4:dd.0 Request processed in 1473us (1850us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1788201321.060745:0:24875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1057 00002000:00100000:2.0:1788201321.060757:0:24875:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x38b:0x0] (0->1023) req@ffff8dc005d5aa00 x1875060695501184/t8589934602(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/448 e 0 to 0 dl 1788201332 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201321.060768:0:24875:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc005d5aa00 with x1875060695501184 ext(0->1023) 00002000:00010000:2.0:1788201321.060774:0:24875:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc005d5aa00 00000100:00100000:3.0:1788201321.065221:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201321.067542:0:25933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695501312 00000100:00100000:0.0:1788201321.067563:0:25933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695501312 00002000:00100000:0.0:1788201321.067638:0:25933:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x38c:0x0] (0->1023) req@ffff8dc118143480 x1875060695501312/t0(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/0 e 0 to 0 dl 1788201332 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201321.067650:0:25933:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc118143480 with x1875060695501312 ext(0->1023) 00002000:00010000:0.0:1788201321.067657:0:25933:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc118143480 00000100:00100000:0.0:1788201321.067695:0:25933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1058 00000100:00100000:0.0:1788201321.067705:0:25933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+43:2400:x1875060695501312:12345-192.168.201.20@tcp:4:dd.0 00000100:00100000:0.0:1788201321.068998:0:25933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:6e293f14-c501-4bc5-9dd4-a18ef02756b4+45:2400:x1875060695501312:12345-192.168.201.20@tcp:4:dd.0 Request processed in 1286us (3779us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788201321.069009:0:25933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1058 00002000:00100000:0.0:1788201321.069041:0:25933:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x38c:0x0] (0->1023) req@ffff8dc118143480 x1875060695501312/t8589934603(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/448 e 0 to 0 dl 1788201332 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201321.069052:0:25933:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc118143480 with x1875060695501312 ext(0->1023) 00002000:00010000:0.0:1788201321.069058:0:25933:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc118143480 00000100:00100000:0.0:1788201321.076649:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201321.076780:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695501440 00000100:00100000:1.0:1788201321.076794:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695501440 00002000:00100000:1.0:1788201321.076923:0:8454:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x38d:0x0] (0->1023) req@ffff8dc005d59500 x1875060695501440/t0(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/0 e 0 to 0 dl 1788201332 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201321.076936:0:8454:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc005d59500 with x1875060695501440 ext(0->1023) 00002000:00010000:1.0:1788201321.076944:0:8454:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc005d59500 00000100:00100000:1.0:1788201321.076981:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1059 00000100:00100000:1.0:1788201321.076992:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+45:2401:x1875060695501440:12345-192.168.201.20@tcp:4:dd.0 00000100:00100000:0.0:1788201321.078801:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+47:2401:x1875060695501440:12345-192.168.201.20@tcp:4:dd.0 Request processed in 1797us (2155us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788201321.078816:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1059 00002000:00100000:0.0:1788201321.078837:0:8454:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x38d:0x0] (0->1023) req@ffff8dc005d59500 x1875060695501440/t8589934604(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/448 e 0 to 0 dl 1788201332 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201321.078849:0:8454:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc005d59500 with x1875060695501440 ext(0->1023) 00002000:00010000:0.0:1788201321.078858:0:8454:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc005d59500 00000100:00100000:1.0:1788201321.082877:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201321.083278:0:24876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695501568 00000100:00100000:0.0:1788201321.083291:0:24876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695501568 00002000:00100000:0.0:1788201321.083359:0:24876:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x38e:0x0] (0->1023) req@ffff8dc12efc9500 x1875060695501568/t0(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/0 e 0 to 0 dl 1788201332 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201321.083373:0:24876:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc12efc9500 with x1875060695501568 ext(0->1023) 00002000:00010000:0.0:1788201321.083380:0:24876:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc12efc9500 00000100:00100000:0.0:1788201321.087519:0:24876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1060 00000100:00100000:0.0:1788201321.087612:0:24876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+47:2401:x1875060695501568:12345-192.168.201.20@tcp:4:dd.0 00000100:00100000:0.0:1788201321.092936:0:24876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+49:2401:x1875060695501568:12345-192.168.201.20@tcp:4:dd.0 Request processed in 5387us (10114us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788201321.092967:0:24876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1060 00002000:00100000:0.0:1788201321.092985:0:24876:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x38e:0x0] (0->1023) req@ffff8dc12efc9500 x1875060695501568/t8589934605(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/448 e 0 to 0 dl 1788201332 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201321.092997:0:24876:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc12efc9500 with x1875060695501568 ext(0->1023) 00002000:00010000:0.0:1788201321.093005:0:24876:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc12efc9500 00000100:00100000:2.0:1788201321.106007:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201321.106162:0:24873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695501696 00000100:00100000:0.0:1788201321.106177:0:24873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695501696 00002000:00100000:0.0:1788201321.106230:0:24873:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x38f:0x0] (0->1023) req@ffff8dc13f8d9500 x1875060695501696/t0(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/0 e 0 to 0 dl 1788201332 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201321.106242:0:24873:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc13f8d9500 with x1875060695501696 ext(0->1023) 00002000:00010000:0.0:1788201321.106248:0:24873:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc13f8d9500 00000100:00100000:0.0:1788201321.106284:0:24873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1061 00000100:00100000:0.0:1788201321.106296:0:24873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+49:2401:x1875060695501696:12345-192.168.201.20@tcp:4:dd.0 00000100:00100000:2.0:1788201321.109713:0:24873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2401:x1875060695501696:12345-192.168.201.20@tcp:4:dd.0 Request processed in 3405us (3710us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788201321.109791:0:24873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1061 00002000:00100000:2.0:1788201321.109807:0:24873:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x38f:0x0] (0->1023) req@ffff8dc13f8d9500 x1875060695501696/t8589934606(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/448 e 0 to 0 dl 1788201332 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201321.109819:0:24873:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc13f8d9500 with x1875060695501696 ext(0->1023) 00002000:00010000:2.0:1788201321.110123:0:24873:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc13f8d9500 00000100:00100000:2.0:1788201321.119331:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201321.119396:0:25936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695501824 00000100:00100000:1.0:1788201321.119411:0:25936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695501824 00002000:00100000:1.0:1788201321.119480:0:25936:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x390:0x0] (0->1023) req@ffff8dc13f8d8a80 x1875060695501824/t0(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/0 e 0 to 0 dl 1788201332 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201321.119499:0:25936:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc13f8d8a80 with x1875060695501824 ext(0->1023) 00002000:00010000:1.0:1788201321.119506:0:25936:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc13f8d8a80 00000100:00100000:1.0:1788201321.119542:0:25936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1062 00000100:00100000:1.0:1788201321.119552:0:25936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2403:x1875060695501824:12345-192.168.201.20@tcp:4:dd.0 00000100:00100000:1.0:1788201321.124491:0:25936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:6e293f14-c501-4bc5-9dd4-a18ef02756b4+53:2403:x1875060695501824:12345-192.168.201.20@tcp:4:dd.0 Request processed in 4928us (5161us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788201321.124505:0:25936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1062 00002000:00100000:1.0:1788201321.124518:0:25936:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x390:0x0] (0->1023) req@ffff8dc13f8d8a80 x1875060695501824/t8589934607(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/448 e 0 to 0 dl 1788201332 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201321.124528:0:25936:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc13f8d8a80 with x1875060695501824 ext(0->1023) 00002000:00010000:1.0:1788201321.124535:0:25936:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc13f8d8a80 00000100:00100000:0.0:1788201321.133727:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201321.133864:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695501952 00000100:00100000:1.0:1788201321.133875:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695501952 00002000:00100000:1.0:1788201321.133923:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x391:0x0] (0->1023) req@ffff8dc005d58a80 x1875060695501952/t0(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/0 e 0 to 0 dl 1788201332 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201321.133936:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc005d58a80 with x1875060695501952 ext(0->1023) 00002000:00010000:1.0:1788201321.133941:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc005d58a80 00000100:00100000:1.0:1788201321.133978:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1063 00000100:00100000:1.0:1788201321.133989:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+53:2403:x1875060695501952:12345-192.168.201.20@tcp:4:dd.0 00000100:00100000:1.0:1788201321.138906:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+55:2403:x1875060695501952:12345-192.168.201.20@tcp:4:dd.0 Request processed in 4908us (5177us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788201321.138919:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1063 00002000:00100000:1.0:1788201321.138932:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x391:0x0] (0->1023) req@ffff8dc005d58a80 x1875060695501952/t8589934608(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/448 e 0 to 0 dl 1788201332 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201321.138950:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc005d58a80 with x1875060695501952 ext(0->1023) 00002000:00010000:1.0:1788201321.138956:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc005d58a80 00000100:00100000:3.0:1788201321.152514:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201321.152629:0:24857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695502080 00000100:00100000:2.0:1788201321.152646:0:24857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695502080 00002000:00100000:2.0:1788201321.152722:0:24857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x392:0x0] (0->1023) req@ffff8dc118142d80 x1875060695502080/t0(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/0 e 0 to 0 dl 1788201332 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201321.152738:0:24857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc118142d80 with x1875060695502080 ext(0->1023) 00002000:00010000:2.0:1788201321.152745:0:24857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc118142d80 00000100:00100000:2.0:1788201321.152798:0:24857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1064 00000100:00100000:2.0:1788201321.152811:0:24857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118142d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+55:2400:x1875060695502080:12345-192.168.201.20@tcp:4:dd.0 00000100:00100000:2.0:1788201321.154527:0:24857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118142d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+57:2400:x1875060695502080:12345-192.168.201.20@tcp:4:dd.0 Request processed in 1704us (2009us total) trans 8589934609 rc 0/0 00000100:00100000:2.0:1788201321.154552:0:24857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1064 00002000:00100000:2.0:1788201321.154567:0:24857:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x392:0x0] (0->1023) req@ffff8dc118142d80 x1875060695502080/t8589934609(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/448 e 0 to 0 dl 1788201332 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201321.154887:0:24857:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc118142d80 with x1875060695502080 ext(0->1023) 00002000:00010000:2.0:1788201321.154896:0:24857:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc118142d80 00000100:00100000:2.0:1788201321.162591:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201321.163120:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695502208 00000100:00100000:0.0:1788201321.163131:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695502208 00002000:00100000:0.0:1788201321.163177:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x393:0x0] (0->1023) req@ffff8dc13f8db480 x1875060695502208/t0(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/0 e 0 to 0 dl 1788201332 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201321.163200:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc13f8db480 with x1875060695502208 ext(0->1023) 00002000:00010000:0.0:1788201321.163206:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc13f8db480 00000100:00100000:0.0:1788201321.163239:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1065 00000100:00100000:0.0:1788201321.163249:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+57:2400:x1875060695502208:12345-192.168.201.20@tcp:4:dd.0 00000100:00100000:0.0:1788201321.166412:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:2400:x1875060695502208:12345-192.168.201.20@tcp:4:dd.0 Request processed in 3153us (3821us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788201321.166443:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1065 00002000:00100000:0.0:1788201321.166455:0:8452:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x393:0x0] (0->1023) req@ffff8dc13f8db480 x1875060695502208/t8589934610(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/448 e 0 to 0 dl 1788201332 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201321.166467:0:8452:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc13f8db480 with x1875060695502208 ext(0->1023) 00002000:00010000:0.0:1788201321.166474:0:8452:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc13f8db480 00000100:00100000:1.0:1788201321.173066:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201321.174164:0:25502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695502336 00000100:00100000:3.0:1788201321.174185:0:25502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695502336 00002000:00100000:3.0:1788201321.174401:0:25502:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x394:0x0] (0->1023) req@ffff8dc12efca680 x1875060695502336/t0(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/0 e 0 to 0 dl 1788201332 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788201321.174415:0:25502:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc12efca680 with x1875060695502336 ext(0->1023) 00002000:00010000:3.0:1788201321.174424:0:25502:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc12efca680 00000100:00100000:3.0:1788201321.174478:0:25502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1066 00000100:00100000:3.0:1788201321.174492:0:25502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:2400:x1875060695502336:12345-192.168.201.20@tcp:4:dd.0 00000100:00100000:1.0:1788201321.179807:0:25502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6e293f14-c501-4bc5-9dd4-a18ef02756b4+61:2400:x1875060695502336:12345-192.168.201.20@tcp:4:dd.0 Request processed in 5310us (6788us total) trans 8589934611 rc 0/0 00000100:00100000:1.0:1788201321.179822:0:25502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1066 00002000:00100000:1.0:1788201321.179852:0:25502:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x394:0x0] (0->1023) req@ffff8dc12efca680 x1875060695502336/t8589934611(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/448 e 0 to 0 dl 1788201332 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788201321.179866:0:25502:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc12efca680 with x1875060695502336 ext(0->1023) 00002000:00010000:1.0:1788201321.179874:0:25502:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc12efca680 00000100:00100000:2.0:1788201321.185619:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201321.189398:0:24874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695502464 00000100:00100000:3.0:1788201321.189413:0:24874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695502464 00002000:00100000:2.0:1788201321.189668:0:24874:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x395:0x0] (0->1023) req@ffff8dc13f8d9c00 x1875060695502464/t0(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/0 e 0 to 0 dl 1788201332 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788201321.189682:0:24874:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc13f8d9c00 with x1875060695502464 ext(0->1023) 00002000:00010000:2.0:1788201321.189689:0:24874:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc13f8d9c00 00000100:00100000:2.0:1788201321.189717:0:24874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1067 00000100:00100000:2.0:1788201321.189728:0:24874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+61:2401:x1875060695502464:12345-192.168.201.20@tcp:4:dd.0 00000100:00100000:0.0:1788201321.198547:0:24874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+63:2401:x1875060695502464:12345-192.168.201.20@tcp:4:dd.0 Request processed in 8809us (12926us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788201321.198562:0:24874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1067 00002000:00100000:0.0:1788201321.198574:0:24874:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x395:0x0] (0->1023) req@ffff8dc13f8d9c00 x1875060695502464/t8589934612(0) o4->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:442/0 lens 1512/448 e 0 to 0 dl 1788201332 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788201321.198585:0:24874:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dc13f8d9c00 with x1875060695502464 ext(0->1023) 00002000:00010000:0.0:1788201321.198593:0:24874:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dc13f8d9c00 00010000:00010000:3.0:1788201321.232955:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201321.815931:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201321.815970:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715321984:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201321.816104:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201321.822499:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715321984 00000100:00100000:3.0:1788201321.822521:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715321984 00000100:00100000:3.0:1788201321.822614:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2393 00000100:00100000:3.0:1788201321.822627:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715321984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201321.822671:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201321.822772:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715321984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 149us (6669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201321.822780:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2393 00000100:00100000:3.0:1788201321.823068:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715321984:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788201321.824432:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788201322.256197:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201323.279641:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201323.858913:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201323.858974:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715322112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201323.859370:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201323.859486:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715322112 00000100:00100000:1.0:1788201323.859494:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715322112 00000100:00100000:1.0:1788201323.859582:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4149 00000100:00100000:1.0:1788201323.859592:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715322112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201323.859628:0:8458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:1.0:1788201323.859676:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715322112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201323.859683:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4149 00000100:00100000:0.0:1788201323.859751:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715322112:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788201324.311530:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201324.367168:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201324.367190:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715322240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201324.367256:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201324.367301:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715322240 00000100:00100000:1.0:1788201324.367307:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715322240 00000100:00100000:1.0:1788201324.367358:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2394 00000100:00100000:1.0:1788201324.367366:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715322240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201324.367411:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201324.367451:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715322240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201324.367458:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2394 00000100:00080000:1.0:1788201324.367477:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201324.367512:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715322240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201324.368693:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201324.368710:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715322368:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201324.368756:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201324.368874:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715322368 00000100:00100000:0.0:1788201324.368880:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715322368 00000100:00100000:0.0:1788201324.368919:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4150 00000100:00100000:0.0:1788201324.368926:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715322368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201324.368952:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:0.0:1788201324.368998:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715322368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201324.369004:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4150 00000100:00100000:2.0:1788201324.369418:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715322368:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201324.369676:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715322496:0@lo:400:kworker.0 00000100:00100000:2.0:1788201324.369711:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201324.369740:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715323008:0@lo:400:kworker.0 00000100:00100000:2.0:1788201324.369778:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201324.369798:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715323520:0@lo:400:kworker.0 00000100:00100000:2.0:1788201324.369822:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201324.369839:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788201324.369845:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715322880:0@lo:400:kworker.0 00000100:00100000:2.0:1788201324.369863:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201324.369879:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715323392:0@lo:400:kworker.0 00000100:00100000:2.0:1788201324.369898:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201324.369925:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715322496 00000100:00100000:2.0:1788201324.369929:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715322496 00000100:00100000:2.0:1788201324.369962:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788201324.369969:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715322496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201324.370001:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715322496:12345-0@lo:400:kworker.0 Request processed in 32us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201324.370007:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788201324.370064:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715323008 00000100:00100000:2.0:1788201324.370068:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715323008 00000100:00100000:2.0:1788201324.370102:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715322880 00000100:00100000:2.0:1788201324.370105:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715322880 00000100:00100000:2.0:1788201324.370123:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2956 00000100:00100000:2.0:1788201324.370129:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715323008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201324.370177:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715323008:12345-0@lo:400:kworker.0 Request processed in 48us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201324.370183:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2956 00000100:00100000:2.0:1788201324.370194:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2957 00000100:00100000:2.0:1788201324.370200:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715322880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201324.370235:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715322880:12345-0@lo:400:kworker.0 Request processed in 36us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201324.370241:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2957 00000100:00100000:2.0:1788201324.370258:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715323520 00000100:00100000:2.0:1788201324.370261:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715323520 00000100:00100000:2.0:1788201324.370286:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715323392 00000100:00100000:2.0:1788201324.370289:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715323392 00000100:00100000:2.0:1788201324.370304:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1615 00000100:00100000:2.0:1788201324.370310:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715323520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201324.370341:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715323520:12345-0@lo:400:kworker.0 Request processed in 31us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201324.370347:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1615 00000100:00100000:2.0:1788201324.370359:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1616 00000100:00100000:2.0:1788201324.370365:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715323392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201324.370402:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715323392:12345-0@lo:400:kworker.0 Request processed in 37us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201324.370412:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1616 00000100:00080000:2.0:1788201324.370444:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201324.370447:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715322752:0@lo:400:kworker.0 00000100:00080000:2.0:1788201324.370448:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201324.370450:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201324.370469:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715322880:0@lo:400:kworker.0 00000100:00100000:0.0:1788201324.370477:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201324.370479:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715323392:0@lo:400:kworker.0 00000100:00100000:2.0:1788201324.370487:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715322496:0@lo:400:kworker.0 00000100:00100000:2.0:1788201324.370495:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715323008:0@lo:400:kworker.0 00000100:00100000:2.0:1788201324.370504:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715323520:0@lo:400:kworker.0 00000100:00100000:0.0:1788201324.370509:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715323264:0@lo:400:kworker.0 00000100:00100000:0.0:1788201324.370531:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201324.370545:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715323264 00000100:00100000:0.0:1788201324.370547:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788201324.370549:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715323264 00000100:00100000:0.0:1788201324.370552:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715322624:0@lo:400:kworker.0 00000100:00100000:0.0:1788201324.370574:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201324.370574:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2958 00000100:00100000:2.0:1788201324.370580:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140e9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715323264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201324.370588:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715323136:0@lo:400:kworker.0 00000100:00100000:0.0:1788201324.370604:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201324.370608:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140e9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715323264:12345-0@lo:400:kworker.0 Request processed in 28us (76us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201324.370614:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2958 00000100:00100000:0.0:1788201324.370617:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715323648:0@lo:400:kworker.0 00000100:00100000:0.0:1788201324.370634:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201324.370652:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715323264:0@lo:400:kworker.0 00000100:00100000:0.0:1788201324.370669:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715322752 00000100:00100000:0.0:1788201324.370671:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715322752 00000100:00100000:0.0:1788201324.370689:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715322624 00000100:00100000:0.0:1788201324.370691:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715322624 00000100:00100000:0.0:1788201324.370700:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715323136 00000100:00100000:0.0:1788201324.370702:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715323136 00000100:00100000:0.0:1788201324.370710:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715323648 00000100:00100000:0.0:1788201324.370712:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715323648 00000100:00100000:0.0:1788201324.370723:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1617 00000100:00100000:0.0:1788201324.370729:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715322752:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788201324.370735:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201324.370737:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201324.370739:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201324.370774:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715322752:12345-0@lo:400:kworker.0 Request processed in 44us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201324.370788:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1617 00000100:00100000:0.0:1788201324.370801:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1618 00000100:00100000:0.0:1788201324.370806:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715322624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201324.370834:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715322624:12345-0@lo:400:kworker.0 Request processed in 28us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201324.370835:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715322752:0@lo:400:kworker.0 00000100:00100000:0.0:1788201324.370840:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1618 00000100:00100000:2.0:1788201324.370849:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715322624:0@lo:400:kworker.0 00000100:00100000:0.0:1788201324.370851:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1619 00000100:00100000:0.0:1788201324.370856:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715323136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201324.370893:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715323136:12345-0@lo:400:kworker.0 Request processed in 37us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201324.370899:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1619 00000100:00100000:0.0:1788201324.370911:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1620 00000100:00100000:0.0:1788201324.370917:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715323648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201324.370937:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715323136:0@lo:400:kworker.0 00000100:00100000:0.0:1788201324.370941:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715323648:12345-0@lo:400:kworker.0 Request processed in 25us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201324.370947:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1620 00000100:00100000:2.0:1788201324.370947:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715323648:0@lo:400:kworker.0 00010000:00010000:3.0:1788201325.328520:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201325.524700:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201325.524852:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201325.524882:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201325.524904:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201325.525077:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201325.525107:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695502848 00000100:00100000:3.0:1788201325.525116:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695502848 00000100:00100000:3.0:1788201325.525177:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695502720 00000100:00100000:3.0:1788201325.525180:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695502720 00000100:00100000:3.0:1788201325.525207:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1621 00000100:00100000:3.0:1788201325.525218:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2402:x1875060695502848:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201325.525295:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2402:x1875060695502848:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 79us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201325.525303:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1621 00000100:00100000:3.0:1788201325.525321:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1622 00000100:00100000:3.0:1788201325.525341:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2402:x1875060695502720:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201325.525451:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2402:x1875060695502720:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 111us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201325.525458:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1622 00000100:00080000:3.0:1788201325.525481:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201325.525485:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201325.525668:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695502592 00000100:00100000:1.0:1788201325.525674:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695502592 00000100:00100000:1.0:1788201325.525713:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 261 00000100:00100000:1.0:1788201325.525721:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695502592:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201325.525750:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695502592:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 31us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201325.525757:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 261 00000100:00100000:1.0:1788201325.525789:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695503104 00000100:00100000:1.0:1788201325.525792:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695503104 00000100:00100000:1.0:1788201325.525823:0:26200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695502976 00000100:00100000:1.0:1788201325.525826:0:26200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695502976 00000100:00100000:1.0:1788201325.525849:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2959 00000100:00100000:1.0:1788201325.525856:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2402:x1875060695503104:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201325.525883:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2402:x1875060695503104:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 28us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201325.525890:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2959 00000100:00100000:1.0:1788201325.525902:0:26200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2960 00000100:00100000:1.0:1788201325.525910:0:26200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+63:2402:x1875060695502976:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201325.526101:0:26200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+63:2402:x1875060695502976:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 190us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201325.526121:0:26200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2960 00000100:00080000:1.0:1788201325.526147:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201325.526150:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201325.908197:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201325.908222:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715323776:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201325.908298:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201325.908695:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715323776 00000100:00100000:3.0:1788201325.908705:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715323776 00000100:00100000:3.0:1788201325.908857:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2395 00000100:00100000:3.0:1788201325.908868:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715323776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201325.908899:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 169579968 pending 544768 free 3922382848 avail 3690860544 00000100:00100000:3.0:1788201325.908960:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715323776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201325.908975:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2395 00000100:00100000:2.0:1788201325.909080:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715323776:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1788201326.054781:0:98909:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788201326.353211:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201326.419959:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715323904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201326.420058:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201326.422536:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715323904 00000100:00100000:0.0:1788201326.422550:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715323904 00000100:00100000:0.0:1788201326.422607:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2396 00000100:00100000:0.0:1788201326.422614:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715323904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201326.422634:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 169579968 pending 544768 free 3922382848 avail 3690860544 00000100:00100000:0.0:1788201326.422704:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715323904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (2647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201326.422716:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2396 00000100:00080000:3.0:1788201326.422806:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201326.422847:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715323904:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788201326.426475:0:98553:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934612 is committed 00000100:00100000:2.0:1788201326.931908:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201326.931936:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715324032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201326.932008:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201326.932189:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715324032 00000100:00100000:2.0:1788201326.932197:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715324032 00000100:00100000:2.0:1788201326.932250:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2397 00000100:00100000:2.0:1788201326.932267:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715324032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201326.932296:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201326.932358:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715324032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201326.932366:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2397 00000100:00080000:2.0:1788201326.932385:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201326.932433:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715324032:0@lo:13:osp-pre-1-1.0 00000020:00000004:3.0:1788201326.942736:0:98961:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788201326.942962:0:98961:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788201327.377421:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788201327.879881:0:99011:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788201327.880146:0:99011:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788201328.399298:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201328.976331:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201328.976355:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715324160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201328.976421:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201328.976470:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715324160 00000100:00100000:0.0:1788201328.976478:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715324160 00000100:00100000:0.0:1788201328.976536:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4151 00000100:00100000:0.0:1788201328.976548:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715324160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201328.976582:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:0.0:1788201328.976638:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715324160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201328.976645:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4151 00000100:00100000:0.0:1788201328.976694:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715324160:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788201329.428642:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201329.488452:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201329.488480:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715324288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201329.488661:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201329.488723:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715324288 00000100:00100000:1.0:1788201329.488732:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715324288 00000100:00100000:1.0:1788201329.488789:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2398 00000100:00100000:1.0:1788201329.488799:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715324288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201329.488828:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788201329.488872:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715324288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201329.488880:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2398 00000100:00080000:1.0:1788201329.488903:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201329.488939:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715324288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201329.489469:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201329.489480:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715324416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201329.489522:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201329.489555:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715324416 00000100:00100000:1.0:1788201329.489560:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715324416 00000100:00100000:1.0:1788201329.489591:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4152 00000100:00100000:1.0:1788201329.489598:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715324416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201329.489624:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:1.0:1788201329.489661:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715324416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201329.489680:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4152 00000100:00100000:1.0:1788201329.489728:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715324416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201329.498904:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715324800:0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.498981:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201329.499310:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715325312:0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.499342:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201329.499369:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788201329.499375:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715324672:0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.499394:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201329.499408:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715325184:0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.499426:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201329.499439:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715325696:0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.499458:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201329.499485:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715324800 00000100:00100000:1.0:1788201329.499492:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715324800 00000100:00100000:1.0:1788201329.499550:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715324672 00000100:00100000:1.0:1788201329.499553:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715324672 00000100:00100000:1.0:1788201329.499564:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715325184 00000100:00100000:1.0:1788201329.499566:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715325184 00000100:00100000:1.0:1788201329.499575:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715325696 00000100:00100000:1.0:1788201329.499577:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715325696 00000100:00100000:1.0:1788201329.499589:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1623 00000100:00100000:1.0:1788201329.499596:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715324800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.499639:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715324800:12345-0@lo:400:kworker.0 Request processed in 43us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201329.499645:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1623 00000100:00100000:1.0:1788201329.499669:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1624 00000100:00100000:1.0:1788201329.499674:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715324672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.499696:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715324672:12345-0@lo:400:kworker.0 Request processed in 22us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201329.499701:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1624 00000100:00100000:1.0:1788201329.499710:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1625 00000100:00100000:1.0:1788201329.499714:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715325184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.499736:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715325184:12345-0@lo:400:kworker.0 Request processed in 22us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201329.499742:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1625 00000100:00100000:1.0:1788201329.499753:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1626 00000100:00100000:1.0:1788201329.499759:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715325696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.499784:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715325696:12345-0@lo:400:kworker.0 Request processed in 25us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201329.499789:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1626 00000100:00100000:1.0:1788201329.499808:0:26203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715325312 00000100:00100000:1.0:1788201329.499811:0:26203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715325312 00000100:00100000:1.0:1788201329.499840:0:26203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2961 00000100:00100000:1.0:1788201329.499846:0:26203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715325312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.499876:0:26203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715325312:12345-0@lo:400:kworker.0 Request processed in 31us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201329.499882:0:26203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2961 00000100:00100000:1.0:1788201329.499915:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715324928:0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.499941:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201329.499958:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715325440:0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.499991:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201329.500011:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788201329.500043:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715324544:0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.500070:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201329.500096:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715325056:0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.500116:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201329.500133:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715325568:0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.500152:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201329.500174:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715324544 00000100:00100000:1.0:1788201329.500178:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715324544 00000100:00100000:1.0:1788201329.500204:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788201329.500211:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715324544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.500241:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715324544:12345-0@lo:400:kworker.0 Request processed in 31us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201329.500248:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788201329.500272:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715324928 00000100:00100000:1.0:1788201329.500276:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715324928 00000100:00100000:1.0:1788201329.500312:0:26202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715325056 00000100:00100000:1.0:1788201329.500315:0:26202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715325056 00000100:00100000:1.0:1788201329.500336:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2962 00000100:00100000:1.0:1788201329.500342:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715324928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.500372:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715324928:12345-0@lo:400:kworker.0 Request processed in 30us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201329.500378:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2962 00000100:00100000:1.0:1788201329.500390:0:26202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2963 00000100:00100000:1.0:1788201329.500396:0:26202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715325056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.500432:0:26202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715325056:12345-0@lo:400:kworker.0 Request processed in 36us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201329.500439:0:26202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2963 00000100:00100000:1.0:1788201329.500463:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715325440 00000100:00100000:1.0:1788201329.500467:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715325440 00000100:00100000:1.0:1788201329.500487:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715325568 00000100:00100000:1.0:1788201329.500489:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715325568 00000100:00100000:1.0:1788201329.500503:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1627 00000100:00100000:1.0:1788201329.500509:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715325440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.500536:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715325440:12345-0@lo:400:kworker.0 Request processed in 27us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201329.500542:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1627 00000100:00100000:1.0:1788201329.500553:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1628 00000100:00100000:1.0:1788201329.500558:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715325568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.500584:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715325568:12345-0@lo:400:kworker.0 Request processed in 26us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201329.500590:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1628 00000100:00080000:1.0:1788201329.500625:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201329.500629:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201329.500632:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201329.500633:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201329.500661:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715324544:0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.500674:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715325056:0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.500683:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715325568:0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.500692:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715324928:0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.500712:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715325440:0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.500747:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715324672:0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.500756:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715325184:0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.500764:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715325696:0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.500773:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715324800:0@lo:400:kworker.0 00000100:00100000:1.0:1788201329.500781:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715325312:0@lo:400:kworker.0 00000020:01000004:1.0:1788201330.062624:0:99108:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788201330.082245:0:99108:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788201330.082324:0:99108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc000/0x96d0c9b8c9a1d59d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d5a4 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.082342:0:99108:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc000/0x96d0c9b8c9a1d59d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d5a4 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.082350:0:99108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc000/0x96d0c9b8c9a1d59d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1d5a4 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.082357:0:99108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc000/0x96d0c9b8c9a1d59d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1d5a4 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.082383:0:99108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788201330.082388:0:99108:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1788201330.082409:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201330.082418:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc000/0x96d0c9b8c9a1d59d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1d5a4 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788201330.082426:0:99108:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1788201330.082429:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc000 already unused, calling callback (ffffffffc1280c20) 00000100:00100000:1.0:1788201330.082434:0:99108:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 10000000:00010000:2.0:1788201330.082436:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc000/0x96d0c9b8c9a1d59d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1d5a4 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788201330.082444:0:99108:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1788201330.082449:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc000/0x96d0c9b8c9a1d59d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1d5a4 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201330.082459:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc000/0x96d0c9b8c9a1d59d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1d5a4 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201330.082466:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788201330.082469:0:24979:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788201330.082472:0:24979:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:1.0:1788201330.082473:0:99108:0:(import.c:65:import_set_state_nolock()) ffff8dc11077f800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788201330.082501:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc000/0x96d0c9b8c9a1d59d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1d5a4 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.082510:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201330.082547:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc000/0x96d0c9b8c9a1d59d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1d5a4 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201330.082548:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715325824:0@lo:39:umount.0 00010000:00010000:2.0:1788201330.082561:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc000/0x96d0c9b8c9a1d59d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1d5a4 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.082574:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201330.082576:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201330.082578:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201330.082588:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201330.082603:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715325952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201330.082626:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201330.082643:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201330.082690:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715325952 00000100:00100000:2.0:1788201330.082697:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715325952 00000100:00100000:2.0:1788201330.082747:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:2.0:1788201330.082756:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715325952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201330.082780:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201330.082796:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140d58600/0x96d0c9b8c9a1d5a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d59d expref: 24 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.082810:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201330.082902:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+23:3657:x1875060715325952:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201330.082907:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:1.0:1788201330.082951:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715325952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201330.083361:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715325824 00000100:00100000:0.0:1788201330.083367:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715325824 00000100:00100000:0.0:1788201330.083407:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1609 00000100:00100000:0.0:1788201330.083414:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875060715325824:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788201330.083436:0:69485:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d5c0 00000100:00080000:0.0:1788201330.083444:0:69485:0:(import.c:65:import_set_state_nolock()) ffff8dc00520b800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788201330.083472:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201330.087254:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+1:3654:x1875060715325824:12345-0@lo:39:umount.0 Request processed in 3829us (4618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201330.087270:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1609 00000020:00000080:0.0:1788201330.087304:0:69485:0:(genops.c:885:class_export_put()) final put ffff8dc005209800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788201330.087416:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005209800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788201330.087471:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc00520b800 for lustre-MDT0000 00000100:00080000:3.0:1788201330.087594:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11077f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788201330.087647:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715325824:0@lo:39:umount.0 00000100:00080000:1.0:1788201330.087704:0:99108:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788201330.087708:0:99108:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788201330.087917:0:99108:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788201330.090061:0:99108:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788201330.090068:0:99108:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788201330.090074:0:99108:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788201330.090104:0:99108:0:(import.c:65:import_set_state_nolock()) ffff8dc001db5800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788201330.090342:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715326080:0@lo:39:umount.0 00000100:00100000:3.0:1788201330.090420:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201330.091663:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715326080 00000100:00100000:2.0:1788201330.091678:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715326080 00000100:00100000:2.0:1788201330.091737:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1610 00000100:00100000:2.0:1788201330.091744:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875060715326080:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788201330.091773:0:66313:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d5ce 00000100:00080000:2.0:1788201330.091783:0:66313:0:(import.c:65:import_set_state_nolock()) ffff8dc005208000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788201330.091855:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+1:3654:x1875060715326080:12345-0@lo:39:umount.0 Request processed in 111us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201330.091861:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1610 00000020:00000080:2.0:1788201330.091869:0:66313:0:(genops.c:885:class_export_put()) final put ffff8dc00520a000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1788201330.091892:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc00520a000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1788201330.091929:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc005208000 for lustre-MDT0001 00010000:00010000:0.0:1788201330.092011:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201330.092183:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db5800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788201330.092198:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715326080:0@lo:39:umount.0 00000100:00080000:2.0:1788201330.092642:0:99108:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788201330.092645:0:99108:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788201330.092648:0:99108:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788201330.093439:0:99108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc200/0x96d0c9b8c9a1d55e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d565 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.093452:0:99108:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc200/0x96d0c9b8c9a1d55e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d565 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.093457:0:99108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc200/0x96d0c9b8c9a1d55e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1d565 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.093461:0:99108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc200/0x96d0c9b8c9a1d55e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1d565 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.093482:0:99108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201330.093487:0:99108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbde00/0x96d0c9b8c9a1d58f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d596 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.093501:0:99108:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbde00/0x96d0c9b8c9a1d58f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d596 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.093505:0:99108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbde00/0x96d0c9b8c9a1d58f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1d596 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.093508:0:99108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc006dbde00/0x96d0c9b8c9a1d58f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1d596 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.093519:0:99108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788201330.093523:0:99108:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788201330.093566:0:99108:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788201330.093571:0:99108:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788201330.093575:0:99108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201330.093581:0:99108:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:2.0:1788201330.093590:0:99108:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8dc12e642000 6e293f14-c501-4bc5-9dd4-a18ef02756b4 192.168.201.20@tcp 24 (0 0 20) 0 0 0 0: 0000000000000000 8589934612 stale:0 00000020:00080000:2.0:1788201330.093596:0:99108:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8dc12e640000 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294969474 stale:0 00000020:00080000:2.0:1788201330.093601:0:99108:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff8dc13f869000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294969456 stale:0 00010000:00010000:3.0:1788201330.093604:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00080000:2.0:1788201330.093605:0:99108:0:(genops.c:1553:class_disconnect_exports()) OBD device 18 (ffff8dc139bbb370) has exports, disconnecting them 00000020:00080000:2.0:1788201330.093610:0:99108:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.201.20@tcp (ffff8dc12e642000), last request at 1788201325 00010000:00010000:3.0:1788201330.093615:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc200/0x96d0c9b8c9a1d55e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1d565 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.093626:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc200 already unused, calling callback (ffffffffc1280c20) 00000020:00000080:2.0:1788201330.093627:0:99108:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d588 10000000:00010000:3.0:1788201330.093631:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc200/0x96d0c9b8c9a1d55e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1d565 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1788201330.093635:0:99108:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc12e642000: total 0 00000100:00080000:2.0:1788201330.093640:0:99108:0:(import.c:65:import_set_state_nolock()) ffff8dc120727000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788201330.093657:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc200/0x96d0c9b8c9a1d55e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1d565 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201330.093666:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc200/0x96d0c9b8c9a1d55e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1d565 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201330.093673:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788201330.093676:0:6521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788201330.093679:0:6521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000001:00000004:2.0:1788201330.093710:0:99108:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934612 00010000:00010000:3.0:1788201330.093727:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc200/0x96d0c9b8c9a1d55e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1d565 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.093734:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201330.093761:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc200/0x96d0c9b8c9a1d55e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1d565 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.093768:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc006dbc200/0x96d0c9b8c9a1d55e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1d565 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:3.0:1788201330.093781:0:6521:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc12e642000: total 0 00000020:00080000:2.0:1788201330.093813:0:99108:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.201.20@tcp (ffff8dc12e642000): rc 0 00000020:00080000:2.0:1788201330.093819:0:99108:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8dc12e640000), last request at 1788201329 00000020:00000080:2.0:1788201330.093827:0:99108:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d581 00000100:00080000:2.0:1788201330.093831:0:99108:0:(import.c:65:import_set_state_nolock()) ffff8dc005208800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788201330.093831:0:6521:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc12e642000, canceled 0 locks, left on hash table 20. 00000001:00000004:2.0:1788201330.093862:0:99108:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934612 00002000:00010000:3.0:1788201330.093879:0:6521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x392:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00000020:00080000:2.0:1788201330.093893:0:99108:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc12e640000): rc 0 00000020:00080000:2.0:1788201330.093896:0:99108:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8dc13f869000), last request at 1788201329 00000020:00000080:2.0:1788201330.093899:0:99108:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d57a 00000100:00080000:2.0:1788201330.093902:0:99108:0:(import.c:65:import_set_state_nolock()) ffff8dc120723000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788201330.093911:0:99108:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934612 00010000:00010000:3.0:1788201330.093913:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1d668 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c8c expref: 22 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788201330.093928:0:99108:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc13f869000): rc 0 00002000:00010000:3.0:1788201330.093944:0:6521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38a:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00000020:00080000:2.0:1788201330.093950:0:99108:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8dc139bbb370) has no exports 00010000:00010000:3.0:1788201330.093959:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1d60d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b6d expref: 21 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201330.093996:0:6521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x394:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:2.0:1788201330.093997:0:99108:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1d66f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106400000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b19 expref: 20 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.094042:0:99108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1d66f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907400000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b19 expref: 20 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.094045:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cc1cd93/0x96d0c9b8c9a1d64c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bac expref: 20 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.094069:0:99108:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000ab39a76d/0x96d0c9b8c9a1d661 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x383:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106400000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b3c expref: 18 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201330.094072:0:6521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x383:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:3.0:1788201330.094089:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab39a76d/0x96d0c9b8c9a1d661 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907400000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b3c expref: 18 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.094102:0:99108:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 000000006ccd9d4f/0x96d0c9b8c9a1d653 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x384:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106400000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bcf expref: 17 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201330.094108:0:6521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38b:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:2.0:1788201330.094111:0:99108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ccd9d4f/0x96d0c9b8c9a1d653 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x384:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907400000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bcf expref: 17 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.094127:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090d8cd0e/0x96d0c9b8c9a1d630 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bf9 expref: 16 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.094139:0:99108:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000e365e6f9/0x96d0c9b8c9a1d645 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106400000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b74 expref: 15 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201330.094149:0:6521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x387:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:2.0:1788201330.094158:0:99108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e365e6f9/0x96d0c9b8c9a1d645 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x385:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907400000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b74 expref: 15 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.094165:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b840617e/0x96d0c9b8c9a1d622 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b58 expref: 15 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.094187:0:99108:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 0000000008eb566b/0x96d0c9b8c9a1d637 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106400000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ba5 expref: 13 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201330.094187:0:6521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38e:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:2.0:1788201330.094207:0:99108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008eb566b/0x96d0c9b8c9a1d637 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x386:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907400000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ba5 expref: 13 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201330.094208:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000279447c9/0x96d0c9b8c9a1d5ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c2a expref: 13 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201330.094235:0:6521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x391:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:3.0:1788201330.094247:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f6d99c0/0x96d0c9b8c9a1d676 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c69 expref: 11 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.094251:0:99108:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1d61b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106400000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b51 expref: 11 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.094290:0:99108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1d61b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x388:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907400000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b51 expref: 10 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201330.094298:0:6521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x393:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:3.0:1788201330.094314:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094a83153/0x96d0c9b8c9a1d65a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c85 expref: 9 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.094323:0:99108:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1d614 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x389:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106400000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bd6 expref: 9 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201330.094335:0:6521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x389:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:3.0:1788201330.094345:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1d614 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907400000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bd6 expref: 8 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201330.094362:0:6521:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38c:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:3.0:1788201330.094371:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1d629 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c15 expref: 7 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.094385:0:99108:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1d606 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106400000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c00 expref: 6 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.094394:0:99108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1d606 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907400000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c00 expref: 6 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.094430:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201330.094440:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc006dbde00/0x96d0c9b8c9a1d58f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1d596 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.094440:0:99108:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000a7227628/0x96d0c9b8c9a1d684 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106400000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c3f expref: 5 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.094459:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbde00 already unused, calling callback (ffffffffc1280c20) 00010000:00010000:2.0:1788201330.094461:0:99108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7227628/0x96d0c9b8c9a1d684 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907400000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c3f expref: 5 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201330.094464:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc006dbde00/0x96d0c9b8c9a1d58f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1d596 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.094475:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc006dbde00/0x96d0c9b8c9a1d58f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1d596 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201330.094483:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc006dbde00/0x96d0c9b8c9a1d58f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1d596 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.094486:0:99108:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 000000003ab5e6bc/0x96d0c9b8c9a1d67d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106400000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c54 expref: 4 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201330.094501:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788201330.094507:0:13349:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788201330.094507:0:99108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ab5e6bc/0x96d0c9b8c9a1d67d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x390:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907400000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c54 expref: 4 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201330.094511:0:13349:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788201330.094535:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc006dbde00/0x96d0c9b8c9a1d58f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1d596 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.094542:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201330.094551:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc006dbde00/0x96d0c9b8c9a1d58f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1d596 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.094557:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc006dbde00/0x96d0c9b8c9a1d58f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1d596 expref: -99 pid: 98552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201330.094566:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201330.094568:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201330.094570:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201330.094577:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201330.094593:0:99108:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: filter-lustre-OST0000_UUID lock: 00000000b5bab93d/0x96d0c9b8c9a1d63e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40106400000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c93 expref: 3 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201330.094603:0:99108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5bab93d/0x96d0c9b8c9a1d63e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x395:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44907400000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c93 expref: 3 pid: 98568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.094634:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201330.095193:0:6521:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc12e642000, canceled 11 locks, left on hash table 0. 00000100:00100000:0.0:1788201330.096114:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715326336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201330.096201:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201330.096266:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201330.096282:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715326208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201330.096307:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201330.096398:0:9535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715326336 00000100:00100000:1.0:1788201330.096406:0:9535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715326336 00000100:00100000:1.0:1788201330.096460:0:9535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715326208 00000100:00100000:1.0:1788201330.096464:0:9535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715326208 00000100:00100000:1.0:1788201330.096491:0:9535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:1.0:1788201330.096499:0:9535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715326336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201330.096512:0:9535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201330.096530:0:9535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc108c75200/0x96d0c9b8c9a1d596 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d58f expref: 24 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.096545:0:9535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201330.096587:0:9535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9b18af6-fecc-4172-82c2-66531890fe11+23:3656:x1875060715326336:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201330.096595:0:9535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00000100:00100000:1.0:1788201330.096615:0:9535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:1.0:1788201330.096622:0:9535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9b18af6-fecc-4172-82c2-66531890fe11+22:3656:x1875060715326208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201330.096630:0:9535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201330.096641:0:9535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140d58c00/0x96d0c9b8c9a1d565 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d55e expref: 22 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201330.096650:0:9535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201330.096683:0:9535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9b18af6-fecc-4172-82c2-66531890fe11+21:3656:x1875060715326208:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201330.096690:0:9535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:1.0:1788201330.096733:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715326208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201330.096741:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715326336:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201330.101392:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201330.101398:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201330.101400:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201330.447217:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201330.644802:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201330.644859:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201330.644901:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201330.644925:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201330.644945:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201330.644973:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695503744 00000100:00100000:0.0:1788201330.644982:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695503744 00000100:00100000:0.0:1788201330.645082:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695503616 00000100:00100000:0.0:1788201330.645086:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695503616 00000100:00100000:0.0:1788201330.645104:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2964 00000100:00100000:0.0:1788201330.645114:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695503744:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201330.645183:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695503744:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 70us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201330.645191:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2964 00000100:00100000:0.0:1788201330.645209:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6043 00000100:00100000:0.0:1788201330.645213:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2403:x1875060695503616:12345-192.168.201.20@tcp:400:kworker.0 00000020:00080000:0.0:1788201330.645219:0:8448:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.20@tcp 00000100:00100000:0.0:1788201330.645242:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2403:x1875060695503616:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (296us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788201330.645249:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6043 00000100:00100000:2.0:1788201330.647173:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695503488 00000100:00100000:2.0:1788201330.647185:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695503488 00000100:00100000:2.0:1788201330.647248:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695503360 00000100:00100000:2.0:1788201330.647274:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695503360 00000100:00100000:2.0:1788201330.647315:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1629 00000100:00100000:2.0:1788201330.647327:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695503488:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201330.647405:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695503488:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 80us (2545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201330.647413:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1629 00000100:00100000:2.0:1788201330.647430:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1630 00000100:00100000:2.0:1788201330.647437:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2403:x1875060695503360:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201330.647460:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2403:x1875060695503360:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (2534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201330.647466:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1630 00000100:00100000:1.0:1788201330.648056:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695503232 00000100:00100000:1.0:1788201330.648063:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695503232 00000100:00100000:1.0:1788201330.648098:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 263 00000100:00100000:1.0:1788201330.648105:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695503232:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201330.648141:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695503232:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 36us (3350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201330.648148:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 263 00000100:00080000:1.0:1788201330.648181:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201330.648185:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201330.648187:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201330.660195:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201330.660354:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695503872 00000100:00100000:2.0:1788201330.660365:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695503872 00000100:00100000:2.0:1788201330.660423:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6044 00000100:00100000:2.0:1788201330.660431:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2399:x1875060695503872:12345-192.168.201.20@tcp:8:ptlrpcd_01_01.0 00010000:02000000:2.0:1788201330.660453:0:26205:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-OST0000: Not available for connect from 192.168.201.20@tcp (stopping) 00000100:00100000:2.0:1788201330.668440:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2399:x1875060695503872:12345-192.168.201.20@tcp:8:ptlrpcd_01_01.0 Request processed in 7997us (8243us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201330.668456:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6044 00000100:00100000:1.0:1788201331.025598:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715326464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201331.025678:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201331.026825:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715326464 00000100:00100000:2.0:1788201331.026835:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715326464 00000100:00100000:2.0:1788201331.026888:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2399 00000100:00100000:2.0:1788201331.026896:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3657:x1875060715326464:12345-0@lo:13:osp-pre-0-1.0 00000020:00080000:2.0:1788201331.026906:0:8451:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788201331.026966:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3657:x1875060715326464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (1287us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788201331.026992:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2399 00000100:02020000:1.0:1788201331.027482:0:3657:0:(client.c:1505:ptlrpc_check_status()) lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1788201331.027487:0:3657:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788201331.027492:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788201331.027497:0:3657:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:1.0:1788201331.027513:0:3657:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:1.0:1788201331.027516:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201331.027520:0:3657:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 4172 00000100:00080000:1.0:1788201331.027528:0:3657:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8dc006d84000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201331.027577:0:3657:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc1333bf800 x1875060715326592/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201331.027617:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715326592:0@lo:8:ptlrpcd_00_02.0 00000100:00100000:1.0:1788201331.027653:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201331.027842:0:26214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715326592 00000100:00100000:2.0:1788201331.027848:0:26214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715326592 00000100:00100000:2.0:1788201331.027880:0:26214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6045 00000100:00100000:2.0:1788201331.027886:0:26214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:3654:x1875060715326592:12345-0@lo:8:ptlrpcd_00_02.0 00010000:02000000:2.0:1788201331.027904:0:26214:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-OST0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788201331.027944:0:26214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:3654:x1875060715326592:12345-0@lo:8:ptlrpcd_00_02.0 Request processed in 56us (290us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201331.027951:0:26214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6045 00000100:00080000:2.0:1788201331.027977:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201331.027981:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201331.027984:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715326592:0@lo:8:ptlrpcd_00_02.0 00010000:00010000:0.0:1788201331.471324:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201331.535716:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715326720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201331.535787:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201331.536526:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715326720 00000100:00100000:2.0:1788201331.536539:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715326720 00000100:00100000:2.0:1788201331.545641:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2400 00000100:00100000:2.0:1788201331.545656:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3658:x1875060715326720:12345-0@lo:13:osp-pre-0-0.0 00000020:00080000:2.0:1788201331.545669:0:8450:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788201331.545794:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3658:x1875060715326720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (10006us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788201331.545801:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2400 00000100:02020000:1.0:1788201331.546032:0:3658:0:(client.c:1505:ptlrpc_check_status()) lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1788201331.546039:0:3658:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788201331.546044:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788201331.546049:0:3658:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:1.0:1788201331.546069:0:3658:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:1.0:1788201331.546082:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201331.546087:0:3658:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 4172 00000100:00080000:1.0:1788201331.546096:0:3658:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dc109815000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201331.546127:0:3658:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc1333bca80 x1875060715326848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201331.546733:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715326848:0@lo:8:ptlrpcd_00_03.0 00000100:00100000:2.0:1788201331.546787:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201331.546899:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715326848 00000100:00100000:1.0:1788201331.546906:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715326848 00000100:00100000:1.0:1788201331.546946:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6046 00000100:00100000:1.0:1788201331.546952:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3654:x1875060715326848:12345-0@lo:8:ptlrpcd_00_03.0 00010000:02000000:1.0:1788201331.546972:0:23974:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-OST0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788201331.547045:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3654:x1875060715326848:12345-0@lo:8:ptlrpcd_00_03.0 Request processed in 91us (258us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201331.547051:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6046 00000100:00080000:2.0:1788201331.547640:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201331.547648:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201331.547652:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715326848:0@lo:8:ptlrpcd_00_03.0 00000100:00100000:1.0:1788201332.047212:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201332.047246:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715326976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201332.047314:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201332.047429:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715326976 00000100:00100000:2.0:1788201332.047442:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715326976 00000100:00100000:2.0:1788201332.047522:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2401 00000100:00100000:2.0:1788201332.047534:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715326976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201332.047563:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201332.047615:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715326976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201332.047622:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2401 00000100:00100000:2.0:1788201332.047664:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715326976:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788201332.047871:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788201332.495223:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201333.532344:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201334.095316:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201334.095344:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715327104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201334.095421:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201334.095578:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715327104 00000100:00100000:0.0:1788201334.095587:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715327104 00000100:00100000:0.0:1788201334.095642:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4153 00000100:00100000:0.0:1788201334.095659:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715327104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201334.095693:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:0.0:1788201334.095758:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715327104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201334.095766:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4153 00000100:00100000:3.0:1788201334.095955:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715327104:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788201334.543218:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201334.607374:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715327232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201334.607465:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201334.607539:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715327232 00000100:00100000:1.0:1788201334.607546:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715327232 00000100:00100000:1.0:1788201334.607591:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4154 00000100:00100000:1.0:1788201334.607600:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715327232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201334.607633:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:1.0:1788201334.607673:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715327232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201334.607680:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4154 00000100:00100000:1.0:1788201334.607723:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715327232:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201334.608136:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715327360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201334.608170:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201334.608262:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715327360 00000100:00100000:3.0:1788201334.608267:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715327360 00000100:00100000:3.0:1788201334.608318:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2402 00000100:00100000:3.0:1788201334.608326:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715327360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201334.608345:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788201334.608397:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715327360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201334.608404:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2402 00000100:00100000:3.0:1788201334.608450:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715327360:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788201334.608705:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201334.609059:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201334.609064:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788201334.609067:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201334.609074:0:57134:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 4182 00000100:00080000:2.0:1788201334.609079:0:57134:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788201334.609084:0:57134:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8dc006d84000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201334.609105:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13f8dad80 x1875060715327872/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201334.609136:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201334.609139:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788201334.609140:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201334.609143:0:57134:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 4183 00000100:00080000:2.0:1788201334.609146:0:57134:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788201334.609150:0:57134:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dc109815000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201334.609163:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc137cece00 x1875060715328384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201334.609272:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715327616:0@lo:400:kworker.0 00000100:00100000:0.0:1788201334.609317:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201334.609342:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715328256:0@lo:400:kworker.0 00000100:00100000:0.0:1788201334.609365:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201334.609387:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788201334.609392:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715327488:0@lo:400:kworker.0 00000100:00100000:0.0:1788201334.609421:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201334.609874:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715327744:0@lo:400:kworker.0 00000100:00100000:1.0:1788201334.609905:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201334.609928:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201334.609933:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715328000:0@lo:400:kworker.0 00000100:00100000:1.0:1788201334.609955:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201334.609984:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715327616 00000100:00100000:1.0:1788201334.609989:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715327616 00000100:00100000:1.0:1788201334.610047:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715327744 00000100:00100000:1.0:1788201334.610051:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715327744 00000100:00100000:1.0:1788201334.610074:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1631 00000100:00100000:1.0:1788201334.610083:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715327616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201334.610121:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715327616:12345-0@lo:400:kworker.0 Request processed in 40us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201334.610127:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1631 00000100:00100000:1.0:1788201334.610163:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1632 00000100:00100000:1.0:1788201334.610170:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715327744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201334.610216:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715327744:12345-0@lo:400:kworker.0 Request processed in 47us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201334.610222:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1632 00000100:00100000:1.0:1788201334.610239:0:26212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715328000 00000100:00100000:1.0:1788201334.610243:0:26212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715328000 00000100:00100000:1.0:1788201334.610267:0:26212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2965 00000100:00100000:1.0:1788201334.610272:0:26212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715328000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201334.610297:0:26212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715328000:12345-0@lo:400:kworker.0 Request processed in 26us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201334.610302:0:26212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2965 00000100:00080000:1.0:1788201334.610322:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201334.610325:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201334.610327:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201334.610348:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715328000:0@lo:400:kworker.0 00000100:00100000:1.0:1788201334.610356:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715327744:0@lo:400:kworker.0 00000100:00100000:1.0:1788201334.610387:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715328256 00000100:00100000:1.0:1788201334.610390:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715328256 00000100:00100000:1.0:1788201334.610411:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4155 00000100:00100000:1.0:1788201334.610415:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715328256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201334.610455:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715328256:12345-0@lo:400:kworker.0 Request processed in 39us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201334.610460:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4155 00000100:00100000:1.0:1788201334.610484:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715327872:0@lo:8:kworker.0 00000100:00100000:1.0:1788201334.610504:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201334.611208:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715328128:0@lo:400:kworker.0 00000100:00100000:0.0:1788201334.611242:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201334.611270:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715327616:0@lo:400:kworker.0 00000100:00100000:0.0:1788201334.611281:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715328256:0@lo:400:kworker.0 00000100:00100000:0.0:1788201334.611321:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715327488 00000100:00100000:0.0:1788201334.611326:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715327488 00000100:00100000:0.0:1788201334.611359:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788201334.611366:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:3656:x1875060715327488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201334.611403:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:3656:x1875060715327488:12345-0@lo:400:kworker.0 Request processed in 38us (1981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201334.611409:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788201334.611450:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715328128 00000100:00100000:0.0:1788201334.611454:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715328128 00000100:00100000:0.0:1788201334.611479:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1633 00000100:00100000:0.0:1788201334.611486:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715328128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201334.611651:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715328512:0@lo:400:kworker.0 00000100:00100000:3.0:1788201334.617139:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715327872 00000100:00100000:3.0:1788201334.617155:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715327872 00000100:00100000:3.0:1788201334.617225:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6047 00000100:00100000:3.0:1788201334.617234:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3654:x1875060715327872:12345-0@lo:8:kworker.0 00010000:02000000:3.0:1788201334.617259:0:8491:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-OST0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788201334.618356:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201334.618419:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715328512 00000100:00100000:2.0:1788201334.618488:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715328512 00000100:00100000:2.0:1788201334.618619:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1634 00000100:00100000:2.0:1788201334.618625:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715328512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201334.618677:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715328512:12345-0@lo:400:kworker.0 Request processed in 53us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201334.618682:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1634 00000100:00100000:2.0:1788201334.618713:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137ceea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715328512:0@lo:400:kworker.0 00000100:00100000:2.0:1788201334.621100:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715327488:0@lo:400:kworker.0 00000100:00100000:2.0:1788201334.621133:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715328128:0@lo:400:kworker.0 00000100:00100000:0.0:1788201334.622059:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715328128:12345-0@lo:400:kworker.0 Request processed in 10568us (10810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201334.622072:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1633 00000100:00100000:1.0:1788201334.628119:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715328384:0@lo:8:kworker.0 00000100:00100000:1.0:1788201334.628191:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201334.628345:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715328384 00000100:00100000:0.0:1788201334.628353:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715328384 00000100:00100000:0.0:1788201334.628400:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6048 00000100:00100000:0.0:1788201334.628408:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3654:x1875060715328384:12345-0@lo:8:kworker.0 00010000:02000000:0.0:1788201334.628429:0:26209:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-OST0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788201334.628492:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3654:x1875060715328384:12345-0@lo:8:kworker.0 Request processed in 84us (300us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201334.628500:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6048 00000100:00080000:2.0:1788201334.628703:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201334.628710:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201334.628714:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715328384:0@lo:8:kworker.0 00000100:00100000:3.0:1788201334.629569:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3654:x1875060715327872:12345-0@lo:8:kworker.0 Request processed in 12331us (19059us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201334.629579:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6047 00000100:00080000:2.0:1788201334.631626:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201334.631639:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201334.631643:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715327872:0@lo:8:kworker.0 00010000:00010000:0.0:1788201335.567271:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788201335.632678:0:98553:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788201335.632688:0:98553:0:(genops.c:885:class_export_put()) final put ffff8dc13f869000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788201335.632764:0:98553:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201335.632767:0:98553:0:(genops.c:885:class_export_put()) final put ffff8dc12e640000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201335.635602:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13f869000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788201335.636072:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc120723000 for lustre-OST0000 00000001:00100000:2.0:1788201335.636223:0:98553:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:2.0:1788201335.636244:0:98553:0:(genops.c:885:class_export_put()) final put ffff8dc12e642000/6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:0.0:1788201335.637913:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12e640000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788201335.637962:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12e642000/6e293f14-c501-4bc5-9dd4-a18ef02756b4 for lustre-OST0000 00000020:00000080:0.0:1788201335.637993:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc005208800 for lustre-OST0000 00000020:00000080:0.0:1788201335.637997:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc120727000 for lustre-OST0000 00000100:00100000:0.0:1788201335.766749:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201335.766856:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201335.766889:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201335.766947:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695504128 00000100:00100000:3.0:1788201335.766967:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695504128 00000100:00100000:3.0:1788201335.767078:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1635 00000100:00100000:3.0:1788201335.767089:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2403:x1875060695504128:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201335.767164:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2403:x1875060695504128:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 78us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201335.767171:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1635 00000100:00080000:2.0:1788201335.772205:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201335.774306:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201335.774338:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201335.774363:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695504256 00000100:00100000:0.0:1788201335.774373:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695504256 00000100:00100000:0.0:1788201335.774454:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1636 00000100:00100000:0.0:1788201335.774465:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695504256:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201335.774703:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695504000 00000100:00100000:3.0:1788201335.774708:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695504000 00000100:00100000:3.0:1788201335.774756:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 265 00000100:00100000:3.0:1788201335.774765:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695504000:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201335.774822:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695504000:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 58us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201335.774829:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 265 00000100:00080000:3.0:1788201335.774888:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201335.775345:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695504256:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 880us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201335.775354:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1636 00000100:00100000:1.0:1788201335.778927:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695504384 00000100:00100000:1.0:1788201335.778944:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695504384 00000100:00100000:1.0:1788201335.779679:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695504512 00000100:00100000:1.0:1788201335.779685:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695504512 00000100:00100000:2.0:1788201335.779797:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2966 00000100:00100000:2.0:1788201335.779812:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695504512:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201335.779895:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695504512:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 87us (13004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201335.779902:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2966 00000100:00100000:2.0:1788201335.779923:0:26199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6049 00000100:00100000:2.0:1788201335.779928:0:26199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2399:x1875060695504384:12345-192.168.201.20@tcp:8:kworker.0 00010000:02000000:2.0:1788201335.779947:0:26199:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-OST0000: Not available for connect from 192.168.201.20@tcp (stopping) 00000100:00100000:2.0:1788201335.779988:0:26199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2399:x1875060695504384:12345-192.168.201.20@tcp:8:kworker.0 Request processed in 59us (13261us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201335.779996:0:26199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6049 00000100:00080000:0.0:1788201335.780050:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:01000000:0.0:1788201336.150454:0:99108:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc12f2f3e40 - data ffff8dc133943a20/ffff8dc001e57c00 00000020:01000000:0.0:1788201336.150708:0:99108:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc005a2a060 - data ffff8dc00201f1b0/ffff8dc004c3c800 00100000:10000000:0.0:1788201336.162196:0:99108:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788201336.172397:0:99108:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d573 00000020:00000080:1.0:1788201336.172412:0:99108:0:(genops.c:885:class_export_put()) final put ffff8dc13f86d800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788201336.172430:0:99108:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc12b6b8000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788201336.172435:0:99108:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc12b6b8000 2 00000020:01000004:1.0:1788201336.172439:0:99108:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dc12b6b8000 from lustre-OST0000 00000020:00000080:1.0:1788201336.172482:0:99108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201336.172500:0:99108:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788201336.172504:0:99108:0:(genops.c:885:class_export_put()) final put ffff8dc001e2e000/lustre-OST0000_UUID 00000020:00000080:1.0:1788201336.172508:0:99108:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc001e2e000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788201336.172517:0:99108:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:2.0:1788201336.172719:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13f86d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:1.0:1788201336.172778:0:99108:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:1.0:1788201336.172784:0:99108:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788201336.172788:0:99108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201336.172798:0:99108:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788201336.172806:0:99108:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8dc103486800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201336.172814:0:99108:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8dc12ef60000) has exports, disconnecting them 00000020:00080000:1.0:1788201336.172821:0:99108:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8dc103486800), last request at 1788201318 00000020:00000080:1.0:1788201336.172826:0:99108:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d5b2 00000020:00080000:1.0:1788201336.172838:0:99108:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc103486800): rc 0 00000020:00000080:1.0:1788201336.172843:0:99108:0:(genops.c:885:class_export_put()) final put ffff8dc103486800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788201336.173007:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc103486800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788201336.175794:0:99108:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788201336.175806:0:99108:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201336.175814:0:99108:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788201336.175823:0:99108:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788201336.175866:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc11077f800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788201336.176115:0:99108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201336.176132:0:99108:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788201336.176140:0:99108:0:(genops.c:885:class_export_put()) final put ffff8dc120725000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788201336.176145:0:99108:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc120725000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788201336.176153:0:99108:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788201336.176274:0:99108:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788201336.176295:0:99108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201336.176303:0:99108:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788201336.176313:0:99108:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8dc11ccfc800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788201336.176320:0:99108:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8dc12f308000) has exports, disconnecting them 00000020:00080000:2.0:1788201336.176325:0:99108:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8dc11ccfc800), last request at 1788201318 00000020:00000080:2.0:1788201336.176329:0:99108:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d5c7 00000020:00080000:2.0:1788201336.176347:0:99108:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc11ccfc800): rc 0 00000020:00000080:2.0:1788201336.176352:0:99108:0:(genops.c:885:class_export_put()) final put ffff8dc11ccfc800/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788201336.176390:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11ccfc800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788201336.177248:0:99108:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788201336.177257:0:99108:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788201336.177261:0:99108:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788201336.177269:0:99108:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788201336.178721:0:99108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201336.178738:0:99108:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788201336.178749:0:99108:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc12b6b8000 1 00000020:00000080:3.0:1788201336.178757:0:99108:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d557 00000020:00000080:3.0:1788201336.178767:0:99108:0:(genops.c:885:class_export_put()) final put ffff8dc005fac000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788201336.178776:0:99108:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788201336.178784:0:99108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201336.178789:0:99108:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788201336.178793:0:99108:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8dc139bb8000) has no exports 00000020:00000080:3.0:1788201336.192529:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc001db5800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788201336.192546:0:76267:0:(genops.c:885:class_export_put()) final put ffff8dc11ccff000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788201336.192549:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11ccff000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788201336.192562:0:76267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788201336.194287:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005fac000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788201336.297963:0:99108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201336.297989:0:99108:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788201336.297997:0:99108:0:(genops.c:885:class_export_put()) final put ffff8dc12b6bf000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788201336.298003:0:99108:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12b6bf000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788201336.298045:0:99108:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788201336.298205:0:99108:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dc12b6bb000 00000020:02000400:2.0:1788201336.298570:0:99108:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788201336.594730:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201337.178345:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715328640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201337.178456:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201337.178571:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715328640 00000100:00100000:0.0:1788201337.178584:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715328640 00000100:00100000:0.0:1788201337.178672:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2403 00000100:00100000:0.0:1788201337.178686:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715328640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201337.178724:0:8450:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788201337.178786:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715328640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201337.178794:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2403 00000100:00080000:1.0:1788201337.178853:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201337.178906:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715328640:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788201337.620542:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201338.639235:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201339.215266:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201339.215291:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715328768:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201339.215364:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201339.215477:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715328768 00000100:00100000:1.0:1788201339.215487:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715328768 00000100:00100000:1.0:1788201339.215552:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4156 00000100:00100000:1.0:1788201339.215561:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715328768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201339.215595:0:8457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:1.0:1788201339.215649:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715328768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201339.215656:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4156 00000100:00100000:0.0:1788201339.215741:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715328768:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788201339.664051:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201339.727314:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201339.727339:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715328896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201339.727408:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201339.727549:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715328896 00000100:00100000:2.0:1788201339.727557:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715328896 00000100:00100000:2.0:1788201339.727622:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2404 00000100:00080000:1.0:1788201339.727655:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201339.727682:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715328896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201339.727712:0:10112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788201339.727776:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715328896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201339.727835:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715328896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201339.728093:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715329024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201339.728137:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201339.728170:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715329024 00000100:00100000:1.0:1788201339.728174:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715329024 00000100:00100000:1.0:1788201339.728201:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4157 00000100:00100000:1.0:1788201339.728208:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715329024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201339.728244:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:1.0:1788201339.728280:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715329024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201339.728287:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4157 00000100:00100000:1.0:1788201339.728323:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715329024:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788201339.734581:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201339.734588:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788201339.734592:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201339.734600:0:76267:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 4186 00000100:00080000:1.0:1788201339.734605:0:76267:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201339.734613:0:76267:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8dc006d84000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201339.734636:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc1333bf100 x1875060715329536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201339.734678:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201339.734682:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788201339.734684:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201339.734688:0:76267:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 4186 00000100:00080000:1.0:1788201339.734691:0:76267:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201339.734694:0:76267:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dc109815000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201339.734707:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc007c35880 x1875060715330048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201339.734823:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715329408:0@lo:400:kworker.0 00000100:00100000:1.0:1788201339.734892:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201339.734930:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715330176:0@lo:400:kworker.0 00000100:00100000:1.0:1788201339.734953:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201339.734976:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715329408 00000100:00100000:1.0:1788201339.734984:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788201339.734986:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715329408 00000100:00100000:1.0:1788201339.734992:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715329280:0@lo:400:kworker.0 00000100:00100000:1.0:1788201339.735037:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201339.735061:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715329920:0@lo:400:kworker.0 00000100:00100000:0.0:1788201339.735065:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715330176 00000100:00100000:0.0:1788201339.735069:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715330176 00000100:00100000:0.0:1788201339.735091:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715329280 00000100:00100000:0.0:1788201339.735095:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715329280 00000100:00100000:1.0:1788201339.735114:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201339.735133:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1637 00000100:00100000:0.0:1788201339.735144:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715329408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201339.735155:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1638 00000100:00100000:1.0:1788201339.735166:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715330176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201339.735213:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715329408:12345-0@lo:400:kworker.0 Request processed in 71us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201339.735222:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1637 00000100:00100000:0.0:1788201339.735239:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1639 00000100:00100000:0.0:1788201339.735246:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715329280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201339.735276:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715329280:12345-0@lo:400:kworker.0 Request processed in 31us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201339.735282:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1639 00000100:00100000:1.0:1788201339.735478:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715330176:12345-0@lo:400:kworker.0 Request processed in 52us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201339.735485:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1638 00000100:00100000:1.0:1788201339.735512:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715329920 00000100:00100000:1.0:1788201339.735516:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715329920 00000100:00100000:1.0:1788201339.735547:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4158 00000100:00100000:1.0:1788201339.735554:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715329920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201339.735587:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715329920:12345-0@lo:400:kworker.0 Request processed in 34us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201339.735593:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4158 00000100:00080000:1.0:1788201339.735610:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201339.735615:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201339.735629:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715329664:0@lo:400:kworker.0 00000100:00100000:1.0:1788201339.735656:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201339.735693:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788201339.735699:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715329664 00000100:00100000:1.0:1788201339.735700:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715329152:0@lo:400:kworker.0 00000100:00100000:0.0:1788201339.735707:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715329664 00000100:00100000:0.0:1788201339.735754:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2967 00000100:00100000:0.0:1788201339.735761:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715329664:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788201339.735814:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201339.735841:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2404 00000100:00100000:2.0:1788201339.735865:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715329536:0@lo:8:kworker.0 00000100:00100000:0.0:1788201339.736494:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715329664:12345-0@lo:400:kworker.0 Request processed in 732us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201339.736502:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2967 00000100:00100000:1.0:1788201339.736872:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201339.736971:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715329152 00000100:00100000:0.0:1788201339.736977:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715329152 00000100:00100000:0.0:1788201339.737089:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788201339.737120:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:3657:x1875060715329152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201339.737165:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:3657:x1875060715329152:12345-0@lo:400:kworker.0 Request processed in 60us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201339.737172:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788201339.741142:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715329280:0@lo:400:kworker.0 00000100:00100000:0.0:1788201339.741161:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715329920:0@lo:400:kworker.0 00000100:00100000:0.0:1788201339.741172:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715329408:0@lo:400:kworker.0 00000100:00100000:0.0:1788201339.741183:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715330176:0@lo:400:kworker.0 00000100:00100000:2.0:1788201339.741713:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201339.742899:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715329152:0@lo:400:kworker.0 00000100:00100000:1.0:1788201339.742913:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715329792:0@lo:400:kworker.0 00000100:00100000:1.0:1788201339.742967:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201339.743004:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715329792 00000100:00100000:1.0:1788201339.743010:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715329792 00000100:00100000:1.0:1788201339.743072:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1640 00000100:00100000:1.0:1788201339.743089:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715329792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201339.743149:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715329792:12345-0@lo:400:kworker.0 Request processed in 61us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201339.743157:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1640 00000100:00100000:1.0:1788201339.743195:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715329792:0@lo:400:kworker.0 00000100:00100000:1.0:1788201339.743209:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715329664:0@lo:400:kworker.0 00000100:00100000:2.0:1788201339.743840:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715330048:0@lo:8:kworker.0 00000100:00100000:2.0:1788201339.743875:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201339.744126:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715329536 00000100:00100000:0.0:1788201339.744133:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715329536 00000100:00100000:0.0:1788201339.744168:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715330048 00000100:00100000:0.0:1788201339.744171:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715330048 00000100:00100000:0.0:1788201339.744190:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6050 00000100:00100000:0.0:1788201339.744196:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3654:x1875060715329536:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788201339.744217:0:8449:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201339.744261:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3654:x1875060715329536:12345-0@lo:8:kworker.0 Request processed in 63us (2549us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201339.744268:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6050 00000100:00100000:0.0:1788201339.744281:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6051 00000100:00100000:0.0:1788201339.744285:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3654:x1875060715330048:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788201339.744294:0:8449:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201339.744323:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3654:x1875060715330048:12345-0@lo:8:kworker.0 Request processed in 37us (448us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201339.744329:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6051 00000100:00080000:2.0:1788201339.748468:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201339.748482:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201339.748487:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715329536:0@lo:8:kworker.0 00000100:00080000:2.0:1788201339.748502:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201339.748506:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201339.748509:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715330048:0@lo:8:kworker.0 00000020:01000004:3.0:1788201340.339530:0:99310:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788201340.368069:0:99310:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788201340.368132:0:99310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adf800/0x96d0c9b8c9a1ca83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca8a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201340.368145:0:99310:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adf800/0x96d0c9b8c9a1ca83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ca8a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201340.368152:0:99310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adf800/0x96d0c9b8c9a1ca83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ca8a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201340.368160:0:99310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc007adf800/0x96d0c9b8c9a1ca83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ca8a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201340.368285:0:99310:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788201340.368292:0:99310:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788201340.368317:0:99310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201340.368322:0:99310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788201340.368327:0:99310:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788201340.368348:0:99310:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788201340.368428:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715330304:0@lo:39:umount.0 00000100:00100000:2.0:1788201340.368499:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201340.368649:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715330304 00000100:00100000:0.0:1788201340.368657:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715330304 00000100:00100000:0.0:1788201340.368724:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1611 00000100:00100000:0.0:1788201340.368734:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875060715330304:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788201340.368760:0:66312:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c6d2 00000100:00080000:0.0:1788201340.368768:0:66312:0:(import.c:65:import_set_state_nolock()) ffff8dc11d63f000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788201340.369062:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201340.369069:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc007adf800/0x96d0c9b8c9a1ca83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1ca8a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201340.369078:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf800 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:3.0:1788201340.369081:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc007adf800/0x96d0c9b8c9a1ca83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1ca8a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201340.369090:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007adf800/0x96d0c9b8c9a1ca83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1ca8a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201340.369118:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007adf800/0x96d0c9b8c9a1ca83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1ca8a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201340.369124:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788201340.369126:0:24979:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788201340.369128:0:24979:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788201340.369153:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc007adf800/0x96d0c9b8c9a1ca83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ca8a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201340.369159:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201340.369176:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc007adf800/0x96d0c9b8c9a1ca83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ca8a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201340.369182:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007adf800/0x96d0c9b8c9a1ca83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ca8a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201340.369191:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201340.369193:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201340.369195:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201340.369217:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201340.369227:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715330432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201340.369264:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201340.369303:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715330432 00000100:00100000:3.0:1788201340.369307:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715330432 00000100:00100000:3.0:1788201340.369340:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:3.0:1788201340.369347:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+21:3658:x1875060715330432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201340.369357:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201340.369371:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fd200/0x96d0c9b8c9a1ca8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca83 expref: 21 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201340.369388:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201340.369432:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+20:3658:x1875060715330432:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201340.369439:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:1.0:1788201340.369523:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715330432:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201340.369649:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201340.372575:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+1:3654:x1875060715330304:12345-0@lo:39:umount.0 Request processed in 3834us (4068us total) trans 0 rc 0/0 00000100:00080000:2.0:1788201340.372575:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788201340.372587:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1611 00000020:00000080:1.0:1788201340.372604:0:66312:0:(genops.c:885:class_export_put()) final put ffff8dc11cdda800/lustre-MDT0000-lwp-OST0001_UUID 00000100:00100000:2.0:1788201340.372635:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715330304:0@lo:39:umount.0 00000020:00000080:3.0:1788201340.372664:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11cdda800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788201340.372713:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc11d63f000 for lustre-MDT0000 00000100:00080000:0.0:1788201340.372797:0:99310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201340.372801:0:99310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788201340.372806:0:99310:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788201340.374133:0:99310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788201340.374139:0:99310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788201340.374145:0:99310:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788201340.374164:0:99310:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f2000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788201340.374271:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715330560:0@lo:39:umount.0 00000100:00100000:2.0:1788201340.374321:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201340.374363:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715330560 00000100:00100000:1.0:1788201340.374371:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715330560 00000100:00100000:1.0:1788201340.374417:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1612 00000100:00100000:1.0:1788201340.374425:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875060715330560:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788201340.374514:0:66757:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1644d 00000100:00080000:1.0:1788201340.374524:0:66757:0:(import.c:65:import_set_state_nolock()) ffff8dc12f3a4800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788201340.374552:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201340.374580:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+1:3654:x1875060715330560:12345-0@lo:39:umount.0 Request processed in 155us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201340.374587:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1612 00000100:00080000:2.0:1788201340.374604:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc0034f2000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:1.0:1788201340.374609:0:66757:0:(genops.c:885:class_export_put()) final put ffff8dc10558f000/lustre-MDT0001-lwp-OST0001_UUID 00000100:00100000:2.0:1788201340.374622:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715330560:0@lo:39:umount.0 00000100:00080000:3.0:1788201340.374669:0:99310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788201340.374672:0:99310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788201340.374675:0:99310:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788201340.374794:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc10558f000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1788201340.375239:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc12f3a4800 for lustre-MDT0001 00010000:00010000:3.0:1788201340.376183:0:99310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1ca91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca98 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201340.376267:0:99310:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1ca91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ca98 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201340.376275:0:99310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1ca91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ca98 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201340.376282:0:99310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1ca91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ca98 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201340.376345:0:99310:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201340.376354:0:99310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c670 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c677 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201340.376360:0:99310:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c670 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c677 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201340.376380:0:99310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c670 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1c677 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201340.376386:0:99310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c670 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1c677 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201340.376420:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201340.376427:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1ca91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1ca98 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201340.376434:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fd000 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201340.376438:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1ca91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1ca98 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201340.376446:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1ca91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1ca98 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201340.376453:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1ca91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1ca98 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201340.376458:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201340.376460:0:6520:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1788201340.376489:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1ca91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ca98 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201340.376495:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201340.376528:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1ca91 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ca98 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201340.376534:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0078fd000/0x96d0c9b8c9a1ca91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ca98 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201340.376547:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201340.376550:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c670 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1c677 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201340.376555:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782dc00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201340.376564:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c670 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1c677 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201340.376571:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c670 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1c677 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201340.376577:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c670 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1c677 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201340.376583:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788201340.376585:0:6520:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788201340.376597:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c670 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c677 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201340.376603:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201340.376618:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c670 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c677 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201340.376625:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201340.376627:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201340.376629:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201340.376643:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715330816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201340.376734:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715330688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201340.376991:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201340.377215:0:99310:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201340.377221:0:99310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc00782dc00/0x96d0c9b8c9a1c670 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c677 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201340.377232:0:99310:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788201340.377237:0:99310:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788201340.377240:0:99310:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788201340.377286:0:99310:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788201340.377291:0:99310:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788201340.377296:0:99310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201340.377303:0:99310:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 3/7 00000020:00080000:3.0:1788201340.377310:0:99310:0:(genops.c:1819:print_export_data()) lustre-OST0001: ACTIVE ffff8dc1401c6800 6e293f14-c501-4bc5-9dd4-a18ef02756b4 192.168.201.20@tcp 6 (0 0 2) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201340.377317:0:99310:0:(genops.c:1819:print_export_data()) lustre-OST0001: ACTIVE ffff8dc0059d1800 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294969457 stale:0 00000020:00080000:3.0:1788201340.377321:0:99310:0:(genops.c:1819:print_export_data()) lustre-OST0001: ACTIVE ffff8dc1201ce800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294969442 stale:0 00000020:00080000:3.0:1788201340.377325:0:99310:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff8dc139bbcd28) has exports, disconnecting them 00000020:00080000:3.0:1788201340.377329:0:99310:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0001: disconnecting export at 192.168.201.20@tcp (ffff8dc1401c6800), last request at 1788201335 00000020:00000080:3.0:1788201340.377334:0:99310:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c8e6 00000020:00010000:3.0:1788201340.377342:0:99310:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc1401c6800: total 0 00000100:00080000:3.0:1788201340.377346:0:99310:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788201340.377413:0:9535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715330816 00000100:00100000:1.0:1788201340.377421:0:9535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715330816 00000100:00100000:1.0:1788201340.377477:0:9535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:1.0:1788201340.377486:0:9535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9b18af6-fecc-4172-82c2-66531890fe11+20:3655:x1875060715330816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201340.377499:0:9535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201340.377514:0:9535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782c600/0x96d0c9b8c9a1c677 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c670 expref: 20 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1788201340.377514:0:24979:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc1401c6800: total 0 00010000:00010000:1.0:1788201340.377525:0:9535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201340.377555:0:24979:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc1401c6800, canceled 0 locks, left on hash table 2. 00000100:00100000:1.0:1788201340.377568:0:9535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9b18af6-fecc-4172-82c2-66531890fe11+19:3655:x1875060715330816:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201340.377575:0:9535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00010000:00010000:2.0:1788201340.377596:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e992bbc1/0x96d0c9b8c9a1c99c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78696e expref: 6 pid: 26210 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201340.377601:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201340.377627:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1c94f lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786952 expref: 5 pid: 26203 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201340.377632:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715330688 00000100:00100000:1.0:1788201340.377637:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715330688 00010000:00010000:2.0:1788201340.377655:0:24979:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc1401c6800, canceled 2 locks, left on hash table 0. 00000100:00100000:1.0:1788201340.377658:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00000100:00100000:1.0:1788201340.377664:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10a224850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+19:3658:x1875060715330688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201340.377670:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201340.377678:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00896b000/0x96d0c9b8c9a1ca98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca91 expref: 19 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201340.377686:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201340.377711:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10a224850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+18:3658:x1875060715330688:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201340.377717:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000100:00100000:0.0:1788201340.377730:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715330816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201340.377776:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715330688:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1788201340.378520:0:99310:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969457 00010000:00010000:1.0:1788201340.378577:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788201340.378622:0:99310:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.201.20@tcp (ffff8dc1401c6800): rc 0 00000020:00080000:3.0:1788201340.378633:0:99310:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0001: disconnecting export at 0@lo (ffff8dc0059d1800), last request at 1788201339 00000020:00000080:3.0:1788201340.378638:0:99310:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c5ba 00000100:00080000:3.0:1788201340.378644:0:99310:0:(import.c:65:import_set_state_nolock()) ffff8dc005d75800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788201340.379349:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201340.379353:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788201340.379410:0:99310:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969457 00000020:00080000:3.0:1788201340.379452:0:99310:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc0059d1800): rc 0 00000020:00080000:3.0:1788201340.379456:0:99310:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0001: disconnecting export at 0@lo (ffff8dc1201ce800), last request at 1788201339 00000020:00000080:3.0:1788201340.379460:0:99310:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a163d6 00000100:00080000:3.0:1788201340.379466:0:99310:0:(import.c:65:import_set_state_nolock()) ffff8dc1201cc800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788201340.379823:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201340.379944:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788201340.380048:0:99310:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969457 00000020:00080000:3.0:1788201340.380087:0:99310:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc1201ce800): rc 0 00000020:00080000:3.0:1788201340.380120:0:99310:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8dc139bbcd28) has no exports 00010000:00010000:0.0:1788201340.381137:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201340.687328:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201340.887435:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201340.887490:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201340.887531:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201340.887565:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201340.887611:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695504896 00000100:00100000:3.0:1788201340.887612:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201340.887622:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695504896 00000100:00100000:3.0:1788201340.887639:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695504768 00000100:00100000:3.0:1788201340.887645:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695504768 00000100:00100000:0.0:1788201340.887729:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695504640 00000100:00100000:0.0:1788201340.887734:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695504640 00000100:00100000:0.0:1788201340.887780:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 267 00000100:00100000:2.0:1788201340.887781:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1641 00000100:00100000:0.0:1788201340.887794:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695504640:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201340.887797:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2402:x1875060695504768:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201340.887946:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2402:x1875060695504768:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 154us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201340.887947:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1642 00000100:00100000:2.0:1788201340.887958:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1641 00000100:00100000:3.0:1788201340.887963:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2402:x1875060695504896:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201340.888049:0:26208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695505024 00000100:00080000:2.0:1788201340.888053:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201340.888055:0:26208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695505024 00000100:00080000:2.0:1788201340.888059:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201340.888071:0:23974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695505152 00000100:00100000:2.0:1788201340.888076:0:23974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695505152 00000100:00100000:1.0:1788201340.888097:0:26208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6052 00000100:00100000:1.0:1788201340.888104:0:26208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:2399:x1875060695505024:12345-192.168.201.20@tcp:8:kworker.0 00010000:00020000:1.0:1788201340.888124:0:26208:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201340.888134:0:23974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6053 00000100:00100000:2.0:1788201340.888140:0:23974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2402:x1875060695505152:12345-192.168.201.20@tcp:400:kworker.0 00000020:00080000:2.0:1788201340.888147:0:23974:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.20@tcp 00000100:00100000:0.0:1788201340.888458:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695504640:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 666us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201340.888466:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 267 00000100:00100000:1.0:1788201340.904869:0:26208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:2399:x1875060695505024:12345-192.168.201.20@tcp:8:kworker.0 Request processed in 16751us (17433us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201340.904885:0:26208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6052 00000100:00100000:3.0:1788201340.906376:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2402:x1875060695504896:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 18410us (18836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201340.906390:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1642 00000100:00100000:2.0:1788201340.908334:0:23974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2402:x1875060695505152:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 20184us (20713us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788201340.908348:0:23974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6053 00000100:00100000:0.0:1788201340.919098:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201340.919235:0:26211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695505280 00000100:00100000:1.0:1788201340.919246:0:26211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695505280 00000100:00100000:1.0:1788201340.919305:0:26211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6054 00000100:00100000:1.0:1788201340.919315:0:26211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2399:x1875060695505280:12345-192.168.201.20@tcp:8:ptlrpcd_01_00.0 00010000:02000000:1.0:1788201340.919339:0:26211:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-OST0001: Not available for connect from 192.168.201.20@tcp (stopping) 00000100:00100000:0.0:1788201340.932180:0:26211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2399:x1875060695505280:12345-192.168.201.20@tcp:8:ptlrpcd_01_00.0 Request processed in 12857us (13096us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201340.932195:0:26211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6054 00010000:00010000:0.0:1788201341.711318:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201342.291756:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201342.291783:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715330944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201342.291871:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201342.292627:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715330944 00000100:00100000:0.0:1788201342.292636:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715330944 00000100:00100000:0.0:1788201342.292684:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2405 00000100:00100000:0.0:1788201342.292692:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12580b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3655:x1875060715330944:12345-0@lo:13:osp-pre-1-1.0 00000020:00080000:0.0:1788201342.292701:0:8451:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788201342.292759:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12580b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3655:x1875060715330944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (887us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788201342.292766:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2405 00000100:02020000:1.0:1788201342.292972:0:3655:0:(client.c:1505:ptlrpc_check_status()) lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1788201342.292978:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0001-osc-MDT0001 of lustre-OST0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788201342.292982:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc1031f8800 lustre-OST0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788201342.292986:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:1.0:1788201342.293002:0:3655:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:1.0:1788201342.293005:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc1031f8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201342.293052:0:3655:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 3184 00000100:00080000:1.0:1788201342.293058:0:3655:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8dc1031f8800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201342.293092:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc125808000 x1875060715331072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201342.293338:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715331072:0@lo:8:ptlrpcd_00_00.0 00000100:00100000:3.0:1788201342.293380:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201342.294390:0:26209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715331072 00000100:00100000:1.0:1788201342.294399:0:26209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715331072 00000100:00100000:1.0:1788201342.294443:0:26209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6055 00000100:00100000:1.0:1788201342.294449:0:26209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3654:x1875060715331072:12345-0@lo:8:ptlrpcd_00_00.0 00010000:02000000:1.0:1788201342.294471:0:26209:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-OST0001: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788201342.294527:0:26209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3654:x1875060715331072:12345-0@lo:8:ptlrpcd_00_00.0 Request processed in 76us (1145us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201342.294533:0:26209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6055 00000100:00080000:3.0:1788201342.294619:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1031f8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201342.294624:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201342.294638:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715331072:0@lo:8:ptlrpcd_00_00.0 00010000:00010000:2.0:1788201342.736252:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201343.759239:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201344.335433:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201344.335453:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715331200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201344.335530:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201344.336107:0:83817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715331200 00000100:00100000:1.0:1788201344.336116:0:83817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715331200 00000100:00100000:1.0:1788201344.336176:0:83817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4159 00000100:00100000:1.0:1788201344.336186:0:83817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715331200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201344.336219:0:83817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:1.0:1788201344.336282:0:83817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715331200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201344.336289:0:83817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4159 00000100:00100000:3.0:1788201344.337496:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715331200:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788201344.783319:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201344.847342:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:1.0:1788201344.847349:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201344.847355:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788201344.847359:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1788201344.847363:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715331584:0@lo:400:kworker.0 00000100:00080000:1.0:1788201344.847368:0:57134:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 4191 00000100:00080000:1.0:1788201344.847374:0:57134:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788201344.847382:0:57134:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8dc006d84000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201344.847423:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12580ad80 x1875060715331712/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201344.847430:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201344.847449:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201344.847453:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788201344.847457:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc1031f8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201344.847462:0:57134:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4193 00000100:00080000:1.0:1788201344.847465:0:57134:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788201344.847469:0:57134:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8dc1031f8800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201344.847475:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715331456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201344.847483:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc125808a80 x1875060715331840/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201344.847508:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201344.847510:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201344.847515:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788201344.847516:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201344.847521:0:57134:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 4191 00000100:00080000:1.0:1788201344.847524:0:57134:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788201344.847528:0:57134:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dc109815000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201344.847541:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12580a680 x1875060715332224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201344.847553:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715331584 00000100:00100000:3.0:1788201344.847565:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715331584 00000100:00100000:3.0:1788201344.847619:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4160 00000100:00100000:1.0:1788201344.847623:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12580b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715332352:0@lo:400:kworker.0 00000100:00100000:3.0:1788201344.847632:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715331584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201344.847661:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201344.847699:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715331584:12345-0@lo:400:kworker.0 Request processed in 69us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201344.847705:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12580aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715331968:0@lo:400:kworker.0 00000100:00100000:3.0:1788201344.847710:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4160 00000100:00100000:1.0:1788201344.847736:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201344.847741:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12580ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715331712:0@lo:8:kworker.0 00000100:00100000:1.0:1788201344.847760:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788201344.847769:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12580a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715331328:0@lo:400:kworker.0 00000100:00100000:3.0:1788201344.847782:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201344.847810:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715331840:0@lo:8:kworker.0 00000100:00100000:1.0:1788201344.847816:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201344.847843:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201344.847852:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715332096:0@lo:400:kworker.0 00000100:00100000:3.0:1788201344.847867:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12580a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715332224:0@lo:8:kworker.0 00000100:00100000:1.0:1788201344.847885:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201344.847900:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201344.847921:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715331328 00000100:00100000:1.0:1788201344.847926:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715331328 00000100:00100000:3.0:1788201344.847941:0:10112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715331456 00000100:00100000:3.0:1788201344.847947:0:10112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715331456 00000100:00100000:1.0:1788201344.847957:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788201344.847967:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+18:3657:x1875060715331328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201344.847982:0:10112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2406 00000100:00100000:3.0:1788201344.847988:0:10112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3656:x1875060715331456:12345-0@lo:13:osp-pre-1-0.0 00000020:00080000:3.0:1788201344.847994:0:10112:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788201344.848056:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+18:3657:x1875060715331328:12345-0@lo:400:kworker.0 Request processed in 91us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201344.848063:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788201344.848077:0:10112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3656:x1875060715331456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (568us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788201344.848085:0:10112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2406 00000100:00100000:1.0:1788201344.848099:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715331712 00000100:00100000:1.0:1788201344.848104:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715331712 00000100:00100000:3.0:1788201344.848110:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715332096 00000100:00100000:3.0:1788201344.848116:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715332096 00000100:00100000:1.0:1788201344.848125:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715331840 00000100:00100000:1.0:1788201344.848130:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715331840 00000100:00100000:1.0:1788201344.848146:0:26210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715332224 00000100:00100000:1.0:1788201344.848148:0:26210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715332224 00000100:00100000:1.0:1788201344.848165:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6056 00000100:00100000:1.0:1788201344.848170:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3654:x1875060715331712:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788201344.848191:0:26210:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201344.848201:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4161 00000100:00100000:3.0:1788201344.848210:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125808e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715332096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201344.848227:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3654:x1875060715331712:12345-0@lo:8:kworker.0 Request processed in 55us (447us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201344.848234:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6056 00000100:00100000:1.0:1788201344.848251:0:26210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6057 00000100:00100000:3.0:1788201344.848256:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125808e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715332096:12345-0@lo:400:kworker.0 Request processed in 45us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201344.848261:0:26210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3654:x1875060715331840:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788201344.848269:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4161 00010000:02000000:1.0:1788201344.848275:0:26210:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-OST0001: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788201344.848297:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6058 00000100:00100000:1.0:1788201344.848305:0:26210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3654:x1875060715331840:12345-0@lo:8:kworker.0 Request processed in 43us (461us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201344.848305:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3654:x1875060715332224:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788201344.848322:0:8491:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201344.848330:0:26210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6057 00000100:00100000:3.0:1788201344.848357:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3654:x1875060715332224:12345-0@lo:8:kworker.0 Request processed in 52us (458us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201344.848364:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6058 00000100:00080000:1.0:1788201344.848375:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201344.848381:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201344.848385:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12580ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715331712:0@lo:8:kworker.0 00000100:00080000:1.0:1788201344.848398:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1031f8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201344.848401:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201344.848405:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715331840:0@lo:8:kworker.0 00000100:00100000:3.0:1788201344.848411:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715331584:0@lo:400:kworker.0 00000100:00080000:1.0:1788201344.848418:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201344.848423:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201344.848430:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12580a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715332224:0@lo:8:kworker.0 00000100:02020000:3.0:1788201344.848430:0:3656:0:(client.c:1505:ptlrpc_check_status()) lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1788201344.848440:0:3656:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0001-osc-MDT0000 of lustre-OST0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788201344.848445:0:3656:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f0800 lustre-OST0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788201344.848449:0:3656:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:3.0:1788201344.848461:0:3656:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00100000:1.0:1788201344.848467:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715332352 00000100:00080000:3.0:1788201344.848470:0:3656:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1788201344.848472:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715332352 00000100:00080000:3.0:1788201344.848478:0:3656:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4052 00000100:00080000:3.0:1788201344.848485:0:3656:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dc1257f0800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201344.848500:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715331968 00000100:00100000:3.0:1788201344.848504:0:3656:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc1060cf800 x1875060715332480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201344.848506:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715331968 00000100:00100000:1.0:1788201344.848532:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1643 00000100:00100000:1.0:1788201344.848542:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715332352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201344.848584:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715332352:12345-0@lo:400:kworker.0 Request processed in 44us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201344.848590:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12580a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715331328:0@lo:400:kworker.0 00000100:00100000:1.0:1788201344.848595:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1643 00000100:00100000:3.0:1788201344.848607:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125808380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715332096:0@lo:400:kworker.0 00000100:00100000:1.0:1788201344.848613:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1644 00000100:00100000:1.0:1788201344.848622:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125809880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715331968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201344.848650:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12580b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715332352:0@lo:400:kworker.0 00000100:00100000:1.0:1788201344.848668:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125809880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715331968:12345-0@lo:400:kworker.0 Request processed in 39us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201344.848676:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1644 00000100:00100000:3.0:1788201344.848679:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12580aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715331968:0@lo:400:kworker.0 00000100:00100000:1.0:1788201344.848699:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715332480:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:1.0:1788201344.848730:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201344.848897:0:26206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715332480 00000100:00100000:3.0:1788201344.848901:0:26206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715332480 00000100:00100000:3.0:1788201344.848937:0:26206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6059 00000100:00100000:3.0:1788201344.848942:0:26206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12580a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3654:x1875060715332480:12345-0@lo:8:ptlrpcd_00_01.0 00010000:02000000:3.0:1788201344.848954:0:26206:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-OST0001: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788201344.848994:0:26206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12580a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3654:x1875060715332480:12345-0@lo:8:ptlrpcd_00_01.0 Request processed in 48us (261us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201344.849000:0:26206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6059 00000100:00080000:3.0:1788201344.849051:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201344.849055:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201344.849059:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715332480:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:2.0:1788201344.849191:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201344.849200:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715332608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201344.849241:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201344.849364:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715332608 00000100:00100000:0.0:1788201344.849369:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715332608 00000100:00100000:0.0:1788201344.849404:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4162 00000100:00100000:0.0:1788201344.849412:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715332608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201344.849437:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:0.0:1788201344.849475:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715332608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201344.849481:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4162 00000100:00100000:2.0:1788201344.850112:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715332608:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788201345.808365:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201346.005884:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201346.005959:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201346.005993:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201346.006082:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695505664 00000100:00100000:1.0:1788201346.006094:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695505664 00000100:00100000:3.0:1788201346.006117:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695505536 00000100:00100000:3.0:1788201346.006124:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695505536 00000100:00100000:1.0:1788201346.006165:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1645 00000100:00100000:1.0:1788201346.006174:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2402:x1875060695505664:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201346.006208:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695505408 00000100:00100000:2.0:1788201346.006214:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695505408 00000100:00100000:1.0:1788201346.006242:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2402:x1875060695505664:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 68us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201346.006252:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1645 00000100:00100000:2.0:1788201346.006256:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 269 00000100:00100000:2.0:1788201346.006267:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695505408:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201346.006278:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1646 00000100:00100000:1.0:1788201346.006288:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2402:x1875060695505536:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201346.006313:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695505408:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 39us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201346.006318:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2402:x1875060695505536:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 30us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201346.006329:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 269 00000100:00100000:1.0:1788201346.006330:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1646 00000100:00080000:0.0:1788201346.006391:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201346.006394:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201346.011756:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201346.011815:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201346.011953:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695505792 00000100:00100000:2.0:1788201346.011964:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695505792 00000100:00100000:2.0:1788201346.012047:0:26205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695505920 00000100:00100000:2.0:1788201346.012051:0:26205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695505920 00000100:00100000:0.0:1788201346.012053:0:26204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6060 00000100:00100000:0.0:1788201346.012064:0:26204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:2399:x1875060695505792:12345-192.168.201.20@tcp:8:kworker.0 00000100:00100000:2.0:1788201346.012076:0:26205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6061 00000100:00100000:2.0:1788201346.012083:0:26205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2399:x1875060695505920:12345-192.168.201.20@tcp:8:kworker.0 00010000:00020000:0.0:1788201346.012091:0:26204:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:02000000:2.0:1788201346.012099:0:26205:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-OST0001: Not available for connect from 192.168.201.20@tcp (stopping) 00000100:00100000:0.0:1788201346.012156:0:26204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:2399:x1875060695505792:12345-192.168.201.20@tcp:8:kworker.0 Request processed in 91us (409us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201346.012164:0:26204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6060 00000100:00100000:2.0:1788201346.032578:0:26205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2399:x1875060695505920:12345-192.168.201.20@tcp:8:kworker.0 Request processed in 20485us (20754us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201346.032592:0:26205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6061 00000001:00100000:0.0:1788201346.395737:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788201346.395762:0:9526:0:(genops.c:885:class_export_put()) final put ffff8dc1201ce800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788201346.395801:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201346.395804:0:9526:0:(genops.c:885:class_export_put()) final put ffff8dc0059d1800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788201346.395810:0:9526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:0.0:1788201346.395812:0:9526:0:(genops.c:885:class_export_put()) final put ffff8dc1401c6800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:3.0:1788201346.396396:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1201ce800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788201346.396498:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0059d1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788201346.396521:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1401c6800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 for lustre-OST0001 00000020:00000080:3.0:1788201346.396542:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1201cc800 for lustre-OST0001 00000020:00000080:3.0:1788201346.396548:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc005d75800 for lustre-OST0001 00000020:00000080:3.0:1788201346.396551:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1401c4800 for lustre-OST0001 00000020:01000000:3.0:1788201346.447630:0:99310:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc003604000 - data ffff8dc11da43510/ffff8dc13f85f000 00000020:01000000:3.0:1788201346.447972:0:99310:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc00340bde0 - data ffff8dc11d851870/ffff8dc002b37000 00100000:10000000:3.0:1788201346.469469:0:99310:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788201346.489859:0:99310:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c99cfa44 00000020:00000080:0.0:1788201346.489879:0:99310:0:(genops.c:885:class_export_put()) final put ffff8dc13f808800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788201346.489900:0:99310:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc001db6000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788201346.489905:0:99310:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc001db6000 2 00000020:01000004:0.0:1788201346.489908:0:99310:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dc001db6000 from lustre-OST0001 00000020:00000080:0.0:1788201346.489943:0:99310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201346.493485:0:99310:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788201346.493503:0:99310:0:(genops.c:885:class_export_put()) final put ffff8dc13f80d800/lustre-OST0001_UUID 00000020:00000080:0.0:1788201346.493510:0:99310:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13f80d800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788201346.493524:0:99310:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:01000004:0.0:1788201346.493800:0:99310:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788201346.493807:0:99310:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788201346.493832:0:99310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201346.493843:0:99310:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788201346.493852:0:99310:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8dc0034f1000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201346.493860:0:99310:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff8dc002643370) has exports, disconnecting them 00000020:00080000:0.0:1788201346.493866:0:99310:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8dc0034f1000), last request at 1788197394 00000020:00000080:0.0:1788201346.493871:0:99310:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c99cfa6e 00000020:00080000:0.0:1788201346.493898:0:99310:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc0034f1000): rc 0 00000020:00000080:0.0:1788201346.493905:0:99310:0:(genops.c:885:class_export_put()) final put ffff8dc0034f1000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788201346.494093:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13f808800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788201346.494109:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0034f1000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788201346.495717:0:99310:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788201346.495727:0:99310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788201346.495733:0:99310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788201346.495743:0:99310:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201346.495972:0:99310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201346.495997:0:99310:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1788201346.496006:0:99310:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788201346.496012:0:99310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201346.496035:0:99310:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788201346.496043:0:99310:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8dc0034f3000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201346.496050:0:99310:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff8dc0026419b8) has exports, disconnecting them 00000020:00080000:1.0:1788201346.496069:0:99310:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8dc0034f3000), last request at 1788197394 00000020:00000080:3.0:1788201346.496070:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc0034f0000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788201346.496075:0:99310:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c99cfa83 00000020:00000080:3.0:1788201346.496083:0:76267:0:(genops.c:885:class_export_put()) final put ffff8dc13f879800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788201346.496087:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13f879800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:00080000:1.0:1788201346.496093:0:99310:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc0034f3000): rc 0 00000020:01000000:3.0:1788201346.496093:0:76267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788201346.496100:0:99310:0:(genops.c:885:class_export_put()) final put ffff8dc0034f3000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788201346.496197:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0034f3000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788201346.538120:0:99310:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788201346.538134:0:99310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788201346.538140:0:99310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788201346.538151:0:99310:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788201346.538198:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc0034f2000 for lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788201346.538436:0:99310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201346.538455:0:99310:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788201346.538464:0:99310:0:(genops.c:885:class_export_put()) final put ffff8dc0034f6800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788201346.538469:0:99310:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0034f6800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788201346.538485:0:99310:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788201346.538608:0:99310:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc001db6000 1 00000020:00000080:3.0:1788201346.538616:0:99310:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c99cfa13 00000020:00000080:3.0:1788201346.538624:0:99310:0:(genops.c:885:class_export_put()) final put ffff8dc13f86c800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788201346.538636:0:99310:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788201346.538647:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13f86c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788201346.538681:0:99310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201346.538690:0:99310:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788201346.538695:0:99310:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff8dc0027d19b8) has no exports 00000020:00000080:3.0:1788201346.671510:0:99310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201346.671535:0:99310:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788201346.671543:0:99310:0:(genops.c:885:class_export_put()) final put ffff8dc12f19d800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788201346.671549:0:99310:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12f19d800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788201346.671557:0:99310:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788201346.671713:0:99310:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dc12f199000 00000020:01000000:3.0:1788201346.671744:0:99310:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788201346.671748:0:99310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201346.671754:0:99310:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788201346.671759:0:99310:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8dc12f0c3370) has no exports 00000020:00000080:3.0:1788201346.671782:0:99310:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201346.671786:0:99310:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788201346.671789:0:99310:0:(genops.c:885:class_export_put()) final put ffff8dc12587a000/OSS_uuid 00000020:00000080:3.0:1788201346.671792:0:99310:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12587a000/OSS_uuid for OSS 00000020:01000000:3.0:1788201346.671795:0:99310:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788201346.676974:0:26212:0:(service.c:3183:ptlrpc_main()) ll_ost00_017: service thread [ffff8dc11cc52400:26212] 17 exiting: rc = 0 00000100:00100000:1.0:1788201346.677158:0:26208:0:(service.c:3183:ptlrpc_main()) ll_ost00_013: service thread [ffff8dc005111200:26208] 13 exiting: rc = 0 00000100:00100000:1.0:1788201346.677240:0:26209:0:(service.c:3183:ptlrpc_main()) ll_ost00_014: service thread [ffff8dc12f7d1600:26209] 14 exiting: rc = 0 00000100:00100000:1.0:1788201346.677309:0:26210:0:(service.c:3183:ptlrpc_main()) ll_ost00_015: service thread [ffff8dc00579f600:26210] 15 exiting: rc = 0 00000100:00100000:1.0:1788201346.677378:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8dc140153e00:8446] 0 exiting: rc = 1 00000100:00100000:2.0:1788201346.677432:0:23974:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8dc00587e600:23974] 4 exiting: rc = 0 00000100:00100000:1.0:1788201346.677455:0:8449:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8dc14018c200:8449] 2 exiting: rc = 0 00000100:00100000:2.0:1788201346.677499:0:26202:0:(service.c:3183:ptlrpc_main()) ll_ost00_008: service thread [ffff8dc005cac800:26202] 8 exiting: rc = 0 00000100:00100000:1.0:1788201346.677515:0:26200:0:(service.c:3183:ptlrpc_main()) ll_ost00_006: service thread [ffff8dc11cf06200:26200] 6 exiting: rc = 0 00000100:00100000:2.0:1788201346.677560:0:26199:0:(service.c:3183:ptlrpc_main()) ll_ost00_005: service thread [ffff8dc1333ca200:26199] 5 exiting: rc = 0 00000100:00100000:2.0:1788201346.677636:0:26205:0:(service.c:3183:ptlrpc_main()) ll_ost00_011: service thread [ffff8dc005dc1600:26205] 11 exiting: rc = 0 00000100:00100000:3.0:1788201346.679870:0:26203:0:(service.c:3183:ptlrpc_main()) ll_ost00_009: service thread [ffff8dc004fbd600:26203] 9 exiting: rc = 0 00000100:00100000:3.0:1788201346.680054:0:8491:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8dc13abe1200:8491] 3 exiting: rc = 0 00000100:00100000:3.0:1788201346.680131:0:26201:0:(service.c:3183:ptlrpc_main()) ll_ost00_007: service thread [ffff8dc006c5ba00:26201] 7 exiting: rc = 0 00000100:00100000:1.0:1788201346.680132:0:8448:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8dc140152c00:8448] 1 exiting: rc = 0 00000100:00100000:0.0:1788201346.680254:0:26211:0:(service.c:3183:ptlrpc_main()) ll_ost00_016: service thread [ffff8dc0075e0200:26211] 16 exiting: rc = 0 00000100:00100000:3.0:1788201346.681975:0:26206:0:(service.c:3183:ptlrpc_main()) ll_ost00_012: service thread [ffff8dc005d6d600:26206] 12 exiting: rc = 0 00000100:00100000:3.0:1788201346.682113:0:26214:0:(service.c:3183:ptlrpc_main()) ll_ost00_018: service thread [ffff8dc12bc33000:26214] 18 exiting: rc = 0 00000100:00100000:1.0:1788201346.682133:0:26204:0:(service.c:3183:ptlrpc_main()) ll_ost00_010: service thread [ffff8dc0059e2e00:26204] 10 exiting: rc = 0 00000100:00100000:3.0:1788201346.682240:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682249:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682256:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682266:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682273:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682283:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682292:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682299:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682306:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682843:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682851:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682859:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682867:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682873:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682879:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682886:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682894:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682901:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682909:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682917:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682924:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682932:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682940:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682947:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682955:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682963:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682969:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682977:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.682994:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.683002:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.683010:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.683063:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.683072:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.683078:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686431:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686455:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686464:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686471:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686478:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686485:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686492:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686499:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686507:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686515:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686542:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686548:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686554:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686580:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686588:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686594:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686601:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686608:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686615:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686633:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686641:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686647:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686654:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686660:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686677:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686683:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686689:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686695:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686700:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.686706:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.688436:0:10112:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8dc13ab33a00:10112] 2 exiting: rc = 0 00000100:00100000:0.0:1788201346.688507:0:8450:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8dc13a890600:8450] 0 exiting: rc = 1 00000100:00100000:0.0:1788201346.688625:0:8451:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8dc13a891c00:8451] 1 exiting: rc = 0 00000100:00100000:3.0:1788201346.688942:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.688954:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.688962:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.688969:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.688977:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.688998:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689007:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689013:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689089:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689097:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689105:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689113:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689123:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689131:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689150:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689157:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689176:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689185:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689193:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689201:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689208:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689215:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689221:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689228:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689235:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689244:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689251:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689261:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689268:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689280:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689288:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689295:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689302:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689809:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689827:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689833:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689839:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689845:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689851:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689857:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689865:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689870:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689876:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689882:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689887:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689892:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689898:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689903:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689909:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689927:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689933:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689939:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689945:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689950:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689956:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689961:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689968:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689973:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689979:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.689996:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.690003:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.690009:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.690051:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.690059:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.694678:0:8454:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8dc14018da00:8454] 2 exiting: rc = 0 00000100:00100000:1.0:1788201346.694682:0:25936:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_011: service thread [ffff8dc12f3c8a00:25936] 11 exiting: rc = 0 00000100:00100000:2.0:1788201346.694967:0:25729:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_009: service thread [ffff8dc005ab6400:25729] 9 exiting: rc = 0 00000100:00100000:1.0:1788201346.695343:0:8453:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8dc14018dc00:8453] 1 exiting: rc = 0 00000100:00100000:0.0:1788201346.695995:0:24875:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_006: service thread [ffff8dc0058a5e00:24875] 6 exiting: rc = 0 00000100:00100000:3.0:1788201346.697944:0:24857:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff8dc1396b4400:24857] 3 exiting: rc = 0 00000100:00100000:3.0:1788201346.703684:0:24873:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_004: service thread [ffff8dc11013a600:24873] 4 exiting: rc = 0 00000100:00100000:1.0:1788201346.704556:0:25933:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_010: service thread [ffff8dc105f69800:25933] 10 exiting: rc = 0 00000100:00100000:1.0:1788201346.705381:0:25502:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_008: service thread [ffff8dc005f45600:25502] 8 exiting: rc = 0 00000100:00100000:3.0:1788201346.705714:0:24876:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_007: service thread [ffff8dc13a478a00:24876] 7 exiting: rc = 0 00000100:00100000:3.0:1788201346.706066:0:8452:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8dc13a957400:8452] 0 exiting: rc = 1 00000100:00100000:3.0:1788201346.707274:0:24874:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_005: service thread [ffff8dc00390d600:24874] 5 exiting: rc = 0 00000100:00100000:3.0:1788201346.723292:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723308:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723663:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723670:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723676:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723683:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723689:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723695:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723701:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723707:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723713:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723718:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723724:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723820:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723827:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723834:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723841:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723856:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723864:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723870:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723877:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723884:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723891:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723898:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723904:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723911:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723917:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723924:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723931:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723937:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723943:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723949:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723956:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723963:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723969:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723976:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723991:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.723998:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.724008:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.724013:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.724066:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.724231:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.724240:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.724246:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.724252:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.724258:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.724264:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.724270:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.724285:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.724293:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.724299:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.724306:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.724401:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.724410:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.724638:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.724647:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.724654:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.724661:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.724667:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.724674:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.724680:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.724687:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.724708:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201346.724717:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201346.747552:0:8456:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8dc14018ce00:8456] 1 exiting: rc = 0 00000100:00100000:3.0:1788201346.751571:0:8455:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8dc13a890200:8455] 0 exiting: rc = 1 00000100:00100000:0.0:1788201346.751810:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.751820:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.751827:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.751833:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.751840:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.751846:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.751852:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.751858:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.751865:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.751870:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.751877:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.751883:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.751888:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.751893:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.751899:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.751905:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.751911:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.751916:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.751923:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.751929:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.751950:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.751955:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.751961:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.751966:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.751972:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.751978:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.751997:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752003:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752008:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752013:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752051:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752056:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752062:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752068:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752076:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752082:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752088:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752093:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752099:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752104:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752110:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752115:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752121:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752127:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752132:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752137:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752142:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752148:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752153:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752159:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752165:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752171:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752178:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752183:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752189:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752202:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752208:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752214:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752220:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752226:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752231:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752237:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752242:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.752247:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.753186:0:23728:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_002: service thread [ffff8dc125931800:23728] 2 exiting: rc = 0 00000100:00100000:2.0:1788201346.755437:0:8457:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8dc14018d400:8457] 0 exiting: rc = 1 00000100:00100000:2.0:1788201346.755612:0:8458:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8dc13a92c000:8458] 1 exiting: rc = 0 00000100:00100000:1.0:1788201346.755828:0:83817:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_003: service thread [ffff8dc11cd52200:83817] 3 exiting: rc = 0 00000100:00100000:0.0:1788201346.757979:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758006:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758035:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758047:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758057:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758066:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758075:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758083:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758092:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758101:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758110:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758118:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758127:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758136:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758144:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758152:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758159:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758168:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758177:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758186:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758194:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758202:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758211:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758219:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758229:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758255:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758264:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758277:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758287:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758295:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758302:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758423:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758436:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758445:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758453:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758460:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758468:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758475:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758484:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758492:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758501:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758509:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758521:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758529:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758538:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758546:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758555:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758564:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758571:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758579:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758588:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758597:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758604:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758614:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758637:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758647:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758657:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758677:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758686:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758702:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758719:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758733:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758741:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201346.758828:0:99310:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788201346.787729:0:99310:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00010000:00010000:0.0:1788201346.833194:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201347.855434:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201348.887352:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201349.458467:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715332736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201349.458575:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201349.458673:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715332736 00000100:00100000:0.0:1788201349.458681:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715332736 00000100:00100000:0.0:1788201349.458734:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201349.458744:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715332736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201349.458778:0:66317:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:0.0:1788201349.458836:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715332736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201349.458843:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201349.459002:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715332736:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788201349.904177:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201349.968423:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715332864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201349.968505:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788201349.968936:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201349.968941:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788201349.968946:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201349.968951:0:57134:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 4196 00000100:00080000:0.0:1788201349.968954:0:57134:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201349.968960:0:57134:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8dc006d84000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201349.968985:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc0058a8700 x1875060715333120/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201349.969006:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201349.969009:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788201349.969011:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc1031f8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201349.969031:0:57134:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4196 00000100:00080000:0.0:1788201349.969041:0:57134:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788201349.969046:0:57134:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8dc1031f8800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201349.969059:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc0058aaa00 x1875060715333248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201349.969092:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201349.969095:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788201349.969097:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201349.969100:0:57134:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 4196 00000100:00080000:0.0:1788201349.969102:0:57134:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201349.969107:0:57134:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dc109815000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201349.969118:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc0058a9c00 x1875060715333632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201349.969126:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201349.969129:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788201349.969130:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201349.969133:0:57134:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4196 00000100:00080000:0.0:1788201349.969135:0:57134:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788201349.969139:0:57134:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dc1257f0800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201349.969149:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc0058a9880 x1875060715333760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201349.969186:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715332864 00000100:00100000:0.0:1788201349.969194:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715332864 00000100:00100000:1.0:1788201349.969399:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715333376:0@lo:400:kworker.0 00000100:00100000:1.0:1788201349.969447:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201349.969474:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201349.969480:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715332992:0@lo:400:kworker.0 00000100:00100000:1.0:1788201349.969518:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201349.969554:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715333504:0@lo:400:kworker.0 00000100:00100000:1.0:1788201349.969581:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201349.969899:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715333120:0@lo:8:kworker.0 00000400:00000100:3.0:1788201349.969935:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875060715333120 offset 0 length 520: 4 00000100:00100000:3.0:1788201349.969951:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715333248:0@lo:8:kworker.0 00000400:00000100:3.0:1788201349.969967:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875060715333248 offset 0 length 520: 4 00000100:00100000:3.0:1788201349.969978:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715333632:0@lo:8:kworker.0 00000400:00000100:3.0:1788201349.969992:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875060715333632 offset 0 length 520: 4 00000100:00100000:3.0:1788201349.970000:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715333760:0@lo:8:kworker.0 00000400:00000100:3.0:1788201349.970014:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875060715333760 offset 0 length 520: 4 00000100:00100000:1.0:1788201349.970525:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201349.970533:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715333888:0@lo:400:kworker.0 00000100:00100000:1.0:1788201349.970565:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201349.970602:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715333376 00000100:00100000:1.0:1788201349.970608:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715333376 00000100:00100000:1.0:1788201349.970653:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715333888 00000100:00100000:1.0:1788201349.970656:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715333888 00000100:00100000:1.0:1788201349.970679:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1647 00000100:00100000:1.0:1788201349.970700:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12580ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715333376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201349.970756:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12580ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715333376:12345-0@lo:400:kworker.0 Request processed in 69us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201349.970763:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1647 00000100:00100000:1.0:1788201349.970781:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1648 00000100:00100000:1.0:1788201349.970787:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715333888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201349.970822:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715333888:12345-0@lo:400:kworker.0 Request processed in 35us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201349.970828:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1648 00000100:00100000:1.0:1788201349.970846:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715332992 00000100:00100000:1.0:1788201349.970850:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715332992 00000100:00100000:1.0:1788201349.970877:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788201349.970883:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+18:3656:x1875060715332992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201349.970913:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+18:3656:x1875060715332992:12345-0@lo:400:kworker.0 Request processed in 31us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201349.970939:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788201349.970992:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715333888:0@lo:400:kworker.0 00000100:00100000:1.0:1788201349.971055:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715332992:0@lo:400:kworker.0 00000100:00100000:1.0:1788201349.971067:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715333376:0@lo:400:kworker.0 00000100:00100000:0.0:1788201349.971831:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715333504 00000100:00100000:0.0:1788201349.971838:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715333504 00000100:00100000:0.0:1788201349.971872:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201349.971880:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715332864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201349.971918:0:66317:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:0.0:1788201349.971985:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715332864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (3480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201349.971992:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201349.972007:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201349.972135:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715332864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201349.972380:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12580b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715333504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201349.972613:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12580b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715333504:12345-0@lo:400:kworker.0 Request processed in 598us (3029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201349.972620:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201349.978002:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715333504:0@lo:400:kworker.0 00010000:00010000:2.0:1788201350.929492:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1788201351.125486:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 28 match 1875060695506432 offset 0 length 520: 4 00000400:00000100:1.0:1788201351.133757:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 28 match 1875060695506560 offset 0 length 520: 4 00000100:00100000:1.0:1788201351.133802:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201351.133848:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201351.133893:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201351.133937:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695506176 00000100:00100000:1.0:1788201351.133948:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695506176 00000100:00100000:1.0:1788201351.134036:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695506304 00000100:00100000:1.0:1788201351.134040:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695506304 00000100:00100000:1.0:1788201351.134064:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1649 00000100:00100000:1.0:1788201351.134074:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2401:x1875060695506176:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201351.134151:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2401:x1875060695506176:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 78us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201351.134159:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1649 00000100:00100000:1.0:1788201351.134178:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1650 00000100:00100000:1.0:1788201351.134185:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12580bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2401:x1875060695506304:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201351.134210:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12580bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2401:x1875060695506304:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201351.134231:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1650 00000100:00100000:2.0:1788201351.134755:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695506048 00000100:00100000:2.0:1788201351.134761:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695506048 00000100:00100000:2.0:1788201351.134806:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 271 00000100:00100000:2.0:1788201351.134815:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695506048:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201351.134853:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695506048:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 39us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201351.134859:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 271 00000100:00080000:0.0:1788201351.135570:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201351.135575:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788201351.951123:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201352.978121:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201353.999133:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201354.583359:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715334016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201354.583439:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201354.583620:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715334016 00000100:00100000:2.0:1788201354.583629:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715334016 00000100:00100000:2.0:1788201354.583682:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201354.583692:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715334016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201354.583726:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:2.0:1788201354.583781:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715334016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201354.583790:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788201354.583972:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715334016:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788201355.023369:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201355.087585:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715334144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201355.087718:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201355.087907:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715334144 00000100:00100000:2.0:1788201355.087916:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715334144 00000100:00100000:2.0:1788201355.087963:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201355.087971:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715334144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201355.088002:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:3.0:1788201355.088698:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715334144:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788201355.088822:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201355.088848:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201355.088850:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201355.088853:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201355.088866:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201355.088869:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201355.088871:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201355.088874:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788201355.089271:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715334144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201355.089287:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788201355.089365:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12580aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715334528:0@lo:400:kworker.0 00000100:00100000:3.0:1788201355.089419:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201355.089543:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12580a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715334400:0@lo:400:kworker.0 00000100:00100000:3.0:1788201355.089569:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201355.089593:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201355.090220:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715334528 00000100:00100000:2.0:1788201355.090227:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715334528 00000100:00100000:2.0:1788201355.090261:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715334400 00000100:00100000:2.0:1788201355.090264:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715334400 00000100:00100000:2.0:1788201355.090281:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1651 00000100:00100000:2.0:1788201355.090288:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715334528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201355.090336:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715334528:12345-0@lo:400:kworker.0 Request processed in 48us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201355.090342:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1651 00000100:00100000:2.0:1788201355.090353:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1652 00000100:00100000:2.0:1788201355.090358:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715334400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201355.090378:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715334400:12345-0@lo:400:kworker.0 Request processed in 21us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201355.090384:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1652 00000100:00100000:3.0:1788201355.090511:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12580b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715334272:0@lo:400:kworker.0 00000100:00100000:3.0:1788201355.090547:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201355.090589:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12580a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715334400:0@lo:400:kworker.0 00000100:00100000:2.0:1788201355.090894:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715334272 00000100:00100000:2.0:1788201355.090900:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715334272 00000100:00100000:2.0:1788201355.090939:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788201355.090945:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+18:3658:x1875060715334272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201355.090981:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+18:3658:x1875060715334272:12345-0@lo:400:kworker.0 Request processed in 36us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201355.090987:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788201355.091285:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12580b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715334272:0@lo:400:kworker.0 00000100:00100000:3.0:1788201355.091325:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12580aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715334528:0@lo:400:kworker.0 00000020:01000004:2.0:1788201355.653895:0:99760:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788201355.653901:0:99760:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788201355.653903:0:99760:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788201355.654085:0:99760:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dc12b6bc800 00000020:01000004:2.0:1788201355.654108:0:99760:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788201355.654127:0:99760:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788201355.654154:0:99760:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8dc004fd3370) 00000020:00000080:2.0:1788201355.654177:0:99760:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788201355.792836:0:99760:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788201355.799532:0:99760:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788201355.800512:0:99760:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788201355.802582:0:99760:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788201355.803191:0:99760:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788201355.803851:0:99760:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788201355.804194:0:99760:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1788201355.806476:0:99760:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788201355.807218:0:99760:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788201355.807235:0:99760:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788201355.807266:0:99760:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x96d0c9b8c9a1d692 00000020:01000004:3.0:1788201355.807277:0:99760:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788201355.807321:0:99760:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.120@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788201355.807325:0:99760:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788201355.807333:0:99760:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788201355.807340:0:99760:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788201355.807356:0:99760:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8dc12ef619b8) 00000020:00000080:3.0:1788201355.807370:0:99760:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1788201355.809780:0:99760:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788201355.810069:0:99760:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788201355.810076:0:99760:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788201355.813939:0:99760:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788201355.813958:0:99760:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788201355.832947:0:99760:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788201355.832965:0:99760:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788201355.835838:0:99760:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201355.836556:0:99760:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788201355.836567:0:99760:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788201355.837958:0:99760:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788201355.837972:0:99760:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788201355.870132:0:99760:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788201355.870383:0:99760:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788201355.870389:0:99760:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788201355.872611:0:99760:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788201355.872634:0:99760:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788201355.874494:0:99760:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788201355.874511:0:99760:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788201355.878904:0:99760:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201355.879577:0:99760:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788201355.879646:0:99760:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788201355.882913:0:99760:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788201355.882929:0:99760:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788201355.925370:0:99760:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201355.925586:0:99760:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788201355.925594:0:99760:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788201355.927549:0:99760:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788201355.927563:0:99760:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788201355.928091:0:99760:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788201355.928123:0:99760:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788201355.928366:0:99760:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788201355.945486:0:99760:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788201355.945530:0:99760:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.120@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788201355.945534:0:99760:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788201355.945536:0:99760:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201355.945537:0:99760:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201355.945539:0:99760:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201355.945540:0:99760:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201355.945541:0:99760:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201355.945543:0:99760:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201355.945544:0:99760:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201355.945546:0:99760:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788201355.945549:0:99760:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788201355.945551:0:99760:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788201355.945552:0:99760:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201355.945553:0:99760:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201355.945554:0:99760:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201355.945555:0:99760:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201355.945556:0:99760:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201355.945557:0:99760:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201355.945559:0:99760:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201355.945560:0:99760:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788201355.945596:0:99760:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788201355.945617:0:99760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12580b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715334656:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788201355.945684:0:99760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201355.945784:0:99760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13aa35d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201355.945876:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715334656 00000100:00100000:2.0:1788201355.945883:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715334656 00000100:00100000:2.0:1788201355.945963:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788201355.945972:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+18:99760:x1875060715334656:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788201355.946001:0:94467:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788201355.946004:0:94467:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788201355.946008:0:94467:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788201355.946579:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+18:99760:x1875060715334656:12345-0@lo:253:mount.lustre.0 Request processed in 606us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201355.946599:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788201355.946718:0:99760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12580b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715334656:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788201355.946732:0:99760:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788201355.946734:0:99760:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788201355.946735:0:99760:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201355.946736:0:99760:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201355.946737:0:99760:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201355.946738:0:99760:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201355.946739:0:99760:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201355.946740:0:99760:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201355.946742:0:99760:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201355.946743:0:99760:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788201355.946761:0:99760:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dc12b6bc800 from lustre-OST0000 10000000:01000000:3.0:1788201355.946790:0:99760:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788201355.946800:0:99760:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788201355.946808:0:99760:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8dc12563cd28 local copy 00010000:00010000:3.0:1788201355.946819:0:99760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1cabb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1cac2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201355.946918:0:99760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715334784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201355.946949:0:99760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201355.947467:0:99760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccfa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201355.947553:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715334784 00000100:00100000:1.0:1788201355.947560:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715334784 00000100:00100000:1.0:1788201355.947618:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788201355.947628:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+18:99760:x1875060715334784:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201355.947707:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+18:99760:x1875060715334784:12345-0@lo:501:mount.lustre.0 Request processed in 81us (757us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201355.947713:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788201355.948397:0:99760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715334784:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788201355.948419:0:99760:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788201355.948449:0:99760:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788201355.948457:0:99760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1cabb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1cac2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201355.948466:0:99760:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1cabb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1cac2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201355.948493:0:99760:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dc12b6bc800 10000000:01000000:3.0:1788201355.948498:0:99760:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788201355.948503:0:99760:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788201355.948505:0:99760:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201355.948510:0:99760:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788201355.948513:0:99760:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788201355.948539:0:99760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1d6a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201355.948546:0:99760:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1d6a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201355.948570:0:99760:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1d6a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201355.948602:0:99760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715334912:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201355.948640:0:99760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201355.948668:0:99760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccfa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201355.948800:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715334912 00000100:00100000:1.0:1788201355.948806:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715334912 00000100:00100000:1.0:1788201355.948845:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788201355.948854:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+18:99760:x1875060715334912:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201355.948864:0:94464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201355.948876:0:94464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1d6a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1d6a0 expref: -99 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201355.948899:0:94464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1d6a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d6a0 expref: 19 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201355.948909:0:94464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1d6a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d6a0 expref: 19 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201355.948917:0:94464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ed600, rc 0) 00000100:00100000:1.0:1788201355.948948:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:99760:x1875060715334912:12345-0@lo:101:mount.lustre.0 Request processed in 96us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201355.948954:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788201355.949060:0:99760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715334912:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201355.949071:0:99760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1d6a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d6a7 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201355.949079:0:99760:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1d6a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d6a7 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201355.950084:0:99760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000040:00080000:3.0:1788201355.950965:0:99760:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201355.958184:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:1.0:1788201355.958252:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 128 off8544 00000040:00080000:1.0:1788201355.958271:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 112 off8656 00000040:00080000:1.0:1788201355.958293:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8880 00000040:00080000:1.0:1788201355.958306:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9104 00000040:00080000:1.0:1788201355.958316:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 80 off9184 00000040:00080000:1.0:1788201355.958327:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 224 off9408 00000040:00080000:1.0:1788201355.958339:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9632 00000040:00080000:1.0:1788201355.958350:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 80 off9712 00000040:00080000:1.0:1788201355.958360:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 224 off9936 00000040:00080000:1.0:1788201355.958372:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10160 00000040:00080000:1.0:1788201355.958385:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 120 off10280 00000040:00080000:1.0:1788201355.958407:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 224 off10504 00000040:00080000:1.0:1788201355.958413:0:99760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 13 count 14 00000100:00100000:1.0:1788201355.958524:0:99760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125808380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715335040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201355.958597:0:99760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201355.958640:0:99760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13aa35d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201355.958783:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715335040 00000100:00100000:2.0:1788201355.958791:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715335040 00000100:00100000:2.0:1788201355.958849:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788201355.958857:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:99760:x1875060715335040:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201355.958984:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:99760:x1875060715335040:12345-0@lo:501:mount.lustre.0 Request processed in 127us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201355.958991:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788201355.959203:0:99760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125808380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715335040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201355.959372:0:99760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125808380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715335168:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201355.959416:0:99760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201355.959605:0:99760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13aa35d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201355.960506:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715335168 00000100:00100000:2.0:1788201355.960525:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715335168 00000100:00100000:2.0:1788201355.960563:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788201355.960571:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+19:99760:x1875060715335168:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201355.960747:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+19:99760:x1875060715335168:12345-0@lo:503:mount.lustre.0 Request processed in 176us (1329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201355.960754:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788201355.961308:0:99760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125808380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715335168:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788201355.968761:0:99760:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201355.968873:0:99760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125808380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715335296:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201355.969298:0:99760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201355.969345:0:99760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13aa35d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201355.969464:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715335296 00000100:00100000:2.0:1788201355.969473:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715335296 00000100:00100000:2.0:1788201355.969523:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788201355.969532:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:99760:x1875060715335296:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201355.969651:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:99760:x1875060715335296:12345-0@lo:502:mount.lustre.0 Request processed in 119us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201355.969658:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788201355.969968:0:99760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125808380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715335296:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201355.970238:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:1.0:1788201355.970268:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 128 off8544 00000040:00080000:1.0:1788201355.970284:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 112 off8656 00000040:00080000:1.0:1788201355.970310:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8880 00000040:00080000:1.0:1788201355.970323:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9104 00000040:00080000:1.0:1788201355.970337:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 80 off9184 00000040:00080000:1.0:1788201355.970349:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 224 off9408 00000040:00080000:1.0:1788201355.970362:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9632 00000040:00080000:1.0:1788201355.970374:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 80 off9712 00000040:00080000:1.0:1788201355.970388:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 224 off9936 00000040:00080000:1.0:1788201355.970401:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10160 00000040:00080000:1.0:1788201355.970413:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 120 off10280 00000100:00100000:1.0:1788201355.970440:0:99760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125808380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715335424:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201355.970481:0:99760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201355.970516:0:99760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13aa35d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201355.970634:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715335424 00000100:00100000:2.0:1788201355.970639:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715335424 00000100:00100000:2.0:1788201355.970673:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788201355.970680:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:99760:x1875060715335424:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201355.970757:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:99760:x1875060715335424:12345-0@lo:502:mount.lustre.0 Request processed in 77us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201355.970763:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788201355.971011:0:99760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125808380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715335424:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201355.971083:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 224 off10504 00000040:00080000:1.0:1788201355.971091:0:99760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788201355.977122:0:99777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788201355.977143:0:99777:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788201355.977149:0:99777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201355.977152:0:99777:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788201355.977157:0:99777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201355.977176:0:99777:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8dc139bbb370) 00000020:00000080:1.0:1788201355.977201:0:99777:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788201355.977207:0:99777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788201355.977275:0:99777:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc12b6bc800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788201355.977283:0:99777:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788201355.977290:0:99777:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x96d0c9b8c9a1d6b5 00010000:00010000:2.0:1788201355.983499:0:99777:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1788201355.984352:0:99777:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 8589934612 00080000:10000000:2.0:1788201355.987732:0:99777:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/32) registered 00000020:00000080:2.0:1788201355.989281:0:99777:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788201355.989296:0:99777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201355.989303:0:99777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201355.989305:0:99777:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788201355.989319:0:99777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788201355.989321:0:99777:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1788201355.989323:0:99777:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201355.989325:0:99777:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201355.989326:0:99777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788201355.989328:0:99777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201355.989329:0:99777:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788201355.989331:0:99777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201355.989334:0:99777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201355.989336:0:99777:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788201355.989339:0:99777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788201355.989341:0:99777:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788201355.989343:0:99777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201355.989345:0:99777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201355.989346:0:99777:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788201355.989348:0:99777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201355.989350:0:99777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201355.989351:0:99777:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788201355.989354:0:99777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788201355.989384:0:99777:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201355.989386:0:99777:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201355.989388:0:99777:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788201355.989391:0:99777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 14 count 14 00000020:01000000:3.0:1788201355.990359:0:99760:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788201355.990397:0:99760:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788201355.990424:0:99760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1d6a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d6a7 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201355.990439:0:99760:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1d6a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d6a7 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201355.990447:0:99760:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc12b6bc800 from 1 10000000:01000000:3.0:1788201355.990451:0:99760:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201355.990487:0:99760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74600/0x96d0c9b8c9a1d6bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201355.990506:0:99760:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc108c74600/0x96d0c9b8c9a1d6bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201355.990518:0:99760:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc108c74600/0x96d0c9b8c9a1d6bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201355.990548:0:99760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715335552:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201355.990631:0:99760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201355.990670:0:99760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccf180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201355.991239:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715335552 00000100:00100000:2.0:1788201355.991249:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715335552 00000100:00100000:2.0:1788201355.991291:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788201355.991301:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:99760:x1875060715335552:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201355.991314:0:94464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201355.991328:0:94464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fd200/0x96d0c9b8c9a1d6c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1d6bc expref: -99 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201355.991353:0:94464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fd200/0x96d0c9b8c9a1d6c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d6bc expref: 20 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201355.991371:0:94464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fd200/0x96d0c9b8c9a1d6c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d6bc expref: 20 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201355.991378:0:94464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fd200, rc 0) 00000100:00100000:2.0:1788201355.991415:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+20:99760:x1875060715335552:12345-0@lo:101:mount.lustre.0 Request processed in 117us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201355.991420:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788201355.991497:0:99760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715335552:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201355.991509:0:99760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc108c74600/0x96d0c9b8c9a1d6bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d6c3 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201355.991515:0:99760:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc108c74600/0x96d0c9b8c9a1d6bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d6c3 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201355.992876:0:99760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 7 count 7 00000040:00080000:3.0:1788201355.993273:0:99760:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201355.993441:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].1, 224 off8416 00000040:00080000:3.0:1788201355.993467:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].2, 112 off8528 00000040:00080000:3.0:1788201355.993482:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].3, 224 off8752 00000040:00080000:3.0:1788201355.993496:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].4, 224 off8976 00000040:00080000:3.0:1788201355.993509:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].5, 112 off9088 00000040:00080000:3.0:1788201355.993527:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].6, 224 off9312 00000040:00080000:3.0:1788201355.993531:0:99760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 6 count 7 00000100:00100000:3.0:1788201355.993669:0:99760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715335680:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201355.993743:0:99760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201355.993799:0:99760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccf540 going to sleep for 11 seconds 00000100:00100000:2.0:1788201355.993889:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715335680 00000100:00100000:2.0:1788201355.993897:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715335680 00000100:00100000:2.0:1788201355.993945:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788201355.993959:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:99760:x1875060715335680:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201355.994146:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:99760:x1875060715335680:12345-0@lo:501:mount.lustre.0 Request processed in 189us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201355.994153:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788201355.994313:0:99760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715335680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201355.994350:0:99760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125808380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715335808:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201355.994392:0:99760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201355.994427:0:99760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13aa35a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201355.994465:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715335808 00000100:00100000:2.0:1788201355.994470:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715335808 00000100:00100000:2.0:1788201355.994504:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788201355.994511:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+20:99760:x1875060715335808:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201355.994696:0:99760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125808380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715335808:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788201355.995045:0:99760:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201355.995101:0:99760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125808380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715335936:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201355.995478:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+20:99760:x1875060715335808:12345-0@lo:503:mount.lustre.0 Request processed in 966us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201355.995486:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788201355.995651:0:99760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201355.995711:0:99760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004bde900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201355.995745:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715335936 00000100:00100000:2.0:1788201355.995750:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715335936 00000100:00100000:2.0:1788201355.995832:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788201355.995841:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:99760:x1875060715335936:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201355.995934:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:99760:x1875060715335936:12345-0@lo:502:mount.lustre.0 Request processed in 95us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201355.995946:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788201355.996005:0:99760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125808380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715335936:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201355.996206:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].1, 224 off8416 00000040:00080000:1.0:1788201355.996233:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].2, 112 off8528 00000040:00080000:1.0:1788201355.996249:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].3, 224 off8752 00000040:00080000:1.0:1788201355.996262:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].4, 224 off8976 00000040:00080000:1.0:1788201355.996273:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].5, 112 off9088 00000100:00100000:1.0:1788201355.996295:0:99760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125808380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715336064:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201355.996331:0:99760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201355.996529:0:99760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13aa35a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201355.996562:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715336064 00000100:00100000:3.0:1788201355.996567:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715336064 00000100:00100000:3.0:1788201355.996664:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788201355.996672:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:99760:x1875060715336064:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201355.996791:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:99760:x1875060715336064:12345-0@lo:502:mount.lustre.0 Request processed in 119us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201355.996798:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788201355.996914:0:99760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125808380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715336064:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201355.996953:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].6, 224 off9312 00000040:00080000:1.0:1788201355.996961:0:99760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:2.0:1788201355.997713:0:99781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201355.997722:0:99781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201355.997724:0:99781:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788201355.997731:0:99781:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc12b6bc800 00000020:00000080:2.0:1788201355.997733:0:99781:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788201355.997741:0:99781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201355.997743:0:99781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201355.997744:0:99781:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788201355.997746:0:99781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201355.997748:0:99781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201355.997750:0:99781:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788201355.997752:0:99781:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc12b6bc800 00000020:00000080:2.0:1788201355.997754:0:99781:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788201355.997846:0:99781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201355.997850:0:99781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201355.997851:0:99781:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788201355.997854:0:99781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 7 count 7 00000020:01000000:3.0:1788201355.997968:0:99760:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1788201355.997994:0:99760:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201355.998013:0:99760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74600/0x96d0c9b8c9a1d6bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d6c3 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201355.998043:0:99760:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc108c74600/0x96d0c9b8c9a1d6bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d6c3 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201355.998089:0:99760:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788201355.998092:0:99760:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dc12b6bc800 10000000:01000000:3.0:1788201355.998095:0:99760:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dc12b6bc800 10000000:01000000:3.0:1788201355.998099:0:99760:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201355.998103:0:99760:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc12b6bc800 from 1 10000000:01000000:3.0:1788201355.998106:0:99760:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201355.998250:0:99760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c75000/0x96d0c9b8c9a1d6ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201355.998258:0:99760:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc108c75000/0x96d0c9b8c9a1d6ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201355.998269:0:99760:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc108c75000/0x96d0c9b8c9a1d6ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201355.998301:0:99760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715336192:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201355.998348:0:99760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201355.998390:0:99760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccf480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201355.998436:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715336192 00000100:00100000:2.0:1788201355.998442:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715336192 00000100:00100000:2.0:1788201355.998484:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788201355.998492:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12e6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:99760:x1875060715336192:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201355.998503:0:94461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201355.998528:0:94461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fd000/0x96d0c9b8c9a1d6d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1d6ca expref: -99 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201355.998644:0:94461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fd000/0x96d0c9b8c9a1d6d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d6ca expref: 21 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201355.998655:0:94461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fd000/0x96d0c9b8c9a1d6d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d6ca expref: 21 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201355.998669:0:94461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fd000, rc 0) 00000100:00100000:2.0:1788201355.998707:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12e6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:99760:x1875060715336192:12345-0@lo:101:mount.lustre.0 Request processed in 216us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201355.998713:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788201355.998776:0:99760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715336192:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201355.998788:0:99760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc108c75000/0x96d0c9b8c9a1d6ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d6d1 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201355.998795:0:99760:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc108c75000/0x96d0c9b8c9a1d6ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d6d1 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201355.999920:0:99760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 64 count 63 00000040:00080000:3.0:1788201356.000141:0:99760:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201356.000293:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:3.0:1788201356.000310:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 120 off8536 00000040:00080000:3.0:1788201356.000318:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 168 off8704 00000040:00080000:3.0:1788201356.000325:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].4, 224 off8928 00000040:00080000:3.0:1788201356.000331:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].5, 224 off9152 00000040:00080000:3.0:1788201356.000338:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].6, 120 off9272 00000040:00080000:3.0:1788201356.000345:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].7, 168 off9440 00000040:00080000:3.0:1788201356.000351:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].8, 224 off9664 00000040:00080000:3.0:1788201356.000358:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].9, 224 off9888 00000040:00080000:3.0:1788201356.000364:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].10, 120 off10008 00000040:00080000:3.0:1788201356.000371:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].11, 224 off10232 00000040:00080000:3.0:1788201356.000378:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].12, 224 off10456 00000040:00080000:3.0:1788201356.000385:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].13, 88 off10544 00000040:00080000:3.0:1788201356.000392:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].14, 128 off10672 00000040:00080000:3.0:1788201356.000399:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].15, 144 off10816 00000040:00080000:3.0:1788201356.000405:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].16, 160 off10976 00000040:00080000:3.0:1788201356.000412:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].17, 224 off11200 00000040:00080000:3.0:1788201356.000426:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].18, 224 off11424 00000040:00080000:3.0:1788201356.000433:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].19, 80 off11504 00000040:00080000:3.0:1788201356.000440:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].20, 224 off11728 00000040:00080000:3.0:1788201356.000447:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].21, 224 off11952 00000040:00080000:3.0:1788201356.000453:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].22, 88 off12040 00000040:00080000:3.0:1788201356.000460:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].23, 128 off12168 00000040:00080000:3.0:1788201356.000466:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].24, 144 off12312 00000040:00080000:3.0:1788201356.000473:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].25, 160 off12472 00000040:00080000:3.0:1788201356.000479:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].26, 224 off12696 00000040:00080000:3.0:1788201356.000485:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].27, 224 off12920 00000040:00080000:3.0:1788201356.000492:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].28, 80 off13000 00000040:00080000:3.0:1788201356.000498:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].29, 224 off13224 00000040:00080000:3.0:1788201356.000505:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].30, 224 off13448 00000040:00080000:3.0:1788201356.000512:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].31, 88 off13536 00000040:00080000:3.0:1788201356.000518:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].32, 128 off13664 00000040:00080000:3.0:1788201356.000525:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].33, 144 off13808 00000040:00080000:3.0:1788201356.000531:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].34, 128 off13936 00000040:00080000:3.0:1788201356.000538:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].35, 224 off14160 00000040:00080000:3.0:1788201356.000544:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].36, 224 off14384 00000040:00080000:3.0:1788201356.000551:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].37, 80 off14464 00000040:00080000:3.0:1788201356.000557:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].38, 224 off14688 00000040:00080000:3.0:1788201356.000564:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].39, 224 off14912 00000040:00080000:3.0:1788201356.000571:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].40, 88 off15000 00000040:00080000:3.0:1788201356.000578:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].41, 128 off15128 00000040:00080000:3.0:1788201356.000585:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].42, 144 off15272 00000040:00080000:3.0:1788201356.000597:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].43, 128 off15400 00000040:00080000:3.0:1788201356.000609:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].44, 224 off15624 00000040:00080000:3.0:1788201356.000622:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].45, 224 off15848 00000040:00080000:3.0:1788201356.000634:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].46, 80 off15928 00000040:00080000:3.0:1788201356.000647:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].47, 224 off16152 00000040:00080000:3.0:1788201356.000655:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].48, 232 off16384 00000040:00080000:3.0:1788201356.000725:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].49, 224 off16608 00000040:00080000:3.0:1788201356.000738:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].50, 120 off16728 00000040:00080000:3.0:1788201356.000751:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].51, 224 off16952 00000040:00080000:3.0:1788201356.000759:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].52, 224 off17176 00000040:00080000:3.0:1788201356.000766:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].53, 112 off17288 00000040:00080000:3.0:1788201356.000777:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].54, 224 off17512 00000040:00080000:3.0:1788201356.000784:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].55, 224 off17736 00000040:00080000:3.0:1788201356.000791:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].56, 136 off17872 00000040:00080000:3.0:1788201356.000798:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].57, 224 off18096 00000040:00080000:3.0:1788201356.000804:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].58, 224 off18320 00000040:00080000:3.0:1788201356.000811:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].59, 136 off18456 00000040:00080000:3.0:1788201356.000818:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].60, 224 off18680 00000040:00080000:3.0:1788201356.000842:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].61, 224 off18904 00000040:00080000:3.0:1788201356.000861:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].62, 112 off19016 00000040:00080000:3.0:1788201356.000880:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].63, 224 off19240 00000040:00080000:3.0:1788201356.000886:0:99760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 63 count 63 00000100:00100000:3.0:1788201356.000957:0:99760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715336320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201356.001048:0:99760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201356.001080:0:99760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccf900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201356.001244:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715336320 00000100:00100000:2.0:1788201356.001251:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715336320 00000100:00100000:2.0:1788201356.001288:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788201356.001297:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12e6ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+21:99760:x1875060715336320:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201356.001404:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12e6ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+21:99760:x1875060715336320:12345-0@lo:501:mount.lustre.0 Request processed in 107us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201356.001412:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788201356.001424:0:99760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715336320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201356.001454:0:99760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715336448:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201356.001492:0:99760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201356.001515:0:99760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccf900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201356.001950:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715336448 00000100:00100000:2.0:1788201356.001956:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715336448 00000100:00100000:2.0:1788201356.001994:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788201356.002001:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134207c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:99760:x1875060715336448:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201356.002561:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134207c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:99760:x1875060715336448:12345-0@lo:503:mount.lustre.0 Request processed in 558us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201356.002569:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788201356.002668:0:99760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715336448:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788201356.003937:0:99760:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788201356.004047:0:99760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715336576:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201356.004099:0:99760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201356.004253:0:99760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201356.004328:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715336576 00000100:00100000:3.0:1788201356.004334:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715336576 00000100:00100000:3.0:1788201356.004411:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788201356.004420:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134204850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:99760:x1875060715336576:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201356.004564:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134204850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:99760:x1875060715336576:12345-0@lo:502:mount.lustre.0 Request processed in 145us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201356.004572:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788201356.004654:0:99760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715336576:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201356.004841:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].1, 224 off8416 00000040:00080000:1.0:1788201356.004865:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].2, 120 off8536 00000040:00080000:1.0:1788201356.004876:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].3, 168 off8704 00000040:00080000:1.0:1788201356.004888:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].4, 224 off8928 00000040:00080000:1.0:1788201356.004900:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].5, 224 off9152 00000040:00080000:1.0:1788201356.004913:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].6, 120 off9272 00000040:00080000:1.0:1788201356.004926:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].7, 168 off9440 00000040:00080000:1.0:1788201356.004939:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].8, 224 off9664 00000040:00080000:1.0:1788201356.004959:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].9, 224 off9888 00000040:00080000:1.0:1788201356.004973:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].10, 120 off10008 00000040:00080000:1.0:1788201356.004986:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].11, 224 off10232 00000040:00080000:1.0:1788201356.004999:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].12, 224 off10456 00000040:00080000:1.0:1788201356.005011:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].13, 88 off10544 00000040:00080000:1.0:1788201356.005421:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].14, 128 off10672 00000040:00080000:1.0:1788201356.005442:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].15, 144 off10816 00000040:00080000:1.0:1788201356.005455:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].16, 160 off10976 00000040:00080000:1.0:1788201356.005469:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].17, 224 off11200 00000040:00080000:1.0:1788201356.005482:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].18, 224 off11424 00000040:00080000:1.0:1788201356.005495:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].19, 80 off11504 00000040:00080000:1.0:1788201356.005508:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].20, 224 off11728 00000040:00080000:1.0:1788201356.005520:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].21, 224 off11952 00000040:00080000:1.0:1788201356.005530:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].22, 88 off12040 00000040:00080000:1.0:1788201356.005542:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].23, 128 off12168 00000040:00080000:1.0:1788201356.005555:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].24, 144 off12312 00000040:00080000:1.0:1788201356.005567:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].25, 160 off12472 00000040:00080000:1.0:1788201356.005592:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].26, 224 off12696 00000040:00080000:1.0:1788201356.005608:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].27, 224 off12920 00000040:00080000:1.0:1788201356.005621:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].28, 80 off13000 00000040:00080000:1.0:1788201356.005635:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].29, 224 off13224 00000040:00080000:1.0:1788201356.005650:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].30, 224 off13448 00000040:00080000:1.0:1788201356.005662:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].31, 88 off13536 00000040:00080000:1.0:1788201356.005676:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].32, 128 off13664 00000040:00080000:1.0:1788201356.005688:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].33, 144 off13808 00000040:00080000:1.0:1788201356.005700:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].34, 128 off13936 00000040:00080000:1.0:1788201356.005713:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].35, 224 off14160 00000040:00080000:1.0:1788201356.005726:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].36, 224 off14384 00000040:00080000:1.0:1788201356.005738:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].37, 80 off14464 00000040:00080000:1.0:1788201356.005751:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].38, 224 off14688 00000040:00080000:1.0:1788201356.005765:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].39, 224 off14912 00000040:00080000:1.0:1788201356.005776:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].40, 88 off15000 00000040:00080000:1.0:1788201356.005789:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].41, 128 off15128 00000040:00080000:1.0:1788201356.005810:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].42, 144 off15272 00000040:00080000:1.0:1788201356.005837:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].43, 128 off15400 00000040:00080000:1.0:1788201356.005853:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].44, 224 off15624 00000040:00080000:1.0:1788201356.005866:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].45, 224 off15848 00000040:00080000:1.0:1788201356.005877:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].46, 80 off15928 00000040:00080000:1.0:1788201356.005888:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].47, 224 off16152 00000040:00080000:1.0:1788201356.005901:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].48, 232 off16384 00000100:00100000:1.0:1788201356.005940:0:99760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125808380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715336704:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201356.005991:0:99760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201356.006892:0:99760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004bde900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201356.006965:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715336704 00000100:00100000:3.0:1788201356.006972:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715336704 00000100:00100000:2.0:1788201356.007102:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788201356.007113:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134207450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:99760:x1875060715336704:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201356.007486:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134207450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:99760:x1875060715336704:12345-0@lo:502:mount.lustre.0 Request processed in 375us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201356.007494:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788201356.007563:0:99760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125808380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715336704:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201356.007726:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].49, 224 off16608 00000040:00080000:1.0:1788201356.007751:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].50, 120 off16728 00000040:00080000:1.0:1788201356.007767:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].51, 224 off16952 00000040:00080000:1.0:1788201356.007781:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].52, 224 off17176 00000040:00080000:1.0:1788201356.007797:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].53, 112 off17288 00000040:00080000:1.0:1788201356.007811:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].54, 224 off17512 00000040:00080000:1.0:1788201356.007840:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].55, 224 off17736 00000040:00080000:1.0:1788201356.007856:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].56, 136 off17872 00000040:00080000:1.0:1788201356.007870:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].57, 224 off18096 00000040:00080000:1.0:1788201356.007882:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].58, 224 off18320 00000040:00080000:1.0:1788201356.007896:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].59, 136 off18456 00000040:00080000:1.0:1788201356.007910:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].60, 224 off18680 00000040:00080000:1.0:1788201356.007924:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].61, 224 off18904 00000040:00080000:1.0:1788201356.007939:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].62, 112 off19016 00000100:00100000:1.0:1788201356.007965:0:99760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125808380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715336832:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201356.008004:0:99760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201356.008107:0:99760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004bde900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201356.008304:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715336832 00000100:00100000:2.0:1788201356.008317:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715336832 00000100:00100000:2.0:1788201356.008353:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788201356.008360:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+21:99760:x1875060715336832:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201356.008480:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+21:99760:x1875060715336832:12345-0@lo:502:mount.lustre.0 Request processed in 119us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201356.008487:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788201356.008548:0:99760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125808380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715336832:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201356.008592:0:99760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].63, 224 off19240 00000040:00080000:1.0:1788201356.008600:0:99760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 00000020:01000004:3.0:1788201356.009674:0:99784:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788201356.009687:0:99784:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8dc12ef60000) 00000020:00000080:3.0:1788201356.009705:0:99784:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788201356.009763:0:99784:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc12b6bc800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788201356.009765:0:99784:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc12b6bc800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788201356.009767:0:99784:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc12b6bc800 3 00010000:00080000:3.0:1788201356.009788:0:99784:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc11ccfb000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.120@tcp at head 00010000:00010000:3.0:1788201356.011377:0:99784:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1788201356.011561:0:99784:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788201356.011596:0:99784:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788201356.011607:0:99784:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x96d0c9b8c9a1d6df 00000100:00080000:3.0:1788201356.011616:0:99784:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201356.011620:0:99784:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc11ccfb000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201356.011652:0:99784:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc1060cf800 x1875060715336960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201356.011688:0:99784:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788201356.011871:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715336960:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788201356.011938:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201356.012116:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715336960 00000100:00100000:3.0:1788201356.012123:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715336960 00000100:00100000:3.0:1788201356.012189:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1613 00000100:00100000:3.0:1788201356.012197:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715336960:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788201356.012220:0:66314:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 4207 last 0 00000020:00000080:3.0:1788201356.012249:0:66314:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x96d0c9b8c9a1d6e6 00000004:00100000:3.0:1788201356.012263:0:66314:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201356.012293:0:66314:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201356.012343:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875060715336960:12345-0@lo:38:llog_process_th.0 Request processed in 145us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201356.012360:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1613 00000100:00100000:3.0:1788201356.012448:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201356.012456:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 29 00000100:00080000:3.0:1788201356.012462:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788201356.012467:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788201356.012469:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788201356.012475:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715336960:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788201356.012489:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201356.012493:0:57134:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201356.012496:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201356.012499:0:57134:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201356.012523:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201356.012526:0:57134:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201356.012529:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201356.012531:0:57134:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:3.0:1788201356.012548:0:99784:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000100:00100000:0.0:1788201356.012560:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715337472:0@lo:400:kworker.0 00000020:00000080:3.0:1788201356.012563:0:99784:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8dc12f0c3370) 00000020:00000080:3.0:1788201356.012575:0:99784:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000100:00100000:0.0:1788201356.012589:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201356.012613:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201356.012619:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715337088:0@lo:400:kworker.0 00000100:00100000:0.0:1788201356.012644:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201356.012673:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715337216:0@lo:400:kworker.0 00000100:00100000:0.0:1788201356.012696:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201356.012713:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201356.012718:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715337344:0@lo:400:kworker.0 00000100:00100000:0.0:1788201356.012740:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201356.012782:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715337472 00000100:00100000:0.0:1788201356.012786:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715337472 00000020:01000004:3.0:1788201356.012800:0:99784:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc12b6bc800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788201356.012804:0:99784:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc12b6bc800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788201356.012806:0:99784:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc12b6bc800 3 00000100:00100000:0.0:1788201356.012814:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715337216 00000100:00100000:0.0:1788201356.012834:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715337216 00000100:00100000:2.0:1788201356.012854:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715337088 00000100:00100000:0.0:1788201356.012857:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1653 00000100:00100000:2.0:1788201356.012857:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715337088 00000100:00100000:0.0:1788201356.012863:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715337472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201356.012874:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715337344 00000100:00100000:2.0:1788201356.012877:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715337344 00000100:00100000:2.0:1788201356.012888:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201356.012894:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715337088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201356.012898:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715337472:12345-0@lo:400:kworker.0 Request processed in 36us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201356.012904:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1653 00000100:00100000:0.0:1788201356.012916:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1654 00000100:00100000:0.0:1788201356.012922:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715337216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201356.012924:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715337088:12345-0@lo:400:kworker.0 Request processed in 31us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201356.012930:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201356.012941:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788201356.012947:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715337216:12345-0@lo:400:kworker.0 Request processed in 26us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201356.012947:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715337344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201356.012952:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1654 00000100:00100000:2.0:1788201356.012972:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715337344:12345-0@lo:400:kworker.0 Request processed in 25us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201356.012978:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788201356.012983:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715337088:0@lo:400:kworker.0 00000100:00100000:0.0:1788201356.012993:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715337472:0@lo:400:kworker.0 00000100:00100000:0.0:1788201356.013041:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715337344:0@lo:400:kworker.0 00000100:00100000:0.0:1788201356.013050:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715337216:0@lo:400:kworker.0 00010000:00080000:2.0:1788201356.013168:0:99784:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc13f86f000@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.120@tcp at head 00010000:00010000:2.0:1788201356.016473:0:99784:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1788201356.018248:0:99784:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788201356.018301:0:99784:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788201356.018315:0:99784:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x96d0c9b8c9a1d6f4 00000100:00080000:0.0:1788201356.018327:0:99784:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788201356.018333:0:99784:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8dc13f86f000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201356.018369:0:99784:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc007c35c00 x1875060715337600/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201356.018396:0:99784:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788201356.018420:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201356.018430:0:57134:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201356.018432:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201356.018435:0:57134:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201356.018438:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201356.018441:0:57134:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201356.018444:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201356.018447:0:57134:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788201356.018773:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715337600:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788201356.018863:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201356.018909:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715337600 00000100:00100000:3.0:1788201356.018917:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715337600 00000100:00100000:3.0:1788201356.018952:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1614 00000100:00100000:3.0:1788201356.018960:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715337600:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788201356.018986:0:66314:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 4207 last 0 00000020:00000080:3.0:1788201356.019032:0:66314:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x96d0c9b8c9a1d6fb 00000004:00100000:3.0:1788201356.019050:0:66314:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201356.019083:0:66314:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201356.019137:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875060715337600:12345-0@lo:38:llog_process_th.0 Request processed in 177us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201356.019145:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1614 00000100:00100000:1.0:1788201356.019219:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788201356.019228:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 18 00000100:00080000:1.0:1788201356.019301:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788201356.019306:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788201356.019309:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788201356.019315:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715337600:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788201356.020062:0:99784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 64 count 63 00000020:01000000:1.0:1788201356.020396:0:99760:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:1.0:1788201356.020427:0:99760:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201356.020449:0:99760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c75000/0x96d0c9b8c9a1d6ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d6d1 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201356.020459:0:99760:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc108c75000/0x96d0c9b8c9a1d6ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d6d1 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788201356.020505:0:99760:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788201356.020508:0:99760:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201356.020510:0:99760:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201356.020511:0:99760:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201356.020512:0:99760:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201356.020513:0:99760:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201356.020515:0:99760:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201356.020516:0:99760:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201356.020518:0:99760:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201356.020522:0:99760:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788201356.020524:0:99760:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788201356.020525:0:99760:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201356.020531:0:99760:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201356.020532:0:99760:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201356.020533:0:99760:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201356.020534:0:99760:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201356.020535:0:99760:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201356.020535:0:99760:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201356.020536:0:99760:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201356.020554:0:99760:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788201356.020571:0:99760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12580a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715337728:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788201356.020632:0:99760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201356.020661:0:99760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004bde900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201356.020714:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715337728 00000100:00100000:3.0:1788201356.020720:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715337728 00000100:00100000:3.0:1788201356.020770:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788201356.020841:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:99760:x1875060715337728:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788201356.020865:0:94461:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788201356.020877:0:94461:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788201356.027591:0:94461:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788201356.027610:0:94461:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788201356.027679:0:94465:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788201356.027685:0:94465:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788201356.027708:0:94465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc108c74400/0x96d0c9b8c9a1d702 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201356.027729:0:94465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc006dbda00/0x96d0c9b8c9a1d5dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ca1 expref: 9 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201356.027738:0:94465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc108c75600/0x96d0c9b8c9a1d5ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d5e3 expref: 21 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201356.027746:0:94465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc108c74e00/0x96d0c9b8c9a1d5f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d5f1 expref: 21 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201356.027753:0:94465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dc108c74400/0x96d0c9b8c9a1d702 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201356.027795:0:94465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc108c74e00/0x96d0c9b8c9a1d5f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1d5f1 expref: 21 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201356.027810:0:94465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc108c74e00/0x96d0c9b8c9a1d5f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d5f1 expref: 21 pid: 94461 timeout: 4307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201356.027923:0:94465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cf800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715337856:0@lo:104: 00000100:00100000:3.0:1788201356.027992:0:94465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201356.028450:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:99760:x1875060715337728:12345-0@lo:253:mount.lustre.0 Request processed in 7671us (7817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201356.028466:0:95383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715337856 00000100:00100000:2.0:1788201356.028470:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788201356.028474:0:95383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715337856 00000100:00100000:0.0:1788201356.028513:0:95383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1788201356.028524:0:95383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c9b18af6-fecc-4172-82c2-66531890fe11+3:94465:x1875060715337856:12345-0@lo:104: 00010000:00010000:0.0:1788201356.028538:0:95383:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1d5f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1d5f8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201356.028598:0:95383:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201356.028604:0:95383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c9b18af6-fecc-4172-82c2-66531890fe11+3:94465:x1875060715337856:12345-0@lo:104: Request processed in 83us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201356.028610:0:95383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00010000:00010000:2.0:1788201356.028684:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201356.028690:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1d5f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1d5f8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201356.028698:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59a00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788201356.028702:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1d5f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1d5f8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201356.028709:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1d5f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1d5f8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201356.028716:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1d5f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1d5f8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201356.028721:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201356.028756:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1d5f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1d5f8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201356.028762:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201356.028772:0:94465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc108c75600/0x96d0c9b8c9a1d5ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1d5e3 expref: 20 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201356.028780:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1d5f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1d5f8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201356.028787:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1d5f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1d5f8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201356.028791:0:94465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc108c75600/0x96d0c9b8c9a1d5ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d5e3 expref: 20 pid: 94461 timeout: 4307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201356.028798:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201356.028799:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201356.028801:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201356.028801:0:94465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cfb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715338112:0@lo:104: 00000100:00100000:2.0:1788201356.028813:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715337984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201356.028842:0:94465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201356.028859:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201356.028870:0:94465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc006dbda00/0x96d0c9b8c9a1d5dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ca1 expref: 9 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201356.028879:0:94465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc006dbda00/0x96d0c9b8c9a1d5dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ca1 expref: 9 pid: 94461 timeout: 4307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201356.028888:0:94465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715338240:192.168.201.20@tcp:104: 00000100:00100000:2.0:1788201356.028894:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715337984 00000100:00100000:2.0:1788201356.028898:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715337984 00010000:00010000:2.0:1788201356.028915:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc108c74e00/0x96d0c9b8c9a1d5f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d5f1 expref: 21 pid: 94461 timeout: 4307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201356.028933:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2618 00000100:00100000:3.0:1788201356.028935:0:94465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccf480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201356.028939:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+21:3656:x1875060715337984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201356.028949:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788201356.028951:0:94465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cf800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715337856:0@lo:104: 00010000:00010000:2.0:1788201356.028953:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc108c74e00/0x96d0c9b8c9a1d5f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d5f1 expref: 21 pid: 94461 timeout: 4307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201356.028962:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc108c74e00/0x96d0c9b8c9a1d5f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d5f1 expref: 21 pid: 94461 timeout: 4307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201356.028968:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715338112 00000100:00100000:3.0:1788201356.028970:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715338112 00010000:00010000:2.0:1788201356.028973:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc108c74e00/0x96d0c9b8c9a1d5f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d5f1 expref: 21 pid: 94461 timeout: 4307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201356.028984:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201356.028992:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788201356.028997:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+3:94465:x1875060715338112:12345-0@lo:104: 00010000:00010000:3.0:1788201356.029006:0:19665:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d5e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1d5ea expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201356.029007:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+20:3656:x1875060715337984:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201356.029031:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2618 00010000:00010000:3.0:1788201356.029059:0:19665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201356.029061:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715337984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201356.029064:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+3:94465:x1875060715338112:12345-0@lo:104: Request processed in 67us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201356.029070:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1788201356.029364:0:99760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12580a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:99760:1875060715337728:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788201356.029376:0:99760:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788201356.029379:0:99760:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788201356.029381:0:99760:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201356.029382:0:99760:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201356.029383:0:99760:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201356.029385:0:99760:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201356.029386:0:99760:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201356.029388:0:99760:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201356.029389:0:99760:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201356.029391:0:99760:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788201356.029401:0:99760:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788201356.029969:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201356.029975:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d5e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1d5ea expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201356.029983:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbcc00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201356.029987:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d5e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1d5ea expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201356.030005:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d5e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1d5ea expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201356.030011:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d5e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1d5ea expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201356.030037:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201356.030059:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d5e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1d5ea expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201356.030066:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201356.030081:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d5e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1d5ea expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201356.030088:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d5e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1d5ea expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201356.030100:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201356.030102:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201356.030104:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201356.030116:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715338368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201356.030167:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201356.030219:0:9535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715338368 00000100:00100000:0.0:1788201356.030224:0:9535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715338368 00000100:00100000:2.0:1788201356.031090:0:94465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cfb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715338112:0@lo:104: 00010000:00010000:0.0:1788201356.031368:0:9535:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc108c75600/0x96d0c9b8c9a1d5ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d5e3 expref: 20 pid: 94461 timeout: 4307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201356.031408:0:9535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2619 00000100:00100000:0.0:1788201356.031420:0:9535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9b18af6-fecc-4172-82c2-66531890fe11+20:3657:x1875060715338368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201356.031443:0:9535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201356.031449:0:9535:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc108c75600/0x96d0c9b8c9a1d5ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d5e3 expref: 20 pid: 94461 timeout: 4307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201356.031459:0:9535:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc108c75600/0x96d0c9b8c9a1d5ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d5e3 expref: 20 pid: 94461 timeout: 4307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201356.031474:0:9535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc108c75600/0x96d0c9b8c9a1d5ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d5e3 expref: 20 pid: 94461 timeout: 4307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201356.031488:0:9535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201356.031537:0:9535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9b18af6-fecc-4172-82c2-66531890fe11+19:3657:x1875060715338368:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201356.031544:0:9535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2619 00000100:00100000:2.0:1788201356.031598:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715338368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201356.033479:0:94465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715338240:192.168.201.20@tcp:104: 00010000:00010000:0.0:1788201356.033508:0:94465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dc108c74400/0x96d0c9b8c9a1d702 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1788201356.034726:0:99760:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901888 00000100:00100000:3.0:1788201356.036242:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201356.036424:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695506688 00000100:00100000:1.0:1788201356.036433:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695506688 00010000:00010000:1.0:1788201356.036471:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc006dbda00/0x96d0c9b8c9a1d5dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ca1 expref: 10 pid: 94461 timeout: 4307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201356.036511:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2620 00000100:00100000:1.0:1788201356.036521:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695506688:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201356.036535:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201356.036542:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc006dbda00/0x96d0c9b8c9a1d5dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ca1 expref: 10 pid: 94461 timeout: 4307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201356.036571:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc006dbda00/0x96d0c9b8c9a1d5dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ca1 expref: 10 pid: 94461 timeout: 4307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201356.036589:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006dbda00/0x96d0c9b8c9a1d5dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ca1 expref: 10 pid: 94461 timeout: 4307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201356.036605:0:26215:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dc108c74400/0x96d0c9b8c9a1d702 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201356.036614:0:26215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc108c74400/0x96d0c9b8c9a1d702 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788201356.036631:0:26215:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.036317302s 00010000:00010000:1.0:1788201356.036636:0:26215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc108c74400/0x96d0c9b8c9a1d702 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201356.036643:0:26215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc108c74400/0x96d0c9b8c9a1d702 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201356.036650:0:26215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc108c74400/0x96d0c9b8c9a1d702 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201356.036656:0:26215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc108c74400/0x96d0c9b8c9a1d702 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201356.036662:0:26215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201356.036667:0:26215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc108c74400/0x96d0c9b8c9a1d702 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201356.036674:0:26215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc108c74400/0x96d0c9b8c9a1d702 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201356.036710:0:26215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc108c74400/0x96d0c9b8c9a1d702 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201356.036722:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201356.036775:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:2401:x1875060695506688:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 255us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201356.036783:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2620 00010000:00010000:3.0:1788201356.036904:0:94465:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dc108c74400/0x96d0c9b8c9a1d702 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201356.036919:0:94465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc108c74400/0x96d0c9b8c9a1d702 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201356.036924:0:94465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc108c74400/0x96d0c9b8c9a1d702 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788201356.044002:0:99760:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788201356.044053:0:99760:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788201356.044096:0:99760:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788201356.044147:0:99760:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788201356.044167:0:99760:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788201356.044187:0:99760:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788201356.047908:0:99760:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788201356.048235:0:99760:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788201356.053622:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201356.244814:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201356.244877:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201356.244912:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201356.245073:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695507072 00000100:00100000:0.0:1788201356.245083:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695507072 00000100:00100000:0.0:1788201356.245158:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695506944 00000100:00100000:0.0:1788201356.245161:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695506944 00000100:00100000:0.0:1788201356.245184:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1655 00000100:00100000:0.0:1788201356.245194:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695507072:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201356.245283:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695507072:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 90us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201356.245291:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1655 00000100:00100000:0.0:1788201356.245319:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1656 00000100:00100000:0.0:1788201356.245326:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2403:x1875060695506944:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201356.245352:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2403:x1875060695506944:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201356.245357:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1656 00000100:00100000:2.0:1788201356.246378:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695506816 00000100:00100000:2.0:1788201356.246386:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695506816 00000100:00100000:2.0:1788201356.246437:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 292 00000100:00100000:2.0:1788201356.246446:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134205850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:2403:x1875060695506816:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201356.246499:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134205850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:2403:x1875060695506816:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 54us (1696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201356.246505:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 292 00000100:00080000:3.0:1788201356.246791:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201356.246796:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000004:1.0:1788201357.058514:0:99838:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788201357.060989:0:99838:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788201357.073151:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788201357.527834:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788201357.527842:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc11d438000 from 130 10000000:01000000:3.0:1788201357.527847:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788201357.527893:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1d709 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201357.527905:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1d709 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201357.527916:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1d709 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201357.527942:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715338496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201357.528012:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201357.528082:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccf000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201357.533902:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715338496 00000100:00100000:0.0:1788201357.533919:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715338496 00000100:00100000:0.0:1788201357.533981:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788201357.533990:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134206450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715338496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201357.534006:0:94467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201357.534050:0:94467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00896b600/0x96d0c9b8c9a1d710 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1d709 expref: -99 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.534078:0:94467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00896b600/0x96d0c9b8c9a1d710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d709 expref: 20 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.534089:0:94467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00896b600/0x96d0c9b8c9a1d710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d709 expref: 20 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.534098:0:94467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896b600, rc 0) 00000100:00100000:0.0:1788201357.534176:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134206450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715338496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (6163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201357.534182:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788201357.534235:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715338496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201357.534251:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1d709 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d710 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.534276:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1d709 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d710 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201357.534348:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715338624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788201357.534383:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201357.534411:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121b48a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201357.534423:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715338624 00000100:00100000:0.0:1788201357.534426:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715338624 00000100:00100000:0.0:1788201357.534449:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788201357.534455:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134207850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715338624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788201357.534469:0:94464:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788201357.534485:0:94464:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788201357.534488:0:94464:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 130 00000100:00100000:0.0:1788201357.534561:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134207850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715338624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201357.534567:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788201357.534598:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715338624:0@lo:256:ll_cfg_requeue.0 00000100:00080000:0.0:1788201357.534638:0:6529:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8dc109815000 already not connected (conn 16, was 0): CONNECTING 00010000:00080000:0.0:1788201357.534649:0:6529:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8dc109815000@lustre-OST0000-osc-MDT0000: found existing conn 192.168.201.120@tcp, moved to head 10000000:01000000:0.0:1788201357.534670:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788201357.534677:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1d709 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d710 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.534684:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1d709 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d710 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201357.534704:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788201357.534706:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc0053a4000 from 130 10000000:01000000:0.0:1788201357.534708:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788201357.534727:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00896ae00/0x96d0c9b8c9a1d717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.534734:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc00896ae00/0x96d0c9b8c9a1d717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.534742:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc00896ae00/0x96d0c9b8c9a1d717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201357.534754:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715338752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201357.534781:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201357.534808:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc109832600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201357.534819:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715338752 00000100:00100000:0.0:1788201357.534823:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715338752 00000100:00100000:0.0:1788201357.534845:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788201357.534851:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc134204c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715338752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201357.534858:0:94467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201357.534866:0:94467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00896b000/0x96d0c9b8c9a1d71e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1d717 expref: -99 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.534880:0:94467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00896b000/0x96d0c9b8c9a1d71e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d717 expref: 21 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.534888:0:94467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00896b000/0x96d0c9b8c9a1d71e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d717 expref: 21 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.534905:0:94467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896b000, rc 0) 00000100:00100000:0.0:1788201357.534933:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc134204c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715338752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201357.534939:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788201357.534968:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715338752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201357.534978:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc00896ae00/0x96d0c9b8c9a1d717 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d71e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.534986:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc00896ae00/0x96d0c9b8c9a1d717 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d71e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201357.535044:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715338880:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788201357.535070:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201357.535082:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc109832600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201357.535093:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715338880 00000100:00100000:0.0:1788201357.535097:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715338880 00000100:00100000:0.0:1788201357.535117:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788201357.535123:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715338880:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788201357.535134:0:94463:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788201357.535145:0:94463:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788201357.535147:0:94463:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 130 00000100:00100000:0.0:1788201357.535204:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715338880:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 81us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201357.535211:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788201357.535239:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715338880:0@lo:256:ll_cfg_requeue.0 00000100:00080000:0.0:1788201357.535270:0:6529:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8dc006d84000 already not connected (conn 16, was 0): CONNECTING 00010000:00080000:0.0:1788201357.535275:0:6529:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8dc006d84000@lustre-OST0000-osc-MDT0001: found existing conn 192.168.201.120@tcp, moved to head 10000000:01000000:0.0:1788201357.535295:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788201357.535299:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00896ae00/0x96d0c9b8c9a1d717 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d71e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.535305:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc00896ae00/0x96d0c9b8c9a1d717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d71e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201357.784133:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201357.784222:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695507200 00000100:00100000:0.0:1788201357.784235:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695507200 00000100:00100000:0.0:1788201357.784295:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 297 00000100:00100000:0.0:1788201357.784306:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695507200:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201357.784322:0:94464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201357.784339:0:94464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00896a600/0x96d0c9b8c9a1d725 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ca8 expref: -99 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.784366:0:94464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00896a600/0x96d0c9b8c9a1d725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ca8 expref: 10 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.784378:0:94464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00896a600/0x96d0c9b8c9a1d725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ca8 expref: 10 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201357.784388:0:94464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896a600, rc 0) 00000100:00100000:0.0:1788201357.784441:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695507200:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 136us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201357.784448:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 297 00000100:00100000:0.0:1788201357.788320:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201357.788414:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695507328 00000100:00100000:2.0:1788201357.788425:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695507328 00000100:00100000:2.0:1788201357.788488:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 298 00000100:00100000:2.0:1788201357.788499:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695507328:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201357.788525:0:94467:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1788201357.788542:0:94467:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201357.788544:0:94467:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 130 00000100:00100000:2.0:1788201357.789773:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695507328:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 Request processed in 1269us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201357.789785:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 298 00010000:00010000:3.0:1788201358.095491:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201359.120262:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201359.695281:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715339008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201359.695360:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201359.695481:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715339008 00000100:00100000:3.0:1788201359.695492:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715339008 00000100:00100000:3.0:1788201359.695545:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788201359.695555:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715339008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788201359.695590:0:66317:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:3.0:1788201359.695638:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715339008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201359.695646:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201359.695828:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715339008:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788201360.143141:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201360.209053:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715339136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201360.209126:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201360.209204:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715339136 00000100:00100000:3.0:1788201360.209212:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715339136 00000100:00100000:3.0:1788201360.209269:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788201360.209278:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12580a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715339136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201360.209314:0:66317:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:3.0:1788201360.213550:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12580a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715339136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4262us (4413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201360.213565:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788201360.213689:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715339136:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788201361.168784:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201361.232597:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715339264:0@lo:400:kworker.0 00000100:00100000:3.0:1788201361.232677:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201361.232765:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715339264 00000100:00100000:0.0:1788201361.232773:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715339264 00000100:00100000:0.0:1788201361.232821:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788201361.232831:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:3656:x1875060715339264:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788201361.232913:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201361.232918:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201361.232921:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201361.232925:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788201361.242929:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:3656:x1875060715339264:12345-0@lo:400:kworker.0 Request processed in 10088us (10241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201361.242945:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788201361.243066:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715339392:0@lo:400:kworker.0 00000100:00100000:0.0:1788201361.243119:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201361.243153:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201361.243160:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715339520:0@lo:400:kworker.0 00000100:00100000:0.0:1788201361.243184:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201361.243223:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715339392 00000100:00100000:0.0:1788201361.243230:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715339392 00000100:00100000:0.0:1788201361.243270:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788201361.243280:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715339392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201361.243329:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715339392:12345-0@lo:400:kworker.0 Request processed in 50us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201361.243335:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788201361.243368:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715339392:0@lo:400:kworker.0 00000100:00100000:3.0:1788201361.243459:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715339264:0@lo:400:kworker.0 00000100:00100000:3.0:1788201361.243474:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715339520 00000100:00100000:3.0:1788201361.243477:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715339520 00000100:00100000:3.0:1788201361.243580:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1657 00000100:00100000:3.0:1788201361.243587:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715339520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201361.243624:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715339520:12345-0@lo:400:kworker.0 Request processed in 38us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201361.243638:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1657 00000100:00100000:3.0:1788201361.243664:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12580b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715339648:0@lo:400:kworker.0 00000100:00100000:3.0:1788201361.243690:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201361.243795:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201361.243800:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201361.243802:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201361.243805:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788201361.243843:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201361.243850:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12580aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715339776:0@lo:400:kworker.0 00000100:00100000:1.0:1788201361.243878:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201361.243929:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201361.243935:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12580a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715339904:0@lo:400:kworker.0 00000100:00100000:1.0:1788201361.243963:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201361.243996:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715340032:0@lo:400:kworker.0 00000100:00100000:1.0:1788201361.244032:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201361.244060:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715339776 00000100:00100000:1.0:1788201361.244064:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715339776 00000100:00100000:1.0:1788201361.244087:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715339904 00000100:00100000:1.0:1788201361.244090:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715339904 00000100:00100000:1.0:1788201361.244112:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715340032 00000100:00100000:1.0:1788201361.244115:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715340032 00000100:00100000:1.0:1788201361.244129:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1658 00000100:00100000:1.0:1788201361.244135:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12580b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715339776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201361.244170:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12580b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715339776:12345-0@lo:400:kworker.0 Request processed in 34us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201361.244176:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1658 00000100:00100000:1.0:1788201361.244189:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1659 00000100:00100000:1.0:1788201361.244194:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715339904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201361.244220:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715339904:12345-0@lo:400:kworker.0 Request processed in 26us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201361.244226:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1659 00000100:00100000:1.0:1788201361.244237:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1660 00000100:00100000:1.0:1788201361.244243:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715340032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201361.244270:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715340032:12345-0@lo:400:kworker.0 Request processed in 28us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201361.244275:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1660 00000100:00080000:1.0:1788201361.244292:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201361.244302:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201361.244322:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715340032:0@lo:400:kworker.0 00000100:00100000:1.0:1788201361.244333:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12580a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715339904:0@lo:400:kworker.0 00000100:00100000:1.0:1788201361.244357:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12580aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715339776:0@lo:400:kworker.0 00000100:00100000:0.0:1788201361.244572:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715339520:0@lo:400:kworker.0 00000100:00100000:0.0:1788201361.244592:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715339648 00000100:00100000:0.0:1788201361.244595:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715339648 00000100:00100000:0.0:1788201361.244636:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788201361.244642:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715339648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201361.244725:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715339648:12345-0@lo:400:kworker.0 Request processed in 82us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201361.244742:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201361.248760:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12580b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715339648:0@lo:400:kworker.0 00000100:00100000:0.0:1788201361.380400:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201361.380487:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201361.380523:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201361.380553:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695507712 00000100:00100000:0.0:1788201361.380563:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695507712 00000100:00100000:0.0:1788201361.380619:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695507584 00000100:00100000:0.0:1788201361.380621:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695507584 00000100:00100000:0.0:1788201361.380642:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1661 00000100:00100000:0.0:1788201361.380651:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2400:x1875060695507712:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201361.380724:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2400:x1875060695507712:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 75us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201361.380743:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1661 00000100:00100000:0.0:1788201361.380761:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1662 00000100:00100000:0.0:1788201361.380768:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2400:x1875060695507584:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201361.380795:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2400:x1875060695507584:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201361.380800:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1662 00000100:00080000:0.0:1788201361.380821:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201361.380825:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201361.386555:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695507456 00000100:00100000:3.0:1788201361.386575:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695507456 00000100:00100000:2.0:1788201361.386720:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 300 00000100:00100000:2.0:1788201361.386748:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695507456:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201361.386845:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695507456:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 100us (6453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201361.386853:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 300 00010000:00010000:2.0:1788201362.192757:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201362.327130:0:100128:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788201363.218188:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788201363.368806:0:100180:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788201363.368999:0:100180:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788201364.239205:0:3654:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201349/real 1788201349] req@ffff8dc0058a9880 x1875060715333760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201364 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201364.239236:0:3654:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dc0058a9880 x1875060715333760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201364 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201364.239258:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201364.239283:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788201364.239288:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715333760:0@lo:8:kworker.0 00000100:00080000:1.0:1788201364.239471:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201364.239476:0:57134:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201364.239479:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201364.239482:0:57134:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201364.239506:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201364.239509:0:57134:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201364.239512:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201364.239515:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788201364.239517:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201364.239523:0:57134:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4201 00000100:00080000:1.0:1788201364.239527:0:57134:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201364.239533:0:57134:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dc1257f0800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201364.239551:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004b3a300 x1875060715340672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201364.239595:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715340544:0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.239655:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201364.239712:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788201364.239718:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715340416:0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.239762:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201364.239781:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715341056:0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.239800:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201364.239831:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715340544 00000100:00100000:1.0:1788201364.239837:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715340544 00000100:00100000:1.0:1788201364.239877:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201364.239886:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715340544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.239930:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715340544:12345-0@lo:400:kworker.0 Request processed in 44us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201364.239937:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201364.239959:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715340416 00000100:00100000:1.0:1788201364.239962:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715340416 00000100:00100000:1.0:1788201364.239984:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715341056 00000100:00100000:1.0:1788201364.239986:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715341056 00000100:00100000:1.0:1788201364.240010:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1663 00000100:00100000:1.0:1788201364.240053:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715340416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.240082:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715340416:12345-0@lo:400:kworker.0 Request processed in 66us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201364.240088:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1663 00000100:00100000:1.0:1788201364.240099:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1664 00000100:00100000:1.0:1788201364.240105:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12580b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715341056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.240126:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12580b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715341056:12345-0@lo:400:kworker.0 Request processed in 22us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201364.240132:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1664 00000100:00080000:1.0:1788201364.240156:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201364.240194:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715340416:0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.240213:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715341056:0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.240221:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715340544:0@lo:400:kworker.0 00000100:00100000:3.0:1788201364.240313:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715340288:0@lo:400:kworker.0 00000100:00100000:3.0:1788201364.240342:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201364.240366:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715340928:0@lo:400:kworker.0 00000100:00100000:3.0:1788201364.240385:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201364.240404:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788201364.240409:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715340160:0@lo:400:kworker.0 00000100:00100000:3.0:1788201364.240432:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201364.240454:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715340800:0@lo:400:kworker.0 00000100:00100000:3.0:1788201364.240472:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201364.240495:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715340928 00000100:00100000:3.0:1788201364.240498:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715340928 00000100:00100000:3.0:1788201364.240518:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715340800 00000100:00100000:3.0:1788201364.240521:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715340800 00000100:00100000:3.0:1788201364.240534:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1665 00000100:00100000:3.0:1788201364.240540:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715340928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201364.240570:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715340928:12345-0@lo:400:kworker.0 Request processed in 30us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201364.240576:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1665 00000100:00100000:3.0:1788201364.240596:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1666 00000100:00100000:3.0:1788201364.240601:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715340800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201364.240626:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715340800:12345-0@lo:400:kworker.0 Request processed in 25us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201364.240631:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1666 00000100:00100000:3.0:1788201364.240647:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715340160 00000100:00100000:3.0:1788201364.240650:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715340160 00000100:00100000:3.0:1788201364.240671:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788201364.240689:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:3656:x1875060715340160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201364.240717:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:3656:x1875060715340160:12345-0@lo:400:kworker.0 Request processed in 40us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201364.240723:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788201364.240754:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715340160:0@lo:400:kworker.0 00000100:00100000:3.0:1788201364.240766:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715340800:0@lo:400:kworker.0 00000100:00100000:3.0:1788201364.240774:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715340928:0@lo:400:kworker.0 00000100:00080000:1.0:1788201364.240965:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201364.240978:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715340288 00000100:00100000:1.0:1788201364.240982:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715340288 00000100:00100000:1.0:1788201364.241012:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201364.241037:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715340288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201364.241072:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715340288:12345-0@lo:400:kworker.0 Request processed in 36us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201364.241079:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201364.241104:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715340288:0@lo:400:kworker.0 00000100:00100000:2.0:1788201364.241182:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715340672:0@lo:8:kworker.0 00000100:00100000:2.0:1788201364.241212:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201364.241322:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715340672 00000100:00100000:1.0:1788201364.241327:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715340672 00000100:00100000:1.0:1788201364.241357:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201364.241362:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3654:x1875060715340672:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788201364.241381:0:99764:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201364.241501:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3654:x1875060715340672:12345-0@lo:8:kworker.0 Request processed in 136us (287us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201364.241508:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788201364.244166:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201364.246200:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201364.246211:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201364.246215:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715340672:0@lo:8:kworker.0 00000020:00000004:3.0:1788201364.547424:0:100230:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788201364.548418:0:100230:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788201364.823824:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715341184:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201364.823900:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201364.823971:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715341184 00000100:00100000:0.0:1788201364.823981:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715341184 00000100:00100000:0.0:1788201364.824047:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201364.824057:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715341184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201364.824089:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:0.0:1788201364.824135:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715341184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201364.824142:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201364.824188:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715341184:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788201365.268050:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201365.328716:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715341312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201365.328797:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201365.328937:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715341312 00000100:00100000:2.0:1788201365.328947:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715341312 00000100:00100000:2.0:1788201365.329003:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788201365.329045:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715341312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201365.329084:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:2.0:1788201365.329139:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715341312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201365.329146:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788201365.329268:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715341312:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788201366.288633:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201366.484132:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201366.486261:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201366.486309:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201366.486349:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695508096 00000100:00100000:3.0:1788201366.486358:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695508096 00000100:00100000:3.0:1788201366.486418:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695507968 00000100:00100000:3.0:1788201366.486421:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695507968 00000100:00100000:3.0:1788201366.486447:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1667 00000100:00100000:3.0:1788201366.486458:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2402:x1875060695508096:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201366.486532:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2402:x1875060695508096:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 75us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201366.486540:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1667 00000100:00100000:3.0:1788201366.486558:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1668 00000100:00100000:3.0:1788201366.486565:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2402:x1875060695507968:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201366.486589:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2402:x1875060695507968:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201366.486595:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1668 00000100:00080000:3.0:1788201366.486613:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201366.486617:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201366.490977:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695507840 00000100:00100000:1.0:1788201366.490992:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695507840 00000100:00100000:1.0:1788201366.491071:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 302 00000100:00100000:1.0:1788201366.491081:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695507840:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201366.491158:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695507840:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 78us (7223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201366.491178:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 302 00010000:00010000:2.0:1788201367.318125:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201368.337322:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201369.359143:0:3654:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201349/real 1788201349] req@ffff8dc0058aaa00 x1875060715333248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201369 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201369.359188:0:3654:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dc0058aaa00 x1875060715333248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201369 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201369.359216:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1031f8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201369.359251:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788201369.359257:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715333248:0@lo:8:kworker.0 00000100:00080000:3.0:1788201369.359531:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201369.359536:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201369.359539:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201369.359542:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788201369.359546:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc1031f8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201369.359553:0:93109:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4201 00000100:00080000:3.0:1788201369.359559:0:93109:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788201369.359569:0:93109:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8dc1031f8800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201369.359603:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc1060cdc00 x1875060715341696/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201369.359653:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201369.359657:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201369.359660:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201369.359663:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788201369.359665:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201369.359669:0:93109:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4215 00000100:00080000:3.0:1788201369.359672:0:93109:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788201369.359676:0:93109:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dc1257f0800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201369.359690:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efcaa00 x1875060715342080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201369.362431:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715341440:0@lo:400:kworker.0 00000100:00100000:0.0:1788201369.362698:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201369.362782:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715342208:0@lo:400:kworker.0 00000100:00100000:0.0:1788201369.362816:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201369.362855:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201369.362891:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715341568:0@lo:400:kworker.0 00000100:00100000:3.0:1788201369.362942:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201369.362978:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715342336:0@lo:400:kworker.0 00000100:00100000:3.0:1788201369.363003:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201369.363041:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788201369.363049:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715341824:0@lo:400:kworker.0 00000100:00100000:3.0:1788201369.363073:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201369.363090:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715342464:0@lo:400:kworker.0 00000100:00100000:3.0:1788201369.363119:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201369.363178:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715341440 00000100:00100000:3.0:1788201369.363189:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715341440 00000100:00100000:3.0:1788201369.363251:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788201369.363262:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:3656:x1875060715341440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201369.363343:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:3656:x1875060715341440:12345-0@lo:400:kworker.0 Request processed in 82us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201369.363366:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788201369.363408:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715342208 00000100:00100000:3.0:1788201369.363412:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715342208 00000100:00100000:3.0:1788201369.363442:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715342336 00000100:00100000:3.0:1788201369.363445:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715342336 00000100:00100000:3.0:1788201369.363471:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715341824 00000100:00100000:3.0:1788201369.363473:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715341824 00000100:00100000:3.0:1788201369.364569:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715342464 00000100:00100000:3.0:1788201369.364580:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715342464 00000100:00100000:3.0:1788201369.364621:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1669 00000100:00100000:3.0:1788201369.364631:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715342208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201369.364704:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715342208:12345-0@lo:400:kworker.0 Request processed in 74us (1886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201369.364711:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1669 00000100:00100000:3.0:1788201369.364727:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1670 00000100:00100000:3.0:1788201369.364735:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715342336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201369.365267:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715341568 00000100:00100000:2.0:1788201369.365276:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715341568 00000100:00100000:2.0:1788201369.365322:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788201369.365332:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715341568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201369.365433:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715341952:0@lo:400:kworker.0 00000100:00100000:0.0:1788201369.365647:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201369.365697:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715341440:0@lo:400:kworker.0 00000100:00100000:0.0:1788201369.365716:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715342208:0@lo:400:kworker.0 00000100:00100000:0.0:1788201369.365816:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1671 00000100:00100000:0.0:1788201369.365826:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715341824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201369.366080:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715342336:12345-0@lo:400:kworker.0 Request processed in 1343us (3073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201369.366089:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1670 00000100:00100000:3.0:1788201369.366110:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1672 00000100:00100000:3.0:1788201369.366120:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715342464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201369.366269:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715341568:12345-0@lo:400:kworker.0 Request processed in 938us (3326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201369.366277:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788201369.366292:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715341952 00000100:00100000:2.0:1788201369.366296:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715341952 00000100:00100000:2.0:1788201369.366318:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788201369.366324:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715341952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201369.366361:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715341952:12345-0@lo:400:kworker.0 Request processed in 37us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201369.366368:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788201369.367234:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715341696:0@lo:8:kworker.0 00000100:00100000:2.0:1788201369.367292:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201369.367334:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715342080:0@lo:8:kworker.0 00000100:00100000:2.0:1788201369.367372:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201369.367423:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715341696 00000100:00100000:2.0:1788201369.367429:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715341696 00000100:00100000:2.0:1788201369.367452:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715342080 00000100:00100000:2.0:1788201369.367467:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715342080 00000100:00100000:2.0:1788201369.367482:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201369.367488:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3654:x1875060715341696:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788201369.367513:0:99766:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201369.367552:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3654:x1875060715341696:12345-0@lo:8:kworker.0 Request processed in 63us (262us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201369.367559:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201369.367575:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201369.367579:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3654:x1875060715342080:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788201369.367600:0:99766:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201369.367631:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715342464:12345-0@lo:400:kworker.0 Request processed in 1513us (4509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201369.367637:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3654:x1875060715342080:12345-0@lo:8:kworker.0 Request processed in 54us (262us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201369.367645:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1672 00000100:00100000:2.0:1788201369.367649:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788201369.367692:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1031f8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201369.367695:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201369.367698:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201369.367702:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715341696:0@lo:8:kworker.0 00000100:00080000:2.0:1788201369.367713:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201369.367720:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00080000:3.0:1788201369.367722:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201369.367724:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715342080:0@lo:8:kworker.0 00010000:00010000:1.0:1788201369.369742:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201369.370101:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715341952:0@lo:400:kworker.0 00000100:00100000:0.0:1788201369.373662:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715341824:12345-0@lo:400:kworker.0 Request processed in 7815us (10565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201369.373685:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1671 00000100:00100000:3.0:1788201369.374090:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715341824:0@lo:400:kworker.0 00000100:00100000:3.0:1788201369.374122:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715342464:0@lo:400:kworker.0 00000100:00100000:3.0:1788201369.374139:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715341568:0@lo:400:kworker.0 00000100:00100000:3.0:1788201369.374153:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715342336:0@lo:400:kworker.0 00000100:00100000:2.0:1788201369.936332:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201369.936359:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715342592:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201369.936472:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201369.936595:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715342592 00000100:00100000:0.0:1788201369.936607:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715342592 00000100:00100000:0.0:1788201369.936673:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788201369.936685:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715342592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201369.936731:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:0.0:1788201369.936788:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715342592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201369.936795:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201369.936903:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715342592:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788201370.383347:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201370.447289:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715342720:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201370.447399:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201370.447520:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715342720 00000100:00100000:3.0:1788201370.447532:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715342720 00000100:00100000:3.0:1788201370.447609:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788201370.447621:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715342720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201370.447672:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:3.0:1788201370.447733:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715342720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201370.447741:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788201370.447799:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715342720:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788201371.408329:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201371.607571:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201371.607698:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201371.607732:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201371.607774:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695508224 00000100:00100000:3.0:1788201371.607785:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695508224 00000100:00100000:3.0:1788201371.607844:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 304 00000100:00100000:3.0:1788201371.607868:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695508224:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201371.607937:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695508224:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 84us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201371.607944:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 304 00000100:00100000:0.0:1788201371.609795:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201371.610526:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695508608 00000100:00100000:1.0:1788201371.610538:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695508608 00000100:00100000:1.0:1788201371.610596:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:1.0:1788201371.610606:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2399:x1875060695508608:12345-192.168.201.20@tcp:8:kworker.0 00010000:00020000:1.0:1788201371.610631:0:99766:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201371.610696:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2399:x1875060695508608:12345-192.168.201.20@tcp:8:kworker.0 Request processed in 89us (910us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201371.610703:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:2.0:1788201371.615952:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695508352 00000100:00100000:2.0:1788201371.615969:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695508352 00000100:00100000:2.0:1788201371.616066:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695508480 00000100:00100000:2.0:1788201371.616070:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695508480 00000100:00100000:2.0:1788201371.616101:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1673 00000100:00100000:2.0:1788201371.616111:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2400:x1875060695508352:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201371.616191:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2400:x1875060695508352:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 83us (8642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201371.616200:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1673 00000100:00100000:2.0:1788201371.616217:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1674 00000100:00100000:2.0:1788201371.616224:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2400:x1875060695508480:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201371.616246:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2400:x1875060695508480:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (8514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201371.616252:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1674 00000100:00080000:1.0:1788201371.618001:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201371.618012:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000004:2.0:1788201372.224197:0:100575:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788201372.224201:0:100575:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788201372.224203:0:100575:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788201372.224389:0:100575:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dc13aa9f000 00000020:01000004:2.0:1788201372.224406:0:100575:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788201372.224421:0:100575:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788201372.224435:0:100575:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8dc004fd19b8) 00000020:00000080:2.0:1788201372.224453:0:100575:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788201372.273789:0:100575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788201372.280655:0:100575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788201372.281409:0:100575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788201372.281785:0:100575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788201372.281981:0:100575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788201372.282557:0:100575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788201372.282781:0:100575:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:3.0:1788201372.284789:0:100575:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788201372.285013:0:100575:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788201372.285073:0:100575:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788201372.285086:0:100575:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x96d0c9b8c9a1d733 00000020:01000004:3.0:1788201372.285093:0:100575:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788201372.285118:0:100575:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.120@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788201372.285122:0:100575:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788201372.285129:0:100575:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788201372.285158:0:100575:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788201372.285162:0:100575:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788201372.312919:0:100575:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788201372.312966:0:100575:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.120@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788201372.312971:0:100575:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788201372.312972:0:100575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788201372.312973:0:100575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201372.312975:0:100575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201372.312976:0:100575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201372.312977:0:100575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201372.312978:0:100575:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201372.312980:0:100575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201372.312982:0:100575:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788201372.312986:0:100575:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788201372.312988:0:100575:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788201372.312990:0:100575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788201372.312991:0:100575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201372.312992:0:100575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201372.312993:0:100575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201372.312995:0:100575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201372.312995:0:100575:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201372.312996:0:100575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201372.312997:0:100575:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788201372.313065:0:100575:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788201372.313094:0:100575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715342848:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788201372.313172:0:100575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201372.313217:0:100575:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc00745d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201372.313358:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715342848 00000100:00100000:1.0:1788201372.313367:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715342848 00000100:00100000:1.0:1788201372.313423:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788201372.313433:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:100575:x1875060715342848:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788201372.313466:0:94464:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788201372.313470:0:94464:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788201372.313474:0:94464:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788201372.313976:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:100575:x1875060715342848:12345-0@lo:253:mount.lustre.0 Request processed in 543us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201372.313985:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788201372.314138:0:100575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715342848:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788201372.314148:0:100575:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788201372.314150:0:100575:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788201372.314152:0:100575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788201372.314153:0:100575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201372.314154:0:100575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201372.314155:0:100575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201372.314156:0:100575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201372.314157:0:100575:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201372.314159:0:100575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201372.314160:0:100575:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788201372.314181:0:100575:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dc13aa9f000 from lustre-OST0001 10000000:01000000:3.0:1788201372.314207:0:100575:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788201372.314209:0:100575:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788201372.314218:0:100575:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8dc12563cd28 local copy 00010000:00010000:3.0:1788201372.314229:0:100575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1cabb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1cac2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201372.314388:0:100575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715342976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201372.314421:0:100575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201372.314457:0:100575:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004b1cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201372.315164:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715342976 00000100:00100000:1.0:1788201372.315171:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715342976 00000100:00100000:1.0:1788201372.315215:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788201372.315236:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:100575:x1875060715342976:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201372.315778:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:100575:x1875060715342976:12345-0@lo:501:mount.lustre.0 Request processed in 543us (1355us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201372.315786:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788201372.318005:0:100575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715342976:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788201372.318057:0:100575:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788201372.318104:0:100575:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788201372.318113:0:100575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1cabb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1cac2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.318124:0:100575:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1cabb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1cac2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201372.318163:0:100575:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dc13aa9f000 10000000:01000000:2.0:1788201372.318168:0:100575:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788201372.318174:0:100575:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788201372.318177:0:100575:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788201372.318181:0:100575:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788201372.318184:0:100575:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788201372.318217:0:100575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fde00/0x96d0c9b8c9a1d73a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.318225:0:100575:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0078fde00/0x96d0c9b8c9a1d73a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.318236:0:100575:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0078fde00/0x96d0c9b8c9a1d73a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201372.318256:0:100575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715343104:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201372.318455:0:100575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201372.318738:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715343104 00000100:00100000:3.0:1788201372.318745:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715343104 00000100:00100000:3.0:1788201372.318913:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788201372.318924:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+21:100575:x1875060715343104:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201372.318939:0:94463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201372.318953:0:94463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc108c74400/0x96d0c9b8c9a1d741 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1d73a expref: -99 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201372.318998:0:94463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc108c74400/0x96d0c9b8c9a1d741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d73a expref: 22 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201372.319009:0:94463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc108c74400/0x96d0c9b8c9a1d741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d73a expref: 22 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201372.319050:0:94463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c74400, rc 0) 00000100:00100000:3.0:1788201372.319089:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:100575:x1875060715343104:12345-0@lo:101:mount.lustre.0 Request processed in 168us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201372.319096:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788201372.319187:0:100575:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0039cf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201372.319205:0:100575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715343104:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201372.319227:0:100575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0078fde00/0x96d0c9b8c9a1d73a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d741 expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.319237:0:100575:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0078fde00/0x96d0c9b8c9a1d73a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d741 expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201372.320953:0:100575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788201372.321717:0:100575:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201372.336978:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788201372.337394:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788201372.337415:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788201372.337430:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788201372.337444:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788201372.337456:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788201372.337484:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788201372.337490:0:100575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788201372.338493:0:100575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125809500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715343232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201372.338991:0:100575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201372.339124:0:100575:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1259aeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201372.341011:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715343232 00000100:00100000:3.0:1788201372.341052:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715343232 00000100:00100000:3.0:1788201372.341127:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788201372.341137:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+22:100575:x1875060715343232:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201372.341322:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+22:100575:x1875060715343232:12345-0@lo:501:mount.lustre.0 Request processed in 186us (2331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201372.341330:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788201372.341698:0:100575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125809500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715343232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201372.341749:0:100575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125809500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715343360:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201372.341821:0:100575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201372.341859:0:100575:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1259aeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201372.342483:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715343360 00000100:00100000:3.0:1788201372.342489:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715343360 00000100:00100000:3.0:1788201372.342531:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788201372.342558:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:100575:x1875060715343360:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201372.342671:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:100575:x1875060715343360:12345-0@lo:503:mount.lustre.0 Request processed in 132us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201372.342678:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788201372.342963:0:100575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125809500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715343360:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788201372.343608:0:100575:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201372.343690:0:100575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125809500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715343488:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201372.343739:0:100575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201372.343766:0:100575:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0058463c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201372.343835:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715343488 00000100:00100000:3.0:1788201372.343840:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715343488 00000100:00100000:3.0:1788201372.343885:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788201372.343892:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003bfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+22:100575:x1875060715343488:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201372.344874:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003bfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+22:100575:x1875060715343488:12345-0@lo:502:mount.lustre.0 Request processed in 979us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201372.344884:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788201372.346481:0:100575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125809500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715343488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788201372.346778:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788201372.346824:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788201372.346838:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788201372.346850:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788201372.346862:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788201372.346875:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788201372.346887:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788201372.346903:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788201372.346917:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1788201372.346955:0:100575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715343616:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201372.347057:0:100575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201372.347099:0:100575:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0039cfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201372.347492:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715343616 00000100:00100000:3.0:1788201372.347499:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715343616 00000100:00100000:3.0:1788201372.347573:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788201372.347582:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003bfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:100575:x1875060715343616:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201372.347703:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003bfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:100575:x1875060715343616:12345-0@lo:502:mount.lustre.0 Request processed in 121us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201372.347710:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788201372.347938:0:100575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715343616:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788201372.347989:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1788201372.347999:0:100575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788201372.348793:0:100579:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788201372.348874:0:100579:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788201372.348881:0:100579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201372.348884:0:100579:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788201372.348891:0:100579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201372.348913:0:100579:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8dc004fd0000) 00000020:00000080:2.0:1788201372.348937:0:100579:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788201372.348944:0:100579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788201372.349011:0:100579:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc13aa9f000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788201372.349046:0:100579:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788201372.349052:0:100579:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x96d0c9b8c9a1d74f 00010000:00010000:3.0:1788201372.358766:0:100579:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788201372.361866:0:100579:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294969457 00080000:10000000:3.0:1788201372.367063:0:100579:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788201372.370090:0:100579:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788201372.370104:0:100579:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201372.370111:0:100579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201372.370113:0:100579:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788201372.370116:0:100579:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201372.370120:0:100579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201372.370121:0:100579:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788201372.370124:0:100579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788201372.370126:0:100579:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788201372.370129:0:100579:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201372.370131:0:100579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201372.370132:0:100579:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788201372.370134:0:100579:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201372.370136:0:100579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201372.370138:0:100579:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788201372.370140:0:100579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788201372.370167:0:100579:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201372.370170:0:100579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201372.370171:0:100579:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788201372.370174:0:100579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788201372.372603:0:100575:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788201372.372652:0:100575:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788201372.372678:0:100575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0078fde00/0x96d0c9b8c9a1d73a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d741 expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201372.372692:0:100575:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0078fde00/0x96d0c9b8c9a1d73a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d741 expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201372.372701:0:100575:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc13aa9f000 from 1 10000000:01000000:0.0:1788201372.372704:0:100575:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201372.372747:0:100575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00896a800/0x96d0c9b8c9a1d756 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201372.372757:0:100575:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc00896a800/0x96d0c9b8c9a1d756 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201372.372768:0:100575:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc00896a800/0x96d0c9b8c9a1d756 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201372.372795:0:100575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715343744:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201372.372866:0:100575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201372.372904:0:100575:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1064709c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201372.380125:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715343744 00000100:00100000:1.0:1788201372.380142:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715343744 00000100:00100000:1.0:1788201372.380208:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788201372.380218:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:100575:x1875060715343744:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201372.380236:0:94461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201372.380254:0:94461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064ec600/0x96d0c9b8c9a1d75d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1d756 expref: -99 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201372.380282:0:94461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ec600/0x96d0c9b8c9a1d75d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d756 expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201372.380293:0:94461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064ec600/0x96d0c9b8c9a1d75d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d756 expref: 23 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201372.380476:0:94461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ec600, rc 0) 00000100:00100000:1.0:1788201372.380618:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:100575:x1875060715343744:12345-0@lo:101:mount.lustre.0 Request processed in 400us (7751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201372.380626:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788201372.386064:0:100575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715343744:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201372.386097:0:100575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc00896a800/0x96d0c9b8c9a1d756 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d75d expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201372.386110:0:100575:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc00896a800/0x96d0c9b8c9a1d756 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d75d expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201372.387498:0:100575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788201372.387820:0:100575:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201372.388008:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788201372.388073:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788201372.388093:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788201372.388099:0:100575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788201372.388177:0:100575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715343872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201372.388242:0:100575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201372.388291:0:100575:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc106470000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201372.388510:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715343872 00000100:00100000:1.0:1788201372.388518:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715343872 00000100:00100000:1.0:1788201372.388573:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788201372.388583:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:100575:x1875060715343872:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201372.388696:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:100575:x1875060715343872:12345-0@lo:501:mount.lustre.0 Request processed in 115us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201372.388703:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788201372.389566:0:100575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715343872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201372.389621:0:100575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715344000:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201372.389675:0:100575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201372.389713:0:100575:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc106470000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201372.389764:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715344000 00000100:00100000:1.0:1788201372.389770:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715344000 00000100:00100000:1.0:1788201372.389819:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788201372.389827:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:100575:x1875060715344000:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201372.389930:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:100575:x1875060715344000:12345-0@lo:503:mount.lustre.0 Request processed in 103us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201372.389943:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788201372.390144:0:100575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715344000:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788201372.390523:0:100575:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788201372.390600:0:100575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715344128:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201372.390642:0:100575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201372.390669:0:100575:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1064709c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201372.390838:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715344128 00000100:00100000:1.0:1788201372.390843:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715344128 00000100:00100000:1.0:1788201372.390868:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1788201372.390875:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:100575:x1875060715344128:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201372.390961:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:100575:x1875060715344128:12345-0@lo:502:mount.lustre.0 Request processed in 86us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201372.390968:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788201372.391194:0:100575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715344128:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788201372.391380:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788201372.391405:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788201372.391418:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788201372.391429:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788201372.391441:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000100:00100000:2.0:1788201372.391460:0:100575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715344256:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201372.391501:0:100575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201372.391529:0:100575:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0039cfc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201372.391658:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715344256 00000100:00100000:1.0:1788201372.391663:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715344256 00000100:00100000:1.0:1788201372.391697:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1788201372.391705:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:100575:x1875060715344256:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201372.391790:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:100575:x1875060715344256:12345-0@lo:502:mount.lustre.0 Request processed in 85us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201372.391808:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788201372.391966:0:100575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715344256:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788201372.392005:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788201372.392045:0:100575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:2.0:1788201372.393955:0:100583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201372.393968:0:100583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201372.393971:0:100583:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788201372.393979:0:100583:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc13aa9f000 00000020:00000080:2.0:1788201372.393982:0:100583:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788201372.393990:0:100583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201372.393992:0:100583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201372.393994:0:100583:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788201372.393996:0:100583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201372.393999:0:100583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201372.394000:0:100583:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788201372.394003:0:100583:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc13aa9f000 00000020:00000080:2.0:1788201372.394006:0:100583:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788201372.394514:0:100583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201372.394519:0:100583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201372.394520:0:100583:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788201372.394523:0:100583:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 7 00000020:01000000:0.0:1788201372.394692:0:100575:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1788201372.394730:0:100575:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201372.394756:0:100575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00896a800/0x96d0c9b8c9a1d756 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d75d expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201372.394768:0:100575:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc00896a800/0x96d0c9b8c9a1d756 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d75d expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201372.394839:0:100575:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788201372.394842:0:100575:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dc13aa9f000 10000000:01000000:0.0:1788201372.394846:0:100575:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dc13aa9f000 10000000:01000000:0.0:1788201372.394849:0:100575:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788201372.394855:0:100575:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc13aa9f000 from 1 10000000:01000000:0.0:1788201372.394858:0:100575:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201372.394893:0:100575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00896bc00/0x96d0c9b8c9a1d764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201372.394901:0:100575:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc00896bc00/0x96d0c9b8c9a1d764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201372.394926:0:100575:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc00896bc00/0x96d0c9b8c9a1d764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201372.394950:0:100575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715344384:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201372.395041:0:100575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201372.395087:0:100575:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1064709c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201372.395213:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715344384 00000100:00100000:3.0:1788201372.395220:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715344384 00000100:00100000:3.0:1788201372.395270:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788201372.395279:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:100575:x1875060715344384:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201372.395293:0:94464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201372.395319:0:94464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc108c75e00/0x96d0c9b8c9a1d76b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1d764 expref: -99 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201372.395342:0:94464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc108c75e00/0x96d0c9b8c9a1d76b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d764 expref: 24 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201372.395352:0:94464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc108c75e00/0x96d0c9b8c9a1d76b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d764 expref: 24 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201372.395366:0:94464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c75e00, rc 0) 00000100:00100000:3.0:1788201372.395407:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:100575:x1875060715344384:12345-0@lo:101:mount.lustre.0 Request processed in 128us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201372.395413:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788201372.395567:0:100575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715344384:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201372.395581:0:100575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc00896bc00/0x96d0c9b8c9a1d764 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d76b expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201372.395590:0:100575:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc00896bc00/0x96d0c9b8c9a1d764 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d76b expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201372.400919:0:100575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1788201372.401251:0:100575:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201372.401453:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788201372.401475:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788201372.401487:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788201372.401497:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788201372.401507:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788201372.401519:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788201372.401532:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788201372.401557:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788201372.401571:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788201372.401584:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788201372.401597:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788201372.401609:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788201372.401621:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788201372.401648:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788201372.401661:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788201372.401673:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788201372.401685:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788201372.401698:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788201372.401712:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788201372.401724:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788201372.401735:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788201372.401746:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788201372.401757:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788201372.401772:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788201372.401785:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1788201372.401814:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1788201372.401828:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1788201372.401840:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1788201372.401851:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1788201372.401863:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1788201372.401875:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1788201372.401891:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1788201372.401905:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1788201372.401919:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1788201372.401932:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1788201372.401947:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1788201372.401962:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1788201372.401976:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1788201372.401989:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1788201372.402003:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1788201372.402048:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1788201372.402066:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1788201372.402079:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1788201372.402093:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1788201372.402105:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1788201372.402119:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1788201372.402153:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1788201372.402159:0:100575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1788201372.402249:0:100575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715344512:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201372.402318:0:100575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201372.402376:0:100575:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc106470000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201372.405228:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715344512 00000100:00100000:3.0:1788201372.405247:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715344512 00000100:00100000:3.0:1788201372.405331:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788201372.405343:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:100575:x1875060715344512:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201372.405564:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:100575:x1875060715344512:12345-0@lo:501:mount.lustre.0 Request processed in 222us (3244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201372.405573:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1788201372.405738:0:100575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715344512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201372.405794:0:100575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715344640:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201372.405850:0:100575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201372.405888:0:100575:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0039cfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201372.406426:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715344640 00000100:00100000:3.0:1788201372.406433:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715344640 00000100:00100000:3.0:1788201372.406479:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788201372.406487:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0072aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:100575:x1875060715344640:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201372.406598:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0072aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:100575:x1875060715344640:12345-0@lo:503:mount.lustre.0 Request processed in 109us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201372.406605:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1788201372.406690:0:100575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715344640:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788201372.407149:0:100575:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788201372.407219:0:100575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715344768:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201372.407268:0:100575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201372.407297:0:100575:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0039cfb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201372.407548:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715344768 00000100:00100000:1.0:1788201372.407553:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715344768 00000100:00100000:1.0:1788201372.407592:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788201372.407600:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:100575:x1875060715344768:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201372.407693:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:100575:x1875060715344768:12345-0@lo:502:mount.lustre.0 Request processed in 94us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201372.407701:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788201372.409166:0:100575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715344768:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788201372.409420:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788201372.409454:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788201372.409469:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788201372.409484:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788201372.409499:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788201372.409513:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788201372.409526:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788201372.409551:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788201372.409567:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788201372.409582:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788201372.409596:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788201372.409609:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788201372.409622:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788201372.409635:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788201372.409647:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788201372.409658:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788201372.409673:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788201372.409686:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788201372.409700:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788201372.409714:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788201372.409728:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788201372.409742:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788201372.409759:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788201372.409774:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788201372.409785:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788201372.409814:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788201372.409827:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788201372.409838:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788201372.409858:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788201372.409869:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788201372.409880:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788201372.409890:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788201372.409902:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788201372.409914:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788201372.409927:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788201372.409938:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788201372.409949:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788201372.409959:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788201372.409970:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788201372.409980:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788201372.409990:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788201372.410000:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788201372.410010:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788201372.410062:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788201372.410078:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788201372.410092:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788201372.410104:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788201372.410115:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788201372.410161:0:100575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715344896:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201372.410231:0:100575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201372.410276:0:100575:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0039cfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201372.410502:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715344896 00000100:00100000:3.0:1788201372.410509:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715344896 00000100:00100000:3.0:1788201372.410568:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788201372.410578:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:100575:x1875060715344896:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201372.410708:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:100575:x1875060715344896:12345-0@lo:502:mount.lustre.0 Request processed in 131us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201372.410716:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788201372.413563:0:100575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715344896:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201372.427275:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788201372.427363:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000040:00080000:3.0:1788201372.427385:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1788201372.427402:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].52, 224 off17176 00000040:00080000:3.0:1788201372.427420:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].53, 112 off17288 00000040:00080000:3.0:1788201372.427437:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].54, 224 off17512 00000040:00080000:3.0:1788201372.427471:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].55, 224 off17736 00000040:00080000:3.0:1788201372.427488:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].56, 136 off17872 00000040:00080000:3.0:1788201372.427503:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].57, 224 off18096 00000040:00080000:3.0:1788201372.427519:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].58, 224 off18320 00000040:00080000:3.0:1788201372.427550:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].59, 136 off18456 00000040:00080000:3.0:1788201372.427569:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].60, 224 off18680 00000040:00080000:3.0:1788201372.427583:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].61, 224 off18904 00000040:00080000:3.0:1788201372.427598:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].62, 112 off19016 00000100:00100000:3.0:1788201372.427651:0:100575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715345024:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201372.427735:0:100575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201372.427785:0:100575:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103180600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201372.428563:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715345024 00000100:00100000:0.0:1788201372.428572:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715345024 00000100:00100000:0.0:1788201372.428631:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788201372.428642:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:100575:x1875060715345024:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201372.428784:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:100575:x1875060715345024:12345-0@lo:502:mount.lustre.0 Request processed in 143us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201372.428791:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788201372.429106:0:100575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715345024:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201372.429177:0:100575:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].63, 224 off19240 00000040:00080000:3.0:1788201372.429189:0:100575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 00010000:00010000:2.0:1788201372.432068:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788201372.432321:0:100586:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788201372.432335:0:100586:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8dc12f0c4d28) 00000020:00000080:3.0:1788201372.432360:0:100586:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1788201372.432666:0:100586:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc13aa9f000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788201372.432672:0:100586:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc13aa9f000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788201372.432674:0:100586:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc13aa9f000 3 00010000:00080000:3.0:1788201372.432707:0:100586:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc1401c3800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.120@tcp at head 00010000:00010000:3.0:1788201372.438268:0:100586:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1788201372.439701:0:100586:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788201372.439749:0:100586:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788201372.439775:0:100586:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x96d0c9b8c9a1d779 00000100:00080000:3.0:1788201372.439786:0:100586:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201372.439793:0:100586:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc1401c3800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201372.439830:0:100586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efcb100 x1875060715345152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201372.439854:0:100586:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788201372.439894:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201372.439897:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201372.439900:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201372.439903:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788201372.439906:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc1031f8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201372.439910:0:93109:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 4220 00000100:00080000:3.0:1788201372.439913:0:93109:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201372.439916:0:93109:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8dc1031f8800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201372.439929:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efc8000 x1875060715345408/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201372.439958:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201372.439961:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201372.439963:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201372.439966:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788201372.439968:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201372.439971:0:93109:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4220 00000100:00080000:3.0:1788201372.439973:0:93109:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201372.439976:0:93109:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dc1257f0800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201372.439993:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efc9c00 x1875060715345792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201372.440063:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715345664:0@lo:400:kworker.0 00000100:00100000:3.0:1788201372.440127:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201372.440165:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201372.440171:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715345920:0@lo:400:kworker.0 00000100:00100000:3.0:1788201372.440196:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201372.440234:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715345664 00000100:00100000:3.0:1788201372.440240:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715345664 00000100:00100000:3.0:1788201372.440278:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788201372.440287:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715345664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201372.445998:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715345664:12345-0@lo:400:kworker.0 Request processed in 5700us (5859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201372.446034:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788201372.446086:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715345920 00000100:00100000:3.0:1788201372.446094:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715345920 00000100:00100000:3.0:1788201372.446149:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1675 00000100:00100000:3.0:1788201372.446158:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715345920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201372.446195:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715345920:12345-0@lo:400:kworker.0 Request processed in 38us (5998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201372.446201:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1675 00000100:00100000:3.0:1788201372.446237:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715345280:0@lo:400:kworker.0 00000100:00100000:3.0:1788201372.446278:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201372.446319:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715346048:0@lo:400:kworker.0 00000100:00100000:3.0:1788201372.446345:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201372.446375:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788201372.446392:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715345536:0@lo:400:kworker.0 00000100:00100000:3.0:1788201372.446419:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201372.446437:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715346176:0@lo:400:kworker.0 00000100:00100000:3.0:1788201372.446458:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201372.446489:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715346048 00000100:00100000:3.0:1788201372.446492:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715346048 00000100:00100000:3.0:1788201372.446526:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715345536 00000100:00100000:3.0:1788201372.446529:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715345536 00000100:00100000:3.0:1788201372.446550:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715346176 00000100:00100000:3.0:1788201372.446553:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715346176 00000100:00100000:3.0:1788201372.446567:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1676 00000100:00100000:3.0:1788201372.446572:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715346048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201372.446605:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715346048:12345-0@lo:400:kworker.0 Request processed in 34us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201372.446611:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1676 00000100:00100000:3.0:1788201372.446623:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1677 00000100:00100000:3.0:1788201372.446629:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715345536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201372.446652:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715345536:12345-0@lo:400:kworker.0 Request processed in 24us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201372.446658:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1677 00000100:00100000:3.0:1788201372.446667:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1678 00000100:00100000:3.0:1788201372.446672:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715346176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201372.446700:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715346176:12345-0@lo:400:kworker.0 Request processed in 28us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201372.446706:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1678 00000100:00080000:3.0:1788201372.446724:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201372.446728:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201372.446770:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715345536:0@lo:400:kworker.0 00000100:00100000:3.0:1788201372.446783:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715346176:0@lo:400:kworker.0 00000100:00100000:3.0:1788201372.446791:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715346048:0@lo:400:kworker.0 00000100:00100000:3.0:1788201372.446818:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715345280 00000100:00100000:3.0:1788201372.446821:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715345280 00000100:00100000:3.0:1788201372.446844:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201372.446850:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715345280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201372.446885:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715345280:12345-0@lo:400:kworker.0 Request processed in 35us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201372.446890:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201372.446913:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715345280:0@lo:400:kworker.0 00000100:00100000:3.0:1788201372.447100:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715345152:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201372.447136:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201372.447162:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715345408:0@lo:8:kworker.0 00000100:00100000:3.0:1788201372.447184:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201372.447202:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715345792:0@lo:8:kworker.0 00000100:00100000:3.0:1788201372.447223:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201372.447261:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715345408 00000100:00100000:3.0:1788201372.447265:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715345408 00000100:00100000:3.0:1788201372.447280:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715345792 00000100:00100000:3.0:1788201372.447282:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715345792 00000100:00100000:3.0:1788201372.447290:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788201372.448403:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3654:x1875060715345408:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788201372.448488:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3654:x1875060715345408:12345-0@lo:8:kworker.0 Request processed in 89us (1301us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788201372.448506:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788201372.448530:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788201372.448546:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3654:x1875060715345792:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788201372.448579:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3654:x1875060715345792:12345-0@lo:8:kworker.0 Request processed in 43us (1356us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788201372.448586:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788201372.448636:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1031f8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201372.448641:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788201372.448644:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715345408:0@lo:8:kworker.0 00000100:00080000:3.0:1788201372.448653:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201372.448656:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788201372.448659:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715345792:0@lo:8:kworker.0 00000100:00100000:3.0:1788201372.448688:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715345152 00000100:00100000:3.0:1788201372.448693:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715345152 00000100:00100000:3.0:1788201372.448720:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1615 00000100:00100000:3.0:1788201372.448725:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715345152:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788201372.448741:0:66757:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 4223 last 0 00000020:00000080:3.0:1788201372.448778:0:66757:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x96d0c9b8c9a1d780 00000004:00100000:3.0:1788201372.448797:0:66757:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201372.448829:0:66757:0:(import.c:65:import_set_state_nolock()) ffff8dc00397e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201372.448871:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875060715345152:12345-0@lo:38:llog_process_th.0 Request processed in 145us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201372.448878:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1615 00000100:00100000:3.0:1788201372.448906:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201372.448913:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 29 00000100:00080000:3.0:1788201372.448926:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788201372.448931:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788201372.448933:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788201372.448939:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715345152:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788201372.455044:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715345920:0@lo:400:kworker.0 00000100:00100000:0.0:1788201372.455067:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715345664:0@lo:400:kworker.0 00000020:01000004:3.0:1788201372.455257:0:100586:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788201372.455275:0:100586:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8dc125638000) 00000020:00000080:3.0:1788201372.455311:0:100586:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:3.0:1788201372.455399:0:100586:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc13aa9f000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788201372.455404:0:100586:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc13aa9f000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788201372.455407:0:100586:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc13aa9f000 3 00010000:00080000:3.0:1788201372.455437:0:100586:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc1401c2800@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.120@tcp at head 00010000:00010000:3.0:1788201372.457086:0:100586:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1788201372.457301:0:100586:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788201372.457342:0:100586:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788201372.457355:0:100586:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x96d0c9b8c9a1d78e 00000100:00080000:3.0:1788201372.457365:0:100586:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201372.457370:0:100586:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8dc1401c2800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201372.457405:0:100586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efcb100 x1875060715346304/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201372.457449:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715346304:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201372.457522:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201372.457596:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715346304 00000100:00100000:3.0:1788201372.457603:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715346304 00000100:00100000:3.0:1788201372.457635:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1616 00000100:00100000:3.0:1788201372.457642:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715346304:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788201372.457664:0:66313:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 4223 last 0 00000020:00000080:3.0:1788201372.457694:0:66313:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x96d0c9b8c9a1d795 00000004:00100000:3.0:1788201372.457715:0:66313:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201372.457749:0:66313:0:(import.c:65:import_set_state_nolock()) ffff8dc00520e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201372.457798:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875060715346304:12345-0@lo:38:llog_process_th.0 Request processed in 154us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201372.457805:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1616 00000100:00100000:3.0:1788201372.457842:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201372.457851:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 18 00000100:00080000:3.0:1788201372.457857:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788201372.457861:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788201372.457864:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788201372.457870:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715346304:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788201372.457888:0:100586:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788201372.457909:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201372.457913:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201372.457917:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201372.457920:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1788201372.466293:0:100586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64 count 63 00000020:01000000:3.0:1788201372.468563:0:100575:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:3.0:1788201372.468618:0:100575:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201372.468643:0:100575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00896bc00/0x96d0c9b8c9a1d764 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d76b expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201372.468656:0:100575:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc00896bc00/0x96d0c9b8c9a1d764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d76b expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788201372.468729:0:100575:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788201372.468731:0:100575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788201372.468739:0:100575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201372.468740:0:100575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201372.468741:0:100575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201372.468742:0:100575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201372.468743:0:100575:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201372.468744:0:100575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201372.468746:0:100575:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788201372.468749:0:100575:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788201372.468751:0:100575:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788201372.468752:0:100575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788201372.468753:0:100575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201372.468754:0:100575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201372.468755:0:100575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201372.468756:0:100575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201372.468757:0:100575:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201372.468758:0:100575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201372.468758:0:100575:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788201372.468785:0:100575:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788201372.468806:0:100575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715346432:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788201372.468876:0:100575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201372.468926:0:100575:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005dfdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201372.469049:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715346432 00000100:00100000:1.0:1788201372.469057:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715346432 00000100:00100000:1.0:1788201372.469104:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788201372.469113:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1330fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:100575:x1875060715346432:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788201372.469146:0:94461:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788201372.469159:0:94461:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788201372.470641:0:94461:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788201372.470663:0:94461:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788201372.470839:0:94465:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788201372.470845:0:94465:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788201372.470866:0:94465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc0078fc000/0x96d0c9b8c9a1d79c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.470899:0:94465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc00896b600/0x96d0c9b8c9a1d710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d709 expref: 24 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.470907:0:94465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc00896b000/0x96d0c9b8c9a1d71e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d717 expref: 24 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.470917:0:94465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc00896a600/0x96d0c9b8c9a1d725 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ca8 expref: 9 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.470925:0:94465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dc0078fc000/0x96d0c9b8c9a1d79c lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.470962:0:94465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc00896a600/0x96d0c9b8c9a1d725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ca8 expref: 9 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.470976:0:94465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc00896a600/0x96d0c9b8c9a1d725 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ca8 expref: 9 pid: 94464 timeout: 4323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201372.470990:0:94465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715346560:192.168.201.20@tcp:104: 00010000:00010000:2.0:1788201372.471099:0:94465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc00896b000/0x96d0c9b8c9a1d71e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1d717 expref: 24 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.471108:0:94465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc00896b000/0x96d0c9b8c9a1d71e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d717 expref: 24 pid: 94467 timeout: 4323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201372.471118:0:94465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333be300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715346688:0@lo:104: 00000100:00100000:2.0:1788201372.471160:0:94465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201372.471197:0:94465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc00896b600/0x96d0c9b8c9a1d710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1d709 expref: 24 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.471211:0:94465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc00896b600/0x96d0c9b8c9a1d710 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d709 expref: 24 pid: 94467 timeout: 4323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201372.471220:0:94465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715346816:0@lo:104: 00000100:00100000:2.0:1788201372.471245:0:94465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201372.471262:0:94465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0039cfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201372.471286:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715346688 00000100:00100000:2.0:1788201372.471293:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715346688 00000100:00100000:2.0:1788201372.471398:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715346816 00000100:00100000:2.0:1788201372.471402:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715346816 00000100:00100000:2.0:1788201372.471424:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788201372.471434:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+4:94465:x1875060715346688:12345-0@lo:104: 00010000:00010000:2.0:1788201372.471446:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc00896ae00/0x96d0c9b8c9a1d717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1d71e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.471498:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201372.471505:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+4:94465:x1875060715346688:12345-0@lo:104: Request processed in 73us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201372.471512:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788201372.471530:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1788201372.471545:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+3:94465:x1875060715346816:12345-0@lo:104: 00010000:00010000:2.0:1788201372.471553:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1d709 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1d710 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.471586:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788201372.471591:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+3:94465:x1875060715346816:12345-0@lo:104: Request processed in 57us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201372.471608:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00010000:00010000:2.0:1788201372.471636:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201372.471642:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc00896ae00/0x96d0c9b8c9a1d717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1d71e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.471650:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896ae00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788201372.471654:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc00896ae00/0x96d0c9b8c9a1d717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1d71e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.471664:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc00896ae00/0x96d0c9b8c9a1d717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1d71e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201372.471672:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc00896ae00/0x96d0c9b8c9a1d717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1d71e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201372.471678:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201372.471727:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc00896ae00/0x96d0c9b8c9a1d717 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1d71e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.471734:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201372.471757:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc00896ae00/0x96d0c9b8c9a1d717 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1d71e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.471765:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc00896ae00/0x96d0c9b8c9a1d717 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1d71e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.471782:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201372.471786:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1d709 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1d710 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.471801:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74a00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788201372.471805:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1d709 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1d710 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.471813:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1d709 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1d710 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201372.471819:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1d709 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1d710 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201372.471825:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201372.471839:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1d709 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1d710 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.471845:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201372.471852:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1d709 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1d710 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.471858:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1d709 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1d710 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.471872:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201372.471874:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201372.471875:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201372.471883:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201372.472045:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715346944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201372.472082:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201372.472114:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201372.472120:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715347072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201372.472152:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201372.472193:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715346944 00000100:00100000:2.0:1788201372.472197:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715346944 00010000:00010000:2.0:1788201372.472220:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc00896b000/0x96d0c9b8c9a1d71e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d717 expref: 25 pid: 94467 timeout: 4323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201372.472242:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715347072 00000100:00100000:2.0:1788201372.472246:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715347072 00010000:00010000:2.0:1788201372.472257:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc00896b600/0x96d0c9b8c9a1d710 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d709 expref: 26 pid: 94467 timeout: 4323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201372.472275:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2621 00000100:00100000:2.0:1788201372.472282:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+26:3655:x1875060715346944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201372.472293:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788201372.472617:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1330fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+26:100575:x1875060715346432:12345-0@lo:253:mount.lustre.0 Request processed in 3503us (3739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201372.472627:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788201372.473952:0:100575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:100575:1875060715346432:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788201372.473968:0:100575:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788201372.473971:0:100575:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788201372.473973:0:100575:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788201372.473974:0:100575:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201372.473975:0:100575:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201372.473976:0:100575:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201372.473978:0:100575:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201372.473979:0:100575:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201372.473980:0:100575:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201372.473981:0:100575:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788201372.473999:0:100575:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788201372.475099:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2622 00000100:00100000:1.0:1788201372.475113:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+25:3655:x1875060715347072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201372.475128:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201372.475137:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc00896b600/0x96d0c9b8c9a1d710 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d709 expref: 25 pid: 94467 timeout: 4323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201372.475150:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc00896b600/0x96d0c9b8c9a1d710 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d709 expref: 25 pid: 94467 timeout: 4323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201372.475169:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201372.475221:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+25:3655:x1875060715347072:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (3067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201372.475227:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2622 00000100:00100000:1.0:1788201372.475278:0:94465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715346560:192.168.201.20@tcp:104: 00000100:00100000:1.0:1788201372.475289:0:94465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333be300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715346688:0@lo:104: 00010000:00010000:1.0:1788201372.475305:0:94465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00896b600/0x96d0c9b8c9a1d710 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d709 expref: 24 pid: 94467 timeout: 4323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201372.475317:0:94465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94465:1875060715346816:0@lo:104: 00010000:00010000:1.0:1788201372.475340:0:94465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dc0078fc000/0x96d0c9b8c9a1d79c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201372.476158:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201372.476185:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695508736 00000100:00100000:1.0:1788201372.476191:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695508736 00010000:00010000:1.0:1788201372.476215:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc00896a600/0x96d0c9b8c9a1d725 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ca8 expref: 10 pid: 94464 timeout: 4323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201372.476249:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2623 00000100:00100000:1.0:1788201372.476257:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12580aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695508736:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201372.476267:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201372.476272:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc00896a600/0x96d0c9b8c9a1d725 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ca8 expref: 10 pid: 94464 timeout: 4323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201372.476281:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc00896a600/0x96d0c9b8c9a1d725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ca8 expref: 10 pid: 94464 timeout: 4323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201372.476293:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00896a600/0x96d0c9b8c9a1d725 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ca8 expref: 10 pid: 94464 timeout: 4323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201372.476305:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201372.476348:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12580aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:2401:x1875060695508736:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 93us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201372.476355:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2623 00010000:00010000:2.0:1788201372.476477:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc00896b000/0x96d0c9b8c9a1d71e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d717 expref: 23 pid: 94467 timeout: 4323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.476488:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc00896b000/0x96d0c9b8c9a1d71e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d717 expref: 23 pid: 94467 timeout: 4323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.476498:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00896b000/0x96d0c9b8c9a1d71e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1d717 expref: 23 pid: 94467 timeout: 4323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.476511:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dc0078fc000/0x96d0c9b8c9a1d79c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.476520:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fc000/0x96d0c9b8c9a1d79c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201372.476585:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715347072:0@lo:103:ldlm_bl.0 20000000:01000000:2.0:1788201372.477128:0:6518:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.036317302s 00010000:00010000:2.0:1788201372.477134:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc0078fc000/0x96d0c9b8c9a1d79c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.477142:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc0078fc000/0x96d0c9b8c9a1d79c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.477149:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc0078fc000/0x96d0c9b8c9a1d79c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.477156:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc0078fc000/0x96d0c9b8c9a1d79c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.477162:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fc000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201372.477166:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc0078fc000/0x96d0c9b8c9a1d79c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.477174:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc0078fc000/0x96d0c9b8c9a1d79c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.477193:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc0078fc000/0x96d0c9b8c9a1d79c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201372.477202:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201372.479766:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+22:3655:x1875060715346944:12345-0@lo:103:ldlm_bl.0 Request processed in 7478us (7676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201372.479782:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2621 00010000:00010000:0.0:1788201372.480172:0:94465:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dc0078fc000/0x96d0c9b8c9a1d79c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201372.480185:0:94465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc0078fc000/0x96d0c9b8c9a1d79c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201372.480208:0:94465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fc000/0x96d0c9b8c9a1d79c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201372.480420:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715346944:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1788201372.481782:0:100575:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788201372.489623:0:100575:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788201372.489634:0:100575:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788201372.489675:0:100575:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788201372.489736:0:100575:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788201372.489756:0:100575:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788201372.489774:0:100575:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788201372.495412:0:100575:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788201372.495708:0:100575:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788201373.457300:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788201373.565360:0:100639:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788201373.565603:0:100639:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1788201374.287570:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788201374.287579:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc11d438000 from 131 10000000:01000000:1.0:1788201374.287585:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788201374.287633:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1d7a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201374.287665:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1d7a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201374.287677:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1d7a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201374.287703:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12580a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715347200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201374.287833:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201374.287868:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103892a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201374.288389:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715347200 00000100:00100000:0.0:1788201374.288399:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715347200 00000100:00100000:0.0:1788201374.288447:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788201374.288455:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107d23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715347200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201374.288481:0:94463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201374.288496:0:94463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00896be00/0x96d0c9b8c9a1d7aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1d7a3 expref: -99 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201374.288556:0:94463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00896be00/0x96d0c9b8c9a1d7aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d7a3 expref: 23 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201374.288566:0:94463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00896be00/0x96d0c9b8c9a1d7aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d7a3 expref: 23 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201374.288576:0:94463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896be00, rc 0) 00000100:00100000:0.0:1788201374.288626:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107d23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715347200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201374.288633:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788201374.288694:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12580a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715347200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201374.288708:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1d7a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d7aa expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201374.288717:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1d7a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d7aa expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201374.288766:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715347328:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788201374.288798:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201374.288812:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715347328 00000100:00100000:0.0:1788201374.288815:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f6dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201374.288816:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715347328 00000100:00100000:1.0:1788201374.288843:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788201374.288850:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715347328:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788201374.288864:0:94461:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788201374.288881:0:94461:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788201374.288884:0:94461:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 131 00000100:00100000:1.0:1788201374.288968:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715347328:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201374.288975:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788201374.292852:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715347328:0@lo:256:ll_cfg_requeue.0 00000100:00080000:0.0:1788201374.292912:0:6529:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8dc1257f0800 already not connected (conn 6, was 0): DISCONN 00010000:00080000:0.0:1788201374.292927:0:6529:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8dc1257f0800@lustre-OST0001-osc-MDT0000: found existing conn 192.168.201.120@tcp, moved to head 00000100:00080000:0.0:1788201374.292938:0:6529:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201374.292946:0:6529:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dc1257f0800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201374.292981:0:6529:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc1060cf100 x1875060715347456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:0.0:1788201374.293069:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788201374.293080:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1d7a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d7aa expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201374.293090:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1d7a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d7aa expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201374.293100:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788201374.293103:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc0053a4000 from 131 10000000:01000000:0.0:1788201374.293106:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788201374.293131:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1d7b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201374.293139:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1d7b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201374.293148:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1d7b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201374.293168:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715347584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201374.293228:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201374.293284:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121c61780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201374.293483:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715347456:0@lo:8:ll_cfg_requeue.0 00000100:00100000:2.0:1788201374.293609:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715347584 00000100:00100000:2.0:1788201374.293617:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715347584 00000100:00100000:2.0:1788201374.293661:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788201374.293670:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715347584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201374.293683:0:94463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201374.293697:0:94463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0078fd400/0x96d0c9b8c9a1d7b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1d7b1 expref: -99 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201374.293719:0:94463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0078fd400/0x96d0c9b8c9a1d7b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d7b1 expref: 24 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201374.293728:0:94463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0078fd400/0x96d0c9b8c9a1d7b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d7b1 expref: 24 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201374.293737:0:94463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fd400, rc 0) 00000100:00100000:2.0:1788201374.293775:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715347584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201374.293782:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788201374.293860:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715347584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201374.293872:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1d7b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d7b8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201374.293886:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1d7b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d7b8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201374.293924:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715347712:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788201374.293952:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201374.293979:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121c61780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201374.294053:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201374.294212:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715347456 00000100:00100000:0.0:1788201374.294216:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715347456 00000100:00100000:0.0:1788201374.294244:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788201374.294249:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3654:x1875060715347456:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:0.0:1788201374.294280:0:99767:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4225 last 0 00000020:00000080:0.0:1788201374.294303:0:99767:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1d7bf 00002000:00100000:0.0:1788201374.294315:0:99767:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8dc11cddd000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788201374.294319:0:99767:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788201374.294322:0:99767:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788201374.294492:0:99767:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1788201374.294707:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715347712 00000100:00100000:2.0:1788201374.294712:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715347712 00000100:00100000:2.0:1788201374.294746:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788201374.294754:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715347712:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201374.294768:0:94464:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788201374.294785:0:94464:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201374.294792:0:94464:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 131 00000100:00100000:2.0:1788201374.294872:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715347712:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201374.294879:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788201374.294911:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715347712:0@lo:256:ll_cfg_requeue.0 00000100:00080000:2.0:1788201374.294942:0:6529:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8dc1031f8800 already not connected (conn 6, was 0): DISCONN 00010000:00080000:2.0:1788201374.294949:0:6529:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8dc1031f8800@lustre-OST0001-osc-MDT0001: found existing conn 192.168.201.120@tcp, moved to head 00000100:00080000:2.0:1788201374.294953:0:6529:0:(import.c:65:import_set_state_nolock()) ffff8dc1031f8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201374.294959:0:6529:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8dc1031f8800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201374.294978:0:6529:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d5b800 x1875060715347840/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:2.0:1788201374.295029:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788201374.295037:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1d7b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d7b8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201374.295046:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1d7b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d7b8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201374.295064:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715347840:0@lo:8:ll_cfg_requeue.0 00000100:00100000:2.0:1788201374.295090:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201374.295123:0:99764:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788201374.295129:0:99764:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:0.0:1788201374.295185:0:99767:0:(import.c:65:import_set_state_nolock()) ffff8dc11cddb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201374.295231:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715347456:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 980us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201374.295239:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788201374.295251:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715347840 00000100:00100000:0.0:1788201374.295254:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715347840 00000100:00100000:0.0:1788201374.295286:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201374.295291:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3654:x1875060715347840:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:0.0:1788201374.295308:0:99767:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4225 last 0 00000020:00000080:0.0:1788201374.295332:0:99767:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x96d0c9b8c9a1d7c6 00002000:00100000:0.0:1788201374.295339:0:99767:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8dc11cddb000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788201374.295342:0:99767:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1788201374.295344:0:99767:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788201374.295375:0:99767:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788201374.295388:0:99767:0:(import.c:65:import_set_state_nolock()) ffff8dc11cdda000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201374.295415:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715347840:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 122us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201374.295422:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788201374.296745:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc005d5b800 x1875060715347840/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201374.296764:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788201374.296779:0:3654:0:(import.c:1338:ptlrpc_connect_interpret()) @@@ lustre-OST0001-osc-MDT0001: evicting (reconnect/recover flags not set: 4) req@ffff8dc005d5b800 x1875060715347840/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201399 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201374.296792:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1031f8800 lustre-OST0001_UUID: changing import state from CONNECTING to EVICTED 00000100:02020000:2.0:1788201374.296799:0:3654:0:(import.c:1663:ptlrpc_import_recovery_state_machine()) lustre-OST0001-osc-MDT0001: This client was evicted by lustre-OST0001; in progress operations using this service will fail. 00000100:00080000:2.0:1788201374.311513:0:3654:0:(import.c:1674:ptlrpc_import_recovery_state_machine()) evicted from lustre-OST0001_UUID@0@lo; invalidating 00000100:00100000:3.0:1788201374.313742:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715347840:0@lo:8:ll_cfg_requeue.0 00010000:00080000:3.0:1788201374.313784:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc1060cf100 x1875060715347456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201374.313803:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788201374.313817:0:3654:0:(import.c:1338:ptlrpc_connect_interpret()) @@@ lustre-OST0001-osc-MDT0000: evicting (reconnect/recover flags not set: 4) req@ffff8dc1060cf100 x1875060715347456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201399 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201374.313825:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f0800 lustre-OST0001_UUID: changing import state from CONNECTING to EVICTED 00000100:02020000:3.0:1788201374.313830:0:3654:0:(import.c:1663:ptlrpc_import_recovery_state_machine()) lustre-OST0001-osc-MDT0000: This client was evicted by lustre-OST0001; in progress operations using this service will fail. 00000100:00080000:3.0:1788201374.331012:0:3654:0:(import.c:1674:ptlrpc_import_recovery_state_machine()) evicted from lustre-OST0001_UUID@0@lo; invalidating 00000100:00080000:3.0:1788201374.331062:0:100690:0:(import.c:1598:ptlrpc_invalidate_import_thread()) thread invalidate import lustre-OST0001-osc-MDT0001 to lustre-OST0001_UUID@0@lo 00000100:00080000:3.0:1788201374.331067:0:100690:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788201374.331078:0:100690:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8dc0058aa300 x1875060715330944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/224 e 0 to 0 dl 1788201358 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201374.331092:0:100690:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294969442 gen 3 00000004:00080000:3.0:1788201374.331102:0:100690:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201374.331105:0:100690:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1788201374.333077:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715330944:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788201374.333183:0:100690:0:(import.c:65:import_set_state_nolock()) ffff8dc1031f8800 lustre-OST0001_UUID: changing import state from EVICTED to RECOVER 00000100:00080000:1.0:1788201374.333189:0:100690:0:(import.c:65:import_set_state_nolock()) ffff8dc1031f8800 lustre-OST0001_UUID: changing import state from RECOVER to FULL 00000004:00080000:1.0:1788201374.333197:0:100690:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:1.0:1788201374.333200:0:100690:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0001-osc-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788201374.333280:0:75750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12580a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:75750:1875060715348096:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788201374.333346:0:75750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201374.333360:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715347968:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201374.333392:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201374.333394:0:75750:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103892c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201374.333423:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715347968 00000100:00100000:0.0:1788201374.333430:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715348096 00000100:00100000:1.0:1788201374.333431:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715347968 00000100:00100000:0.0:1788201374.333432:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715348096 00000100:00100000:1.0:1788201374.333480:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201374.334720:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715347456:0@lo:8:ll_cfg_requeue.0 00000100:00100000:0.0:1788201374.335161:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788201374.335171:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125809500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:75750:x1875060715348096:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:2.0:1788201374.335647:0:100691:0:(import.c:1598:ptlrpc_invalidate_import_thread()) thread invalidate import lustre-OST0001-osc-MDT0000 to lustre-OST0001_UUID@0@lo 00000100:00080000:2.0:1788201374.335652:0:100691:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788201374.335660:0:100691:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8dc11cd18e00 x1875060715331456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/224 e 0 to 0 dl 1788201360 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201374.335713:0:100691:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969457 gen 3 00000004:00080000:2.0:1788201374.335732:0:100691:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201374.335734:0:100691:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1788201374.335819:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715331456:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788201374.335932:0:100691:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f0800 lustre-OST0001_UUID: changing import state from EVICTED to RECOVER 00000100:00080000:2.0:1788201374.335938:0:100691:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f0800 lustre-OST0001_UUID: changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201374.336038:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715348224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201374.336097:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201374.336169:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715347968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201374.336193:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788201374.336204:0:94477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94477:1875060715348352:0@lo:7:osp-pre-1-0.0 00000100:00100000:0.0:1788201374.336229:0:94477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201374.336235:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715347968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2748us (2842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201374.336244:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201374.336246:0:94477:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f6dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201374.336259:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715348352 00000100:00100000:1.0:1788201374.336263:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715348224 00000100:00100000:0.0:1788201374.336265:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715348352 00000100:00100000:1.0:1788201374.336277:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715348224 00000100:00100000:1.0:1788201374.336291:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201374.336298:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788201374.336298:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3658:x1875060715348224:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201374.336303:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:94477:x1875060715348352:12345-0@lo:7:osp-pre-1-0.0 00002000:00000024:1.0:1788201374.336307:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00010000:00080000:0.0:1788201374.336354:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc125808000 x1875060715347968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201374.336370:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125808000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715347968:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788201374.337077:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788201374.337244:0:100691:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:2.0:1788201374.337249:0:100691:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0001-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788201374.337775:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3658:x1875060715348224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1475us (1676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201374.337785:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788201374.337816:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc1060cd180 x1875060715348224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201374.337832:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715348224:0@lo:13:osp-pre-1-0.0 00002000:00080000:0.0:1788201374.337936:0:99767:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788201374.337941:0:99767:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x621:0x0] 00000100:00100000:0.0:1788201374.338002:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125809500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:75750:x1875060715348096:12345-0@lo:7:osp-pre-1-1.0 Request processed in 2832us (4654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201374.338009:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788201374.339517:0:75750:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc12580a680 x1875060715348096/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788201390 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201374.339533:0:75750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12580a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:75750:1875060715348096:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788201374.339546:0:75750:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x621:0x0] 00002000:00080000:2.0:1788201374.341046:0:99764:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788201374.341055:0:99764:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000401:0x3a1:0x0] 00000100:00100000:2.0:1788201374.341140:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:94477:x1875060715348352:12345-0@lo:7:osp-pre-1-0.0 Request processed in 4833us (4907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201374.341150:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788201374.341250:0:94477:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc1060cf100 x1875060715348352/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788201390 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201374.341263:0:94477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94477:1875060715348352:0@lo:7:osp-pre-1-0.0 00000004:00080000:0.0:1788201374.341274:0:94477:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x2c0000401:0x3a1:0x0] 00000100:00100000:3.0:1788201374.362323:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201374.362674:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695508864 00000100:00100000:0.0:1788201374.362686:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695508864 00000100:00100000:0.0:1788201374.362843:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 328 00000100:00100000:0.0:1788201374.362853:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695508864:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201374.362872:0:94463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201374.362889:0:94463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc00896ac00/0x96d0c9b8c9a1d7cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786caf expref: -99 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201374.362917:0:94463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc00896ac00/0x96d0c9b8c9a1d7cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786caf expref: 10 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201374.362928:0:94463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc00896ac00/0x96d0c9b8c9a1d7cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786caf expref: 10 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201374.362938:0:94463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896ac00, rc 0) 00000100:00100000:0.0:1788201374.363001:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695508864:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 149us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201374.363062:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 328 00000100:00100000:2.0:1788201374.373589:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201374.375307:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695508992 00000100:00100000:3.0:1788201374.375322:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695508992 00000100:00100000:3.0:1788201374.375390:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 329 00000100:00100000:3.0:1788201374.375400:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695508992:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788201374.375425:0:94464:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1788201374.375444:0:94464:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788201374.375447:0:94464:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 131 00000100:00100000:3.0:1788201374.383462:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695508992:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 Request processed in 8052us (9872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201374.383477:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 329 00000100:00100000:3.0:1788201374.391835:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201374.393128:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695509120 00000100:00100000:0.0:1788201374.393142:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695509120 00000100:00100000:0.0:1788201374.393203:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:0.0:1788201374.393212:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2399:x1875060695509120:12345-192.168.201.20@tcp:8:ll_cfg_requeue.0 00010000:00080000:0.0:1788201374.393247:0:99766:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp t0 exp 0000000000000000 cur 4225 last 0 00000020:00000080:0.0:1788201374.393281:0:99766:0:(genops.c:1385:class_connect()) connect: client 6e293f14-c501-4bc5-9dd4-a18ef02756b4, cookie 0x96d0c9b8c9a1d7d4 00002000:00100000:0.0:1788201374.393293:0:99766:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6e293f14-c501-4bc5-9dd4-a18ef02756b4/ffff8dc11cdd8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788201374.393304:0:99766:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788201374.393478:0:99766:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788201374.393521:0:99766:0:(import.c:65:import_set_state_nolock()) ffff8dc11cdd9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201374.393591:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695509120:12345-192.168.201.20@tcp:8:ll_cfg_requeue.0 Request processed in 378us (1765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201374.393599:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 10 00010000:00010000:2.0:1788201374.479316:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201375.059538:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201375.059575:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715348480:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201375.059652:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201375.059828:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715348480 00000100:00100000:0.0:1788201375.059838:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715348480 00000100:00100000:0.0:1788201375.059893:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788201375.059903:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715348480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201375.059943:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:0.0:1788201375.059994:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715348480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201375.060001:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788201375.060121:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715348480:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201375.376668:0:3654:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201349/real 1788201349] req@ffff8dc0058a8700 x1875060715333120/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201374 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201375.376703:0:3654:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dc0058a8700 x1875060715333120/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201374 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201375.376713:0:3654:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201349/real 1788201349] req@ffff8dc0058a9c00 x1875060715333632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201374 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201375.376735:0:3654:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dc0058a9c00 x1875060715333632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788201374 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201375.376749:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201375.376771:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788201375.376775:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715333120:0@lo:8:kworker.0 00000100:00080000:1.0:1788201375.376780:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201375.376787:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00080000:0.0:1788201375.376983:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201375.376987:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788201375.376996:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201375.377000:0:93109:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788201375.377009:0:93109:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8dc006d84000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201375.377077:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc0058aa300 x1875060715348864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201375.377094:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201375.377096:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788201375.377098:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201375.377100:0:93109:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788201375.377103:0:93109:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dc109815000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201375.377109:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13f8dad80 x1875060715349248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201375.377145:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715348992:0@lo:400:kworker.0 00000100:00100000:0.0:1788201375.377195:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201375.377227:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715349632:0@lo:400:kworker.0 00000100:00100000:2.0:1788201375.377324:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715348608:0@lo:400:kworker.0 00000100:00100000:2.0:1788201375.377351:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201375.377380:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715349376:0@lo:400:kworker.0 00000100:00100000:2.0:1788201375.377412:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201375.377432:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715349888:0@lo:400:kworker.0 00000100:00100000:2.0:1788201375.377458:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715348608 00000100:00100000:2.0:1788201375.377463:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715348608 00000100:00100000:2.0:1788201375.377513:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788201375.377522:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715348608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201375.377569:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715348608:12345-0@lo:400:kworker.0 Request processed in 48us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201375.377581:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788201375.377600:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715333632:0@lo:8:kworker.0 00000100:00100000:2.0:1788201375.377613:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715348992 00000100:00100000:2.0:1788201375.377617:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715348992 00000100:00100000:1.0:1788201375.377626:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715348864:0@lo:8:kworker.0 00000100:00100000:2.0:1788201375.377639:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715349376 00000100:00100000:2.0:1788201375.377641:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715349376 00000100:00100000:1.0:1788201375.377654:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201375.377657:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715348864 00000100:00100000:2.0:1788201375.377659:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715348864 00000100:00100000:2.0:1788201375.377670:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201375.377677:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715348992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201375.377679:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715349248:0@lo:8:kworker.0 00000100:00100000:1.0:1788201375.377701:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201375.377706:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715348992:12345-0@lo:400:kworker.0 Request processed in 31us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201375.377712:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201375.377721:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715349248 00000100:00100000:1.0:1788201375.377722:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715349120:0@lo:400:kworker.0 00000100:00100000:2.0:1788201375.377724:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715349248 00000100:00100000:2.0:1788201375.377734:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201375.377739:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715349376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201375.377763:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715349376:12345-0@lo:400:kworker.0 Request processed in 24us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201375.377765:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715348736:0@lo:400:kworker.0 00000100:00100000:2.0:1788201375.377769:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201375.377779:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201375.377783:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12580a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3654:x1875060715348864:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788201375.377789:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201375.377808:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715349504:0@lo:400:kworker.0 00000100:00100000:1.0:1788201375.377835:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715348736 00000100:00100000:1.0:1788201375.377839:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715348736 00000100:00100000:1.0:1788201375.377867:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788201375.377874:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715348736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201375.377910:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715348736:12345-0@lo:400:kworker.0 Request processed in 37us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201375.377925:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788201375.377964:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201375.377969:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125808000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3654:x1875060715349248:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788201375.378001:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788201375.378068:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc0058a9880 x1875060715348992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201375.378080:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715348992:0@lo:400:kworker.0 00000100:00100000:0.0:1788201375.378103:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715349632 00000100:00100000:0.0:1788201375.378106:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715349632 00000100:00100000:0.0:1788201375.378146:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1679 00000100:00100000:0.0:1788201375.378152:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715349632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201375.378186:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715349632:12345-0@lo:400:kworker.0 Request processed in 35us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201375.378198:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1679 00010000:00080000:1.0:1788201375.378204:0:99767:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4226 last 0 00000100:00080000:0.0:1788201375.378215:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201375.378234:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715349632:0@lo:400:kworker.0 00000020:00000080:1.0:1788201375.378243:0:99767:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1d7db 00002000:00100000:1.0:1788201375.378261:0:99767:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8dc12f19a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788201375.378266:0:99767:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788201375.378268:0:99767:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:2.0:1788201375.378352:0:99764:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4226 last 0 00000020:00000080:2.0:1788201375.378369:0:99764:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x96d0c9b8c9a1d7e2 00002000:00100000:2.0:1788201375.378375:0:99764:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8dc001db6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788201375.378377:0:99764:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788201375.378379:0:99764:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788201375.378466:0:99764:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00002000:00080000:1.0:1788201375.378470:0:99767:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788201375.378496:0:99767:0:(import.c:65:import_set_state_nolock()) ffff8dc12f19c800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788201375.378496:0:99764:0:(import.c:65:import_set_state_nolock()) ffff8dc001db3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201375.378534:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12580a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715348864:12345-0@lo:8:kworker.0 Request processed in 749us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201375.378542:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201375.378569:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201375.378600:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715348608:0@lo:400:kworker.0 00000100:00100000:1.0:1788201375.378601:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125808000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715349248:12345-0@lo:8:kworker.0 Request processed in 630us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201375.378607:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788201375.378610:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc13f8da300 x1875060715349376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201375.378619:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715349376:0@lo:400:kworker.0 00000100:00100000:1.0:1788201375.378625:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201375.378637:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715349888 00000100:00100000:2.0:1788201375.378641:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715349888 00000100:00100000:1.0:1788201375.378646:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715349760:0@lo:400:kworker.0 00000100:00100000:2.0:1788201375.378668:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715349120 00000100:00100000:2.0:1788201375.378671:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715349120 00000100:00100000:2.0:1788201375.378689:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1680 00000100:00100000:2.0:1788201375.378695:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715349888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201375.378729:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715349888:12345-0@lo:400:kworker.0 Request processed in 34us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201375.378735:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1680 00000100:00100000:1.0:1788201375.378737:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201375.378748:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715349760 00000100:00100000:2.0:1788201375.378751:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715349760 00000100:00100000:1.0:1788201375.378766:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1681 00000100:00100000:1.0:1788201375.378773:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715349120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201375.378775:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1682 00000100:00100000:2.0:1788201375.378780:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715349760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201375.378808:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715349120:12345-0@lo:400:kworker.0 Request processed in 36us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201375.378814:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1681 00000100:00100000:1.0:1788201375.378836:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201375.378854:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715350016:0@lo:400:kworker.0 00000100:00100000:1.0:1788201375.378881:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201375.378909:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715348736:0@lo:400:kworker.0 00000100:00100000:1.0:1788201375.378934:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715349504 00000100:00100000:1.0:1788201375.378938:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715349504 00000100:00100000:1.0:1788201375.378955:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715350016 00000100:00100000:1.0:1788201375.378958:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715350016 00000100:00100000:1.0:1788201375.378972:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1683 00000100:00100000:1.0:1788201375.378977:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715349504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201375.378982:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715349760:12345-0@lo:400:kworker.0 Request processed in 202us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201375.378989:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1682 00000100:00100000:2.0:1788201375.379001:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1684 00000100:00100000:2.0:1788201375.379007:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715350016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201375.379041:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715349504:12345-0@lo:400:kworker.0 Request processed in 63us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201375.379048:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1683 00000100:00100000:0.0:1788201375.379055:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715349504:0@lo:400:kworker.0 00000100:00100000:1.0:1788201375.379072:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715349120:0@lo:400:kworker.0 00000100:00100000:2.0:1788201375.379174:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715350016:12345-0@lo:400:kworker.0 Request processed in 167us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201375.379181:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1684 00000100:00080000:2.0:1788201375.379201:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201375.379203:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201375.379225:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715349888:0@lo:400:kworker.0 00000100:00100000:1.0:1788201375.379454:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715349760:0@lo:400:kworker.0 00010000:00080000:1.0:1788201375.379481:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc0058aa300 x1875060715348864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201375.379504:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 4 00000100:00080000:1.0:1788201375.379584:0:3654:0:(import.c:1338:ptlrpc_connect_interpret()) @@@ lustre-OST0000-osc-MDT0001: evicting (reconnect/recover flags not set: 4) req@ffff8dc0058aa300 x1875060715348864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201385 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201375.379592:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from CONNECTING to EVICTED 00000100:02020000:1.0:1788201375.379596:0:3654:0:(import.c:1663:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. 00000100:00100000:0.0:1788201375.380972:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715350016:0@lo:400:kworker.0 00000100:00080000:1.0:1788201375.388217:0:3654:0:(import.c:1674:ptlrpc_import_recovery_state_machine()) evicted from lustre-OST0000_UUID@0@lo; invalidating 00000100:00100000:0.0:1788201375.389199:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715348864:0@lo:8:kworker.0 00010000:00080000:0.0:1788201375.389247:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc13f8dad80 x1875060715349248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201375.389266:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 4 00000100:00080000:0.0:1788201375.389281:0:3654:0:(import.c:1338:ptlrpc_connect_interpret()) @@@ lustre-OST0000-osc-MDT0000: evicting (reconnect/recover flags not set: 4) req@ffff8dc13f8dad80 x1875060715349248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201385 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201375.389288:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from CONNECTING to EVICTED 00000100:02020000:0.0:1788201375.389293:0:3654:0:(import.c:1663:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. 00000100:00080000:2.0:1788201375.391996:0:100731:0:(import.c:1598:ptlrpc_invalidate_import_thread()) thread invalidate import lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00000100:00080000:2.0:1788201375.392004:0:100731:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788201375.392071:0:100731:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8dc13f8db100 x1875060715326464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/224 e 0 to 0 dl 1788201347 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201375.392103:0:100731:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294969456 gen 3 00000004:00080000:2.0:1788201375.392157:0:100731:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201375.392161:0:100731:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1788201375.394736:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715326464:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788201375.395837:0:100731:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from EVICTED to RECOVER 00000100:00080000:2.0:1788201375.395846:0:100731:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:2.0:1788201375.395861:0:100731:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:2.0:1788201375.395866:0:100731:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788201375.395980:0:75748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:75748:1875060715350272:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788201375.396068:0:75748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201375.396099:0:75748:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038b7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201375.396120:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715350272 00000100:00100000:1.0:1788201375.396134:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715350272 00000100:00100000:1.0:1788201375.396192:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788201375.396201:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:75748:x1875060715350272:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:1.0:1788201375.396440:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201375.396454:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201375.396465:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715350144:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201375.396508:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201375.396537:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715350144 00000100:00100000:1.0:1788201375.396541:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715350144 00000100:00100000:1.0:1788201375.396568:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201375.396575:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715350144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201375.396593:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3922382848 avail 3690860544 00000100:00100000:1.0:1788201375.396638:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715350144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201375.396644:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788201375.396687:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc1333bed80 x1875060715350144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201375.396704:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715350144:0@lo:13:osp-pre-0-1.0 00002000:00080000:1.0:1788201375.410501:0:99764:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788201375.410511:0:99764:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x621:0x0] 00000100:00100000:1.0:1788201375.410615:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:75748:x1875060715350272:12345-0@lo:7:osp-pre-0-1.0 Request processed in 14410us (14541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201375.410627:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788201375.410730:0:75748:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc004b3a300 x1875060715350272/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788201391 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201375.410745:0:75748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:75748:1875060715350272:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788201375.410760:0:75748:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x621:0x0] 00000100:00080000:0.0:1788201375.411833:0:3654:0:(import.c:1674:ptlrpc_import_recovery_state_machine()) evicted from lustre-OST0000_UUID@0@lo; invalidating 00000100:00100000:1.0:1788201375.412373:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715349248:0@lo:8:kworker.0 00000100:00080000:0.0:1788201375.412397:0:100735:0:(import.c:1598:ptlrpc_invalidate_import_thread()) thread invalidate import lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00000100:00080000:0.0:1788201375.412401:0:100735:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788201375.412408:0:100735:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8dc11cd1b800 x1875060715326720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/224 e 0 to 0 dl 1788201347 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201375.412425:0:100735:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969474 gen 3 00000004:00080000:0.0:1788201375.412438:0:100735:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201375.412441:0:100735:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1788201375.412899:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715326720:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788201375.414754:0:100735:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from EVICTED to RECOVER 00000100:00080000:0.0:1788201375.414764:0:100735:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:0.0:1788201375.414784:0:100735:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:0.0:1788201375.414789:0:100735:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1788201375.414877:0:94475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8db800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94475:1875060715350528:0@lo:7:osp-pre-0-0.0 00000100:00100000:0.0:1788201375.414944:0:94475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201375.414977:0:94475:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc003a3ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201375.414998:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715350400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201375.415047:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201375.415087:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715350528 00000100:00100000:0.0:1788201375.415094:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715350528 00000100:00100000:0.0:1788201375.415153:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201375.415163:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:94475:x1875060715350528:12345-0@lo:7:osp-pre-0-0.0 00000100:00080000:3.0:1788201375.417519:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201375.419055:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715350400 00000100:00100000:1.0:1788201375.419067:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715350400 00000100:00100000:1.0:1788201375.419125:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201375.419142:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3655:x1875060715350400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201375.419169:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3922382848 avail 3690860544 00000100:00100000:1.0:1788201375.419258:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3655:x1875060715350400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (4209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201375.419265:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00002000:00080000:1.0:1788201375.419556:0:99767:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788201375.419562:0:99767:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000401:0x3c1:0x0] 00000100:00100000:1.0:1788201375.419610:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:94475:x1875060715350528:12345-0@lo:7:osp-pre-0-0.0 Request processed in 4448us (4665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201375.419618:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788201375.419718:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc13f8d9c00 x1875060715350400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201375.419740:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715350400:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788201375.419830:0:94475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc13f8db800 x1875060715350528/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788201391 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201375.419840:0:94475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8db800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94475:1875060715350528:0@lo:7:osp-pre-0-0.0 00000004:00080000:0.0:1788201375.419850:0:94475:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x280000401:0x3c1:0x0] 00010000:00010000:3.0:1788201375.507538:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201375.582881:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201375.582903:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715350656:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201375.582982:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201375.583046:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715350656 00000100:00100000:1.0:1788201375.583055:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715350656 00000100:00100000:1.0:1788201375.583102:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788201375.583110:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715350656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201375.583144:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:1.0:1788201375.583189:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715350656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201375.583196:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788201375.583242:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715350656:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201376.471636:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201376.471694:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201376.471735:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201376.471829:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201376.471865:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695509376 00000100:00100000:1.0:1788201376.471886:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695509376 00000100:00100000:1.0:1788201376.471953:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695509504 00000100:00100000:1.0:1788201376.471956:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695509504 00000100:00100000:1.0:1788201376.471984:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1685 00000100:00100000:1.0:1788201376.471993:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2400:x1875060695509376:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201376.472098:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2400:x1875060695509376:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 106us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201376.472106:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1685 00000100:00100000:1.0:1788201376.472125:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1686 00000100:00100000:1.0:1788201376.472131:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2400:x1875060695509504:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201376.472157:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2400:x1875060695509504:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201376.472163:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1686 00000100:00100000:3.0:1788201376.474006:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695509760 00000100:00100000:3.0:1788201376.474057:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695509760 00000100:00100000:3.0:1788201376.474126:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:3.0:1788201376.474137:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2400:x1875060695509760:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201376.474204:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2400:x1875060695509760:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 71us (2510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201376.474212:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00080000:3.0:1788201376.474233:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201376.474238:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201376.474241:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201376.474287:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201376.474370:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695509632 00000100:00100000:3.0:1788201376.474374:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695509632 00000100:00100000:3.0:1788201376.474396:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:3.0:1788201376.474400:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1875060695509632:12345-192.168.201.20@tcp:8:kworker.0 00010000:00080000:3.0:1788201376.474427:0:100688:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp t8589934594 exp 0000000000000000 cur 4227 last 0 00000020:00000080:3.0:1788201376.474456:0:100688:0:(genops.c:1385:class_connect()) connect: client 6e293f14-c501-4bc5-9dd4-a18ef02756b4, cookie 0x96d0c9b8c9a1d7e9 00002000:00100000:3.0:1788201376.474478:0:100688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6e293f14-c501-4bc5-9dd4-a18ef02756b4/ffff8dc00520b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788201376.474489:0:100688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788201376.474665:0:100688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788201376.474694:0:100688:0:(import.c:65:import_set_state_nolock()) ffff8dc00520a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201376.474731:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695509632:12345-192.168.201.20@tcp:8:kworker.0 Request processed in 328us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201376.474738:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:0.0:1788201376.475854:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695509248 00000100:00100000:0.0:1788201376.475864:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695509248 00000100:00100000:1.0:1788201376.476038:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 331 00000100:00100000:1.0:1788201376.476049:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695509248:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201376.476141:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695509248:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 93us (4404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201376.476148:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 331 00010000:00010000:2.0:1788201376.527708:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201377.551411:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201378.580482:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201379.212191:0:100934:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788201379.601380:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201379.663505:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201379.663651:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715350912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201379.663725:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201379.663770:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715350784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201379.663801:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715350912 00000100:00100000:3.0:1788201379.663809:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201379.663810:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715350912 00000100:00100000:1.0:1788201379.664086:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715350784 00000100:00100000:1.0:1788201379.664091:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715350784 00000100:00100000:1.0:1788201379.664117:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201379.664127:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715350912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201379.664156:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201379.664316:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715350912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 189us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201379.664334:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201379.664353:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201379.664359:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715350784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201379.664370:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201379.665526:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715350784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1163us (1711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201379.665536:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788201379.666299:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc004b39c00 x1875060715350912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201379.666323:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715350912:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788201379.666336:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc13f8db800 x1875060715350784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201379.666346:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715350784:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788201379.666809:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201380.179683:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201380.179707:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13f8d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715351040:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201380.179781:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201380.179838:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715351040 00000100:00100000:0.0:1788201380.179845:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715351040 00000100:00100000:0.0:1788201380.179896:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788201380.179905:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715351040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201380.179939:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:0.0:1788201380.179986:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715351040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201380.180007:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788201380.180080:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13f8d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715351040:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1788201380.252089:0:100986:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788201380.252326:0:100986:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788201380.627757:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201380.687266:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201380.687298:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715351168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201380.687408:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201380.687687:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715351168 00000100:00100000:1.0:1788201380.687703:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715351168 00000100:00100000:1.0:1788201380.687789:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788201380.687801:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715351168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201380.687838:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922382848 avail 3690860544 00000100:00100000:1.0:1788201380.687892:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715351168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201380.687899:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788201380.687966:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201380.687980:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715351296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201380.688010:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201380.688050:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201380.688055:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715351424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201380.688075:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201380.688099:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715351296 00000100:00100000:1.0:1788201380.688103:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715351296 00000100:00100000:1.0:1788201380.688126:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201380.688131:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715351296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201380.688454:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:1.0:1788201380.688517:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715351296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 385us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201380.688524:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201380.688576:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715351296:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1788201380.688609:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc005d5bb80 x1875060715351168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201380.688622:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715351168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201380.688637:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715351424 00000100:00100000:1.0:1788201380.688640:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715351424 00000100:00100000:1.0:1788201380.688678:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788201380.688684:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715351424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201380.688702:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922382848 avail 3690860544 00000100:00100000:1.0:1788201380.688789:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715351424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201380.688797:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788201380.688815:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788201380.688832:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc004b3a300 x1875060715351424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201380.688844:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715351424:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1788201380.695890:0:100576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000001:00100000:0.0:1788201380.695911:0:100576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788201380.695917:0:100576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788201380.696177:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201380.697571:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201380.697613:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715351680:0@lo:400:kworker.0 00000100:00100000:1.0:1788201380.697709:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201380.698516:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715351680 00000100:00100000:3.0:1788201380.698529:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715351680 00000100:00100000:3.0:1788201380.698600:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788201380.698612:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715351680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201380.698695:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715351680:12345-0@lo:400:kworker.0 Request processed in 85us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201380.698703:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788201380.698769:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc005d5a300 x1875060715351680/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201380.698785:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715351680:0@lo:400:kworker.0 00000100:00100000:0.0:1788201380.701623:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715351552:0@lo:400:kworker.0 00000100:00100000:0.0:1788201380.701917:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201380.703351:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715351936:0@lo:400:kworker.0 00000100:00100000:2.0:1788201380.703441:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201380.703479:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715352448:0@lo:400:kworker.0 00000100:00100000:2.0:1788201380.703510:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201380.703536:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788201380.703542:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715351808:0@lo:400:kworker.0 00000100:00100000:2.0:1788201380.703564:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201380.703583:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715352320:0@lo:400:kworker.0 00000100:00100000:2.0:1788201380.703604:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201380.703637:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715352448 00000100:00100000:2.0:1788201380.703645:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715352448 00000100:00100000:2.0:1788201380.703717:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715351808 00000100:00100000:2.0:1788201380.703720:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715351808 00000100:00100000:1.0:1788201380.703875:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715352064:0@lo:400:kworker.0 00000100:00100000:1.0:1788201380.703913:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201380.703933:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715352576:0@lo:400:kworker.0 00000100:00100000:1.0:1788201380.703978:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201380.703997:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201380.704002:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715352192:0@lo:400:kworker.0 00000100:00100000:1.0:1788201380.704040:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201380.704050:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715352704:0@lo:400:kworker.0 00000100:00100000:1.0:1788201380.704065:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201380.704086:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715352064 00000100:00100000:1.0:1788201380.704089:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715352064 00000100:00100000:1.0:1788201380.704123:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201380.704132:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715352064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201380.704182:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715352064:12345-0@lo:400:kworker.0 Request processed in 51us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201380.704188:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788201380.704232:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc005d5b480 x1875060715352064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201380.704247:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715352064:0@lo:400:kworker.0 00000100:00100000:2.0:1788201380.704431:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715352320 00000100:00100000:2.0:1788201380.704435:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715352320 00000100:00100000:2.0:1788201380.704451:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715352576 00000100:00100000:2.0:1788201380.704454:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715352576 00000100:00100000:2.0:1788201380.704479:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715352192 00000100:00100000:2.0:1788201380.704481:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715352192 00000100:00100000:2.0:1788201380.704491:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715352704 00000100:00100000:2.0:1788201380.704493:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715352704 00000100:00100000:2.0:1788201380.704506:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1687 00000100:00100000:2.0:1788201380.704512:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715352448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201380.704555:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715352448:12345-0@lo:400:kworker.0 Request processed in 43us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201380.704562:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1687 00000100:00100000:2.0:1788201380.704575:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1688 00000100:00100000:2.0:1788201380.704581:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715351808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201380.704609:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715351808:12345-0@lo:400:kworker.0 Request processed in 29us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201380.704615:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1688 00000100:00100000:2.0:1788201380.704626:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1689 00000100:00100000:2.0:1788201380.704633:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715352320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201380.704658:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715352320:12345-0@lo:400:kworker.0 Request processed in 26us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201380.704664:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1689 00000100:00100000:2.0:1788201380.704674:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1690 00000100:00100000:2.0:1788201380.704680:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715352576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201380.704723:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715352576:12345-0@lo:400:kworker.0 Request processed in 44us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201380.705503:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1690 00000100:00100000:2.0:1788201380.705531:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1691 00000100:00100000:2.0:1788201380.705539:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715352192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201380.705603:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715352192:12345-0@lo:400:kworker.0 Request processed in 66us (1562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201380.705608:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1691 00000100:00100000:2.0:1788201380.705618:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1692 00000100:00100000:2.0:1788201380.705624:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715352704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201380.705646:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715352704:12345-0@lo:400:kworker.0 Request processed in 22us (1580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201380.705650:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1692 00000100:00100000:2.0:1788201380.705904:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715351808:0@lo:400:kworker.0 00000100:00100000:2.0:1788201380.705923:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715352320:0@lo:400:kworker.0 00000100:00100000:2.0:1788201380.705935:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715352448:0@lo:400:kworker.0 00000100:00080000:2.0:1788201380.705968:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201380.705974:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201380.705988:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715351936 00000100:00100000:2.0:1788201380.705994:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715351936 00000100:00100000:2.0:1788201380.706056:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788201380.706063:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715351936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201380.706112:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715351936:12345-0@lo:400:kworker.0 Request processed in 50us (2672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201380.706117:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788201380.706141:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715351936:0@lo:400:kworker.0 00000100:00100000:2.0:1788201380.706171:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715352192:0@lo:400:kworker.0 00000100:00100000:2.0:1788201380.706187:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715352704:0@lo:400:kworker.0 00000100:00100000:2.0:1788201380.706208:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715352576:0@lo:400:kworker.0 00000100:00100000:3.0:1788201380.708235:0:94467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715351552 00000100:00100000:3.0:1788201380.708253:0:94467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715351552 00000100:00100000:3.0:1788201380.708323:0:94467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788201380.708335:0:94467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715351552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201380.708604:0:94467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715351552:12345-0@lo:400:kworker.0 Request processed in 271us (6686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201380.708631:0:94467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788201380.708949:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715351552:0@lo:400:kworker.0 00000020:00000004:0.0:1788201381.223105:0:101037:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788201381.223346:0:101037:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788201381.648362:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788201381.721788:0:99761:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000001:00100000:0.0:1788201381.721804:0:99761:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788201381.721811:0:99761:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788201381.846222:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201381.846273:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201381.846314:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201381.846346:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201381.846368:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201381.846411:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695510400 00000100:00100000:3.0:1788201381.846422:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695510400 00000100:00100000:3.0:1788201381.846481:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695510272 00000100:00100000:3.0:1788201381.846485:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695510272 00000100:00100000:1.0:1788201381.846496:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:0.0:1788201381.846620:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695510144 00000100:00100000:0.0:1788201381.846625:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695510144 00000100:00100000:0.0:1788201381.846659:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695510016 00000100:00100000:0.0:1788201381.846662:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695510016 00000100:00100000:0.0:1788201381.846694:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1693 00000100:00100000:0.0:1788201381.846703:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2401:x1875060695510144:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201381.846775:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2401:x1875060695510144:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 74us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201381.846782:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1693 00000100:00100000:0.0:1788201381.846801:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1694 00000100:00100000:0.0:1788201381.846818:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2401:x1875060695510016:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201381.846863:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:2401:x1875060695510016:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 46us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201381.846869:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1694 00000100:00100000:1.0:1788201381.847008:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695510400:12345-192.168.201.20@tcp:400:kworker.0 00000100:00080000:0.0:1788201381.847051:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201381.847056:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201381.847059:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201381.847061:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201381.847107:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695510400:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 599us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201381.847164:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695509888 00000100:00100000:2.0:1788201381.847168:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695509888 00000100:00100000:2.0:1788201381.847211:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 333 00000100:00100000:2.0:1788201381.847219:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695509888:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201381.847253:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695509888:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 35us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201381.847260:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 333 00000100:00100000:3.0:1788201381.853783:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:3.0:1788201381.853803:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695510272:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201381.853903:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695510272:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 107us (7533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201381.853910:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:1.0:1788201381.860998:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5 00010000:00010000:2.0:1788201382.671534:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201383.394210:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201383.394322:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695510528 00000100:00100000:2.0:1788201383.394333:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695510528 00000100:00100000:2.0:1788201383.394427:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1617 00000100:00100000:2.0:1788201383.394441:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:75347:x1875060695510528:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:2.0:1788201383.394481:0:69485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:2.0:1788201383.394557:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:75347:x1875060695510528:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 119us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201383.394565:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1617 00000100:00080000:0.0:1788201383.394628:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201383.402571:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201383.402687:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695510656 00000100:00100000:2.0:1788201383.402697:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695510656 00000100:00100000:2.0:1788201383.402834:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1618 00000100:00100000:2.0:1788201383.402846:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:75347:x1875060695510656:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:2.0:1788201383.402883:0:66313:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:2.0:1788201383.402957:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:75347:x1875060695510656:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 114us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201383.402964:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1618 00000100:00080000:0.0:1788201383.403173:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201383.416433:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201383.416544:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695510784 00000100:00100000:1.0:1788201383.416556:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695510784 00000100:00100000:1.0:1788201383.416703:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:1.0:1788201383.416715:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:75347:x1875060695510784:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:1.0:1788201383.416764:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922382848 avail 3690860544 00000100:00100000:1.0:1788201383.416863:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:75347:x1875060695510784:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 151us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201383.416871:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00080000:0.0:1788201383.418126:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201383.420184:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201383.420332:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695510912 00000100:00100000:1.0:1788201383.420354:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695510912 00000100:00100000:1.0:1788201383.420435:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:1.0:1788201383.420446:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:75347:x1875060695510912:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:1.0:1788201383.420481:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201383.420569:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:75347:x1875060695510912:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 125us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201383.420577:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00080000:0.0:1788201383.421150:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201383.445679:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201383.445867:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695511168 00000100:00100000:0.0:1788201383.445880:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695511168 00000100:00100000:0.0:1788201383.445954:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1619 00000100:00100000:0.0:1788201383.445966:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+51:73451:x1875060695511168:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:0.0:1788201383.445988:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201383.446013:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b000/0x96d0c9b8c9a1d7f0 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786cb6 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.446167:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d7f7 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.446181:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d7f7 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.446194:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d7f7 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.446225:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d7fe lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xc8d93425 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.446233:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d7fe lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.446240:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d7fe lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201383.446609:0:66314:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x396:0x0], index 0: 0 00010000:00010000:0.0:1788201383.447531:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1d805 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.447547:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1d805 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.447556:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1d805 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.447588:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d7f7 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.447596:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d7f7 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.447602:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d7f7 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.447608:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d7f7 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.447614:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896b600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201383.447628:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d7f7 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.447636:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d7f7 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.447648:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201383.447979:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201383.447984:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d7f7 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.447991:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d7f7 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201383.448006:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049c622b0 reply state 000000006717a9d0 transno 124554051731 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d7fe lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.448059:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d7fe lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.448066:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8d93425 (ffff8dc0084fb500) 00010000:00010000:0.0:1788201383.448069:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201383.448072:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201383.448732:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b000/0x96d0c9b8c9a1d7f0 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cb6 expref: 54 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.448757:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1d805 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cb6 expref: 53 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.448765:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x2f:0x0].0x0 (ffff8dc0084fb000) 00010000:00010000:0.0:1788201383.448767:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201383.448780:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896ae00, rc 0) 00000100:00100000:0.0:1788201383.448982:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+54:73451:x1875060695511168:12345-192.168.201.20@tcp:101:bash.0 Request processed in 3018us (3314us total) trans 124554051731 rc 0/0 00000100:00100000:0.0:1788201383.448991:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1619 00000100:00100000:3.0:1788201383.473848:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201383.473965:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695511296 00000100:00100000:0.0:1788201383.473977:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695511296 00000100:00100000:0.0:1788201383.474082:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:0.0:1788201383.474093:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:73451:x1875060695511296:12345-192.168.201.20@tcp:101:bash.0 00010000:00010000:0.0:1788201383.474124:0:99767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201383.474150:0:99767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df038d52/0x96d0c9b8c9a1d813 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786cbd expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201383.474769:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x396:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201383.474795:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x396:0x0].0x0 since=4234s v=(0 0) 00010000:00010000:0.0:1788201383.474800:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x396:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201383.474810:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df038d52/0x96d0c9b8c9a1d813 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cbd expref: 6 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.474831:0:99767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df038d52/0x96d0c9b8c9a1d813 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cbd expref: 6 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.474844:0:99767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896b000, rc 0) 00000100:00100000:0.0:1788201383.474914:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:73451:x1875060695511296:12345-192.168.201.20@tcp:101:bash.0 Request processed in 823us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201383.474922:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:1.0:1788201383.489784:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201383.489964:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695511552 00000100:00100000:0.0:1788201383.489976:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695511552 00000100:00100000:0.0:1788201383.490086:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 285 00000100:00100000:0.0:1788201383.490097:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+54:73451:x1875060695511552:12345-192.168.201.20@tcp:35:bash.0 00000100:00100000:0.0:1788201383.490429:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+55:73451:x1875060695511552:12345-192.168.201.20@tcp:35:bash.0 Request processed in 333us (656us total) trans 124554051732 rc 0/0 00000100:00100000:0.0:1788201383.490437:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 285 00000100:00100000:3.0:1788201383.529516:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201383.529609:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695511680 00000100:00100000:1.0:1788201383.529620:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695511680 00000100:00100000:1.0:1788201383.529695:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1620 00000100:00100000:1.0:1788201383.529707:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+55:75365:x1875060695511680:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:1.0:1788201383.529732:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201383.529753:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1d81a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786cc4 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.529825:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1d821 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.529839:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1d821 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.529868:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1d821 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201383.529918:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00000004:00200000:1.0:1788201383.529922:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201383.529943:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1d821 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.529969:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1d81a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cc4 expref: 57 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.529988:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1d821 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cc4 expref: 56 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.529997:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:1.0:1788201383.530000:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201383.530004:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064eca00, rc 0) 00000100:00100000:2.0:1788201383.530515:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+56:75365:x1875060695511680:12345-192.168.201.20@tcp:101:rm.0 Request processed in 808us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201383.530526:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1620 00000100:00100000:3.0:1788201383.551407:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201383.551549:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695511936 00000100:00100000:2.0:1788201383.551559:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695511936 00000100:00100000:2.0:1788201383.551622:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1621 00000100:00100000:2.0:1788201383.551632:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+56:75365:x1875060695511936:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:2.0:1788201383.551659:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201383.551679:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc200/0x96d0c9b8c9a1d828 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ccb expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201383.551776:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:2.0:1788201383.551869:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc200/0x96d0c9b8c9a1d828 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ccb expref: 58 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.551884:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:2.0:1788201383.551887:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201383.551893:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc200/0x96d0c9b8c9a1d828 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ccb expref: 58 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.551907:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fc200, rc 0) 00000100:00100000:2.0:1788201383.551963:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+57:75365:x1875060695511936:12345-192.168.201.20@tcp:101:rm.0 Request processed in 332us (566us total) trans 124554051733 rc 301/301 00000100:00100000:2.0:1788201383.551970:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1621 00000100:00100000:1.0:1788201383.561945:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201383.562050:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695512064 00000100:00100000:2.0:1788201383.562059:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695512064 00000100:00100000:2.0:1788201383.562098:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 286 00000100:00100000:2.0:1788201383.562105:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+57:75365:x1875060695512064:12345-192.168.201.20@tcp:37:rm.0 00000100:00100000:2.0:1788201383.569355:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+57:75365:x1875060695512064:12345-192.168.201.20@tcp:37:rm.0 Request processed in 7228us (7395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201383.569371:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 286 00000100:00100000:2.0:1788201383.582420:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201383.582569:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695512320 00000100:00100000:0.0:1788201383.582579:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695512320 00000100:00100000:0.0:1788201383.582638:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 287 00000100:00100000:0.0:1788201383.582648:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107db7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+57:75365:x1875060695512320:12345-192.168.201.20@tcp:35:rm.0 00000100:00100000:0.0:1788201383.582924:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107db7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+58:75365:x1875060695512320:12345-192.168.201.20@tcp:35:rm.0 Request processed in 276us (514us total) trans 124554051734 rc 0/0 00000100:00100000:0.0:1788201383.582931:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 287 00000100:00100000:1.0:1788201383.594577:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201383.594682:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695512576 00000100:00100000:0.0:1788201383.594693:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695512576 00000100:00100000:0.0:1788201383.594762:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1622 00000100:00100000:0.0:1788201383.594773:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+58:75365:x1875060695512576:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1788201383.594797:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201383.594821:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d836 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786cd2 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.594936:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adf800/0x96d0c9b8c9a1d83d lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.594951:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adf800/0x96d0c9b8c9a1d83d lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.594964:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adf800/0x96d0c9b8c9a1d83d lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201383.594991:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:0.0:1788201383.595145:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d836 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cd2 expref: 61 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.595164:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adf800/0x96d0c9b8c9a1d83d lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cd2 expref: 60 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.595174:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201383.595177:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788201383.595180:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007adf800, rc 0) 00000100:00100000:0.0:1788201383.595238:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695512576:12345-192.168.201.20@tcp:101:rm.0 Request processed in 466us (671us total) trans 124554051735 rc 0/0 00000100:00100000:0.0:1788201383.595245:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1622 00000100:00100000:0.0:1788201383.612987:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201383.613134:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695512704 00000100:00100000:2.0:1788201383.613146:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695512704 00000100:00100000:2.0:1788201383.613219:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1623 00000100:00100000:2.0:1788201383.613231:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695512704:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:2.0:1788201383.613259:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201383.613282:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1d84b lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786cd9 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613362:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc200/0x96d0c9b8c9a1d852 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613378:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc200/0x96d0c9b8c9a1d852 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613390:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc200/0x96d0c9b8c9a1d852 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613408:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1d859 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613416:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1d859 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613422:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1d859 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613530:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d860 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613540:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d860 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613548:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d860 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201383.613592:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x14:0x0]: returning size 1024 00000004:00200000:2.0:1788201383.613597:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201383.613614:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d860 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613627:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d860 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613637:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc200/0x96d0c9b8c9a1d852 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613644:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc200/0x96d0c9b8c9a1d852 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613650:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc200/0x96d0c9b8c9a1d852 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613656:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc200/0x96d0c9b8c9a1d852 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613662:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fc200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.613666:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc200/0x96d0c9b8c9a1d852 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613681:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc200/0x96d0c9b8c9a1d852 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613693:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201383.613696:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.613700:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc200/0x96d0c9b8c9a1d852 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613706:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc200/0x96d0c9b8c9a1d852 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613719:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1d859 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613725:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1d859 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613730:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1d859 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613734:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fc000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.613737:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1d859 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613742:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1d859 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613749:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff8dc108994000) 00010000:00010000:2.0:1788201383.613751:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.613754:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1d859 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613770:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1d859 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613805:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1d84b lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cd9 expref: 62 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613820:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d860 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cd9 expref: 61 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.613827:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff8dc12196e200) 00010000:00010000:2.0:1788201383.613829:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201383.613832:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59a00, rc 0) 00000100:00100000:2.0:1788201383.613906:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+61:75365:x1875060695512704:12345-192.168.201.20@tcp:101:rm.0 Request processed in 677us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201383.613914:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1623 00000100:00100000:2.0:1788201383.619436:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201383.619532:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695512960 00000100:00100000:0.0:1788201383.619543:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695512960 00000100:00100000:0.0:1788201383.619608:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1624 00000100:00100000:0.0:1788201383.619618:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+61:75365:x1875060695512960:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:0.0:1788201383.619673:0:69485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788201383.619699:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d860 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cd9 expref: 61 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.619721:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1d389 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c31 expref: 60 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.619733:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673800/0x96d0c9b8c9a1ce2d lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a7f expref: 59 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.619759:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff8dc12196e200) 00010000:00010000:0.0:1788201383.619777:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1d821 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cc4 expref: 58 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.619786:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201383.619789:0:69485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201383.619809:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1d867 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.619822:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1d867 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.619831:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1d867 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.619846:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1d86e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.619852:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1d86e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.619859:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1d86e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.619938:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1d875 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.619946:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1d875 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.619962:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1d875 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201383.620254:0:69485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].2, 64 off8320 00000004:00080000:0.0:1788201383.620265:0:69485:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 4235092248306ns, next at 4236092246112ns, rc = 0 00010000:00010000:0.0:1788201383.620312:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d87c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.620321:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d87c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.620329:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d87c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.620335:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d87c lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.620354:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d87c lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.620361:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d87c lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.620374:0:69485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201383.620392:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1d875 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.620398:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1d875 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.620405:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1d875 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.620418:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201383.620422:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1d875 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.620429:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1d875 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.620439:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff8dc0084fbc00) 00010000:00010000:0.0:1788201383.620441:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201383.620445:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1d875 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.620450:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfc00/0x96d0c9b8c9a1d875 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.620467:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1d867 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.620474:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1d867 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.620480:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1d867 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.620486:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1d867 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.620491:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201383.620494:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1d867 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.620509:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1d867 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.620517:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201383.620520:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201383.620522:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1d867 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.620528:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade800/0x96d0c9b8c9a1d867 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201383.620537:0:69485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000622c3e9f reply state 000000001adfecfa transno 124554051736 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1d86e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.620546:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1d86e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.620552:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff8dc0084fb200) 00010000:00010000:0.0:1788201383.620554:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201383.620556:0:69485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201383.620631:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695512960:12345-192.168.201.20@tcp:36:rm.0 Request processed in 1012us (1201us total) trans 124554051736 rc 0/0 00000100:00100000:0.0:1788201383.620639:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1624 00010000:00010000:2.0:1788201383.621275:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201383.621284:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d87c lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.621291:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896b600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201383.621295:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d87c lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.621302:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d87c lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.621313:0:24979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x14:0x0].0x0 (ffff8dc0084fbc00) 00010000:00010000:2.0:1788201383.621323:0:24979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788201383.621327:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d87c lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.621333:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d87c lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.621357:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201383.621359:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201383.621360:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201383.624955:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201383.625076:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695513088 00000100:00100000:0.0:1788201383.625086:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695513088 00000100:00100000:0.0:1788201383.625374:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1625 00000100:00100000:0.0:1788201383.625386:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695513088:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1788201383.625413:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201383.625437:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1d883 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ce0 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625523:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1d88a lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625538:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1d88a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625550:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1d88a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625565:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1d891 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625574:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1d891 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625580:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1d891 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625651:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1d898 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625660:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1d898 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625667:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1d898 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201383.625710:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x12:0x0]: returning size 1024 00000004:00200000:0.0:1788201383.625715:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201383.625732:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1d898 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625756:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1d898 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625766:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1d88a lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625772:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1d88a lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625778:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1d88a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625785:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1d88a lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625790:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782ca00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201383.625794:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1d88a lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625801:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1d88a lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625813:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201383.625815:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201383.625820:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1d88a lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625825:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1d88a lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625839:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1d891 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625850:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1d891 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625855:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1d891 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625859:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782da00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201383.625862:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1d891 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625867:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1d891 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625875:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff8dc0084fbd00) 00010000:00010000:0.0:1788201383.625877:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201383.625879:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1d891 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625885:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1d891 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625914:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1d883 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ce0 expref: 61 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625927:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1d898 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ce0 expref: 60 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.625934:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff8dc0048be900) 00010000:00010000:0.0:1788201383.625936:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201383.625945:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782de00, rc 0) 00000100:00100000:0.0:1788201383.626338:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695513088:12345-192.168.201.20@tcp:101:rm.0 Request processed in 952us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201383.626355:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1625 00000100:00100000:0.0:1788201383.643011:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201383.648433:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695513344 00000100:00100000:2.0:1788201383.648448:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695513344 00000100:00100000:2.0:1788201383.648526:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1626 00000100:00100000:2.0:1788201383.648538:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695513344:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:2.0:1788201383.648600:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788201383.648629:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1d898 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ce0 expref: 60 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.648653:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75a00/0x96d0c9b8c9a1d30b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c07 expref: 59 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.648818:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1cdcb lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a63 expref: 58 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.648833:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff8dc0048be900) 00010000:00010000:2.0:1788201383.648844:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201383.648867:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1d89f lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.648881:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1d89f lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.648906:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1d89f lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.648934:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1d8a6 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.648942:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1d8a6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.648949:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1d8a6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.649140:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d8ad lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.649149:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d8ad lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.649157:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d8ad lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201383.649409:0:66313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].3, 64 off8384 00010000:00010000:2.0:1788201383.649465:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d8b4 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.649475:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d8b4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.649483:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d8b4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.649489:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d8b4 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.649503:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d8b4 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.649509:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d8b4 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.649536:0:66313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201383.649556:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d8ad lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.649561:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d8ad lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.649567:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d8ad lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.649572:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.649576:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d8ad lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.649584:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d8ad lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.649592:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff8dc108994400) 00010000:00010000:2.0:1788201383.649595:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201383.649599:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d8ad lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.649604:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d8ad lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.649632:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1d89f lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.649638:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1d89f lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.649644:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1d89f lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.649649:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1d89f lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.649654:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.649657:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1d89f lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.649662:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1d89f lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.649681:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201383.649683:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.649687:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1d89f lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.649692:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1d89f lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201383.649702:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000531eb83e reply state 0000000097c4674b transno 124554051737 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1d8a6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.649712:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1d8a6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.649723:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff8dc108994000) 00010000:00010000:2.0:1788201383.649725:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201383.649727:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201383.649815:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695513344:12345-192.168.201.20@tcp:36:rm.0 Request processed in 1278us (6815us total) trans 124554051737 rc 0/0 00000100:00100000:2.0:1788201383.649824:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1626 00010000:00010000:0.0:1788201383.650645:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201383.650653:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d8b4 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.650659:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201383.650673:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d8b4 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.650680:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d8b4 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.650690:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x12:0x0].0x0 (ffff8dc108994400) 00010000:00010000:0.0:1788201383.650693:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201383.650696:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d8b4 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.650701:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d8b4 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.650718:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201383.650720:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201383.650722:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201383.658546:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201383.658660:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695513472 00000100:00100000:1.0:1788201383.658679:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695513472 00000100:00100000:1.0:1788201383.658732:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1627 00000100:00100000:1.0:1788201383.658739:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695513472:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:1.0:1788201383.658762:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201383.658780:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1d8bb lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ce7 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.658848:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1d8c2 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.658859:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1d8c2 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.658868:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1d8c2 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.658877:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1d8c9 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.658882:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1d8c9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.658886:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1d8c9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.658968:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d8d0 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.658975:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d8d0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.658979:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d8d0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201383.659011:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xd:0x0]: returning size 1024 00000004:00200000:1.0:1788201383.659287:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201383.659309:0:66312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d8d0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.659332:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d8d0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.659350:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1d8c2 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.659357:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1d8c2 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.659363:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1d8c2 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.659370:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1d8c2 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.659376:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201383.659380:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1d8c2 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.659385:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1d8c2 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.659395:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:1.0:1788201383.659397:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201383.659400:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1d8c2 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.659404:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1d8c2 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.659414:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1d8c9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.659423:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1d8c9 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.659427:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1d8c9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.659430:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ede00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201383.659432:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1d8c9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.659436:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1d8c9 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.659440:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff8dc103b47f00) 00010000:00010000:1.0:1788201383.659441:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201383.659443:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1d8c9 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.659446:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1d8c9 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.659469:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1d8bb lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ce7 expref: 61 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.659477:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d8d0 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ce7 expref: 60 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.659482:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff8dc0048be500) 00010000:00010000:1.0:1788201383.659483:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201383.659488:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064edc00, rc 0) 00000100:00100000:1.0:1788201383.659576:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695513472:12345-192.168.201.20@tcp:101:rm.0 Request processed in 837us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201383.659582:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1627 00000100:00100000:1.0:1788201383.674510:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201383.674638:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695513728 00000100:00100000:0.0:1788201383.674654:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695513728 00000100:00100000:0.0:1788201383.674719:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1628 00000100:00100000:0.0:1788201383.674730:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695513728:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:0.0:1788201383.674788:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788201383.674811:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1d8d0 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ce7 expref: 60 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.674828:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1d22b lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bba expref: 59 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.674837:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ccd6 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a1d expref: 58 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.674843:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff8dc0048be500) 00010000:00010000:0.0:1788201383.674851:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201383.674867:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1d8d7 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.674877:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1d8d7 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.674883:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1d8d7 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.674892:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1d8de lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.674896:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1d8de lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.674900:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1d8de lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.674971:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1d8e5 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.674977:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1d8e5 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.674981:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1d8e5 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201383.675500:0:66314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].4, 64 off8448 00010000:00010000:1.0:1788201383.675543:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1d8ec lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.675549:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1d8ec lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.675555:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1d8ec lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.675559:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1d8ec lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.675564:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1d8ec lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.675567:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1d8ec lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.675585:0:66314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201383.675601:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1d8e5 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.675604:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1d8e5 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.675608:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1d8e5 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.675617:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782ca00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201383.675621:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1d8e5 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.675625:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1d8e5 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.675632:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff8dc0084fba00) 00010000:00010000:1.0:1788201383.675634:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201383.675636:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1d8e5 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.675640:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1d8e5 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.675660:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1d8d7 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.675664:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1d8d7 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.675670:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1d8d7 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.675675:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1d8d7 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.675680:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782dc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201383.675683:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1d8d7 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.675697:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1d8d7 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.675706:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:1.0:1788201383.675708:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201383.675711:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1d8d7 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.675718:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1d8d7 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201383.675729:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8266f86 reply state 000000002615eeac transno 124554051738 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1d8de lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.675737:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1d8de lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.675741:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff8dc0084fbd00) 00010000:00010000:1.0:1788201383.675742:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201383.675744:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201383.675805:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695513728:12345-192.168.201.20@tcp:36:rm.0 Request processed in 1077us (1304us total) trans 124554051738 rc 0/0 00000100:00100000:1.0:1788201383.675811:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1628 00010000:00010000:0.0:1788201383.676525:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201383.676532:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1d8ec lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.676538:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201383.676540:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1d8ec lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.676545:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1d8ec lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.676553:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xd:0x0].0x0 (ffff8dc0084fba00) 00010000:00010000:0.0:1788201383.676555:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201383.676557:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1d8ec lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.676561:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1d8ec lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.676574:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201383.676575:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201383.676576:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201383.682182:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201383.682318:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695513856 00000100:00100000:2.0:1788201383.682328:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695513856 00000100:00100000:2.0:1788201383.682397:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1629 00000100:00100000:2.0:1788201383.682408:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695513856:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:2.0:1788201383.682435:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201383.682456:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1d8f3 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786cee expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682519:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d8fa lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682534:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d8fa lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682545:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d8fa lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682561:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d901 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682569:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d901 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682600:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d901 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682677:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1d908 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682685:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1d908 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682693:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1d908 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201383.682735:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xb:0x0]: returning size 1024 00000004:00200000:2.0:1788201383.682740:0:66313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201383.682757:0:66313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1d908 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682770:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1d908 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682778:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d8fa lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682785:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d8fa lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682793:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d8fa lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682799:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d8fa lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682814:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.682818:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d8fa lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682827:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d8fa lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682840:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201383.682843:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.682848:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d8fa lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682854:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d8fa lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682867:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d901 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682873:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d901 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682878:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d901 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682883:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.682886:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d901 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682892:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d901 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682910:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff8dc108994e00) 00010000:00010000:2.0:1788201383.682913:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.682916:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d901 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682922:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d901 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682957:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1d8f3 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cee expref: 61 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682970:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1d908 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cee expref: 60 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.682977:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff8dc0048be700) 00010000:00010000:2.0:1788201383.682979:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201383.682982:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59c00, rc 0) 00000100:00100000:2.0:1788201383.683090:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695513856:12345-192.168.201.20@tcp:101:rm.0 Request processed in 683us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201383.683098:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1629 00000100:00100000:3.0:1788201383.685639:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201383.685953:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695514112 00000100:00100000:1.0:1788201383.685964:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695514112 00000100:00100000:2.0:1788201383.686486:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1630 00000100:00100000:2.0:1788201383.686501:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695514112:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:2.0:1788201383.686558:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788201383.686585:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1d908 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cee expref: 60 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.686607:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1d087 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b2e expref: 59 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.686637:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030e00/0x96d0c9b8c9a1cc74 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a01 expref: 58 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.686648:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff8dc0048be700) 00010000:00010000:2.0:1788201383.686657:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201383.686679:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1d90f lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.686692:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1d90f lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.686702:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1d90f lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.686716:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1d916 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.686723:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1d916 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.686730:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1d916 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.686814:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d91d lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.686822:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d91d lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.686829:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d91d lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201383.687083:0:66314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].5, 64 off8512 00010000:00010000:2.0:1788201383.687726:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d924 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.687738:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d924 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.687746:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d924 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.687753:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d924 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.687759:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d924 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.687766:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d924 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.687849:0:66314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201383.687868:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d91d lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.687875:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d91d lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.687880:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d91d lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.687885:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.687889:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d91d lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.687903:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d91d lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.687913:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff8dc108994a00) 00010000:00010000:2.0:1788201383.687915:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201383.687920:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d91d lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.687926:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d91d lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.687944:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1d90f lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.687949:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1d90f lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.687955:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1d90f lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.687959:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1d90f lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.687964:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.687966:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1d90f lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.687972:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1d90f lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.687979:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201383.687986:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.687990:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1d90f lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.687995:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1d90f lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201383.688005:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000808a5da9 reply state 000000008b62e7b9 transno 124554051739 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1d916 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.688047:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1d916 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.688055:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff8dc108994200) 00010000:00010000:2.0:1788201383.688057:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201383.688060:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201383.688157:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695514112:12345-192.168.201.20@tcp:36:rm.0 Request processed in 1657us (2523us total) trans 124554051739 rc 0/0 00000100:00100000:2.0:1788201383.688166:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1630 00010000:00010000:0.0:1788201383.689869:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201383.689881:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d924 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.689890:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201383.689894:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d924 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.689902:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d924 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.689917:0:13349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xb:0x0].0x0 (ffff8dc108994a00) 00010000:00010000:0.0:1788201383.689920:0:13349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201383.689924:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d924 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.689930:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d924 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.689953:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201383.689955:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201383.689957:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201383.694299:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201383.694573:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695514240 00000100:00100000:2.0:1788201383.694585:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695514240 00000100:00100000:2.0:1788201383.694657:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1631 00000100:00100000:2.0:1788201383.694744:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695514240:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:2.0:1788201383.694770:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201383.694792:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1d92b lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786cf5 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.694854:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d932 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.694870:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d932 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.694894:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d932 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.694909:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d939 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.694916:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d939 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.694923:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d939 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.694998:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d940 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.695007:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d940 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.695400:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d940 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201383.695450:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x9:0x0]: returning size 1024 00000004:00200000:2.0:1788201383.695455:0:69485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201383.695473:0:69485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d940 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.695486:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d940 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.695496:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d932 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.695515:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d932 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.695520:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d932 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.695527:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d932 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.695534:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.695539:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d932 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.695547:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d932 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.695561:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201383.695564:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.695568:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d932 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.695575:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d932 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.695588:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d939 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.695594:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d939 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.695598:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d939 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.695610:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.695613:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d939 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.695618:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d939 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.695625:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff8dc108994e00) 00010000:00010000:2.0:1788201383.695627:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.695629:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d939 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.695634:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d939 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.696012:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1d92b lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cf5 expref: 61 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.696400:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201383.696547:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d940 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cf5 expref: 60 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.696556:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff8dc11248c400) 00010000:00010000:2.0:1788201383.696559:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201383.696562:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896b600, rc 0) 00000100:00100000:2.0:1788201383.696711:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695514240:12345-192.168.201.20@tcp:101:rm.0 Request processed in 2044us (2420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201383.696720:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1631 00000100:00100000:1.0:1788201383.701762:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201383.701840:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695514496 00000100:00100000:2.0:1788201383.701863:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695514496 00000100:00100000:2.0:1788201383.701924:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1632 00000100:00100000:2.0:1788201383.701935:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695514496:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:2.0:1788201383.701991:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788201383.702092:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d940 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cf5 expref: 60 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702122:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1d113 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b5f expref: 59 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702135:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b800/0x96d0c9b8c9a1cc12 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869e5 expref: 58 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702145:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff8dc11248c400) 00010000:00010000:2.0:1788201383.702154:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201383.702176:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1d947 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702190:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1d947 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702208:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1d947 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702223:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d94e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702230:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d94e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702248:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d94e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702497:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d955 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702506:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d955 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702513:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d955 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201383.702707:0:66313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].6, 64 off8576 00010000:00010000:2.0:1788201383.702755:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d95c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702763:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d95c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702770:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d95c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702776:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d95c lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702781:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d95c lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702787:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d95c lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702854:0:66313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201383.702880:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d955 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702888:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d955 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702893:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d955 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702900:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.702904:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d955 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702912:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d955 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702921:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff8dc108994900) 00010000:00010000:2.0:1788201383.702924:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201383.702927:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d955 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702933:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d955 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702949:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1d947 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702956:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1d947 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702961:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1d947 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702967:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1d947 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702978:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.702982:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1d947 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702988:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1d947 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.702997:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201383.702999:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.703002:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1d947 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.703008:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1d947 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201383.703062:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008165d44d reply state 00000000b8dba7f4 transno 124554051740 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d94e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.703074:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d94e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.703081:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff8dc108994e00) 00010000:00010000:2.0:1788201383.703083:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201383.703086:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201383.703146:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695514496:12345-192.168.201.20@tcp:36:rm.0 Request processed in 1211us (1394us total) trans 124554051740 rc 0/0 00000100:00100000:2.0:1788201383.703153:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1632 00000100:00100000:3.0:1788201383.705477:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201383.705595:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695514624 00000100:00100000:2.0:1788201383.705604:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695514624 00000100:00100000:2.0:1788201383.705656:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1633 00000100:00100000:2.0:1788201383.705678:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695514624:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:2.0:1788201383.705701:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201383.705719:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1d963 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786cfc expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.705778:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d96a lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.705792:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d96a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.705804:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d96a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.705819:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1d971 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.705825:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1d971 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.705830:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1d971 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.705895:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1d978 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.705903:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1d978 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.705910:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1d978 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201383.705957:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xe:0x0]: returning size 1024 00000004:00200000:2.0:1788201383.705973:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201383.705993:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1d978 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.706004:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1d978 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.706013:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d96a lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.706050:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d96a lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.706055:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d96a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.706062:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d96a lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.706068:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.706072:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d96a lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.706079:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d96a lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.706090:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201383.706094:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.707476:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d96a lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.707503:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1d96a lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.707517:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1d971 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.707521:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1d971 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.707526:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1d971 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.707529:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.707531:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1d971 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.707534:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1d971 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.707542:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff8dc108994700) 00010000:00010000:2.0:1788201383.707544:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.707547:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1d971 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.707550:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1d971 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.707580:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1d963 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cfc expref: 61 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.707597:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1d978 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cfc expref: 60 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.707602:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff8dc005cc6c00) 00010000:00010000:2.0:1788201383.707604:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201383.707606:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0078fd800, rc 0) 00000100:00100000:2.0:1788201383.707709:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695514624:12345-192.168.201.20@tcp:101:rm.0 Request processed in 2031us (2239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201383.707717:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1633 00010000:00010000:0.0:1788201383.708722:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201383.708733:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d95c lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.708741:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201383.708744:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d95c lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.708752:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d95c lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.708779:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x9:0x0].0x0 (ffff8dc108994900) 00010000:00010000:0.0:1788201383.708781:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201383.708785:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d95c lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.708790:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1d95c lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.709058:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201383.709061:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201383.709062:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201383.713689:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201383.713767:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695514880 00000100:00100000:2.0:1788201383.713778:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695514880 00000100:00100000:2.0:1788201383.713842:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1634 00000100:00100000:2.0:1788201383.713853:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695514880:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:2.0:1788201383.713913:0:69485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788201383.713943:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fd800/0x96d0c9b8c9a1d978 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cfc expref: 60 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.713964:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1d0f0 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b4a expref: 59 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.713976:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1cd07 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a2b expref: 58 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.713987:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff8dc005cc6c00) 00010000:00010000:2.0:1788201383.713997:0:69485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201383.714065:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1d97f lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.714079:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1d97f lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.714089:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1d97f lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.714116:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc200/0x96d0c9b8c9a1d986 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.714123:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc200/0x96d0c9b8c9a1d986 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.714129:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc200/0x96d0c9b8c9a1d986 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.714206:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d98d lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.714214:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d98d lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.714220:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d98d lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201383.714439:0:69485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].7, 64 off8640 00010000:00010000:2.0:1788201383.714491:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b800/0x96d0c9b8c9a1d994 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.714500:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b800/0x96d0c9b8c9a1d994 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.714518:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b800/0x96d0c9b8c9a1d994 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.714525:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b800/0x96d0c9b8c9a1d994 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.714531:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b800/0x96d0c9b8c9a1d994 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.714537:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b800/0x96d0c9b8c9a1d994 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.714560:0:69485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201383.714578:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d98d lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.714580:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201383.714585:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d98d lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.714587:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b800/0x96d0c9b8c9a1d994 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.714591:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d98d lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.714594:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896b800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201383.714595:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201383.714598:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b800/0x96d0c9b8c9a1d994 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.714599:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d98d lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.714607:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b800/0x96d0c9b8c9a1d994 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.714607:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d98d lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.714860:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff8dc108994300) 00010000:00010000:0.0:1788201383.714864:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201383.714867:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b800/0x96d0c9b8c9a1d994 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.714874:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b800/0x96d0c9b8c9a1d994 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.714886:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201383.714896:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201383.714898:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201383.715398:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xe:0x0].0x0 (ffff8dc108994300) 00010000:00010000:2.0:1788201383.715402:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201383.715412:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d98d lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.715418:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1d98d lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.715445:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1d97f lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.715451:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1d97f lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.715458:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1d97f lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.715463:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1d97f lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.715468:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fc000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.715471:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1d97f lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.715477:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1d97f lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.715486:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201383.715488:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.715491:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1d97f lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.715497:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc000/0x96d0c9b8c9a1d97f lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201383.715507:0:69485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c7a766a reply state 0000000059cdfd54 transno 124554051741 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc200/0x96d0c9b8c9a1d986 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.715523:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc200/0x96d0c9b8c9a1d986 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.715530:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff8dc108994500) 00010000:00010000:2.0:1788201383.715532:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201383.715535:0:69485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201383.715614:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695514880:12345-192.168.201.20@tcp:36:rm.0 Request processed in 1760us (1932us total) trans 124554051741 rc 0/0 00000100:00100000:2.0:1788201383.715622:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1634 00000100:00100000:1.0:1788201383.718118:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201383.718173:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695515008 00000100:00100000:2.0:1788201383.718184:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695515008 00000100:00100000:2.0:1788201383.718250:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1635 00000100:00100000:2.0:1788201383.718260:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695515008:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:2.0:1788201383.718282:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201383.718301:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d99b lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786d03 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.718374:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1d9a2 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.718387:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1d9a2 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.718398:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1d9a2 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.718413:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1d9a9 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.718432:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1d9a9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.718439:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1d9a9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.718513:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9b0 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.718523:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9b0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.718530:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9b0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201383.718571:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x13:0x0]: returning size 1024 00000004:00200000:2.0:1788201383.718576:0:66313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201383.718594:0:66313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9b0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.718605:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9b0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.718614:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1d9a2 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.718620:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1d9a2 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.718626:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1d9a2 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.718642:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1d9a2 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.718647:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.718651:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1d9a2 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.718659:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1d9a2 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.719911:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201383.719917:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.719923:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1d9a2 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.719932:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1d9a2 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.719947:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1d9a9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.719953:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1d9a9 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.719960:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1d9a9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.719965:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.719969:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1d9a9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.719989:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1d9a9 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.719997:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff8dc108994b00) 00010000:00010000:2.0:1788201383.719999:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.720002:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1d9a9 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.720008:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1d9a9 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.720073:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1d99b lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d03 expref: 61 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.720088:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9b0 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d03 expref: 60 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.720095:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff8dc0048be200) 00010000:00010000:2.0:1788201383.720097:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201383.720100:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbda00, rc 0) 00000100:00100000:2.0:1788201383.720163:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695515008:12345-192.168.201.20@tcp:101:rm.0 Request processed in 1904us (2064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201383.720172:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1635 00000100:00100000:1.0:1788201383.725934:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201383.728227:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695515264 00000100:00100000:2.0:1788201383.728242:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695515264 00000100:00100000:2.0:1788201383.728310:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1636 00000100:00100000:2.0:1788201383.728322:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695515264:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:2.0:1788201383.728403:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788201383.728430:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9b0 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d03 expref: 60 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.728452:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75c00/0x96d0c9b8c9a1d34a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c1c expref: 59 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.728464:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101673600/0x96d0c9b8c9a1cdfc lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a71 expref: 58 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.728474:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff8dc0048be200) 00010000:00010000:2.0:1788201383.728482:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201383.728499:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d9b7 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.728511:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d9b7 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.728521:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d9b7 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.728533:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbde00/0x96d0c9b8c9a1d9be lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.728540:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbde00/0x96d0c9b8c9a1d9be lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.728546:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbde00/0x96d0c9b8c9a1d9be lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.728630:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9c5 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.728636:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9c5 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.728641:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9c5 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x13:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201383.728838:0:66314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].8, 64 off8704 00010000:00010000:2.0:1788201383.728884:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1d9cc lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.728893:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1d9cc lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.728900:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1d9cc lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.728907:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1d9cc lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.728912:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1d9cc lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.728918:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1d9cc lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.728940:0:66314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201383.728957:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9c5 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.728972:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9c5 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.728978:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9c5 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.728984:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.728987:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9c5 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.728994:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9c5 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.729003:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff8dc108994700) 00010000:00010000:2.0:1788201383.729006:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201383.729009:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9c5 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.729047:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9c5 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.729064:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d9b7 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.729069:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d9b7 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.729075:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d9b7 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.729080:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d9b7 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.729090:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbcc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.729094:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d9b7 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.729100:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d9b7 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.729109:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201383.729111:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.729114:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d9b7 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.729119:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d9b7 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201383.729128:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e755e5e reply state 0000000049673ab5 transno 124554051742 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbde00/0x96d0c9b8c9a1d9be lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.729138:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbde00/0x96d0c9b8c9a1d9be lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.729143:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff8dc108994300) 00010000:00010000:2.0:1788201383.729145:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201383.729147:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201383.729218:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695515264:12345-192.168.201.20@tcp:36:rm.0 Request processed in 898us (3293us total) trans 124554051742 rc 0/0 00000100:00100000:2.0:1788201383.729226:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1636 00010000:00010000:0.0:1788201383.729811:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201383.729819:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1d9cc lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.729828:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201383.729832:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1d9cc lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.729840:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1d9cc lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.729851:0:13349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x13:0x0].0x0 (ffff8dc108994700) 00010000:00010000:0.0:1788201383.729854:0:13349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201383.729857:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1d9cc lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.729864:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1d9cc lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.729879:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201383.729881:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201383.729883:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201383.736997:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201383.737156:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695515392 00000100:00100000:2.0:1788201383.737166:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695515392 00000100:00100000:2.0:1788201383.737235:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1637 00000100:00100000:2.0:1788201383.737260:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695515392:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:2.0:1788201383.737284:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201383.737304:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d9d3 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786d0a expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737385:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9da lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737399:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9da lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737410:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9da lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737425:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9e1 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737432:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9e1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737439:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9e1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737514:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1d9e8 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737523:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1d9e8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737531:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1d9e8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201383.737580:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x11:0x0]: returning size 1024 00000004:00200000:2.0:1788201383.737585:0:69485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201383.737604:0:69485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1d9e8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737616:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1d9e8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737626:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9da lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737631:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9da lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737635:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9da lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737639:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9da lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737642:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.737645:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9da lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737650:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9da lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737672:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201383.737675:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.737680:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9da lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737697:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9da lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737711:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9e1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737717:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9e1 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737722:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9e1 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737726:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbda00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.737729:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9e1 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737735:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9e1 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737743:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff8dc108994b00) 00010000:00010000:2.0:1788201383.737745:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.737747:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9e1 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737753:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9e1 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737778:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d9d3 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d0a expref: 61 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737806:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1d9e8 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d0a expref: 60 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.737813:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff8dc005cc6800) 00010000:00010000:2.0:1788201383.737815:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201383.737817:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbd000, rc 0) 00000100:00100000:2.0:1788201383.737884:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695515392:12345-192.168.201.20@tcp:101:rm.0 Request processed in 626us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201383.737891:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1637 00000100:00100000:1.0:1788201383.744118:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201383.744208:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695515648 00000100:00100000:2.0:1788201383.744219:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695515648 00000100:00100000:2.0:1788201383.744270:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1638 00000100:00100000:2.0:1788201383.744278:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695515648:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:2.0:1788201383.744331:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788201383.744367:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1d9e8 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d0a expref: 60 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744387:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fce00/0x96d0c9b8c9a1d28d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786be4 expref: 59 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744396:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1cd9a lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a55 expref: 58 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744403:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff8dc005cc6800) 00010000:00010000:2.0:1788201383.744411:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201383.744438:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d9ef lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744448:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d9ef lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744454:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d9ef lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744463:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9f6 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744467:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9f6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744471:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9f6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744535:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9fd lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744540:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9fd lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744543:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9fd lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201383.744725:0:66313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].9, 64 off8768 00010000:00010000:2.0:1788201383.744764:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1da04 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744770:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1da04 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744782:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1da04 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744786:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1da04 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744791:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1da04 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744794:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1da04 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744810:0:66313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201383.744828:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9fd lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744834:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9fd lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744840:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9fd lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744846:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.744849:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9fd lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.744853:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201383.744856:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9fd lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.744859:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1da04 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744864:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff8dc108994f00) 00010000:00010000:2.0:1788201383.744867:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201383.744873:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201383.744875:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9fd lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.744877:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1da04 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744881:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1d9fd lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x11:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.744883:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1da04 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.744891:0:24979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x11:0x0].0x0 (ffff8dc108994f00) 00010000:00010000:3.0:1788201383.744892:0:24979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201383.744895:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1da04 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744896:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d9ef lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.744901:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1da04 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744902:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d9ef lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744908:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d9ef lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744913:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d9ef lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.744913:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201383.744914:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201383.744916:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201383.744931:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbcc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.744934:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d9ef lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744940:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d9ef lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744946:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201383.744947:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.744949:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d9ef lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744953:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1d9ef lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201383.744959:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dad94179 reply state 00000000e5be1d40 transno 124554051743 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9f6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744971:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9f6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.744975:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff8dc108994b00) 00010000:00010000:2.0:1788201383.744976:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201383.744978:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201383.745076:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695515648:12345-192.168.201.20@tcp:36:rm.0 Request processed in 797us (968us total) trans 124554051743 rc 0/0 00000100:00100000:2.0:1788201383.745083:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1638 00000100:00100000:3.0:1788201383.749421:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201383.749765:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695515776 00000100:00100000:2.0:1788201383.749774:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695515776 00000100:00100000:2.0:1788201383.749827:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1639 00000100:00100000:2.0:1788201383.749838:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695515776:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:2.0:1788201383.749862:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201383.749882:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1da0b lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786d11 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.749944:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1da12 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.749954:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1da12 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.749962:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1da12 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.749971:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1da19 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.749990:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1da19 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.749994:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1da19 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.750071:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbdc00/0x96d0c9b8c9a1da20 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.750078:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbdc00/0x96d0c9b8c9a1da20 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.750081:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbdc00/0x96d0c9b8c9a1da20 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201383.750116:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xc:0x0]: returning size 1024 00000004:00200000:2.0:1788201383.750121:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201383.750139:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbdc00/0x96d0c9b8c9a1da20 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.750152:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbdc00/0x96d0c9b8c9a1da20 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.750162:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1da12 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.750167:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1da12 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.750173:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1da12 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.750190:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1da12 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.750196:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.750200:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1da12 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.750207:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1da12 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.750216:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201383.750218:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.750221:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1da12 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.750226:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1da12 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.750234:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1da19 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.750237:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1da19 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.750241:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1da19 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.750244:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.750246:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1da19 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.750257:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1da19 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.750261:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff8dc108994f00) 00010000:00010000:2.0:1788201383.750262:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.750264:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1da19 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.750267:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1da19 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.750287:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1da0b lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d11 expref: 61 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.750296:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbdc00/0x96d0c9b8c9a1da20 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d11 expref: 60 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.750301:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff8dc11248ce00) 00010000:00010000:2.0:1788201383.750303:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201383.750306:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbdc00, rc 0) 00000100:00100000:2.0:1788201383.750377:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695515776:12345-192.168.201.20@tcp:101:rm.0 Request processed in 541us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201383.750383:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1639 00000100:00100000:3.0:1788201383.758408:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201383.758612:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695516032 00000100:00100000:1.0:1788201383.758623:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695516032 00000100:00100000:1.0:1788201383.758849:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1640 00000100:00100000:1.0:1788201383.758860:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695516032:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:1.0:1788201383.758916:0:66757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788201383.758945:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbdc00/0x96d0c9b8c9a1da20 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d11 expref: 60 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.758967:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda8e00/0x96d0c9b8c9a1d056 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b20 expref: 59 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.758982:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1cca5 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a0f expref: 58 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.758992:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff8dc11248ce00) 00010000:00010000:1.0:1788201383.759002:0:66757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201383.759069:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1da27 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759083:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1da27 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759092:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1da27 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759114:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1da2e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759135:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1da2e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759143:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1da2e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759283:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1da35 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759292:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1da35 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759298:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1da35 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201383.759566:0:66757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].10, 64 off8832 00010000:00010000:1.0:1788201383.759613:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1da3c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759622:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1da3c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759630:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1da3c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759636:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1da3c lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759642:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1da3c lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759658:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1da3c lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759807:0:66757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201383.759829:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1da35 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759836:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1da35 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759843:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1da35 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759849:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ece00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201383.759853:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1da35 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759859:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1da35 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759868:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff8dc103b47300) 00010000:00010000:1.0:1788201383.759870:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201383.759873:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1da35 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759879:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1da35 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759895:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1da27 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759901:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1da27 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759906:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1da27 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759918:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1da27 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759923:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201383.759926:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1da27 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759933:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1da27 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759942:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:1.0:1788201383.759944:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201383.759947:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1da27 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759953:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1da27 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201383.759963:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ba309e5 reply state 000000006ce56088 transno 124554051744 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1da2e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759972:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1da2e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.759978:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff8dc103b47f00) 00010000:00010000:1.0:1788201383.759980:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201383.759982:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201383.760085:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695516032:12345-192.168.201.20@tcp:36:rm.0 Request processed in 1226us (1684us total) trans 124554051744 rc 0/0 00000100:00100000:1.0:1788201383.760092:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1640 00010000:00010000:3.0:1788201383.761817:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201383.761828:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1da3c lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.761837:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201383.761842:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1da3c lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.761851:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1da3c lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.761886:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xc:0x0].0x0 (ffff8dc103b47300) 00010000:00010000:3.0:1788201383.761889:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201383.761893:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1da3c lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.761900:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1da3c lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.761923:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201383.761925:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201383.761927:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201383.764413:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201383.764462:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695516160 00000100:00100000:2.0:1788201383.764473:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695516160 00000100:00100000:2.0:1788201383.764535:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1641 00000100:00100000:2.0:1788201383.764545:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695516160:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:2.0:1788201383.764583:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201383.764604:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1da43 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786d18 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.764673:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1da4a lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.764686:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1da4a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.764697:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1da4a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.764712:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1da51 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.764719:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1da51 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.764725:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1da51 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.764800:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1da58 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.764809:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1da58 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.764816:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1da58 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201383.764856:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x7:0x0]: returning size 1024 00000004:00200000:2.0:1788201383.764866:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201383.764887:0:66312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1da58 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.764900:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1da58 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.764909:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1da4a lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.768131:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1da4a lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.768151:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1da4a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.768158:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1da4a lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.768164:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.768169:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1da4a lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.768179:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1da4a lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.768198:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201383.768201:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.768206:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1da4a lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.768212:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1da4a lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.768252:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1da51 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.768256:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1da51 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.768260:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1da51 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.768263:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.768264:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1da51 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.768268:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1da51 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.768273:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff8dc108994f00) 00010000:00010000:2.0:1788201383.768274:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.768276:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1da51 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.768280:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1da51 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.768323:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1da43 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d18 expref: 61 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.768336:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1da58 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d18 expref: 60 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.768364:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff8dc11248c900) 00010000:00010000:2.0:1788201383.768367:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201383.768370:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbd600, rc 0) 00000100:00100000:2.0:1788201383.768439:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695516160:12345-192.168.201.20@tcp:101:rm.0 Request processed in 3894us (4031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201383.768448:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1641 00000100:00100000:0.0:1788201383.771951:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201383.772550:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695516416 00000100:00100000:2.0:1788201383.772562:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695516416 00000100:00100000:2.0:1788201383.772620:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1642 00000100:00100000:2.0:1788201383.772631:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695516416:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:2.0:1788201383.772700:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788201383.772724:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1da58 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d18 expref: 60 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.772740:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9000/0x96d0c9b8c9a1d010 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b0b expref: 59 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.772749:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2200/0x96d0c9b8c9a1cbb0 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869c9 expref: 58 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.772755:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff8dc11248c900) 00010000:00010000:2.0:1788201383.772762:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201383.772778:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1da5f lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.772788:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1da5f lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.772805:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1da5f lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.772816:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1da66 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.772820:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1da66 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.772824:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1da66 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.772888:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1da6d lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.772892:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1da6d lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.772895:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1da6d lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201383.773086:0:66314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].11, 64 off8896 00010000:00010000:2.0:1788201383.773144:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1da74 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.773154:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1da74 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.773161:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1da74 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.773166:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1da74 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.773175:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1da74 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.773179:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1da74 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.773192:0:66314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201383.773209:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1da6d lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.773215:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1da6d lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.773220:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1da6d lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.773226:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbce00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.773230:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1da6d lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.773237:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1da6d lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.773245:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff8dc108994900) 00010000:00010000:2.0:1788201383.773248:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201383.773251:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1da6d lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.773257:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1da6d lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.773272:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1da5f lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.773275:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201383.773281:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1da74 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.773285:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1da5f lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.773287:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201383.773291:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1da74 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.773292:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1da5f lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.773298:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1da5f lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.773302:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.773305:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1da5f lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.773312:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1da74 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.773312:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1da5f lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.773320:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201383.773321:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x7:0x0].0x0 (ffff8dc108994900) 00010000:00010000:0.0:1788201383.773323:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788201383.773323:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201383.773327:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1da74 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.773327:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1da5f lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.773333:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1da74 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.773334:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1da5f lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201383.773353:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005681a3ce reply state 000000006d134db4 transno 124554051745 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1da66 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.773357:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201383.773358:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201383.773360:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201383.773363:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1da66 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.773369:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff8dc108994700) 00010000:00010000:2.0:1788201383.773376:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201383.773379:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201383.773453:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695516416:12345-192.168.201.20@tcp:36:rm.0 Request processed in 822us (1512us total) trans 124554051745 rc 0/0 00000100:00100000:2.0:1788201383.773460:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1642 00000100:00100000:3.0:1788201383.775911:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201383.776119:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695516544 00000100:00100000:1.0:1788201383.776128:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695516544 00000100:00100000:1.0:1788201383.776220:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1643 00000100:00100000:1.0:1788201383.776230:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695516544:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:1.0:1788201383.776251:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201383.776270:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1da7b lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786d1f expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776357:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1da82 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776371:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1da82 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776383:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1da82 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776409:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1da89 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776416:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1da89 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776422:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1da89 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776491:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1da90 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776500:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1da90 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776524:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1da90 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201383.776566:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x19:0x0]: returning size 1024 00000004:00200000:1.0:1788201383.776571:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201383.776587:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1da90 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776598:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1da90 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776607:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1da82 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776613:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1da82 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776619:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1da82 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776625:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1da82 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776629:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ece00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201383.776633:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1da82 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776639:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1da82 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776663:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:1.0:1788201383.776672:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201383.776678:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1da82 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776684:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1da82 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776697:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1da89 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776703:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1da89 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776709:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1da89 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776715:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201383.776718:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1da89 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776724:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1da89 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776731:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff8dc103b47c00) 00010000:00010000:1.0:1788201383.776734:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201383.776736:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1da89 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776742:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1da89 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776771:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1da7b lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d1f expref: 61 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776797:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1da90 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d1f expref: 60 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.776805:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff8dc103a3a300) 00010000:00010000:1.0:1788201383.776807:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201383.776809:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ecc00, rc 0) 00000100:00100000:1.0:1788201383.776870:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695516544:12345-192.168.201.20@tcp:101:rm.0 Request processed in 642us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201383.776877:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1643 00000100:00100000:0.0:1788201383.781695:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201383.781759:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695516800 00000100:00100000:2.0:1788201383.781770:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695516800 00000100:00100000:3.0:1788201383.781896:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1644 00000100:00100000:3.0:1788201383.781909:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695516800:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:3.0:1788201383.781971:0:66312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788201383.781998:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1da90 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d1f expref: 60 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782050:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1d48c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c7e expref: 59 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782066:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9600/0x96d0c9b8c9a1cf22 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ac5 expref: 58 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782076:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff8dc103a3a300) 00010000:00010000:3.0:1788201383.782086:0:66312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201383.782115:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1da97 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782142:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1da97 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782153:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1da97 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782168:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1da9e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782176:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1da9e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782182:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1da9e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782276:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1daa5 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782285:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1daa5 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782292:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1daa5 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x19:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201383.782508:0:66312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].12, 64 off8960 00010000:00010000:3.0:1788201383.782555:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75c00/0x96d0c9b8c9a1daac lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782562:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75c00/0x96d0c9b8c9a1daac lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782566:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75c00/0x96d0c9b8c9a1daac lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782576:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75c00/0x96d0c9b8c9a1daac lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782580:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75c00/0x96d0c9b8c9a1daac lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782584:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75c00/0x96d0c9b8c9a1daac lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782601:0:66312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201383.782618:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1daa5 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782623:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1daa5 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.782626:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201383.782629:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1daa5 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.782633:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75c00/0x96d0c9b8c9a1daac lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782634:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201383.782639:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201383.782639:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1daa5 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x19:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782647:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1daa5 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x19:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782656:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff8dc004b23a00) 00010000:00010000:3.0:1788201383.782658:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201383.782662:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1daa5 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x19:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782676:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1daa5 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x19:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782692:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1da97 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782699:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1da97 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782704:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1da97 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.782706:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75c00/0x96d0c9b8c9a1daac lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782711:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1da97 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.782714:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75c00/0x96d0c9b8c9a1daac lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782715:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201383.782719:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1da97 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.782724:0:13349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x19:0x0].0x0 (ffff8dc004b23a00) 00010000:00010000:3.0:1788201383.782724:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1da97 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.782727:0:13349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201383.782730:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75c00/0x96d0c9b8c9a1daac lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782732:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:3.0:1788201383.782734:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201383.782736:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75c00/0x96d0c9b8c9a1daac lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782737:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1da97 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782743:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1da97 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.782750:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:3.0:1788201383.782751:0:66312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000069cca891 reply state 00000000270d1148 transno 124554051746 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1da9e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.782757:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201383.782759:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201383.782766:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1da9e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.782772:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff8dc004b23f00) 00010000:00010000:3.0:1788201383.782774:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201383.782777:0:66312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201383.782839:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695516800:12345-192.168.201.20@tcp:36:rm.0 Request processed in 933us (1153us total) trans 124554051746 rc 0/0 00000100:00100000:3.0:1788201383.782847:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1644 00000100:00100000:0.0:1788201383.790000:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201383.791731:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695516928 00000100:00100000:2.0:1788201383.791745:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695516928 00000100:00100000:2.0:1788201383.791993:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1645 00000100:00100000:2.0:1788201383.792005:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695516928:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:2.0:1788201383.792052:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201383.792075:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1dab3 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786d26 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.792471:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1daba lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.792486:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1daba lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.792497:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1daba lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.792513:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1dac1 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.792520:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1dac1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.792527:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1dac1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.792614:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1dac8 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.792623:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1dac8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.792630:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1dac8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201383.799752:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x6:0x0]: returning size 1024 00000004:00200000:2.0:1788201383.799765:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201383.799831:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1dac8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.799852:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1dac8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.799866:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1daba lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.799872:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1daba lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.799879:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1daba lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.799885:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1daba lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.799892:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbce00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.799896:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1daba lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.799923:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1daba lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.799940:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201383.799943:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.799948:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1daba lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.799953:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1daba lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.799970:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1dac1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.799976:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1dac1 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.799982:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1dac1 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.799987:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.799990:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1dac1 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.799996:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1dac1 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.800003:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff8dc108994f00) 00010000:00010000:2.0:1788201383.800005:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.800008:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1dac1 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.800039:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1dac1 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.800084:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1dab3 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d26 expref: 61 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.800110:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1dac8 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d26 expref: 60 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.800118:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff8dc11248cb00) 00010000:00010000:2.0:1788201383.800120:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201383.800123:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbcc00, rc 0) 00000100:00100000:2.0:1788201383.800203:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695516928:12345-192.168.201.20@tcp:101:rm.0 Request processed in 8199us (10211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201383.800212:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1645 00000100:00100000:1.0:1788201383.805623:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201383.805969:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695517184 00000100:00100000:0.0:1788201383.805981:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695517184 00000100:00100000:0.0:1788201383.806072:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1646 00000100:00100000:0.0:1788201383.806083:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695517184:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:0.0:1788201383.806149:0:66757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788201383.806175:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbcc00/0x96d0c9b8c9a1dac8 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d26 expref: 60 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.806199:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc400/0x96d0c9b8c9a1d002 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b04 expref: 59 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.806223:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1cb7f lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869bb expref: 58 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.806249:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff8dc11248cb00) 00010000:00010000:0.0:1788201383.806261:0:66757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201383.806283:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1dacf lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.806295:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1dacf lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.806318:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1dacf lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.806333:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1dad6 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.806347:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1dad6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.806353:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1dad6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.806432:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1dadd lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.806439:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1dadd lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.806446:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1dadd lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201383.806632:0:66757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].13, 64 off9024 00010000:00010000:0.0:1788201383.806970:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1dae4 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.806987:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1dae4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.806995:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1dae4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.807001:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1dae4 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.807008:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1dae4 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.807037:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1dae4 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.807061:0:66757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201383.807082:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1dadd lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.807088:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1dadd lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.807103:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1dadd lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.807109:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201383.807114:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1dadd lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.807121:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1dadd lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.807141:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff8dc0084fb100) 00010000:00010000:0.0:1788201383.807144:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201383.807148:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1dadd lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.807154:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1dadd lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.807171:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1dacf lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.807171:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201383.807177:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1dacf lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.807178:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1dae4 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.807183:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1dacf lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.807185:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782ce00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201383.807188:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1dae4 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.807189:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1dacf lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.807194:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201383.807262:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1dae4 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.807274:0:24979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x6:0x0].0x0 (ffff8dc0084fb100) 00010000:00010000:3.0:1788201383.807277:0:24979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201383.807280:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1dae4 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.807286:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1dae4 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.807301:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201383.807303:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201383.807310:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201383.807366:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1dacf lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.807373:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1dacf lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.807381:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201383.807383:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201383.807386:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1dacf lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.807403:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1dacf lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201383.807414:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008cad2614 reply state 000000005b991ac0 transno 124554051747 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1dad6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.807426:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1dad6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.807432:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff8dc0084fba00) 00010000:00010000:0.0:1788201383.807434:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201383.807438:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201383.807521:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695517184:12345-192.168.201.20@tcp:36:rm.0 Request processed in 1438us (1905us total) trans 124554051747 rc 0/0 00000100:00100000:0.0:1788201383.807529:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1646 00000100:00100000:1.0:1788201383.812449:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201383.812538:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695517312 00000100:00100000:0.0:1788201383.812549:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695517312 00000100:00100000:0.0:1788201383.812614:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1647 00000100:00100000:0.0:1788201383.812626:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695517312:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1788201383.812652:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201383.812676:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1daeb lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786d2d expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.812740:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1daf2 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.812753:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1daf2 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.812776:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1daf2 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.812786:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1daf9 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.812791:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1daf9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.812795:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1daf9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.812864:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1db00 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.812873:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1db00 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.812879:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1db00 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201383.812923:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xa:0x0]: returning size 1024 00000004:00200000:0.0:1788201383.812928:0:66313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201383.812945:0:66313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1db00 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.812955:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1db00 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.812962:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1daf2 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.812978:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1daf2 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.812983:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1daf2 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.812989:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1daf2 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.812995:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201383.813000:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1daf2 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.813007:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1daf2 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.813048:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201383.813051:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201383.813054:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1daf2 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.813059:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1daf2 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.813072:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1daf9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.813075:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1daf9 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.813079:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1daf9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.813087:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201383.813089:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1daf9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.813093:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1daf9 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.813105:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff8dc0084fb800) 00010000:00010000:0.0:1788201383.813106:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201383.813108:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1daf9 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.813112:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1daf9 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.813134:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1daeb lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d2d expref: 61 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.813143:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1db00 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d2d expref: 60 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.813148:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff8dc11248c800) 00010000:00010000:0.0:1788201383.813149:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201383.813151:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782dc00, rc 0) 00000100:00100000:0.0:1788201383.813192:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695517312:12345-192.168.201.20@tcp:101:rm.0 Request processed in 570us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201383.813196:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1647 00000100:00100000:3.0:1788201383.822481:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201383.825055:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695517568 00000100:00100000:2.0:1788201383.825069:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695517568 00000100:00100000:0.0:1788201383.825178:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1648 00000100:00100000:1.0:1788201383.825228:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695517568:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:1.0:1788201383.825283:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788201383.825312:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1db00 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d2d expref: 60 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.825346:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1d152 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b7b expref: 59 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.825362:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030800/0x96d0c9b8c9a1cc43 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869f3 expref: 58 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.825374:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff8dc11248c800) 00010000:00010000:1.0:1788201383.825384:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201383.825405:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1db07 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.825417:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1db07 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.825426:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1db07 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.825439:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1db0e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.825446:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1db0e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.825459:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1db0e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.825535:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1db15 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.825541:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1db15 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.825548:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1db15 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201383.825739:0:66314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].14, 64 off9088 00010000:00010000:1.0:1788201383.825785:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1db1c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.825794:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1db1c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.825801:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1db1c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.825808:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1db1c lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.825814:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1db1c lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.825819:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1db1c lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.825841:0:66314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201383.825867:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1db15 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.825873:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1db15 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.825880:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1db15 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.825881:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201383.825891:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1db1c lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.825891:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201383.825898:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1db15 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.825904:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064edc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201383.825910:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1db15 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.825911:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1db1c lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.825922:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1db1c lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.825932:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff8dc103b47700) 00010000:00010000:0.0:1788201383.825934:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201383.825938:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1db1c lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.825945:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1db1c lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.825957:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201383.825959:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201383.825960:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201383.826063:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xa:0x0].0x0 (ffff8dc103b47700) 00010000:00010000:1.0:1788201383.826065:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201383.826069:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1db15 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.826076:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1db15 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.826093:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1db07 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.826099:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1db07 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.826105:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1db07 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.826110:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1db07 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.826121:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ece00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201383.826124:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1db07 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.826130:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1db07 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.826138:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:1.0:1788201383.826140:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201383.826143:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1db07 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.826149:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1db07 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201383.826159:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5fd6a5f reply state 00000000478235ee transno 124554051748 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1db0e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.826169:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1db0e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.826174:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff8dc103b47c00) 00010000:00010000:1.0:1788201383.826176:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201383.826178:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201383.826499:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695517568:12345-192.168.201.20@tcp:36:rm.0 Request processed in 1298us (4024us total) trans 124554051748 rc 0/0 00000100:00100000:1.0:1788201383.826509:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1648 00000100:00100000:3.0:1788201383.831609:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201383.831661:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695517696 00000100:00100000:0.0:1788201383.831671:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695517696 00000100:00100000:0.0:1788201383.831716:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1649 00000100:00100000:0.0:1788201383.831724:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695517696:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1788201383.831744:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201383.831761:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1db23 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786d34 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.831819:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1db2a lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.831847:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1db2a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.831858:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1db2a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.831873:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1db31 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.831881:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1db31 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.831888:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1db31 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.831962:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c600/0x96d0c9b8c9a1db38 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.831970:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c600/0x96d0c9b8c9a1db38 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.831977:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c600/0x96d0c9b8c9a1db38 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201383.832055:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0xf:0x0]: returning size 1024 00000004:00200000:0.0:1788201383.832059:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201383.832075:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c600/0x96d0c9b8c9a1db38 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.832085:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c600/0x96d0c9b8c9a1db38 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.832110:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1db2a lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.832115:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1db2a lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.832119:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1db2a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.832123:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1db2a lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.832127:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782ca00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201383.832129:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1db2a lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.832134:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1db2a lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.832143:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201383.832144:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201383.832147:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1db2a lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.832152:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1db2a lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.832161:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1db31 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.832164:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1db31 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.832173:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1db31 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.832176:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782de00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201383.832178:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1db31 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.832181:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1db31 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.832185:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff8dc0084fbf00) 00010000:00010000:0.0:1788201383.832187:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201383.832188:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1db31 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.832191:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1db31 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.832210:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1db23 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d34 expref: 61 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.832218:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c600/0x96d0c9b8c9a1db38 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d34 expref: 60 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.832223:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff8dc005cc6f00) 00010000:00010000:0.0:1788201383.832224:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201383.832226:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00782c600, rc 0) 00000100:00100000:0.0:1788201383.832282:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695517696:12345-192.168.201.20@tcp:101:rm.0 Request processed in 559us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201383.832293:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1649 00000100:00100000:3.0:1788201383.838274:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201383.838379:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695517952 00000100:00100000:0.0:1788201383.838389:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695517952 00000100:00100000:0.0:1788201383.838470:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1650 00000100:00100000:0.0:1788201383.838479:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695517952:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:0.0:1788201383.838537:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788201383.838562:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c600/0x96d0c9b8c9a1db38 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d34 expref: 60 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.838587:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1d271 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786bc1 expref: 59 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.838600:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1cd38 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a39 expref: 58 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.838608:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff8dc005cc6f00) 00010000:00010000:0.0:1788201383.838616:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201383.838632:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1db3f lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.838642:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1db3f lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.838648:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1db3f lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.838657:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1db46 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.838674:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1db46 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.838678:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1db46 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.838741:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1db4d lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.838746:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1db4d lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.838750:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1db4d lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201383.838917:0:66313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].15, 64 off9152 00010000:00010000:0.0:1788201383.838966:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1db54 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.838974:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1db54 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.838981:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1db54 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.838987:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1db54 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.838993:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1db54 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.838999:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1db54 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.839059:0:66313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201383.839075:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1db4d lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.839079:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1db4d lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.839084:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1db4d lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.839087:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201383.839090:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1db4d lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.839095:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1db4d lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.839101:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff8dc0084fb400) 00010000:00010000:0.0:1788201383.839103:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201383.839105:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1db4d lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.839109:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c200/0x96d0c9b8c9a1db4d lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.839121:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1db3f lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.839124:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1db3f lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.839127:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201383.839128:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1db3f lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.839136:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1db54 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.839139:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1db3f lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.839150:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.839154:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782dc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201383.839155:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1db3f lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.839162:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1db54 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.839163:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1db3f lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.839178:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201383.839181:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.839181:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1db54 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.839184:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1db3f lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.839197:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d600/0x96d0c9b8c9a1db3f lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201383.839204:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000088735dcf reply state 000000002778ed4c transno 124554051749 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1db46 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.839214:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1db46 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.839215:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0xf:0x0].0x0 (ffff8dc0084fb400) 00010000:00010000:0.0:1788201383.839219:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff8dc0084fb800) 00010000:00010000:0.0:1788201383.839221:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201383.839223:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201383.839229:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788201383.839233:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1db54 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.839240:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782dc00/0x96d0c9b8c9a1db54 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.839256:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201383.839258:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201383.839260:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201383.839282:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695517952:12345-192.168.201.20@tcp:36:rm.0 Request processed in 805us (1021us total) trans 124554051749 rc 0/0 00000100:00100000:0.0:1788201383.839288:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1650 00000100:00100000:0.0:1788201383.842607:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201383.842684:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695518080 00000100:00100000:1.0:1788201383.842695:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695518080 00000100:00100000:1.0:1788201383.842760:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1651 00000100:00100000:1.0:1788201383.842782:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695518080:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:1.0:1788201383.842807:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201383.842829:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1db5b lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786d3b expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.842889:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1db62 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.842903:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1db62 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.842913:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1db62 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.842940:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1db69 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.842948:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1db69 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.842954:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1db69 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.843039:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1db70 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.843049:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1db70 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.843057:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1db70 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201383.843325:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x8:0x0]: returning size 1024 00000004:00200000:1.0:1788201383.843334:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201383.843364:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1db70 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.843377:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1db70 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.843386:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1db62 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.843392:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1db62 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.843398:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1db62 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.843403:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1db62 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.843408:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064eca00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201383.843412:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1db62 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.843419:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1db62 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.843429:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:1.0:1788201383.843432:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201383.843435:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1db62 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.843452:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1db62 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.843464:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1db69 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.843469:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1db69 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.843474:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1db69 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.843478:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ece00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201383.843482:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1db69 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.843487:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1db69 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.843493:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff8dc103b47700) 00010000:00010000:1.0:1788201383.843495:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201383.843498:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1db69 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.843504:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1db69 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.843530:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1db5b lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d3b expref: 61 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.843551:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1db70 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d3b expref: 60 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.843558:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff8dc11248c300) 00010000:00010000:1.0:1788201383.843560:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201383.843562:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ed200, rc 0) 00000100:00100000:1.0:1788201383.843619:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695518080:12345-192.168.201.20@tcp:101:rm.0 Request processed in 840us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201383.843627:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1651 00000100:00100000:1.0:1788201383.848371:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201383.849113:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695518336 00000100:00100000:0.0:1788201383.849126:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695518336 00000100:00100000:0.0:1788201383.849190:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1652 00000100:00100000:0.0:1788201383.849217:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695518336:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:0.0:1788201383.849268:0:66757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788201383.849298:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1db70 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d3b expref: 60 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.849335:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672000/0x96d0c9b8c9a1d1f3 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b9e expref: 59 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.849361:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100031e00/0x96d0c9b8c9a1cbe1 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869d7 expref: 58 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.849373:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff8dc11248c300) 00010000:00010000:0.0:1788201383.849383:0:66757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201383.849403:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1db77 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.849415:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1db77 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.849425:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1db77 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.849445:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1db7e lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.849452:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1db7e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.849472:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1db7e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.849569:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1db85 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.849577:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1db85 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.849584:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1db85 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201383.849788:0:66757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].16, 64 off9216 00010000:00010000:0.0:1788201383.849832:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1db8c lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.849841:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1db8c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.849850:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1db8c lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.849858:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1db8c lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.849865:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1db8c lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.849872:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1db8c lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.849898:0:66757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201383.849925:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1db85 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.849932:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1db85 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.849938:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1db85 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.849944:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782ca00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201383.849948:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1db85 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.849955:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1db85 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.849964:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff8dc0084fbb00) 00010000:00010000:0.0:1788201383.849967:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201383.849971:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1db85 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.849977:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ca00/0x96d0c9b8c9a1db85 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.849994:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1db77 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.850000:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1db77 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.850005:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1db77 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.850012:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1db77 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.850055:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201383.850058:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1db77 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.850064:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1db77 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.850072:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201383.850074:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201383.850077:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1db77 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.850082:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c400/0x96d0c9b8c9a1db77 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201383.850091:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002cb19ad reply state 0000000039c3513b transno 124554051750 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1db7e lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.850101:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1db7e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.850107:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff8dc0084fbf00) 00010000:00010000:0.0:1788201383.850110:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201383.850112:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201383.850190:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695518336:12345-192.168.201.20@tcp:36:rm.0 Request processed in 989us (1827us total) trans 124554051750 rc 0/0 00000100:00100000:0.0:1788201383.850198:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1652 00010000:00010000:1.0:1788201383.850379:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201383.850388:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1db8c lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.850394:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201383.850398:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1db8c lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.850404:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1db8c lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.850414:0:13349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x8:0x0].0x0 (ffff8dc0084fbb00) 00010000:00010000:1.0:1788201383.850417:0:13349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201383.850419:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1db8c lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.850424:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d400/0x96d0c9b8c9a1db8c lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.850453:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201383.850455:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201383.850458:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201383.853227:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201383.853531:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695518464 00000100:00100000:0.0:1788201383.853542:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695518464 00000100:00100000:0.0:1788201383.853607:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1653 00000100:00100000:0.0:1788201383.853631:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695518464:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1788201383.853665:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201383.853688:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1db93 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786d42 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.853764:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1db9a lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.853779:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1db9a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.853790:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1db9a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.853804:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1dba1 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.853810:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1dba1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.853816:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1dba1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.853898:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b800/0x96d0c9b8c9a1dba8 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.853906:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b800/0x96d0c9b8c9a1dba8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.853913:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b800/0x96d0c9b8c9a1dba8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201383.853962:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x15:0x0]: returning size 1024 00000004:00200000:0.0:1788201383.853967:0:66313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201383.853985:0:66313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b800/0x96d0c9b8c9a1dba8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.853997:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b800/0x96d0c9b8c9a1dba8 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.854006:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1db9a lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.854011:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1db9a lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.854050:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1db9a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.854056:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1db9a lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.854061:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896b600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201383.854066:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1db9a lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.854073:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1db9a lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.854084:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201383.854087:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201383.854091:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1db9a lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.854108:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b600/0x96d0c9b8c9a1db9a lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.854121:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1dba1 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.854127:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1dba1 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.854132:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1dba1 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.854137:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896b200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201383.854140:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1dba1 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.854146:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1dba1 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.854153:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff8dc0084fb900) 00010000:00010000:0.0:1788201383.854156:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201383.854159:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1dba1 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.854164:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b200/0x96d0c9b8c9a1dba1 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.854194:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782ce00/0x96d0c9b8c9a1db93 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d42 expref: 61 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.854228:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b800/0x96d0c9b8c9a1dba8 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d42 expref: 60 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.854235:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff8dc0048be800) 00010000:00010000:0.0:1788201383.854237:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201383.854240:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc00896b800, rc 0) 00000100:00100000:0.0:1788201383.854311:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695518464:12345-192.168.201.20@tcp:101:rm.0 Request processed in 675us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201383.854319:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1653 00000100:00100000:3.0:1788201383.858646:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201383.858729:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695518720 00000100:00100000:1.0:1788201383.858739:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695518720 00000100:00100000:1.0:1788201383.858793:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1654 00000100:00100000:1.0:1788201383.858802:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695518720:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:1.0:1788201383.858851:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788201383.858876:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b800/0x96d0c9b8c9a1dba8 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d42 expref: 60 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.858899:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74c00/0x96d0c9b8c9a1d3c8 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c46 expref: 59 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.858913:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ce5e lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a8d expref: 58 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.858923:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff8dc0048be800) 00010000:00010000:1.0:1788201383.858932:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201383.858951:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dbaf lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.858963:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dbaf lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.858972:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dbaf lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859005:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1dbb6 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859012:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1dbb6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859049:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1dbb6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859136:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1dbbd lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859143:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1dbbd lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x15:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859149:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1dbbd lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x15:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201383.859391:0:66314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].17, 64 off9280 00010000:00010000:1.0:1788201383.859439:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dbc4 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859448:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dbc4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859455:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dbc4 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859462:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dbc4 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859467:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dbc4 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859482:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dbc4 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859498:0:66314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201383.859515:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1dbbd lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859520:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1dbbd lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859525:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1dbbd lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859530:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064eca00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201383.859534:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1dbbd lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859542:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1dbbd lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859550:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff8dc103b47500) 00010000:00010000:1.0:1788201383.859553:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201383.859557:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1dbbd lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859563:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1dbbd lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x15:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859578:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dbaf lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859594:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dbaf lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859600:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dbaf lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859606:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dbaf lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859611:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201383.859614:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dbaf lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859620:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dbaf lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859627:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:1.0:1788201383.859630:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201383.859632:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dbaf lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859637:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dbaf lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201383.859647:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea163604 reply state 00000000fc8d35db transno 124554051751 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1dbb6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859657:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1dbb6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.859662:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff8dc103b47700) 00010000:00010000:1.0:1788201383.859669:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201383.859672:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201383.859749:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695518720:12345-192.168.201.20@tcp:36:rm.0 Request processed in 946us (1110us total) trans 124554051751 rc 0/0 00000100:00100000:1.0:1788201383.859756:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1654 00010000:00010000:2.0:1788201383.859996:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201383.860003:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dbc4 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.860010:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ecc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201383.860047:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dbc4 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.860055:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dbc4 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.860065:0:24979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x15:0x0].0x0 (ffff8dc103b47500) 00010000:00010000:2.0:1788201383.860068:0:24979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788201383.860071:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dbc4 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.860077:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dbc4 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.860089:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201383.860091:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201383.860092:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201383.866391:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201383.866466:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695518848 00000100:00100000:0.0:1788201383.866477:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695518848 00000100:00100000:0.0:1788201383.866554:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1655 00000100:00100000:0.0:1788201383.866564:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695518848:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1788201383.866589:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201383.866611:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1dbcb lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786d49 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.866676:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1dbd2 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.866689:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1dbd2 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.866700:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1dbd2 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.866714:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1dbd9 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.866734:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1dbd9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.866740:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1dbd9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.866813:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1dbe0 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.866822:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1dbe0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.866828:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1dbe0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201383.866866:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x10:0x0]: returning size 1024 00000004:00200000:0.0:1788201383.866871:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201383.866888:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1dbe0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.866899:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1dbe0 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.866909:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1dbd2 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.866916:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1dbd2 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.866921:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1dbd2 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.866940:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1dbd2 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.866945:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201383.866949:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1dbd2 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.866957:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1dbd2 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.866968:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201383.866971:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201383.866975:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1dbd2 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.866980:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1dbd2 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.866995:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1dbd9 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.867001:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1dbd9 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.867007:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1dbd9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.867012:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201383.867295:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1dbd9 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.867313:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1dbd9 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.867322:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff8dc0084fbb00) 00010000:00010000:0.0:1788201383.867324:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201383.867327:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1dbd9 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.867333:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1dbd9 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.867373:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a000/0x96d0c9b8c9a1dbcb lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d49 expref: 61 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.867387:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1dbe0 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d49 expref: 60 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.867394:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff8dc005cc6500) 00010000:00010000:0.0:1788201383.867396:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201383.867398:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58a00, rc 0) 00000100:00100000:0.0:1788201383.867464:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695518848:12345-192.168.201.20@tcp:101:rm.0 Request processed in 902us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201383.867473:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1655 00000100:00100000:0.0:1788201383.872146:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201383.872247:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695519104 00000100:00100000:2.0:1788201383.872258:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695519104 00000100:00100000:2.0:1788201383.872311:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1656 00000100:00100000:2.0:1788201383.872321:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695519104:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:2.0:1788201383.872386:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788201383.872414:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1dbe0 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d49 expref: 60 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.872438:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75800/0x96d0c9b8c9a1d2cc lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786beb expref: 59 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.872451:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc101672600/0x96d0c9b8c9a1cd69 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a47 expref: 58 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.872464:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff8dc005cc6500) 00010000:00010000:2.0:1788201383.872474:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201383.872506:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1dbe7 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.872528:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1dbe7 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.872537:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1dbe7 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.872552:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1dbee lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.872559:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1dbee lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.872582:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1dbee lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.872995:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dbf5 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.873005:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dbf5 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x10:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.873012:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dbf5 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x10:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201383.873221:0:66313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].18, 64 off9344 00010000:00010000:2.0:1788201383.873603:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1dbfc lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.873613:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1dbfc lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.873622:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1dbfc lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.873629:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1dbfc lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.873635:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1dbfc lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.873641:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1dbfc lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.873660:0:66313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201383.873686:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dbf5 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.873692:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dbf5 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.873698:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dbf5 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.873704:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbce00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.873708:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dbf5 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.873715:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dbf5 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.873724:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff8dc108994a00) 00010000:00010000:2.0:1788201383.873727:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201383.873730:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dbf5 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.873736:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dbf5 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.873751:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1dbe7 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.873757:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1dbe7 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.873764:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1dbe7 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.873769:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1dbe7 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.873778:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.873781:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1dbe7 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.873787:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1dbe7 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.873794:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201383.873796:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.873799:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1dbe7 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.873804:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1dbe7 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201383.873812:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008acfcd90 reply state 000000001973c1fc transno 124554051752 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1dbee lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.873822:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1dbee lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.873828:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff8dc108994f00) 00010000:00010000:2.0:1788201383.873830:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201383.873833:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201383.873914:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695519104:12345-192.168.201.20@tcp:36:rm.0 Request processed in 1593us (1775us total) trans 124554051752 rc 0/0 00000100:00100000:2.0:1788201383.873924:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1656 00010000:00010000:0.0:1788201383.874087:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201383.874095:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1dbfc lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.874111:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201383.874115:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1dbfc lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.874121:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1dbfc lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.874130:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x10:0x0].0x0 (ffff8dc108994a00) 00010000:00010000:0.0:1788201383.874132:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201383.874135:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1dbfc lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.874141:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1dbfc lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.874155:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201383.874156:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201383.874158:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201383.878175:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201383.878352:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695519360 00000100:00100000:1.0:1788201383.878363:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695519360 00000100:00100000:1.0:1788201383.878423:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1657 00000100:00100000:1.0:1788201383.878433:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+59:75365:x1875060695519360:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:1.0:1788201383.878501:0:66312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201383.878526:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896ae00/0x96d0c9b8c9a1d805 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cb6 expref: 59 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.878546:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x2f:0x0].0x0 (ffff8dc0084fb000) 00010000:00010000:1.0:1788201383.878556:0:66312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201383.878575:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dc03 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.878589:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dc03 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.878599:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dc03 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.878610:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1dc0a lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xc8d93425 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.878617:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1dc0a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.878623:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1dc0a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.878716:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1dc11 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.878725:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1dc11 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.878731:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1dc11 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201383.878914:0:66312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].19, 64 off9408 00010000:00010000:1.0:1788201383.878959:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1dc18 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.878967:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1dc18 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.878975:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1dc18 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.878981:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1dc18 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.878987:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1dc18 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.878993:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1dc18 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.879055:0:66312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201383.879075:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1dc11 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.879092:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1dc11 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.879098:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1dc11 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.879104:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201383.879108:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1dc11 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.879116:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1dc11 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.879126:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x2f:0x0].0x0 (ffff8dc103b47d00) 00010000:00010000:1.0:1788201383.879128:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201383.879132:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1dc11 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.879138:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1dc11 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.879155:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dc03 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.879161:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dc03 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.879168:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dc03 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.879173:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dc03 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.879187:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201383.879190:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dc03 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.879195:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dc03 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.879203:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:1.0:1788201383.879205:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201383.879208:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dc03 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.879214:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dc03 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201383.879223:0:66312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082f8de2a reply state 00000000d840917d transno 124554051753 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1dc0a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.879234:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1dc0a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.879429:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201383.879437:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1dc18 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.879454:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201383.879458:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1dc18 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.879465:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1dc18 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.879474:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x2f:0x0].0x0 (ffff8dc103b47d00) 00010000:00010000:2.0:1788201383.879477:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788201383.879480:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1dc18 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.879497:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1dc18 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.879511:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201383.879512:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201383.879514:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201383.879620:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8d93425 (ffff8dc0084fb500) 00010000:00010000:1.0:1788201383.879622:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201383.879626:0:66312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201383.879736:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695519360:12345-192.168.201.20@tcp:36:rm.0 Request processed in 1302us (1567us total) trans 124554051753 rc 0/0 00000100:00100000:1.0:1788201383.879744:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1657 00000100:00100000:3.0:1788201383.890951:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201383.891104:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695519488 00000100:00100000:0.0:1788201383.891115:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695519488 00000100:00100000:0.0:1788201383.891205:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1658 00000100:00100000:0.0:1788201383.891216:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695519488:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1788201383.891249:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201383.891270:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1dc1f lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786d50 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891348:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1dc26 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891378:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1dc26 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891390:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1dc26 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891406:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1dc2d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891412:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1dc2d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891418:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1dc2d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891499:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1dc34 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891508:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1dc34 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891516:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1dc34 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201383.891553:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x18:0x0]: returning size 1024 00000004:00200000:0.0:1788201383.891558:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201383.891577:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1dc34 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891589:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1dc34 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891611:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1dc26 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891616:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1dc26 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891622:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1dc26 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891628:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1dc26 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891634:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201383.891639:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1dc26 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891646:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1dc26 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891658:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201383.891661:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201383.891665:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1dc26 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891672:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1dc26 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891686:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1dc2d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891692:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1dc2d lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891705:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1dc2d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891711:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201383.891714:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1dc2d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891720:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1dc2d lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891729:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff8dc0084fbb00) 00010000:00010000:0.0:1788201383.891731:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201383.891734:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1dc2d lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891739:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1dc2d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891770:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1dc1f lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d50 expref: 62 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891784:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1dc34 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d50 expref: 61 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.891791:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff8dc1207c9500) 00010000:00010000:0.0:1788201383.891793:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201383.891796:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59000, rc 0) 00000100:00100000:0.0:1788201383.891860:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+61:75365:x1875060695519488:12345-192.168.201.20@tcp:101:rm.0 Request processed in 646us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201383.891875:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1658 00000100:00100000:0.0:1788201383.895444:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201383.895592:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695519744 00000100:00100000:1.0:1788201383.895603:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695519744 00000100:00100000:1.0:1788201383.895664:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1659 00000100:00100000:1.0:1788201383.895687:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+61:75365:x1875060695519744:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:1.0:1788201383.895739:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788201383.895765:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1dc34 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d50 expref: 61 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.895789:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9400/0x96d0c9b8c9a1d18a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786b89 expref: 60 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.895802:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782d000/0x96d0c9b8c9a1cef1 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ab7 expref: 59 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.895813:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff8dc1207c9500) 00010000:00010000:1.0:1788201383.895823:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201383.895842:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dc3b lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.895855:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dc3b lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.895864:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dc3b lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.895879:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1dc42 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.895886:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1dc42 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.895893:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1dc42 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.895984:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1dc49 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.895993:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1dc49 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x18:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.896000:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1dc49 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x18:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201383.896229:0:66314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].20, 64 off9472 00010000:00010000:1.0:1788201383.896289:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1dc50 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.896298:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1dc50 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.896306:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1dc50 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.896314:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1dc50 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.896320:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1dc50 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.896326:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1dc50 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.896352:0:66314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201383.896369:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1dc49 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.896386:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1dc49 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.896393:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1dc49 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.896398:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201383.896403:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1dc49 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.896410:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1dc49 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.896420:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff8dc103b47600) 00010000:00010000:1.0:1788201383.896422:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201383.896426:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1dc49 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.896433:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1dc49 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.896451:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dc3b lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.896457:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dc3b lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.896463:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dc3b lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.896468:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dc3b lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.896480:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201383.896496:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dc3b lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.896504:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dc3b lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.896513:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:1.0:1788201383.896515:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201383.896519:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dc3b lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.896525:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dc3b lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201383.896535:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067093a0a reply state 00000000206cf585 transno 124554051754 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1dc42 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.896546:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1dc42 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.896552:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff8dc103b47200) 00010000:00010000:1.0:1788201383.896554:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201383.896556:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201383.896626:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695519744:12345-192.168.201.20@tcp:36:rm.0 Request processed in 940us (1192us total) trans 124554051754 rc 0/0 00000100:00100000:1.0:1788201383.896634:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1659 00010000:00010000:2.0:1788201383.896840:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201383.896847:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1dc50 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.896853:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201383.896856:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1dc50 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.896863:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1dc50 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.896872:0:13349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x18:0x0].0x0 (ffff8dc103b47600) 00010000:00010000:2.0:1788201383.896881:0:13349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788201383.896884:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1dc50 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.896890:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1dc50 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x18:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.896904:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201383.896906:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201383.896907:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201383.900119:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201383.901390:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695519872 00000100:00100000:1.0:1788201383.901403:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695519872 00000100:00100000:1.0:1788201383.901464:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1660 00000100:00100000:1.0:1788201383.901490:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11d29dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695519872:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:1.0:1788201383.901515:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201383.901537:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dc57 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786d57 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.901603:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1dc5e lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.901618:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1dc5e lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.901629:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1dc5e lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.901644:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dc65 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.901651:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dc65 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.901658:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dc65 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.901728:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1dc6c lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.901737:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1dc6c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.901745:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1dc6c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201383.901793:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x17:0x0]: returning size 1024 00000004:00200000:1.0:1788201383.901798:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201383.901816:0:66312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1dc6c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.901827:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1dc6c lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.901837:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1dc5e lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.901842:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1dc5e lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.901849:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1dc5e lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.901855:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1dc5e lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.901861:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201383.901865:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1dc5e lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.901873:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1dc5e lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.901884:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:1.0:1788201383.901888:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201383.901892:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1dc5e lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.901910:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1dc5e lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.901922:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dc65 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.901928:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dc65 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.901934:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dc65 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.901939:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ecc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201383.901942:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dc65 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.901948:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dc65 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.901956:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff8dc103b47900) 00010000:00010000:1.0:1788201383.901959:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201383.901962:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dc65 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.901967:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dc65 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.901995:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dc57 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d57 expref: 62 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.902057:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1dc6c lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d57 expref: 61 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201383.902064:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff8dc0048be100) 00010000:00010000:1.0:1788201383.902066:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201383.902069:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ed200, rc 0) 00000100:00100000:1.0:1788201383.902124:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11d29dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+61:75365:x1875060695519872:12345-192.168.201.20@tcp:101:rm.0 Request processed in 638us (2027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201383.902131:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1660 00000100:00100000:3.0:1788201383.906979:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201383.907757:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695520128 00000100:00100000:0.0:1788201383.907771:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695520128 00000100:00100000:0.0:1788201383.907893:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1661 00000100:00100000:0.0:1788201383.907906:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+61:75365:x1875060695520128:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:0.0:1788201383.907961:0:66757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788201383.907988:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1dc6c lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d57 expref: 61 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908010:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1d43f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c70 expref: 60 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908051:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc11cda9800/0x96d0c9b8c9a1cec0 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786aa9 expref: 59 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908062:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff8dc0048be100) 00010000:00010000:0.0:1788201383.908072:0:66757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201383.908093:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1dc73 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908116:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1dc73 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908125:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1dc73 lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908141:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1dc7a lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908163:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1dc7a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908170:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1dc7a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908261:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1dc81 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908269:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1dc81 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908275:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1dc81 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x17:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201383.908471:0:66757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].21, 64 off9536 00010000:00010000:0.0:1788201383.908519:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1dc88 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908528:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1dc88 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908535:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1dc88 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908542:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1dc88 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908549:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1dc88 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908555:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1dc88 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908583:0:66757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201383.908600:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1dc81 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908607:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1dc81 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908613:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1dc81 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908618:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201383.908622:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1dc81 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908629:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1dc81 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908637:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff8dc0084fb900) 00010000:00010000:0.0:1788201383.908640:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201383.908652:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1dc81 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908660:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1dc81 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x17:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908677:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1dc73 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908684:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1dc73 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908690:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1dc73 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908701:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1dc73 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908706:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201383.908709:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1dc73 lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908716:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1dc73 lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908725:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:0.0:1788201383.908727:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201383.908730:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1dc73 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908735:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1dc73 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201383.908744:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e089dd76 reply state 000000006fb9e1c1 transno 124554051755 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1dc7a lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908754:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1dc7a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.908760:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff8dc0084fbb00) 00010000:00010000:0.0:1788201383.908762:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201383.908765:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201383.908839:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695520128:12345-192.168.201.20@tcp:36:rm.0 Request processed in 936us (1870us total) trans 124554051755 rc 0/0 00000100:00100000:0.0:1788201383.908846:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1661 00010000:00010000:2.0:1788201383.908923:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201383.908931:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1dc88 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.908939:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201383.908943:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1dc88 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.908950:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1dc88 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.908961:0:24979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x17:0x0].0x0 (ffff8dc0084fb900) 00010000:00010000:2.0:1788201383.908964:0:24979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788201383.908967:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1dc88 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.908973:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1dc88 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x17:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.908987:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201383.908989:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201383.908991:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201383.914136:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201383.914215:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695520256 00000100:00100000:3.0:1788201383.914226:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695520256 00000100:00100000:3.0:1788201383.914287:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1662 00000100:00100000:3.0:1788201383.914299:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695520256:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:3.0:1788201383.914323:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201383.914353:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1dc8f lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786d5e expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914420:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1dc96 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914435:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1dc96 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914446:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1dc96 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914459:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75a00/0x96d0c9b8c9a1dc9d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914483:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75a00/0x96d0c9b8c9a1dc9d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914490:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75a00/0x96d0c9b8c9a1dc9d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914554:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1dca4 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914562:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1dca4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914568:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1dca4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201383.914609:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x16:0x0]: returning size 1024 00000004:00200000:3.0:1788201383.914613:0:69485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201383.914628:0:69485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1dca4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914639:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1dca4 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914661:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1dc96 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914667:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1dc96 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914673:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1dc96 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914689:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1dc96 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914695:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201383.914699:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1dc96 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914706:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1dc96 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914718:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:3.0:1788201383.914721:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201383.914725:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1dc96 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914732:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1dc96 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914744:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75a00/0x96d0c9b8c9a1dc9d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914750:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75a00/0x96d0c9b8c9a1dc9d lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914756:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75a00/0x96d0c9b8c9a1dc9d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914761:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201383.914763:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75a00/0x96d0c9b8c9a1dc9d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914776:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75a00/0x96d0c9b8c9a1dc9d lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914783:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff8dc004b23b00) 00010000:00010000:3.0:1788201383.914786:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201383.914788:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75a00/0x96d0c9b8c9a1dc9d lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914793:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75a00/0x96d0c9b8c9a1dc9d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914821:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1dc8f lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d5e expref: 62 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914833:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1dca4 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d5e expref: 61 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201383.914840:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff8dc103a3a600) 00010000:00010000:3.0:1788201383.914843:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201383.914845:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c74a00, rc 0) 00000100:00100000:3.0:1788201383.914901:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+61:75365:x1875060695520256:12345-192.168.201.20@tcp:101:rm.0 Request processed in 605us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201383.914908:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1662 00000100:00100000:3.0:1788201383.917887:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201383.917959:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695520512 00000100:00100000:2.0:1788201383.917970:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695520512 00000100:00100000:2.0:1788201383.918037:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1663 00000100:00100000:2.0:1788201383.918047:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+61:75365:x1875060695520512:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:2.0:1788201383.918100:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788201383.918128:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1dca4 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d5e expref: 61 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918152:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfe00/0x96d0c9b8c9a1d407 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786c5b expref: 60 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918165:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1ce8f lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786a9b expref: 59 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918175:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff8dc103a3a600) 00010000:00010000:2.0:1788201383.918185:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201383.918204:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dcab lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918217:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dcab lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918226:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dcab lrc: 3/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918253:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1dcb2 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918261:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1dcb2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918283:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1dcb2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918371:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1dcb9 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918379:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1dcb9 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918386:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1dcb9 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201383.918585:0:66313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x74:0x0].22, 64 off9600 00010000:00010000:2.0:1788201383.918630:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1dcc0 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918638:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1dcc0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918645:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1dcc0 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918651:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1dcc0 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918657:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1dcc0 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918662:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1dcc0 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918685:0:66313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201383.918708:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1dcb9 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.918709:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201383.918721:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1dcc0 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918721:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1dcb9 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x16:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.918741:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201383.918741:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1dcb9 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.918749:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1dcc0 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918751:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.918758:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1dcb9 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x16:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.918762:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1dcc0 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918768:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1dcb9 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x16:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.918777:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff8dc108994c00) 00010000:00010000:0.0:1788201383.918781:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788201383.918785:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1dcc0 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918788:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x16:0x0].0x0 (ffff8dc108994c00) 00010000:00010000:2.0:1788201383.918795:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201383.918796:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1dcc0 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x16:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918799:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1dcb9 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x16:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918812:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1dcb9 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x16:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201383.918816:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201383.918819:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201383.918821:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201383.918833:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dcab lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918840:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dcab lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918846:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dcab lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918852:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dcab lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918862:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbce00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.918865:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dcab lrc: 4/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918871:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dcab lrc: 5/0,0 mode: CW/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918880:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201383.918882:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.918885:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dcab lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918890:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dcab lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201383.918900:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b6e1205 reply state 0000000016045380 transno 124554051756 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1dcb2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918910:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1dcb2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.918916:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff8dc108994400) 00010000:00010000:2.0:1788201383.918918:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201383.918920:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201383.918984:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695520512:12345-192.168.201.20@tcp:36:rm.0 Request processed in 937us (1105us total) trans 124554051756 rc 0/0 00000100:00100000:2.0:1788201383.918991:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1663 00000100:00100000:2.0:1788201383.923425:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201383.923578:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695520768 00000100:00100000:0.0:1788201383.923588:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695520768 00000100:00100000:0.0:1788201383.923659:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 288 00000100:00100000:0.0:1788201383.923671:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695520768:12345-192.168.201.20@tcp:35:rm.0 00000100:00100000:0.0:1788201383.923892:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+61:75365:x1875060695520768:12345-192.168.201.20@tcp:35:rm.0 Request processed in 223us (475us total) trans 124554051757 rc 0/0 00000100:00100000:0.0:1788201383.923900:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 288 00000100:00100000:0.0:1788201383.931646:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201383.931764:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695521024 00000100:00100000:2.0:1788201383.931774:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695521024 00000100:00100000:2.0:1788201383.931840:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1664 00000100:00100000:2.0:1788201383.931849:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+61:75365:x1875060695521024:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:2.0:1788201383.931898:0:66312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788201383.931925:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007adf800/0x96d0c9b8c9a1d83d lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cd2 expref: 61 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.931948:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1cb4e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7869ad expref: 60 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.931959:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc0048be300) 00010000:00010000:2.0:1788201383.931973:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2800/0x96d0c9b8c9a1cf84 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ada expref: 59 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.931981:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:2.0:1788201383.931984:0:66312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201383.932003:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dcc7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.932062:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dcc7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.932073:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dcc7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.932089:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1dcce lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.932096:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1dcce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.932123:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1dcce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.932199:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1dcd5 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.932208:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1dcd5 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.932215:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1dcd5 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201383.932452:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x4:0x0]: returning size 4096 00010000:00010000:2.0:1788201383.932467:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1dcd5 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.932474:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1dcd5 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.932480:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1dcd5 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.932486:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.932490:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1dcd5 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.932497:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1dcd5 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.932506:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x0 (ffff8dc108994d00) 00010000:00010000:2.0:1788201383.932508:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201383.932517:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1dcd5 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.932523:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1dcd5 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.932542:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dcc7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.932550:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dcc7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.932555:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dcc7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.932561:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dcc7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.932565:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbce00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201383.932567:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dcc7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.932573:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dcc7 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.932580:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:2.0:1788201383.932582:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201383.932584:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dcc7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.932589:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1dcc7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201383.932598:0:66312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003df1c2d reply state 00000000834a70f3 transno 124554051758 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1dcce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.932614:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1dcce lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201383.932620:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff8dc108994c00) 00010000:00010000:2.0:1788201383.932622:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201383.932625:0:66312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201383.932700:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:75365:x1875060695521024:12345-192.168.201.20@tcp:36:rm.0 Request processed in 851us (1062us total) trans 124554051758 rc 0/0 00000100:00100000:2.0:1788201383.932708:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1664 00010000:00010000:3.0:1788201384.720114:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201384.784032:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201384.784057:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715352832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201384.784139:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201384.784256:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715352832 00000100:00100000:0.0:1788201384.784264:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715352832 00000100:00100000:0.0:1788201384.784348:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788201384.784358:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715352832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201384.784389:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788201384.784437:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715352832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201384.784443:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788201384.784484:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc120092d80 x1875060715352832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201384.784501:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715352832:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788201384.784625:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201384.785549:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715352960:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201384.785606:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201384.785748:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715352960 00000100:00100000:2.0:1788201384.785755:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715352960 00000100:00100000:2.0:1788201384.785802:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201384.785810:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715352960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201384.785827:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00080000:1.0:1788201384.785905:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201384.786198:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715352960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 388us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201384.786206:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788201384.786367:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc005d59c00 x1875060715352960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201384.786384:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715352960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201385.297908:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201385.297932:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715353088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201385.298008:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201385.300602:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715353088 00000100:00100000:1.0:1788201385.300616:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715353088 00000100:00100000:1.0:1788201385.300668:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788201385.300678:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715353088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201385.300714:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:1.0:1788201385.300807:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715353088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (2799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201385.300814:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788201385.300865:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715353088:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788201385.743774:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201385.807844:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201385.807868:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715353344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201385.807939:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201385.808109:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715353344 00000100:00100000:1.0:1788201385.808118:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715353344 00000100:00100000:0.0:1788201385.808238:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715353216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201385.808272:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201385.808345:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715353216 00000100:00100000:0.0:1788201385.808349:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715353216 00000100:00100000:0.0:1788201385.808390:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788201385.808399:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715353216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201385.808427:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922382848 avail 3690860544 00000100:00100000:0.0:1788201385.808476:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715353216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201385.808482:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788201385.808503:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201385.808535:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715353216:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201385.808661:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788201385.808671:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715353344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201385.808694:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444937728 avail 1298698240 00000100:00100000:1.0:1788201385.808740:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715353344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201385.808754:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788201385.808817:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715353344:0@lo:41:osp-pre-0-1.0 00000004:00080000:2.0:1788201385.811540:0:94475:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 4237283520744ns, next at 4238283517727ns, rc = 0 00000100:00100000:2.0:1788201385.811676:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715353600:0@lo:400:kworker.0 00000100:00100000:2.0:1788201385.811743:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201385.811782:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715354112:0@lo:400:kworker.0 00000100:00100000:2.0:1788201385.811808:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201385.811826:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715354624:0@lo:400:kworker.0 00000100:00100000:2.0:1788201385.811849:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201385.811894:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788201385.811901:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715353728:0@lo:400:kworker.0 00000100:00100000:2.0:1788201385.811925:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201385.811942:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715354240:0@lo:400:kworker.0 00000100:00100000:2.0:1788201385.811961:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201385.811975:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715354752:0@lo:400:kworker.0 00000100:00100000:2.0:1788201385.811992:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201385.812040:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715353600 00000100:00100000:2.0:1788201385.812047:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715353600 00000100:00100000:2.0:1788201385.812095:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788201385.812105:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715353600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201385.812153:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715353600:12345-0@lo:400:kworker.0 Request processed in 48us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201385.812160:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788201385.812191:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715354112 00000100:00100000:2.0:1788201385.812195:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715354112 00000100:00100000:2.0:1788201385.812230:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715353728 00000100:00100000:2.0:1788201385.812233:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715353728 00000100:00100000:2.0:1788201385.812244:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715354240 00000100:00100000:2.0:1788201385.812246:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715354240 00000100:00100000:2.0:1788201385.812257:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201385.812262:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715354112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201385.812294:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715354112:12345-0@lo:400:kworker.0 Request processed in 31us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201385.812300:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201385.812326:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788201385.812333:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715353728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201385.812371:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715353728:12345-0@lo:400:kworker.0 Request processed in 40us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201385.812378:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788201385.812390:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788201385.812396:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715354240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201385.812421:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715354240:12345-0@lo:400:kworker.0 Request processed in 26us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201385.812427:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788201385.812450:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201385.812461:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715353856:0@lo:400:kworker.0 00000100:00100000:2.0:1788201385.812486:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201385.812504:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715354368:0@lo:400:kworker.0 00000100:00100000:2.0:1788201385.812523:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201385.812538:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715354880:0@lo:400:kworker.0 00000100:00100000:2.0:1788201385.812556:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201385.812576:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788201385.812581:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715353472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201385.812605:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201385.812623:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715353984:0@lo:400:kworker.0 00000100:00100000:2.0:1788201385.812643:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201385.813300:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715354624 00000100:00100000:0.0:1788201385.813321:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715354624 00000100:00100000:0.0:1788201385.813363:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715354752 00000100:00100000:0.0:1788201385.813366:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715354752 00000100:00100000:0.0:1788201385.813381:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715353856 00000100:00100000:0.0:1788201385.813383:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715353856 00000100:00100000:0.0:1788201385.813393:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715354368 00000100:00100000:0.0:1788201385.813395:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715354368 00000100:00100000:0.0:1788201385.813404:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715354880 00000100:00100000:0.0:1788201385.813407:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715354880 00000100:00100000:0.0:1788201385.813423:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1695 00000100:00100000:0.0:1788201385.813430:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715354624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201385.813481:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715354624:12345-0@lo:400:kworker.0 Request processed in 50us (1629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201385.813488:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1695 00000100:00100000:0.0:1788201385.813501:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1696 00000100:00100000:0.0:1788201385.813507:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715354752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201385.813533:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715354752:12345-0@lo:400:kworker.0 Request processed in 26us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201385.813538:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1696 00000100:00100000:0.0:1788201385.813548:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1697 00000100:00100000:0.0:1788201385.813553:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715353856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201385.813578:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715353856:12345-0@lo:400:kworker.0 Request processed in 25us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201385.813583:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1697 00000100:00100000:0.0:1788201385.813594:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1698 00000100:00100000:0.0:1788201385.813623:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715354368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201385.813662:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715354368:12345-0@lo:400:kworker.0 Request processed in 53us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201385.813667:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1698 00000100:00100000:0.0:1788201385.813678:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1699 00000100:00100000:0.0:1788201385.813683:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715354880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201385.813707:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715354880:12345-0@lo:400:kworker.0 Request processed in 24us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201385.813712:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1699 00000100:00080000:0.0:1788201385.813731:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201385.813735:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201385.813813:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715353472 00000100:00100000:0.0:1788201385.813817:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715353472 00000100:00100000:0.0:1788201385.813841:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201385.813847:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715353472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201385.813861:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922382848 avail 3690860544 00000100:00100000:0.0:1788201385.813892:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715353472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201385.813898:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788201385.813935:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc118141f80 x1875060715353728/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201385.813950:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715353728:0@lo:400:kworker.0 00010000:00080000:0.0:1788201385.813963:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc118143100 x1875060715354240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201385.813972:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715354240:0@lo:400:kworker.0 00000100:00100000:0.0:1788201385.814000:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715354752:0@lo:400:kworker.0 00000100:00100000:0.0:1788201385.814010:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715353600:0@lo:400:kworker.0 00000100:00100000:0.0:1788201385.814064:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715354112:0@lo:400:kworker.0 00000100:00100000:0.0:1788201385.814079:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715354624:0@lo:400:kworker.0 00000100:00100000:2.0:1788201385.815374:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715354496:0@lo:400:kworker.0 00000100:00100000:2.0:1788201385.815422:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201385.815454:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715353856:0@lo:400:kworker.0 00000100:00100000:2.0:1788201385.815466:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715354368:0@lo:400:kworker.0 00000100:00100000:2.0:1788201385.815490:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715354880:0@lo:400:kworker.0 00000100:00100000:2.0:1788201385.815521:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715353472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201385.819514:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715354496 00000100:00100000:0.0:1788201385.819532:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715354496 00000100:00100000:0.0:1788201385.819642:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1700 00000100:00100000:0.0:1788201385.819653:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715354496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201385.819749:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715354496:12345-0@lo:400:kworker.0 Request processed in 98us (4326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201385.819757:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1700 00000100:00080000:2.0:1788201385.820362:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201385.820406:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715354496:0@lo:400:kworker.0 00000100:00100000:3.0:1788201385.820545:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715353984 00000100:00100000:3.0:1788201385.820551:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715353984 00000100:00100000:0.0:1788201385.820752:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788201385.820760:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715353984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201385.820879:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715353984:12345-0@lo:400:kworker.0 Request processed in 119us (8234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201385.820886:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788201385.825248:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715353984:0@lo:400:kworker.0 00010000:00010000:1.0:1788201386.775174:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201386.966798:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201386.966844:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201386.966953:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695521152 00000100:00100000:3.0:1788201386.966964:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695521152 00000100:00100000:3.0:1788201386.967050:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 335 00000100:00100000:3.0:1788201386.967072:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695521152:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201386.967135:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695521152:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 76us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201386.967142:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 335 00000100:00100000:3.0:1788201386.967559:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695521408 00000100:00100000:3.0:1788201386.967564:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695521408 00000100:00100000:3.0:1788201386.967618:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1701 00000100:00100000:3.0:1788201386.967626:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695521408:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201386.967667:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695521408:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 42us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201386.967674:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1701 00000100:00080000:2.0:1788201386.968360:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201386.977320:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201386.977365:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201386.977395:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201386.977433:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695521664 00000100:00100000:1.0:1788201386.977447:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695521664 00000100:00100000:1.0:1788201386.977526:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695521536 00000100:00100000:1.0:1788201386.977530:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695521536 00000100:00100000:1.0:1788201386.977559:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:1.0:1788201386.978328:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695521664:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201386.978459:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695521664:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 889us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201386.978468:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:1.0:1788201386.978497:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:1.0:1788201386.978506:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2403:x1875060695521536:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201386.978531:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2403:x1875060695521536:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201386.978537:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:1.0:1788201386.978561:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695521280 00000100:00100000:1.0:1788201386.978566:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695521280 00000100:00100000:1.0:1788201386.978823:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1702 00000100:00100000:1.0:1788201386.978830:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:2403:x1875060695521280:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201386.978863:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+60:2403:x1875060695521280:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 33us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201386.978887:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1702 00000100:00080000:1.0:1788201386.978911:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201386.978916:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201386.978918:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788201387.794499:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201388.823534:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788201389.392724:0:94457:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1788201389.392780:0:94457:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051758 is committed 00000004:00080000:0.0:1788201389.392820:0:94457:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:3.0:1788201389.392900:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d7fe lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.392914:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d7fe lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.392922:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d7fe lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.392929:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896a600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201389.392934:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d7fe lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.392941:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d7fe lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.392959:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8d93425 (ffff8dc0084fb500) 00010000:00010000:3.0:1788201389.392962:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.392966:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d7fe lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.392972:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a600/0x96d0c9b8c9a1d7fe lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.392991:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1d86e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.392997:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1d86e lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393041:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1d86e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393059:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201389.393062:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1d86e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393069:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1d86e lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393077:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2f385ca3 (ffff8dc0084fb200) 00010000:00010000:3.0:1788201389.393080:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.393083:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1d86e lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393088:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1d86e lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393107:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1d8a6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393113:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1d8a6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393119:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1d8a6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393123:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201389.393126:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1d8a6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393131:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1d8a6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393149:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x7bc65ca3 (ffff8dc108994000) 00010000:00010000:3.0:1788201389.393151:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.393154:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1d8a6 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393160:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1d8a6 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393175:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1d8de lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393181:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1d8de lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393187:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1d8de lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393191:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782da00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201389.393194:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1d8de lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393200:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1d8de lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393206:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x965f6ba3 (ffff8dc0084fbd00) 00010000:00010000:3.0:1788201389.393208:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.393211:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1d8de lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393216:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782da00/0x96d0c9b8c9a1d8de lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393233:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1d916 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393254:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1d916 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393261:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1d916 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393266:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201389.393269:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1d916 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393275:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1d916 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393283:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x5abf9a3 (ffff8dc108994200) 00010000:00010000:3.0:1788201389.393285:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.393288:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1d916 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393293:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1d916 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393305:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d94e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393311:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d94e lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393317:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d94e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393326:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201389.393329:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d94e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393336:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d94e lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393343:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x74f887a3 (ffff8dc108994e00) 00010000:00010000:3.0:1788201389.393345:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.393348:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d94e lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393353:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1d94e lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393367:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc200/0x96d0c9b8c9a1d986 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393372:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc200/0x96d0c9b8c9a1d986 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393378:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc200/0x96d0c9b8c9a1d986 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393382:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0078fc200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201389.393385:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc200/0x96d0c9b8c9a1d986 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393391:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc200/0x96d0c9b8c9a1d986 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393407:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xdeb924a3 (ffff8dc108994500) 00010000:00010000:3.0:1788201389.393410:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.393412:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc200/0x96d0c9b8c9a1d986 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393419:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fc200/0x96d0c9b8c9a1d986 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393433:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbde00/0x96d0c9b8c9a1d9be lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393439:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbde00/0x96d0c9b8c9a1d9be lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393444:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbde00/0x96d0c9b8c9a1d9be lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393449:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbde00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201389.393452:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbde00/0x96d0c9b8c9a1d9be lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393458:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbde00/0x96d0c9b8c9a1d9be lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393465:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xd57f5ca3 (ffff8dc108994300) 00010000:00010000:3.0:1788201389.393467:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.393470:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbde00/0x96d0c9b8c9a1d9be lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393475:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbde00/0x96d0c9b8c9a1d9be lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393495:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9f6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393502:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9f6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393507:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9f6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393513:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbda00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201389.393516:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9f6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393521:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9f6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393528:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x220d5ca3 (ffff8dc108994b00) 00010000:00010000:3.0:1788201389.393529:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.393532:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9f6 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393537:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1d9f6 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393560:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1da2e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393566:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1da2e lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393571:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1da2e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393580:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201389.393583:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1da2e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393588:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1da2e lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393596:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x4e05b2a3 (ffff8dc103b47f00) 00010000:00010000:3.0:1788201389.393598:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.393601:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1da2e lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393605:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1da2e lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393619:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1da66 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393624:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1da66 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393630:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1da66 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393633:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201389.393635:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1da66 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393640:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1da66 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393656:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe44515a3 (ffff8dc108994700) 00010000:00010000:3.0:1788201389.393658:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.393661:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1da66 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393666:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1da66 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393679:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1da9e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393684:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1da9e lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393690:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1da9e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393695:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201389.393697:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1da9e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393702:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1da9e lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393708:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xb6f515a3 (ffff8dc004b23f00) 00010000:00010000:3.0:1788201389.393710:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.393713:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1da9e lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393718:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1da9e lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393739:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1dad6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393746:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1dad6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393751:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1dad6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393756:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201389.393759:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1dad6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393764:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1dad6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393771:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x9beb5ca3 (ffff8dc0084fba00) 00010000:00010000:3.0:1788201389.393773:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.393775:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1dad6 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393781:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c000/0x96d0c9b8c9a1dad6 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393791:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1db0e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393796:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1db0e lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393802:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1db0e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393810:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ede00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201389.393813:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1db0e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393818:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1db0e lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393825:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xbd5240a3 (ffff8dc103b47c00) 00010000:00010000:3.0:1788201389.393827:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.393829:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1db0e lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393834:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1db0e lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393846:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1db46 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393851:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1db46 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393856:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1db46 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393861:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201389.393863:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1db46 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393869:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1db46 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393885:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x6e9b5ca3 (ffff8dc0084fb800) 00010000:00010000:3.0:1788201389.393887:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.393890:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1db46 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393895:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782c800/0x96d0c9b8c9a1db46 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393906:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1db7e lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393912:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1db7e lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393917:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1db7e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393922:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782de00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201389.393925:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1db7e lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393930:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1db7e lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393937:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x2c9ecea3 (ffff8dc0084fbf00) 00010000:00010000:3.0:1788201389.393939:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.393942:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1db7e lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393948:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00782de00/0x96d0c9b8c9a1db7e lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393970:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1dbb6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393976:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1dbb6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393981:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1dbb6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393985:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ece00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201389.393988:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1dbb6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.393993:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1dbb6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.394001:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x88f15ca3 (ffff8dc103b47700) 00010000:00010000:3.0:1788201389.394003:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.394006:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1dbb6 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.394011:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1dbb6 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201389.394304:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715355136:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201389.394367:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201389.394398:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715355648:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201389.394417:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201389.394438:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201389.394444:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715355264:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201389.394463:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201389.394479:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715355776:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201389.394499:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201389.394532:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715355136 00000100:00100000:1.0:1788201389.394540:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715355136 00000100:00100000:1.0:1788201389.394593:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715355648 00000100:00100000:1.0:1788201389.394597:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715355648 00000100:00100000:1.0:1788201389.394607:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715355264 00000100:00100000:1.0:1788201389.394610:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715355264 00000100:00100000:1.0:1788201389.394617:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715355776 00000100:00100000:1.0:1788201389.394620:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715355776 00000100:00100000:1.0:1788201389.394631:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788201389.394638:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3655:x1875060715355136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201389.394664:0:99764:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:910 count 1 00000100:00100000:1.0:1788201389.394808:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788201389.394815:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3655:x1875060715355648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201389.394827:0:99766:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:906 count 1 00000100:00080000:1.0:1788201389.394890:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788201389.394999:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1dbee lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395008:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1dbee lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395055:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1dbee lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395068:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201389.395071:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1dbee lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395077:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1dbee lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395086:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8545ca3 (ffff8dc108994f00) 00010000:00010000:3.0:1788201389.395089:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.395092:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1dbee lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395097:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1dbee lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395113:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1dc0a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395118:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1dc0a lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395123:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1dc0a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395128:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064eca00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201389.395130:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1dc0a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395135:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1dc0a lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395151:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xc8d93425 (ffff8dc0084fb500) 00010000:00010000:3.0:1788201389.395153:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.395155:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1dc0a lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395160:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1dc0a lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xc8d93425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395175:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1dc42 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395181:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1dc42 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395186:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1dc42 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395190:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201389.395192:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1dc42 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395198:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1dc42 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395203:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x961c5ca3 (ffff8dc103b47200) 00010000:00010000:3.0:1788201389.395205:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.395208:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1dc42 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395213:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1dc42 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395253:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1dc7a lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395260:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1dc7a lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395265:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1dc7a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395269:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201389.395272:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1dc7a lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395277:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1dc7a lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395285:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0x3c635ca3 (ffff8dc0084fbb00) 00010000:00010000:3.0:1788201389.395287:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.395290:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1dc7a lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395294:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1dc7a lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395306:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1dcb2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395310:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1dcb2 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395315:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1dcb2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395325:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201389.395328:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1dcb2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395333:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1dcb2 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395341:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x4:0x0].0xe2aa5ca3 (ffff8dc108994400) 00010000:00010000:3.0:1788201389.395343:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.395345:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1dcb2 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395351:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1dcb2 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395365:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1dcce lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395371:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1dcce lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395377:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1dcce lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395381:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201389.395384:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1dcce lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395389:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1dcce lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395407:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff8dc108994c00) 00010000:00010000:3.0:1788201389.395410:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201389.395413:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1dcce lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.395419:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1dcce lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201389.395759:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715355008:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201389.395806:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201389.395843:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715355520:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201389.395862:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201389.395886:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788201389.395891:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715355392:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201389.395909:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201389.395916:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715355904:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201389.395929:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201389.396465:0:99767:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788201389.396474:0:99767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00010000:1.0:1788201389.396755:0:99766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38a:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:1.0:1788201389.396765:0:99766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000847d8716/0x96d0c9b8c9a1dcdc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.396779:0:99766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38a:0x0].0x0 since=4240s v=(0 0) 00010000:00010000:1.0:1788201389.396784:0:99766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201389.396790:0:99766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000847d8716/0x96d0c9b8c9a1dcdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.396805:0:99766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000847d8716/0x96d0c9b8c9a1dcdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.396815:0:99766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000847d8716/0x96d0c9b8c9a1dcdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.396822:0:99766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000847d8716/0x96d0c9b8c9a1dcdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.396838:0:99766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201389.397000:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3655:x1875060715355648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2183us (2580us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788201389.397136:0:100688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788201389.397146:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715355008 00000100:00100000:3.0:1788201389.397152:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715355008 00000100:00100000:3.0:1788201389.397179:0:100688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788201389.397184:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715355520 00000100:00100000:3.0:1788201389.397186:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715355520 00000100:00100000:3.0:1788201389.397194:0:100688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788201389.397198:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715355392 00000100:00100000:3.0:1788201389.397200:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715355392 00000100:00100000:3.0:1788201389.397208:0:100688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788201389.397211:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715355904 00000100:00100000:3.0:1788201389.397213:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715355904 00000100:00100000:1.0:1788201389.397682:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788201389.397705:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788201389.397713:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3655:x1875060715355264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201389.397749:0:99766:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:905 count 1 00000004:00080000:1.0:1788201389.397908:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dc005d52300/2, rc 0, transno 12884901889 00000100:00100000:1.0:1788201389.397919:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715355648:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201389.398042:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788201389.398049:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3655:x1875060715355776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201389.398061:0:101188:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:911 count 1 00010000:00010000:2.0:1788201389.398178:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201389.398186:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000847d8716/0x96d0c9b8c9a1dcdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.398196:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201389.398200:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000847d8716/0x96d0c9b8c9a1dcdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.398209:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000847d8716/0x96d0c9b8c9a1dcdc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.398230:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000847d8716/0x96d0c9b8c9a1dcdc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.398237:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000847d8716/0x96d0c9b8c9a1dcdc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.398279:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201389.398282:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201389.398283:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201389.398349:0:99764:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38e:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:2.0:1788201389.398355:0:99764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b1b722d/0x96d0c9b8c9a1dce3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.398365:0:99764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38e:0x0].0x0 since=4240s v=(0 0) 00010000:00010000:2.0:1788201389.398370:0:99764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201389.398376:0:99764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b1b722d/0x96d0c9b8c9a1dce3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.398385:0:99764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b1b722d/0x96d0c9b8c9a1dce3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.398399:0:99764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b1b722d/0x96d0c9b8c9a1dce3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.398406:0:99764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b1b722d/0x96d0c9b8c9a1dce3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.398425:0:99764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201389.398563:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3655:x1875060715355136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3924us (4195us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788201389.398570:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201389.398592:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788201389.398599:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3658:x1875060715355008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201389.398611:0:99764:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:912 count 1 00000004:00080000:2.0:1788201389.398689:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dc005d5ad80/2, rc 0, transno 12884901890 00000100:00100000:2.0:1788201389.398695:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715355136:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201389.399847:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201389.399866:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715356160:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788201389.399922:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201389.399972:0:100688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:0.0:1788201389.399980:0:100688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_005' 00000100:00100000:0.0:1788201389.400119:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715356160 00000100:00100000:0.0:1788201389.400125:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715356160 00000100:00100000:0.0:1788201389.400229:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788201389.400250:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3658:x1875060715355520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201389.400273:0:101189:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:901 count 1 00000100:00100000:2.0:1788201389.400856:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201389.400868:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715356032:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788201389.400909:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201389.400956:0:100688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 6 min 3 max 116 00000100:00100000:2.0:1788201389.400962:0:100688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_006' 00000100:00100000:2.0:1788201389.401057:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715356032 00000100:00100000:2.0:1788201389.401061:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715356032 00000100:00100000:2.0:1788201389.401137:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788201389.401146:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3658:x1875060715355392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201389.401162:0:101191:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:903 count 1 00010000:00010000:1.0:1788201389.401502:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201389.401511:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b1b722d/0x96d0c9b8c9a1dce3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.401523:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201389.401528:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b1b722d/0x96d0c9b8c9a1dce3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.401537:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b1b722d/0x96d0c9b8c9a1dce3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201389.401744:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x385:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:0.0:1788201389.401752:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1dcea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.401764:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x385:0x0].0x0 since=4240s v=(0 0) 00010000:00010000:0.0:1788201389.401768:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x385:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201389.401775:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1dcea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.401789:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1dcea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.401798:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1dcea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.401813:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1dcea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.401831:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201389.401841:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201389.401846:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1dcea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.401853:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201389.401857:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1dcea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.401865:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1dcea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.401882:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1dcea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.401890:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1dcea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.401906:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.401908:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201389.401910:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201389.402103:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3658:x1875060715355520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1864us (6236us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1788201389.402118:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788201389.402143:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788201389.402151:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3658:x1875060715355904:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788201389.402168:0:101189:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:909 count 1 00010000:00010000:1.0:1788201389.402662:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b1b722d/0x96d0c9b8c9a1dce3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.402674:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b1b722d/0x96d0c9b8c9a1dce3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.402692:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.402694:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.402696:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201389.402766:0:99766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x389:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:1.0:1788201389.402773:0:99766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1dcf1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.402783:0:99766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x389:0x0].0x0 since=4240s v=(0 0) 00010000:00010000:1.0:1788201389.402787:0:99766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x389:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201389.402793:0:99766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1dcf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.402803:0:99766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1dcf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.402812:0:99766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1dcf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.402820:0:99766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1dcf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.402834:0:99766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201389.402940:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3655:x1875060715355264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5227us (8474us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1788201389.402948:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788201389.402970:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201389.402978:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3656:x1875060715356160:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201389.402993:0:99766:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:899 count 1 00000004:00080000:1.0:1788201389.403252:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dc005d59c00/2, rc 0, transno 12884901892 00000100:00100000:1.0:1788201389.403265:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715355264:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201389.403340:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715356288:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201389.403375:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201389.403410:0:100688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 7 min 3 max 116 00000100:00100000:1.0:1788201389.403418:0:100688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_007' 00000004:00080000:2.0:1788201389.404152:0:3658:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dc005d53800/2, rc 0, transno 12884901891 00000100:00100000:2.0:1788201389.404163:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715355520:0@lo:6:osp-syn-0-0.0 00002000:00010000:2.0:1788201389.404231:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38f:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:2.0:1788201389.404238:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1dcf8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.404262:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38f:0x0].0x0 since=4240s v=(0 0) 00010000:00010000:2.0:1788201389.404265:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201389.404271:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1dcf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.404286:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1dcf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.404303:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1dcf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.404310:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1dcf8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.404325:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201389.404327:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201389.404332:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201389.404334:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1dcf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.404336:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1dcf8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.404343:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbca00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201389.404343:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064eda00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201389.404348:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1dcf8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.404348:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1dcf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.404358:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1dcf8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.404359:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1dcf1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.404373:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1dcf8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.404379:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1dcf8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.404381:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1dcf1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.404388:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1dcf1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.404394:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201389.404400:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201389.404401:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201389.404403:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201389.404404:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201389.404406:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201389.404460:0:99764:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x390:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:3.0:1788201389.404465:0:99764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1dcff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.404473:0:99764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x390:0x0].0x0 since=4240s v=(0 0) 00010000:00010000:3.0:1788201389.404475:0:99764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x390:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201389.404479:0:99764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1dcff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.404487:0:99764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1dcff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.404494:0:99764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1dcff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.404500:0:99764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1dcff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.404513:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3655:x1875060715355776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6465us (10013us total) trans 12884901893 rc 0/0 00010000:00010000:3.0:1788201389.404519:0:99764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201389.404522:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788201389.404541:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715356288 00000100:00100000:2.0:1788201389.404547:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715356288 00000100:00100000:2.0:1788201389.404584:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788201389.404593:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10981ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3657:x1875060715356032:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201389.404594:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3658:x1875060715355008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5996us (8788us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1788201389.404600:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00002000:00080000:2.0:1788201389.404612:0:99767:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:904 count 1 00000100:00100000:3.0:1788201389.404614:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788201389.404619:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3656:x1875060715356288:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201389.404628:0:99764:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:917 count 1 00010000:00010000:3.0:1788201389.404698:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201389.404703:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1dcff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.404711:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201389.404714:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1dcff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.404722:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1dcff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.404732:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1dcff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.404738:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1dcff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.404751:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201389.404758:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201389.404760:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788201389.404779:0:3658:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dc005d5b480/2, rc 0, transno 12884901894 00000100:00100000:3.0:1788201389.404785:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715355008:0@lo:6:osp-syn-0-0.0 00002000:00010000:2.0:1788201389.406569:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38d:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:2.0:1788201389.406579:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1dd06 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.406592:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38d:0x0].0x0 since=4240s v=(0 0) 00010000:00010000:2.0:1788201389.406597:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201389.406602:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1dd06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.406615:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1dd06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.406624:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1dd06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.406633:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1dd06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.406658:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201389.406976:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715356416:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201389.407374:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201389.407411:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201389.407416:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715356544:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201389.407441:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201389.407468:0:100688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 7 min 3 max 116 00000100:00100000:1.0:1788201389.407476:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715356416 00000100:00100000:1.0:1788201389.407480:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715356416 00000100:00100000:1.0:1788201389.407504:0:100688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 7 min 3 max 116 00000100:00100000:1.0:1788201389.407508:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715356544 00000100:00100000:1.0:1788201389.407509:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715356544 00000004:00080000:1.0:1788201389.407539:0:3655:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dc005d53b80/2, rc 0, transno 12884901893 00000100:00100000:1.0:1788201389.407548:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715355776:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201389.407579:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201389.407585:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715356672:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201389.407605:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201389.407621:0:100688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 7 min 3 max 116 00000100:00100000:1.0:1788201389.407625:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715356672 00000100:00100000:1.0:1788201389.407627:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715356672 00010000:00010000:1.0:1788201389.407642:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201389.407648:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1dd06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.407657:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201389.407668:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1dd06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.407677:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1dd06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.407694:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1dd06 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.407702:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1dd06 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.407721:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.407723:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.407724:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201389.407774:0:99766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x383:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:1.0:1788201389.407792:0:99766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1dd0d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.407801:0:99766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x383:0x0].0x0 since=4240s v=(0 0) 00010000:00010000:1.0:1788201389.407806:0:99766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x383:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201389.407810:0:99766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1dd0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.407820:0:99766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1dd0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.407838:0:99766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1dd0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.407845:0:99766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1dd0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.407859:0:99766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788201389.407941:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3656:x1875060715356160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4963us (8018us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1788201389.407948:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201389.407966:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788201389.407973:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007159180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3657:x1875060715356416:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201389.407992:0:99766:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:898 count 1 00000100:00100000:2.0:1788201389.409304:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3658:x1875060715355904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7150us (13369us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788201389.409316:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788201389.409339:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788201389.409349:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3657:x1875060715356544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201389.409366:0:101189:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:902 count 1 00002000:00010000:2.0:1788201389.410688:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x386:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:2.0:1788201389.410698:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1dd14 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.410713:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x386:0x0].0x0 since=4240s v=(0 0) 00010000:00010000:2.0:1788201389.410718:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x386:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201389.410723:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1dd14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.410735:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1dd14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.410744:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1dd14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.410751:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1dd14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.410796:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788201389.410969:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3657:x1875060715356544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1620us (3524us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1788201389.410978:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788201389.411406:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788201389.411418:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3656:x1875060715356672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201389.411439:0:101189:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:907 count 1 00000004:00080000:1.0:1788201389.411764:0:3657:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dc00715aa00/2, rc 0, transno 12884901897 00000100:00100000:1.0:1788201389.411777:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715356544:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788201389.411810:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201389.411817:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1dd0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.411826:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064edc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201389.411830:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1dd0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.411839:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1dd0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.411865:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1dd0d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.411872:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1dd0d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.411892:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201389.411896:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1dd14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.411902:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbce00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201389.411905:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1dd14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.411912:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1dd14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.411922:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1dd14 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.411928:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1dd14 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.411945:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.411946:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.411954:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788201389.411994:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dc120091500/2, rc 0, transno 12884901896 00000100:00100000:1.0:1788201389.412000:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715356160:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201389.412435:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715356800:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201389.412484:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201389.412528:0:100688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 7 min 3 max 116 00000100:00100000:1.0:1788201389.412537:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715356800 00000100:00100000:1.0:1788201389.412542:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715356800 00000100:00100000:1.0:1788201389.412586:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715356928:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201389.412610:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201389.412632:0:100688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 7 min 3 max 116 00000100:00100000:1.0:1788201389.412637:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715356928 00000100:00100000:1.0:1788201389.412640:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715356928 00002000:00010000:3.0:1788201389.412747:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x388:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:3.0:1788201389.412755:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1dd1b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.412766:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x388:0x0].0x0 since=4240s v=(0 0) 00010000:00010000:3.0:1788201389.412770:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x388:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201389.412776:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1dd1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.412787:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1dd1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.412796:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1dd1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.412804:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1dd1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.412820:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201389.412981:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38b:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:2.0:1788201389.412988:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1dd22 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201389.412990:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10981ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3657:x1875060715356032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8398us (12080us total) trans 12884901898 rc 0/0 00010000:00010000:2.0:1788201389.412996:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38b:0x0].0x0 since=4240s v=(0 0) 00000100:00100000:3.0:1788201389.412998:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788201389.412999:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38b:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1788201389.413035:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788201389.413051:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3656:x1875060715356800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201389.413069:0:99767:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:900 count 1 00000004:00080000:3.0:1788201389.413160:0:3658:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dc005d50e00/2, rc 0, transno 12884901895 00000100:00100000:3.0:1788201389.413176:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715355904:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788201389.413189:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201389.413193:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1dd1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.413200:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201389.413204:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1dd1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.413212:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1dd1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.413225:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1dd1b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.413231:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1dd1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.413255:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201389.413256:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201389.413258:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201389.413299:0:99764:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x395:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:3.0:1788201389.413305:0:99764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002723d596/0x96d0c9b8c9a1dd29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.413318:0:99764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x395:0x0].0x0 since=4240s v=(0 0) 00010000:00010000:3.0:1788201389.413321:0:99764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x395:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201389.413325:0:99764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002723d596/0x96d0c9b8c9a1dd29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.413335:0:99764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002723d596/0x96d0c9b8c9a1dd29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.413343:0:99764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002723d596/0x96d0c9b8c9a1dd29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.413350:0:99764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002723d596/0x96d0c9b8c9a1dd29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.413366:0:99764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201389.413928:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3656:x1875060715356288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9306us (10550us total) trans 12884901899 rc 0/0 00000100:00100000:3.0:1788201389.413934:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788201389.413953:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788201389.413961:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3657:x1875060715356928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788201389.413977:0:99764:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:913 count 1 00010000:00010000:3.0:1788201389.414076:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201389.414082:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002723d596/0x96d0c9b8c9a1dd29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.414102:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201389.414106:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002723d596/0x96d0c9b8c9a1dd29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.414115:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002723d596/0x96d0c9b8c9a1dd29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.414127:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002723d596/0x96d0c9b8c9a1dd29 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.414133:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002723d596/0x96d0c9b8c9a1dd29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.414148:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201389.414150:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201389.414151:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201389.414224:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x384:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:3.0:1788201389.414230:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1dd30 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.414238:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x384:0x0].0x0 since=4240s v=(0 0) 00010000:00010000:3.0:1788201389.414251:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x384:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201389.414255:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1dd30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.414275:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1dd30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.414283:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1dd30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.414290:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1dd30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.414303:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201389.414365:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3656:x1875060715356800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1315us (1881us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1788201389.414371:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1788201389.414388:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201389.414393:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1dd30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.414400:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201389.414403:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1dd30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.414411:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1dd30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.414506:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1dd30 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.414518:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1dd30 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.414533:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201389.414534:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201389.414536:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788201389.414565:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dc007159500/2, rc 0, transno 12884901900 00000100:00100000:3.0:1788201389.414571:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715356800:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788201389.414581:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dc005d52d80/2, rc 0, transno 12884901899 00000100:00100000:3.0:1788201389.414584:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715356288:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788201389.414603:0:3657:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dc120090700/2, rc 0, transno 12884901898 00000100:00100000:3.0:1788201389.414607:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715356032:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788201389.414615:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201389.416960:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715357312:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201389.417046:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201389.417083:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201389.417089:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715357184:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201389.417111:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201389.417143:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715357312 00000100:00100000:1.0:1788201389.417149:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715357312 00000100:00100000:1.0:1788201389.417184:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715357184 00000100:00100000:1.0:1788201389.417187:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715357184 00000100:00100000:1.0:1788201389.417201:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788201389.417217:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3656:x1875060715357312:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201389.417238:0:99767:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:916 count 1 00000100:00100000:1.0:1788201389.417379:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788201389.417386:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3656:x1875060715357184:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201389.417400:0:100688:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:918 count 1 00010000:00010000:1.0:1788201389.417425:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1dd37 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.417448:0:100688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df038d52/0x96d0c9b8c9a1d813 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cbd expref: 5 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.417456:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x396:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1788201389.417461:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x396:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788201389.417466:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1dd37 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.417492:0:100688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000df038d52/0x96d0c9b8c9a1d813 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cbd expref: 5 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.417507:0:100688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000df038d52/0x96d0c9b8c9a1d813 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cbd expref: 5 pid: 99767 timeout: 4340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201389.417519:0:100688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:100688:1875060715357568:192.168.201.20@tcp:104: 00000100:00100000:1.0:1788201389.417580:0:100688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0058463c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201389.417690:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715357440:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201389.417714:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201389.417727:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201389.417731:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715357056:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201389.417745:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1788201389.417809:0:99766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x382:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:1.0:1788201389.417815:0:99766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1dd3e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.417828:0:99766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x382:0x0].0x0 since=4240s v=(0 0) 00010000:00010000:1.0:1788201389.417831:0:99766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x382:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201389.417837:0:99766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1dd3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.417849:0:99766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1dd3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.417858:0:99766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1dd3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.417867:0:99766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1dd3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.417882:0:99766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201389.417891:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201389.417897:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1dd3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.417903:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ece00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201389.417907:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1dd3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.417916:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1dd3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.417940:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1dd3e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.417948:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1dd3e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.417965:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.417967:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.417968:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201389.418107:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007159180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3657:x1875060715356416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10133us (10732us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1788201389.418114:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:1.0:1788201389.418148:0:3657:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dc007158380/2, rc 0, transno 12884901901 00000100:00100000:1.0:1788201389.418157:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715356416:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201389.418188:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201389.418194:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00388ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715357696:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788201389.418214:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201389.418232:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715357440 00000100:00100000:1.0:1788201389.418236:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715357440 00000100:00100000:1.0:1788201389.418262:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715357056 00000100:00100000:1.0:1788201389.418264:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715357056 00000100:00100000:1.0:1788201389.418271:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715357696 00000100:00100000:1.0:1788201389.418273:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715357696 00000100:00100000:1.0:1788201389.418283:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788201389.418289:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3657:x1875060715357440:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201389.418300:0:99766:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:915 count 1 00002000:00010000:1.0:1788201389.418396:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x387:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:1.0:1788201389.418402:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1dd45 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.418410:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x387:0x0].0x0 since=4240s v=(0 0) 00010000:00010000:1.0:1788201389.418413:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x387:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201389.418418:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1dd45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.418427:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1dd45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.418435:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1dd45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.418442:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1dd45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.418455:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201389.418462:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201389.418466:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1dd45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.418472:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ede00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201389.418475:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1dd45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.418493:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1dd45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.418504:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1dd45 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.418511:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1dd45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.418523:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.418524:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.418526:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201389.418587:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3658:x1875060715355392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17442us (22677us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1788201389.418594:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788201389.418705:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788201389.418710:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3657:x1875060715357056:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788201389.418719:0:101191:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:908 count 1 00010000:00010000:2.0:1788201389.421810:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1dd22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.421832:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1dd22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.421843:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1dd22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.421851:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1dd22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.421888:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201389.422104:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3656:x1875060715356672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10684us (14492us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1788201389.422116:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788201389.422149:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788201389.422160:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3657:x1875060715357696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788201389.422185:0:101189:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:914 count 1 00000004:00080000:2.0:1788201389.422360:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dc00715b800/2, rc 0, transno 12884901903 00000100:00100000:2.0:1788201389.422368:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715356672:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788201389.422979:0:3658:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dc005d51180/2, rc 0, transno 12884901902 00000100:00100000:3.0:1788201389.422986:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715355392:0@lo:6:osp-syn-0-0.0 00002000:00010000:2.0:1788201389.423278:0:99764:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x391:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:2.0:1788201389.423285:0:99764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1dd4c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.423298:0:99764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x391:0x0].0x0 since=4240s v=(0 0) 00010000:00010000:2.0:1788201389.423303:0:99764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x391:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201389.423308:0:99764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1dd4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.423318:0:99764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1dd4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.423325:0:99764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1dd4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.423345:0:99764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1dd4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.423361:0:99764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788201389.423482:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3657:x1875060715356928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9521us (10870us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1788201389.423491:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:2.0:1788201389.423528:0:3657:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dc007159880/2, rc 0, transno 12884901904 00000100:00100000:2.0:1788201389.423533:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715356928:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788201389.423547:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201389.423552:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1dd22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.423560:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201389.423564:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1dd22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.423572:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1dd22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.423587:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1dd22 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.423594:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1dd22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.423622:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201389.423626:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1dd4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.423632:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbca00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201389.423635:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1dd4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.423642:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1dd4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.423652:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1dd4c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.423657:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1dd4c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.423666:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201389.423667:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201389.423669:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201389.423747:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x392:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:3.0:1788201389.423753:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001345303e/0x96d0c9b8c9a1dd53 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.423761:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x392:0x0].0x0 since=4240s v=(0 0) 00010000:00010000:3.0:1788201389.423764:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x392:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201389.423769:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001345303e/0x96d0c9b8c9a1dd53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.423804:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001345303e/0x96d0c9b8c9a1dd53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.423811:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001345303e/0x96d0c9b8c9a1dd53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.423817:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001345303e/0x96d0c9b8c9a1dd53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.423837:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201389.423913:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3657:x1875060715357696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1756us (5697us total) trans 12884901905 rc 0/0 00000100:00100000:3.0:1788201389.423920:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1788201389.424140:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201389.424145:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001345303e/0x96d0c9b8c9a1dd53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.424153:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201389.424162:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001345303e/0x96d0c9b8c9a1dd53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.424170:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001345303e/0x96d0c9b8c9a1dd53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.424181:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001345303e/0x96d0c9b8c9a1dd53 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.424189:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001345303e/0x96d0c9b8c9a1dd53 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.424203:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201389.424205:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201389.424206:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788201389.424225:0:3657:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dc00388ea00/2, rc 0, transno 12884901905 00000100:00100000:2.0:1788201389.424230:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00388ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715357696:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788201389.424534:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201389.424749:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x394:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:3.0:1788201389.424755:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1dd5a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.424764:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x394:0x0].0x0 since=4240s v=(0 0) 00010000:00010000:3.0:1788201389.424768:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x394:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201389.424772:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1dd5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.424793:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1dd5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.424814:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1dd5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.424821:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1dd5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.424834:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201389.424936:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3656:x1875060715357312:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7719us (7889us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1788201389.424944:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:1.0:1788201389.425565:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201389.425573:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1dd5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.425583:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201389.425586:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1dd5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.425607:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1dd5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.425623:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1dd5a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.425630:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1dd5a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201389.425649:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.425651:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201389.425653:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201389.425848:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38c:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:0.0:1788201389.425855:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1dd61 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.425865:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38c:0x0].0x0 since=4240s v=(0 0) 00010000:00010000:0.0:1788201389.425869:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201389.425874:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1dd61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.425884:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1dd61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.425892:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1dd61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.425901:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1dd61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201389.425925:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201389.426117:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201389.426123:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1dd61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.426130:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201389.426133:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1dd61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.426140:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1dd61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.426151:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1dd61 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.426158:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1dd61 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.426180:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201389.426181:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201389.426183:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201389.426289:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3657:x1875060715357056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7576us (8539us total) trans 12884901907 rc 0/0 00000100:00100000:0.0:1788201389.426306:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000004:00080000:3.0:1788201389.426388:0:3657:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dc007158000/2, rc 0, transno 12884901907 00000100:00100000:3.0:1788201389.426395:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715357056:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788201389.434453:0:100688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:100688:1875060715357568:192.168.201.20@tcp:104: 00010000:00010000:3.0:1788201389.434484:0:100688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1dd37 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201389.434835:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dc007158700/2, rc 0, transno 12884901906 00000100:00100000:2.0:1788201389.434844:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715357312:0@lo:6:osp-syn-0-0.0 00002000:00010000:2.0:1788201389.434936:0:99766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x393:0x0] initial LVB size: 1024, mtime: 0x6a95c921, atime: 0x6a95c916, ctime: 0x6a95c921, blocks: 0x8 00010000:00010000:2.0:1788201389.434943:0:99766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1dd68 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.434957:0:99766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x393:0x0].0x0 since=4240s v=(0 0) 00010000:00010000:2.0:1788201389.434961:0:99766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x393:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201389.434967:0:99766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1dd68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.434989:0:99766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1dd68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.435000:0:99766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1dd68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.435008:0:99766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1dd68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.435066:0:99766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201389.435255:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3657:x1875060715357440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16963us (17537us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1788201389.435265:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000004:00080000:2.0:1788201389.435303:0:3657:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dc00715b100/2, rc 0, transno 12884901908 00000100:00100000:2.0:1788201389.435308:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715357440:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788201389.435506:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201389.435513:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1dd68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.435522:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbce00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201389.435527:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1dd68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.435538:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1dd68 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.435570:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1dd68 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.435580:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1dd68 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201389.435606:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201389.435608:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201389.435610:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201389.435808:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201389.435984:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695521792 00000100:00100000:2.0:1788201389.435992:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695521792 00010000:00010000:2.0:1788201389.436074:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000df038d52/0x96d0c9b8c9a1d813 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cbd expref: 6 pid: 99767 timeout: 4340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201389.436107:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2624 00000100:00100000:2.0:1788201389.436117:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10a224c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695521792:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201389.436131:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201389.436137:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000df038d52/0x96d0c9b8c9a1d813 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cbd expref: 6 pid: 99767 timeout: 4340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.436156:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000df038d52/0x96d0c9b8c9a1d813 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cbd expref: 6 pid: 99767 timeout: 4340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.436171:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df038d52/0x96d0c9b8c9a1d813 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x396:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786cbd expref: 6 pid: 99767 timeout: 4340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.436182:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x396:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201389.436186:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x396:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788201389.436191:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1dd37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.436200:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1dd37 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x396:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.436223:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201389.436278:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10a224c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695521792:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 162us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201389.436285:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2624 00010000:00010000:2.0:1788201389.436410:0:100688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1dd37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.436420:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1dd37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.436429:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1dd37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.436443:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1dd37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.436461:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201389.436594:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3656:x1875060715357184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19207us (19481us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1788201389.436602:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1788201389.436622:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201389.436627:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1dd37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.436635:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201389.436639:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1dd37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.436649:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1dd37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.436661:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1dd37 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.436668:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1dd37 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201389.436685:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201389.436693:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201389.436695:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788201389.436724:0:3656:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dc007159f80/2, rc 0, transno 12884901909 00000100:00100000:2.0:1788201389.436730:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715357184:0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1788201389.436820:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788201389.840649:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201389.903869:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715357824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201389.903950:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201389.904163:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715357824 00000100:00100000:0.0:1788201389.904172:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715357824 00000100:00100000:0.0:1788201389.904262:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201389.904274:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715357824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201389.904303:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788201389.904360:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715357824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201389.904368:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788201389.904689:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788201389.906884:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc120090380 x1875060715357824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201389.906912:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715357824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201389.908820:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00388d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715357952:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201389.908891:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201389.909786:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715357952 00000100:00100000:0.0:1788201389.909796:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715357952 00000100:00100000:0.0:1788201389.909881:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201389.909894:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715357952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201389.909923:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788201389.909999:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715357952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201389.910007:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788201389.910162:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788201389.910318:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc00388d500 x1875060715357952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201389.910338:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00388d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715357952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201390.424132:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201390.431715:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715358080:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201390.432158:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201390.432293:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715358080 00000100:00100000:0.0:1788201390.432302:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715358080 00000100:00100000:0.0:1788201390.432362:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788201390.432371:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715358080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201390.432406:0:66317:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:0.0:1788201390.432465:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715358080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201390.432472:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788201390.432595:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715358080:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788201390.863483:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201390.927316:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715358208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201390.927387:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201390.927430:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715358208 00000100:00100000:3.0:1788201390.927446:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715358336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201390.927448:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715358208 00000100:00100000:3.0:1788201390.927482:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201390.927506:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788201390.927518:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715358208:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201390.927530:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715358336 00000100:00100000:3.0:1788201390.927535:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715358336 00000004:00000024:0.0:1788201390.927563:0:66317:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444937728 avail 1298698240 00000100:00100000:3.0:1788201390.927576:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788201390.927585:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715358336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201390.927606:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201390.927635:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715358208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201390.927644:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788201390.927652:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715358336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201390.927665:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788201390.927689:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201390.927701:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715358208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201390.927718:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715358336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201390.928001:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715358464:0@lo:400:kworker.0 00000100:00100000:0.0:1788201390.928058:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201390.928090:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715358976:0@lo:400:kworker.0 00000100:00100000:0.0:1788201390.928120:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201390.928136:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715359488:0@lo:400:kworker.0 00000100:00100000:0.0:1788201390.928158:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201390.928178:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788201390.928185:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715358848:0@lo:400:kworker.0 00000100:00100000:0.0:1788201390.928208:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201390.928241:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715359360:0@lo:400:kworker.0 00000100:00100000:0.0:1788201390.928264:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201390.928296:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715358464 00000100:00100000:0.0:1788201390.928300:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715358464 00000100:00100000:0.0:1788201390.928339:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788201390.928347:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715358464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201390.928389:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715358464:12345-0@lo:400:kworker.0 Request processed in 43us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201390.928406:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788201390.928440:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715359488 00000100:00100000:0.0:1788201390.928444:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715359488 00000100:00100000:0.0:1788201390.928483:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715359360 00000100:00100000:0.0:1788201390.928487:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715359360 00000100:00100000:0.0:1788201390.928515:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1703 00000100:00100000:0.0:1788201390.928641:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715359488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201390.928682:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715359488:12345-0@lo:400:kworker.0 Request processed in 160us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201390.928689:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1703 00000100:00100000:0.0:1788201390.928709:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1704 00000100:00100000:0.0:1788201390.928716:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715359360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201390.928746:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715359360:12345-0@lo:400:kworker.0 Request processed in 31us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201390.928751:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1704 00000100:00100000:0.0:1788201390.928790:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715358592:0@lo:400:kworker.0 00000100:00100000:0.0:1788201390.928820:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201390.928843:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715359104:0@lo:400:kworker.0 00000100:00100000:0.0:1788201390.928873:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201390.928900:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715359616:0@lo:400:kworker.0 00000100:00100000:0.0:1788201390.928929:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201390.928952:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788201390.928960:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715358720:0@lo:400:kworker.0 00000100:00100000:0.0:1788201390.928987:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201390.929008:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715359232:0@lo:400:kworker.0 00000100:00100000:0.0:1788201390.929073:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201390.929096:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715359744:0@lo:400:kworker.0 00000100:00100000:0.0:1788201390.929121:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201390.929147:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715358976 00000100:00100000:0.0:1788201390.929151:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715358976 00000100:00100000:0.0:1788201390.929176:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715358592 00000100:00100000:0.0:1788201390.929180:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715358592 00000100:00100000:0.0:1788201390.929196:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715359104 00000100:00100000:0.0:1788201390.929199:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715359104 00000100:00100000:0.0:1788201390.929233:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788201390.929241:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3656:x1875060715358976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201390.929277:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3656:x1875060715358976:12345-0@lo:400:kworker.0 Request processed in 38us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201390.929284:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788201390.929298:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201390.929305:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715358592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201390.929339:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715358592:12345-0@lo:400:kworker.0 Request processed in 36us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201390.929345:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201390.929357:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201390.929363:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715359104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201390.929393:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715359104:12345-0@lo:400:kworker.0 Request processed in 31us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201390.929399:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201390.929418:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715359616 00000100:00100000:0.0:1788201390.929421:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715359616 00000100:00100000:0.0:1788201390.929446:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715358720 00000100:00100000:0.0:1788201390.929456:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715358720 00000100:00100000:0.0:1788201390.929472:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715359232 00000100:00100000:0.0:1788201390.929474:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715359232 00000100:00100000:0.0:1788201390.929487:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715359744 00000100:00100000:0.0:1788201390.929489:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715359744 00000100:00100000:0.0:1788201390.929504:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1705 00000100:00100000:0.0:1788201390.929509:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715359616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201390.930245:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715359872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201390.930286:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201390.930325:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715359872 00000100:00100000:3.0:1788201390.930329:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715359872 00000100:00100000:3.0:1788201390.930360:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788201390.930368:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+26:3655:x1875060715359872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201390.930383:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201390.930421:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+26:3655:x1875060715359872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201390.930427:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788201390.930480:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715359872:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788201390.933207:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201390.933228:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201390.933252:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715358848 00000100:00100000:1.0:1788201390.933259:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715358848 00000100:00100000:1.0:1788201390.933304:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788201390.933313:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715358848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201390.935349:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715359616:12345-0@lo:400:kworker.0 Request processed in 5833us (6413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201390.935362:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1705 00000100:00100000:0.0:1788201390.935412:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1706 00000100:00100000:0.0:1788201390.935420:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715358720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201390.935469:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715358720:12345-0@lo:400:kworker.0 Request processed in 52us (6483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201390.935473:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1706 00000100:00100000:0.0:1788201390.935482:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1707 00000100:00100000:0.0:1788201390.935487:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715359232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201390.935513:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715359232:12345-0@lo:400:kworker.0 Request processed in 26us (6441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201390.935519:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1707 00000100:00100000:0.0:1788201390.936137:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1708 00000100:00100000:0.0:1788201390.936147:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715359744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201390.936188:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715359744:12345-0@lo:400:kworker.0 Request processed in 45us (7066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201390.936194:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1708 00000100:00100000:0.0:1788201390.936258:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715358720:0@lo:400:kworker.0 00000100:00100000:0.0:1788201390.936285:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715359232:0@lo:400:kworker.0 00000100:00100000:0.0:1788201390.936295:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715359744:0@lo:400:kworker.0 00010000:00080000:0.0:1788201390.936309:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc120090380 x1875060715358592/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201390.936319:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715358592:0@lo:400:kworker.0 00010000:00080000:0.0:1788201390.936331:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc120091880 x1875060715359104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201390.936339:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715359104:0@lo:400:kworker.0 00000100:00100000:0.0:1788201390.936354:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715359616:0@lo:400:kworker.0 00000100:00100000:1.0:1788201390.936974:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715358848:12345-0@lo:400:kworker.0 Request processed in 3659us (8762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201390.936984:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788201390.937266:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715358848:0@lo:400:kworker.0 00000100:00100000:1.0:1788201390.937281:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715359360:0@lo:400:kworker.0 00000100:00100000:1.0:1788201390.937291:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715358464:0@lo:400:kworker.0 00000100:00100000:1.0:1788201390.937303:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715358976:0@lo:400:kworker.0 00000100:00100000:1.0:1788201390.937315:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715359488:0@lo:400:kworker.0 00000001:02000400:3.0:1788201391.179575:0:101236:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 136: MDS to disconnect all OSPs first, then cleanup ldlm ========================================================== 14:36:29 (1788201389) 00010000:00010000:3.0:1788201391.891400:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201392.089283:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201392.089328:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201392.089362:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201392.089384:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201392.089404:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201392.089537:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695522176 00000100:00100000:0.0:1788201392.089548:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695522176 00000100:00100000:0.0:1788201392.089622:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695522048 00000100:00100000:0.0:1788201392.089626:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695522048 00000100:00100000:0.0:1788201392.089652:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1709 00000100:00100000:0.0:1788201392.089663:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695522176:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201392.089734:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2403:x1875060695522176:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 73us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201392.089742:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1709 00000100:00100000:0.0:1788201392.089762:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1710 00000100:00100000:0.0:1788201392.089768:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2403:x1875060695522048:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201392.089791:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2403:x1875060695522048:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201392.089798:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1710 00000100:00100000:2.0:1788201392.089922:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695522432 00000100:00100000:2.0:1788201392.089926:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695522432 00000100:00100000:2.0:1788201392.089963:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695522304 00000100:00100000:2.0:1788201392.089966:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695522304 00000100:00100000:2.0:1788201392.089986:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:2.0:1788201392.089994:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695522432:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201392.090062:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695522432:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 69us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201392.090069:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:2.0:1788201392.090083:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:2.0:1788201392.090090:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695522304:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201392.090114:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695522304:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201392.090120:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:3.0:1788201392.090438:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695521920 00000100:00100000:3.0:1788201392.090444:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695521920 00000100:00100000:3.0:1788201392.090488:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 337 00000100:00100000:3.0:1788201392.090496:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695521920:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201392.090525:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695521920:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 30us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201392.090531:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 337 00000100:00080000:1.0:1788201392.090645:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201392.090649:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201392.090652:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201392.090654:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788201392.911476:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201392.961951:0:101284:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_136 needs > 2 MDTs 00010000:00010000:1.0:1788201393.935654:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201394.959818:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201395.025348:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201395.025373:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00388c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715360000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201395.025441:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201395.025506:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715360000 00000100:00100000:1.0:1788201395.025513:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715360000 00000100:00100000:1.0:1788201395.025575:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788201395.025584:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715360000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201395.025612:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201395.025655:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715360000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201395.025662:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788201395.025682:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788201395.025711:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc00388c000 x1875060715360000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201395.025729:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00388c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715360000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201395.026842:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715360128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201395.026889:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201395.027293:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715360128 00000100:00100000:2.0:1788201395.027301:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715360128 00000100:00100000:2.0:1788201395.027355:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788201395.027364:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715360128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201395.027381:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201395.027432:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715360128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201395.027440:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788201395.027528:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788201395.027583:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc13a91d880 x1875060715360128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201395.027600:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715360128:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788201395.092788:0:101332:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 137a: DNE: create under striped dir, fail MDT1 ========================================================== 14:36:33 (1788201393) 00000100:00100000:3.0:1788201395.504390:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201395.504570:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695522560 00000100:00100000:1.0:1788201395.504581:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695522560 00000100:00100000:1.0:1788201395.504700:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1665 00000100:00100000:1.0:1788201395.504712:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:76261:x1875060695522560:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:1.0:1788201395.504734:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201395.504756:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dd6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786d65 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.504823:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dd76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.504840:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dd76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.504852:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dd76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201395.504923:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788201395.504927:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201395.504949:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dd76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.504972:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1dd6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d65 expref: 11 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.504990:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dd76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d65 expref: 10 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.504999:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:1.0:1788201395.505003:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201395.505006:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ecc00, rc 0) 00000100:00100000:1.0:1788201395.505101:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:76261:x1875060695522560:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 392us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201395.505108:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1665 00000100:00080000:2.0:1788201395.505688:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201395.510672:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201395.510756:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695522816 00000100:00100000:0.0:1788201395.510764:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695522816 00000100:00100000:0.0:1788201395.510828:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1666 00000100:00100000:0.0:1788201395.510835:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:76261:x1875060695522816:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:0.0:1788201395.510852:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201395.510869:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1dd7d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786d6c expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201395.510971:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715360256:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201395.511012:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201395.511059:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715360256 00000100:00100000:0.0:1788201395.511064:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038e00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201395.511064:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715360256 00000100:00100000:3.0:1788201395.511093:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788201395.511099:0:66317:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788201395.511099:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:66313:x1875060715360256:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201395.511105:0:66317:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788201395.511178:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:66313:x1875060715360256:12345-0@lo:1000:mdt00_001.0 Request processed in 78us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201395.511185:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788201395.511293:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715360256:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201395.511336:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715360384:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201395.511358:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201395.511374:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038e00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201395.511384:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715360384 00000100:00100000:0.0:1788201395.511387:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715360384 00000100:00100000:0.0:1788201395.511405:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788201395.511412:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:66313:x1875060715360384:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201395.511505:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:66313:x1875060715360384:12345-0@lo:1000:mdt00_001.0 Request processed in 93us (146us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201395.511512:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788201395.511539:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715360384:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788201395.511581:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc108c75a00/0x96d0c9b8c9a1dd84 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201395.511590:0:66313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc108c75a00/0x96d0c9b8c9a1dd84 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201395.511598:0:66313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc108c75a00/0x96d0c9b8c9a1dd84 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201395.511610:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715360512:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1788201395.511636:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201395.511662:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc00745dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201395.511739:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715360512 00000100:00080000:2.0:1788201395.511741:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201395.511743:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715360512 00000100:00100000:3.0:1788201395.511776:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788201395.511783:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:66313:x1875060715360512:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1788201395.511791:0:101344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201395.511803:0:101344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1dd8b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1dd84 expref: -99 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201395.511825:0:101344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dd76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d65 expref: 9 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201395.511840:0:101344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1dd8b lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1dd84 expref: 8 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201395.511863:0:101344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dd76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d65 expref: 9 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201395.511876:0:101344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dd76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d65 expref: 9 pid: 66314 timeout: 4346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201395.511886:0:101344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:101344:1875060715360640:192.168.201.20@tcp:104: 00000100:00100000:3.0:1788201395.511962:0:101344:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc00745d180 going to sleep for 11 seconds 00000100:00100000:1.0:1788201395.514638:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201395.514742:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695522944 00000100:00100000:2.0:1788201395.514751:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695522944 00010000:00010000:2.0:1788201395.514786:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dd76 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d65 expref: 10 pid: 66314 timeout: 4346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201395.514833:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2625 00000100:00100000:2.0:1788201395.514842:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2401:x1875060695522944:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201395.514854:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201395.514860:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dd76 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d65 expref: 10 pid: 66314 timeout: 4346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201395.514873:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dd76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d65 expref: 10 pid: 66314 timeout: 4346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201395.514892:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:2.0:1788201395.514905:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1dd8b lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1dd84 expref: 8 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201395.514932:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1dd8b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x96d0c9b8c9a1dd84 expref: 8 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201395.514941:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1dd8b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x96d0c9b8c9a1dd84 expref: 8 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201395.514973:0:6517:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1dd8b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1dd84 expref: 8 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201395.514986:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6517:1875060715360768:0@lo:105: 00000100:00100000:2.0:1788201395.515171:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201395.515231:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0010eb900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201395.515296:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715360768 00000100:00100000:1.0:1788201395.515301:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715360768 00000100:00100000:1.0:1788201395.515334:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1788201395.515342:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6517:x1875060715360768:12345-0@lo:105: 00010000:00010000:1.0:1788201395.515352:0:6515:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc108c75a00/0x96d0c9b8c9a1dd84 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1dd8b expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.515361:0:6515:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc108c75a00/0x96d0c9b8c9a1dd84 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1dd8b expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.515376:0:6515:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc108c75a00/0x96d0c9b8c9a1dd84 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1dd8b expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.515384:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc108c75a00/0x96d0c9b8c9a1dd84 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x96d0c9b8c9a1dd8b expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.515391:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc108c75a00/0x96d0c9b8c9a1dd84 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x96d0c9b8c9a1dd8b expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.515400:0:6515:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc108c75a00/0x96d0c9b8c9a1dd84 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x96d0c9b8c9a1dd8b expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.515413:0:6515:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8dc108c75a00) 00000100:00100000:1.0:1788201395.515453:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6517:x1875060715360768:12345-0@lo:105: Request processed in 112us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201395.515460:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1788201395.515497:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6517:1875060715360768:0@lo:105: 00010000:00010000:1.0:1788201395.515511:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201395.515547:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2401:x1875060695522944:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 705us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201395.515554:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2625 00010000:00010000:3.0:1788201395.522803:0:101344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1dd76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d65 expref: 9 pid: 66314 timeout: 4346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201395.522829:0:101344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:101344:1875060715360640:192.168.201.20@tcp:104: 00010000:00010000:3.0:1788201395.522860:0:101344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1dd8b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1dd84 expref: 8 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201395.522871:0:101344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:3.0:1788201395.522874:0:101344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201395.522878:0:101344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c75400, rc 0) 00000100:00100000:3.0:1788201395.522964:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:66313:x1875060715360512:12345-0@lo:101:mdt00_001.0 Request processed in 11181us (11326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201395.522973:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788201395.523072:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715360512:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1788201395.523092:0:66313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc108c75a00/0x96d0c9b8c9a1dd84 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1dd8b expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201395.523112:0:66313:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1788201395.523166:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbd400/0x96d0c9b8c9a1dd92 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201395.523175:0:66313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbd400/0x96d0c9b8c9a1dd92 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201395.523184:0:66313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbd400/0x96d0c9b8c9a1dd92 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201395.523205:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715360896:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1788201395.523256:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201395.523293:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0010eb900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201395.523486:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715360896 00000100:00100000:0.0:1788201395.523494:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715360896 00000100:00100000:0.0:1788201395.523536:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788201395.523547:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:66313:x1875060715360896:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1788201395.523560:0:66318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201395.523571:0:66318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1dd99 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1dd92 expref: -99 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.523589:0:66318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1dd99 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1dd92 expref: 9 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.523598:0:66318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1dd99 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1dd92 expref: 9 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.523603:0:66318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc9f42202 (ffff8dc008723900) 00010000:00010000:0.0:1788201395.523605:0:66318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201395.523606:0:66318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59200, rc 0) 00000100:00100000:0.0:1788201395.523638:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715360896:12345-0@lo:101:mdt00_001.0 Request processed in 92us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201395.523642:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788201395.523722:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715360896:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1788201395.523730:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbd400/0x96d0c9b8c9a1dd92 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1dd99 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201395.523737:0:66313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbd400/0x96d0c9b8c9a1dd92 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1dd99 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201395.523747:0:66313:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1788201395.523772:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715361024:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788201395.523792:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201395.523809:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0010eb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201395.523828:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715361024 00000100:00100000:3.0:1788201395.523838:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715361024 00000100:00100000:3.0:1788201395.523870:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788201395.523877:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715361024:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788201395.523941:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715361024:12345-0@lo:1000:mdt00_001.0 Request processed in 64us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201395.523948:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788201395.523994:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715361024:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788201395.524054:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715361152:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788201395.524077:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201395.524094:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0010eb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201395.524143:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715361152 00000100:00100000:1.0:1788201395.524147:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715361152 00000100:00100000:1.0:1788201395.524185:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788201395.524192:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715361152:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201395.524519:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715361152:12345-0@lo:1000:mdt00_001.0 Request processed in 327us (440us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201395.524534:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788201395.524638:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715361152:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788201395.524711:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715361280:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788201395.524737:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201395.524814:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0010eb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201395.524975:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715361280 00000100:00100000:0.0:1788201395.524979:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715361280 00000100:00100000:0.0:1788201395.525148:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788201395.525156:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715361280:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201395.525233:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715361280:12345-0@lo:1000:mdt00_001.0 Request processed in 77us (494us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201395.525239:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788201395.525296:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715361280:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788201395.525343:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715361408:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788201395.525368:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201395.525510:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0010eb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201395.525611:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715361408 00000100:00100000:1.0:1788201395.525615:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715361408 00000100:00100000:1.0:1788201395.525638:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788201395.525644:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715361408:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201395.525703:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715361408:12345-0@lo:1000:mdt00_001.0 Request processed in 58us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201395.525709:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788201395.525776:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715361408:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788201395.525820:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715361536:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788201395.525843:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201395.525864:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0010eb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201395.525916:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715361536 00000100:00100000:1.0:1788201395.525920:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715361536 00000100:00100000:1.0:1788201395.525937:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788201395.525942:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715361536:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201395.526000:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715361536:12345-0@lo:1000:mdt00_001.0 Request processed in 57us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201395.526007:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788201395.526158:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715361536:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788201395.526196:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715361664:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788201395.526222:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201395.526243:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0010eb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201395.526290:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715361664 00000100:00100000:1.0:1788201395.526294:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715361664 00000100:00100000:1.0:1788201395.526313:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788201395.526318:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715361664:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201395.526374:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715361664:12345-0@lo:1000:mdt00_001.0 Request processed in 55us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201395.526380:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788201395.526441:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715361664:0@lo:1000:mdt00_001.0 00000040:00080000:2.0:1788201395.526902:0:66313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x1:0x0].10, 1000 off45240 00000040:00080000:2.0:1788201395.526956:0:66313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x1:0x0].9, 1152 off44408 00000004:00080000:2.0:1788201395.526963:0:66313:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc0010eb900 with version 24 00000004:00080000:1.0:1788201395.527245:0:75745:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc007566d80 version 24 rpc_version 24 00000020:00100000:1.0:1788201395.527267:0:75745:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788201395.527274:0:75745:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc00388dc00 x1875060715361920/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201395.527341:0:75745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00388dc00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715361920:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788201395.527379:0:75745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201395.527399:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201395.527413:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715361920 00000100:00100000:1.0:1788201395.527417:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715361920 00000100:00100000:1.0:1788201395.527443:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788201395.527450:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:75745:x1875060715361920:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788201395.527835:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:75745:x1875060715361920:12345-0@lo:1000:osp_up0-1.0 Request processed in 384us (454us total) trans 124554051759 rc 0/0 00000100:00100000:1.0:1788201395.527843:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788201395.527888:0:75745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00388dc00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715361920:0@lo:1000:osp_up0-1.0 00000004:00200000:2.0:1788201395.528084:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x6:0x0]: returning size 4096 00010000:00010000:2.0:1788201395.528112:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1dda0 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201395.528127:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1dda0 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201395.528150:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1dda0 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201395.528164:0:66313:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1788201395.528173:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc108c75a00/0x96d0c9b8c9a1dd84 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1dd8b expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201395.528182:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc108c75a00/0x96d0c9b8c9a1dd84 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1dd8b expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201395.528201:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc108c75a00/0x96d0c9b8c9a1dd84 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1dd8b expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201395.528227:0:66313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1788201395.528234:0:66313:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1788201395.528239:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbd400/0x96d0c9b8c9a1dd92 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1dd99 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201395.528247:0:66313:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbd400/0x96d0c9b8c9a1dd92 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1dd99 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201395.528290:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1dd7d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d6c expref: 14 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201395.528313:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1dda0 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d6c expref: 13 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201395.528321:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0x0 (ffff8dc1207c9a00) 00010000:00010000:2.0:1788201395.528325:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201395.528328:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbd200, rc 0) 00000100:00100000:2.0:1788201395.528473:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:76261:x1875060695522816:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 17636us (17808us total) trans 77309411475 rc 0/0 00000100:00100000:2.0:1788201395.528481:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1666 00010000:00010000:1.0:1788201395.529699:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201395.529711:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc108c75a00/0x96d0c9b8c9a1dd84 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1dd8b expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.529722:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75a00 already unused, calling callback (ffffffffc189cee0) 00010000:00010000:1.0:1788201395.529729:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc108c75a00/0x96d0c9b8c9a1dd84 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1dd8b expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201395.529738:0:6521:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc108c75a00/0x96d0c9b8c9a1dd84 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1dd8b expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.529779:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc108c75a00/0x96d0c9b8c9a1dd84 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1dd8b expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.529786:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201395.529833:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc108c75a00/0x96d0c9b8c9a1dd84 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1dd8b expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.529840:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc108c75a00/0x96d0c9b8c9a1dd84 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1dd8b expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.529855:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201395.529856:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201395.529858:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201395.529867:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201395.529884:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00388ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715362048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201395.529950:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201395.530180:0:9535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715362048 00000100:00100000:2.0:1788201395.530189:0:9535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715362048 00000100:00100000:2.0:1788201395.530236:0:9535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:2.0:1788201395.530245:0:9535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3657:x1875060715362048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201395.530267:0:9535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201395.530289:0:9535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1dd8b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1dd84 expref: 10 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201395.530304:0:9535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:2.0:1788201395.530308:0:9535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201395.530344:0:9535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3657:x1875060715362048:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201395.530351:0:9535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:1.0:1788201395.530452:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00388ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715362048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201395.536825:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201395.536851:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715362176:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201395.536935:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201395.537690:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715362176 00000100:00100000:3.0:1788201395.537699:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715362176 00000100:00100000:3.0:1788201395.537741:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788201395.537749:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715362176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788201395.537780:0:66317:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445388288 avail 1299148800 00000100:00100000:3.0:1788201395.537831:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715362176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201395.537838:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788201395.538886:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715362176:0@lo:41:osp-pre-1-0.0 00000001:00080000:0.0:1788201395.542406:0:99761:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901909 is committed 00000100:00100000:1.0:1788201395.547378:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201395.548005:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695523072 00000100:00100000:0.0:1788201395.548034:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695523072 00000100:00100000:0.0:1788201395.548100:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1667 00000100:00100000:0.0:1788201395.548122:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:76262:x1875060695523072:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788201395.548151:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201395.548170:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1dda7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786d73 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.548243:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1ddae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.548256:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1ddae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.548267:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1ddae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201395.548316:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201395.548320:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201395.548340:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1ddae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.548365:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1dda7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d73 expref: 11 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.548384:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1ddae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d73 expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.548393:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:0.0:1788201395.548396:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201395.548400:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58a00, rc 0) 00000100:00100000:0.0:1788201395.548462:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:76262:x1875060695523072:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 340us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201395.548478:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1667 00000100:00100000:2.0:1788201395.552797:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201395.552845:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695523200 00000100:00100000:0.0:1788201395.552856:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695523200 00000100:00100000:0.0:1788201395.552967:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1668 00000100:00100000:0.0:1788201395.552978:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:76262:x1875060695523200:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788201395.552998:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201395.553057:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1ddb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786d7a expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.553121:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1ddbc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.553146:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1ddbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.553158:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1ddbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.553170:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1ddc3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.553179:0:66312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1dd99 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1dd92 expref: 8 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.553188:0:66312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1ddc3 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.553240:0:66312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1dd99 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1dd92 expref: 8 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201395.553274:0:66312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66312:1875060715362304:0@lo:104: 00000100:00100000:0.0:1788201395.553320:0:66312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201395.553364:0:66312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038e0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201395.553840:0:95383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715362304 00000100:00100000:2.0:1788201395.553844:0:95383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715362304 00000100:00100000:2.0:1788201395.553876:0:95383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1788201395.553884:0:95383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:66312:x1875060715362304:12345-0@lo:104: 00010000:00010000:2.0:1788201395.553909:0:95383:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbd400/0x96d0c9b8c9a1dd92 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1dd99 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201395.553963:0:95383:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201395.553969:0:95383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:66312:x1875060715362304:12345-0@lo:104: Request processed in 87us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201395.553975:0:95383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788201395.553981:0:66312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66312:1875060715362304:0@lo:104: 00010000:00010000:0.0:1788201395.553999:0:66312:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1ddc3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.554091:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201395.554099:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbd400/0x96d0c9b8c9a1dd92 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1dd99 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.554107:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd400 already unused, calling callback (ffffffffc189cee0) 00010000:00010000:1.0:1788201395.554113:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbd400/0x96d0c9b8c9a1dd92 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1dd99 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201395.554121:0:13349:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbd400/0x96d0c9b8c9a1dd92 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1dd99 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.554159:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbd400/0x96d0c9b8c9a1dd92 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1dd99 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.554166:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788201395.554283:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715362432:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201395.554318:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbd400/0x96d0c9b8c9a1dd92 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1dd99 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201395.554324:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201395.554327:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbd400/0x96d0c9b8c9a1dd92 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1dd99 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.554346:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201395.554348:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201395.554350:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201395.554384:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715362432 00000100:00100000:0.0:1788201395.554389:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715362432 00010000:00010000:0.0:1788201395.554407:0:26213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1dd99 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1dd92 expref: 9 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201395.554436:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2626 00000100:00100000:0.0:1788201395.554523:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+9:3656:x1875060715362432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201395.554534:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1788201395.556344:0:94457:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051759 is committed 00010000:00010000:3.0:1788201395.556459:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1dd99 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1dd92 expref: 8 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201395.556477:0:26213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc9f42202 (ffff8dc008723900) 00010000:00010000:3.0:1788201395.556481:0:26213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1ddc3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201395.556492:0:26213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1ddc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201395.556499:0:26213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1ddc3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201395.556531:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201395.556552:0:66312:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1ddc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.556560:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1ddc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201395.556599:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715362432:12345-0@lo:103:ldlm_bl.0 Request processed in 2156us (2273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201395.556616:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2626 00000100:00100000:0.0:1788201395.556667:0:66312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66312:1875060715362560:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788201395.556703:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715362432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201395.556709:0:66312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201395.556740:0:66312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038e0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201395.556762:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715362560 00000100:00100000:3.0:1788201395.556768:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715362560 00000100:00100000:3.0:1788201395.556814:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788201395.556822:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:66312:x1875060715362560:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788201395.556950:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:66312:x1875060715362560:12345-0@lo:1000:mdt00_000.0 Request processed in 129us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201395.556957:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788201395.556997:0:66312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66312:1875060715362560:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788201395.557080:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1ddca lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.557092:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1ddca lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.557098:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1ddca lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201395.557115:0:66312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1ddca lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.557125:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1ddbc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.557129:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1ddbc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.557148:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1ddbc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.557155:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1ddbc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.557164:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201395.557168:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1ddbc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.557176:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1ddbc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.557185:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:0.0:1788201395.557188:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201395.557246:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1ddbc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.557253:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1ddbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.557264:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1ddc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.557274:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1ddc3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.557280:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1ddc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.557286:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201395.557288:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1ddc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.557294:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1ddc3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.557303:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc9f42202 (ffff8dc008723900) 00010000:00010000:0.0:1788201395.557305:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201395.557308:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1ddc3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.557314:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1ddc3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.557347:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1ddb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d7a expref: 12 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.557373:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1ddca lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d7a expref: 11 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.557380:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0x0 (ffff8dc0084fb400) 00010000:00010000:0.0:1788201395.557382:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201395.557384:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59000, rc 0) 00000100:00100000:0.0:1788201395.557481:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:76262:x1875060695523200:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 4503us (4689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201395.557488:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1668 00000100:00100000:2.0:1788201395.561044:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201395.561077:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695523328 00000100:00100000:0.0:1788201395.561087:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695523328 00000100:00100000:0.0:1788201395.561152:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1669 00000100:00100000:0.0:1788201395.561163:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:76262:x1875060695523328:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788201395.561189:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201395.561209:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1ddd1 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786d81 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.561270:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1ddd8 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.561283:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1ddd8 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.561296:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1ddd8 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201395.561354:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x6:0x0]: returning size 4096 00000004:00200000:0.0:1788201395.561371:0:66313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1788201395.561404:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1ddd1 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d81 expref: 15 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.561418:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1ddd8 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d81 expref: 14 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.561424:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0x0 (ffff8dc1207c9a00) 00010000:00010000:0.0:1788201395.561426:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1788201395.561428:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59400, rc 0) 00000100:00100000:0.0:1788201395.561487:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:76262:x1875060695523328:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 326us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201395.561494:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1669 00000100:00100000:1.0:1788201395.570553:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201395.570710:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201395.572447:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695523584 00000100:00100000:3.0:1788201395.572461:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695523584 00000100:00100000:3.0:1788201395.572537:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 735 00000100:00100000:3.0:1788201395.572548:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2403:x1875060695523584:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201395.572563:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201395.572589:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1ddd8 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d81 expref: 14 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201395.572610:0:26215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0x0 (ffff8dc1207c9a00) 00010000:00010000:3.0:1788201395.572615:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201395.572671:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:2403:x1875060695523584:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 126us (1962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201395.572679:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 735 00000100:00100000:0.0:1788201395.575391:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695523456 00000100:00100000:0.0:1788201395.575405:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695523456 00000100:00100000:0.0:1788201395.575624:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1670 00000100:00100000:0.0:1788201395.575636:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:76262:x1875060695523456:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788201395.575657:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201395.575679:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1dddf lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786d88 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.575743:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1dde6 lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.575757:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1dde6 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.575769:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1dde6 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.575800:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1dded lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.575807:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1dded lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.575814:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1dded lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.575855:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1dde6 lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.575863:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1dde6 lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.575870:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1dde6 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.575877:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1dde6 lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.575883:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201395.575887:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1dde6 lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.575908:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1dde6 lrc: 5/0,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.575921:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0x0 (ffff8dc1207c9a00) 00010000:00010000:0.0:1788201395.575924:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201395.575928:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1dde6 lrc: 3/0,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.575941:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1dde6 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.575957:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1dded lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.575963:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1dded lrc: 2/0,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.575969:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1dded lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.575973:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201395.575977:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1dded lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.575983:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1dded lrc: 4/0,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.575990:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0xd1d4b922 (ffff8dc0084fb900) 00010000:00010000:0.0:1788201395.575993:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201395.575996:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1dded lrc: 2/0,0 mode: --/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.576001:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1dded lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.576060:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1dddf lrc: 1/0,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d88 expref: 14 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.576082:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0x0 (ffff8dc1207c9a00) 00010000:00010000:0.0:1788201395.576085:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201395.576089:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1dddf lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d88 expref: 14 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.576098:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59c00, rc 0) 00000100:00100000:0.0:1788201395.576236:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:76262:x1875060695523456:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 602us (5693us total) trans 0 rc 301/301 00000100:00100000:0.0:1788201395.576243:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1670 00000100:00100000:1.0:1788201395.584341:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201395.584486:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695523840 00000100:00100000:0.0:1788201395.584496:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695523840 00000100:00100000:0.0:1788201395.584569:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1671 00000100:00100000:0.0:1788201395.584579:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:76262:x1875060695523840:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788201395.584602:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201395.584624:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1ddf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786d8f expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201395.584750:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x6:0x0]: returning size 4096 00010000:00010000:0.0:1788201395.584856:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1ddf4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d8f expref: 15 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.584870:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0084fb900) 00010000:00010000:0.0:1788201395.584873:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201395.584879:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1ddf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d8f expref: 15 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.584930:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59c00, rc 0) 00000100:00100000:0.0:1788201395.584992:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:76262:x1875060695523840:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 414us (661us total) trans 77309411476 rc 301/301 00000100:00100000:0.0:1788201395.584999:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1671 00000100:00100000:2.0:1788201395.591264:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201395.591336:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695524096 00000100:00100000:0.0:1788201395.591347:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695524096 00000100:00100000:0.0:1788201395.591410:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1672 00000100:00100000:0.0:1788201395.591421:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:76262:x1875060695524096:12345-192.168.201.20@tcp:36:lfs.0 00010000:00010000:0.0:1788201395.591481:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201395.591508:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1dda0 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d6c expref: 14 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.591527:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0x0 (ffff8dc1207c9a00) 00010000:00010000:0.0:1788201395.591536:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201395.591589:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1de02 lrc: 3/0,1 mode: --/CW res: [0x2400088d5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.591602:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1de02 lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.591612:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1de02 lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.591623:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1de09 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.591629:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1de09 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.591650:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1de09 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201395.592593:0:66313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x1:0x0].11, 2152 off47392 00000040:00080000:0.0:1788201395.592681:0:66313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x1:0x0].10, 2352 off46760 00000004:00080000:0.0:1788201395.592687:0:66313:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc0038e0b40 with version 25 00000004:00080000:2.0:1788201395.594587:0:75745:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc007566d80 version 25 rpc_version 25 00000020:00100000:2.0:1788201395.594638:0:75745:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788201395.594651:0:75745:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc00714c700 x1875060715362816/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201395.594673:0:75745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00714c700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715362816:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788201395.594747:0:75745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201395.594794:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1030cb300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201395.595095:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715362816 00000100:00100000:1.0:1788201395.595104:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715362816 00000100:00100000:1.0:1788201395.595177:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788201395.595187:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:75745:x1875060715362816:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788201395.596575:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:75745:x1875060715362816:12345-0@lo:1000:osp_up0-1.0 Request processed in 1384us (1822us total) trans 124554051760 rc 0/0 00000100:00100000:1.0:1788201395.596586:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788201395.596739:0:75745:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051759 gen 3 00000004:00080000:3.0:1788201395.596746:0:75745:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051759 committed transno 124554051759 00000100:00100000:3.0:1788201395.596770:0:75745:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8dc00714c700 x1875060715362816/t124554051760(124554051760) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 1788201411 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201395.596813:0:75745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00714c700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715362816:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1788201395.597056:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1de10 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.597072:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1de10 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.597084:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1de10 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.597105:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1de17 lrc: 3/0,1 mode: --/PW res: [0x2400088d0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.597114:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1de17 lrc: 3/0,1 mode: PW/PW res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.597120:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1de17 lrc: 3/0,1 mode: PW/PW res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.597158:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d58800/0x96d0c9b8c9a1de1e lrc: 3/0,1 mode: --/PW res: [0x2000090a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.597166:0:66313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d58800/0x96d0c9b8c9a1de1e lrc: 3/0,1 mode: --/PW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.597175:0:66313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d58800/0x96d0c9b8c9a1de1e lrc: 3/0,1 mode: --/PW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201395.597207:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715362944:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1788201395.597247:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201395.597272:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0010eb900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201395.597532:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715362944 00000100:00100000:1.0:1788201395.597538:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715362944 00000100:00100000:1.0:1788201395.597576:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788201395.597584:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:66313:x1875060715362944:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1788201395.597598:0:101344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201395.597613:0:101344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1de25 lrc: 2/0,0 mode: --/PW res: [0x2000090a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1de1e expref: -99 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.597631:0:101344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1de25 lrc: 3/0,0 mode: PW/PW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1de1e expref: 9 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.597649:0:101344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1de25 lrc: 3/0,0 mode: PW/PW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1de1e expref: 9 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.597657:0:101344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x6:0x0].0x0 (ffff8dc103b47c00) 00010000:00010000:1.0:1788201395.597660:0:101344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201395.597664:0:101344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064edc00, rc 0) 00000100:00100000:1.0:1788201395.597702:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715362944:12345-0@lo:101:mdt00_001.0 Request processed in 119us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201395.597709:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788201395.597797:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715362944:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1788201395.597809:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d58800/0x96d0c9b8c9a1de1e lrc: 4/0,1 mode: PW/PW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1de25 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.597818:0:66313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d58800/0x96d0c9b8c9a1de1e lrc: 4/0,1 mode: PW/PW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1de25 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201395.597834:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d133132 reply state 00000000aa73c35f transno 77309411477 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1de17 lrc: 3/0,1 mode: PW/PW res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.597958:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1de17 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.597965:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x6:0x0].0x0 (ffff8dc0084fbd00) 00010000:00010000:0.0:1788201395.597967:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201395.597970:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201395.597976:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d58800/0x96d0c9b8c9a1de1e lrc: 4/0,1 mode: PW/PW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1de25 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201395.597984:0:66313:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d58800/0x96d0c9b8c9a1de1e lrc: 3/0,0 mode: PW/PW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1de25 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201395.597994:0:66313:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000090a1:0x6:0x0] 00000004:00010000:1.0:1788201395.608217:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d133132 reply state 00000000aa73c35f transno 77309411477 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1de10 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.608249:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1de10 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.608258:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x7:0x0].0x0 (ffff8dc0084fb200) 00010000:00010000:1.0:1788201395.608261:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201395.608265:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1788201395.608272:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x7:0x0]: returning size 4096 00010000:00010000:1.0:1788201395.608285:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1de02 lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.608292:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1de02 lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.608298:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1de02 lrc: 3/0,0 mode: CW/CW res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.608303:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1de02 lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.608324:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201395.608329:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1de02 lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.608336:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1de02 lrc: 5/0,0 mode: CW/CW res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.608347:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0x0 (ffff8dc0084fb900) 00010000:00010000:1.0:1788201395.608349:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201395.608353:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1de02 lrc: 3/0,0 mode: --/CW res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.608358:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1de02 lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201395.608381:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d133132 reply state 00000000aa73c35f transno 77309411477 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1de09 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.608389:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1de09 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201395.608395:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0xd1d4b922 (ffff8dc0084fb000) 00010000:00010000:1.0:1788201395.608397:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201395.608399:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1788201395.609241:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:76262:x1875060695524096:12345-192.168.201.20@tcp:36:lfs.0 Request processed in 17814us (17981us total) trans 77309411477 rc 0/0 00000100:00100000:1.0:1788201395.609251:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1672 00000100:00100000:2.0:1788201395.611477:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201395.611581:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695524352 00000100:00100000:0.0:1788201395.611592:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695524352 00000100:00100000:0.0:1788201395.611660:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 289 00000100:00100000:0.0:1788201395.611669:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:76262:x1875060695524352:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:0.0:1788201395.611890:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:76262:x1875060695524352:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 221us (419us total) trans 77309411478 rc 0/0 00000100:00100000:0.0:1788201395.611897:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 289 00010000:00010000:3.0:1788201395.987087:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201396.047214:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715363072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201396.047291:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201396.047367:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715363072 00000100:00100000:2.0:1788201396.047376:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715363072 00000100:00100000:2.0:1788201396.047445:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788201396.047455:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715363072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201396.047485:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201396.047514:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715363328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201396.047529:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715363072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201396.047537:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788201396.047543:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201396.047563:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715363200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201396.047605:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201396.047645:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201396.047658:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715363328 00000100:00100000:1.0:1788201396.047661:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715363328 00000100:00100000:0.0:1788201396.047664:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901909 gen 3 00000004:00080000:0.0:1788201396.047669:0:3657:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dc005d52300, transno 12884901889 00000004:00080000:0.0:1788201396.047677:0:3657:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dc005d5ad80, transno 12884901890 00000004:00080000:0.0:1788201396.047680:0:3657:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dc005d53800, transno 12884901891 00000004:00080000:0.0:1788201396.047682:0:3657:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dc005d59c00, transno 12884901892 00000004:00080000:0.0:1788201396.047685:0:3657:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dc005d53b80, transno 12884901893 00000004:00080000:0.0:1788201396.047687:0:3657:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dc005d5b480, transno 12884901894 00000100:00100000:1.0:1788201396.047687:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000004:00080000:0.0:1788201396.047689:0:3657:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dc005d50e00, transno 12884901895 00000004:00080000:0.0:1788201396.047692:0:3657:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dc120091500, transno 12884901896 00000100:00100000:1.0:1788201396.047693:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3655:x1875060715363328:12345-0@lo:41:osp-pre-0-1.0 00000004:00080000:0.0:1788201396.047695:0:3657:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dc00715aa00, transno 12884901897 00000004:00080000:0.0:1788201396.047697:0:3657:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dc120090700, transno 12884901898 00000004:00080000:0.0:1788201396.047700:0:3657:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dc005d52d80, transno 12884901899 00000004:00080000:0.0:1788201396.047702:0:3657:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dc007159500, transno 12884901900 00000004:00080000:0.0:1788201396.047705:0:3657:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dc007158380, transno 12884901901 00000004:00080000:0.0:1788201396.047707:0:3657:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dc005d51180, transno 12884901902 00000004:00080000:0.0:1788201396.047710:0:3657:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dc00715b800, transno 12884901903 00000004:00080000:0.0:1788201396.047712:0:3657:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dc007159880, transno 12884901904 00000004:00000024:1.0:1788201396.047714:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444925440 avail 1298685952 00000004:00080000:0.0:1788201396.047715:0:3657:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dc00388ea00, transno 12884901905 00000004:00080000:0.0:1788201396.047718:0:3657:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dc007158700, transno 12884901906 00000004:00080000:0.0:1788201396.047720:0:3657:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dc007158000, transno 12884901907 00000004:00080000:0.0:1788201396.047729:0:3657:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dc00715b100, transno 12884901908 00000004:00080000:0.0:1788201396.047732:0:3657:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dc007159f80, transno 12884901909 00000100:00100000:0.0:1788201396.047744:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715363072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201396.047748:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3655:x1875060715363328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201396.047753:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788201396.047783:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715363328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201396.047830:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715363200 00000100:00100000:2.0:1788201396.047835:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715363200 00000100:00100000:2.0:1788201396.047867:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788201396.047873:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715363200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201396.047884:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201396.047924:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715363200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (318us total) trans 0 rc 0/0 00000004:00080000:0.0:1788201396.047929:0:94474:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 21 done 00000100:00100000:2.0:1788201396.047929:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788201396.047957:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715363200:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788201396.048006:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201396.048161:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00388ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715363840:0@lo:400:kworker.0 00000100:00100000:1.0:1788201396.048205:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201396.048229:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715364352:0@lo:400:kworker.0 00000100:00100000:1.0:1788201396.048255:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201396.048258:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715363840 00000100:00100000:3.0:1788201396.048262:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715363840 00000100:00100000:1.0:1788201396.048273:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788201396.048279:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715363456:0@lo:400:kworker.0 00000100:00100000:3.0:1788201396.048290:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788201396.048297:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715363840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201396.048303:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201396.048328:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00388dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715363968:0@lo:400:kworker.0 00000100:00100000:3.0:1788201396.048329:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715363840:12345-0@lo:400:kworker.0 Request processed in 32us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201396.048335:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788201396.048347:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201396.048361:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715364480:0@lo:400:kworker.0 00000100:00100000:1.0:1788201396.048382:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788201396.048528:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc00388ea00 x1875060715363840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201396.048541:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00388ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715363840:0@lo:400:kworker.0 00000100:00100000:1.0:1788201396.048571:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715363456 00000100:00100000:1.0:1788201396.048574:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715363456 00000100:00100000:1.0:1788201396.048601:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788201396.048607:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715363456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201396.048640:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715363456:12345-0@lo:400:kworker.0 Request processed in 33us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201396.048647:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788201396.048677:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715363456:0@lo:400:kworker.0 00000100:00100000:0.0:1788201396.051196:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715364352 00000100:00100000:0.0:1788201396.051210:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715364352 00000100:00080000:1.0:1788201396.051261:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201396.051276:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715363968 00000100:00100000:1.0:1788201396.051277:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715364480 00000100:00100000:0.0:1788201396.051279:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715363968 00000100:00100000:1.0:1788201396.051280:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715364480 00000100:00100000:0.0:1788201396.051304:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1711 00000100:00100000:0.0:1788201396.051313:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715364352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201396.051423:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715364352:12345-0@lo:400:kworker.0 Request processed in 103us (3158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201396.051541:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1712 00000100:00100000:1.0:1788201396.051551:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715363968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201396.051585:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715363968:12345-0@lo:400:kworker.0 Request processed in 37us (3237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201396.051592:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1712 00000100:00100000:1.0:1788201396.051610:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1713 00000100:00100000:1.0:1788201396.051616:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12580aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715364480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201396.051644:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12580aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715364480:12345-0@lo:400:kworker.0 Request processed in 28us (3261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201396.051650:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1713 00000100:00080000:1.0:1788201396.051665:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201396.051708:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00388dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715363968:0@lo:400:kworker.0 00000100:00100000:1.0:1788201396.051720:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715364480:0@lo:400:kworker.0 00000100:00100000:1.0:1788201396.051730:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715364352:0@lo:400:kworker.0 00000100:00100000:0.0:1788201396.053010:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1711 00000100:00100000:0.0:1788201396.053064:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715363584:0@lo:400:kworker.0 00000100:00100000:0.0:1788201396.053121:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201396.053168:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715364096:0@lo:400:kworker.0 00000100:00100000:0.0:1788201396.053191:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201396.053215:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788201396.053222:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715363712:0@lo:400:kworker.0 00000100:00100000:0.0:1788201396.053244:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201396.053263:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715364224:0@lo:400:kworker.0 00000100:00100000:0.0:1788201396.053284:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201396.053311:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715363584 00000100:00100000:0.0:1788201396.053316:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715363584 00000100:00100000:0.0:1788201396.053349:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788201396.053357:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715363584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201396.053425:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715363584:12345-0@lo:400:kworker.0 Request processed in 68us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201396.053963:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788201396.053993:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715364096 00000100:00100000:0.0:1788201396.053997:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715364096 00000100:00100000:0.0:1788201396.054052:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715363712 00000100:00100000:0.0:1788201396.054055:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715363712 00000100:00100000:0.0:1788201396.054065:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715364224 00000100:00100000:0.0:1788201396.054066:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715364224 00000100:00100000:0.0:1788201396.054080:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1714 00000100:00100000:0.0:1788201396.054086:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715364096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201396.054122:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715364096:12345-0@lo:400:kworker.0 Request processed in 36us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201396.054140:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1714 00000100:00100000:0.0:1788201396.054152:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1715 00000100:00100000:0.0:1788201396.054157:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715363712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201396.054184:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715363712:12345-0@lo:400:kworker.0 Request processed in 27us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201396.054190:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1715 00000100:00100000:0.0:1788201396.054201:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1716 00000100:00100000:0.0:1788201396.054207:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715364224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201396.054232:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715364224:12345-0@lo:400:kworker.0 Request processed in 26us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201396.054236:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1716 00000100:00080000:0.0:1788201396.054252:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201396.054255:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201396.054283:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715363712:0@lo:400:kworker.0 00000100:00100000:0.0:1788201396.054301:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715364224:0@lo:400:kworker.0 00010000:00080000:0.0:1788201396.054312:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc005abe680 x1875060715363584/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201396.054322:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715363584:0@lo:400:kworker.0 00000100:00100000:0.0:1788201396.054331:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715364096:0@lo:400:kworker.0 00010000:00010000:0.0:1788201396.400383:0:75739:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d58800/0x96d0c9b8c9a1de1e lrc: 3/0,0 mode: PW/PW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1de25 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201396.400404:0:75739:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d58800/0x96d0c9b8c9a1de1e lrc: 3/0,0 mode: PW/PW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1de25 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201396.400418:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1de09 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201396.400430:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1de09 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201396.400437:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1de09 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201396.400443:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201396.400448:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1de09 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.400453:0:75739:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d58800/0x96d0c9b8c9a1de1e lrc: 2/0,0 mode: --/PW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1de25 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201396.400455:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1de09 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201396.400471:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0xd1d4b922 (ffff8dc0084fb000) 00010000:00010000:0.0:1788201396.400473:0:75739:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201396.400478:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201396.400483:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1de09 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201396.400490:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1de09 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.400509:0:75739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d58800/0x96d0c9b8c9a1de1e lrc: 0/0,0 mode: --/PW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1de25 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201396.400511:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1de10 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788201396.400537:0:75739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411478 is committed 00000100:00100000:1.0:1788201396.400542:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715364608:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1788201396.400546:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1de10 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201396.400555:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1de10 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788201396.400560:0:75739:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8dc0010eb0c0 refcount 2 committed 0 result 0 batchid 73014444098 00010000:00010000:2.0:1788201396.400560:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58200 already unused, calling callback (ffffffffc18904f0) 00000020:00080000:0.0:1788201396.400567:0:75739:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc1409faa00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8dc0010eb900 00010000:00010000:2.0:1788201396.400568:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1de10 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788201396.400574:0:75739:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000090a1:0x1:0x0].9 00000020:00080000:0.0:1788201396.400580:0:75739:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc1409fa300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dc105dd6600 00010000:00010000:2.0:1788201396.400580:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1de10 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788201396.400589:0:75739:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2400088d0:0x1:0x0].10 00010000:00010000:2.0:1788201396.400598:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x7:0x0].0x0 (ffff8dc0084fb200) 00010000:00010000:2.0:1788201396.400602:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201396.400605:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1de10 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201396.400611:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1de10 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201396.400618:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788201396.400621:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444098 committed batchid 73014444097 00010000:00010000:2.0:1788201396.400634:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1de17 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201396.400642:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1de17 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201396.400647:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1de17 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201396.400653:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201396.400662:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1de17 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201396.400670:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1de17 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201396.400680:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x6:0x0].0x0 (ffff8dc0084fbd00) 00010000:00010000:2.0:1788201396.400683:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201396.400686:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715364608 00010000:00010000:2.0:1788201396.400686:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1de17 lrc: 2/0,0 mode: --/TXN res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788201396.400689:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444097 00000100:00100000:1.0:1788201396.400696:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715364608 00010000:00010000:2.0:1788201396.400696:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1de17 lrc: 0/0,0 mode: --/TXN res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201396.400749:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:1.0:1788201396.400761:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125809500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3657:x1875060715364608:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1788201396.400774:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201396.400793:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1de25 lrc: 0/0,0 mode: --/PW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1de1e expref: 9 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201396.400809:0:26207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x6:0x0].0x0 (ffff8dc103b47c00) 00010000:00010000:1.0:1788201396.400818:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00080000:3.0:1788201396.400820:0:94457:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051760 is committed 00000100:00100000:1.0:1788201396.400868:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125809500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715364608:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 109us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201396.400875:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000100:00100000:2.0:1788201396.400906:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715364608:0@lo:103:jbd2/dm-1-8.0 00000020:00080000:0.0:1788201396.419196:0:75739:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444098 batchid updated 00000020:00080000:2.0:1788201396.420446:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444098 00000004:00080000:2.0:1788201396.420511:0:75759:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc0010d7480 with version 26 00000020:00080000:2.0:1788201396.420530:0:75759:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444098 cancel update log [0x2000090a1:0x1:0x0].9: rc = 0 00000020:00080000:2.0:1788201396.420621:0:75759:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444098 cancel update log [0x2400088d0:0x1:0x0].10: rc = 0 00000020:00080000:2.0:1788201396.420630:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444098 00000004:00080000:3.0:1788201396.420909:0:75745:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc007566d80 version 26 rpc_version 26 00000020:00100000:3.0:1788201396.420953:0:75745:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788201396.420966:0:75745:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc007159880 x1875060715364864/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201396.420996:0:75745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715364864:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201396.421131:0:75745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201396.421167:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005a8ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201396.421239:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715364864 00000100:00100000:1.0:1788201396.421250:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715364864 00000100:00100000:0.0:1788201396.421368:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788201396.421380:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:75745:x1875060715364864:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788201396.421540:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:75745:x1875060715364864:12345-0@lo:1000:osp_up0-1.0 Request processed in 162us (409us total) trans 124554051761 rc 0/0 00000100:00100000:0.0:1788201396.421548:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788201396.421630:0:75745:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051760 gen 3 00000004:00080000:3.0:1788201396.421636:0:75745:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051760 committed transno 124554051760 00000020:00080000:3.0:1788201396.421641:0:75745:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8dc0038e0000 refcount 2 committed 0 result 0 batchid 73014444099 00000020:00080000:3.0:1788201396.421645:0:75745:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc140d8c500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8dc0038e0b40 00000020:00080000:3.0:1788201396.421649:0:75745:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000090a1:0x1:0x0].10 00000020:00080000:3.0:1788201396.421651:0:75745:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc140d8cb00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dc005dd9600 00000020:00080000:3.0:1788201396.421654:0:75745:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2400088d0:0x1:0x0].11 00000100:00100000:3.0:1788201396.421690:0:75745:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8dc007159880 x1875060715364864/t124554051761(124554051761) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788201412 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201396.421709:0:75745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715364864:0@lo:1000:osp_up0-1.0 00000020:00080000:0.0:1788201396.421763:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444099 committed batchid 73014444098 00000020:00080000:0.0:1788201396.421789:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444098 00000001:00080000:3.0:1788201396.437700:0:94457:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051761 is committed 00000020:00080000:0.0:1788201396.439682:0:75739:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444099 batchid updated 00000020:00080000:2.0:1788201396.439726:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444099 00000004:00080000:2.0:1788201396.439791:0:75759:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc0010d7300 with version 27 00000020:00080000:2.0:1788201396.439851:0:75759:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444099 cancel update log [0x2000090a1:0x1:0x0].10: rc = 0 00000020:00080000:2.0:1788201396.439940:0:75759:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444099 cancel update log [0x2400088d0:0x1:0x0].11: rc = 0 00000020:00080000:2.0:1788201396.439959:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444099 00000004:00080000:3.0:1788201396.443703:0:75745:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc007566d80 version 27 rpc_version 27 00000020:00100000:3.0:1788201396.443748:0:75745:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788201396.443759:0:75745:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc007158000 x1875060715365120/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201396.443784:0:75745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715365120:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201396.443855:0:75745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201396.443898:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005a8ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201396.444315:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715365120 00000100:00100000:1.0:1788201396.444327:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715365120 00000100:00100000:1.0:1788201396.444393:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788201396.444412:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:75745:x1875060715365120:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788201396.444608:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:75745:x1875060715365120:12345-0@lo:1000:osp_up0-1.0 Request processed in 204us (751us total) trans 124554051762 rc 0/0 00000100:00100000:1.0:1788201396.444615:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788201396.444703:0:75745:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051761 gen 3 00000004:00080000:2.0:1788201396.444709:0:75745:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051761 committed transno 124554051761 00000100:00100000:2.0:1788201396.444729:0:75745:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8dc007158000 x1875060715365120/t124554051762(124554051762) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788201412 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201396.444758:0:75745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715365120:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201396.544454:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201396.544513:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695524480 00000100:00100000:1.0:1788201396.544524:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695524480 00000100:00100000:1.0:1788201396.544596:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1673 00000100:00100000:1.0:1788201396.544619:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:76271:x1875060695524480:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:1.0:1788201396.544662:0:69485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444925440 avail 1298685952 00000100:00100000:1.0:1788201396.544752:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:76271:x1875060695524480:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 135us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201396.544759:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1673 00000100:00100000:1.0:1788201396.556619:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201396.556789:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695524608 00000100:00100000:3.0:1788201396.556799:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695524608 00000100:00100000:3.0:1788201396.556858:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1674 00000100:00100000:3.0:1788201396.556869:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12580a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:76271:x1875060695524608:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:3.0:1788201396.556929:0:66313:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445376000 avail 1299136512 00000100:00100000:3.0:1788201396.557010:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12580a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:76271:x1875060695524608:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 142us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201396.557040:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1674 00000100:00100000:3.0:1788201396.568375:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201396.568463:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695524736 00000100:00100000:2.0:1788201396.568474:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695524736 00000100:00100000:2.0:1788201396.568548:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:2.0:1788201396.568559:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:76271:x1875060695524736:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:2.0:1788201396.568590:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201396.568666:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:76271:x1875060695524736:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 108us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201396.568673:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00080000:0.0:1788201396.569364:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201396.574049:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201396.574205:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695524864 00000100:00100000:1.0:1788201396.574216:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695524864 00000100:00100000:1.0:1788201396.574335:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00100000:1.0:1788201396.574345:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118142d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:76271:x1875060695524864:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:1.0:1788201396.574380:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201396.574552:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118142d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:76271:x1875060695524864:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 207us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201396.574560:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00080000:1.0:1788201396.574585:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201396.655280:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201396.655438:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695525120 00000100:00100000:3.0:1788201396.655449:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695525120 00000100:00100000:3.0:1788201396.655509:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1675 00000100:00100000:3.0:1788201396.655519:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:76278:x1875060695525120:12345-192.168.201.20@tcp:36:mcreate.0 00010000:00010000:3.0:1788201396.655574:0:66757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201396.655602:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1ddae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d73 expref: 11 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.655639:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:3.0:1788201396.655644:0:66757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201396.655708:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de2c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.655721:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de2c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.655731:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de2c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.655745:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1de33 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.655753:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1de33 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.655759:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1de33 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.656437:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de2c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.656446:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de2c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.656452:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de2c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.656458:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de2c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.656475:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74e00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201396.656480:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de2c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.656487:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de2c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.656497:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:3.0:1788201396.656499:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201396.656503:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de2c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.656509:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de2c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201396.656520:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011930d06 reply state 0000000098c8ca19 transno 124554051763 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1de33 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.656530:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1de33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.656536:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc103255400) 00010000:00010000:3.0:1788201396.656538:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201396.656540:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201396.656616:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:76278:x1875060695525120:12345-192.168.201.20@tcp:36:mcreate.0 Request processed in 1098us (1345us total) trans 124554051763 rc 0/0 00000100:00100000:3.0:1788201396.656625:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1675 00000100:00100000:2.0:1788201396.682444:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201396.682594:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695525248 00000100:00100000:1.0:1788201396.682605:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695525248 00000100:00100000:1.0:1788201396.682681:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1676 00000100:00100000:1.0:1788201396.682693:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:76281:x1875060695525248:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:1.0:1788201396.682717:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201396.682737:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1de3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786d96 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201396.682801:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1de41 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201396.682832:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1de41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201396.682844:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1de41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201396.682894:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788201396.682898:0:69485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201396.688184:0:69485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1de41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201396.688384:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1de3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d96 expref: 14 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201396.688410:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1de41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d96 expref: 13 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201396.688499:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:2.0:1788201396.688503:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201396.688507:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064edc00, rc 0) 00000100:00100000:2.0:1788201396.688644:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:76281:x1875060695525248:12345-192.168.201.20@tcp:101:rm.0 Request processed in 5951us (6207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201396.688653:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1676 00000100:00100000:0.0:1788201396.693354:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201396.693539:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695525376 00000100:00100000:1.0:1788201396.693550:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695525376 00000100:00100000:0.0:1788201396.693725:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1677 00000100:00100000:0.0:1788201396.693737:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:76281:x1875060695525376:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1788201396.693757:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201396.693779:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1de48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786d9d expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.693845:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1de4f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.693860:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1de4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.693871:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1de4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.693894:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1de56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.693917:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1de56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.693925:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1de56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.694062:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1de5d lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.694071:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1de5d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.694077:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1de5d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201396.694133:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x30:0x0]: returning size 0 00000004:00200000:0.0:1788201396.694137:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201396.694156:0:66312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1de5d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.694167:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1de5d lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.694177:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1de4f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.694183:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1de4f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.694190:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1de4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.694207:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1de4f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.694214:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201396.694218:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1de4f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.694226:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1de4f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.694239:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:0.0:1788201396.694242:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201396.694246:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1de4f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.694252:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59600/0x96d0c9b8c9a1de4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.694265:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1de56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.694270:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1de56 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.694277:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1de56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.694281:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201396.694294:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1de56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.694312:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1de56 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.694321:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc103255400) 00010000:00010000:0.0:1788201396.694324:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201396.694327:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1de56 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.694333:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1de56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.694360:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1de48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d9d expref: 15 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.694374:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1de5d lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d9d expref: 14 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201396.694382:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x30:0x0].0x0 (ffff8dc0084fb700) 00010000:00010000:0.0:1788201396.694384:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201396.694387:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58c00, rc 0) 00000100:00100000:0.0:1788201396.694461:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:76281:x1875060695525376:12345-192.168.201.20@tcp:101:rm.0 Request processed in 726us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201396.694470:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1677 00000100:00100000:2.0:1788201396.697769:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201396.697891:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695525632 00000100:00100000:3.0:1788201396.697902:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695525632 00000100:00100000:3.0:1788201396.697969:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1678 00000100:00100000:3.0:1788201396.697988:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:76281:x1875060695525632:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:3.0:1788201396.698192:0:66757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788201396.698230:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1de5d lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d9d expref: 14 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.698250:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x30:0x0].0x0 (ffff8dc0084fb700) 00010000:00010000:3.0:1788201396.698267:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064edc00/0x96d0c9b8c9a1de41 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d96 expref: 13 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.698276:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:3.0:1788201396.698279:0:66757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201396.698397:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de64 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.698413:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de64 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.698545:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de64 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.698559:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75200/0x96d0c9b8c9a1de6b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.698568:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75200/0x96d0c9b8c9a1de6b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.698575:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75200/0x96d0c9b8c9a1de6b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.698658:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1de72 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.698672:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1de72 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.698680:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1de72 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.698879:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75a00/0x96d0c9b8c9a1de79 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.698889:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75a00/0x96d0c9b8c9a1de79 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.698897:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75a00/0x96d0c9b8c9a1de79 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.698903:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75a00/0x96d0c9b8c9a1de79 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.698909:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75a00/0x96d0c9b8c9a1de79 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.698915:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75a00/0x96d0c9b8c9a1de79 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.698988:0:66757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201396.699007:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1de72 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.699054:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1de72 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.699061:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1de72 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.699075:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201396.699080:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1de72 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.699089:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1de72 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.699099:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x30:0x0].0x0 (ffff8dc103255900) 00010000:00010000:3.0:1788201396.699102:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201396.699106:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1de72 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.699122:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1de72 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.699142:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de64 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.699148:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de64 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.699153:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de64 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.699159:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de64 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.699164:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74e00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201396.699167:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de64 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.699184:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de64 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.699193:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:3.0:1788201396.699196:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201396.699199:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de64 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.699217:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de64 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201396.699227:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009f4fb63 reply state 00000000fc6451fb transno 124554051764 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75200/0x96d0c9b8c9a1de6b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.699239:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75200/0x96d0c9b8c9a1de6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201396.699245:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc103255400) 00010000:00010000:3.0:1788201396.699248:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201396.699251:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201396.699337:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:76281:x1875060695525632:12345-192.168.201.20@tcp:36:rm.0 Request processed in 1349us (1576us total) trans 124554051764 rc 0/0 00000100:00100000:3.0:1788201396.699345:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1678 00010000:00010000:1.0:1788201396.699784:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201396.699792:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75a00/0x96d0c9b8c9a1de79 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201396.699799:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201396.699803:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75a00/0x96d0c9b8c9a1de79 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201396.699809:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75a00/0x96d0c9b8c9a1de79 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201396.699820:0:24979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x30:0x0].0x0 (ffff8dc103255900) 00010000:00010000:1.0:1788201396.699823:0:24979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201396.699826:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75a00/0x96d0c9b8c9a1de79 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201396.699830:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75a00/0x96d0c9b8c9a1de79 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201396.699846:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201396.699848:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201396.699857:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201397.007412:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201397.204373:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201397.204413:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201397.204453:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201397.204548:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201397.204597:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201397.204629:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695525888 00000100:00100000:2.0:1788201397.204640:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695525888 00000100:00100000:2.0:1788201397.204699:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695526016 00000100:00100000:2.0:1788201397.204703:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695526016 00000100:00100000:2.0:1788201397.204728:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1717 00000100:00100000:2.0:1788201397.204740:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2400:x1875060695525888:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201397.204817:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2400:x1875060695525888:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 79us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201397.204825:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1717 00000100:00100000:2.0:1788201397.204842:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1718 00000100:00100000:2.0:1788201397.204848:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2400:x1875060695526016:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201397.205123:0:94464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695525760 00000100:00100000:1.0:1788201397.205128:0:94464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695525760 00000100:00100000:1.0:1788201397.205159:0:94464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 339 00000100:00100000:1.0:1788201397.205167:0:94464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695525760:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201397.205231:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2400:x1875060695526016:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 382us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201397.205238:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1718 00000100:00100000:2.0:1788201397.205258:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695526144 00000100:00100000:2.0:1788201397.205262:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695526144 00000100:00100000:2.0:1788201397.205283:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695526272 00000100:00100000:2.0:1788201397.205286:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695526272 00000100:00100000:2.0:1788201397.205305:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:2.0:1788201397.205312:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695526144:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201397.205377:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:3.0:1788201397.205388:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695526272:12345-192.168.201.20@tcp:400:kworker.0 00000100:00080000:0.0:1788201397.205478:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201397.205483:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201397.213497:0:94464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695525760:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 8305us (9017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201397.213514:0:94464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 339 00000100:00100000:2.0:1788201397.215938:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695526144:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 10613us (11511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201397.215966:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:3.0:1788201397.220076:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695526272:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 14677us (15464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201397.220093:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 20 00010000:00010000:1.0:1788201398.031536:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201399.056192:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201400.080784:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201400.146695:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715365248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201400.146793:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201400.146868:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715365248 00000100:00100000:1.0:1788201400.146877:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715365248 00000100:00100000:1.0:1788201400.146949:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788201400.146961:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715365248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201400.146999:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201400.147138:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715365248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 180us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201400.147146:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788201400.147170:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788201400.147217:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc005abe680 x1875060715365248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201400.147238:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715365248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201400.150067:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715365376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201400.150159:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201400.150361:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715365376 00000100:00100000:0.0:1788201400.150371:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715365376 00000100:00100000:0.0:1788201400.150446:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788201400.150465:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715365376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201400.150493:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00080000:3.0:1788201400.150576:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201400.153915:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715365376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3438us (3742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201400.153934:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788201400.156741:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc007159880 x1875060715365376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201400.156781:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715365376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201400.657100:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201400.657135:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715365504:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201400.657236:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201400.657298:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715365504 00000100:00100000:3.0:1788201400.657309:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715365504 00000100:00100000:3.0:1788201400.657373:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788201400.657385:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715365504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788201400.657432:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445376000 avail 1299136512 00000100:00100000:3.0:1788201400.657490:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715365504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201400.657498:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788201400.657557:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715365504:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788201401.107859:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201401.167840:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715365632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201401.167949:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715366016:0@lo:400:kworker.0 00000100:00100000:0.0:1788201401.167992:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201401.168072:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715366528:0@lo:400:kworker.0 00000100:00100000:0.0:1788201401.168103:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201401.168129:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715367040:0@lo:400:kworker.0 00000100:00100000:2.0:1788201401.168131:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715365760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201401.168169:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201401.168203:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788201401.168210:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715365888:0@lo:400:kworker.0 00000100:00100000:1.0:1788201401.168245:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201401.168247:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201401.168288:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715366400:0@lo:400:kworker.0 00000100:00100000:1.0:1788201401.168297:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715366144:0@lo:400:kworker.0 00000100:00100000:0.0:1788201401.168317:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201401.168452:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715366912:0@lo:400:kworker.0 00000100:00100000:0.0:1788201401.168481:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201401.168548:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715366016 00000100:00100000:0.0:1788201401.168556:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715366016 00000100:00100000:0.0:1788201401.168616:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788201401.168627:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3656:x1875060715366016:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788201401.168666:0:66317:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc001e43100 x1875060715366016/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:522/0 lens 224/224 e 0 to 0 dl 1788201412 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201401.168703:0:94463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715365888 00000100:00100000:2.0:1788201401.168710:0:94463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715365888 00000100:00100000:0.0:1788201401.168737:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3656:x1875060715366016:12345-0@lo:400:kworker.0 Request processed in 110us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201401.168745:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788201401.168754:0:94463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788201401.168764:0:94463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004c3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715365888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201401.168778:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715366528 00000100:00100000:0.0:1788201401.168783:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715366528 00000100:00100000:2.0:1788201401.168822:0:94463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004c3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715365888:12345-0@lo:400:kworker.0 Request processed in 59us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201401.168827:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788201401.168833:0:94463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788201401.168866:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715365632 00000100:00100000:2.0:1788201401.168870:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715365632 00000100:00100000:2.0:1788201401.168896:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788201401.168902:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715365632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201401.168939:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1788201401.169699:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201401.169753:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715366656:0@lo:400:kworker.0 00000100:00100000:1.0:1788201401.169799:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201401.169825:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715367168:0@lo:400:kworker.0 00000100:00100000:1.0:1788201401.169854:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201401.170405:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715366528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201401.170466:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715365632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1561us (2508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201401.170474:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715366528:12345-0@lo:400:kworker.0 Request processed in 76us (2369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201401.170479:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788201401.170488:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788201401.170529:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715366144 00000100:00100000:0.0:1788201401.170535:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715366144 00000100:00100000:2.0:1788201401.170538:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715367040 00000100:00100000:2.0:1788201401.170544:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715367040 00000100:00100000:0.0:1788201401.170572:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715366656 00000100:00100000:0.0:1788201401.170577:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715366656 00000100:00100000:0.0:1788201401.170604:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788201401.170611:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715366144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201401.170641:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715366144:12345-0@lo:400:kworker.0 Request processed in 31us (2295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201401.170648:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788201401.170659:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788201401.170665:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715366656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201401.170693:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715366656:12345-0@lo:400:kworker.0 Request processed in 28us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201401.170699:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788201401.170716:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201401.170722:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201401.171051:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715366400 00000100:00100000:2.0:1788201401.171056:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715366400 00000100:00100000:2.0:1788201401.171073:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715366912 00000100:00100000:2.0:1788201401.171076:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715366912 00000100:00100000:2.0:1788201401.171094:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715367168 00000100:00100000:2.0:1788201401.171097:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715367168 00000100:00100000:2.0:1788201401.171113:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1719 00000100:00100000:2.0:1788201401.171127:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715367040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201401.171168:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715367040:12345-0@lo:400:kworker.0 Request processed in 42us (3000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201401.171188:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1719 00000100:00100000:2.0:1788201401.171203:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1720 00000100:00100000:2.0:1788201401.171210:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715366400:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788201401.171222:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00000080:2.0:1788201401.171225:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc001e41f80 x1875060715366400/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:522/0 lens 224/224 e 0 to 0 dl 1788201412 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201401.171257:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715366400:12345-0@lo:400:kworker.0 Request processed in 47us (2940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201401.171264:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1721 00000100:00100000:0.0:1788201401.171276:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715366912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201401.171277:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1720 00000100:00100000:2.0:1788201401.171295:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1722 00010000:00000080:0.0:1788201401.171296:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc001e40a80 x1875060715366912/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:522/0 lens 224/224 e 0 to 0 dl 1788201412 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201401.171312:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715367168:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788201401.171326:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc13f8d9f80 x1875060715367168/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:522/0 lens 224/224 e 0 to 0 dl 1788201412 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201401.171337:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715366912:12345-0@lo:400:kworker.0 Request processed in 64us (2854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201401.171344:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1721 00000100:00100000:2.0:1788201401.171361:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715367168:12345-0@lo:400:kworker.0 Request processed in 57us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201401.171369:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1722 00000100:00100000:0.0:1788201401.171400:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715365888:0@lo:400:kworker.0 00000100:00100000:2.0:1788201401.171402:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201401.171426:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715366400:0@lo:400:kworker.0 00000100:00100000:2.0:1788201401.171442:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715366272:0@lo:400:kworker.0 00000100:00100000:0.0:1788201401.171443:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715366912:0@lo:400:kworker.0 00000100:00100000:0.0:1788201401.171464:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715366016:0@lo:400:kworker.0 00000100:00100000:0.0:1788201401.171480:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715366528:0@lo:400:kworker.0 00000100:00100000:2.0:1788201401.171485:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201401.171500:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715367040:0@lo:400:kworker.0 00000100:00100000:2.0:1788201401.171522:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715366784:0@lo:400:kworker.0 00000100:00100000:0.0:1788201401.171536:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201401.171546:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715367424:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201401.171553:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201401.171574:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715367296:0@lo:400:kworker.0 00000100:00100000:0.0:1788201401.171583:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201401.171615:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715366784 00000100:00100000:0.0:1788201401.171620:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715366784 00000100:00100000:0.0:1788201401.171647:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1723 00000100:00100000:0.0:1788201401.171653:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f2e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715366784:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788201401.171666:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12f2e0380 x1875060715366784/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:522/0 lens 224/224 e 0 to 0 dl 1788201412 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201401.171710:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715367424 00000100:00100000:0.0:1788201401.171714:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f2e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715366784:12345-0@lo:400:kworker.0 Request processed in 60us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201401.171717:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715367424 00000100:00100000:0.0:1788201401.171726:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1723 00000100:00100000:1.0:1788201401.171869:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788201401.171887:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3656:x1875060715367424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201401.171922:0:101344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444925440 avail 1298685952 00010000:00000080:1.0:1788201401.171937:0:101344:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc001e43480 x1875060715367424/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:522/0 lens 224/368 e 0 to 0 dl 1788201412 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201401.172252:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3656:x1875060715367424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 375us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201401.172270:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788201401.173402:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201401.173479:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715366784:0@lo:400:kworker.0 00000100:00100000:3.0:1788201401.173636:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715367296 00000100:00100000:3.0:1788201401.173645:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715367296 00000100:00100000:1.0:1788201401.173666:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715366272 00000100:00100000:1.0:1788201401.173672:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715366272 00000100:00100000:1.0:1788201401.173719:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788201401.173720:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1724 00000100:00100000:1.0:1788201401.173733:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715366272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201401.173735:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715367296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201401.173814:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715367296:12345-0@lo:400:kworker.0 Request processed in 84us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201401.173822:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1724 00010000:00080000:2.0:1788201401.173843:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc120090a80 x1875060715366272/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201401.173855:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715366272:0@lo:400:kworker.0 00000100:00100000:2.0:1788201401.173869:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715367296:0@lo:400:kworker.0 00000100:00100000:3.0:1788201401.173884:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715367168:0@lo:400:kworker.0 00000100:00100000:3.0:1788201401.173906:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715365632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201401.173916:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715366144:0@lo:400:kworker.0 00010000:00080000:3.0:1788201401.173928:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc120090380 x1875060715366656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201401.173946:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715366656:0@lo:400:kworker.0 00000100:00100000:3.0:1788201401.173979:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715365760 00000100:00100000:3.0:1788201401.173983:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715365760 00000100:00100000:3.0:1788201401.174007:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788201401.174032:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715365760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201401.174062:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1788201401.174161:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715366272:12345-0@lo:400:kworker.0 Request processed in 430us (2678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201401.174169:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788201401.174207:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201401.174253:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715367424:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201401.180666:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715365760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6636us (9249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201401.180687:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788201401.180792:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715365760:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788201402.129167:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201402.328191:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201402.328425:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695526528 00000100:00100000:1.0:1788201402.328436:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695526528 00000100:00100000:2.0:1788201402.328445:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201402.328485:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201402.328510:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00080000:3.0:1788201402.328566:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201402.328576:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695526784 00000100:00100000:0.0:1788201402.328582:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695526784 00000100:00100000:1.0:1788201402.328616:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695526656 00000100:00100000:1.0:1788201402.328622:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695526656 00000100:00100000:1.0:1788201402.328666:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1725 00000100:00100000:1.0:1788201402.328677:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f2e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2402:x1875060695526528:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000080:1.0:1788201402.328708:0:66757:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12f2e1880 x1875060695526528/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:523/0 lens 224/224 e 0 to 0 dl 1788201413 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201402.328709:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201402.328743:0:94461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695526400 00000100:00100000:2.0:1788201402.328748:0:94461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695526400 00000100:00100000:1.0:1788201402.328774:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f2e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2402:x1875060695526528:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 98us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201402.328782:0:94461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 341 00000100:00100000:2.0:1788201402.328795:0:94461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695526400:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201402.328798:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1725 00000100:00100000:1.0:1788201402.328830:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1726 00000100:00100000:2.0:1788201402.328830:0:94461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695526400:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 35us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201402.328839:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f2e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2402:x1875060695526656:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201402.328843:0:94461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 341 00000100:00100000:1.0:1788201402.328877:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f2e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2402:x1875060695526656:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 39us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201402.328885:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1726 00000100:00080000:1.0:1788201402.328923:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201402.328927:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201402.328942:0:101189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695526912 00000100:00100000:1.0:1788201402.328947:0:101189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695526912 00000100:00100000:1.0:1788201402.328982:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 25 00000100:00100000:0.0:1788201402.329098:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:0.0:1788201402.329107:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695526784:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201402.329139:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f2e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695526912:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201402.329147:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695526784:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 41us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201402.329153:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:1.0:1788201402.329192:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f2e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695526912:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 201us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201402.329200:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 25 00000100:00080000:1.0:1788201402.329221:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788201402.705729:0:94457:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051764 is committed 00000001:00080000:3.0:1788201402.705743:0:94457:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051762 is committed 00010000:00010000:2.0:1788201402.705791:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1de33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201402.705804:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1de33 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201402.705828:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1de33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201402.705834:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201402.705839:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1de33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201402.705848:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1de33 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201402.705865:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc103255400) 00010000:00010000:2.0:1788201402.705868:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201402.705872:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1de33 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201402.705878:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74800/0x96d0c9b8c9a1de33 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201402.705894:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75200/0x96d0c9b8c9a1de6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201402.705900:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75200/0x96d0c9b8c9a1de6b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201402.705906:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75200/0x96d0c9b8c9a1de6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201402.705911:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201402.705914:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75200/0x96d0c9b8c9a1de6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201402.705931:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75200/0x96d0c9b8c9a1de6b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201402.705941:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc103255400) 00010000:00010000:2.0:1788201402.705944:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201402.705946:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75200/0x96d0c9b8c9a1de6b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201402.705952:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75200/0x96d0c9b8c9a1de6b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:02000400:1.0:1788201402.956665:0:101729:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:0.0:1788201403.057457:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201403.057611:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695527040 00000100:00100000:3.0:1788201403.057625:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695527040 00000100:00100000:3.0:1788201403.057707:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1679 00000100:00100000:3.0:1788201403.057720:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:76349:x1875060695527040:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:3.0:1788201403.057749:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201403.057789:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1de80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786da4 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.057879:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de87 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.057897:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.057911:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201403.057974:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788201403.057978:0:69485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201403.058032:0:69485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.058061:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1de80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786da4 expref: 12 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.058080:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786da4 expref: 11 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.058089:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:3.0:1788201403.058092:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201403.058096:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c74e00, rc 0) 00010000:00000080:3.0:1788201403.058104:0:69485:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc001e42a00 x1875060695527040/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:524/0 lens 576/688 e 0 to 0 dl 1788201414 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201403.058186:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:76349:x1875060695527040:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 470us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201403.058193:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1679 00000100:00100000:0.0:1788201403.063941:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201403.064881:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695527168 00000100:00100000:3.0:1788201403.064897:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695527168 00000100:00100000:3.0:1788201403.064976:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1680 00000100:00100000:3.0:1788201403.064988:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:76349:x1875060695527168:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:3.0:1788201403.065036:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201403.065062:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1de8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786dab expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.065154:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1de95 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.065170:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1de95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.065182:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1de95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.065196:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1de9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.065202:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1de9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.065208:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1de9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.065273:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75800/0x96d0c9b8c9a1dea3 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.065280:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75800/0x96d0c9b8c9a1dea3 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.065285:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75800/0x96d0c9b8c9a1dea3 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201403.065935:0:66313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75800/0x96d0c9b8c9a1dea3 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.065963:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1de95 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.065980:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1de95 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.065987:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1de95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.065994:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1de95 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.066001:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201403.066039:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1de95 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.066049:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1de95 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.066062:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12b661a00) 00010000:00010000:3.0:1788201403.066065:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201403.066070:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1de95 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.066077:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1de95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.066092:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1de9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.066099:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1de9c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.066105:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1de9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.066116:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201403.066119:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1de9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.066125:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1de9c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.066134:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc9f42202 (ffff8dc004b23000) 00010000:00010000:3.0:1788201403.066137:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201403.066140:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1de9c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.066146:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1de9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.066191:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1de8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dab expref: 13 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.066207:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75800/0x96d0c9b8c9a1dea3 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dab expref: 12 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.066214:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0x0 (ffff8dc0084fb400) 00010000:00010000:3.0:1788201403.066216:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201403.066218:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c75800, rc 0) 00010000:00000080:3.0:1788201403.066229:0:66313:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc001e43b80 x1875060695527168/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:524/0 lens 592/584 e 0 to 0 dl 1788201414 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201403.066325:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:76349:x1875060695527168:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 1338us (2400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201403.066343:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1680 00000100:00100000:3.0:1788201403.073326:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201403.073400:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201403.073443:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695527424 00000100:00100000:3.0:1788201403.073456:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695527424 00000100:00100000:3.0:1788201403.073540:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 737 00000100:00100000:3.0:1788201403.073553:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2400:x1875060695527424:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201403.073573:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201403.073607:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75800/0x96d0c9b8c9a1dea3 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dab expref: 12 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.073633:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0x0 (ffff8dc0084fb400) 00010000:00010000:3.0:1788201403.073639:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201403.073704:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2400:x1875060695527424:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 153us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201403.073711:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 737 00000100:00100000:2.0:1788201403.073812:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695527296 00000100:00100000:2.0:1788201403.073817:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695527296 00000100:00100000:2.0:1788201403.073860:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1681 00000100:00100000:2.0:1788201403.073867:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:76349:x1875060695527296:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:2.0:1788201403.073888:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201403.073914:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1deaa lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786db2 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201403.073981:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1deb1 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201403.073994:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1deb1 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201403.074036:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1deb1 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201403.074092:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x6:0x0]: returning size 4096 00000004:00200000:2.0:1788201403.074110:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1788201403.074156:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1deaa lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786db2 expref: 13 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201403.074171:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1deb1 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786db2 expref: 12 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201403.074178:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0x0 (ffff8dc006c71800) 00010000:00010000:2.0:1788201403.074181:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1788201403.074183:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbd600, rc 0) 00000100:00100000:2.0:1788201403.074210:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:76349:x1875060695527296:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 344us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201403.074216:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1681 00000100:00100000:2.0:1788201403.079755:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201403.079843:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695527552 00000100:00100000:1.0:1788201403.079856:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695527552 00000100:00100000:1.0:1788201403.079932:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1682 00000100:00100000:1.0:1788201403.079944:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:76349:x1875060695527552:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:1.0:1788201403.079971:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201403.080000:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1deb8 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786db9 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080124:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1debf lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080140:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1debf lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080153:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1debf lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080169:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1dec6 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080176:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1dec6 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080197:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1dec6 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080324:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1decd lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080332:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1decd lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x7:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080338:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1decd lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x7:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201403.080434:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x7:0x0]: returning size 4096 00000004:00200000:1.0:1788201403.080439:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1788201403.080463:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1decd lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x7:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080477:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1debf lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080484:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1debf lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080489:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1debf lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080495:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1debf lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080501:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ede00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201403.080506:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1debf lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080513:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1debf lrc: 5/0,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080533:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0x0 (ffff8dc006c71800) 00010000:00010000:1.0:1788201403.080536:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201403.080540:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1debf lrc: 3/0,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080547:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1debf lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080564:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1dec6 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080570:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1dec6 lrc: 2/0,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080575:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1dec6 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080580:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ece00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201403.080583:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1dec6 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080589:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1dec6 lrc: 4/0,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080596:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0xd1d4b922 (ffff8dc108994300) 00010000:00010000:1.0:1788201403.080598:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201403.080601:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1dec6 lrc: 2/0,0 mode: --/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080608:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1dec6 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080673:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1deb8 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786db9 expref: 14 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080688:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1decd lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x7:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786db9 expref: 13 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.080695:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x7:0x0].0x0 (ffff8dc108994d00) 00010000:00010000:1.0:1788201403.080697:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788201403.080700:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ec000, rc 0) 00000100:00100000:1.0:1788201403.080781:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:76349:x1875060695527552:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 839us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201403.080790:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1682 00000100:00100000:0.0:1788201403.087323:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201403.088895:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695527680 00000100:00100000:1.0:1788201403.088915:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695527680 00000100:00100000:1.0:1788201403.089776:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1683 00000100:00100000:1.0:1788201403.089794:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:76349:x1875060695527680:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:1.0:1788201403.089822:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201403.089849:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1ded4 lrc: 2/0,0 mode: --/CR res: [0x2400088d0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786dc0 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.089922:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1dedb lrc: 3/1,0 mode: --/PR res: [0x2400088d0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.089939:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1dedb lrc: 3/1,0 mode: PR/PR res: [0x2400088d0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.089952:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1dedb lrc: 3/1,0 mode: PR/PR res: [0x2400088d0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201403.090065:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d0:0x6:0x0]: returning size 4096 00000004:00200000:1.0:1788201403.090071:0:66313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1788201403.090117:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1ded4 lrc: 0/0,0 mode: --/CR res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dc0 expref: 15 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.090137:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1dedb lrc: 3/0,0 mode: PR/PR res: [0x2400088d0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dc0 expref: 14 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.090147:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x6:0x0].0x0 (ffff8dc108994900) 00010000:00010000:1.0:1788201403.090150:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788201403.090154:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ed400, rc 0) 00000100:00100000:1.0:1788201403.090243:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:76349:x1875060695527680:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 454us (2935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201403.090252:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1683 00000100:00100000:0.0:1788201403.100972:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201403.101150:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695527808 00000100:00100000:3.0:1788201403.101165:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695527808 00000100:00100000:3.0:1788201403.101239:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1684 00000100:00100000:3.0:1788201403.101251:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:76349:x1875060695527808:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:3.0:1788201403.101276:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201403.101304:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75800/0x96d0c9b8c9a1dee2 lrc: 2/0,0 mode: --/CR res: [0x2000090a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786dc7 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.101479:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1dee9 lrc: 3/1,0 mode: --/PR res: [0x2000090a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.101506:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1dee9 lrc: 3/1,0 mode: PR/PR res: [0x2000090a1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.101519:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1dee9 lrc: 3/1,0 mode: PR/PR res: [0x2000090a1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201403.101582:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000090a1:0x6:0x0]: returning size 4096 00000004:00200000:3.0:1788201403.101587:0:69485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1788201403.101634:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75800/0x96d0c9b8c9a1dee2 lrc: 0/0,0 mode: --/CR res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dc7 expref: 13 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.101653:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1dee9 lrc: 3/0,0 mode: PR/PR res: [0x2000090a1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dc7 expref: 12 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.101662:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x6:0x0].0x0 (ffff8dc004b23000) 00010000:00010000:3.0:1788201403.101665:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201403.101668:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c75600, rc 0) 00010000:00000080:3.0:1788201403.101678:0:69485:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc001e43800 x1875060695527808/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:524/0 lens 576/640 e 0 to 0 dl 1788201414 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201403.101797:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:76349:x1875060695527808:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 547us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201403.101805:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1684 00000100:00100000:0.0:1788201403.107961:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201403.108094:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695528064 00000100:00100000:1.0:1788201403.108110:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695528064 00000100:00100000:1.0:1788201403.108196:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1685 00000100:00100000:1.0:1788201403.108209:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:76349:x1875060695528064:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:1.0:1788201403.108239:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201403.108242:0:66312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788201403.108281:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c75600/0x96d0c9b8c9a1dee9 lrc: 0/0,0 mode: --/PR res: [0x2000090a1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dc7 expref: 12 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.108302:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x6:0x0].0x0 (ffff8dc004b23000) 00010000:00010000:1.0:1788201403.108327:0:66312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201403.108348:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1def0 lrc: 2/0,0 mode: --/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786dce expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.108529:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1def7 lrc: 3/0,1 mode: --/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.108545:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1def7 lrc: 3/0,1 mode: CW/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.108557:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1def7 lrc: 3/0,1 mode: CW/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.108572:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1defe lrc: 3/0,1 mode: --/PW res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.108580:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1defe lrc: 3/0,1 mode: PW/PW res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.108587:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1defe lrc: 3/0,1 mode: PW/PW res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201403.110138:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x31:0x0]: returning size 4096 00010000:00010000:1.0:1788201403.110171:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1df05 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.110185:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1df05 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.110196:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1df05 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.110294:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1def7 lrc: 4/0,1 mode: CW/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.110372:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1def7 lrc: 4/0,1 mode: CW/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.110379:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1def7 lrc: 3/0,0 mode: CW/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.110386:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1def7 lrc: 4/0,0 mode: CW/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.110391:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ece00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201403.110396:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1def7 lrc: 4/0,0 mode: CW/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.110404:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1def7 lrc: 5/0,0 mode: CW/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.110418:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x6:0x0].0x0 (ffff8dc108994300) 00010000:00010000:1.0:1788201403.110420:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201403.110425:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1def7 lrc: 3/0,0 mode: --/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.110430:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1def7 lrc: 0/0,0 mode: --/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201403.110447:0:66312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093e9a665 reply state 000000003f9cc496 transno 124554051765 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1defe lrc: 3/0,1 mode: PW/PW res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.110460:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1defe lrc: 3/0,1 mode: TXN/TXN res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.110466:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x6:0x0].0xcd52553e (ffff8dc108994600) 00010000:00010000:1.0:1788201403.110474:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201403.110477:0:66312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201403.110525:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1def0 lrc: 0/0,0 mode: --/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dce expref: 14 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.110547:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1df05 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dce expref: 13 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201403.110554:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x31:0x0].0x0 (ffff8dc108994200) 00010000:00010000:1.0:1788201403.110556:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201403.110558:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ed200, rc 0) 00010000:00000080:1.0:1788201403.110569:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc001e41500 x1875060695528064/t124554051765(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:524/0 lens 520/584 e 0 to 0 dl 1788201414 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201403.110706:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:76349:x1875060695528064:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 2499us (2761us total) trans 124554051765 rc 0/0 00000100:00100000:1.0:1788201403.110717:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1685 00000100:00100000:1.0:1788201403.137954:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201403.140175:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695528320 00000100:00100000:3.0:1788201403.140196:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695528320 00000100:00100000:3.0:1788201403.140612:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1686 00000100:00100000:3.0:1788201403.140627:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:76350:x1875060695528320:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:3.0:1788201403.140657:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201403.140672:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788201403.140708:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed400/0x96d0c9b8c9a1dedb lrc: 0/0,0 mode: --/PR res: [0x2400088d0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dc0 expref: 14 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.140729:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x6:0x0].0x0 (ffff8dc108994900) 00010000:00010000:3.0:1788201403.140741:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201403.140762:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c75800/0x96d0c9b8c9a1df0c lrc: 2/0,0 mode: --/CW res: [0x2400088d0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786dd5 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.140944:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1df13 lrc: 3/0,1 mode: --/CW res: [0x2400088d0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.140959:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1df13 lrc: 3/0,1 mode: CW/CW res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.140971:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1df13 lrc: 3/0,1 mode: CW/CW res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.140988:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1df1a lrc: 3/0,1 mode: --/PW res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.140995:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1df1a lrc: 3/0,1 mode: PW/PW res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.141012:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1df1a lrc: 3/0,1 mode: PW/PW res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201403.141657:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x8:0x0]: returning size 4096 00010000:00010000:3.0:1788201403.141678:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1df21 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.141689:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1df21 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.141703:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1df21 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.141718:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1df13 lrc: 4/0,1 mode: CW/CW res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.141725:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1df13 lrc: 4/0,1 mode: CW/CW res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.141730:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1df13 lrc: 3/0,0 mode: CW/CW res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.141738:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1df13 lrc: 4/0,0 mode: CW/CW res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.141745:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201403.141750:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1df13 lrc: 4/0,0 mode: CW/CW res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.141758:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1df13 lrc: 5/0,0 mode: CW/CW res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.141769:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x6:0x0].0x0 (ffff8dc004b23c00) 00010000:00010000:3.0:1788201403.141772:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201403.141778:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1df13 lrc: 3/0,0 mode: --/CW res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.141785:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c74a00/0x96d0c9b8c9a1df13 lrc: 0/0,0 mode: --/CW res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201403.141799:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dfc3f813 reply state 00000000366129f5 transno 77309411479 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1df1a lrc: 3/0,1 mode: PW/PW res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.141818:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1df1a lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.141825:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x6:0x0].0xf0209d98 (ffff8dc004b23a00) 00010000:00010000:3.0:1788201403.141827:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201403.141831:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788201403.141874:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c75800/0x96d0c9b8c9a1df0c lrc: 0/0,0 mode: --/CW res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dd5 expref: 16 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.141895:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1df21 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dd5 expref: 15 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201403.141904:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x8:0x0].0x0 (ffff8dc004b23800) 00010000:00010000:3.0:1788201403.141906:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201403.141908:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c75400, rc 0) 00000100:00100000:3.0:1788201403.142051:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:76350:x1875060695528320:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 1427us (4110us total) trans 77309411479 rc 0/0 00000100:00100000:3.0:1788201403.142061:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1686 00010000:00010000:2.0:1788201403.151296:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201404.175537:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788201404.852319:0:101826:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788201404.852368:0:101826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ade400/0x96d0c9b8c9a1ca4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca52 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.852383:0:101826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ade400/0x96d0c9b8c9a1ca4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ca52 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.852390:0:101826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ade400/0x96d0c9b8c9a1ca4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ca52 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.852397:0:101826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc007ade400/0x96d0c9b8c9a1ca4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ca52 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.852425:0:101826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788201404.852444:0:101826:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788201404.852468:0:101826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201404.852471:0:101826:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788201404.852475:0:101826:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788201404.852499:0:101826:0:(import.c:65:import_set_state_nolock()) ffff8dc137d33000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788201404.852543:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715367552:0@lo:39:umount.0 00000100:00100000:1.0:1788201404.852599:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201404.852665:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201404.852671:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc007ade400/0x96d0c9b8c9a1ca4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1ca52 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201404.852677:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade400 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201404.852680:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc007ade400/0x96d0c9b8c9a1ca4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1ca52 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201404.852695:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007ade400/0x96d0c9b8c9a1ca4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1ca52 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201404.852700:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007ade400/0x96d0c9b8c9a1ca4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1ca52 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201404.852704:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201404.852706:0:6521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788201404.852707:0:6521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788201404.852738:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc007ade400/0x96d0c9b8c9a1ca4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ca52 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201404.852742:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788201404.852775:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715367680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201404.852799:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201404.852837:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715367680 00010000:00010000:0.0:1788201404.852842:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc007ade400/0x96d0c9b8c9a1ca4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ca52 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201404.852845:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715367680 00010000:00010000:0.0:1788201404.852850:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007ade400/0x96d0c9b8c9a1ca4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ca52 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201404.852859:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201404.852861:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201404.852862:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201404.852902:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:2.0:1788201404.852916:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10a227050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715367680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201404.852929:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201404.852947:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00896aa00/0x96d0c9b8c9a1ca52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca4b expref: 24 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.852958:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201404.853265:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715367552 00000100:00100000:3.0:1788201404.853420:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715367552 00000100:00100000:2.0:1788201404.853427:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10a227050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+23:3656:x1875060715367680:12345-0@lo:103:ldlm_bl.0 Request processed in 515us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201404.853428:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715367680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201404.853443:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:2.0:1788201404.856106:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1687 00000100:00100000:2.0:1788201404.856129:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875060715367552:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788201404.856162:0:66314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c6e0 00000100:00080000:2.0:1788201404.856173:0:66314:0:(import.c:65:import_set_state_nolock()) ffff8dc137d30800 : changing import state from FULL to CLOSED 00010000:00000080:2.0:1788201404.856211:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12efc9180 x1875060715367552/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:525/0 lens 224/224 e 0 to 0 dl 1788201415 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201404.856294:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3654:x1875060715367552:12345-0@lo:39:umount.0 Request processed in 177us (3693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201404.856346:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1687 00000020:00000080:2.0:1788201404.856362:0:66314:0:(genops.c:885:class_export_put()) final put ffff8dc137d37000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1788201404.856388:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788201404.856407:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d37000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788201404.856531:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc137d30800 for lustre-MDT0000 00000100:00080000:0.0:1788201404.857665:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc137d33000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788201404.857683:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715367552:0@lo:39:umount.0 00000100:00080000:3.0:1788201404.860399:0:101826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201404.860409:0:101826:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788201404.860418:0:101826:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788201404.866137:0:101826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adee00/0x96d0c9b8c9a1ca59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ca60 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.866186:0:101826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adee00/0x96d0c9b8c9a1ca59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ca60 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.866194:0:101826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adee00/0x96d0c9b8c9a1ca59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ca60 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.866201:0:101826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc007adee00/0x96d0c9b8c9a1ca59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ca60 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.866224:0:101826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201404.866233:0:101826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1d7a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1d7aa expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.866240:0:101826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1d7a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1d7aa expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.866248:0:101826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1d7a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1d7aa expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.866255:0:101826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1d7a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1d7aa expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.866273:0:101826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788201404.866292:0:101826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adea00/0x96d0c9b8c9a1c5cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c5d6 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201404.866296:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201404.866300:0:101826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adea00/0x96d0c9b8c9a1c5cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c5d6 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201404.866321:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc007adee00/0x96d0c9b8c9a1ca59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1ca60 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.866329:0:101826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007adea00/0x96d0c9b8c9a1c5cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1c5d6 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.866336:0:101826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc007adea00/0x96d0c9b8c9a1c5cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1c5d6 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201404.866358:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adee00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201404.866364:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc007adee00/0x96d0c9b8c9a1ca59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1ca60 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.866371:0:101826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788201404.866374:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007adee00/0x96d0c9b8c9a1ca59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1ca60 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.866383:0:101826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c4fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1c504 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201404.866384:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007adee00/0x96d0c9b8c9a1ca59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1ca60 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201404.866427:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201404.866428:0:101826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c4fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c504 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201404.866444:0:24979:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788201404.866449:0:101826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c4fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1c504 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.866460:0:101826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c4fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1c504 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.866479:0:101826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1788201404.866486:0:101826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788201404.866502:0:101826:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1788201404.866538:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc007adee00/0x96d0c9b8c9a1ca59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ca60 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201404.866550:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:2.0:1788201404.866576:0:101826:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788201404.866586:0:101826:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1788201404.866595:0:101826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1788201404.866607:0:101826:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:1.0:1788201404.866610:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc007adee00/0x96d0c9b8c9a1ca59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ca60 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201404.866625:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007adee00/0x96d0c9b8c9a1ca59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ca60 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201404.866653:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201404.866661:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1d7a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1d7aa expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201404.866668:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec400 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201404.866670:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1d7a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1d7aa expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201404.866690:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1d7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1d7aa expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201404.866695:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1d7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1d7aa expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201404.866700:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201404.866715:0:24979:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788201404.866718:0:24979:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788201404.866737:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1d7a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1d7aa expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201404.866743:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201404.866749:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1d7a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1d7aa expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201404.866755:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec400/0x96d0c9b8c9a1d7a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1d7aa expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201404.866765:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201404.866769:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc007adea00/0x96d0c9b8c9a1c5cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1c5d6 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201404.866775:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adea00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201404.866778:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc007adea00/0x96d0c9b8c9a1c5cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1c5d6 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201404.866782:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007adea00/0x96d0c9b8c9a1c5cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1c5d6 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201404.866793:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007adea00/0x96d0c9b8c9a1c5cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1c5d6 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201404.866797:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788201404.866798:0:24979:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788201404.866800:0:24979:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788201404.866809:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc007adea00/0x96d0c9b8c9a1c5cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c5d6 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201404.866813:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201404.866824:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc007adea00/0x96d0c9b8c9a1c5cf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c5d6 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201404.866830:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007adea00/0x96d0c9b8c9a1c5cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c5d6 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201404.866837:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201404.866840:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c4fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1c504 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201404.866844:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade200 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201404.866845:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c4fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1c504 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201404.866849:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c4fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1c504 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201404.866852:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c4fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1c504 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201404.866862:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201404.866863:0:24979:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788201404.866864:0:24979:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788201404.866872:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c4fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c504 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201404.866875:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201404.866879:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c4fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c504 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201404.866883:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc007ade200/0x96d0c9b8c9a1c4fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1c504 expref: -99 pid: 94456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201404.866888:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201404.866889:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201404.866890:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201404.866896:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201404.866910:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715367936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201404.866988:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201404.867059:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201404.867064:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715367808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201404.867081:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201404.867100:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715368064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201404.867112:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201404.867123:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201404.867126:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715368192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201404.867136:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201404.868057:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201404.868103:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715367936 00000100:00100000:3.0:1788201404.868115:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715367936 00000100:00100000:3.0:1788201404.868199:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715367808 00000100:00100000:3.0:1788201404.868203:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715367808 00000100:00100000:3.0:1788201404.868227:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715368064 00000100:00100000:3.0:1788201404.868230:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715368064 00000100:00100000:3.0:1788201404.868249:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715368192 00000100:00100000:3.0:1788201404.868252:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715368192 00000100:00100000:3.0:1788201404.868272:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:3.0:1788201404.868295:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+26:3658:x1875060715367936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201404.868313:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201404.868336:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00896be00/0x96d0c9b8c9a1d7aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d7a3 expref: 26 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201404.868514:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201404.868598:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+25:3658:x1875060715367936:12345-0@lo:103:ldlm_bl.0 Request processed in 306us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201404.868604:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:3.0:1788201404.868621:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:3.0:1788201404.868626:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715367808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201404.868632:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201404.868640:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140d58400/0x96d0c9b8c9a1ca60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca59 expref: 24 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201404.868647:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201404.868661:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+23:3658:x1875060715367808:12345-0@lo:103:ldlm_bl.0 Request processed in 36us (1579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201404.868666:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:3.0:1788201404.868673:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 741 00000100:00100000:3.0:1788201404.868676:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+22:3655:x1875060715368064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201404.868689:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201404.868695:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782cc00/0x96d0c9b8c9a1c5d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c5cf expref: 22 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201404.868701:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201404.868717:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+21:3655:x1875060715368064:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201404.868721:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 741 00000100:00100000:3.0:1788201404.868729:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:3.0:1788201404.868735:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+20:3655:x1875060715368192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201404.868741:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201404.868750:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fd600/0x96d0c9b8c9a1c504 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c4fd expref: 20 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201404.868758:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201404.868778:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+19:3655:x1875060715368192:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (1639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201404.868785:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000100:00100000:3.0:1788201404.868839:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715367808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201404.868849:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715367936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201404.868917:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715368192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201404.868926:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715368064:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201404.868984:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:2.0:1788201404.869411:0:101826:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:3.0:1788201404.871106:0:94457:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051765 is committed 00010000:00010000:2.0:1788201404.871506:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1defe lrc: 3/0,1 mode: TXN/TXN res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.871553:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1defe lrc: 2/0,0 mode: TXN/TXN res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.871561:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1defe lrc: 3/0,0 mode: TXN/TXN res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.871568:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ede00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201404.871574:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1defe lrc: 3/0,0 mode: TXN/TXN res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788201404.871578:0:101826:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00010000:00010000:2.0:1788201404.871582:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1defe lrc: 4/0,0 mode: TXN/TXN res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788201404.871592:0:101826:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc11077f800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201404.871600:0:101826:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc11ccff000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1788201404.871604:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x6:0x0].0xcd52553e (ffff8dc108994600) 00000020:00080000:1.0:1788201404.871606:0:101826:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc11d63e800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1788201404.871611:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:1.0:1788201404.871617:0:101826:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc103483800 6e293f14-c501-4bc5-9dd4-a18ef02756b4 192.168.201.20@tcp 12 (0 0 6) 0 0 0 0: 0000000000000000 124554051765 stale:0 00010000:00010000:2.0:1788201404.871619:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1defe lrc: 2/0,0 mode: --/TXN res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788201404.871627:0:101826:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc103486000 lustre-MDT0001-mdtlov_UUID 0@lo 6 (0 0 1) 0 0 0 0: 0000000000000000 124554051762 stale:0 00000020:00080000:1.0:1788201404.871634:0:101826:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff8dc13f870000) has exports, disconnecting them 00010000:00010000:2.0:1788201404.871636:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ede00/0x96d0c9b8c9a1defe lrc: 0/0,0 mode: --/TXN res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788201404.871640:0:101826:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc11077f800), last request at 1788201401 00000020:00000080:1.0:1788201404.871653:0:101826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d780 00000100:00080000:1.0:1788201404.871663:0:101826:0:(import.c:65:import_set_state_nolock()) ffff8dc00397e800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201404.871714:0:101826:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc11077f800): rc 0 00010000:00010000:3.0:1788201404.871717:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201404.871718:0:101826:0:(genops.c:885:class_export_put()) final put ffff8dc11077f800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788201404.871743:0:101826:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc11ccff000), last request at 1788201401 00000020:00000080:1.0:1788201404.871747:0:101826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d6e6 00000100:00080000:1.0:1788201404.871752:0:101826:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfc000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788201404.871770:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11077f800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00080000:1.0:1788201404.871774:0:101826:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc11ccff000): rc 0 00000020:00000080:1.0:1788201404.871778:0:101826:0:(genops.c:885:class_export_put()) final put ffff8dc11ccff000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788201404.871787:0:101826:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc11d63e800), last request at 1788201206 00000020:00000080:1.0:1788201404.871790:0:101826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c6d9 00000100:00080000:1.0:1788201404.871794:0:101826:0:(import.c:65:import_set_state_nolock()) ffff8dc103483000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201404.871810:0:101826:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc11d63e800): rc 0 00000020:00000080:1.0:1788201404.871813:0:101826:0:(genops.c:885:class_export_put()) final put ffff8dc11d63e800/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:2.0:1788201404.871828:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788201404.871830:0:101826:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.201.20@tcp (ffff8dc103483800), last request at 1788201403 00000020:00000080:1.0:1788201404.871840:0:101826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c551 00000020:00010000:1.0:1788201404.871850:0:101826:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc103483800: total 3 00000100:00080000:1.0:1788201404.871852:0:101826:0:(import.c:65:import_set_state_nolock()) ffff8dc103ca4800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201404.871891:0:101826:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.201.20@tcp (ffff8dc103483800): rc 0 00000020:00080000:1.0:1788201404.871894:0:101826:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc103486000), last request at 1788201200 00000020:00000080:1.0:1788201404.871896:0:101826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c54a 00000020:00010000:1.0:1788201404.871899:0:101826:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc103486000: total 3 00000100:00080000:1.0:1788201404.871900:0:101826:0:(import.c:65:import_set_state_nolock()) ffff8dc137d36000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201404.871907:0:101826:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc103486000): rc 0 00000004:00000080:1.0:1788201404.871911:0:101826:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa0dd41ca7ae0 00000020:00010000:2.0:1788201404.871913:0:6521:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc103483800: total 3 00000100:00080000:1.0:1788201404.871928:0:101826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788201404.871932:0:101826:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1788201404.871960:0:6521:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc103483800, canceled 0 locks, left on hash table 6. 00010000:00010000:2.0:1788201404.872002:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1ddca lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786d7a expref: 7 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.872056:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896a400/0x96d0c9b8c9a1c91e lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78693d expref: 6 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.872092:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74e00/0x96d0c9b8c9a1de87 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786da4 expref: 5 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.872108:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc00896b400/0x96d0c9b8c9a1c96b lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786959 expref: 4 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.872125:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc100030c00/0x96d0c9b8c9a1c902 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786936 expref: 3 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.872144:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1df05 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dce expref: 2 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201404.872159:0:6521:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc103483800, canceled 6 locks, left on hash table 0. 00000020:00000080:3.0:1788201404.873069:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11ccff000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788201404.877052:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc00397e800 for lustre-MDT0000 00000020:00000080:3.0:1788201404.877081:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d63e800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788201404.877231:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc11ccfc000 for lustre-MDT0000 00000020:00000080:3.0:1788201404.877236:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc103483000 for lustre-MDT0000 00000020:00010000:3.0:1788201404.877251:0:6520:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc103486000: total 0 00010000:00010000:3.0:1788201404.877256:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201404.878174:0:6520:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc103486000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788201404.878235:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0078fca00/0x96d0c9b8c9a1c70a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1be0b expref: 2 pid: 94490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201404.878275:0:6520:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc103486000, canceled 1 locks, left on hash table 0. 00000100:00080000:1.0:1788201404.879280:0:101826:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788201404.879322:0:101826:0:(import.c:65:import_set_state_nolock()) ffff8dc104281000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788201404.879677:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715368320:0@lo:39:umount.0 00000100:00100000:0.0:1788201404.879869:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201404.880322:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715368320 00000100:00100000:1.0:1788201404.880331:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715368320 00000100:00100000:1.0:1788201404.880386:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788201404.880396:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715368320:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788201404.880423:0:66318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c582 00000100:00080000:1.0:1788201404.880431:0:66318:0:(import.c:65:import_set_state_nolock()) ffff8dc11d63f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788201404.880457:0:66318:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 18, last_transno is 77309411479 00000100:00100000:1.0:1788201404.880597:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3654:x1875060715368320:12345-0@lo:39:umount.0 Request processed in 201us (728us total) trans 77309411480 rc 0/0 00000100:00100000:1.0:1788201404.880604:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:1.0:1788201404.882391:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201404.882460:0:101826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788201404.882465:0:101826:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901909 gen 4 00000004:00080000:1.0:1788201404.882492:0:101826:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788201404.882551:0:101826:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788201404.882571:0:101826:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788201404.882582:0:101826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788201404.882584:0:101826:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969457 gen 4 00000004:00080000:1.0:1788201404.882592:0:101826:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788201404.882643:0:101826:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788201404.882650:0:101826:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f0800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788201404.882692:0:101826:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8dc13f870000) has no exports 00000100:00100000:0.0:1788201404.882919:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715368448:0@lo:9:umount.0 00000100:00100000:0.0:1788201404.882988:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201404.883049:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715368576:0@lo:9:umount.0 00000100:00100000:0.0:1788201404.883072:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788201404.883107:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc104281000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788201404.883114:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715368320:0@lo:39:umount.0 00000100:00100000:0.0:1788201404.883146:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715368448 00000100:00100000:0.0:1788201404.883152:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715368448 00000100:00100000:0.0:1788201404.883202:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715368576 00000100:00100000:0.0:1788201404.883206:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715368576 00000100:00100000:0.0:1788201404.883540:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788201404.883553:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715368448:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788201404.883573:0:100688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d7db 00000100:00080000:0.0:1788201404.883586:0:100688:0:(import.c:65:import_set_state_nolock()) ffff8dc12f19c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788201404.883624:0:100688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901909 00000100:00100000:0.0:1788201404.884877:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3654:x1875060715368448:12345-0@lo:9:umount.0 Request processed in 1326us (1886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201404.884943:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788201404.884967:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788201404.884988:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715368576:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788201404.885004:0:100688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d7bf 00000100:00080000:0.0:1788201404.885031:0:100688:0:(import.c:65:import_set_state_nolock()) ffff8dc11cddb800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788201404.885058:0:100688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1788201404.886122:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3654:x1875060715368576:12345-0@lo:9:umount.0 Request processed in 1134us (3045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201404.886131:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1788201404.886157:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201404.886161:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201404.886251:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109815000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788201404.886272:0:3654:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788201404.886274:0:3654:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201404.886277:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715368448:0@lo:9:umount.0 00010000:00080000:0.0:1788201404.886293:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc11cd19180 x1875060715368576/t0(0) o9->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201404.886303:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f0800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788201404.886307:0:3654:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788201404.886308:0:3654:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201404.886311:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715368576:0@lo:9:umount.0 00010000:00010000:0.0:1788201404.886340:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788201404.889040:0:101826:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8dc13f870000) has no exports 00010000:00010000:0.0:1788201404.894410:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788201404.931093:0:6521:0:(genops.c:885:class_export_put()) final put ffff8dc103483800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 00010000:00010000:2.0:1788201404.931166:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201404.931170:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201404.931175:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788201404.933106:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc103483800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 for lustre-MDT0000 00000020:00000080:0.0:1788201404.933181:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc103ca4800 for lustre-MDT0000 00000020:00000080:3.0:1788201404.964782:0:6520:0:(genops.c:885:class_export_put()) final put ffff8dc103486000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788201404.964886:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc103486000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788201404.964981:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc137d36000 for lustre-MDT0000 00010000:00010000:2.0:1788201404.964997:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201404.965000:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201404.965003:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201405.001256:0:101826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c566 00000020:00000080:1.0:1788201405.001272:0:101826:0:(genops.c:885:class_export_put()) final put ffff8dc004010000/lustre-QMT0000_UUID 00000020:01000000:1.0:1788201405.001289:0:101826:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788201405.001458:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc004010000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788201405.001481:0:101826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201405.001492:0:101826:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788201405.001497:0:101826:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8dc004044d28) has no exports 00000020:00000080:0.0:1788201405.003607:0:101826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c55f 00000020:00000080:0.0:1788201405.003622:0:101826:0:(genops.c:885:class_export_put()) final put ffff8dc106073800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788201405.003714:0:101826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201405.003726:0:101826:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788201405.003729:0:101826:0:(genops.c:885:class_export_put()) final put ffff8dc106071000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788201405.003745:0:101826:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc106071000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788201405.003751:0:101826:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788201405.004196:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc106073800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788201405.004263:0:101826:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc0055e59c0 - data ffff8dc1338c9af8/ffff8dc12bfd5800 00000020:01000000:0.0:1788201405.004406:0:101826:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc1060905a0 - data ffff8dc1338f9288/ffff8dc120148c00 00000100:00080000:2.0:1788201405.049839:0:101826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788201405.049848:0:101826:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788201405.049862:0:101826:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8dc11cd19c00 x1875060715368320/t77309411480(77309411480) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201414 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201405.049912:0:101826:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788201405.051115:0:101826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788201405.051121:0:101826:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901909 gen 5 00000004:00080000:2.0:1788201405.051136:0:101826:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201405.051139:0:101826:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788201405.051505:0:94474:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788201405.051510:0:94474:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x74:0x0] index 22 count 1 00000040:00080000:1.0:1788201405.051519:0:94474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 29 count 2 00000100:00080000:2.0:1788201405.052132:0:101826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788201405.052136:0:101826:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969457 gen 5 00000004:00080000:2.0:1788201405.052149:0:101826:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201405.052151:0:101826:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788201405.052465:0:94476:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788201405.052469:0:94476:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x76:0x0] index 1 count 1 00000040:00080000:1.0:1788201405.052477:0:94476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 29 count 2 00000020:00000080:2.0:1788201405.053322:0:101826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c520 00000020:00000080:2.0:1788201405.053332:0:101826:0:(genops.c:885:class_export_put()) final put ffff8dc10630d800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788201405.053966:0:101826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c535 00000020:00000080:2.0:1788201405.053984:0:101826:0:(genops.c:885:class_export_put()) final put ffff8dc0059d7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201405.056384:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc10630d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788201405.060056:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0059d7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788201405.060234:0:101826:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788201405.060244:0:101826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201405.060257:0:101826:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788201405.060263:0:101826:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8dc13f874d28) has no exports 00000004:01000000:2.0:1788201405.060438:0:101826:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788201405.060448:0:101826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c5b3 00000020:00000080:2.0:1788201405.060457:0:101826:0:(genops.c:885:class_export_put()) final put ffff8dc005d73000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788201405.060478:0:101826:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788201405.060482:0:101826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201405.060489:0:101826:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788201405.060492:0:101826:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8dc12ef63370) has no exports 00000020:00000080:2.0:1788201405.060498:0:101826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c5a5 00000020:00000080:2.0:1788201405.060502:0:101826:0:(genops.c:885:class_export_put()) final put ffff8dc005d73800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788201405.060806:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005d73000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788201405.060814:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005d73800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788201405.060950:0:101826:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788201405.060954:0:101826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788201405.060959:0:101826:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969457 gen 6 00000004:00080000:2.0:1788201405.060964:0:101826:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201405.060977:0:101826:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788201405.061055:0:101826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201405.061064:0:101826:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201405.061069:0:101826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c597 00000020:00000080:2.0:1788201405.061074:0:101826:0:(genops.c:885:class_export_put()) final put ffff8dc005d70800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788201405.061079:0:101826:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788201405.061082:0:101826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201405.061086:0:101826:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788201405.061089:0:101826:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8dc12f0c0000) has no exports 00000020:00000080:2.0:1788201405.061093:0:101826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c590 00000020:00000080:2.0:1788201405.061095:0:101826:0:(genops.c:885:class_export_put()) final put ffff8dc109812000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788201405.061404:0:101826:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788201405.061407:0:101826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788201405.061409:0:101826:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901909 gen 6 00000004:00080000:2.0:1788201405.061412:0:101826:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201405.061414:0:101826:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788201405.061436:0:101826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201405.061442:0:101826:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1788201405.061453:0:101826:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788201405.061458:0:101826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c57b 00000020:00000080:2.0:1788201405.061462:0:101826:0:(genops.c:885:class_export_put()) final put ffff8dc0059d5000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788201405.061465:0:101826:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1788201405.061468:0:101826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201405.061473:0:101826:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788201405.061475:0:101826:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8dc004040000) has no exports 00000020:00000080:2.0:1788201405.061478:0:101826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c574 00000020:00000080:2.0:1788201405.061480:0:101826:0:(genops.c:885:class_export_put()) final put ffff8dc104283800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788201405.061840:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1257f0800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788201405.061847:0:76267:0:(genops.c:885:class_export_put()) final put ffff8dc005d74800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201405.061849:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005d74800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788201405.061853:0:76267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201405.061930:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005d70800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788201405.061934:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc109812000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788201405.061937:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc109815000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788201405.061941:0:76267:0:(genops.c:885:class_export_put()) final put ffff8dc106309000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201405.061943:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc106309000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788201405.061946:0:76267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201405.061986:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0059d5000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788201405.061991:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc104283800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788201405.063056:0:101826:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1788201405.063070:0:101826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788201405.063074:0:101826:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788201405.063078:0:101826:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788201405.063119:0:101826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201405.063129:0:101826:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201405.063157:0:101826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201405.063161:0:101826:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201405.063165:0:101826:0:(genops.c:885:class_export_put()) final put ffff8dc109816800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201405.063168:0:101826:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc109816800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788201405.063173:0:101826:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201405.063242:0:101826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c53c 00000020:00000080:3.0:1788201405.063248:0:101826:0:(genops.c:885:class_export_put()) final put ffff8dc12f1ab800/lustre-MDD0000_UUID 00000020:01000000:3.0:1788201405.063252:0:101826:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788201405.063255:0:101826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201405.063259:0:101826:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788201405.063262:0:101826:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8dc13f8719b8) has no exports 00000020:00000080:3.0:1788201405.063281:0:101826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201405.063284:0:101826:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788201405.063288:0:101826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c543 00000020:00000080:3.0:1788201405.063291:0:101826:0:(genops.c:885:class_export_put()) final put ffff8dc005d72000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788201405.063297:0:101826:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc11d438000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788201405.063300:0:101826:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc11d438000 3 00000020:01000004:3.0:1788201405.063303:0:101826:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dc11d438000 from lustre-MDT0000 00000020:00000080:3.0:1788201405.063325:0:101826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201405.063329:0:101826:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788201405.063331:0:101826:0:(genops.c:885:class_export_put()) final put ffff8dc10630a000/lustre-MDT0000_UUID 00000020:00000080:3.0:1788201405.063333:0:101826:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc10630a000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788201405.063340:0:101826:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788201405.063368:0:101826:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1788201405.063372:0:101826:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788201405.063374:0:101826:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788201405.063376:0:101826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201405.063384:0:101826:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788201405.063391:0:101826:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8dc110735800 c9b18af6-fecc-4172-82c2-66531890fe11 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201405.063399:0:101826:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8dc13aa9c000 93ba7067-43b5-4e46-8db7-27c040fa03d9 192.168.201.20@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201405.063403:0:101826:0:(genops.c:1553:class_disconnect_exports()) OBD device 3 (ffff8dc1060e3370) has exports, disconnecting them 00000020:00080000:3.0:1788201405.063408:0:101826:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8dc110735800), last request at 1788201200 00000020:00000080:3.0:1788201405.063429:0:101826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c4ef 00000020:00010000:3.0:1788201405.063433:0:101826:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc110735800: total 2 00000100:00080000:3.0:1788201405.063436:0:101826:0:(import.c:65:import_set_state_nolock()) ffff8dc110732000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788201405.063447:0:101826:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc110735800): rc 0 00000020:00080000:3.0:1788201405.063450:0:101826:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.201.20@tcp (ffff8dc13aa9c000), last request at 1788201198 00000020:00000080:3.0:1788201405.063488:0:101826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c4cc 00000020:00010000:3.0:1788201405.063491:0:101826:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc13aa9c000: total 2 00000100:00080000:3.0:1788201405.063493:0:101826:0:(import.c:65:import_set_state_nolock()) ffff8dc103487000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788201405.063500:0:101826:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.201.20@tcp (ffff8dc13aa9c000): rc 0 00000020:00080000:3.0:1788201405.063504:0:101826:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8dc1060e3370) has no exports 00000020:00000080:1.0:1788201405.063835:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc104281000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788201405.063843:0:76267:0:(genops.c:885:class_export_put()) final put ffff8dc10630b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788201405.063846:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc10630b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788201405.063850:0:76267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201405.063905:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12f1ab800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788201405.063909:0:76267:0:(genops.c:885:class_export_put()) final put ffff8dc109815800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788201405.063911:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc109815800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788201405.063915:0:76267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788201405.063941:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005d72000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1788201405.064091:0:24979:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc110735800: total 0 00010000:00010000:1.0:1788201405.064116:0:24979:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc110735800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788201405.064154:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00782d800/0x96d0c9b8c9a1c63f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c638 expref: 14 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201405.064173:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc108c75e00/0x96d0c9b8c9a1d76b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d764 expref: 13 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201405.064185:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fd400/0x96d0c9b8c9a1d7b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d7b1 expref: 12 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201405.064195:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007adf400/0x96d0c9b8c9a1c6af lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c6a8 expref: 11 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201405.064207:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ed600/0x96d0c9b8c9a1d6a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d6a0 expref: 10 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201405.064217:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fdc00/0x96d0c9b8c9a1c64d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1c646 expref: 9 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201405.064227:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fd200/0x96d0c9b8c9a1d6c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d6bc expref: 8 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201405.064237:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc108c74400/0x96d0c9b8c9a1d741 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d73a expref: 7 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201405.064248:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007adf600/0x96d0c9b8c9a1cac2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1cabb expref: 6 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201405.064257:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0078fd000/0x96d0c9b8c9a1d6d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d6ca expref: 5 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201405.064267:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140d59800/0x96d0c9b8c9a1ca6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca67 expref: 4 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201405.064286:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007adf200/0x96d0c9b8c9a1ca7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ca75 expref: 3 pid: 94467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201405.064296:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ec600/0x96d0c9b8c9a1d75d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1d756 expref: 2 pid: 94461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201405.064306:0:24979:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc110735800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1788201405.064324:0:24979:0:(genops.c:885:class_export_put()) final put ffff8dc110735800/c9b18af6-fecc-4172-82c2-66531890fe11 00000020:00010000:1.0:1788201405.064343:0:24979:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc13aa9c000: total 1 00010000:00010000:1.0:1788201405.064362:0:24979:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc13aa9c000, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1788201405.064378:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00896ba00/0x96d0c9b8c9a1ca44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78698a expref: 5 pid: 94464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201405.064390:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc007adec00/0x96d0c9b8c9a1c4e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78691a expref: 4 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201405.064403:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140d59e00/0x96d0c9b8c9a1ca3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786983 expref: 3 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201405.064414:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc00896ac00/0x96d0c9b8c9a1d7cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786caf expref: 2 pid: 94463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201405.064424:0:24979:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc13aa9c000, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1788201405.064433:0:24979:0:(genops.c:885:class_export_put()) final put ffff8dc13aa9c000/93ba7067-43b5-4e46-8db7-27c040fa03d9 00010000:00010000:1.0:1788201405.064437:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201405.064440:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201405.064442:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788201405.064478:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110735800/c9b18af6-fecc-4172-82c2-66531890fe11 for MGS 00000020:00000080:3.0:1788201405.064509:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13aa9c000/93ba7067-43b5-4e46-8db7-27c040fa03d9 for MGS 00000020:00000080:3.0:1788201405.064521:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc110732000 for MGS 00000020:00000080:3.0:1788201405.064525:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc103487000 for MGS 00010000:00010000:1.0:1788201405.065060:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201405.065136:0:94467:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff8dc006dd2000:94467] 3 exiting: rc = 0 00000100:00100000:3.0:1788201405.065250:0:94463:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8dc11cd5ea00:94463] 1 exiting: rc = 0 00000100:00100000:3.0:1788201405.067172:0:94461:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8dc10428a000:94461] 0 exiting: rc = 1 00000100:00100000:3.0:1788201405.074237:0:94464:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8dc10428a800:94464] 2 exiting: rc = 0 00000100:00100000:1.0:1788201405.083012:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083058:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083066:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083073:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083081:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083088:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083096:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083102:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083107:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083113:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083118:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083123:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083129:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083135:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083139:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083145:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083150:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083160:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083165:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083170:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083175:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083181:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083186:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083191:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083199:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083205:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083210:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083216:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083221:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083228:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083234:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083240:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083246:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083251:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083258:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083263:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083278:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083284:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083289:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083295:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083299:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083304:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083308:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083313:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083317:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083322:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083327:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083332:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083336:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083341:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083346:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083351:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083356:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083361:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083367:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083372:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083376:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083381:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083387:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083392:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083396:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083401:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083406:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201405.083411:0:101826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1788201405.084703:0:101826:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc12b66b840 - data ffff8dc11dbf2948/ffff8dc1330cb000 00000020:01000000:1.0:1788201405.084840:0:101826:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc003bd7a20 - data ffff8dc11dbf5798/ffff8dc120067800 00000020:00000080:1.0:1788201405.085327:0:101826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c4c5 00000020:00000080:1.0:1788201405.085336:0:101826:0:(genops.c:885:class_export_put()) final put ffff8dc13339f800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788201405.085352:0:101826:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc11d438000 from MGS, refs=2 00000020:01000004:1.0:1788201405.085356:0:101826:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc11d438000 2 00000020:01000004:1.0:1788201405.085368:0:101826:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dc11d438000 from MGS 00000020:00000080:1.0:1788201405.085388:0:101826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201405.085396:0:101826:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788201405.085399:0:101826:0:(genops.c:885:class_export_put()) final put ffff8dc12b6b9800/MGS 00000020:00000080:1.0:1788201405.085402:0:101826:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12b6b9800/MGS for MGS 00000020:01000000:1.0:1788201405.085408:0:101826:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788201405.085477:0:101826:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788201405.085481:0:101826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201405.085491:0:101826:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788201405.085498:0:101826:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8dc137d32000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201405.085504:0:101826:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8dc12f0c19b8) has exports, disconnecting them 00000020:00080000:1.0:1788201405.085509:0:101826:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8dc137d32000), last request at 1788201200 00000020:00000080:1.0:1788201405.085513:0:101826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c5f2 00000020:00080000:1.0:1788201405.085523:0:101826:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc137d32000): rc 0 00000020:00000080:1.0:1788201405.085529:0:101826:0:(genops.c:885:class_export_put()) final put ffff8dc137d32000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788201405.086343:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13339f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788201405.086353:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d32000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788201405.100081:0:101826:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788201405.100090:0:101826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201405.100094:0:101826:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788201405.100112:0:101826:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788201405.100144:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc137d33000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788201405.100330:0:101826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201405.100344:0:101826:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788201405.100350:0:101826:0:(genops.c:885:class_export_put()) final put ffff8dc110736000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788201405.100353:0:101826:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110736000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788201405.100365:0:101826:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788201405.100439:0:101826:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc11d438000 1 00000020:00000080:3.0:1788201405.100445:0:101826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1c4b7 00000020:00000080:3.0:1788201405.100451:0:101826:0:(genops.c:885:class_export_put()) final put ffff8dc12b6bf800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788201405.100460:0:101826:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788201405.100467:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12b6bf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788201405.100476:0:101826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201405.100480:0:101826:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788201405.100484:0:101826:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8dc0040419b8) has no exports 00000020:00000080:3.0:1788201405.150129:0:101826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201405.150142:0:101826:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788201405.150148:0:101826:0:(genops.c:885:class_export_put()) final put ffff8dc11d43d800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788201405.150152:0:101826:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d43d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788201405.150159:0:101826:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788201405.150274:0:101826:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dc11d43f800 00000020:02000400:3.0:1788201405.150341:0:101826:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1788201405.272193:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201405.272216:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715368704:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201405.272283:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201405.272328:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715368704 00000100:00100000:2.0:1788201405.272337:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715368704 00000100:00080000:1.0:1788201405.272370:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201405.272409:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788201405.272418:0:99769:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788201405.272423:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715368704:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201405.272430:0:99769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:2.0:1788201405.272454:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201405.272505:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715368704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201405.272521:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788201405.272563:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc11cd19c00 x1875060715368704/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201405.272580:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715368704:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788201405.460876:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201406.288154:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715368832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201406.288226:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201406.288340:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715368832 00000100:00100000:3.0:1788201406.288348:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715368832 00000100:00100000:3.0:1788201406.288416:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788201406.288426:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f2e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715368832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201406.288453:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201406.288497:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f2e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715368832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201406.288505:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788201406.288577:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201406.288613:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715368832:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201406.291185:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715369088:0@lo:400:kworker.0 00000100:00100000:3.0:1788201406.291256:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201406.291292:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715369600:0@lo:400:kworker.0 00000100:00100000:3.0:1788201406.291317:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201406.291342:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788201406.291350:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715368960:0@lo:400:kworker.0 00000400:00000100:3.0:1788201406.291369:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715368960 offset 0 length 224: 4 00000100:00100000:3.0:1788201406.291391:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715369472:0@lo:400:kworker.0 00000100:00100000:3.0:1788201406.291414:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201406.291445:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715369088 00000100:00100000:3.0:1788201406.291451:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715369088 00000100:00100000:3.0:1788201406.291480:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788201406.291485:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3656:x1875060715369088:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788201406.291491:0:101344:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788201406.291518:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3656:x1875060715369088:12345-0@lo:400:kworker.0 Request processed in 32us (263us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788201406.291522:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788201406.291538:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715369600 00000100:00100000:3.0:1788201406.291540:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715369600 00000100:00100000:3.0:1788201406.291563:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715369472 00000100:00100000:3.0:1788201406.291565:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715369472 00000100:00100000:3.0:1788201406.291574:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1727 00000100:00100000:3.0:1788201406.291578:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715369600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201406.291601:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715369600:12345-0@lo:400:kworker.0 Request processed in 24us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201406.291604:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1727 00000100:00100000:3.0:1788201406.291613:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1688 00000100:00100000:3.0:1788201406.291627:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1875060715369472:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788201406.291630:0:66312:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788201406.291643:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1875060715369472:12345-0@lo:400:kworker.0 Request processed in 16us (230us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788201406.291646:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1688 00000100:00080000:3.0:1788201406.291676:0:3656:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788201406.291680:0:3656:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788201406.291683:0:3656:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788201406.291687:0:3656:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201406.291690:0:3656:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4207 00000100:00080000:3.0:1788201406.291695:0:3656:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc11ccfb000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201406.291715:0:3656:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc14014f100 x1875060715369984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201406.291736:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715369472:0@lo:400:kworker.0 00000100:00080000:3.0:1788201406.291747:0:3656:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788201406.291750:0:3656:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788201406.291753:0:3656:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788201406.291757:0:3656:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201406.291760:0:3656:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4057 00000100:00080000:3.0:1788201406.291764:0:3656:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201406.291776:0:3656:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc14014ea00 x1875060715370112/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201406.291785:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715369088:0@lo:400:kworker.0 00000100:00100000:3.0:1788201406.291809:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715369600:0@lo:400:kworker.0 00000100:00100000:3.0:1788201406.291834:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715369984:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788201406.291857:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201406.291872:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715370112:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788201406.291892:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201406.291917:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715370112 00000100:00100000:3.0:1788201406.291921:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715370112 00000100:00100000:3.0:1788201406.291939:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788201406.291943:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3654:x1875060715370112:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1788201406.291976:0:66317:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201406.292004:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3654:x1875060715370112:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 59us (110us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201406.292010:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788201406.292058:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201406.292063:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201406.292065:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715370112:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788201406.292242:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715369984 00000100:00100000:2.0:1788201406.292247:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715369984 00000100:00100000:2.0:1788201406.292277:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1689 00000100:00100000:2.0:1788201406.292282:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715369984:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1788201406.292293:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201406.292334:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715369984:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 51us (475us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201406.292341:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1689 00000100:00100000:2.0:1788201406.292362:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715369216:0@lo:400:kworker.0 00000100:00100000:2.0:1788201406.292388:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201406.292410:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715369728:0@lo:400:kworker.0 00000100:00100000:2.0:1788201406.292428:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201406.292441:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788201406.292445:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715369344:0@lo:400:kworker.0 00000100:00100000:2.0:1788201406.292456:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201406.292473:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715369856:0@lo:400:kworker.0 00000100:00100000:2.0:1788201406.292486:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201406.292501:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715369216 00000100:00100000:2.0:1788201406.292504:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715369216 00000100:00100000:2.0:1788201406.292525:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788201406.292529:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715369216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201406.292560:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715369216:12345-0@lo:400:kworker.0 Request processed in 30us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201406.292566:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788201406.292585:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715369728 00000100:00100000:2.0:1788201406.292588:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715369728 00000100:00100000:2.0:1788201406.292604:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715369344 00000100:00100000:2.0:1788201406.292607:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715369344 00000100:00100000:2.0:1788201406.292615:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715369856 00000100:00100000:2.0:1788201406.292617:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715369856 00000100:00100000:2.0:1788201406.292632:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1728 00000100:00100000:2.0:1788201406.292638:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715369856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201406.292667:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715369856:12345-0@lo:400:kworker.0 Request processed in 29us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201406.292673:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1728 00000100:00100000:2.0:1788201406.292684:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1690 00000100:00100000:2.0:1788201406.292688:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f2e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1875060715369728:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788201406.292692:0:66313:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788201406.292713:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f2e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1875060715369728:12345-0@lo:400:kworker.0 Request processed in 24us (283us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788201406.292718:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1690 00000100:00100000:2.0:1788201406.292729:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1691 00000100:00100000:2.0:1788201406.292732:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1875060715369344:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788201406.292745:0:66313:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788201406.292768:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1875060715369344:12345-0@lo:400:kworker.0 Request processed in 34us (309us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788201406.292773:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1691 00000100:00080000:2.0:1788201406.292793:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201406.292811:0:3657:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788201406.292815:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788201406.292818:0:3657:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788201406.292822:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201406.292825:0:3657:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4057 00000100:00080000:2.0:1788201406.292830:0:3657:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201406.292847:0:3657:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12f2e3100 x1875060715370240/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201406.292859:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715369344:0@lo:400:kworker.0 00000100:00100000:2.0:1788201406.292872:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715369856:0@lo:400:kworker.0 00010000:00080000:2.0:1788201406.292882:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8dc00715b800 x1875060715369216/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201406.292891:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715369216:0@lo:400:kworker.0 00000100:00080000:2.0:1788201406.292900:0:3657:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788201406.292902:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788201406.292905:0:3657:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788201406.292908:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201406.292911:0:3657:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4223 00000100:00080000:2.0:1788201406.292921:0:3657:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc1401c3800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201406.292935:0:3657:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12f2e2a00 x1875060715370368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201406.292956:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715369728:0@lo:400:kworker.0 00000100:00100000:1.0:1788201406.293226:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f2e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715370240:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788201406.293257:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201406.293272:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f2e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715370368:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788201406.293290:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201406.293324:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201406.293329:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201406.293332:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715369984:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788201406.293399:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715370240 00000100:00100000:3.0:1788201406.293404:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715370240 00000100:00100000:3.0:1788201406.293434:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715370368 00000100:00100000:3.0:1788201406.293437:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715370368 00000100:00100000:3.0:1788201406.293451:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1692 00000100:00100000:3.0:1788201406.293457:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715370240:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788201406.293469:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201406.293503:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715370240:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 45us (245us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201406.293516:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1692 00000100:00100000:3.0:1788201406.293529:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1693 00000100:00100000:3.0:1788201406.293533:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715370368:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788201406.293544:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201406.293567:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715370368:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 32us (276us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201406.293573:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1693 00000100:00080000:3.0:1788201406.293596:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201406.293600:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201406.293602:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f2e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715370240:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1788201406.293610:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201406.293612:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201406.293615:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f2e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715370368:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:2.0:1788201406.479625:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1788201407.443807:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695528448 offset 0 length 224: 4 00000100:00100000:2.0:1788201407.443852:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201407.443888:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201407.443922:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201407.443975:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201407.444007:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695528960 00000100:00100000:2.0:1788201407.444050:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695528960 00000100:00100000:2.0:1788201407.444107:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695528832 00000100:00100000:2.0:1788201407.444111:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695528832 00000100:00100000:2.0:1788201407.444135:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:2.0:1788201407.444147:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f2e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695528960:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201407.444183:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695528704 00000100:00100000:0.0:1788201407.444187:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695528704 00000100:00100000:2.0:1788201407.444218:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f2e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695528960:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 73us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201407.444219:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695528576 00000100:00100000:2.0:1788201407.444225:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:0.0:1788201407.444229:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695528576 00000100:00100000:2.0:1788201407.444241:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:0.0:1788201407.444247:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1729 00000100:00100000:2.0:1788201407.444248:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695528832:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201407.444272:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695528832:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201407.444273:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f2e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:2401:x1875060695528704:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201407.444279:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00080000:2.0:1788201407.444294:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201407.444304:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201407.444306:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f2e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:2401:x1875060695528704:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 53us (455us total) trans 0 rc 0/0 00000100:00080000:2.0:1788201407.444306:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201407.444312:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1729 00000100:00100000:2.0:1788201407.444318:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1694 00000100:00100000:2.0:1788201407.444323:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f2e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1875060695528576:12345-192.168.201.20@tcp:400:kworker.0 00000020:00080000:2.0:1788201407.444330:0:66314:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.20@tcp 00000100:00100000:2.0:1788201407.444354:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f2e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1875060695528576:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 29us (431us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788201407.444359:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1694 00000100:00100000:1.0:1788201407.451094:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201407.451580:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695529088 00000100:00100000:2.0:1788201407.451592:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695529088 00000100:00100000:2.0:1788201407.451652:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1695 00000100:00100000:2.0:1788201407.451661:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695529088:12345-192.168.201.20@tcp:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1788201407.451685:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201407.451810:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695529088:12345-192.168.201.20@tcp:38:ptlrpcd_00_01.0 Request processed in 148us (725us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201407.451818:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1695 00010000:00010000:1.0:1788201407.505457:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788201408.337263:0:75739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788201408.337445:0:75739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411480 is committed 00000020:00000080:0.0:1788201408.337452:0:75739:0:(genops.c:885:class_export_put()) final put ffff8dc11d63c000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788201408.337525:0:75739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411479 is committed 00010000:00010000:2.0:1788201408.340204:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1df1a lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201408.340223:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1df1a lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201408.340231:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1df1a lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201408.340237:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201408.340241:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1df1a lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201408.340270:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1df1a lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201408.340290:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x6:0x0].0xf0209d98 (ffff8dc004b23a00) 00010000:00010000:2.0:1788201408.340294:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201408.340299:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1df1a lrc: 2/0,0 mode: --/TXN res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201408.340304:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c74200/0x96d0c9b8c9a1df1a lrc: 0/0,0 mode: --/TXN res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788201408.341772:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d63c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788201408.341851:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc11d63f800 for lustre-MDT0001 00010000:00010000:1.0:1788201408.527259:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201409.551256:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201410.383759:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715370496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201410.383836:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201410.384050:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715370496 00000100:00100000:1.0:1788201410.384075:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715370496 00000100:00100000:1.0:1788201410.384301:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788201410.384312:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f2e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715370496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201410.384358:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201410.384640:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f2e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715370496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 329us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201410.384647:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788201410.384671:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1788201410.385906:0:99761:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788201410.385919:0:99761:0:(genops.c:885:class_export_put()) final put ffff8dc12f19a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788201410.385963:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12f19a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000001:00100000:0.0:1788201410.389999:0:100576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788201410.390012:0:100576:0:(genops.c:885:class_export_put()) final put ffff8dc11cddd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788201410.390222:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc12f19c800 for lustre-OST0000 00000020:00000080:1.0:1788201410.390232:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11cddd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788201410.390281:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc11cddb800 for lustre-OST0001 00010000:00080000:2.0:1788201410.392622:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8dc005d59c00 x1875060715370496/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201410.392644:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715370496:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788201410.575358:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201411.409325:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715370752:0@lo:400:kworker.0 00000400:00000100:3.0:1788201411.409405:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715370752 offset 0 length 224: 4 00000100:00100000:0.0:1788201411.409514:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715370624:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201411.409581:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201411.409687:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201411.409705:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201411.409709:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201411.409716:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4257 00000100:00080000:1.0:1788201411.409722:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788201411.409729:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201411.409759:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d58700 x1875060715370880/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201411.409871:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715371008:0@lo:400:kworker.0 00000100:00100000:0.0:1788201411.409904:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201411.409945:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715371008 00000100:00100000:0.0:1788201411.409954:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715371008 00000100:00100000:2.0:1788201411.409978:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715370624 00000100:00100000:2.0:1788201411.409983:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715370624 00000100:00100000:0.0:1788201411.410013:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788201411.410049:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788201411.410055:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715371008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201411.410056:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715370624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201411.410092:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201411.410113:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715371008:12345-0@lo:400:kworker.0 Request processed in 61us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201411.410121:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788201411.410132:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715370624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201411.410137:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788201411.410177:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715370880:0@lo:38:kworker.0 00010000:00080000:0.0:1788201411.410209:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8dc005d5b100 x1875060715371008/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201411.410209:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201411.410224:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715371008:0@lo:400:kworker.0 00000100:00080000:2.0:1788201411.410244:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201411.410267:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715370624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201411.410270:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715370880 00000100:00100000:2.0:1788201411.410273:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715370880 00000100:00100000:2.0:1788201411.410294:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788201411.410300:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f2e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3654:x1875060715370880:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788201411.410323:0:66318:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201411.410369:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f2e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3654:x1875060715370880:12345-0@lo:38:kworker.0 Request processed in 68us (159us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201411.410377:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1788201411.415389:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201411.415406:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201411.415412:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715370880:0@lo:38:kworker.0 00000100:00080000:1.0:1788201411.416472:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201411.416482:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201411.416487:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201411.416495:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4257 00000100:00080000:1.0:1788201411.416502:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788201411.416511:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201411.416562:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d5aa00 x1875060715371136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201411.416626:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715371136:0@lo:38:kworker.0 00000100:00100000:0.0:1788201411.416945:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201411.417056:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715371136 00000100:00100000:2.0:1788201411.417067:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715371136 00000100:00100000:2.0:1788201411.417122:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1696 00000100:00100000:2.0:1788201411.417132:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715371136:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788201411.417158:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1788201411.417322:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201411.417326:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201411.417330:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201411.417335:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4257 00000100:00080000:1.0:1788201411.417339:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788201411.417344:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc11ccfb000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201411.417363:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d59500 x1875060715371264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201411.417428:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715371264:0@lo:38:kworker.0 00000100:00100000:0.0:1788201411.417459:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201411.417521:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715371264 00000100:00100000:3.0:1788201411.417527:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715371264 00000100:00100000:3.0:1788201411.417557:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1697 00000100:00100000:3.0:1788201411.417563:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715371264:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788201411.417574:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201411.417612:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715371264:12345-0@lo:38:kworker.0 Request processed in 48us (151us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201411.417619:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1697 00000100:00100000:2.0:1788201411.420543:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715371136:12345-0@lo:38:kworker.0 Request processed in 3395us (3582us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201411.420565:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1696 00000100:00080000:0.0:1788201411.422492:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201411.422508:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201411.422514:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715371136:0@lo:38:kworker.0 00000100:00080000:0.0:1788201411.422567:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201411.422572:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201411.422575:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715371264:0@lo:38:kworker.0 00000100:00100000:2.0:1788201411.423090:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715371392:0@lo:400:kworker.0 00000100:00100000:2.0:1788201411.423181:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201411.423249:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715371392 00000100:00100000:2.0:1788201411.423257:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715371392 00000100:00100000:2.0:1788201411.423334:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1730 00000100:00100000:2.0:1788201411.423347:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715371392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201411.423403:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715371392:12345-0@lo:400:kworker.0 Request processed in 59us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201411.423426:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1730 00000100:00080000:2.0:1788201411.423455:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201411.423488:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715371392:0@lo:400:kworker.0 00000100:00080000:1.0:1788201411.424680:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201411.424690:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201411.424707:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201411.424716:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4257 00000100:00080000:1.0:1788201411.424722:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788201411.424729:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc1401c3800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201411.424769:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d58000 x1875060715371520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201411.426456:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201411.426491:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715371648:0@lo:400:kworker.0 00000100:00100000:2.0:1788201411.426582:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201411.426733:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715371520:0@lo:38:kworker.0 00000100:00100000:0.0:1788201411.426770:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201411.426934:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715371648 00000100:00100000:2.0:1788201411.426944:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715371648 00000100:00100000:2.0:1788201411.427050:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715371520 00000100:00100000:2.0:1788201411.427054:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715371520 00000100:00100000:2.0:1788201411.427075:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1731 00000100:00100000:2.0:1788201411.427085:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715371648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201411.427145:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715371648:12345-0@lo:400:kworker.0 Request processed in 60us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201411.427152:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1731 00000100:00100000:2.0:1788201411.427172:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1698 00000100:00100000:2.0:1788201411.427176:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715371520:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788201411.427200:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201411.427231:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715371520:12345-0@lo:38:kworker.0 Request processed in 53us (460us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201411.427238:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1698 00000100:00100000:2.0:1788201411.427285:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715371648:0@lo:400:kworker.0 00000100:00080000:0.0:1788201411.427634:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201411.427661:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201411.427668:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201411.427671:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715371520:0@lo:38:kworker.0 00010000:00010000:1.0:1788201411.599273:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1788201412.564302:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695529216 offset 0 length 224: 4 00000100:00100000:1.0:1788201412.564361:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201412.564405:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201412.564449:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201412.564551:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695529728 00000100:00100000:3.0:1788201412.564566:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695529728 00000100:00100000:3.0:1788201412.564662:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695529600 00000100:00100000:3.0:1788201412.564665:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695529600 00000100:00100000:3.0:1788201412.564696:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:3.0:1788201412.564708:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695529728:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201412.564807:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695529728:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 102us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201412.564816:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:3.0:1788201412.564835:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:3.0:1788201412.564853:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695529600:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201412.564878:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695529600:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 28us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201412.564885:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:2.0:1788201412.565069:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695529472 00000100:00100000:2.0:1788201412.565074:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695529472 00000100:00100000:2.0:1788201412.565120:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1732 00000100:00100000:2.0:1788201412.565128:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2403:x1875060695529472:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201412.565179:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2403:x1875060695529472:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 52us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201412.565186:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1732 00000100:00080000:1.0:1788201412.565319:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201412.565326:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201412.565328:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201412.566274:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201412.566463:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695529344 00000100:00100000:2.0:1788201412.566471:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695529344 00000100:00100000:2.0:1788201412.566518:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1699 00000100:00100000:2.0:1788201412.566525:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2399:x1875060695529344:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:2.0:1788201412.566551:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201412.566678:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2399:x1875060695529344:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 151us (409us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201412.566686:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1699 00010000:00010000:1.0:1788201412.630478:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201413.647578:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201414.671788:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201415.505421:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715371776:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201415.505539:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201415.505715:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715371776 00000100:00100000:1.0:1788201415.505726:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715371776 00000100:00100000:1.0:1788201415.505831:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788201415.505842:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715371776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201415.505881:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201415.505940:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715371776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201415.505948:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788201415.506037:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788201415.506271:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8dc005d59c00 x1875060715371776/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201415.506296:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715371776:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788201415.701491:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201416.528668:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1788201416.528693:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201416.528698:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201416.528703:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201416.528713:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4262 00000100:00080000:1.0:1788201416.528720:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201416.528729:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201416.528758:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d58000 x1875060715372032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201416.528861:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201416.528865:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201416.528868:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201416.528872:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4262 00000100:00080000:1.0:1788201416.528875:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201416.528880:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201416.528893:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d53800 x1875060715372416/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201416.528903:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201416.528907:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201416.528909:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201416.528914:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4262 00000100:00080000:1.0:1788201416.528916:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201416.528920:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc11ccfb000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201416.528934:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d53b80 x1875060715372544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201416.529032:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715372672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201416.529149:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201416.529233:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201416.529240:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715372800:0@lo:400:kworker.0 00000100:00100000:0.0:1788201416.529273:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201416.529310:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715372032:0@lo:38:kworker.0 00000100:00100000:0.0:1788201416.529338:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201416.529354:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715372416:0@lo:38:kworker.0 00000100:00100000:0.0:1788201416.529370:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201416.529384:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715372544:0@lo:38:kworker.0 00000100:00100000:0.0:1788201416.529400:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201416.529435:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715372672 00000100:00100000:0.0:1788201416.529445:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715372672 00000100:00100000:0.0:1788201416.529512:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788201416.529522:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715372672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201416.529558:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201416.529605:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715372672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201416.529611:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788201416.529636:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715372032 00000100:00100000:0.0:1788201416.529639:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715372032 00000100:00100000:0.0:1788201416.529658:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788201416.529663:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3654:x1875060715372032:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201416.529684:0:66318:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201416.529714:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3654:x1875060715372032:12345-0@lo:38:kworker.0 Request processed in 50us (376us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201416.529719:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788201416.529735:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715372800 00000100:00100000:0.0:1788201416.529745:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715372800 00000100:00100000:0.0:1788201416.529790:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715372416 00000100:00100000:0.0:1788201416.529793:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715372416 00000100:00100000:0.0:1788201416.529807:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715372544 00000100:00100000:0.0:1788201416.529808:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715372544 00000100:00100000:0.0:1788201416.529817:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1733 00000100:00100000:0.0:1788201416.529823:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715372800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201416.529856:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715372800:12345-0@lo:400:kworker.0 Request processed in 33us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201416.529862:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1733 00000100:00100000:0.0:1788201416.529873:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1700 00000100:00100000:0.0:1788201416.529876:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715372416:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201416.529886:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201416.529918:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715372416:12345-0@lo:38:kworker.0 Request processed in 40us (547us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201416.529923:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1700 00000100:00100000:0.0:1788201416.529935:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1701 00000100:00100000:0.0:1788201416.529938:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715372544:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201416.529946:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201416.529968:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715372544:12345-0@lo:38:kworker.0 Request processed in 28us (567us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201416.529974:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1701 00000100:00080000:0.0:1788201416.529990:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201416.529995:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201416.530064:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201416.530070:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201416.530073:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715372032:0@lo:38:kworker.0 00000100:00080000:0.0:1788201416.530091:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201416.530095:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201416.530098:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715372416:0@lo:38:kworker.0 00000100:00080000:0.0:1788201416.530105:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201416.530108:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201416.530111:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715372544:0@lo:38:kworker.0 00000100:00100000:0.0:1788201416.530158:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715372800:0@lo:400:kworker.0 00000100:00100000:0.0:1788201416.530176:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715372672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201416.530245:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715372288:0@lo:400:kworker.0 00000100:00100000:0.0:1788201416.530282:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201416.530311:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715372288 00000100:00100000:0.0:1788201416.530315:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715372288 00000100:00100000:0.0:1788201416.530344:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788201416.530353:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715372288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201416.530385:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715372288:12345-0@lo:400:kworker.0 Request processed in 34us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201416.530391:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788201416.530418:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8dc005d52300 x1875060715372288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201416.530429:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715372288:0@lo:400:kworker.0 00000100:00100000:0.0:1788201416.530442:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201416.530447:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715372160:0@lo:400:kworker.0 00000100:00100000:0.0:1788201416.530469:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201416.530500:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715372160 00000100:00100000:0.0:1788201416.530504:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715372160 00000100:00100000:0.0:1788201416.530529:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788201416.530535:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715372160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201416.530563:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715372160:12345-0@lo:400:kworker.0 Request processed in 29us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201416.530568:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788201416.530593:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715372160:0@lo:400:kworker.0 00000100:00100000:2.0:1788201416.532366:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715371904:0@lo:400:kworker.0 00000400:00000100:2.0:1788201416.532435:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715371904 offset 0 length 224: 4 00000100:00080000:1.0:1788201416.533341:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201416.533350:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201416.533354:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201416.533363:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4262 00000100:00080000:1.0:1788201416.533369:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201416.533377:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc1401c3800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201416.533424:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d52d80 x1875060715372928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201416.533482:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715372928:0@lo:38:kworker.0 00000100:00100000:1.0:1788201416.533563:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201416.533622:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715372928 00000100:00100000:1.0:1788201416.533632:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715372928 00000100:00100000:1.0:1788201416.533673:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1702 00000100:00100000:1.0:1788201416.533681:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715372928:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201416.533706:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201416.533746:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715372928:12345-0@lo:38:kworker.0 Request processed in 64us (183us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201416.533753:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1702 00000100:00080000:1.0:1788201416.533814:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201416.533818:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201416.533822:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715372928:0@lo:38:kworker.0 00000100:00100000:1.0:1788201416.533867:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715373056:0@lo:400:kworker.0 00000100:00100000:1.0:1788201416.533891:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201416.533919:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715373056 00000100:00100000:1.0:1788201416.533922:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715373056 00000100:00100000:1.0:1788201416.533972:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1734 00000100:00100000:1.0:1788201416.533979:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715373056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201416.534456:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715373056:12345-0@lo:400:kworker.0 Request processed in 475us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201416.534463:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1734 00000100:00080000:1.0:1788201416.534487:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201416.534573:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715373056:0@lo:400:kworker.0 00010000:00010000:1.0:1788201416.734449:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1788201417.685396:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695529856 offset 0 length 224: 4 00000100:00100000:1.0:1788201417.685458:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201417.686159:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201417.686301:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695530112 00000100:00100000:2.0:1788201417.686318:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695530112 00000100:00100000:2.0:1788201417.686456:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695529984 00000100:00100000:2.0:1788201417.686460:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695529984 00000100:00100000:0.0:1788201417.686815:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201417.686835:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1735 00000100:00100000:2.0:1788201417.686857:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2402:x1875060695530112:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201417.686871:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201417.686987:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2402:x1875060695530112:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 136us (1528us total) trans 0 rc 0/0 00000100:00080000:1.0:1788201417.687034:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201417.693569:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1703 00000100:00100000:3.0:1788201417.693590:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695529984:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:3.0:1788201417.693625:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201417.693737:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695529984:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 152us (7584us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201417.693796:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1703 00000100:00100000:3.0:1788201417.693860:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695530240 00000100:00100000:3.0:1788201417.693870:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695530240 00000100:00100000:3.0:1788201417.693939:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695530368 00000100:00100000:3.0:1788201417.693943:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695530368 00000100:00100000:3.0:1788201417.693972:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 40 00000100:00100000:3.0:1788201417.693981:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2399:x1875060695530240:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:3.0:1788201417.694042:0:101191:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d7e9 00000100:00080000:3.0:1788201417.694054:0:101191:0:(import.c:65:import_set_state_nolock()) ffff8dc00520a000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1788201417.694110:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:3.0:1788201417.694115:0:101191:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901909 00000100:00080000:0.0:1788201417.694117:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201417.694279:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+2:2399:x1875060695530240:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 298us (7466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201417.694287:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 40 00000100:00100000:3.0:1788201417.694304:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 41 00000100:00100000:3.0:1788201417.694311:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2399:x1875060695530368:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:3.0:1788201417.694327:0:101191:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d7d4 00000100:00080000:3.0:1788201417.694333:0:101191:0:(import.c:65:import_set_state_nolock()) ffff8dc11cdd9000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201417.694366:0:101191:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1788201417.694432:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+2:2399:x1875060695530368:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 122us (7562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201417.694438:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 41 00010000:00010000:3.0:1788201417.694467:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201417.696572:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1735 00010000:00010000:0.0:1788201417.697169:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201417.743349:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201418.768272:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201419.541234:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201419.541241:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201419.541245:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201419.541255:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4267 00000100:00080000:0.0:1788201419.541263:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788201419.541271:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201419.541299:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005256a00 x1875060715373312/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201419.541343:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201419.541347:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201419.541348:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201419.541351:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4267 00000100:00080000:0.0:1788201419.541354:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788201419.541366:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201419.541379:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005254700 x1875060715373696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201419.541387:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201419.541390:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201419.541392:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201419.541395:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4267 00000100:00080000:0.0:1788201419.541397:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788201419.541401:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc11ccfb000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201419.541409:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005257800 x1875060715373824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201419.541423:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201419.541427:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201419.541428:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201419.541431:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4268 00000100:00080000:0.0:1788201419.541434:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788201419.541437:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc1401c3800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201419.541446:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12ee2c000 x1875060715374080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201419.541548:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715373952:0@lo:400:kworker.0 00000100:00100000:0.0:1788201419.541622:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201419.541673:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788201419.541680:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715373184:0@lo:400:kworker.0 00000400:00000100:0.0:1788201419.541701:0:3655:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715373184 offset 0 length 224: 4 00000100:00100000:0.0:1788201419.541751:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715374208:0@lo:400:kworker.0 00000100:00100000:0.0:1788201419.541774:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201419.541801:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715373312:0@lo:38:kworker.0 00000100:00100000:0.0:1788201419.541824:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201419.541841:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715373696:0@lo:38:kworker.0 00000100:00100000:0.0:1788201419.541861:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201419.541875:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715373824:0@lo:38:kworker.0 00000100:00100000:0.0:1788201419.541895:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201419.541921:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715374080:0@lo:38:kworker.0 00000100:00100000:0.0:1788201419.541941:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201419.541971:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715373440:0@lo:400:kworker.0 00000100:00100000:0.0:1788201419.541998:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201419.542148:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715373952 00000100:00100000:2.0:1788201419.542157:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715373952 00000100:00100000:2.0:1788201419.542204:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715374208 00000100:00100000:2.0:1788201419.542207:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715374208 00000100:00100000:2.0:1788201419.542220:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715373696 00000100:00100000:2.0:1788201419.542223:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715373696 00000100:00100000:2.0:1788201419.542230:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715373824 00000100:00100000:2.0:1788201419.542233:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715373824 00000100:00100000:2.0:1788201419.542240:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715374080 00000100:00100000:2.0:1788201419.542242:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715374080 00000100:00100000:2.0:1788201419.542254:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1736 00000100:00100000:2.0:1788201419.542263:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715373952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201419.542319:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715373952:12345-0@lo:400:kworker.0 Request processed in 57us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201419.542325:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1736 00000100:00100000:2.0:1788201419.542343:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1737 00000100:00100000:2.0:1788201419.542350:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715374208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201419.542376:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715374208:12345-0@lo:400:kworker.0 Request processed in 27us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201419.542382:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1737 00000100:00100000:2.0:1788201419.542393:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1704 00000100:00100000:2.0:1788201419.542398:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715373696:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788201419.542417:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201419.542449:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715373696:12345-0@lo:38:kworker.0 Request processed in 49us (586us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201419.542455:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1704 00000100:00100000:2.0:1788201419.542468:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1705 00000100:00100000:2.0:1788201419.542471:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715373824:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788201419.542564:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201419.542590:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715373824:12345-0@lo:38:kworker.0 Request processed in 117us (694us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201419.542596:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1705 00000100:00100000:2.0:1788201419.542608:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1706 00000100:00100000:2.0:1788201419.542612:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715374080:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788201419.542620:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201419.542643:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715374080:12345-0@lo:38:kworker.0 Request processed in 29us (701us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201419.542648:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1706 00000100:00100000:0.0:1788201419.542707:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201419.542724:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715373568:0@lo:400:kworker.0 00000100:00100000:0.0:1788201419.542752:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201419.542801:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715373312 00000100:00100000:0.0:1788201419.542806:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715373312 00000100:00100000:0.0:1788201419.542828:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788201419.542833:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3654:x1875060715373312:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201419.542843:0:101344:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201419.542869:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3654:x1875060715373312:12345-0@lo:38:kworker.0 Request processed in 35us (1044us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201419.542875:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788201419.542891:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715373440 00000100:00100000:0.0:1788201419.542894:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715373440 00000100:00100000:0.0:1788201419.542926:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715373568 00000100:00100000:0.0:1788201419.542929:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715373568 00000100:00100000:0.0:1788201419.542950:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788201419.542957:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715373440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201419.542991:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715373440:12345-0@lo:400:kworker.0 Request processed in 35us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201419.542997:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788201419.543008:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788201419.543260:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715373568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201419.543292:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715373568:12345-0@lo:400:kworker.0 Request processed in 278us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201419.543298:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1788201419.543315:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201419.543319:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201419.543322:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201419.543352:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201419.543357:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201419.543361:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715373312:0@lo:38:kworker.0 00000100:00080000:0.0:1788201419.543370:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201419.543373:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201419.543376:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715373696:0@lo:38:kworker.0 00000100:00080000:0.0:1788201419.543384:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201419.543386:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201419.543389:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715373824:0@lo:38:kworker.0 00000100:00080000:0.0:1788201419.543397:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201419.543400:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201419.543409:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715374080:0@lo:38:kworker.0 00000100:00100000:0.0:1788201419.543448:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715374208:0@lo:400:kworker.0 00000100:00100000:0.0:1788201419.543458:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715373952:0@lo:400:kworker.0 00010000:00080000:0.0:1788201419.544231:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8dc005255f80 x1875060715373568/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201419.544246:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715373568:0@lo:400:kworker.0 00000100:00100000:0.0:1788201419.544263:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715373440:0@lo:400:kworker.0 00010000:00010000:3.0:1788201419.793966:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201420.630802:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715374336:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201420.630873:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201420.630927:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715374336 00000100:00100000:2.0:1788201420.630934:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715374336 00000100:00100000:2.0:1788201420.630983:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788201420.630993:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715374336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201420.631050:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201420.631098:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715374336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201420.631106:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1788201420.631144:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8dc005d52680 x1875060715374336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201420.631162:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715374336:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788201420.815828:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201421.653896:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715374464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201421.653979:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201421.654062:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715374464 00000100:00100000:1.0:1788201421.654070:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715374464 00000100:00100000:1.0:1788201421.654131:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788201421.654141:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715374464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201421.654170:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1788201421.654214:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715374464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201421.654221:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788201421.654244:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201421.654280:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715374464:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788201421.839268:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1788201422.674483:0:3656:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201406/real 1788201406] req@ffff8dc00715aa00 x1875060715368960/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788201422 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201422.674532:0:3656:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8dc00715aa00 x1875060715368960/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788201422 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201422.674541:0:3656:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788201422.674545:0:3656:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788201422.674549:0:3656:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.120@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788201422.674551:0:3656:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788201422.674554:0:3656:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc00715aa00 x1875060715368960/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788201422 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201422.674563:0:3656:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc005d5b480 x1875060715370752/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201427 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201422.674572:0:3656:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc005d59c00 x1875060715371904/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201432 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201422.674580:0:3656:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc005254e00 x1875060715373184/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201435 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788201422.674600:0:3656:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788201422.674603:0:3656:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788201422.674604:0:3656:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788201422.674606:0:3656:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:2.0:1788201422.674634:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715368960:0@lo:400:kworker.0 00000100:00080000:2.0:1788201422.674689:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201422.674694:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788201422.674697:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201422.674702:0:93109:0:(import.c:510:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 4051 00000100:00080000:2.0:1788201422.674709:0:93109:0:(import.c:624:import_select_connection()) MGC192.168.201.120@tcp: import ffff8dc104280800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201422.674736:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc1333bdc00 x1875060715374592/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201422.674766:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201422.674770:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201422.674772:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201422.674775:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4271 00000100:00080000:2.0:1788201422.674778:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201422.674782:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201422.674797:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc125809500 x1875060715374720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201422.674823:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201422.674826:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201422.674828:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201422.674831:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4271 00000100:00080000:2.0:1788201422.674833:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201422.674837:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201422.674846:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12fb0ed80 x1875060715375104/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201422.674854:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201422.674857:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201422.674859:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201422.674862:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4271 00000100:00080000:2.0:1788201422.674864:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201422.674867:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc11ccfb000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201422.674877:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12fb0d500 x1875060715375232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201422.674906:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201422.674909:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201422.674911:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201422.674915:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4271 00000100:00080000:2.0:1788201422.674917:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201422.674920:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc1401c3800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201422.674932:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12fb0dc00 x1875060715375488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201422.674966:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715374592:0@lo:250:kworker.0 00000400:00000100:2.0:1788201422.675012:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715374592 offset 0 length 520: 4 00000100:00100000:2.0:1788201422.675064:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715374720:0@lo:38:kworker.0 00000100:00100000:2.0:1788201422.675097:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201422.675118:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715375104:0@lo:38:kworker.0 00000100:00100000:2.0:1788201422.675139:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201422.675153:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715375232:0@lo:38:kworker.0 00000100:00100000:2.0:1788201422.675172:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201422.675188:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715375488:0@lo:38:kworker.0 00000100:00100000:1.0:1788201422.676351:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715374848:0@lo:400:kworker.0 00000100:00100000:1.0:1788201422.676397:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201422.676437:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715373184:0@lo:400:kworker.0 00000100:00100000:1.0:1788201422.676458:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201422.676464:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715374976:0@lo:400:kworker.0 00000100:00100000:1.0:1788201422.676486:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201422.676529:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715374848 00000100:00100000:1.0:1788201422.676536:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715374848 00000100:00100000:1.0:1788201422.676574:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715374976 00000100:00100000:1.0:1788201422.676577:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715374976 00000100:00100000:1.0:1788201422.676605:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788201422.676613:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715374848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201422.676677:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715374848:12345-0@lo:400:kworker.0 Request processed in 50us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201422.676685:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788201422.676700:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788201422.676707:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715374976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201422.676732:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715374976:12345-0@lo:400:kworker.0 Request processed in 26us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201422.676737:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788201422.676753:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788201422.676779:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8dc12fb0ca80 x1875060715374976/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201422.676791:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715374976:0@lo:400:kworker.0 00000100:00100000:1.0:1788201422.676802:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715374848:0@lo:400:kworker.0 00000100:00100000:3.0:1788201422.676901:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715375360:0@lo:400:kworker.0 00000100:00100000:3.0:1788201422.676935:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201422.676967:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715371904:0@lo:400:kworker.0 00000100:00100000:3.0:1788201422.676983:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715370752:0@lo:400:kworker.0 00000100:00100000:3.0:1788201422.676997:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201422.677002:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715375616:0@lo:400:kworker.0 00000100:00100000:3.0:1788201422.677045:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201422.677070:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715375104 00000100:00100000:3.0:1788201422.677074:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715375104 00000100:00100000:3.0:1788201422.677094:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715375232 00000100:00100000:3.0:1788201422.677097:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715375232 00000100:00100000:3.0:1788201422.677104:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715375360 00000100:00100000:3.0:1788201422.677106:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715375360 00000100:00100000:3.0:1788201422.677124:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715375616 00000100:00100000:3.0:1788201422.677126:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715375616 00000100:00100000:3.0:1788201422.677142:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1738 00000100:00100000:3.0:1788201422.677148:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715375360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201422.677179:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715375360:12345-0@lo:400:kworker.0 Request processed in 31us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201422.677184:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1738 00000100:00100000:3.0:1788201422.677197:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1739 00000100:00100000:2.0:1788201422.677752:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201422.677796:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715374720 00000100:00100000:2.0:1788201422.677802:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715374720 00000100:00100000:1.0:1788201422.677898:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715375488 00000100:00100000:1.0:1788201422.677902:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715375488 00000100:00100000:1.0:1788201422.677919:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1707 00000100:00100000:1.0:1788201422.677924:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715375104:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201422.677945:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201422.677984:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715375104:12345-0@lo:38:kworker.0 Request processed in 59us (2844us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201422.678000:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1707 00000100:00100000:1.0:1788201422.678034:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1708 00000100:00100000:1.0:1788201422.678040:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715375232:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201422.678049:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201422.678074:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715375232:12345-0@lo:38:kworker.0 Request processed in 33us (2901us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201422.678079:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1708 00000100:00100000:1.0:1788201422.678090:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1709 00000100:00100000:1.0:1788201422.678094:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715375488:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201422.678104:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201422.678130:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715375488:12345-0@lo:38:kworker.0 Request processed in 33us (379us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201422.678136:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1709 00000100:00080000:1.0:1788201422.678152:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201422.678302:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715375616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201422.678341:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715375616:12345-0@lo:400:kworker.0 Request processed in 1138us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201422.678349:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1739 00000100:00100000:3.0:1788201422.678391:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715375616:0@lo:400:kworker.0 00000100:00100000:3.0:1788201422.678402:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715375360:0@lo:400:kworker.0 00000100:00100000:2.0:1788201422.678537:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788201422.678544:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3654:x1875060715374720:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788201422.678554:0:66317:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201422.678589:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3654:x1875060715374720:12345-0@lo:38:kworker.0 Request processed in 44us (3491us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201422.678595:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1788201422.678621:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201422.678625:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201422.678628:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715374720:0@lo:38:kworker.0 00000100:00080000:2.0:1788201422.678637:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201422.678640:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201422.678643:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715375104:0@lo:38:kworker.0 00000100:00080000:2.0:1788201422.678650:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201422.678653:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201422.678656:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715375232:0@lo:38:kworker.0 00000100:00080000:2.0:1788201422.678676:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201422.678680:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201422.678683:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715375488:0@lo:38:kworker.0 00000100:00100000:0.0:1788201422.827770:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000400:00000100:0.0:1788201422.827811:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695530496 offset 0 length 224: 4 00000100:00100000:0.0:1788201422.827837:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201422.827901:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695530624 00000100:00100000:1.0:1788201422.827912:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695530624 00000100:00100000:1.0:1788201422.827961:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695530752 00000100:00100000:1.0:1788201422.827965:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695530752 00000100:00100000:1.0:1788201422.828056:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1740 00000100:00100000:1.0:1788201422.828067:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2400:x1875060695530752:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201422.828134:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2400:x1875060695530752:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 69us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201422.828142:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1740 00000100:00100000:1.0:1788201422.828161:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1710 00000100:00100000:1.0:1788201422.828166:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695530624:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:1.0:1788201422.828200:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201422.828224:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695530624:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 57us (466us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201422.828231:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1710 00000100:00080000:2.0:1788201422.828394:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788201422.863266:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788201423.697331:0:99761:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:1.0:1788201423.697342:0:99761:0:(genops.c:885:class_export_put()) final put ffff8dc00520b800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:0.0:1788201423.697421:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc00520b800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 for lustre-OST0000 00000020:00000080:0.0:1788201423.697482:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc00520a000 for lustre-OST0000 00000001:00100000:0.0:1788201423.697916:0:100576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:0.0:1788201423.697921:0:100576:0:(genops.c:885:class_export_put()) final put ffff8dc11cdd8800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:2.0:1788201423.700434:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11cdd8800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 for lustre-OST0001 00000020:00000080:3.0:1788201423.700707:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc11cdd9000 for lustre-OST0001 00000100:00100000:1.0:1788201423.855563:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201423.855715:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695531136 00000100:00100000:0.0:1788201423.855726:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695531136 00000100:00100000:0.0:1788201423.855805:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1741 00000100:00100000:0.0:1788201423.855816:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2400:x1875060695531136:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201423.855898:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2400:x1875060695531136:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 84us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201423.855904:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1741 00000400:00000100:1.0:1788201423.865101:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695530880 offset 0 length 520: 4 00000100:00100000:1.0:1788201423.865152:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201423.865237:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695531008 00000100:00100000:0.0:1788201423.865247:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695531008 00000100:00100000:0.0:1788201423.865323:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1711 00000100:00100000:0.0:1788201423.865332:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695531008:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:0.0:1788201423.865357:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201423.865427:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695531008:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 92us (272us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201423.865435:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1711 00010000:00010000:1.0:1788201423.892205:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201424.911150:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201425.743766:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715375744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201425.743847:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201425.750237:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715375744 00000100:00100000:0.0:1788201425.750256:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715375744 00000100:00100000:0.0:1788201425.750348:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788201425.750360:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715375744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201425.750414:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788201425.750533:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715375744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 175us (6685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201425.750540:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788201425.750726:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8dc005d53800 x1875060715375744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201425.750759:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715375744:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788201425.750836:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788201425.946785:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201426.767578:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201426.767811:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715375872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201426.767883:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201426.767996:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715375872 00000100:00100000:1.0:1788201426.768004:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715375872 00000100:00100000:1.0:1788201426.768211:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788201426.768222:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715375872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201426.768249:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1788201426.768307:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715375872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201426.768314:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1788201426.768347:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201426.768448:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715375872:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788201426.959335:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788201427.468574:0:102446:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788201427.468591:0:102446:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788201427.468592:0:102446:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788201427.468705:0:102446:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dc12f19b800 00000020:01000004:1.0:1788201427.468721:0:102446:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788201427.468735:0:102446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788201427.468751:0:102446:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8dc139bbcd28) 00000020:00000080:1.0:1788201427.468779:0:102446:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788201427.700647:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788201427.707875:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788201427.711108:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788201427.711868:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788201427.712676:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788201427.713050:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788201427.713257:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788201427.713726:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788201427.716977:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788201427.719801:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788201427.723143:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788201427.725692:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788201427.727157:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788201427.727513:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788201427.749633:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788201427.754847:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788201427.755130:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788201427.758947:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788201427.759679:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788201427.759976:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788201427.761508:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788201427.763643:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788201427.764063:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788201427.766440:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788201427.766985:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788201427.767256:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788201427.767481:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788201427.767702:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788201427.767923:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788201427.775548:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788201427.779842:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788201427.780287:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788201427.780563:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788201427.780797:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788201427.782996:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788201427.783508:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788201427.785955:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788201427.786488:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788201427.787468:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788201427.787769:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788201427.788437:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788201427.788724:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788201427.788944:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788201427.789192:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788201427.789593:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788201427.789831:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788201427.790113:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788201427.794647:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00000100:00080000:3.0:1788201427.795935:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201427.795943:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201427.795946:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201427.795949:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201427.795953:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201427.795963:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4274 00000100:00080000:3.0:1788201427.795967:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201427.795974:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201427.796037:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc14014f800 x1875060715376000/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201427.796107:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201427.796110:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201427.796112:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201427.796118:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4274 00000100:00080000:3.0:1788201427.796120:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201427.796123:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201427.796134:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc14014ea00 x1875060715376384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201427.796156:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201427.796159:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201427.796161:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201427.796164:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4274 00000100:00080000:3.0:1788201427.796167:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201427.796170:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc11ccfb000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201427.796183:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc14014f100 x1875060715376512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201427.796208:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201427.796211:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201427.796213:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201427.796216:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4274 00000100:00080000:3.0:1788201427.796218:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201427.796222:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc1401c3800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201427.796233:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d5b480 x1875060715376768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201427.796270:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715376256:0@lo:400:kworker.0 00000100:00100000:3.0:1788201427.796354:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201427.796395:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201427.796402:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715376128:0@lo:400:kworker.0 00000100:00100000:3.0:1788201427.796426:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201427.796454:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715376640:0@lo:400:kworker.0 00000100:00100000:3.0:1788201427.796479:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201427.796506:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201427.796511:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715376896:0@lo:400:kworker.0 00000100:00100000:3.0:1788201427.796533:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201427.796564:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715376256 00000100:00100000:3.0:1788201427.796581:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715376256 00000100:00100000:3.0:1788201427.796632:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715376128 00000100:00100000:3.0:1788201427.796635:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715376128 00000100:00100000:3.0:1788201427.796657:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201427.796665:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715376256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201427.796716:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715376256:12345-0@lo:400:kworker.0 Request processed in 51us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201427.796723:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201427.796738:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788201427.796745:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715376128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201427.796770:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715376128:12345-0@lo:400:kworker.0 Request processed in 26us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201427.796775:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1788201427.796790:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201427.796817:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715376128:0@lo:400:kworker.0 00010000:00080000:3.0:1788201427.796829:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8dc14014ed80 x1875060715376256/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201427.796838:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715376256:0@lo:400:kworker.0 00000100:00100000:0.0:1788201427.797037:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715376640 00000100:00100000:0.0:1788201427.797040:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715376640 00000100:00100000:0.0:1788201427.797074:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715376896 00000100:00100000:0.0:1788201427.797076:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715376896 00000100:00100000:0.0:1788201427.797089:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1742 00000100:00100000:0.0:1788201427.797093:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715376640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201427.797124:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715376640:12345-0@lo:400:kworker.0 Request processed in 31us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201427.797129:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1742 00000100:00100000:0.0:1788201427.797141:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1743 00000100:00100000:0.0:1788201427.797147:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715376896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201427.797187:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715376896:12345-0@lo:400:kworker.0 Request processed in 40us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201427.797194:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1743 00000100:00100000:0.0:1788201427.797221:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715376000:0@lo:38:kworker.0 00000100:00100000:0.0:1788201427.797242:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201427.797255:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715376384:0@lo:38:kworker.0 00000100:00100000:0.0:1788201427.797267:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201427.797279:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715376512:0@lo:38:kworker.0 00000100:00100000:0.0:1788201427.797300:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201427.797315:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715376768:0@lo:38:kworker.0 00000100:00100000:0.0:1788201427.797349:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201427.797377:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715376000 00000100:00100000:0.0:1788201427.797381:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715376000 00000100:00100000:0.0:1788201427.797402:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788201427.797405:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3654:x1875060715376000:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201427.797419:0:66318:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201427.797443:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3654:x1875060715376000:12345-0@lo:38:kworker.0 Request processed in 37us (200us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201427.797447:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788201427.797459:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715376384 00000100:00100000:0.0:1788201427.797462:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715376384 00000100:00100000:0.0:1788201427.797471:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715376512 00000100:00100000:0.0:1788201427.797473:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715376512 00000100:00100000:0.0:1788201427.797476:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715376768 00000100:00100000:0.0:1788201427.797478:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715376768 00000100:00100000:0.0:1788201427.797483:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1712 00000100:00100000:0.0:1788201427.797491:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715376384:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201427.797498:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201427.797516:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715376384:12345-0@lo:38:kworker.0 Request processed in 25us (249us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201427.797520:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1712 00000100:00100000:0.0:1788201427.797527:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1713 00000100:00100000:0.0:1788201427.797530:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715376512:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201427.797535:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201427.797552:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715376512:12345-0@lo:38:kworker.0 Request processed in 20us (251us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201427.797557:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1713 00000100:00100000:0.0:1788201427.797567:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1714 00000100:00100000:0.0:1788201427.797570:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715376768:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201427.797589:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201427.797611:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715376768:12345-0@lo:38:kworker.0 Request processed in 40us (262us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201427.797618:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1714 00000100:00100000:0.0:1788201427.797643:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715376896:0@lo:400:kworker.0 00000100:00100000:0.0:1788201427.797649:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715376640:0@lo:400:kworker.0 00000100:00080000:0.0:1788201427.797666:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201427.797670:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201427.797672:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715376000:0@lo:38:kworker.0 00000100:00080000:0.0:1788201427.797676:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201427.797684:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201427.797686:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715376384:0@lo:38:kworker.0 00000100:00080000:0.0:1788201427.797692:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201427.797694:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201427.797696:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715376512:0@lo:38:kworker.0 00000100:00080000:0.0:1788201427.797700:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201427.797702:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201427.797703:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715376768:0@lo:38:kworker.0 00000100:00080000:3.0:1788201427.799746:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00100000:10000000:1.0:1788201427.806505:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1788201427.807002:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788201427.807483:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1788201427.810039:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788201427.812528:0:102446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:1.0:1788201427.813166:0:102446:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788201427.813747:0:102446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788201427.813757:0:102446:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788201427.813769:0:102446:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1df2f 00000020:01000004:1.0:1788201427.813778:0:102446:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788201427.813790:0:102446:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788201427.813796:0:102446:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dc12f19b800 from MGS 00000020:01000004:1.0:1788201427.813799:0:102446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788201427.813810:0:102446:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8dc139bb8000) 00000020:00000080:1.0:1788201427.813824:0:102446:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:1.0:1788201427.813884:0:102446:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc12f19b800 from MGS, refs=2 00080000:01000000:1.0:1788201427.813890:0:102446:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788201427.813895:0:102446:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1df3d 00010000:00010000:1.0:1788201427.814047:0:102446:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1788201427.829732:0:102446:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788201427.831459:0:102450:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788201427.831582:0:102446:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788201427.831639:0:102446:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788201427.844955:0:102446:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788201427.845259:0:102446:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201427.845444:0:102446:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788201427.845450:0:102446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788201427.850526:0:102446:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788201427.850539:0:102446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788201427.850943:0:102446:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788201427.850950:0:102446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788201427.851432:0:102446:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788201427.851457:0:102446:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1788201427.851459:0:102446:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.120@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1788201427.851463:0:102446:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.120@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:2.0:1788201427.851473:0:102446:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8dc104280800 already not connected (conn 78, was 0): CONNECTING 00000100:00100000:2.0:1788201427.851479:0:102446:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00010000:00010000:1.0:1788201427.983283:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201428.948247:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201428.948295:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201428.948391:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695531264 00000100:00100000:1.0:1788201428.948404:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695531264 00000100:00100000:1.0:1788201428.948452:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695531392 00000100:00100000:1.0:1788201428.948456:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695531392 00000100:00100000:1.0:1788201428.948509:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1744 00000100:00100000:1.0:1788201428.948521:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2400:x1875060695531392:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201428.948605:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2400:x1875060695531392:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 86us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201428.948613:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1744 00000100:00100000:1.0:1788201428.948647:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1715 00000100:00100000:1.0:1788201428.948652:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695531264:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:1.0:1788201428.948672:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201428.948715:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695531264:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 61us (480us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201428.948722:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1715 00000100:00080000:3.0:1788201428.949061:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788201429.007198:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201430.031264:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201430.864445:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201430.864463:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715377024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201430.864542:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201430.864683:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715377024 00000100:00100000:1.0:1788201430.864691:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715377024 00000100:00100000:1.0:1788201430.864758:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788201430.864768:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715377024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201430.864796:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00080000:2.0:1788201430.865041:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201430.865143:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715377024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 375us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201430.865151:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788201430.865236:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dc005d53800 x1875060715377024/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201430.865255:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715377024:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788201431.056655:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201431.891847:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201431.891876:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715377152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201431.891978:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201431.892553:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715377152 00000100:00100000:1.0:1788201431.892563:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715377152 00000100:00100000:1.0:1788201431.892647:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788201431.892660:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715377152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201431.892690:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1788201431.892749:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715377152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201431.892756:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1788201431.892864:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201431.893071:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715377152:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788201432.079400:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201432.911368:0:3654:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201422/real 1788201422] req@ffff8dc1333bdc00 x1875060715374592/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788201432 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201432.911403:0:3654:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dc1333bdc00 x1875060715374592/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788201432 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201432.911425:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201432.911455:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788201432.911471:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715374592:0@lo:250:kworker.0 00000100:00080000:3.0:1788201432.911940:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201432.911947:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201432.911950:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201432.911956:0:93109:0:(import.c:510:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 4274 00000100:00080000:3.0:1788201432.911961:0:93109:0:(import.c:589:import_select_connection()) MGC192.168.201.120@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201432.911968:0:93109:0:(import.c:624:import_select_connection()) MGC192.168.201.120@tcp: import ffff8dc104280800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201432.912007:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efcb100 x1875060715377280/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201432.912053:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201432.912057:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201432.912059:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201432.912063:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4279 00000100:00080000:3.0:1788201432.912066:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201432.912070:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201432.912088:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efcaa00 x1875060715377408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201432.912142:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201432.912146:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201432.912148:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201432.912151:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4279 00000100:00080000:3.0:1788201432.912153:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201432.912172:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201432.912186:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc14014f800 x1875060715377792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201432.912196:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201432.912198:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201432.912200:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201432.912203:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4279 00000100:00080000:3.0:1788201432.912205:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201432.912208:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc11ccfb000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201432.912217:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc14014fb80 x1875060715377920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201432.912243:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201432.912246:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201432.912248:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201432.912251:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4279 00000100:00080000:3.0:1788201432.912254:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201432.912257:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc1401c3800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201432.912268:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc14014e300 x1875060715378176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201432.912311:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715377664:0@lo:400:kworker.0 00000100:00100000:3.0:1788201432.912376:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201432.912407:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201432.912413:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715377536:0@lo:400:kworker.0 00000100:00100000:3.0:1788201432.912436:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201432.912496:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715378048:0@lo:400:kworker.0 00000100:00100000:3.0:1788201432.912526:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201432.912545:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201432.912550:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715378304:0@lo:400:kworker.0 00000100:00100000:3.0:1788201432.912571:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00020000:2.0:1788201432.912660:0:3654:0:(client.c:1404:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff8dc12efcb100 x1875060715377280/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201432.913675:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715377664 00000100:00100000:1.0:1788201432.913697:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715377664 00000100:00100000:1.0:1788201432.913765:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715377536 00000100:00100000:1.0:1788201432.913768:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715377536 00000100:00100000:1.0:1788201432.913794:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788201432.913804:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715377664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201432.913890:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715377664:12345-0@lo:400:kworker.0 Request processed in 87us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201432.913897:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788201432.913915:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788201432.913922:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715377536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201432.913957:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715377536:12345-0@lo:400:kworker.0 Request processed in 36us (1521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201432.913963:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788201432.913988:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715378048 00000100:00100000:1.0:1788201432.913992:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715378048 00000100:00100000:1.0:1788201432.914055:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715378304 00000100:00100000:1.0:1788201432.914058:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715378304 00000100:00100000:1.0:1788201432.914083:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1745 00000100:00100000:1.0:1788201432.914090:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715378048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201432.914129:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715378048:12345-0@lo:400:kworker.0 Request processed in 40us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201432.914135:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1745 00000100:00100000:1.0:1788201432.914148:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1746 00000100:00100000:1.0:1788201432.914154:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715378304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201432.914183:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715378304:12345-0@lo:400:kworker.0 Request processed in 29us (1610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201432.914189:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1746 00000100:00100000:1.0:1788201432.914259:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715378304:0@lo:400:kworker.0 00000100:00100000:1.0:1788201432.914275:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715378048:0@lo:400:kworker.0 00000100:00100000:1.0:1788201432.914315:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715377536:0@lo:400:kworker.0 00010000:00080000:1.0:1788201432.914330:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dc14014ea00 x1875060715377664/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201432.914340:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715377664:0@lo:400:kworker.0 10000000:01000000:0.0:1788201432.914775:0:102446:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1788201432.914792:0:102446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3800/0x96d0c9b8c9a1c6a8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1c6af expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201432.914802:0:102446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3800/0x96d0c9b8c9a1c6a8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1c6af expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201432.914808:0:102446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788201432.914822:0:102446:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201432.914839:0:102446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3800/0x96d0c9b8c9a1c6a8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1c6af expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201432.914857:0:102446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1ca67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1ca6e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201432.914864:0:102446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1ca67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1ca6e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201432.914869:0:102446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201432.914872:0:102446:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201432.914877:0:102446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1ca67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1ca6e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201432.914885:0:102446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0078fda00/0x96d0c9b8c9a1ca75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1ca7c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201432.914891:0:102446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fda00/0x96d0c9b8c9a1ca75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1ca7c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201432.914895:0:102446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201432.914898:0:102446:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201432.914901:0:102446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0078fda00/0x96d0c9b8c9a1ca75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1ca7c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201432.914909:0:102446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1cabb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1cac2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201432.914915:0:102446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1cabb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1cac2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201432.914930:0:102446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201432.914934:0:102446:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201432.914939:0:102446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0078fcc00/0x96d0c9b8c9a1cabb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1cac2 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201432.914948:0:102446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1d6a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1d6a7 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201432.914955:0:102446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1d6a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1d6a7 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201432.914960:0:102446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201432.914963:0:102446:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201432.914966:0:102446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1d6a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1d6a7 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201432.914975:0:102446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc108c75000/0x96d0c9b8c9a1d6ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1d6d1 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201432.914981:0:102446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc108c75000/0x96d0c9b8c9a1d6ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1d6d1 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201432.914985:0:102446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201432.914988:0:102446:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201432.914990:0:102446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc108c75000/0x96d0c9b8c9a1d6ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1d6d1 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201432.914998:0:102446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0078fde00/0x96d0c9b8c9a1d73a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1d741 expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201432.915048:0:102446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0078fde00/0x96d0c9b8c9a1d73a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1d741 expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201432.915054:0:102446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201432.915058:0:102446:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201432.915064:0:102446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0078fde00/0x96d0c9b8c9a1d73a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1d741 expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201432.915072:0:102446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc00896bc00/0x96d0c9b8c9a1d764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1d76b expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201432.915078:0:102446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc00896bc00/0x96d0c9b8c9a1d764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1d76b expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201432.915083:0:102446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201432.915086:0:102446:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201432.915089:0:102446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc00896bc00/0x96d0c9b8c9a1d764 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1d76b expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201432.915099:0:102446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1d7b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1d7b8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201432.915104:0:102446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1d7b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1d7b8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201432.915109:0:102446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201432.915111:0:102446:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201432.915114:0:102446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc00896a200/0x96d0c9b8c9a1d7b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1d7b8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201432.915136:0:102446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1c63f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201432.915142:0:102446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1c63f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201432.915146:0:102446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201432.915149:0:102446:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201432.915153:0:102446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2a00/0x96d0c9b8c9a1c638 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1c63f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201432.915162:0:102446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3600/0x96d0c9b8c9a1c646 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1c64d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201432.915168:0:102446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3600/0x96d0c9b8c9a1c646 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1c64d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201432.915172:0:102446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788201432.915174:0:102446:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201432.915177:0:102446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3600/0x96d0c9b8c9a1c646 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1c64d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201432.915184:0:102446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc108c74600/0x96d0c9b8c9a1d6bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1d6c3 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201432.915189:0:102446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc108c74600/0x96d0c9b8c9a1d6bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1d6c3 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201432.915193:0:102446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788201432.915201:0:102446:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201432.915205:0:102446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc108c74600/0x96d0c9b8c9a1d6bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1d6c3 expref: -99 pid: 99760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201432.915213:0:102446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc00896a800/0x96d0c9b8c9a1d756 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1d75d expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201432.915219:0:102446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc00896a800/0x96d0c9b8c9a1d756 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1d75d expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201432.915224:0:102446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788201432.915226:0:102446:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788201432.915229:0:102446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc00896a800/0x96d0c9b8c9a1d756 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1d75d expref: -99 pid: 100575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788201432.915554:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201432.915560:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201432.934139:0:102446:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8dc104280800 already not connected (conn 79, was 0): CONNECTING 00000100:00080000:0.0:1788201432.934152:0:102446:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:2.0:1788201432.938179:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201432.938215:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:2.0:1788201432.938233:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:0:1875060715377280:0@lo:250:kworker.0 00000100:00100000:2.0:1788201432.938357:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715377408:0@lo:38:kworker.0 00000100:00100000:2.0:1788201432.938477:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201432.938547:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715377792:0@lo:38:kworker.0 00000100:00100000:2.0:1788201432.938578:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201432.938597:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715377920:0@lo:38:kworker.0 00000100:00100000:2.0:1788201432.938618:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201432.938648:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715378176:0@lo:38:kworker.0 00000100:00100000:2.0:1788201432.938694:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201432.939706:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715377408 00000100:00100000:0.0:1788201432.939724:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715377408 00000100:00100000:0.0:1788201432.939776:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788201432.939785:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118102450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3654:x1875060715377408:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201432.939813:0:101344:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201432.939899:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118102450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3654:x1875060715377408:12345-0@lo:38:kworker.0 Request processed in 113us (1422us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201432.939906:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788201432.940182:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715377792 00000100:00100000:0.0:1788201432.940187:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715377792 00000100:00100000:0.0:1788201432.940205:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715377920 00000100:00100000:0.0:1788201432.940208:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715377920 00000100:00100000:0.0:1788201432.940220:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715378176 00000100:00100000:0.0:1788201432.940233:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715378176 00000100:00100000:0.0:1788201432.940248:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1716 00000100:00100000:0.0:1788201432.940253:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715377792:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201432.940264:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201432.940295:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715377792:12345-0@lo:38:kworker.0 Request processed in 39us (1715us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201432.940300:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1716 00000100:00100000:0.0:1788201432.940311:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1717 00000100:00100000:0.0:1788201432.940315:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715377920:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201432.940324:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201432.940344:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715377920:12345-0@lo:38:kworker.0 Request processed in 29us (1725us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201432.940350:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1717 00000100:00100000:0.0:1788201432.940359:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1718 00000100:00100000:0.0:1788201432.940363:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715378176:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201432.940371:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201432.940391:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715378176:12345-0@lo:38:kworker.0 Request processed in 26us (1697us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201432.940396:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1718 00000100:00080000:1.0:1788201432.942424:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201432.942433:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788201432.942437:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201432.942456:0:93109:0:(import.c:510:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 4284 00000100:00080000:1.0:1788201432.942462:0:93109:0:(import.c:589:import_select_connection()) MGC192.168.201.120@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201432.942469:0:93109:0:(import.c:624:import_select_connection()) MGC192.168.201.120@tcp: import ffff8dc104280800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201432.942516:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d53800 x1875060715378432/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201432.952120:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715378432:0@lo:250:kworker.0 00000100:00100000:2.0:1788201432.952241:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788201432.952452:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201432.952459:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201432.952464:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715377408:0@lo:38:kworker.0 00000100:00080000:2.0:1788201432.952492:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201432.952496:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201432.952499:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715377792:0@lo:38:kworker.0 00000100:00080000:2.0:1788201432.952521:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201432.952524:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201432.952527:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715377920:0@lo:38:kworker.0 00000100:00080000:2.0:1788201432.952544:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201432.952547:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201432.952550:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715378176:0@lo:38:kworker.0 00000100:00100000:1.0:1788201432.952785:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715378432 00000100:00100000:1.0:1788201432.952794:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715378432 00000100:00100000:1.0:1788201432.953001:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201432.953010:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13c3ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3654:x1875060715378432:12345-0@lo:250:kworker.0 00010000:00080000:1.0:1788201432.953082:0:102452:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c9b18af6-fecc-4172-82c2-66531890fe11@0@lo t0 exp 0000000000000000 cur 4284 last 0 00000020:00000080:1.0:1788201432.953121:0:102452:0:(genops.c:1385:class_connect()) connect: client c9b18af6-fecc-4172-82c2-66531890fe11, cookie 0x96d0c9b8c9a1df44 00000100:00080000:1.0:1788201432.953416:0:102452:0:(import.c:65:import_set_state_nolock()) ffff8dc004013800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201432.953761:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13c3ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+5:3654:x1875060715378432:12345-0@lo:250:kworker.0 Request processed in 749us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201432.953770:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201432.954134:0:3654:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.120@tcp: committing for last_committed 0 gen 30 00000100:00080000:3.0:1788201432.954145:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.120@tcp: connect to target with instance 0 00000100:00080000:3.0:1788201432.954154:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788201432.954159:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788201432.954164:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788201432.954167:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788201432.954196:0:3654:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788201432.954206:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715378432:0@lo:250:kworker.0 00000020:01000000:1.0:1788201432.954413:0:93109:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.201.120@tcp 10000000:01000000:1.0:1788201432.954506:0:93109:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1788201432.954510:0:93109:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788201432.954513:0:93109:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788201432.954514:0:93109:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201432.954516:0:93109:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201432.954517:0:93109:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201432.954518:0:93109:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201432.954520:0:93109:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201432.954522:0:93109:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201432.954523:0:93109:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1788201432.954572:0:93109:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1788201432.954581:0:93109:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1788201432.954584:0:93109:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788201432.954585:0:93109:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201432.954588:0:93109:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201432.954590:0:93109:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201432.954592:0:93109:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201432.954594:0:93109:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201432.954595:0:93109:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201432.954597:0:93109:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201432.954598:0:93109:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00080000:0.0:1788201432.954616:0:102446:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000000:1.0:1788201432.954618:0:93109:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 00000020:01000004:0.0:1788201432.954638:0:102446:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788201432.954689:0:102446:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788201432.954695:0:102446:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 10000000:01000000:1.0:1788201432.954763:0:93109:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1788201432.954765:0:93109:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788201432.954766:0:93109:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788201432.954767:0:93109:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201432.954769:0:93109:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201432.954770:0:93109:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201432.954771:0:93109:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201432.954772:0:93109:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201432.954774:0:93109:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201432.954776:0:93109:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000040:01000000:0.0:1788201432.954813:0:102446:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000100:00100000:2.0:1788201432.954845:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715378816:0@lo:253:kworker.0 00000020:01000004:0.0:1788201432.954857:0:102446:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.120@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788201432.954864:0:102446:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788201432.954871:0:102446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788201432.954873:0:102446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201432.954874:0:102446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201432.954875:0:102446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201432.954877:0:102446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201432.954879:0:102446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201432.954881:0:102446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788201432.954882:0:102446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201432.954884:0:102446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788201432.954887:0:102446:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788201432.954889:0:102446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788201432.954890:0:102446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788201432.954891:0:102446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201432.954893:0:102446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201432.954894:0:102446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201432.954895:0:102446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201432.954896:0:102446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201432.954897:0:102446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788201432.954899:0:102446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201432.954900:0:102446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000100:00100000:2.0:1788201432.954916:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1788201432.954928:0:102446:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788201432.954951:0:102446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715378944:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788201432.955049:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715378560:0@lo:253:kworker.0 00000020:01000000:1.0:1788201432.955167:0:93109:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1788201432.955186:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201432.955207:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715378688:0@lo:253:kworker.0 00000100:00100000:2.0:1788201432.962260:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715378816 00000100:00100000:2.0:1788201432.962283:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715378816 00000100:00100000:2.0:1788201432.962359:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715378560 00000100:00100000:2.0:1788201432.962364:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715378560 00000100:00100000:2.0:1788201432.962387:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201432.962398:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13c3c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+6:3657:x1875060715378816:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788201432.962458:0:102454:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:2.0:1788201432.962636:0:102453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201432.962645:0:102453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+6:3655:x1875060715378560:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788201432.962663:0:102453:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:2.0:1788201432.962703:0:102456:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788201432.962901:0:102454:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 131 20000000:01000000:2.0:1788201432.964552:0:102457:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788201432.964562:0:102457:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788201432.964566:0:102457:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788201432.964568:0:102457:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788201432.964589:0:102457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 20000000:01000000:2.0:1788201432.964755:0:102454:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788201432.964777:0:102454:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788201432.966496:0:102446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201432.966543:0:102446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103892540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201432.966606:0:102452:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1788201432.966616:0:102452:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:0.0:1788201432.966747:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715378944 00000100:00100000:0.0:1788201432.966756:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715378944 00000100:00100000:0.0:1788201432.966859:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788201432.966869:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+7:102446:x1875060715378944:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788201432.966911:0:102458:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788201432.966915:0:102458:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788201432.966917:0:102458:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:0.0:1788201432.966924:0:102458:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788201432.967841:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201432.967904:0:102452:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 4 min 3 max 32 00000100:00100000:1.0:1788201432.967915:0:102452:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0004' 00000100:00100000:1.0:1788201432.968111:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715378688 00000100:00100000:1.0:1788201432.968122:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715378688 00000100:00100000:1.0:1788201432.968237:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201432.968258:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+8:3656:x1875060715378688:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788201432.968295:0:102459:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788201432.983306:0:102453:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788201432.983694:0:102454:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788201432.983753:0:102454:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788201432.984226:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+8:102446:x1875060715378944:12345-0@lo:253:mount.lustre.0 Request processed in 17350us (17740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201432.984241:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788201432.984664:0:102446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715378944:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788201432.984702:0:102446:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788201432.984707:0:102446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788201432.984709:0:102446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788201432.984710:0:102446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201432.984712:0:102446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201432.984714:0:102446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201432.984715:0:102446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201432.984716:0:102446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201432.984718:0:102446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788201432.984720:0:102446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201432.984721:0:102446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788201432.984744:0:102446:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dc12f19b800 from lustre-MDT0000 10000000:01000000:0.0:1788201432.984780:0:102446:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788201432.984782:0:102446:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788201432.984793:0:102446:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dc12f19b800 10000000:01000000:0.0:1788201432.984798:0:102446:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788201432.984804:0:102446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8dc12f19b800 10000000:01000000:0.0:1788201432.984807:0:102446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788201432.984811:0:102446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dc12f19b800 from 1 10000000:01000000:0.0:1788201432.984814:0:102446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788201432.984947:0:102446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1df4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201432.984960:0:102446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1df4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201432.984971:0:102446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1df4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201432.984993:0:102446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715379072:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201432.985085:0:102446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201432.985128:0:102446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103892c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201432.985189:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715379072 00000100:00100000:1.0:1788201432.985198:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715379072 00000100:00100000:1.0:1788201432.985254:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201432.985265:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+8:102446:x1875060715379072:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201432.985279:0:102452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201432.985296:0:102452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064ed000/0x96d0c9b8c9a1df52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1df4b expref: -99 pid: 102452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201432.985322:0:102452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ed000/0x96d0c9b8c9a1df52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1df4b expref: 9 pid: 102452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201432.985333:0:102452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064ed000/0x96d0c9b8c9a1df52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1df4b expref: 9 pid: 102452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201432.985343:0:102452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ed000, rc 0) 00000100:00100000:1.0:1788201432.985386:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+9:102446:x1875060715379072:12345-0@lo:101:mount.lustre.0 Request processed in 123us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201432.985392:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788201432.985697:0:102446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715379072:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201432.985724:0:102446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1df4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1df52 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201432.985734:0:102446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1df4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1df52 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201432.985749:0:102446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788201432.985773:0:102446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1df4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1df52 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201432.985780:0:102446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1df4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1df52 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201432.985787:0:102446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788201432.985791:0:102446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788201432.985796:0:102446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8dc12f19b800 10000000:01000000:0.0:1788201432.985799:0:102446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788201432.985803:0:102446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788201432.985806:0:102446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788201432.985835:0:102446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d58800/0x96d0c9b8c9a1df59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201432.985843:0:102446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc140d58800/0x96d0c9b8c9a1df59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201432.985850:0:102446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc140d58800/0x96d0c9b8c9a1df59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201432.985866:0:102446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715379200:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201432.985904:0:102446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201432.985933:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715379200 00000100:00100000:0.0:1788201432.985937:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715379200 00000100:00100000:0.0:1788201432.985960:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788201432.985966:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+9:102446:x1875060715379200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201432.985974:0:102452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201432.985990:0:102452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140d58000/0x96d0c9b8c9a1df60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1df59 expref: -99 pid: 102452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201432.986005:0:102452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140d58000/0x96d0c9b8c9a1df60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1df59 expref: 10 pid: 102452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201432.986012:0:102452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140d58000/0x96d0c9b8c9a1df60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1df59 expref: 10 pid: 102452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201432.986061:0:102452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58000, rc 0) 00000100:00100000:0.0:1788201432.986085:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+10:102446:x1875060715379200:12345-0@lo:101:mount.lustre.0 Request processed in 119us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201432.986092:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788201432.986123:0:102446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103892c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201432.986136:0:102446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715379200:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201432.986145:0:102446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc140d58800/0x96d0c9b8c9a1df59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1df60 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201432.986151:0:102446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc140d58800/0x96d0c9b8c9a1df59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1df60 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201432.986209:0:102446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715379328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201432.986238:0:102446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201432.988586:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715379328 00000100:00100000:0.0:1788201432.988606:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715379328 00000100:00100000:0.0:1788201432.988674:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201432.988685:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+10:102446:x1875060715379328:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201432.988940:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:102446:x1875060715379328:12345-0@lo:501:mount.lustre.0 Request processed in 256us (2699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201432.988948:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201432.989008:0:102446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103892c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201432.989065:0:102446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715379328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201432.989130:0:102446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715379456:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201432.989210:0:102446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201432.989241:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715379456 00000100:00100000:0.0:1788201432.989246:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715379456 00000100:00100000:0.0:1788201432.989266:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788201432.989272:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:102446:x1875060715379456:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201432.989384:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:102446:x1875060715379456:12345-0@lo:503:mount.lustre.0 Request processed in 112us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201432.989391:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788201432.989430:0:102446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103892c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201432.989442:0:102446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715379456:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201432.989704:0:102460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:102460:1875060715379584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201432.989739:0:102460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201432.989757:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715379584 00000100:00100000:0.0:1788201432.989761:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715379584 00000100:00100000:0.0:1788201432.989784:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788201432.989790:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:102460:x1875060715379584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201432.989966:0:102460:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103892900 going to sleep for 11 seconds 20000000:01000000:3.0:1788201432.993500:0:102456:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788201432.993517:0:102456:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788201432.993567:0:102456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1df67 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201432.993590:0:102456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1df67 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788201432.993601:0:102456:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000086110s 00010000:00010000:3.0:1788201432.993608:0:102456:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1df67 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201432.993650:0:102456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1df67 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201432.993657:0:102456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1df67 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201432.993665:0:102456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1df67 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201432.993673:0:102456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201432.993677:0:102456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1df67 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201432.993687:0:102456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1df67 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201432.993703:0:102456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1df67 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201432.993711:0:102456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1df67 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201432.993716:0:102456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1df67 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201432.997413:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13c3c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:3657:x1875060715378816:12345-0@lo:253:kworker.0 Request processed in 35000us (42481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201432.997443:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:0.0:1788201432.997630:0:3657:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788201432.997634:0:3657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788201432.997636:0:3657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201432.997637:0:3657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201432.997638:0:3657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201432.997640:0:3657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201432.997642:0:3657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201432.997643:0:3657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201432.997645:0:3657:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788201432.997649:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715378816:0@lo:253:kworker.0 20000000:01000000:3.0:1788201432.997813:0:102453:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788201432.997827:0:102453:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788201432.997962:0:102459:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788201432.998149:0:102456:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788201432.998154:0:102456:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788201432.998183:0:102456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc006dbc400/0x96d0c9b8c9a1df6e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201432.998203:0:102456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006dbc400/0x96d0c9b8c9a1df6e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788201432.998213:0:102456:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000086110s 00010000:00010000:2.0:1788201432.998219:0:102456:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc006dbc400/0x96d0c9b8c9a1df6e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201432.998227:0:102456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc006dbc400/0x96d0c9b8c9a1df6e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201432.998250:0:102456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc006dbc400/0x96d0c9b8c9a1df6e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201432.998258:0:102456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc006dbc400/0x96d0c9b8c9a1df6e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201432.998265:0:102456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201432.998269:0:102456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc006dbc400/0x96d0c9b8c9a1df6e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201432.998278:0:102456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc006dbc400/0x96d0c9b8c9a1df6e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201432.998295:0:102456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc006dbc400/0x96d0c9b8c9a1df6e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201432.998304:0:102456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc006dbc400/0x96d0c9b8c9a1df6e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201432.998311:0:102456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006dbc400/0x96d0c9b8c9a1df6e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201432.999927:0:102453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:3655:x1875060715378560:12345-0@lo:253:kworker.0 Request processed in 37272us (44731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201432.999950:0:102453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:0.0:1788201433.000171:0:3655:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788201433.000174:0:3655:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788201433.000176:0:3655:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201433.000177:0:3655:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201433.000179:0:3655:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201433.000180:0:3655:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201433.000182:0:3655:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201433.000184:0:3655:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201433.000186:0:3655:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788201433.000190:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715378560:0@lo:253:kworker.0 00000100:00100000:1.0:1788201433.000561:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+9:102460:x1875060715379584:12345-0@lo:502:llog_process_th.0 Request processed in 10769us (10820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201433.000571:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788201433.000758:0:102460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:102460:1875060715379584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201433.000797:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201433.000810:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201433.000812:0:102460:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788201433.000830:0:102460:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788201433.000833:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201433.000854:0:102460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8dc12f30cd28) 00000020:00000080:0.0:1788201433.000884:0:102460:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:0.0:1788201433.000891:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788201433.001061:0:102460:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788201433.001072:0:102460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1df7c 00000020:00000080:0.0:1788201433.001351:0:102460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788201433.001356:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201433.001360:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201433.001361:0:102460:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788201433.001364:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201433.001368:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201433.001369:0:102460:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788201433.001373:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201433.001382:0:102460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8dc12f3099b8) 00000020:00000080:0.0:1788201433.001398:0:102460:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:0.0:1788201433.001402:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788201433.001404:0:102460:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788201433.001407:0:102460:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788201433.001414:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788201433.001835:0:102460:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc12f19b800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788201433.001852:0:102460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8dc12f308000) 00000020:00000080:0.0:1788201433.001866:0:102460:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:0.0:1788201433.002217:0:102460:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788201433.002227:0:102460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1df91 00000020:00000080:0.0:1788201433.002501:0:102460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788201433.002510:0:102460:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788201433.002516:0:102460:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x96d0c9b8c9a1df98 00080000:01000000:0.0:1788201433.002522:0:102460:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788201433.002526:0:102460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1df9f 20000000:01000000:1.0:1788201433.011598:0:102459:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788201433.011642:0:102459:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788201433.012054:0:102456:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788201433.012062:0:102456:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788201433.012095:0:102456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc006dbd400/0x96d0c9b8c9a1dfa6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201433.012117:0:102456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006dbd400/0x96d0c9b8c9a1dfa6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788201433.012131:0:102456:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000086110s 00010000:00010000:2.0:1788201433.012148:0:102456:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc006dbd400/0x96d0c9b8c9a1dfa6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201433.012155:0:102456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc006dbd400/0x96d0c9b8c9a1dfa6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201433.012163:0:102456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc006dbd400/0x96d0c9b8c9a1dfa6 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201433.012171:0:102456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc006dbd400/0x96d0c9b8c9a1dfa6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201433.012178:0:102456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201433.012183:0:102456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc006dbd400/0x96d0c9b8c9a1dfa6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201433.012192:0:102456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc006dbd400/0x96d0c9b8c9a1dfa6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201433.012210:0:102456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc006dbd400/0x96d0c9b8c9a1dfa6 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201433.012218:0:102456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc006dbd400/0x96d0c9b8c9a1dfa6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201433.012225:0:102456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006dbd400/0x96d0c9b8c9a1dfa6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201433.013361:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+8:3656:x1875060715378688:12345-0@lo:253:kworker.0 Request processed in 45104us (45517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201433.013379:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:1.0:1788201433.013470:0:3656:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1788201433.013473:0:3656:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201433.013475:0:3656:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201433.013476:0:3656:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201433.013477:0:3656:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201433.013479:0:3656:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201433.013490:0:3656:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201433.013492:0:3656:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201433.013493:0:3656:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788201433.013498:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715378688:0@lo:253:kworker.0 00000100:00100000:0.0:1788201433.044417:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201433.044529:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695531776 00000100:00100000:2.0:1788201433.044544:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695531776 00000100:00080000:3.0:1788201433.044645:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201433.044657:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1747 00000100:00100000:2.0:1788201433.044674:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2401:x1875060695531776:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201433.044783:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2401:x1875060695531776:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 114us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201433.044791:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1747 00000100:00100000:3.0:1788201433.046206:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201433.046272:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695531520 00000100:00100000:2.0:1788201433.046284:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695531520 00000100:00100000:2.0:1788201433.046335:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:2.0:1788201433.046343:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0+-99:2399:x1875060695531520:12345-192.168.201.20@tcp:250:kworker.0 00010000:00080000:2.0:1788201433.046375:0:102458:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 93ba7067-43b5-4e46-8db7-27c040fa03d9@192.168.201.20@tcp t0 exp 0000000000000000 cur 4284 last 0 00000020:00000080:2.0:1788201433.046413:0:102458:0:(genops.c:1385:class_connect()) connect: client 93ba7067-43b5-4e46-8db7-27c040fa03d9, cookie 0x96d0c9b8c9a1dfad 00000100:00080000:2.0:1788201433.046606:0:102458:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201433.046720:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+5:2399:x1875060695531520:12345-192.168.201.20@tcp:250:kworker.0 Request processed in 376us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201433.046728:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:0.0:1788201433.054641:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201433.054840:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695531648 00000100:00100000:0.0:1788201433.054853:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695531648 00000100:00100000:0.0:1788201433.054905:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1719 00000100:00100000:0.0:1788201433.054916:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695531648:12345-192.168.201.20@tcp:38:kworker.0 00010000:02000000:0.0:1788201433.054944:0:66312:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.201.20@tcp (not set up) 00000100:00100000:0.0:1788201433.062502:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695531648:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 7317us (7616us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201433.062523:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1719 00010000:00010000:0.0:1788201433.103149:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201433.128460:0:102460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1788201433.128663:0:102460:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 120259084300 srv lr: 124554051584 lx: 0 gen 22 00000001:00080000:2.0:1788201433.128724:0:102460:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 6e293f14-c501-4bc5-9dd4-a18ef02756b4 idx: 2 lr: 120259084298 srv lr: 124554051584 lx: 0 gen 24 00000001:00000004:2.0:1788201433.128753:0:102460:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 30, last_transno is 124554051584 00000001:00080000:2.0:1788201433.128884:0:102460:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1788201433.128962:0:102460:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc00750d900: xid 1875060695521024, transno 124554051758, client gen 24, slot idx 0 00000001:00080000:2.0:1788201433.128974:0:102460:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc00750da80: xid 1875060715362816, transno 124554051760, client gen 22, slot idx 1 00000001:00080000:2.0:1788201433.128979:0:102460:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc00750d9c0: xid 1875060715364864, transno 124554051761, client gen 22, slot idx 2 00000001:00080000:2.0:1788201433.128983:0:102460:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc00750d300: xid 1875060695484544, transno 124554051728, client gen 24, slot idx 3 00000001:00080000:2.0:1788201433.128988:0:102460:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc00750d6c0: xid 1875060695484032, transno 124554051729, client gen 24, slot idx 4 00000001:00080000:2.0:1788201433.129002:0:102460:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc140a45900: xid 1875060695483008, transno 124554051723, client gen 24, slot idx 5 00000001:00080000:2.0:1788201433.129007:0:102460:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc140a45cc0: xid 1875060695483008, transno 124554051724, client gen 24, slot idx 6 00000020:00000080:2.0:1788201433.129564:0:102460:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8dc004fd4d28) 00000020:00000080:2.0:1788201433.129590:0:102460:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1788201433.129683:0:102460:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788201433.129693:0:102460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1dfc9 00000020:00000080:0.0:1788201433.145943:0:102460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788201433.155394:0:102460:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x96d0c9b8c9a1dfd0 00000020:00000080:1.0:1788201433.162310:0:102460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788201433.162326:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201433.162337:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201433.162339:0:102460:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788201433.162343:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788201433.162347:0:102460:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1788201433.162348:0:102460:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201433.162350:0:102460:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201433.162352:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788201433.162354:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201433.162355:0:102460:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788201433.162357:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201433.162362:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201433.162363:0:102460:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788201433.162368:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788201433.162426:0:102460:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788201433.162445:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201433.162447:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201433.162449:0:102460:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788201433.162451:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201433.162467:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201433.162468:0:102460:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788201433.162471:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788201433.162476:0:102460:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:00000080:1.0:1788201433.162516:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201433.162531:0:102460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8dc139bb99b8) 00000020:00000080:1.0:1788201433.162551:0:102460:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1788201433.162556:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788201433.162616:0:102460:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788201433.162621:0:102460:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788201433.162628:0:102460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1dfde 00010000:00080000:1.0:1788201433.162658:0:102460:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc13f80c800@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:1.0:1788201433.169230:0:102460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1788201433.173917:0:102460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201433.173932:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788201433.173972:0:102460:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788201433.173996:0:102460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1dfe5 00000100:00080000:1.0:1788201433.174006:0:102460:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201433.174011:0:102460:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8dc13f80c800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201433.174082:0:102460:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc14014e300 x1875060715379712/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201433.174101:0:102460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788201433.174171:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201433.174176:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201433.174177:0:102460:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788201433.174180:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788201433.174183:0:102460:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1788201433.174184:0:102460:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201433.174186:0:102460:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201433.174187:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788201433.174189:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201433.174203:0:102460:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788201433.174207:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788201433.174212:0:102460:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788201433.174215:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201433.174216:0:102460:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788201433.174219:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788201433.174223:0:102460:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:1.0:1788201433.174245:0:102460:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788201433.174248:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201433.174262:0:102460:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8dc1060e3370) 00000020:00000080:1.0:1788201433.174276:0:102460:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1788201433.174281:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788201433.174340:0:102460:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788201433.174345:0:102460:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788201433.174352:0:102460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1dff3 00010000:00080000:1.0:1788201433.174382:0:102460:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc005a48000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:1.0:1788201433.174573:0:102460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:3.0:1788201433.174885:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715379712:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201433.174990:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201433.175158:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715379712 00000100:00100000:0.0:1788201433.175166:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715379712 00000100:00100000:0.0:1788201433.175206:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788201433.175214:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3654:x1875060715379712:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788201433.175240:0:66317:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4284 last 0 00000020:00000080:0.0:1788201433.175289:0:66317:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1dffa 00000004:00100000:0.0:1788201433.175305:0:66317:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788201433.175401:0:66317:0:(import.c:65:import_set_state_nolock()) ffff8dc005d77800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201433.175470:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715379712:12345-0@lo:38:llog_process_th.0 Request processed in 253us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201433.175491:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788201433.175522:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201433.175533:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 18 00000100:00080000:3.0:1788201433.175540:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788201433.175545:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788201433.175548:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f80c800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788201433.175569:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715379712:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201433.175729:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715379840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201433.175760:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201433.176167:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715379840 00000100:00100000:2.0:1788201433.176173:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715379840 00000100:00100000:2.0:1788201433.176221:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788201433.176232:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715379840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201433.176270:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445371904 avail 1299132416 00000100:00100000:2.0:1788201433.176326:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715379840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201433.176335:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788201433.177175:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715379840:0@lo:41:osp-pre-1-0.0 00000040:01000000:2.0:1788201433.179493:0:102460:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788201433.179534:0:102460:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788201433.179987:0:102460:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 28, last_idx 29 00000040:00080000:3.0:1788201433.181679:0:102460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201433.181712:0:102460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].30, 64 off10112 00000040:00080000:3.0:1788201433.181858:0:102460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x78:0x0].1, 64 off8256 00000040:00080000:1.0:1788201433.182294:0:102466:0:(llog.c:805:llog_process_thread()) index: 29, lh_last_idx: 30 synced_idx: 0 lgh_last_idx: 30 00000040:00080000:1.0:1788201433.182299:0:102466:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x74:0x0] at index 29 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788201433.182529:0:102466:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 29, last_idx 30 00000040:00080000:1.0:1788201433.182546:0:102466:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x74:0x0] at index 29 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788201433.182661:0:102466:0:(llog.c:805:llog_process_thread()) index: 30, lh_last_idx: 30 synced_idx: 30 lgh_last_idx: 30 00000040:00080000:1.0:1788201433.182664:0:102466:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x78:0x0] at index 30 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788201433.183700:0:102460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201433.183711:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788201433.183742:0:102460:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788201433.183761:0:102460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1e001 00000100:00080000:3.0:1788201433.183770:0:102460:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201433.183821:0:102460:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dc005a48000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201433.183851:0:102460:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc133330380 x1875060715379968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201433.183874:0:102460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1788201433.183919:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715379968:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1788201433.183944:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201433.183950:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201433.183952:0:102460:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788201433.183963:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788201433.183966:0:102460:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1788201433.183968:0:102460:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201433.183970:0:102460:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201433.183972:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788201433.183975:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201433.183976:0:102460:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788201433.183979:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788201433.183983:0:102460:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788201433.183987:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201433.183989:0:102460:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788201433.183992:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788201433.183996:0:102460:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000100:00100000:2.0:1788201433.184005:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788201433.184040:0:102460:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788201433.184044:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201433.184055:0:102460:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8dc1256399b8) 00000020:00000080:3.0:1788201433.184069:0:102460:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1788201433.184074:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788201433.184147:0:102460:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788201433.184153:0:102460:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788201433.184159:0:102460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1e00f 00010000:00080000:3.0:1788201433.184188:0:102460:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc1031fb000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:3.0:1788201433.184526:0:102460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:3.0:1788201433.184594:0:102460:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788201433.184608:0:102460:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788201433.185083:0:102460:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 28, last_idx 29 00000040:00080000:3.0:1788201433.186075:0:102460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201433.186101:0:102460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].30, 64 off10112 00000040:00080000:3.0:1788201433.186197:0:102460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x7a:0x0].1, 64 off8256 00000100:00100000:0.0:1788201433.187373:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715379968 00000100:00100000:0.0:1788201433.187384:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715379968 00000100:00100000:0.0:1788201433.187432:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788201433.187440:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3654:x1875060715379968:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1788201433.187603:0:99766:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4284 last 0 00000020:00000080:0.0:1788201433.187634:0:99766:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1e016 00002000:00100000:0.0:1788201433.187650:0:99766:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8dc005d72000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788201433.187654:0:99766:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788201433.187657:0:99766:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788201433.187734:0:99766:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788201433.187762:0:99766:0:(import.c:65:import_set_state_nolock()) ffff8dc005d76000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201433.187856:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715379968:12345-0@lo:8:llog_process_th.0 Request processed in 415us (3852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201433.187864:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788201433.188190:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788201433.188199:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 4 00000100:00080000:2.0:1788201433.188207:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788201433.188212:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788201433.188215:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc005a48000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788201433.188244:0:3654:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788201433.188258:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715379968:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788201433.188421:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715380096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201433.188569:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201433.188622:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715380096 00000100:00100000:0.0:1788201433.188628:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715380096 00000100:00100000:0.0:1788201433.188665:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788201433.188673:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715380096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201433.188690:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201433.188728:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715380096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201433.188734:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788201433.188766:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715380096:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788201433.188908:0:102468:0:(llog.c:805:llog_process_thread()) index: 29, lh_last_idx: 30 synced_idx: 0 lgh_last_idx: 30 00000040:00080000:2.0:1788201433.188913:0:102468:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x76:0x0] at index 29 of catalog [0x1:0x5:0x0] 00000100:00080000:3.0:1788201433.189150:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788201433.189163:0:102466:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788201433.189217:0:102466:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 4284661199951ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788201433.189223:0:102466:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000040:00080000:2.0:1788201433.189543:0:102468:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 29, last_idx 30 00000040:00080000:2.0:1788201433.190225:0:102468:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x76:0x0] at index 29 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788201433.190663:0:102460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201433.190678:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788201433.190726:0:102460:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788201433.190752:0:102460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1e01d 00000100:00080000:3.0:1788201433.190765:0:102460:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201433.190771:0:102460:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dc1031fb000 using connection 192.168.201.120@tcp/0@lo 00000004:00080000:0.0:1788201433.190802:0:102447:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:2.0:1788201433.191424:0:102468:0:(llog.c:805:llog_process_thread()) index: 30, lh_last_idx: 30 synced_idx: 30 lgh_last_idx: 30 00000040:00080000:2.0:1788201433.191430:0:102468:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x7a:0x0] at index 30 of catalog [0x1:0x5:0x0] 00000100:00100000:3.0:1788201433.192392:0:102460:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc133330a80 x1875060715380224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201433.192422:0:102460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788201433.192533:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715380224:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788201433.192610:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788201433.192828:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201433.192834:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201433.192836:0:102460:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788201433.192840:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201433.192844:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201433.192845:0:102460:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788201433.192848:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788201433.192850:0:102460:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788201433.192853:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201433.192855:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201433.192857:0:102460:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788201433.192859:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201433.192862:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201433.192863:0:102460:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788201433.192867:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788201433.192872:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201433.192875:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201433.192877:0:102460:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000020:01000000:3.0:1788201433.192879:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788201433.192883:0:102460:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #43 00000020:01000000:3.0:1788201433.192884:0:102460:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201433.192886:0:102460:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000100:00100000:3.0:1788201433.192917:0:102460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:102460:1875060715380352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201433.192939:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715380224 00000100:00100000:0.0:1788201433.192948:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715380224 00000100:00100000:0.0:1788201433.192986:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788201433.192996:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3654:x1875060715380224:12345-0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788201433.192999:0:102460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788201433.193052:0:101192:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4284 last 0 00000100:00100000:3.0:1788201433.193067:0:102453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715380352 00000100:00100000:3.0:1788201433.193073:0:102453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715380352 00000020:00000080:0.0:1788201433.193084:0:101192:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1e024 00002000:00100000:0.0:1788201433.193102:0:101192:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8dc005d71800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788201433.193107:0:101192:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000100:00100000:3.0:1788201433.193109:0:102453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00002000:00100000:0.0:1788201433.193111:0:101192:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1788201433.193118:0:102453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+8:102460:x1875060715380352:12345-0@lo:502:llog_process_th.0 00002000:00080000:0.0:1788201433.193197:0:101192:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788201433.193224:0:101192:0:(import.c:65:import_set_state_nolock()) ffff8dc005d76800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201433.193234:0:102453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+8:102460:x1875060715380352:12345-0@lo:502:llog_process_th.0 Request processed in 115us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201433.193242:0:102453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788201433.193282:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715380224:12345-0@lo:8:llog_process_th.0 Request processed in 285us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201433.193289:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788201433.193299:0:102460:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc139bdf900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201433.193321:0:102460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:102460:1875060715380352:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201433.193345:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788201433.193349:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201433.193351:0:102460:0:(obd_config.c:1563:class_process_config()) marker 43 (0x6) lustre-MDT0000-m new lustre.pool_134 00000020:01000000:3.0:1788201433.193354:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788201433.193357:0:102460:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #46 00000020:01000000:3.0:1788201433.193359:0:102460:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201433.193360:0:102460:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201433.193362:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788201433.193364:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201433.193366:0:102460:0:(obd_config.c:1563:class_process_config()) marker 46 (0x6) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:01000000:3.0:1788201433.193369:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201433.193372:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201433.193374:0:102460:0:(obd_config.c:1563:class_process_config()) marker 47 (0x1) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1788201433.193377:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: ce022 00000020:01000000:3.0:1788201433.193385:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201433.193387:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201433.193389:0:102460:0:(obd_config.c:1563:class_process_config()) marker 47 (0x2) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:01000000:3.0:1788201433.193391:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201433.193394:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201433.193401:0:102460:0:(obd_config.c:1563:class_process_config()) marker 50 (0x1) lustre-MDT0000-m del lustre.pool_134 00000020:00000080:3.0:1788201433.193405:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1788201433.193425:0:102460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:102460:1875060715380480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201433.193457:0:102460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201433.193492:0:102460:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc139bdf900 going to sleep for 11 seconds 00010000:00080000:2.0:1788201433.194287:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dc133330a80 x1875060715380224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788201443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201433.194299:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788201433.194307:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788201433.194315:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788201433.194321:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788201433.194324:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1031fb000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788201433.194340:0:3654:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788201433.194345:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715380224:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788201433.194407:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715380608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201433.194446:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201433.194506:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715380608 00000100:00100000:0.0:1788201433.194508:0:102459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715380480 00000100:00100000:2.0:1788201433.194512:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715380608 00000100:00100000:0.0:1788201433.194515:0:102459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715380480 00000100:00100000:0.0:1788201433.194555:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788201433.194559:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788201433.194566:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+8:102460:x1875060715380480:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201433.194572:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715380608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201433.194595:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201433.194635:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715380608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201433.194649:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788201433.194682:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+8:102460:x1875060715380480:12345-0@lo:502:llog_process_th.0 Request processed in 117us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201433.194691:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788201433.194692:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dc12fb0e680 x1875060715380608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201433.194710:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715380608:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788201433.194892:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201433.194914:0:102460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:102460:1875060715380480:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201433.194938:0:102460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201433.194945:0:102460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201433.194947:0:102460:0:(obd_config.c:1563:class_process_config()) marker 50 (0x2) lustre-MDT0000-m del lustre.pool_134 00000040:00080000:3.0:1788201433.194951:0:102460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000004:00080000:2.0:1788201433.195215:0:102468:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788201433.195296:0:102468:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 4284667278881ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788201433.195303:0:102468:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:0.0:1788201433.195332:0:102446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-58 (rc=0) 10000000:01000000:0.0:1788201433.195358:0:102446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788201433.195378:0:102446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d58800/0x96d0c9b8c9a1df59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1df60 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201433.195390:0:102446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc140d58800/0x96d0c9b8c9a1df59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1df60 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201433.195398:0:102446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc12f19b800 from 1 10000000:01000000:0.0:1788201433.195402:0:102446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788201433.195429:0:102446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1e02b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201433.195437:0:102446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1e02b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201433.195518:0:102446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1e02b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201433.195541:0:102446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715380736:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201433.195579:0:102446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201433.195665:0:102446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0050f1000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201433.200904:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715380736 00000100:00100000:3.0:1788201433.200919:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715380736 00000100:00100000:3.0:1788201433.200978:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788201433.200988:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:102446:x1875060715380736:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201433.201004:0:102454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201433.201050:0:102454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1e032 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e02b expref: -99 pid: 102454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201433.201076:0:102454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1e032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e02b expref: 9 pid: 102454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201433.201085:0:102454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1e032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e02b expref: 9 pid: 102454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201433.201093:0:102454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c75800, rc 0) 00000100:00100000:3.0:1788201433.201169:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+9:102446:x1875060715380736:12345-0@lo:101:mount.lustre.0 Request processed in 182us (5589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201433.201176:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788201433.201254:0:102446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715380736:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201433.201274:0:102446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1e02b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e032 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201433.201283:0:102446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1e02b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e032 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201433.201872:0:102446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715380864:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788201433.201919:0:102446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201433.201961:0:102446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc139bdf900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201433.202062:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715380864 00000100:00100000:1.0:1788201433.202068:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715380864 00000100:00100000:1.0:1788201433.202103:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788201433.202112:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+9:102446:x1875060715380864:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788201433.202129:0:102452:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788201433.202147:0:102452:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788201433.202152:0:102452:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788201433.202159:0:102452:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788201433.202162:0:102452:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 134 00000100:00100000:1.0:1788201433.202271:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+9:102446:x1875060715380864:12345-0@lo:256:mount.lustre.0 Request processed in 152us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201433.202280:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788201433.203648:0:102446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715380864:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788201433.205819:0:102446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788201433.205849:0:102446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1e02b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e032 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201433.205861:0:102446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1e02b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e032 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201433.205870:0:102446:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc12f19b800 from 1 10000000:01000000:3.0:1788201433.205873:0:102446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201433.206202:0:102446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1e039 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201433.206211:0:102446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1e039 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201433.206222:0:102446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1e039 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201433.206264:0:102446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715380992:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201433.206327:0:102446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201433.206368:0:102446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc139bdf900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201433.206636:0:102459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715380992 00000100:00100000:0.0:1788201433.206645:0:102459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715380992 00000100:00100000:0.0:1788201433.206702:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201433.206712:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+9:102446:x1875060715380992:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201433.206725:0:102459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201433.206751:0:102459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140d59c00/0x96d0c9b8c9a1e040 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e039 expref: -99 pid: 102459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201433.206774:0:102459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140d59c00/0x96d0c9b8c9a1e040 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e039 expref: 10 pid: 102459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201433.206783:0:102459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140d59c00/0x96d0c9b8c9a1e040 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e039 expref: 10 pid: 102459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201433.206792:0:102459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59c00, rc 0) 00000100:00100000:0.0:1788201433.206847:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+10:102446:x1875060715380992:12345-0@lo:101:mount.lustre.0 Request processed in 136us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201433.206854:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201433.207376:0:102446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715380992:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201433.207392:0:102446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1e039 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e040 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201433.207402:0:102446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1e039 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e040 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201433.207466:0:102446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715381120:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201433.207509:0:102446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201433.207547:0:102446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f17b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201433.208199:0:102453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715381120 00000100:00100000:3.0:1788201433.208206:0:102453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715381120 00000100:00100000:3.0:1788201433.208247:0:102453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788201433.208255:0:102453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:102446:x1875060715381120:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201433.208416:0:102453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:102446:x1875060715381120:12345-0@lo:501:mount.lustre.0 Request processed in 160us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201433.208423:0:102453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788201433.208865:0:102446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715381120:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201433.208916:0:102446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715381248:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201433.208965:0:102446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201433.209004:0:102446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0050f1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201433.209230:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715381248 00000100:00100000:3.0:1788201433.209236:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715381248 00000100:00100000:3.0:1788201433.209371:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788201433.209382:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+10:102446:x1875060715381248:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201433.209492:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+10:102446:x1875060715381248:12345-0@lo:503:mount.lustre.0 Request processed in 113us (527us total) trans 0 rc 0/0 00000004:00080000:2.0:1788201433.209597:0:102447:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788201433.210117:0:102446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715381248:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201433.210610:0:102470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:102470:1875060715381376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201433.210662:0:102470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201433.210699:0:102470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f17b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201433.210753:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715381376 00000100:00100000:2.0:1788201433.210758:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715381376 00000100:00100000:3.0:1788201433.215212:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788201433.215459:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788201433.215476:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:102470:x1875060715381376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201433.216697:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:102470:x1875060715381376:12345-0@lo:502:llog_process_th.0 Request processed in 1224us (6030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201433.216708:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788201433.216814:0:102470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:102470:1875060715381376:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201433.216850:0:102470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201433.216859:0:102470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201433.216862:0:102470:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788201433.216869:0:102470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc12f19b800 00000020:00000080:1.0:1788201433.216872:0:102470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788201433.216880:0:102470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201433.216882:0:102470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201433.216891:0:102470:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788201433.216894:0:102470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201433.216897:0:102470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201433.216899:0:102470:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788201433.216902:0:102470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc12f19b800 00000020:00000080:1.0:1788201433.216904:0:102470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788201433.217007:0:102470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:102470:1875060715381504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201433.217254:0:102470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201433.217299:0:102470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f17b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201433.217416:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715381504 00000100:00100000:3.0:1788201433.217424:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715381504 00000100:00100000:3.0:1788201433.217473:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788201433.217492:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+10:102470:x1875060715381504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201433.217592:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+10:102470:x1875060715381504:12345-0@lo:502:llog_process_th.0 Request processed in 101us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201433.217599:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788201433.217993:0:102470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:102470:1875060715381504:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788201433.218193:0:102470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201433.218200:0:102470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201433.218203:0:102470:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788201433.218208:0:102470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788201433.218445:0:102446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1788201433.218470:0:102446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201433.218506:0:102446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1e039 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e040 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201433.218518:0:102446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1e039 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e040 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201433.218572:0:102446:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788201433.218575:0:102446:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dc12f19b800 10000000:01000000:1.0:1788201433.218578:0:102446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dc12f19b800 10000000:01000000:1.0:1788201433.218582:0:102446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788201433.218588:0:102446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc12f19b800 from 1 10000000:01000000:1.0:1788201433.218591:0:102446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788201433.218618:0:102446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1e047 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201433.218627:0:102446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1e047 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201433.218636:0:102446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1e047 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201433.218666:0:102446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715381632:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201433.218708:0:102446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201433.218744:0:102446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f17b600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201433.218803:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715381632 00000100:00100000:3.0:1788201433.218815:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715381632 00000100:00100000:3.0:1788201433.218852:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201433.218860:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+10:102446:x1875060715381632:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201433.218870:0:102458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201433.218883:0:102458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc108c74c00/0x96d0c9b8c9a1e04e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e047 expref: -99 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201433.218905:0:102458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc108c74c00/0x96d0c9b8c9a1e04e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e047 expref: 11 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201433.218915:0:102458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc108c74c00/0x96d0c9b8c9a1e04e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e047 expref: 11 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201433.218924:0:102458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c74c00, rc 0) 00000100:00100000:3.0:1788201433.218975:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+11:102446:x1875060715381632:12345-0@lo:101:mount.lustre.0 Request processed in 115us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201433.218981:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201433.219169:0:102446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715381632:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201433.219184:0:102446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1e047 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e04e expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201433.219193:0:102446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1e047 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e04e expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201433.219244:0:102446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133330e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715381760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201433.219337:0:102446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201433.219361:0:102446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004a95540 going to sleep for 11 seconds 00000100:00100000:3.0:1788201433.219376:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715381760 00000100:00100000:3.0:1788201433.219386:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715381760 00000100:00100000:3.0:1788201433.219411:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788201433.219417:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:102446:x1875060715381760:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201433.219539:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:102446:x1875060715381760:12345-0@lo:501:mount.lustre.0 Request processed in 121us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201433.219546:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788201433.219582:0:102446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133330e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715381760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201433.219609:0:102446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133330e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715381888:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201433.219647:0:102446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201433.219661:0:102446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004a95540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201433.219723:0:102453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715381888 00000100:00100000:1.0:1788201433.219728:0:102453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715381888 00000100:00100000:1.0:1788201433.219762:0:102453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788201433.219769:0:102453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:102446:x1875060715381888:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201433.219842:0:102453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:102446:x1875060715381888:12345-0@lo:503:mount.lustre.0 Request processed in 74us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201433.219850:0:102453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201433.220236:0:102446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133330e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715381888:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201433.221599:0:102471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:102471:1875060715382016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201433.221663:0:102471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201433.221704:0:102471:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10bf5d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201433.222222:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715382016 00000100:00100000:3.0:1788201433.222228:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715382016 00000100:00100000:3.0:1788201433.222332:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201433.222342:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:102471:x1875060715382016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201433.223363:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:102471:x1875060715382016:12345-0@lo:502:llog_process_th.0 Request processed in 1020us (1696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201433.223374:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788201433.236190:0:102471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:102471:1875060715382016:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788201433.236287:0:102471:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788201433.236314:0:102471:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8dc0027d19b8) 00000020:00000080:2.0:1788201433.236345:0:102471:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1788201433.236438:0:102471:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc12f19b800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788201433.236442:0:102471:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc12f19b800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788201433.236444:0:102471:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc12f19b800 4 00010000:00080000:2.0:1788201433.236470:0:102471:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc1201c9000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:2.0:1788201433.241856:0:102471:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1788201433.245510:0:102471:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788201433.245562:0:102471:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788201433.245578:0:102471:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x96d0c9b8c9a1e05c 00000100:00080000:2.0:1788201433.245590:0:102471:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201433.245595:0:102471:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dc1201c9000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201433.245631:0:102471:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12fb0e680 x1875060715382144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201433.245669:0:102471:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788201433.245900:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715382144:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201433.245969:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201433.245998:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715382144 00000100:00100000:1.0:1788201433.246005:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715382144 00000100:00100000:1.0:1788201433.246066:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1720 00000100:00100000:1.0:1788201433.246078:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715382144:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788201433.246133:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715382144:12345-0@lo:38:llog_process_th.0 Request processed in 59us (163us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788201433.249506:0:102471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:102471:1875060715382272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201433.249593:0:102471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201433.249634:0:102471:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f2f9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201433.249773:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201433.249783:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1201c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201433.249788:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788201433.249851:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715382144:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788201433.256819:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1720 00000100:00100000:1.0:1788201433.256879:0:102453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715382272 00000100:00100000:1.0:1788201433.256889:0:102453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715382272 00000100:00100000:1.0:1788201433.257170:0:102453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788201433.257182:0:102453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:102471:x1875060715382272:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201433.257365:0:102453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:102471:x1875060715382272:12345-0@lo:502:llog_process_th.0 Request processed in 185us (7772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201433.257373:0:102453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788201433.272350:0:102471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:102471:1875060715382272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201433.272442:0:102471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:102471:1875060715382400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201433.272528:0:102471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201433.272569:0:102471:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f17b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201433.272702:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715382400 00000100:00100000:2.0:1788201433.272709:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715382400 00000100:00100000:2.0:1788201433.272759:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788201433.272769:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc121a80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+11:102471:x1875060715382400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201433.272905:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc121a80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+11:102471:x1875060715382400:12345-0@lo:502:llog_process_th.0 Request processed in 137us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201433.272913:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788201433.272992:0:102471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:102471:1875060715382400:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788201433.273040:0:102471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:2.0:1788201433.274175:0:102446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:2.0:1788201433.274203:0:102446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788201433.274232:0:102446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1e047 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e04e expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201433.274243:0:102446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1e047 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e04e expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788201433.274301:0:102446:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788201433.274303:0:102446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201433.274304:0:102446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201433.274306:0:102446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201433.274307:0:102446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201433.274309:0:102446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201433.274310:0:102446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201433.274311:0:102446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201433.274313:0:102446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201433.274315:0:102446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788201433.274318:0:102446:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788201433.274321:0:102446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788201433.274322:0:102446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201433.274323:0:102446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201433.274324:0:102446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201433.274325:0:102446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201433.274326:0:102446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201433.274327:0:102446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201433.274328:0:102446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201433.274329:0:102446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201433.274330:0:102446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788201433.274352:0:102446:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788201433.274367:0:102446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715382528:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788201433.274417:0:102446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201433.274439:0:102446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f2f96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201433.275171:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715382528 00000100:00100000:1.0:1788201433.275181:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715382528 00000100:00100000:1.0:1788201433.275228:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788201433.275238:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:102446:x1875060715382528:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788201433.275266:0:102452:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788201433.275281:0:102452:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788201433.289873:0:102452:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788201433.289898:0:102452:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788201433.289923:0:102456:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788201433.289930:0:102456:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788201433.289954:0:102456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc006dbd400/0x96d0c9b8c9a1e063 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201433.290085:0:102456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1e032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e02b expref: 11 pid: 102454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201433.290094:0:102456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dc006dbd400/0x96d0c9b8c9a1e063 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201433.290132:0:102456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1e032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1e02b expref: 11 pid: 102454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201433.290145:0:102456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1e032 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1e02b expref: 11 pid: 102454 timeout: 4384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201433.290159:0:102456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:102456:1875060715382656:0@lo:104: 00000100:00100000:2.0:1788201433.290227:0:102456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201433.290305:0:19665:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788201433.290323:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715382656 00000100:00100000:3.0:1788201433.290330:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715382656 00000100:00100000:3.0:1788201433.290376:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1788201433.290387:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+3:102456:x1875060715382656:12345-0@lo:104: 00010000:00010000:3.0:1788201433.290400:0:19665:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1e02b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1e032 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201433.290464:0:102456:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f2f9600 going to sleep for 11 seconds 00010000:00010000:3.0:1788201433.291851:0:19665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201433.291864:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+3:102456:x1875060715382656:12345-0@lo:104: Request processed in 1476us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201433.291875:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00010000:00010000:0.0:1788201433.292364:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201433.292383:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1e02b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1e032 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201433.292384:0:102456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:102456:1875060715382656:0@lo:104: 00010000:00010000:0.0:1788201433.292391:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58c00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201433.292395:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1e02b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1e032 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201433.292403:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1e02b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1e032 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201433.292405:0:102456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dc006dbd400/0x96d0c9b8c9a1e063 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201433.292411:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1e02b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1e032 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201433.292417:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788201433.292455:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1e02b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1e032 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201433.292461:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201433.292502:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1e02b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1e032 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201433.292510:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1e02b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1e032 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201433.292526:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201433.292528:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201433.292530:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201433.292537:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201433.292549:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715382784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201433.292591:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201433.296174:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715382784 00000100:00100000:3.0:1788201433.296195:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715382784 00010000:00010000:3.0:1788201433.296257:0:26213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1e032 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1e02b expref: 12 pid: 102454 timeout: 4384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201433.296372:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2627 00000100:00100000:0.0:1788201433.296397:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9b18af6-fecc-4172-82c2-66531890fe11+12:3658:x1875060715382784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201433.296412:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201433.296418:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1e032 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1e02b expref: 12 pid: 102454 timeout: 4384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201433.296431:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1e032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1e02b expref: 12 pid: 102454 timeout: 4384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201433.296458:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1e032 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1e02b expref: 12 pid: 102454 timeout: 4384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201433.296486:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dc006dbd400/0x96d0c9b8c9a1e063 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201433.296495:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006dbd400/0x96d0c9b8c9a1e063 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788201433.296518:0:6517:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006590563s 00010000:00010000:0.0:1788201433.296523:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc006dbd400/0x96d0c9b8c9a1e063 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201433.296533:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc006dbd400/0x96d0c9b8c9a1e063 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201433.296539:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc006dbd400/0x96d0c9b8c9a1e063 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201433.296546:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc006dbd400/0x96d0c9b8c9a1e063 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201433.296551:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201433.296561:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc006dbd400/0x96d0c9b8c9a1e063 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201433.296569:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc006dbd400/0x96d0c9b8c9a1e063 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201433.296591:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc006dbd400/0x96d0c9b8c9a1e063 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201433.296602:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201433.296679:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9b18af6-fecc-4172-82c2-66531890fe11+11:3658:x1875060715382784:12345-0@lo:103:ldlm_bl.0 Request processed in 285us (4087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201433.296687:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2627 00000100:00100000:0.0:1788201433.296734:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715382784:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201433.296952:0:102456:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dc006dbd400/0x96d0c9b8c9a1e063 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201433.296971:0:102456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc006dbd400/0x96d0c9b8c9a1e063 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201433.296977:0:102456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006dbd400/0x96d0c9b8c9a1e063 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201433.297642:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+10:102446:x1875060715382528:12345-0@lo:253:mount.lustre.0 Request processed in 22403us (23221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201433.297654:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788201433.297820:0:102446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:102446:1875060715382528:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788201433.297840:0:102446:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788201433.297843:0:102446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201433.297845:0:102446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788201433.297846:0:102446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201433.297848:0:102446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201433.297849:0:102446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201433.297850:0:102446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201433.297851:0:102446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201433.297853:0:102446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788201433.297854:0:102446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201433.297855:0:102446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788201433.297869:0:102446:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:0.0:1788201433.328242:0:102446:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411350 00000040:01000000:0.0:1788201433.330456:0:102446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788201433.330560:0:102478:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411350 00000020:00080000:3.0:1788201433.330564:0:102478:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411350 00000040:01000000:3.0:1788201433.332106:0:102479:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788201433.334162:0:102446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1788201433.335644:0:102480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:102480:1875060715382912:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788201433.335720:0:102480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201433.335761:0:102480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0010eb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201433.335780:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715382912 00000100:00100000:1.0:1788201433.335789:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715382912 00000100:00100000:1.0:1788201433.335843:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788201433.335852:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:102480:x1875060715382912:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788201433.335928:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:102480:x1875060715382912:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 77us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201433.335935:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000040:01000000:2.0:1788201433.336212:0:102446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788201433.336273:0:102446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788201433.336699:0:102446:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788201433.336707:0:102446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788201433.336744:0:102446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201433.337726:0:102446:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788201433.338299:0:102446:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788201433.338337:0:102446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788201433.338431:0:102446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788201433.338945:0:102446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x55:0x0] (8/32) registered 00000100:00100000:3.0:1788201433.339821:0:102480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:102480:1875060715382912:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788201433.339863:0:102480:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788201433.339915:0:102480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:102480:1875060715383040:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788201433.339987:0:102480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201433.340057:0:102480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0010eb0c0 going to sleep for 11 seconds 00000040:00080000:0.0:1788201433.341179:0:102479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201433.348633:0:102479:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788201433.348732:0:102479:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1788201433.349102:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715383040 00000100:00100000:2.0:1788201433.349115:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715383040 00000100:00100000:2.0:1788201433.349180:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788201433.349191:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:102480:x1875060715383040:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788201433.351182:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:102480:x1875060715383040:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 1985us (11186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201433.351196:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788201433.351555:0:102480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:102480:1875060715383040:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788201433.351660:0:102480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:102480:1875060715383168:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788201433.351701:0:102480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201433.351736:0:102480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102adc840 going to sleep for 11 seconds 00010000:00080000:3.0:1788201433.352515:0:102446:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 124554051761 00000100:00100000:0.0:1788201433.352683:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715383168 00000100:00100000:0.0:1788201433.352692:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715383168 00000100:00100000:0.0:1788201433.352756:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788201433.352766:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:102480:x1875060715383168:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788201433.353237:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:102480:x1875060715383168:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 469us (1533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201433.353255:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788201433.353388:0:102480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:102480:1875060715383168:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788201433.353441:0:102480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:3.0:1788201433.354238:0:102481:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 102481 00010000:02000000:3.0:1788201433.354255:0:102481:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1788201433.354267:0:102481:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788201433.354271:0:102481:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:0.0:1788201433.356173:0:102446:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788201433.356197:0:102446:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788201433.356221:0:102446:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788201433.356245:0:102446:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788201433.357211:0:102446:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788201433.357462:0:102446:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1788201433.359950:0:102480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788201433.362344:0:102480:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788201433.362351:0:102480:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:2.0:1788201433.365088:0:102481:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:2.0:1788201434.130938:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201434.142760:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201434.143202:0:102453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695531904 00000100:00100000:3.0:1788201434.143214:0:102453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695531904 00000100:00100000:3.0:1788201434.143292:0:102453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:3.0:1788201434.143303:0:102453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+5:71021:x1875060695531904:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201434.143319:0:102453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201434.143339:0:102453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc108c75c00/0x96d0c9b8c9a1e06a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ddc expref: -99 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.143367:0:102453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc108c75c00/0x96d0c9b8c9a1e06a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ddc expref: 6 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.143378:0:102453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc108c75c00/0x96d0c9b8c9a1e06a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ddc expref: 6 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.143386:0:102453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c75c00, rc 0) 00000100:00100000:3.0:1788201434.143443:0:102453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+6:71021:x1875060695531904:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 142us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201434.143449:0:102453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:3.0:1788201434.146138:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201434.146895:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695532032 00000100:00100000:0.0:1788201434.146909:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695532032 00000100:00100000:0.0:1788201434.146990:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:0.0:1788201434.147000:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+6:71021:x1875060695532032:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788201434.147073:0:102454:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1788201434.147098:0:102454:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788201434.147104:0:102454:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1788201434.147107:0:102454:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1788201434.147110:0:102454:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1788201434.147113:0:102454:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 135 00000100:00100000:3.0:1788201434.149543:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+6:71021:x1875060695532032:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 Request processed in 2533us (3404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201434.149558:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:3.0:1788201434.162377:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201434.162431:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201434.162513:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695532160 00000100:00100000:1.0:1788201434.162522:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695532160 00000100:00100000:1.0:1788201434.162563:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1721 00000100:00100000:1.0:1788201434.162572:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695532160:12345-192.168.201.20@tcp:38:ll_cfg_requeue.0 00010000:00080000:1.0:1788201434.162617:0:66313:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '6e293f14-c501-4bc5-9dd4-a18ef02756b4' at ffff8dc1401c5800, cookie 0x96d0c9b8c9a1dfbb 00010000:00080000:1.0:1788201434.162623:0:66313:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp recovering/t124554051763 exp ffff8dc1401c5800 cur 4285 last 1788201433 00010000:02000400:1.0:1788201434.162632:0:66313:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:1.0:1788201434.162638:0:66313:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1788201434.162658:0:66313:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788201434.162817:0:66313:0:(import.c:65:import_set_state_nolock()) ffff8dc104282000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201434.162896:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695532160:12345-192.168.201.20@tcp:38:ll_cfg_requeue.0 Request processed in 322us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201434.162905:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1721 00000100:00100000:2.0:1788201434.163238:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695532288 00000100:00100000:2.0:1788201434.163243:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695532288 00000100:00100000:2.0:1788201434.163295:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:2.0:1788201434.163303:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+6:71021:x1875060695532288:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201434.163313:0:102452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201434.163330:0:102452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006dbc400/0x96d0c9b8c9a1e071 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786de3 expref: -99 pid: 102452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201434.163355:0:102452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006dbc400/0x96d0c9b8c9a1e071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786de3 expref: 7 pid: 102452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201434.163366:0:102452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006dbc400/0x96d0c9b8c9a1e071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786de3 expref: 7 pid: 102452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201434.163376:0:102452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbc400, rc 0) 00000100:00100000:2.0:1788201434.163407:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+7:71021:x1875060695532288:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 105us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201434.163414:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:0.0:1788201434.181303:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201434.181361:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201434.181527:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695525120 00000100:00100000:2.0:1788201434.181539:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695525120 00000100:00100000:2.0:1788201434.181651:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1722 00000100:00100000:2.0:1788201434.181664:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695525120:12345-192.168.201.20@tcp:36:mcreate.0 00010000:00080000:2.0:1788201434.181691:0:66312:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 124554051762, current: 124554051763, replaying 00000100:00100000:2.0:1788201434.181707:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695525120:12345-192.168.201.20@tcp:36:mcreate.0 Request processed in 47us (418us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201434.181714:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1722 00000100:00100000:3.0:1788201434.181982:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695532416 00000100:00100000:3.0:1788201434.181988:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695532416 00000100:00100000:3.0:1788201434.182058:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:3.0:1788201434.182067:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+7:71021:x1875060695532416:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201434.182236:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71021:x1875060695532416:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 169us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201434.182243:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 30 00010000:00080000:3.0:1788201434.185173:0:102481:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:0.0:1788201434.188113:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201434.188206:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695532544 00000100:00100000:1.0:1788201434.188217:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695532544 00000100:00100000:1.0:1788201434.188285:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:1.0:1788201434.188296:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71021:x1875060695532544:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.188451:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71021:x1875060695532544:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 156us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201434.188471:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:1.0:1788201434.194784:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201434.195011:0:102453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695532672 00000100:00100000:3.0:1788201434.195068:0:102453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695532672 00000100:00100000:3.0:1788201434.195130:0:102453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:3.0:1788201434.195141:0:102453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71021:x1875060695532672:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201434.195160:0:102453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201434.195178:0:102453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1e078 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786dea expref: -99 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.195232:0:102453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1e078 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dea expref: 9 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.195265:0:102453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1e078 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dea expref: 9 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.195276:0:102453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c75800, rc 0) 00000100:00100000:3.0:1788201434.195342:0:102453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695532672:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 202us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201434.195350:0:102453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:0.0:1788201434.203684:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201434.203794:0:102459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695532800 00000100:00100000:2.0:1788201434.203822:0:102459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695532800 00000100:00100000:2.0:1788201434.203886:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:2.0:1788201434.203898:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695532800:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201434.204105:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695532800:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 208us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201434.204113:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:3.0:1788201434.215478:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201434.215574:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695532928 00000100:00100000:0.0:1788201434.215585:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695532928 00000100:00100000:0.0:1788201434.215643:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00100000:0.0:1788201434.215653:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695532928:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201434.215814:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695532928:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 162us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201434.215822:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00100000:0.0:1788201434.223931:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201434.224335:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695533056 00000100:00100000:3.0:1788201434.224347:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695533056 00000100:00100000:3.0:1788201434.224416:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00100000:3.0:1788201434.224427:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695533056:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201434.224446:0:102458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201434.224477:0:102458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc108c74600/0x96d0c9b8c9a1e07f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786df1 expref: -99 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.224505:0:102458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc108c74600/0x96d0c9b8c9a1e07f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786df1 expref: 10 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.224517:0:102458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc108c74600/0x96d0c9b8c9a1e07f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786df1 expref: 10 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.224526:0:102458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c74600, rc 0) 00000100:00100000:3.0:1788201434.224585:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695533056:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 160us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201434.224592:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00100000:2.0:1788201434.233006:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201434.233685:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695533184 00000100:00100000:3.0:1788201434.233697:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695533184 00000100:00100000:3.0:1788201434.233772:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 36 00000100:00100000:3.0:1788201434.233783:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695533184:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201434.234089:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695533184:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 307us (1092us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201434.234098:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 36 10000000:01000000:3.0:1788201434.576387:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788201434.576399:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc12f19b800 from 135 10000000:01000000:3.0:1788201434.576406:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788201434.576509:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbdc00/0x96d0c9b8c9a1e086 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201434.576607:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc006dbdc00/0x96d0c9b8c9a1e086 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201434.576621:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc006dbdc00/0x96d0c9b8c9a1e086 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201434.576712:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715383296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201434.576791:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201434.576856:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140a45cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201434.577103:0:102453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715383296 00000100:00100000:3.0:1788201434.577111:0:102453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715383296 00000100:00100000:3.0:1788201434.577178:0:102453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788201434.577189:0:102453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:6529:x1875060715383296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201434.577204:0:102453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201434.577230:0:102453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc108c75000/0x96d0c9b8c9a1e08d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e086 expref: -99 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.577256:0:102453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc108c75000/0x96d0c9b8c9a1e08d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e086 expref: 11 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.577266:0:102453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc108c75000/0x96d0c9b8c9a1e08d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e086 expref: 11 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.577276:0:102453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c75000, rc 0) 00000100:00100000:3.0:1788201434.577322:0:102453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715383296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201434.577330:0:102453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788201434.577393:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715383296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201434.577408:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc006dbdc00/0x96d0c9b8c9a1e086 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e08d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.577418:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc006dbdc00/0x96d0c9b8c9a1e086 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e08d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201434.577485:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715383424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788201434.577518:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201434.577536:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc106470f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201434.577549:0:102459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715383424 00000100:00100000:3.0:1788201434.577553:0:102459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715383424 00000100:00100000:3.0:1788201434.577597:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788201434.577604:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715383424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788201434.577621:0:102459:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788201434.577641:0:102459:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788201434.577644:0:102459:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 135 00000100:00100000:3.0:1788201434.577723:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715383424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201434.577731:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788201434.577776:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715383424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788201434.577819:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788201434.577826:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbdc00/0x96d0c9b8c9a1e086 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e08d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.577834:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc006dbdc00/0x96d0c9b8c9a1e086 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e08d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201434.577854:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788201434.577856:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc13aa9f000 from 64 10000000:01000000:3.0:1788201434.577858:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201434.577875:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1e094 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.577883:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1e094 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.577890:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1e094 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201434.577904:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715383552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201434.577928:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201434.577957:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc106470f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201434.577970:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715383552 00000100:00100000:3.0:1788201434.577973:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715383552 00000100:00100000:3.0:1788201434.577996:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201434.578002:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b68b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715383552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201434.578009:0:102454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201434.578043:0:102454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc108c74200/0x96d0c9b8c9a1e09b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e094 expref: -99 pid: 102454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.578059:0:102454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc108c74200/0x96d0c9b8c9a1e09b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e094 expref: 12 pid: 102454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.578068:0:102454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc108c74200/0x96d0c9b8c9a1e09b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e094 expref: 12 pid: 102454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.578085:0:102454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c74200, rc 0) 00000100:00100000:3.0:1788201434.578113:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b68b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715383552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201434.578119:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201434.578145:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715383552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201434.578155:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1e094 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e09b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.578162:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1e094 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e09b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201434.578230:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715383680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201434.578252:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201434.578264:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc106470f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201434.578276:0:102459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715383680 00000100:00100000:3.0:1788201434.578279:0:102459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715383680 00000100:00100000:3.0:1788201434.578298:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788201434.578304:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b68b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715383680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201434.578410:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b68b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715383680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201434.578417:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788201434.578445:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715383680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201434.578483:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715383808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201434.578520:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201434.578539:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc106470f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201434.578550:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715383808 00000100:00100000:3.0:1788201434.578553:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715383808 00000100:00100000:3.0:1788201434.578572:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788201434.578578:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715383808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201434.578661:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715383808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201434.578668:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788201434.578705:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715383808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788201434.579396:0:102527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:3.0:1788201434.579475:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:3.0:1788201434.579491:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201434.579498:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1e094 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e09b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.579507:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1e094 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e09b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201434.579515:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788201434.579517:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1788201434.579520:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788201434.579542:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74400/0x96d0c9b8c9a1e0a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.579549:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc108c74400/0x96d0c9b8c9a1e0a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.579557:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc108c74400/0x96d0c9b8c9a1e0a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201434.579585:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715383936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201434.579624:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201434.579641:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140c1a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788201434.579656:0:102459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715383936 00000100:00100000:3.0:1788201434.579661:0:102459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715383936 00000100:00100000:3.0:1788201434.579687:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788201434.579696:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715383936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201434.579705:0:102459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201434.579718:0:102459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc108c75e00/0x96d0c9b8c9a1e0a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e0a2 expref: -99 pid: 102459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.579738:0:102459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc108c75e00/0x96d0c9b8c9a1e0a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e0a2 expref: 13 pid: 102459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.579747:0:102459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc108c75e00/0x96d0c9b8c9a1e0a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e0a2 expref: 13 pid: 102459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.579756:0:102459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c75e00, rc 0) 00000100:00100000:3.0:1788201434.579787:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715383936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201434.579794:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788201434.579829:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715383936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201434.579842:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc108c74400/0x96d0c9b8c9a1e0a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e0a9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.579850:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc108c74400/0x96d0c9b8c9a1e0a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e0a9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201434.579899:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715384064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201434.579923:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201434.579937:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140c1a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788201434.579949:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715384064 00000100:00100000:3.0:1788201434.579952:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715384064 00000100:00100000:3.0:1788201434.579972:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788201434.579978:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715384064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201434.580107:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715384064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201434.580114:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788201434.580141:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715384064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201434.580163:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715384192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201434.580200:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201434.580212:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140c1a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788201434.580223:0:102459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715384192 00000100:00100000:3.0:1788201434.580226:0:102459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715384192 00000100:00100000:3.0:1788201434.580246:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788201434.580252:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715384192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201434.593118:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715384192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 12856us (12907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201434.593134:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788201434.593280:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715384192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201434.594240:0:102529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1788201434.594848:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1788201434.594873:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788201434.594885:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74400/0x96d0c9b8c9a1e0a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e0a9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.594910:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc108c74400/0x96d0c9b8c9a1e0a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e0a9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201434.594921:0:6529:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788201434.594923:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc13aa9f000 from 7 10000000:01000000:3.0:1788201434.594926:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201434.594975:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74e00/0x96d0c9b8c9a1e0b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.594984:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc108c74e00/0x96d0c9b8c9a1e0b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.594995:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc108c74e00/0x96d0c9b8c9a1e0b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201434.595046:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715384320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201434.595109:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201434.595152:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140c1ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201434.595410:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715384320 00000100:00100000:0.0:1788201434.595419:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715384320 00000100:00100000:0.0:1788201434.595482:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788201434.595492:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715384320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201434.595505:0:102454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201434.595519:0:102454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140d59400/0x96d0c9b8c9a1e0b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e0b0 expref: -99 pid: 102454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.595544:0:102454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140d59400/0x96d0c9b8c9a1e0b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e0b0 expref: 14 pid: 102454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.595555:0:102454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140d59400/0x96d0c9b8c9a1e0b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e0b0 expref: 14 pid: 102454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.595564:0:102454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59400, rc 0) 00000100:00100000:0.0:1788201434.595619:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715384320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201434.595625:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788201434.595701:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715384320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201434.595718:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc108c74e00/0x96d0c9b8c9a1e0b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e0b7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201434.595727:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc108c74e00/0x96d0c9b8c9a1e0b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e0b7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201434.596084:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715384448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.596130:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201434.596154:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f730c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201434.596503:0:102453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715384448 00000100:00100000:3.0:1788201434.596510:0:102453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715384448 00000100:00100000:3.0:1788201434.596551:0:102453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788201434.596559:0:102453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715384448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201434.596687:0:102453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715384448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201434.596695:0:102453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788201434.597236:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715384448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.597276:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715384576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.597321:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201434.597351:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f730c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201434.597883:0:102459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715384576 00000100:00100000:3.0:1788201434.597890:0:102459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715384576 00000100:00100000:3.0:1788201434.597931:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788201434.598045:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715384576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201434.598163:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715384576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201434.598170:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788201434.599048:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715384576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201434.601439:0:102530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788201434.604083:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788201434.604127:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201434.604139:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74e00/0x96d0c9b8c9a1e0b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e0b7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.604152:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc108c74e00/0x96d0c9b8c9a1e0b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e0b7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201434.604162:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788201434.604164:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc12b6bc800 from 64 10000000:01000000:3.0:1788201434.604168:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201434.604208:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c75600/0x96d0c9b8c9a1e0be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.604216:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc108c75600/0x96d0c9b8c9a1e0be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.604227:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc108c75600/0x96d0c9b8c9a1e0be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201434.604252:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715384704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201434.604316:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201434.604360:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140c1a600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201434.608528:0:102453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715384704 00000100:00100000:1.0:1788201434.608544:0:102453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715384704 00000100:00100000:1.0:1788201434.608607:0:102453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788201434.608617:0:102453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715384704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201434.608634:0:102453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201434.608651:0:102453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064eda00/0x96d0c9b8c9a1e0c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e0be expref: -99 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201434.608677:0:102453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064eda00/0x96d0c9b8c9a1e0c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e0be expref: 15 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201434.608687:0:102453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064eda00/0x96d0c9b8c9a1e0c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e0be expref: 15 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201434.608697:0:102453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064eda00, rc 0) 00000100:00100000:1.0:1788201434.608770:0:102453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715384704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (4454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201434.608777:0:102453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788201434.608836:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715384704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201434.608855:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc108c75600/0x96d0c9b8c9a1e0be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e0c5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201434.608864:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc108c75600/0x96d0c9b8c9a1e0be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e0c5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201434.608935:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715384832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.608966:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201434.608995:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201434.609007:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715384832 00000100:00100000:1.0:1788201434.609010:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715384832 00000100:00100000:1.0:1788201434.609055:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788201434.609061:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715384832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.609169:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715384832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201434.609176:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788201434.609205:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715384832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.609231:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715384960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.609268:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201434.609283:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201434.609295:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715384960 00000100:00100000:1.0:1788201434.609298:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715384960 00000100:00100000:1.0:1788201434.609320:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788201434.609326:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715384960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.609392:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715384960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201434.609404:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788201434.609439:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715384960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201434.610085:0:102533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:1.0:1788201434.610135:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:1.0:1788201434.610153:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201434.610161:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c75600/0x96d0c9b8c9a1e0be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e0c5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201434.610171:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc108c75600/0x96d0c9b8c9a1e0be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e0c5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201434.610181:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788201434.610183:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1788201434.610186:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788201434.610207:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1e0cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201434.610214:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1e0cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201434.610223:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1e0cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201434.610239:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715385088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.610272:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201434.610287:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201434.610301:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715385088 00000100:00100000:1.0:1788201434.610304:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715385088 00000100:00100000:1.0:1788201434.610338:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788201434.610345:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715385088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201434.610353:0:102458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201434.610364:0:102458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064edc00/0x96d0c9b8c9a1e0d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e0cc expref: -99 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201434.610380:0:102458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064edc00/0x96d0c9b8c9a1e0d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e0cc expref: 16 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201434.610388:0:102458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064edc00/0x96d0c9b8c9a1e0d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e0cc expref: 16 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201434.610396:0:102458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064edc00, rc 0) 00000100:00100000:1.0:1788201434.610424:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715385088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201434.610430:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788201434.610477:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715385088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201434.610488:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1e0cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e0d3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201434.610496:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1e0cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e0d3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201434.610531:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715385216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.610552:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201434.610565:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201434.610576:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715385216 00000100:00100000:1.0:1788201434.610579:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715385216 00000100:00100000:1.0:1788201434.610607:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788201434.610613:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715385216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.610711:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715385216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201434.610718:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788201434.610747:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715385216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.610770:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715385344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.610803:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201434.610817:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201434.610827:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715385344 00000100:00100000:1.0:1788201434.610830:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715385344 00000100:00100000:1.0:1788201434.610851:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788201434.610857:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715385344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.620690:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715385344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 9824us (9877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201434.620705:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788201434.625379:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715385344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201434.626670:0:102534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1788201434.626741:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1788201434.626762:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788201434.626774:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1e0cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e0d3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201434.626786:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1e0cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e0d3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201434.626796:0:6529:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788201434.626808:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc12b6bc800 from 7 10000000:01000000:1.0:1788201434.626811:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201434.626848:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1e0da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201434.626857:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1e0da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201434.626868:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1e0da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201434.626893:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715385472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.627063:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201434.627101:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201434.627122:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715385472 00000100:00100000:1.0:1788201434.627130:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715385472 00000100:00100000:1.0:1788201434.627174:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788201434.627183:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715385472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201434.627197:0:102454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201434.627212:0:102454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064ed400/0x96d0c9b8c9a1e0e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e0da expref: -99 pid: 102454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201434.627237:0:102454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ed400/0x96d0c9b8c9a1e0e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e0da expref: 17 pid: 102454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201434.627250:0:102454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064ed400/0x96d0c9b8c9a1e0e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e0da expref: 17 pid: 102454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201434.627258:0:102454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ed400, rc 0) 00000100:00100000:1.0:1788201434.627295:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715385472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201434.627309:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788201434.627359:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715385472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201434.627374:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1e0da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e0e1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201434.627382:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1e0da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e0e1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201434.627432:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715385600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.627469:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201434.627484:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201434.627497:0:102459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715385600 00000100:00100000:1.0:1788201434.627500:0:102459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715385600 00000100:00100000:1.0:1788201434.627524:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788201434.627531:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715385600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.627635:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715385600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201434.627641:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788201434.627673:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715385600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.627698:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715385728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.627736:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201434.627750:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0010d7480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201434.627763:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715385728 00000100:00100000:1.0:1788201434.627766:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715385728 00000100:00100000:1.0:1788201434.627792:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201434.627805:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715385728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.627884:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715385728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201434.627890:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201434.627933:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715385728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788201434.640435:0:102535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788201434.640889:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788201434.640916:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201434.640928:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1e0da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e0e1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201434.640952:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1e0da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e0e1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201434.640962:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788201434.640965:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc0053a4000 from 64 10000000:01000000:1.0:1788201434.640968:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788201434.641006:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1e0e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201434.641041:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1e0e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201434.641053:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1e0e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201434.641080:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715385856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.641150:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201434.641199:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0010d7480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201434.643198:0:102453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715385856 00000100:00100000:3.0:1788201434.643218:0:102453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715385856 00000100:00100000:3.0:1788201434.643274:0:102453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788201434.643283:0:102453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715385856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201434.643301:0:102453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201434.643319:0:102453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc108c75200/0x96d0c9b8c9a1e0ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e0e8 expref: -99 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.643346:0:102453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc108c75200/0x96d0c9b8c9a1e0ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e0e8 expref: 18 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.643357:0:102453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc108c75200/0x96d0c9b8c9a1e0ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e0e8 expref: 18 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.643367:0:102453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c75200, rc 0) 00000100:00100000:3.0:1788201434.645183:0:102453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715385856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1893us (4024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201434.645197:0:102453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788201434.663346:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715385856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201434.663378:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1e0e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e0ef expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.663393:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1e0e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e0ef expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201434.663543:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715385984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.663601:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201434.663646:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0010d7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201434.665339:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715385984 00000100:00100000:0.0:1788201434.665352:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715385984 00000100:00100000:0.0:1788201434.665409:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788201434.665419:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004326050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715385984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201434.665600:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004326050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715385984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (1998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201434.665609:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788201434.668419:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715385984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.668493:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715386112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.668567:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201434.668606:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715386112 00000100:00100000:1.0:1788201434.668613:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715386112 00000100:00100000:1.0:1788201434.668657:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788201434.668665:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715386112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.668776:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715386112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201434.668785:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788201434.668833:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0010d7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201434.668846:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715386112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201434.676450:0:102537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:3.0:1788201434.678113:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:3.0:1788201434.678161:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201434.678175:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1e0e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e0ef expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.678188:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1e0e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e0ef expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201434.678198:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788201434.678214:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc0053a4000 from 132 10000000:01000000:3.0:1788201434.678217:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788201434.678260:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74800/0x96d0c9b8c9a1e0f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.678289:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc108c74800/0x96d0c9b8c9a1e0f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.678302:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc108c74800/0x96d0c9b8c9a1e0f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201434.678329:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715386240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201434.678404:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201434.678462:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140c1ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201434.678499:0:102459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715386240 00000100:00100000:1.0:1788201434.678509:0:102459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715386240 00000100:00100000:1.0:1788201434.678575:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788201434.678585:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715386240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201434.678600:0:102459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201434.678614:0:102459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064ec400/0x96d0c9b8c9a1e0fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e0f6 expref: -99 pid: 102459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201434.678639:0:102459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ec400/0x96d0c9b8c9a1e0fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e0f6 expref: 19 pid: 102459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201434.678663:0:102459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064ec400/0x96d0c9b8c9a1e0fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e0f6 expref: 19 pid: 102459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201434.678672:0:102459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ec400, rc 0) 00000100:00100000:1.0:1788201434.678723:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715386240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201434.678730:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788201434.679968:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715386240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201434.679994:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc108c74800/0x96d0c9b8c9a1e0f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e0fd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.680006:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc108c74800/0x96d0c9b8c9a1e0f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e0fd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201434.680086:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715386368:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788201434.680137:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201434.680175:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140c1ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201434.683091:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715386368 00000100:00100000:0.0:1788201434.683111:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715386368 00000100:00100000:0.0:1788201434.683190:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788201434.683203:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715386368:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788201434.683249:0:102458:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788201434.683271:0:102458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788201434.683276:0:102458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1788201434.683278:0:102458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1788201434.683281:0:102458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1788201434.683282:0:102458:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 135 00000100:00100000:0.0:1788201434.683428:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715386368:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 227us (3289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201434.683435:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788201434.683559:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715386368:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788201434.683654:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788201434.683664:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74800/0x96d0c9b8c9a1e0f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e0fd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.683675:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc108c74800/0x96d0c9b8c9a1e0f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e0fd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201434.683693:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788201434.683696:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 59 10000000:01000000:3.0:1788201434.683699:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788201434.683728:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c75a00/0x96d0c9b8c9a1e104 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.683736:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc108c75a00/0x96d0c9b8c9a1e104 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.683746:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc108c75a00/0x96d0c9b8c9a1e104 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201434.683765:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715386496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201434.683803:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201434.683844:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140c1ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201434.683922:0:102453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715386496 00000100:00100000:0.0:1788201434.683928:0:102453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715386496 00000100:00100000:0.0:1788201434.683974:0:102453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788201434.683981:0:102453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715386496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201434.683991:0:102453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201434.684006:0:102453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140d59200/0x96d0c9b8c9a1e10b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e104 expref: -99 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.684063:0:102453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140d59200/0x96d0c9b8c9a1e10b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e104 expref: 20 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.684074:0:102453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140d59200/0x96d0c9b8c9a1e10b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e104 expref: 20 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.684083:0:102453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59200, rc 0) 00000100:00100000:0.0:1788201434.684115:0:102453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715386496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201434.684121:0:102453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788201434.684422:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715386496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201434.684440:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc108c75a00/0x96d0c9b8c9a1e104 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e10b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.684451:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc108c75a00/0x96d0c9b8c9a1e104 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e10b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201434.684532:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715386624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201434.684562:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201434.684593:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140c1ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201434.685167:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715386624 00000100:00100000:1.0:1788201434.685174:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715386624 00000100:00100000:1.0:1788201434.685212:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788201434.685232:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715386624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.685372:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715386624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201434.685379:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788201434.685940:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715386624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201434.685981:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715386752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201434.686051:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201434.686081:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140c1ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201434.686884:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715386752 00000100:00100000:1.0:1788201434.686894:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715386752 00000100:00100000:1.0:1788201434.686955:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788201434.686966:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13c3ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715386752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201434.687118:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13c3ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715386752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201434.687125:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788201434.692652:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715386752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201434.695544:0:102538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 58 00000020:01000000:0.0:1788201434.696093:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 59-58 (rc=0) 10000000:01000000:0.0:1788201434.696120:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788201434.696134:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c75a00/0x96d0c9b8c9a1e104 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e10b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.696146:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc108c75a00/0x96d0c9b8c9a1e104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e10b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201434.696156:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1788201434.696159:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dc0053a4000 from 1 10000000:01000000:0.0:1788201434.696162:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788201434.696201:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1e112 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.696210:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1e112 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.697882:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1e112 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201434.697921:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715386880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201434.698005:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201434.698075:0:102459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715386880 00000100:00100000:0.0:1788201434.698083:0:102459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715386880 00000100:00100000:0.0:1788201434.698130:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788201434.698139:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715386880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201434.698152:0:102459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201434.698169:0:102459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140d58600/0x96d0c9b8c9a1e119 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e112 expref: -99 pid: 102459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.698195:0:102459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140d58600/0x96d0c9b8c9a1e119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e112 expref: 21 pid: 102459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.698206:0:102459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140d58600/0x96d0c9b8c9a1e119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e112 expref: 21 pid: 102459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.698224:0:102459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58600, rc 0) 00000100:00100000:0.0:1788201434.698258:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715386880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201434.698264:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788201434.698312:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a875900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201434.698333:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715386880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201434.698347:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1e112 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e119 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.698356:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1e112 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e119 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201434.698379:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788201434.698384:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1e112 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e119 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.698391:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1e112 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e119 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201434.698400:0:6529:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201434.698402:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc0053a4000 from 7 10000000:01000000:0.0:1788201434.698405:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201434.698426:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1e120 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.698434:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1e120 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.698441:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1e120 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201434.698467:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715387008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201434.698496:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201434.698521:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715387008 00000100:00100000:0.0:1788201434.698525:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715387008 00000100:00100000:0.0:1788201434.698550:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788201434.698557:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715387008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201434.698564:0:102458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201434.698572:0:102458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1e127 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e120 expref: -99 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.698598:0:102458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1e127 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e120 expref: 22 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.698607:0:102458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1e127 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e120 expref: 22 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.698614:0:102458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59000, rc 0) 00000100:00100000:0.0:1788201434.698639:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715387008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201434.698646:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788201434.698670:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a875900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201434.698681:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715387008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201434.698691:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1e120 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e127 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.698698:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1e120 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e127 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201434.698752:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715387136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201434.698790:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201434.698812:0:102453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715387136 00000100:00100000:0.0:1788201434.698816:0:102453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715387136 00000100:00100000:0.0:1788201434.698839:0:102453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788201434.698845:0:102453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715387136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201434.698945:0:102453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715387136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201434.698961:0:102453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788201434.698983:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a875900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201434.698994:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715387136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201434.699043:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715387264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201434.699080:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201434.699098:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715387264 00000100:00100000:0.0:1788201434.699102:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715387264 00000100:00100000:0.0:1788201434.699122:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788201434.699128:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715387264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201434.699208:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715387264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201434.699215:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788201434.699247:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a875900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201434.699258:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715387264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788201434.704164:0:102540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788201434.704496:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788201434.704524:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201434.704536:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1e120 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e127 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.704548:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1e120 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e127 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201434.704558:0:6529:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788201434.704561:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8dc12563cd28 from 1 10000000:01000000:0.0:1788201434.704564:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788201434.704612:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d58400/0x96d0c9b8c9a1e12e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.704633:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc140d58400/0x96d0c9b8c9a1e12e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.704645:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc140d58400/0x96d0c9b8c9a1e12e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201434.704670:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715387392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201434.704737:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201434.704874:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a875900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201434.705048:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715387392 00000100:00100000:3.0:1788201434.705056:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715387392 00000100:00100000:3.0:1788201434.705112:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788201434.705122:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715387392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201434.705136:0:102454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201434.705154:0:102454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc125ae3600/0x96d0c9b8c9a1e135 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e12e expref: -99 pid: 102454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.705179:0:102454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc125ae3600/0x96d0c9b8c9a1e135 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e12e expref: 23 pid: 102454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.705191:0:102454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc125ae3600/0x96d0c9b8c9a1e135 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e12e expref: 23 pid: 102454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201434.705200:0:102454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3600, rc 0) 00000100:00100000:3.0:1788201434.706087:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715387392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 962us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201434.706097:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788201434.706611:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715387392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201434.706644:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc140d58400/0x96d0c9b8c9a1e12e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e135 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.706655:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc140d58400/0x96d0c9b8c9a1e12e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e135 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201434.706676:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788201434.706682:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d58400/0x96d0c9b8c9a1e12e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e135 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.706688:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc140d58400/0x96d0c9b8c9a1e12e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e135 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201434.706697:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788201434.706699:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dc12563cd28 from 1 10000000:01000000:0.0:1788201434.706702:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788201434.706724:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59800/0x96d0c9b8c9a1e13c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.706742:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc140d59800/0x96d0c9b8c9a1e13c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.706750:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc140d59800/0x96d0c9b8c9a1e13c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201434.707201:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715387520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201434.713197:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201434.713271:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a875900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201434.713380:0:102459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715387520 00000100:00100000:2.0:1788201434.713389:0:102459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715387520 00000100:00100000:2.0:1788201434.713449:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788201434.713471:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13c3c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715387520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201434.713487:0:102459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201434.713507:0:102459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006dbcc00/0x96d0c9b8c9a1e143 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e13c expref: -99 pid: 102459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201434.713553:0:102459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006dbcc00/0x96d0c9b8c9a1e143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e13c expref: 24 pid: 102459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201434.713565:0:102459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006dbcc00/0x96d0c9b8c9a1e143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e13c expref: 24 pid: 102459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201434.713575:0:102459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbcc00, rc 0) 00000100:00100000:2.0:1788201434.713619:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13c3c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715387520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201434.713627:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788201434.713883:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715387520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201434.713901:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc140d59800/0x96d0c9b8c9a1e13c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e143 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.713911:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc140d59800/0x96d0c9b8c9a1e13c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e143 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201434.714138:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715387648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201434.714174:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201434.714242:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a875900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201434.722365:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715387648 00000100:00100000:2.0:1788201434.722382:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715387648 00000100:00100000:0.0:1788201434.722526:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788201434.722540:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715387648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201434.722715:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715387648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 178us (8539us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201434.722723:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788201434.722792:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715387648:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788201434.722850:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788201434.722862:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59800/0x96d0c9b8c9a1e13c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e143 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201434.722874:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc140d59800/0x96d0c9b8c9a1e13c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e143 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201435.151348:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201435.983342:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201435.983366:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715387776:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201435.983448:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201435.983504:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715387776 00000100:00100000:0.0:1788201435.983511:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715387776 00000100:00100000:0.0:1788201435.983569:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788201435.983579:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715387776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201435.983610:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788201435.983660:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715387776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201435.983667:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1788201435.983686:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788201435.983719:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc137cefb80 x1875060715387776/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788201451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201435.983749:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715387776:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788201436.175223:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201437.008256:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715387904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201437.008329:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201437.009234:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715387904 00000100:00100000:2.0:1788201437.009244:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715387904 00000100:00100000:2.0:1788201437.009309:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788201437.009319:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715387904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201437.009350:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3922464768 avail 3690942464 00000100:00080000:3.0:1788201437.011060:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201437.015835:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715387904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6510us (7498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201437.015850:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788201437.018939:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715387904:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788201437.199989:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201438.163535:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201438.163620:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695533312 00000100:00100000:3.0:1788201438.163630:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695533312 00000100:00100000:3.0:1788201438.163691:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 72 00000100:00100000:3.0:1788201438.163710:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695533312:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201438.163799:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695533312:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 99us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201438.163808:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 72 00000100:00100000:3.0:1788201438.170104:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201438.171833:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695533440 00000100:00100000:1.0:1788201438.171849:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695533440 00000100:00100000:1.0:1788201438.171931:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1748 00000100:00100000:1.0:1788201438.171943:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2401:x1875060695533440:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201438.172044:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2401:x1875060695533440:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 104us (1951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201438.172053:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1748 00000100:00080000:0.0:1788201438.173371:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788201438.231518:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201438.407499:0:102731:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788201438.545624:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201438.545648:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715388032:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201438.545721:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201438.545769:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715388032 00000100:00100000:1.0:1788201438.545778:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715388032 00000100:00100000:1.0:1788201438.545826:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788201438.545835:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715388032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201438.545870:0:66317:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445371904 avail 1299132416 00000100:00100000:1.0:1788201438.545914:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715388032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201438.545920:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788201438.545967:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715388032:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201438.546269:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715388160:0@lo:400:kworker.0 00000100:00100000:2.0:1788201438.546307:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788201438.546355:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201438.546359:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201438.546363:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201438.546368:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4284 00000100:00080000:3.0:1788201438.546372:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201438.546378:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc109813800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201438.546409:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc133332300 x1875060715388288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201438.546952:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715388288:0@lo:38:kworker.0 00000100:00100000:0.0:1788201438.546988:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201438.547045:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715388416:0@lo:400:kworker.0 00000100:00100000:0.0:1788201438.547072:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201438.549926:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715388160 00000100:00100000:2.0:1788201438.549938:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715388160 00000100:00100000:2.0:1788201438.550000:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788201438.550009:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715388160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201438.550102:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715388160:12345-0@lo:400:kworker.0 Request processed in 94us (3794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201438.550110:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788201438.550143:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715388288 00000100:00100000:2.0:1788201438.550159:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715388288 00000100:00100000:2.0:1788201438.550180:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788201438.550185:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3654:x1875060715388288:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788201438.550208:0:101344:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8dc1401c4800, cookie 0x96d0c9b8c9a1dfb4 00010000:00080000:2.0:1788201438.550213:0:101344:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t124554051762 exp ffff8dc1401c4800 cur 4290 last 1788201433 00000004:00100000:2.0:1788201438.550232:0:101344:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201438.550371:0:101344:0:(import.c:65:import_set_state_nolock()) ffff8dc12f1ac800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201438.550440:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715388288:12345-0@lo:38:kworker.0 Request processed in 253us (3450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201438.550447:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1788201438.550491:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 30 00000100:00080000:2.0:1788201438.550502:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1788201438.550507:0:3654:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1788201438.550510:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051761 gen 3 00000100:00100000:2.0:1788201438.550518:0:3654:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8dc007158000 x1875060715365120/t124554051762(124554051762) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788201412 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201438.550528:0:3654:0:(recover.c:53:ptlrpc_replay_next()) import ffff8dc109813800 from lustre-MDT0000_UUID committed 124554051761 last 0 00000100:00080000:2.0:1788201438.550535:0:3654:0:(client.c:3553:ptlrpc_replay_req()) @@@ REPLAY req@ffff8dc007158000 x1875060715365120/t124554051762(124554051762) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788201412 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201438.550548:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715388288:0@lo:38:kworker.0 00000100:00100000:2.0:1788201438.550582:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715365120:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788201438.550613:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201438.550646:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715365120 00000100:00100000:2.0:1788201438.550650:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715365120 00000100:00100000:2.0:1788201438.550674:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788201438.550680:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715365120:12345-0@lo:1000:osp_up0-1.0 00010000:00080000:2.0:1788201438.550695:0:66318:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 124554051762, current: 124554051762, replaying 00000100:00100000:2.0:1788201438.550702:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715365120:12345-0@lo:1000:osp_up0-1.0 Request processed in 23us (91us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201438.550709:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788201438.550735:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715388160:0@lo:400:kworker.0 00010000:00080000:3.0:1788201438.551255:0:102481:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788201438.551262:0:102481:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 124554051762 00000020:00080000:3.0:1788201438.551267:0:102481:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201438.551270:0:102481:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 2, req_transno: 124554051762, next_transno: 124554051762 00010000:00080000:3.0:1788201438.551274:0:102481:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (124554051762) 00000020:00080000:3.0:1788201438.551277:0:102481:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201438.551284:0:102481:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060715365120 t124554051762 from 0@lo req@ffff8dc12fb0ca80 x1875060715365120/t0(124554051762) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:559/0 lens 488/0 e 0 to 0 dl 1788201449 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788201438.551496:0:102481:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788201438.551509:0:102481:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201438.551512:0:102481:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 124554051763, next_transno: 124554051763 00010000:00080000:3.0:1788201438.551515:0:102481:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (124554051763) 00000020:00080000:3.0:1788201438.551517:0:102481:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201438.551533:0:102481:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695525120 t124554051763 from 192.168.201.20@tcp req@ffff8dc005256a00 x1875060695525120/t0(124554051763) o36->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:555/0 lens 528/0 e 0 to 0 dl 1788201445 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201438.551641:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201438.551645:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201438.551648:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201438.551654:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4284 00000100:00080000:3.0:1788201438.551657:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201438.551662:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc001db0000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201438.551672:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715388544:0@lo:400:kworker.0 00000100:00100000:3.0:1788201438.551705:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201438.551738:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715388416 00000100:00100000:3.0:1788201438.551742:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715388416 00000100:00100000:3.0:1788201438.551768:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715388544 00000100:00100000:3.0:1788201438.551771:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715388544 00000100:00100000:3.0:1788201438.551802:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788201438.551810:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715388416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201438.551847:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715388416:12345-0@lo:400:kworker.0 Request processed in 39us (4774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201438.551854:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788201438.551867:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788201438.551873:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715388544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201438.551903:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715388544:12345-0@lo:400:kworker.0 Request processed in 30us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201438.551909:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788201438.551926:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201438.551950:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715388416:0@lo:400:kworker.0 00010000:00080000:3.0:1788201438.551983:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc133331180 x1875060715388544/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201438.551994:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715388544:0@lo:400:kworker.0 00000100:00100000:3.0:1788201438.552049:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc133331180 x1875060715388672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201438.552061:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201438.552065:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201438.552067:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201438.552071:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4284 00000100:00080000:3.0:1788201438.552073:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201438.552078:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc11ccfb000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201438.552089:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc133332d80 x1875060715388800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201438.552107:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201438.552110:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201438.552112:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201438.552115:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4284 00000100:00080000:3.0:1788201438.552118:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201438.552121:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc1401c3800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201438.552127:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201438.552133:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715388928:0@lo:400:kworker.0 00000001:00100000:0.0:1788201438.552737:0:100576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788201438.552764:0:99761:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788201438.552789:0:75739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788201438.554867:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715388672:0@lo:38:kworker.0 00000100:00100000:2.0:1788201438.554935:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201438.554968:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715388800:0@lo:38:kworker.0 00000100:00100000:2.0:1788201438.554992:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788201438.555054:0:3654:0:(client.c:3438:ptlrpc_replay_interpret()) @@@ got reply req@ffff8dc007158000 x1875060715365120/t124554051762(124554051762) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788201454 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201438.555064:0:3654:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1788201438.555066:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051761 gen 3 00000100:00100000:2.0:1788201438.555071:0:3654:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8dc007158000 x1875060715365120/t124554051762(124554051762) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788201454 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201438.555078:0:3654:0:(recover.c:53:ptlrpc_replay_next()) import ffff8dc109813800 from lustre-MDT0000_UUID committed 124554051761 last 124554051762 00000100:00080000:2.0:1788201438.555082:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1788201438.555115:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715388672 00000100:00100000:2.0:1788201438.555128:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715388672 00000100:00100000:3.0:1788201438.555248:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201438.555322:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc133369880 x1875060715389056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201438.555371:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201438.555382:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715389184:0@lo:400:kworker.0 00000100:00100000:3.0:1788201438.555421:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201438.555448:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715388800 00000100:00100000:3.0:1788201438.555452:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715388800 00000100:00100000:3.0:1788201438.555474:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715388928 00000100:00100000:3.0:1788201438.555477:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715388928 00000100:00100000:3.0:1788201438.555502:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715389184 00000100:00100000:3.0:1788201438.555505:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715389184 00000100:00100000:3.0:1788201438.555522:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1749 00000100:00100000:3.0:1788201438.555530:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715388928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201438.555578:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715388928:12345-0@lo:400:kworker.0 Request processed in 48us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201438.555585:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1749 00000100:00100000:3.0:1788201438.555604:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1750 00000100:00100000:3.0:1788201438.555610:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715389184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201438.555639:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715389184:12345-0@lo:400:kworker.0 Request processed in 29us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201438.555645:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1750 00000100:00100000:3.0:1788201438.555657:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1723 00000100:00100000:3.0:1788201438.555662:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715388800:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788201438.555685:0:66757:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 4290 last 0 00000020:00000080:3.0:1788201438.555719:0:66757:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x96d0c9b8c9a1e14a 00000004:00100000:3.0:1788201438.555734:0:66757:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201438.555764:0:66757:0:(import.c:65:import_set_state_nolock()) ffff8dc13339c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201438.555802:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875060715388800:12345-0@lo:38:kworker.0 Request processed in 139us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201438.555809:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1723 00000100:00080000:3.0:1788201438.555826:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201438.555845:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715389184:0@lo:400:kworker.0 00000100:00100000:3.0:1788201438.555871:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715388928:0@lo:400:kworker.0 00000100:00100000:3.0:1788201438.555899:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715389312:0@lo:400:kworker.0 00000100:00100000:3.0:1788201438.555932:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201438.555960:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715389312 00000100:00100000:3.0:1788201438.555964:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715389312 00000100:00100000:3.0:1788201438.555992:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788201438.555998:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10981e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715389312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201438.557319:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1724 00000100:00100000:2.0:1788201438.557327:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715388672:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788201438.557353:0:69485:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 4290 last 0 00000020:00000080:2.0:1788201438.557397:0:69485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x96d0c9b8c9a1e151 00000004:00100000:2.0:1788201438.564270:0:69485:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201438.564324:0:69485:0:(import.c:65:import_set_state_nolock()) ffff8dc12f1aa800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201438.564424:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875060715388672:12345-0@lo:38:kworker.0 Request processed in 7093us (9486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201438.564436:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1724 00000001:00080000:2.0:1788201438.564640:0:102447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051762 is committed 00000100:00100000:2.0:1788201438.564694:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715365120:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788201438.564714:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715389056:0@lo:38:kworker.0 00000100:00100000:2.0:1788201438.564755:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788201438.564793:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc133331180 x1875060715388672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201438.564809:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 30 00000100:00080000:2.0:1788201438.565685:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8dc133331180 x1875060715388672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201463 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201438.565694:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788201438.565698:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788201438.565703:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788201438.565707:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715388672:0@lo:38:kworker.0 00010000:00080000:2.0:1788201438.565727:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc133332d80 x1875060715388800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201438.565757:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 30 00000100:00080000:2.0:1788201438.566580:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8dc133332d80 x1875060715388800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201463 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201438.566590:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788201438.566593:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788201438.566596:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788201438.566601:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715388800:0@lo:38:kworker.0 00000100:00100000:2.0:1788201438.566658:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715389056 00000100:00100000:2.0:1788201438.566664:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715389056 00000100:00100000:2.0:1788201438.566707:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1725 00000100:00100000:2.0:1788201438.566715:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715389056:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788201438.566741:0:69485:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 4290 last 0 00000020:00000080:2.0:1788201438.566779:0:69485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x96d0c9b8c9a1e158 00000004:00100000:2.0:1788201438.566793:0:69485:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201438.566820:0:69485:0:(import.c:65:import_set_state_nolock()) ffff8dc12f1a9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201438.566888:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875060715389056:12345-0@lo:38:kworker.0 Request processed in 172us (2132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201438.566894:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1725 00010000:00080000:2.0:1788201438.566931:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc133369880 x1875060715389056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201438.566943:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 30 00000100:00100000:3.0:1788201438.571319:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10981e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715389312:12345-0@lo:400:kworker.0 Request processed in 15311us (15377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201438.571334:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788201438.571531:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201438.573243:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8dc133369880 x1875060715389056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201463 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201438.573257:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788201438.573273:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788201438.573277:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788201438.573283:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715389056:0@lo:38:kworker.0 00010000:00080000:2.0:1788201438.573611:0:102747:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1788201438.573617:0:102747:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1788201438.573622:0:102747:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00010000:00010000:2.0:1788201438.574087:0:102747:0:(ldlm_request.c:2860:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007ade600/0x96d0c9b8c9a1be0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1c70a expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1788201438.574113:0:102747:0:(ldlm_request.c:2910:lock_can_replay()) check lock replay limit, inflights = 1(512) 00000100:00100000:2.0:1788201438.575398:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715389440:0@lo:101:ldlm_lock_repla.0 00000100:00100000:2.0:1788201438.575474:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201438.575514:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715389440 00000100:00100000:2.0:1788201438.575521:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715389440 00000100:00100000:2.0:1788201438.575569:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788201438.575579:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715389440:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:2.0:1788201438.575599:0:66318:0:(ldlm_lib.c:3215:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8dc12efcb100 x1875060715389440/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:559/0 lens 328/0 e 0 to 0 dl 1788201449 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201438.575610:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715389440:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 35us (138us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201438.575616:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000004:00080000:3.0:1788201438.578226:0:102481:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 26645us 00000100:00100000:3.0:1788201438.578298:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715389312:0@lo:400:kworker.0 00000100:00080000:3.0:1788201438.578383:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201438.578399:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201438.578402:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc1201c9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201438.578411:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dc1201c9000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201438.578434:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13336aa00 x1875060715389696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201438.578504:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715389568:0@lo:400:kworker.0 00000100:00100000:1.0:1788201438.578572:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201438.578656:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715389568 00000100:00100000:3.0:1788201438.578672:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715389568 00000100:00100000:3.0:1788201438.580482:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788201438.580495:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715389568:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788201438.580710:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201438.580747:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715389568:12345-0@lo:400:kworker.0 Request processed in 81us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201438.580760:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1788201438.580816:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc133369c00 x1875060715389568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788201454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201438.580829:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715389568:0@lo:400:kworker.0 00000100:00100000:2.0:1788201438.580908:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13336aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715389696:0@lo:38:kworker.0 00000100:00100000:2.0:1788201438.580953:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201438.581052:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715389696 00000100:00100000:3.0:1788201438.581060:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715389696 00000100:00100000:3.0:1788201438.581087:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1726 00000100:00100000:3.0:1788201438.581093:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715389696:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788201438.581118:0:66312:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 4290 last 0 00000020:00000080:3.0:1788201438.581210:0:66312:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x96d0c9b8c9a1e15f 00000004:00100000:3.0:1788201438.581225:0:66312:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201438.581253:0:66312:0:(import.c:65:import_set_state_nolock()) ffff8dc13339e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201438.581290:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875060715389696:12345-0@lo:38:kworker.0 Request processed in 196us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201438.581296:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1726 00010000:00080000:2.0:1788201438.583181:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc13336aa00 x1875060715389696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201438.583215:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 30 00000100:00080000:2.0:1788201438.583225:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788201438.583231:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788201438.583235:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1201c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788201438.583242:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13336aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715389696:0@lo:38:kworker.0 00010000:00010000:3.0:1788201438.584598:0:102481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e166 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.584619:0:102481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e166 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.584634:0:102481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e166 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.584653:0:102481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1e16d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.584660:0:102481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1e16d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.584667:0:102481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1e16d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.585054:0:102481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e166 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.585062:0:102481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e166 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.585068:0:102481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e166 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.585073:0:102481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201438.585077:0:102481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e166 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.585084:0:102481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e166 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.585095:0:102481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12196e400) 00010000:00010000:3.0:1788201438.585098:0:102481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201438.585102:0:102481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e166 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.585108:0:102481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e166 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201438.585129:0:102481:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b2159e7 reply state 00000000923d5fe7 transno 124554051763 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1e16d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.585140:0:102481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1e16d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.585275:0:102481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc12196e200) 00010000:00010000:3.0:1788201438.585279:0:102481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201438.585282:0:102481:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788201438.585382:0:102481:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788201438.585412:0:102481:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201438.585415:0:102481:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 124554051764 00000020:00080000:3.0:1788201438.585419:0:102481:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201438.585421:0:102481:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 124554051764 00000100:00100000:3.0:1788201438.603725:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201438.603805:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695525632 00000100:00100000:1.0:1788201438.603817:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695525632 00000100:00100000:3.0:1788201438.603973:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1727 00000100:00100000:3.0:1788201438.603985:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2399:x1875060695525632:12345-192.168.201.20@tcp:36:rm.0 00010000:00080000:3.0:1788201438.604006:0:69485:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 124554051764, current: 124554051764, replaying 00000100:00100000:3.0:1788201438.604039:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2399:x1875060695525632:12345-192.168.201.20@tcp:36:rm.0 Request processed in 57us (325us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201438.604046:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1727 00000020:00080000:3.0:1788201438.604069:0:102481:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201438.604072:0:102481:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 124554051764, next_transno: 124554051764 00010000:00080000:3.0:1788201438.604077:0:102481:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (124554051764) 00000020:00080000:3.0:1788201438.604080:0:102481:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201438.604090:0:102481:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695525632 t124554051764 from 192.168.201.20@tcp req@ffff8dc133369c00 x1875060695525632/t0(124554051764) o36->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:559/0 lens 512/0 e 0 to 0 dl 1788201449 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788201438.604203:0:102481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e174 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.604221:0:102481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e174 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.604233:0:102481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e174 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.604245:0:102481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1e17b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.604253:0:102481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1e17b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.604259:0:102481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1e17b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.604352:0:102481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e182 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.604726:0:102481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e182 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.604734:0:102481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e182 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.605183:0:102481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e182 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.605191:0:102481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e182 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.605207:0:102481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e182 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.605213:0:102481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201438.605218:0:102481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e182 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.605225:0:102481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e182 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.605237:0:102481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x30:0x0].0x0 (ffff8dc12196ec00) 00010000:00010000:3.0:1788201438.605240:0:102481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201438.605245:0:102481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e182 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.605250:0:102481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e182 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.605273:0:102481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e174 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.605279:0:102481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e174 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.605285:0:102481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e174 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.605290:0:102481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201438.605292:0:102481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e174 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.605309:0:102481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e174 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.605317:0:102481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12196e400) 00010000:00010000:3.0:1788201438.605319:0:102481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201438.605322:0:102481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e174 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.605328:0:102481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e174 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201438.605339:0:102481:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021fe6ddf reply state 000000001262b09b transno 124554051764 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1e17b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.605351:0:102481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1e17b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.605356:0:102481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc12196e200) 00010000:00010000:3.0:1788201438.605358:0:102481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201438.605361:0:102481:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788201438.605455:0:102481:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788201438.606100:0:102481:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201438.606105:0:102481:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 124554051765 00000020:00080000:3.0:1788201438.606109:0:102481:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201438.606111:0:102481:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 124554051765 00000100:00100000:2.0:1788201438.615141:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201438.615190:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695528064 00000100:00100000:2.0:1788201438.615201:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695528064 00000100:00100000:2.0:1788201438.615264:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1728 00000100:00100000:2.0:1788201438.615274:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2399:x1875060695528064:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00080000:2.0:1788201438.615293:0:66314:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 124554051765, current: 124554051765, replaying 00000100:00100000:2.0:1788201438.615306:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2399:x1875060695528064:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 34us (175us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201438.615312:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1728 00000020:00080000:3.0:1788201438.617675:0:102481:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201438.617682:0:102481:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 124554051765, next_transno: 124554051765 00010000:00080000:3.0:1788201438.617688:0:102481:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (124554051765) 00000020:00080000:3.0:1788201438.617691:0:102481:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201438.617714:0:102481:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695528064 t124554051765 from 192.168.201.20@tcp req@ffff8dc1333bfb80 x1875060695528064/t0(124554051765) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:559/0 lens 520/0 e 0 to 0 dl 1788201449 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'mkdir.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1788201438.617746:0:102481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201438.617772:0:102481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e189 lrc: 2/0,0 mode: --/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786dce expref: -99 pid: 102481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.617993:0:102481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e190 lrc: 3/0,1 mode: --/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.618009:0:102481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e190 lrc: 3/0,1 mode: CW/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.618055:0:102481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e190 lrc: 3/0,1 mode: CW/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.618069:0:102481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1e197 lrc: 3/0,1 mode: --/PW res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.618077:0:102481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1e197 lrc: 3/0,1 mode: PW/PW res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.618083:0:102481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1e197 lrc: 3/0,1 mode: PW/PW res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201438.618537:0:102481:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x31:0x0]: returning size 4096 00010000:00010000:3.0:1788201438.618554:0:102481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e19e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.618563:0:102481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e19e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.618571:0:102481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e19e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.618589:0:102481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e190 lrc: 3/0,1 mode: CW/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.618596:0:102481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e190 lrc: 2/0,0 mode: CW/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.618603:0:102481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e190 lrc: 3/0,0 mode: CW/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.618609:0:102481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201438.618614:0:102481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e190 lrc: 3/0,0 mode: CW/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.618622:0:102481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e190 lrc: 4/0,0 mode: CW/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.618634:0:102481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x6:0x0].0x0 (ffff8dc12196e400) 00010000:00010000:3.0:1788201438.618637:0:102481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201438.618642:0:102481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e190 lrc: 2/0,0 mode: --/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.618649:0:102481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e190 lrc: 0/0,0 mode: --/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201438.618659:0:102481:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9dae712 reply state 00000000945145b7 transno 124554051765 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1e197 lrc: 3/0,1 mode: PW/PW res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.618670:0:102481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1e197 lrc: 3/0,1 mode: TXN/TXN res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.618676:0:102481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x6:0x0].0xcd52553e (ffff8dc12196ec00) 00010000:00010000:3.0:1788201438.618683:0:102481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201438.618687:0:102481:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788201438.618738:0:102481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e189 lrc: 0/0,0 mode: --/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dce expref: 13 pid: 102481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.618756:0:102481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e19e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dce expref: 12 pid: 102481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.618764:0:102481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x31:0x0].0x0 (ffff8dc12196e700) 00010000:00010000:3.0:1788201438.618766:0:102481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201438.618768:0:102481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3c00, rc 0) 00010000:00080000:3.0:1788201438.618846:0:102481:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788201438.618865:0:102481:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201438.618868:0:102481:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 124554051766 00000020:00080000:3.0:1788201438.618871:0:102481:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201438.618873:0:102481:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 124554051766 00000100:00100000:1.0:1788201438.629116:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201438.629214:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695533568 00000100:00100000:3.0:1788201438.629226:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695533568 00000100:00100000:3.0:1788201438.629279:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1751 00000100:00100000:3.0:1788201438.629289:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:2399:x1875060695533568:12345-192.168.201.20@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1788201438.629317:0:66313:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc14014ea00 x1875060695533568/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:559/0 lens 224/0 e 0 to 0 dl 1788201449 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201438.629337:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:2399:x1875060695533568:12345-192.168.201.20@tcp:400:ldlm_lock_repla.0 Request processed in 50us (233us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201438.629344:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1751 00000020:00080000:0.0:1788201438.629430:0:102481:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201438.629435:0:102481:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 124554051766 00010000:00080000:0.0:1788201438.629439:0:102481:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1788201438.629442:0:102481:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201438.629449:0:102481:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788201438.629452:0:102481:0:(ldlm_lib.c:2308:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1788201438.629460:0:102481:0:(ldlm_lib.c:2914:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff8dc12efcb100 x1875060715389440/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:559/0 lens 328/0 e 0 to 0 dl 1788201449 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201438.629481:0:102481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201438.629520:0:102481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1e1a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1be0b expref: -99 pid: 102481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.629546:0:102481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1e1a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1be0b expref: 7 pid: 102481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.629563:0:102481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1e1a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1be0b expref: 7 pid: 102481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.629572:0:102481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58c00, rc 0) 00010000:00080000:0.0:1788201438.629642:0:102481:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788201438.629668:0:102481:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1788201438.629733:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 124554051762 gen 3 00000004:00080000:3.0:1788201438.629740:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 124554051762 committed transno 124554051762 00010000:00010000:3.0:1788201438.629775:0:3654:0:(ldlm_request.c:2777:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007ade600/0x96d0c9b8c9a1be0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e1a5 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788201438.629785:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1788201438.629814:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715389440:0@lo:101:ldlm_lock_repla.0 00000100:00100000:3.0:1788201438.629834:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715389824:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:3.0:1788201438.629869:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201438.630001:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715389824 00000100:00100000:1.0:1788201438.630007:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715389824 00000100:00100000:1.0:1788201438.630084:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788201438.630091:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3654:x1875060715389824:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:1.0:1788201438.630101:0:66317:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc133368a80 x1875060715389824/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:559/0 lens 224/0 e 0 to 0 dl 1788201449 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201438.630115:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3654:x1875060715389824:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 26us (246us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201438.630121:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1788201438.630254:0:102481:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1788201438.630382:0:102481:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 30, last_transno is 128849018880 00000001:00100000:2.0:1788201438.632484:0:102447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788201438.632501:0:102447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000001:00080000:2.0:1788201438.632536:0:102447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 124554051765 is committed 00010000:00010000:1.0:1788201438.632583:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1e16d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.632596:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1e16d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.632603:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1e16d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.632609:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201438.632615:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1e16d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.632622:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1e16d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.632643:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1e16d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.632649:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1e16d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.632668:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1e17b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.632689:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1e17b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.632695:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1e17b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.632700:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201438.632703:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1e17b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.632709:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1e17b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.632717:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1e17b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.632723:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1e17b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.632740:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1e197 lrc: 3/0,1 mode: TXN/TXN res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.632745:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1e197 lrc: 2/0,0 mode: TXN/TXN res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.632750:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1e197 lrc: 3/0,0 mode: TXN/TXN res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.632755:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201438.632758:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1e197 lrc: 3/0,0 mode: TXN/TXN res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.632770:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1e197 lrc: 4/0,0 mode: TXN/TXN res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.632779:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1e197 lrc: 2/0,0 mode: --/TXN res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.632785:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1e197 lrc: 0/0,0 mode: --/TXN res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 102481 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788201438.632861:0:102481:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1788201438.632899:0:102481:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1788201438.632915:0:102481:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.201.20@tcp: req@ffff8dc14014ea00 x1875060695533568/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:559/0 lens 224/0 e 0 to 0 dl 1788201449 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788201438.633066:0:102481:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8dc133368a80 x1875060715389824/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:559/0 lens 224/0 e 0 to 0 dl 1788201449 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1788201438.633149:0:102481:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:3.0:1788201438.633503:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788201438.633512:0:3654:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8dc133368380 x1875060715389824/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201454 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201438.633521:0:3654:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8dc133368380 x1875060715389824/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201454 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201438.633529:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788201438.633542:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788201438.633547:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715389824:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:1.0:1788201438.633707:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715389952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201438.633752:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201438.633836:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715389952 00000100:00100000:2.0:1788201438.633843:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715389952 00000100:00100000:2.0:1788201438.633889:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788201438.633898:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715389952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201438.633924:0:101344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444921344 avail 1298681856 00000100:00100000:2.0:1788201438.633967:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3656:x1875060715389952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201438.633985:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788201438.634076:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715389952:0@lo:41:osp-pre-0-1.0 00000004:00000080:1.0:1788201438.679273:0:102481:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa0dd4866fe10 00100000:10000000:1.0:1788201438.679288:0:102481:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1788201438.684531:0:102467:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x396:0x0] 00000100:00100000:3.0:1788201438.684582:0:102467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:102467:1875060715390080:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788201438.684654:0:102467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201438.684695:0:102467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc003491240 going to sleep for 11 seconds 00000100:00100000:0.0:1788201438.684744:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715390080 00000100:00100000:0.0:1788201438.684754:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715390080 00000100:00100000:0.0:1788201438.684805:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788201438.684815:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13336a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:102467:x1875060715390080:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788201438.684845:0:100688:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 961 -> diff = -43 00002000:02000040:0.0:1788201438.684850:0:100688:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:919 to 0x280000401:961) 00000004:00080000:1.0:1788201438.687178:0:102469:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x323:0x0] 00000100:00100000:1.0:1788201438.687234:0:102469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:102469:1875060715390208:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788201438.687302:0:102469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201438.687339:0:102469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007465c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201438.687370:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715390208 00000100:00100000:1.0:1788201438.687376:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715390208 00000100:00100000:1.0:1788201438.687429:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788201438.687438:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:102469:x1875060715390208:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788201438.687464:0:101191:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 929 -> diff = -126 00002000:02000040:1.0:1788201438.687469:0:101191:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:804 to 0x2c0000401:929) 00002000:00010000:0.0:1788201438.702791:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.702804:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067a58ba5/0x96d0c9b8c9a1e1ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.702822:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c1:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.702826:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.702833:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067a58ba5/0x96d0c9b8c9a1e1ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.702849:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067a58ba5/0x96d0c9b8c9a1e1ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.702875:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067a58ba5/0x96d0c9b8c9a1e1ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.702883:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067a58ba5/0x96d0c9b8c9a1e1ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.702908:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788201438.703381:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.703400:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02c69b2/0x96d0c9b8c9a1e1b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.703409:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c0:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.703413:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.703417:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02c69b2/0x96d0c9b8c9a1e1b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.703426:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02c69b2/0x96d0c9b8c9a1e1b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.703435:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02c69b2/0x96d0c9b8c9a1e1b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.703443:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02c69b2/0x96d0c9b8c9a1e1b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.703467:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788201438.703561:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201438.703568:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067a58ba5/0x96d0c9b8c9a1e1ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.703577:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201438.703582:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067a58ba5/0x96d0c9b8c9a1e1ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.703592:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067a58ba5/0x96d0c9b8c9a1e1ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.703609:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067a58ba5/0x96d0c9b8c9a1e1ac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.703617:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067a58ba5/0x96d0c9b8c9a1e1ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.703636:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201438.703640:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02c69b2/0x96d0c9b8c9a1e1b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.703646:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201438.703650:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02c69b2/0x96d0c9b8c9a1e1b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.703668:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02c69b2/0x96d0c9b8c9a1e1b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.703695:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02c69b2/0x96d0c9b8c9a1e1b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.703702:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02c69b2/0x96d0c9b8c9a1e1b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.703716:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201438.703718:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201438.703719:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201438.703755:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.703760:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7a70143/0x96d0c9b8c9a1e1ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.703769:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3bf:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.703773:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.703777:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7a70143/0x96d0c9b8c9a1e1ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.703787:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7a70143/0x96d0c9b8c9a1e1ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.703795:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7a70143/0x96d0c9b8c9a1e1ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.703808:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7a70143/0x96d0c9b8c9a1e1ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.703824:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788201438.704088:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.704095:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7578d6a/0x96d0c9b8c9a1e1c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.704104:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3be:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.704107:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.704111:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7578d6a/0x96d0c9b8c9a1e1c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.704119:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7578d6a/0x96d0c9b8c9a1e1c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.704128:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7578d6a/0x96d0c9b8c9a1e1c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.704135:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7578d6a/0x96d0c9b8c9a1e1c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.704148:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788201438.704704:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201438.704712:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7a70143/0x96d0c9b8c9a1e1ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.704720:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896a800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201438.704724:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7a70143/0x96d0c9b8c9a1e1ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.704732:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7a70143/0x96d0c9b8c9a1e1ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.704745:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7a70143/0x96d0c9b8c9a1e1ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.704753:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7a70143/0x96d0c9b8c9a1e1ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.704769:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201438.704773:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7578d6a/0x96d0c9b8c9a1e1c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.704780:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896a200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201438.704784:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7578d6a/0x96d0c9b8c9a1e1c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.704802:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7578d6a/0x96d0c9b8c9a1e1c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.704812:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7578d6a/0x96d0c9b8c9a1e1c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.704819:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7578d6a/0x96d0c9b8c9a1e1c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.704831:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201438.704833:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201438.704835:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201438.712351:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.712365:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e1c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.712394:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3bd:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.712399:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.712406:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e1c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.712421:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e1c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.712432:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e1c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.712447:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e1c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.712473:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201438.716585:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.716601:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e1cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.716618:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3bc:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.716624:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.716630:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e1cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.716644:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e1cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.716654:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e1cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.716662:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e1cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.716682:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788201438.716899:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201438.716907:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e1c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.716924:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201438.716929:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e1c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.716939:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e1c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.716957:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e1c8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.716965:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e1c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.716983:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201438.716986:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e1cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.716993:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201438.716996:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e1cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.717004:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e1cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.717031:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e1cf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.717044:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e1cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.717059:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201438.717061:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201438.717063:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.717808:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.717816:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201438.718404:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.718412:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1e1d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.718426:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3bb:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.718431:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.718437:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1e1d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.718449:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1e1d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.718458:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1e1d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.718466:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1e1d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.718482:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201438.718646:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201438.718651:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1e1d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.718659:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201438.718663:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1e1d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.718671:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1e1d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.718686:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1e1d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.718694:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1e1d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.718710:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201438.718712:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201438.718714:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201438.718843:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201438.718850:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1e1dd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.718859:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a1:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:1.0:1788201438.718862:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201438.718866:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1e1dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.718879:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1e1dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.718886:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1e1dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.718893:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1e1dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.718906:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201438.718913:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201438.718917:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1e1dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.718925:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.718928:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1e1dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.718947:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1e1dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.718959:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1e1dd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.718967:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000957cff04/0x96d0c9b8c9a1e1dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.718981:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.718982:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.718984:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201438.719543:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.719549:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e1e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.719558:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ba:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.719562:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.719566:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e1e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.719589:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e1e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.719598:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e1e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.719606:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e1e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.719622:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201438.719875:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201438.719880:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e1e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.719888:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.719891:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e1e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.719900:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e1e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.719914:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e1e4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.719933:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e1e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.719951:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.719953:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.719955:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201438.720136:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201438.720299:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.720305:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e1eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.720316:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a0:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.720319:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.720324:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e1eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.720337:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e1eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.720345:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e1eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.720365:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e1eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.720395:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201438.720617:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201438.720623:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e1eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.720632:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.720635:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e1eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.720644:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e1eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.720657:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e1eb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.720665:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e1eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.720680:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.720682:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.720689:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201438.720823:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.720829:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e1f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.720838:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39f:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.720841:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.720845:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e1f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.720853:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e1f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.720861:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e1f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.720868:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e1f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.720888:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201438.721115:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201438.721121:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e1f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.721131:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbca00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.721134:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e1f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.721142:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e1f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.721164:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e1f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.721172:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e1f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.721186:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.721188:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.721190:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201438.721311:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.721317:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e1f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.721332:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39e:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.721336:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.721340:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e1f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.721350:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e1f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.721358:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e1f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.721366:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e1f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.721420:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788201438.721601:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.721612:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ab5e6bc/0x96d0c9b8c9a1e200 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.721621:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b9:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.721624:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.721629:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ab5e6bc/0x96d0c9b8c9a1e200 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.721639:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ab5e6bc/0x96d0c9b8c9a1e200 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.721647:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ab5e6bc/0x96d0c9b8c9a1e200 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.721655:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ab5e6bc/0x96d0c9b8c9a1e200 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201438.723008:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.723045:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e207 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.723059:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39d:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.723063:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.723068:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e207 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.723080:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e207 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.723100:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e207 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.723107:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e207 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.723301:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201438.723310:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e1f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.723318:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbce00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.723322:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e1f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.723343:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e1f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.723359:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e1f9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.723367:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e1f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.723393:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201438.723398:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ab5e6bc/0x96d0c9b8c9a1e200 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.723405:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896bc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.723407:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ab5e6bc/0x96d0c9b8c9a1e200 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.723414:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ab5e6bc/0x96d0c9b8c9a1e200 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.723425:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ab5e6bc/0x96d0c9b8c9a1e200 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.723433:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201438.723436:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e207 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.723448:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.723451:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e207 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.723458:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e207 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.723469:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e207 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.723477:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.723479:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.723481:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201438.723594:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788201438.723601:0:100688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ab5e6bc/0x96d0c9b8c9a1e200 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201438.724011:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.724082:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000362585d6/0x96d0c9b8c9a1e20e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.724091:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b8:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.724095:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.724107:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000362585d6/0x96d0c9b8c9a1e20e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.724119:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000362585d6/0x96d0c9b8c9a1e20e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.724128:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000362585d6/0x96d0c9b8c9a1e20e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.724136:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000362585d6/0x96d0c9b8c9a1e20e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.724244:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201438.724729:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201438.724737:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000362585d6/0x96d0c9b8c9a1e20e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.724745:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896ac00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.724749:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000362585d6/0x96d0c9b8c9a1e20e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.724757:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000362585d6/0x96d0c9b8c9a1e20e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.724773:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000362585d6/0x96d0c9b8c9a1e20e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.724787:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000362585d6/0x96d0c9b8c9a1e20e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.724804:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.724806:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.724808:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201438.725071:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201438.725077:0:101191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e207 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.725227:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201438.725540:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.725547:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1e215 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.725558:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39c:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.725562:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.725567:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1e215 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.725577:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1e215 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.725585:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1e215 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.725602:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1e215 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.725621:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201438.725845:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201438.725850:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1e215 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.725858:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbda00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.725862:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1e215 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.725869:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1e215 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.725883:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1e215 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.725889:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1e215 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.725905:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.725913:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.725914:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201438.725987:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.725993:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1e21c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.726002:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39b:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.726005:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.726009:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1e21c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.726050:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1e21c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.726058:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1e21c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.726066:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1e21c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.726080:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788201438.726412:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.726418:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023a9cd70/0x96d0c9b8c9a1e223 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.726428:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b7:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.726431:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.726436:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023a9cd70/0x96d0c9b8c9a1e223 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.726446:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023a9cd70/0x96d0c9b8c9a1e223 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.726455:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023a9cd70/0x96d0c9b8c9a1e223 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.726474:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023a9cd70/0x96d0c9b8c9a1e223 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.726487:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788201438.726570:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.726575:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a2d8d4f/0x96d0c9b8c9a1e22a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.726583:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b6:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.726586:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.726590:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a2d8d4f/0x96d0c9b8c9a1e22a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.726598:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a2d8d4f/0x96d0c9b8c9a1e22a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.726605:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a2d8d4f/0x96d0c9b8c9a1e22a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.726612:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a2d8d4f/0x96d0c9b8c9a1e22a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.726625:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788201438.726685:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.726690:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000085d0dd9/0x96d0c9b8c9a1e231 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.726703:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b5:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.726706:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.726710:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000085d0dd9/0x96d0c9b8c9a1e231 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.726719:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000085d0dd9/0x96d0c9b8c9a1e231 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.726726:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000085d0dd9/0x96d0c9b8c9a1e231 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.726733:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000085d0dd9/0x96d0c9b8c9a1e231 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.726743:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788201438.726804:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.726809:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000306962a9/0x96d0c9b8c9a1e238 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.726817:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b4:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.726820:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.726824:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000306962a9/0x96d0c9b8c9a1e238 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.726832:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000306962a9/0x96d0c9b8c9a1e238 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.726846:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000306962a9/0x96d0c9b8c9a1e238 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.726853:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000306962a9/0x96d0c9b8c9a1e238 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.726862:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788201438.726922:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.726927:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a9def0/0x96d0c9b8c9a1e23f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.726935:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b3:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.726938:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.726942:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034a9def0/0x96d0c9b8c9a1e23f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.726950:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034a9def0/0x96d0c9b8c9a1e23f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.726958:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a9def0/0x96d0c9b8c9a1e23f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.726966:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034a9def0/0x96d0c9b8c9a1e23f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.726985:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1788201438.727065:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.727070:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df038d52/0x96d0c9b8c9a1e246 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.727078:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b2:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.727081:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.727085:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df038d52/0x96d0c9b8c9a1e246 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.727093:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df038d52/0x96d0c9b8c9a1e246 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.727101:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df038d52/0x96d0c9b8c9a1e246 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.727109:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df038d52/0x96d0c9b8c9a1e246 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.727118:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1788201438.727469:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.727476:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1e24d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.727491:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39a:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.727494:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.727498:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1e24d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.727507:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1e24d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.727515:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1e24d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.727521:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1e24d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.727529:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:1.0:1788201438.727802:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788201438.727808:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1e21c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.727817:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.727822:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1e21c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.727831:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1e21c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.727849:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1e21c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.727857:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1e21c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.727877:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788201438.727881:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023a9cd70/0x96d0c9b8c9a1e223 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.727887:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896ba00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.727890:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023a9cd70/0x96d0c9b8c9a1e223 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.727910:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023a9cd70/0x96d0c9b8c9a1e223 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.727922:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023a9cd70/0x96d0c9b8c9a1e223 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.727929:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023a9cd70/0x96d0c9b8c9a1e223 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.727944:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788201438.727948:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a2d8d4f/0x96d0c9b8c9a1e22a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.727954:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896be00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.727957:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a2d8d4f/0x96d0c9b8c9a1e22a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.727965:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a2d8d4f/0x96d0c9b8c9a1e22a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.727975:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a2d8d4f/0x96d0c9b8c9a1e22a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.727983:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a2d8d4f/0x96d0c9b8c9a1e22a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.728008:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788201438.728012:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000085d0dd9/0x96d0c9b8c9a1e231 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.728035:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896b400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.728039:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000085d0dd9/0x96d0c9b8c9a1e231 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.728048:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000085d0dd9/0x96d0c9b8c9a1e231 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.728059:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000085d0dd9/0x96d0c9b8c9a1e231 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.728067:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000085d0dd9/0x96d0c9b8c9a1e231 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.728079:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788201438.728083:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000306962a9/0x96d0c9b8c9a1e238 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.728090:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896a400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.728093:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000306962a9/0x96d0c9b8c9a1e238 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.728112:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000306962a9/0x96d0c9b8c9a1e238 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.728123:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000306962a9/0x96d0c9b8c9a1e238 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.728131:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000306962a9/0x96d0c9b8c9a1e238 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.728160:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201438.728164:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034a9def0/0x96d0c9b8c9a1e23f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.728172:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896aa00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.728175:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a9def0/0x96d0c9b8c9a1e23f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.728183:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a9def0/0x96d0c9b8c9a1e23f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.728194:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034a9def0/0x96d0c9b8c9a1e23f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.728201:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034a9def0/0x96d0c9b8c9a1e23f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.728224:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201438.728228:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df038d52/0x96d0c9b8c9a1e246 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.728235:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896b000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.728239:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df038d52/0x96d0c9b8c9a1e246 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.728247:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df038d52/0x96d0c9b8c9a1e246 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.728258:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df038d52/0x96d0c9b8c9a1e246 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.728266:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df038d52/0x96d0c9b8c9a1e246 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.728278:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201438.728282:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1e24d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.728289:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.728293:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1e24d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.728311:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1e24d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.728322:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1e24d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.728330:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1e24d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.728345:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.728347:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.728349:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.728357:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.728362:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201438.731645:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x399:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.731660:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1e254 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x399:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.731679:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x399:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.731683:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x399:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.731690:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1e254 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.731704:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1e254 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.731723:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1e254 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.731730:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1e254 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.731760:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201438.731779:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201438.731785:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1e254 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.731793:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201438.731800:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1e254 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.731809:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1e254 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.731826:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1e254 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.731834:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096d2c284/0x96d0c9b8c9a1e254 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.731852:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201438.731859:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201438.731861:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201438.732202:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.732209:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb613a73/0x96d0c9b8c9a1e25b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732217:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b1:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.732227:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.732231:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb613a73/0x96d0c9b8c9a1e25b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732242:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb613a73/0x96d0c9b8c9a1e25b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732250:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb613a73/0x96d0c9b8c9a1e25b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732257:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb613a73/0x96d0c9b8c9a1e25b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732280:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788201438.732356:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.732363:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f6d99c0/0x96d0c9b8c9a1e262 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732371:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b0:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.732374:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.732379:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f6d99c0/0x96d0c9b8c9a1e262 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732400:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f6d99c0/0x96d0c9b8c9a1e262 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732410:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f6d99c0/0x96d0c9b8c9a1e262 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732423:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f6d99c0/0x96d0c9b8c9a1e262 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732444:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788201438.732507:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.732512:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006273b7ee/0x96d0c9b8c9a1e269 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732521:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3af:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.732524:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.732529:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006273b7ee/0x96d0c9b8c9a1e269 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732538:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006273b7ee/0x96d0c9b8c9a1e269 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732547:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006273b7ee/0x96d0c9b8c9a1e269 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732555:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006273b7ee/0x96d0c9b8c9a1e269 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732567:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788201438.732626:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.732631:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093bf9abe/0x96d0c9b8c9a1e270 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732645:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ae:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.732648:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.732652:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093bf9abe/0x96d0c9b8c9a1e270 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732662:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093bf9abe/0x96d0c9b8c9a1e270 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732671:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093bf9abe/0x96d0c9b8c9a1e270 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732679:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093bf9abe/0x96d0c9b8c9a1e270 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732688:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788201438.732748:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.732752:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019e36806/0x96d0c9b8c9a1e277 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732760:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ad:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.732762:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.732766:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019e36806/0x96d0c9b8c9a1e277 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732775:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019e36806/0x96d0c9b8c9a1e277 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732788:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019e36806/0x96d0c9b8c9a1e277 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732795:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019e36806/0x96d0c9b8c9a1e277 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732803:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788201438.732870:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.732876:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7227628/0x96d0c9b8c9a1e27e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732883:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ac:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.732886:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.732889:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7227628/0x96d0c9b8c9a1e27e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732898:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7227628/0x96d0c9b8c9a1e27e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732905:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7227628/0x96d0c9b8c9a1e27e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732913:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7227628/0x96d0c9b8c9a1e27e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.732931:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1788201438.732993:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.732998:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7578d6a/0x96d0c9b8c9a1e285 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733006:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ab:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.733008:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.733012:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7578d6a/0x96d0c9b8c9a1e285 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733049:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7578d6a/0x96d0c9b8c9a1e285 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733057:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7578d6a/0x96d0c9b8c9a1e285 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733064:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7578d6a/0x96d0c9b8c9a1e285 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733073:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1788201438.733138:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.733143:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7a70143/0x96d0c9b8c9a1e28c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733150:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3aa:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.733159:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.733163:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7a70143/0x96d0c9b8c9a1e28c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733172:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7a70143/0x96d0c9b8c9a1e28c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733178:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7a70143/0x96d0c9b8c9a1e28c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733185:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7a70143/0x96d0c9b8c9a1e28c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733193:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1788201438.733251:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.733255:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02c69b2/0x96d0c9b8c9a1e293 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733263:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a9:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.733267:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.733271:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02c69b2/0x96d0c9b8c9a1e293 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733280:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02c69b2/0x96d0c9b8c9a1e293 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733287:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b02c69b2/0x96d0c9b8c9a1e293 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733300:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02c69b2/0x96d0c9b8c9a1e293 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733308:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:0.0:1788201438.733371:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.733376:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067a58ba5/0x96d0c9b8c9a1e29a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733396:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a8:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.733399:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.733402:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067a58ba5/0x96d0c9b8c9a1e29a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733410:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067a58ba5/0x96d0c9b8c9a1e29a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733418:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067a58ba5/0x96d0c9b8c9a1e29a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733424:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067a58ba5/0x96d0c9b8c9a1e29a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733432:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:0.0:1788201438.733489:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.733494:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1e2a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733508:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a7:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.733511:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.733515:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1e2a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733524:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1e2a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733533:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1e2a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733540:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1e2a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733548:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:0.0:1788201438.733610:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.733616:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1e2a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733624:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a6:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.733628:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.733632:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1e2a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733642:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1e2a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733656:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1e2a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733664:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1e2a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733673:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:0.0:1788201438.733732:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.733738:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1e2af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733747:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a5:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.733749:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.733753:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1e2af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733762:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1e2af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733770:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1e2af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733777:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1e2af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733796:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:0.0:1788201438.733858:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.733863:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1e2b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733871:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a4:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.733874:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.733878:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1e2b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733886:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1e2b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733894:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1e2b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733901:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1e2b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733909:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:0.0:1788201438.733964:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.733969:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1e2bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733976:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a3:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.733985:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.733990:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1e2bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.733999:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1e2bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.734007:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1e2bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.734040:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1e2bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.734050:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:0.0:1788201438.734107:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.734113:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1e2c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.734120:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a2:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.734124:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.734128:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1e2c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.734137:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1e2c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.734145:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1e2c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.734157:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1e2c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.734165:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:0.0:1788201438.734222:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.734227:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1e2cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.734236:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a1:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.734239:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.734243:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1e2cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.734251:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1e2cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.734259:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1e2cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.734266:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1e2cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.734273:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:0.0:1788201438.734323:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.734327:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1e2d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.734340:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a0:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.734343:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.734347:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1e2d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.734357:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1e2d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.734364:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1e2d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.734370:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1e2d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.734377:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00010000:00010000:2.0:1788201438.734456:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:2.0:1788201438.734463:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb613a73/0x96d0c9b8c9a1e25b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734471:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896a600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201438.734476:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb613a73/0x96d0c9b8c9a1e25b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734484:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb613a73/0x96d0c9b8c9a1e25b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734500:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb613a73/0x96d0c9b8c9a1e25b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734508:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb613a73/0x96d0c9b8c9a1e25b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734530:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:2.0:1788201438.734534:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f6d99c0/0x96d0c9b8c9a1e262 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734540:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896ae00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201438.734543:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f6d99c0/0x96d0c9b8c9a1e262 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734560:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f6d99c0/0x96d0c9b8c9a1e262 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734571:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f6d99c0/0x96d0c9b8c9a1e262 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734577:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f6d99c0/0x96d0c9b8c9a1e262 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734590:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:2.0:1788201438.734594:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006273b7ee/0x96d0c9b8c9a1e269 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734600:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896a000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201438.734603:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006273b7ee/0x96d0c9b8c9a1e269 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734610:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006273b7ee/0x96d0c9b8c9a1e269 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734620:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006273b7ee/0x96d0c9b8c9a1e269 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734627:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006273b7ee/0x96d0c9b8c9a1e269 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734651:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:2.0:1788201438.734655:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093bf9abe/0x96d0c9b8c9a1e270 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734660:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896b800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201438.734664:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093bf9abe/0x96d0c9b8c9a1e270 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734671:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093bf9abe/0x96d0c9b8c9a1e270 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734680:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093bf9abe/0x96d0c9b8c9a1e270 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734687:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093bf9abe/0x96d0c9b8c9a1e270 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734699:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:2.0:1788201438.734702:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019e36806/0x96d0c9b8c9a1e277 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734709:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896b200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201438.734712:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019e36806/0x96d0c9b8c9a1e277 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734731:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019e36806/0x96d0c9b8c9a1e277 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734742:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019e36806/0x96d0c9b8c9a1e277 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734749:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019e36806/0x96d0c9b8c9a1e277 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734762:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:2.0:1788201438.734766:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7227628/0x96d0c9b8c9a1e27e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734773:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896b600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201438.734776:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7227628/0x96d0c9b8c9a1e27e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734784:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7227628/0x96d0c9b8c9a1e27e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734794:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7227628/0x96d0c9b8c9a1e27e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734801:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7227628/0x96d0c9b8c9a1e27e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734821:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:2.0:1788201438.734825:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7578d6a/0x96d0c9b8c9a1e285 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734832:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896a200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201438.734835:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7578d6a/0x96d0c9b8c9a1e285 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734843:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7578d6a/0x96d0c9b8c9a1e285 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734853:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7578d6a/0x96d0c9b8c9a1e285 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734861:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7578d6a/0x96d0c9b8c9a1e285 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734873:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:2.0:1788201438.734877:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7a70143/0x96d0c9b8c9a1e28c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734884:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00896a800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201438.734887:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7a70143/0x96d0c9b8c9a1e28c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734905:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7a70143/0x96d0c9b8c9a1e28c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734916:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7a70143/0x96d0c9b8c9a1e28c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734923:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7a70143/0x96d0c9b8c9a1e28c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734935:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1788201438.734938:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02c69b2/0x96d0c9b8c9a1e293 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734945:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201438.734948:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02c69b2/0x96d0c9b8c9a1e293 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734957:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02c69b2/0x96d0c9b8c9a1e293 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734965:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02c69b2/0x96d0c9b8c9a1e293 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734973:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02c69b2/0x96d0c9b8c9a1e293 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.734995:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1788201438.734999:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067a58ba5/0x96d0c9b8c9a1e29a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735006:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201438.735010:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067a58ba5/0x96d0c9b8c9a1e29a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735037:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067a58ba5/0x96d0c9b8c9a1e29a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735048:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067a58ba5/0x96d0c9b8c9a1e29a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735056:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067a58ba5/0x96d0c9b8c9a1e29a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735070:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1788201438.735074:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1e2a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735080:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adec00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201438.735083:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1e2a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735101:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1e2a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735112:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1e2a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735120:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1e2a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735132:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788201438.735136:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1e2a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735142:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201438.735146:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1e2a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735154:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1e2a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735163:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1e2a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735170:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1e2a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735192:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788201438.735195:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1e2af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735203:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201438.735206:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1e2af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735214:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1e2af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735225:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1e2af lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735233:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1e2af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735244:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788201438.735248:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1e2b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735255:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201438.735258:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1e2b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735275:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1e2b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735285:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1e2b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735293:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1e2b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735307:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788201438.735311:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1e2bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735318:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201438.735321:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1e2bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735329:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1e2bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735339:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1e2bd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735347:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1e2bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735368:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788201438.735372:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1e2c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735378:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adea00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201438.735395:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1e2c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735404:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1e2c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735416:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1e2c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735424:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1e2c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735435:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201438.735439:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1e2cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735446:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adee00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201438.735449:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1e2cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735468:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1e2cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735480:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1e2cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735488:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1e2cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735501:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201438.735505:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1e2d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735512:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201438.735516:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1e2d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735524:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1e2d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735534:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1e2d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735541:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1e2d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.735566:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201438.735568:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201438.735570:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201438.735581:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201438.735812:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201438.736451:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x398:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.736460:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1e2d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x398:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.736473:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x398:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.736478:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x398:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.736484:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1e2d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.736497:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1e2d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.736507:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1e2d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.736516:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1e2d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.736575:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201438.736944:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x397:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.736950:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1e2e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.736970:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x397:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.736974:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x397:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.736979:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1e2e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.736988:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1e2e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.736995:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1e2e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.737002:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1e2e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201438.737133:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.737140:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1e2e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.737161:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39f:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.737164:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.737168:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1e2e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.737178:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1e2e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.737193:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1e2e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.737199:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1e2e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.737365:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788201438.737372:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1e2d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.737380:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201438.737401:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1e2d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.737411:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1e2d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.737429:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1e2d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.737437:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf9faa0b/0x96d0c9b8c9a1e2d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.737456:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201438.737459:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1e2e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.737466:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782cc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201438.737469:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1e2e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.737477:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1e2e0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.737486:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1e2e0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.737493:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201438.737502:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1e2e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.737509:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201438.737511:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1e2e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.737520:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1e2e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.737531:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1e2e7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.737538:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201438.737540:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201438.737541:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201438.737649:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201438.737655:0:101191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc2534dc/0x96d0c9b8c9a1e2e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201438.737972:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x396:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.737979:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1e2ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.737988:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x396:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.737992:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x396:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.737997:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1e2ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.738028:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1e2ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.738038:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1e2ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.738046:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1e2ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.738062:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201438.738362:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x395:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.738368:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007f42006/0x96d0c9b8c9a1e2f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.738378:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x395:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.738391:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x395:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.738396:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007f42006/0x96d0c9b8c9a1e2f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.738406:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007f42006/0x96d0c9b8c9a1e2f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.738415:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007f42006/0x96d0c9b8c9a1e2f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.738433:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007f42006/0x96d0c9b8c9a1e2f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.738448:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788201438.738695:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x394:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.738701:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1e2fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.738710:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x394:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.738713:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x394:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.738717:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1e2fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.738727:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1e2fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.738736:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1e2fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.738744:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1e2fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.738753:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788201438.738987:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x393:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.738993:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1e303 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.739007:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x393:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.739010:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x393:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.739034:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1e303 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.739044:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1e303 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.739053:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1e303 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.739060:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1e303 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.739069:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788201438.739312:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788201438.739318:0:100688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1e2e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201438.739426:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.739433:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1e30a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.739441:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39e:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.739444:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.739449:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1e30a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.739459:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1e30a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.739467:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1e30a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.739485:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1e30a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.739494:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788201438.739552:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.739557:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1e311 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.739565:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39d:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.739568:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.739572:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1e311 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.739581:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1e311 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.739588:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1e311 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.739595:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1e311 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.739603:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1788201438.739657:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.739662:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1e318 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.739676:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39c:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.739679:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.739683:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1e318 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.739692:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1e318 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.739700:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1e318 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.739706:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1e318 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.739716:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1788201438.739774:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.739779:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1e31f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.739786:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39b:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.739789:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.739793:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1e31f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.739802:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1e31f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.739817:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1e31f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.739823:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1e31f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.739831:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1788201438.739887:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.739892:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1e326 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.739899:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39a:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.739902:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.739907:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1e326 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.739915:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1e326 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.739922:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1e326 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.739930:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1e326 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.739949:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:0.0:1788201438.740008:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x399:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.740013:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1e32d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x399:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.740040:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x399:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.740043:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x399:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.740047:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1e32d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.740055:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1e32d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.740062:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1e32d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.740069:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1e32d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.740077:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:0.0:1788201438.740128:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x398:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.740133:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1e334 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x398:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.740139:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x398:0x0].0x0 since=4290s v=(0 0) 00002000:00010000:2.0:1788201438.740285:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x392:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.740290:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1e33b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.740297:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x392:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.740299:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x392:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.740302:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1e33b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.740310:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1e33b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.740322:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1e33b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.740329:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1e33b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.740337:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00010000:00010000:0.0:1788201438.740588:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x398:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.740595:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1e334 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.740606:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1e334 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.740613:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1e334 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.740620:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1e334 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.740629:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:0.0:1788201438.740692:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x397:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.740698:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1e342 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.740705:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x397:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.740709:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x397:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.740713:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1e342 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.740723:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1e342 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.740731:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1e342 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.740744:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1e342 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.740753:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00080000:0.0:1788201438.740777:0:100688:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:918 00000100:00100000:0.0:1788201438.740874:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13336a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:102467:x1875060715390080:12345-0@lo:5:osp-pre-0-0.0 Request processed in 56057us (56216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201438.740884:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1788201438.740987:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:1.0:1788201438.740995:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1e2ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741003:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782de00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.741008:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1e2ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741034:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1e2ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741053:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1e2ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741068:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002d97a29/0x96d0c9b8c9a1e2ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x396:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741090:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:1.0:1788201438.741093:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007f42006/0x96d0c9b8c9a1e2f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741100:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.741104:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007f42006/0x96d0c9b8c9a1e2f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741111:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007f42006/0x96d0c9b8c9a1e2f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741122:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007f42006/0x96d0c9b8c9a1e2f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741128:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007f42006/0x96d0c9b8c9a1e2f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x395:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741141:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:1.0:1788201438.741145:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1e2fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201438.741278:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x391:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.741284:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008581f318/0x96d0c9b8c9a1e349 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.741291:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x391:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.741294:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x391:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.741299:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008581f318/0x96d0c9b8c9a1e349 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.741308:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008581f318/0x96d0c9b8c9a1e349 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.741316:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008581f318/0x96d0c9b8c9a1e349 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.741322:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008581f318/0x96d0c9b8c9a1e349 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.741344:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00010000:00010000:1.0:1788201438.741604:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.741613:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1e2fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741621:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1e2fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741633:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1e2fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741640:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037e67787/0x96d0c9b8c9a1e2fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x394:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741654:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:1.0:1788201438.741657:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1e303 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741664:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782da00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.741667:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1e303 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741674:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1e303 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741683:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1e303 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741691:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0e5bb1e/0x96d0c9b8c9a1e303 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x393:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741711:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:1.0:1788201438.741715:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1e30a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741723:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.741727:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1e30a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741736:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1e30a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741748:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1e30a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741756:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1e30a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741770:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1788201438.741774:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1e311 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741782:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfa00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.741786:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1e311 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741806:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1e311 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741817:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1e311 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741825:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1e311 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741837:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788201438.741841:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1e318 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741848:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfe00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.741851:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1e318 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741859:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1e318 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741868:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1e318 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741875:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1e318 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741898:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788201438.741902:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1e31f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741909:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.741913:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1e31f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741921:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1e31f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741932:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1e31f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741941:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1e31f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741952:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788201438.741956:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1e326 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741963:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.741966:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1e326 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741985:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1e326 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.741997:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1e326 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.742004:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1e326 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.742038:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788201438.742042:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1e32d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.742050:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.742053:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1e32d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.742061:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1e32d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.742072:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1e32d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.742079:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1e32d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x399:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.742103:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788201438.742107:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1e33b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.742113:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.742117:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1e33b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.742124:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1e33b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.742134:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1e33b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.742141:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb321e81/0x96d0c9b8c9a1e33b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x392:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201438.742283:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x390:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.742290:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1e350 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.742299:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x390:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.742303:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x390:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.742308:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1e350 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.742317:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1e350 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.742326:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1e350 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.742334:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1e350 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.742344:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1788201438.743249:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788201438.743254:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1e334 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.743263:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.743267:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1e334 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.743287:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1e334 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.743302:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1e334 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.743311:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1e334 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x398:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.743326:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201438.743329:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1e342 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.743336:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.743339:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1e342 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.743347:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1e342 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.743357:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1e342 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.743364:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1e342 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x397:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.743397:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201438.743401:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008581f318/0x96d0c9b8c9a1e349 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.743409:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782ce00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.743412:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008581f318/0x96d0c9b8c9a1e349 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.743420:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008581f318/0x96d0c9b8c9a1e349 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.743431:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008581f318/0x96d0c9b8c9a1e349 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.743439:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008581f318/0x96d0c9b8c9a1e349 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x391:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.743451:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201438.743454:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1e350 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.743460:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.743464:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1e350 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.743482:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1e350 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.743493:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1e350 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.743500:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088bfc030/0x96d0c9b8c9a1e350 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x390:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.743514:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.743516:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.743518:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201438.743641:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.743647:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f7ba23f/0x96d0c9b8c9a1e357 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.743657:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38f:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.743667:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.743673:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f7ba23f/0x96d0c9b8c9a1e357 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.743685:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f7ba23f/0x96d0c9b8c9a1e357 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.743694:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f7ba23f/0x96d0c9b8c9a1e357 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.743703:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f7ba23f/0x96d0c9b8c9a1e357 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.743727:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201438.744045:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201438.744053:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f7ba23f/0x96d0c9b8c9a1e357 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.744061:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782ca00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201438.744064:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f7ba23f/0x96d0c9b8c9a1e357 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.744070:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f7ba23f/0x96d0c9b8c9a1e357 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.744093:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f7ba23f/0x96d0c9b8c9a1e357 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.744100:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f7ba23f/0x96d0c9b8c9a1e357 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201438.744220:0:102467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:102467:1875060715390080:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788201438.744236:0:102467:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x3c1:0x0] from OST, last_created [0x280000401:0x3c1:0x0]last_used is [0x280000401:0x396:0x0] 00000100:00100000:3.0:1788201438.744308:0:102467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:102467:1875060715390464:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788201438.744370:0:102467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201438.744409:0:102467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc003491240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201438.744426:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715390336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201438.744450:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201438.744490:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715390464 00000100:00100000:3.0:1788201438.744497:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715390464 00000100:00100000:3.0:1788201438.744536:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788201438.744545:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13336b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:102467:x1875060715390464:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788201438.744584:0:99766:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 962 00002000:00010000:2.0:1788201438.745322:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.745332:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1e35e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.745345:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38e:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.745349:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.745356:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1e35e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.745366:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1e35e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.745375:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1e35e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.745401:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1e35e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.745412:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201438.746252:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201438.746262:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1e35e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.746272:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.746277:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1e35e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.746285:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1e35e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.746303:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1e35e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.746321:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5b8b4c5/0x96d0c9b8c9a1e35e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.746342:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.746344:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.746346:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201438.746465:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.746471:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f3a753/0x96d0c9b8c9a1e365 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.746481:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38d:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.746485:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.746490:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087f3a753/0x96d0c9b8c9a1e365 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.746500:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087f3a753/0x96d0c9b8c9a1e365 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.746508:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087f3a753/0x96d0c9b8c9a1e365 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.746515:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087f3a753/0x96d0c9b8c9a1e365 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.746539:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201438.747236:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201438.747243:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087f3a753/0x96d0c9b8c9a1e365 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.747253:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782d600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.747256:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f3a753/0x96d0c9b8c9a1e365 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.747265:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087f3a753/0x96d0c9b8c9a1e365 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.747279:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087f3a753/0x96d0c9b8c9a1e365 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.747286:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087f3a753/0x96d0c9b8c9a1e365 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.747303:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.747305:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.747313:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201438.747429:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.747436:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034a08521/0x96d0c9b8c9a1e36c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.747450:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38c:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.747454:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.747459:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034a08521/0x96d0c9b8c9a1e36c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.747469:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034a08521/0x96d0c9b8c9a1e36c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.747478:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034a08521/0x96d0c9b8c9a1e36c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.747485:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034a08521/0x96d0c9b8c9a1e36c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.747541:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788201438.749204:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13336b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:102467:x1875060715390464:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4654us (4827us total) trans 12884901910 rc 0/0 00000100:00100000:3.0:1788201438.749217:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788201438.749262:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715390336 00000100:00100000:3.0:1788201438.749270:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715390336 00000100:00100000:3.0:1788201438.749311:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788201438.749329:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715390336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201438.749353:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201438.749399:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715390336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (4947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201438.749405:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788201438.749509:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715390336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201438.749879:0:102467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:102467:1875060715390464:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788201438.749891:0:102467:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x3c1:0x0]-[0x280000401:0x3e1:0x0] 00002000:00010000:0.0:1788201438.750371:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201438.750379:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005be00ded/0x96d0c9b8c9a1e373 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.750404:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38b:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:0.0:1788201438.750409:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201438.750416:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005be00ded/0x96d0c9b8c9a1e373 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.750431:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005be00ded/0x96d0c9b8c9a1e373 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.750442:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005be00ded/0x96d0c9b8c9a1e373 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.750461:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005be00ded/0x96d0c9b8c9a1e373 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.750538:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201438.750546:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034a08521/0x96d0c9b8c9a1e36c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.750555:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.750559:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034a08521/0x96d0c9b8c9a1e36c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.750569:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034a08521/0x96d0c9b8c9a1e36c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.750586:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034a08521/0x96d0c9b8c9a1e36c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.750594:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034a08521/0x96d0c9b8c9a1e36c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.750614:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201438.750618:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005be00ded/0x96d0c9b8c9a1e373 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.750624:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.750628:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005be00ded/0x96d0c9b8c9a1e373 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.750635:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005be00ded/0x96d0c9b8c9a1e373 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.750652:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005be00ded/0x96d0c9b8c9a1e373 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.750660:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.750662:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.750663:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201438.751235:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201438.751244:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201438.751266:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201438.751269:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201438.751270:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201438.752325:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788201438.752335:0:101191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005be00ded/0x96d0c9b8c9a1e373 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.756066:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201438.756714:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.756725:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1e37a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.756745:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38a:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.756750:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.756757:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1e37a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.756772:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1e37a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.756791:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1e37a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.756800:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1e37a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.756826:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201438.757080:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201438.757089:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1e37a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.757099:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782c600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201438.757104:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1e37a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.757114:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1e37a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.757132:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1e37a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.757139:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed75aab7/0x96d0c9b8c9a1e37a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.757183:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201438.757185:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201438.757187:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201438.757321:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x389:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.757327:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1e381 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.757335:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x389:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.757339:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x389:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.757343:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1e381 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.757352:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1e381 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.757360:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1e381 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.757367:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1e381 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.757412:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201438.757755:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x388:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.757761:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e388 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.757771:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x388:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.757775:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x388:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.757779:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e388 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.757788:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e388 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.757796:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e388 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.757805:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e388 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.757884:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788201438.758289:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x387:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.758296:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e38f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.758305:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x387:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.758315:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x387:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.758320:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e38f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.758330:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e38f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.758338:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e38f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.758346:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e38f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.759283:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201438.759292:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1e381 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.759303:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc00782dc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.759308:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1e381 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.759318:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1e381 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.759336:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1e381 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.759345:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000938026cd/0x96d0c9b8c9a1e381 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x389:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.759360:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201438.759365:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e388 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.759377:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbce00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.759392:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e388 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.759400:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e388 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.759410:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e388 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.759416:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e388 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x388:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.759428:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201438.759431:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e38f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.759437:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbca00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201438.759440:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e38f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.759447:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e38f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.759455:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e38f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.759472:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.759473:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201438.759475:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201438.759568:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201438.759638:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201438.759644:0:101191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e38f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x387:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.760001:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201438.760310:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x386:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.760318:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e396 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.760330:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x386:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.760334:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x386:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.760341:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e396 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.760352:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e396 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.760368:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e396 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.760377:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e396 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.760437:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201438.760709:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x385:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.760715:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e39d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.760724:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x385:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.760728:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x385:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.760732:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e39d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.760741:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e39d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.760749:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e39d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.760756:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e39d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.761482:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201438.761491:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e396 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.761500:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201438.761504:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e396 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.761513:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e396 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.761529:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e396 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.761537:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e396 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x386:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.761554:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201438.761558:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e39d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.761564:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201438.761574:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e39d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.761582:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e39d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.761593:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e39d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.761602:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201438.761603:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201438.761605:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201438.761656:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201438.761661:0:101191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e39d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x385:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201438.761955:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201438.762142:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x384:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.762207:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e3a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.762219:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x384:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.762223:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x384:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.762228:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e3a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.762239:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e3a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.762248:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e3a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.762257:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e3a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.762305:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201438.762593:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x383:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.762599:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1e3ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.762613:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x383:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.762616:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x383:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.762620:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1e3ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.762629:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1e3ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.762636:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1e3ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.762643:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1e3ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.762669:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201438.762676:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e3a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.762682:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201438.762686:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e3a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.762694:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e3a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.762707:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e3a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.762715:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e3a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x384:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.762739:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201438.762743:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1e3ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.762750:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201438.762754:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1e3ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.762762:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1e3ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.762773:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1e3ab lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201438.762781:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201438.762783:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201438.762784:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201438.762913:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201438.762919:0:101191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1e3ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x383:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201438.763246:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x382:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201438.763252:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e3b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.763262:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x382:0x0].0x0 since=4290s v=(0 0) 00010000:00010000:2.0:1788201438.763265:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x382:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201438.763270:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e3b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.763286:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e3b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.763294:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e3b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.763302:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e3b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201438.763318:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788201438.763883:0:101191:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:803 00000100:00100000:2.0:1788201438.763988:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:102469:x1875060715390208:12345-0@lo:5:osp-pre-1-0.0 Request processed in 76548us (76683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201438.763997:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788201438.764083:0:102469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:102469:1875060715390208:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788201438.764101:0:102469:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x3a1:0x0] from OST, last_created [0x2c0000401:0x3a1:0x0]last_used is [0x2c0000401:0x323:0x0] 00010000:00010000:0.0:1788201438.764253:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201438.764260:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e3b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.764270:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201438.764273:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e3b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.764283:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e3b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.764297:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e3b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.764304:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e3b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x382:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201438.764325:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201438.764334:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201438.764336:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201438.764401:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201438.764463:0:102469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:102469:1875060715390720:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788201438.764502:0:102469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201438.764524:0:102469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0034c76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201438.764543:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715390720 00000100:00100000:2.0:1788201438.764549:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715390720 00000100:00100000:2.0:1788201438.764588:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788201438.764598:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:102469:x1875060715390720:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788201438.764636:0:101191:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 930 00000100:00100000:3.0:1788201438.765256:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715390592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201438.765292:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201438.765333:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715390592 00000100:00100000:3.0:1788201438.765337:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715390592 00000100:00100000:3.0:1788201438.765361:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788201438.765368:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715390592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201438.765392:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 896 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788201438.765434:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715390592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201438.765440:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788201438.765474:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715390592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201438.766748:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:102469:x1875060715390720:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2148us (2242us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788201438.766757:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788201438.766829:0:102469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:102469:1875060715390720:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788201438.766845:0:102469:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x3a1:0x0]-[0x2c0000401:0x3c1:0x0] 00000100:00100000:1.0:1788201439.192924:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201439.192975:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201439.193037:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201439.193187:0:102453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695533696 00000100:00100000:2.0:1788201439.193198:0:102453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695533696 00000100:00100000:2.0:1788201439.193252:0:102453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 74 00000100:00100000:2.0:1788201439.193262:0:102453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695533696:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201439.193332:0:102453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695533696:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 71us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201439.193340:0:102453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 74 00000100:00100000:0.0:1788201439.193772:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695533952 00000100:00100000:0.0:1788201439.193778:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695533952 00000100:00100000:0.0:1788201439.193819:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695533824 00000100:00100000:0.0:1788201439.193822:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695533824 00000100:00100000:0.0:1788201439.193917:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1752 00000100:00100000:0.0:1788201439.193926:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2401:x1875060695533952:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201439.193970:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2401:x1875060695533952:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 46us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201439.193977:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1752 00000100:00100000:0.0:1788201439.193992:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1753 00000100:00100000:0.0:1788201439.193998:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695533824:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201439.194054:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695533824:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 56us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201439.194061:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1753 00010000:00010000:1.0:1788201439.253497:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788201439.382555:0:102787:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788201439.382860:0:102787:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788201440.271459:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788201440.511440:0:102837:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788201440.511704:0:102837:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788201441.105284:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201441.105312:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715390848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201441.105424:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201441.105623:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715390848 00000100:00100000:2.0:1788201441.105631:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715390848 00000100:00080000:1.0:1788201441.105761:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201441.105924:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788201441.105936:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715390848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201441.106068:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201441.106229:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715390848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 294us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201441.106236:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788201441.112268:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715390848:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788201441.295497:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201442.127763:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13336b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715390976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201442.127842:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201442.127963:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715390976 00000100:00100000:3.0:1788201442.127972:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715390976 00000100:00100000:3.0:1788201442.128066:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788201442.128077:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715390976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201442.128107:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201442.128158:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715390976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201442.128165:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788201442.128214:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13336b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715390976:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788201442.128351:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788201442.319301:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201442.826069:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201442.826377:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695534080 00000100:00100000:2.0:1788201442.826388:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695534080 00000100:00100000:2.0:1788201442.826477:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1729 00000100:00100000:2.0:1788201442.826489:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:76674:x1875060695534080:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1788201442.826517:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201442.826544:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1e3b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786df8 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201442.826647:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e3c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788201442.826875:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788201442.826914:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201442.826940:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201442.826998:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788201442.827002:0:69485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201442.827071:0:69485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201442.827098:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1e3b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786df8 expref: 9 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201442.827117:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e3c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786df8 expref: 8 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201442.827126:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008723a00) 00010000:00010000:2.0:1788201442.827129:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201442.827133:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbd400, rc 0) 00000100:00100000:2.0:1788201442.827202:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:76674:x1875060695534080:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 715us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201442.827210:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1729 00000100:00100000:2.0:1788201442.831886:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201442.831985:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695534208 00000100:00100000:1.0:1788201442.831996:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695534208 00000100:00100000:1.0:1788201442.832094:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1730 00000100:00100000:1.0:1788201442.832105:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:76674:x1875060695534208:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:1.0:1788201442.832148:0:66313:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444921344 avail 1298681856 00000100:00100000:1.0:1788201442.832229:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:76674:x1875060695534208:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 125us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201442.832254:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1730 00000100:00100000:1.0:1788201442.838648:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201442.838782:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695534336 00000100:00100000:3.0:1788201442.838792:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695534336 00000100:00100000:3.0:1788201442.838872:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1731 00000100:00100000:3.0:1788201442.838885:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:76674:x1875060695534336:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:3.0:1788201442.838927:0:66757:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445371904 avail 1299132416 00000100:00100000:3.0:1788201442.839064:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:76674:x1875060695534336:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 182us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201442.839746:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1731 00000100:00080000:1.0:1788201442.840346:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201442.842336:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201442.842501:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695534464 00000100:00100000:1.0:1788201442.842511:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695534464 00000100:00100000:1.0:1788201442.842562:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 48 00000100:00100000:1.0:1788201442.842570:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13336b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2399:x1875060695534464:12345-192.168.201.20@tcp:8:lfs.0 00010000:00080000:1.0:1788201442.842620:0:101188:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp t8589934594 exp 0000000000000000 cur 4294 last 0 00000020:00000080:1.0:1788201442.842663:0:101188:0:(genops.c:1385:class_connect()) connect: client 6e293f14-c501-4bc5-9dd4-a18ef02756b4, cookie 0x96d0c9b8c9a1e3c7 00002000:00100000:1.0:1788201442.842677:0:101188:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6e293f14-c501-4bc5-9dd4-a18ef02756b4/ffff8dc0038ac000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8359936 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788201442.842688:0:101188:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788201442.842767:0:101188:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788201442.842799:0:101188:0:(import.c:65:import_set_state_nolock()) ffff8dc0038a9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201442.842871:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13336b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695534464:12345-192.168.201.20@tcp:8:lfs.0 Request processed in 300us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201442.842880:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 48 00000100:00100000:2.0:1788201442.849950:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201442.850128:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695534592 00000100:00100000:0.0:1788201442.850139:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695534592 00000100:00100000:0.0:1788201442.850228:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 48 00000100:00100000:0.0:1788201442.850239:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125808a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:76674:x1875060695534592:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:0.0:1788201442.850266:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201442.850355:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125808a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:76674:x1875060695534592:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 116us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201442.850362:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 48 00000100:00080000:1.0:1788201442.850772:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201442.856097:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201442.856445:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695534720 00000100:00100000:0.0:1788201442.856457:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695534720 00000100:00100000:0.0:1788201442.856512:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 49 00000100:00100000:0.0:1788201442.856520:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1875060695534720:12345-192.168.201.20@tcp:8:lfs.0 00010000:00080000:0.0:1788201442.856561:0:100688:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp t0 exp 0000000000000000 cur 4294 last 0 00000020:00000080:0.0:1788201442.856590:0:100688:0:(genops.c:1385:class_connect()) connect: client 6e293f14-c501-4bc5-9dd4-a18ef02756b4, cookie 0x96d0c9b8c9a1e3ce 00002000:00100000:0.0:1788201442.856613:0:100688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6e293f14-c501-4bc5-9dd4-a18ef02756b4/ffff8dc003b68800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788201442.856632:0:100688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788201442.856708:0:100688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788201442.856738:0:100688:0:(import.c:65:import_set_state_nolock()) ffff8dc003b6b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201442.856811:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695534720:12345-192.168.201.20@tcp:8:lfs.0 Request processed in 289us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201442.856819:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 49 00000100:00100000:2.0:1788201442.866096:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201442.866216:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695534848 00000100:00100000:3.0:1788201442.866227:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695534848 00000100:00100000:3.0:1788201442.866295:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 49 00000100:00100000:3.0:1788201442.866306:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12580b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:76674:x1875060695534848:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:3.0:1788201442.866344:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788201442.866421:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12580b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:76674:x1875060695534848:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 116us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201442.866429:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 49 00000100:00080000:1.0:1788201442.866558:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788201443.346170:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201443.663982:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc125809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715391232:0@lo:400:kworker.0 00000100:00100000:2.0:1788201443.664104:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715391488:0@lo:400:kworker.0 00000100:00100000:3.0:1788201443.664136:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201443.664281:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12580a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715391104:0@lo:400:kworker.0 00000100:00100000:1.0:1788201443.664417:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715391360:0@lo:400:kworker.0 00000100:00100000:2.0:1788201443.666856:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201443.668749:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715392000:0@lo:400:kworker.0 00000100:00100000:2.0:1788201443.668841:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201443.668886:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715392512:0@lo:400:kworker.0 00000100:00100000:2.0:1788201443.668915:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201443.668987:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715391488 00000100:00100000:2.0:1788201443.668997:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715391488 00000100:00100000:2.0:1788201443.669077:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715392512 00000100:00100000:2.0:1788201443.669081:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715392512 00000100:00100000:2.0:1788201443.669102:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788201443.669110:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715391488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201443.669166:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715391488:12345-0@lo:400:kworker.0 Request processed in 56us (2315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201443.669173:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788201443.669189:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788201443.669195:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715392512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201443.669221:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715392512:12345-0@lo:400:kworker.0 Request processed in 27us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201443.669227:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788201443.669251:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715392000 00000100:00100000:2.0:1788201443.669254:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715392000 00000100:00100000:2.0:1788201443.669282:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1754 00000100:00100000:2.0:1788201443.669288:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715392000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201443.669332:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715392000:12345-0@lo:400:kworker.0 Request processed in 44us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201443.669356:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1754 00000100:00100000:2.0:1788201443.669400:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715391488:0@lo:400:kworker.0 00000100:00100000:2.0:1788201443.669412:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715392000:0@lo:400:kworker.0 00000100:00100000:2.0:1788201443.669422:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715392512:0@lo:400:kworker.0 00000100:00100000:2.0:1788201443.670789:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715391232 00000100:00100000:2.0:1788201443.670799:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715391232 00000100:00100000:2.0:1788201443.670844:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788201443.670852:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13336a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715391232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201443.670987:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13336a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715391232:12345-0@lo:400:kworker.0 Request processed in 64us (6783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201443.670996:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788201443.671122:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201443.671128:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201443.674462:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc125809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715391232:0@lo:400:kworker.0 00000100:00100000:3.0:1788201443.674517:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715391744:0@lo:400:kworker.0 00000100:00100000:3.0:1788201443.674626:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201443.674667:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715392256:0@lo:400:kworker.0 00000100:00100000:3.0:1788201443.674695:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201443.674721:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715392768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201443.674744:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201443.674790:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715392256 00000100:00100000:3.0:1788201443.674798:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715392256 00000100:00100000:3.0:1788201443.674847:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715392768 00000100:00100000:3.0:1788201443.674850:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715392768 00000100:00100000:3.0:1788201443.674867:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788201443.674876:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715392256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201443.674948:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715392256:12345-0@lo:400:kworker.0 Request processed in 73us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201443.674984:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788201443.675003:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788201443.675009:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715392768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201443.675067:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444921344 avail 1298681856 00000100:00100000:3.0:1788201443.675105:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715392768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201443.675111:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788201443.675148:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715392768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201443.675170:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715392256:0@lo:400:kworker.0 00000100:00100000:2.0:1788201443.678179:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715391744 00000100:00100000:2.0:1788201443.678198:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715391744 00000100:00100000:2.0:1788201443.678286:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1755 00000100:00100000:2.0:1788201443.678307:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13336b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715391744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201443.678424:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13336b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715391744:12345-0@lo:400:kworker.0 Request processed in 130us (3799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201443.678431:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1755 00000100:00080000:2.0:1788201443.678454:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201443.680792:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715391744:0@lo:400:kworker.0 00000100:00100000:0.0:1788201443.680887:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201443.680956:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715391616:0@lo:400:kworker.0 00000100:00100000:0.0:1788201443.681000:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201443.681049:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715392128:0@lo:400:kworker.0 00000100:00100000:0.0:1788201443.681072:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201443.681100:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715391616 00000100:00100000:0.0:1788201443.681107:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715391616 00000100:00100000:0.0:1788201443.681149:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715392128 00000100:00100000:0.0:1788201443.681152:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715392128 00000100:00100000:0.0:1788201443.681182:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1756 00000100:00100000:0.0:1788201443.681190:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715391616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201443.681235:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715391616:12345-0@lo:400:kworker.0 Request processed in 47us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201443.681258:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1756 00000100:00100000:0.0:1788201443.681275:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1757 00000100:00100000:0.0:1788201443.681281:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715392128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201443.681325:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715392128:12345-0@lo:400:kworker.0 Request processed in 44us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201443.681331:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1757 00000100:00080000:0.0:1788201443.681349:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201443.681373:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715392128:0@lo:400:kworker.0 00000100:00100000:0.0:1788201443.681381:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715392640:0@lo:400:kworker.0 00000100:00100000:0.0:1788201443.681408:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201443.681431:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715392640 00000100:00100000:0.0:1788201443.681435:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715392640 00000100:00100000:0.0:1788201443.681458:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1758 00000100:00100000:0.0:1788201443.681463:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715392640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201443.681491:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715392640:12345-0@lo:400:kworker.0 Request processed in 28us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201443.681496:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1758 00000100:00100000:0.0:1788201443.681520:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715392640:0@lo:400:kworker.0 00000100:00100000:0.0:1788201443.681541:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715391616:0@lo:400:kworker.0 00000100:00100000:2.0:1788201443.681676:0:102459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715391104 00000100:00100000:2.0:1788201443.681680:0:102459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715391104 00000100:00100000:2.0:1788201443.681717:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788201443.681724:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715391104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201443.681782:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715391104:12345-0@lo:400:kworker.0 Request processed in 58us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201443.681788:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788201443.682200:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12580a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715391104:0@lo:400:kworker.0 00000100:00100000:1.0:1788201443.687691:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201443.687767:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715391872:0@lo:400:kworker.0 00000100:00100000:1.0:1788201443.687816:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201443.687847:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715392384:0@lo:400:kworker.0 00000100:00100000:1.0:1788201443.687873:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201443.688046:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715391872 00000100:00100000:0.0:1788201443.688055:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715391872 00000100:00100000:0.0:1788201443.688112:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1759 00000100:00100000:0.0:1788201443.688122:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715391872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201443.688175:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715391872:12345-0@lo:400:kworker.0 Request processed in 55us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201443.688189:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1759 00000100:00080000:0.0:1788201443.688215:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201443.688564:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715392896:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201443.688595:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201443.688659:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715391872:0@lo:400:kworker.0 00000100:00100000:0.0:1788201443.688829:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715392896 00000100:00100000:0.0:1788201443.688833:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715392896 00000100:00100000:0.0:1788201443.688874:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788201443.688881:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715392896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201443.688913:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445371904 avail 1299132416 00000100:00100000:0.0:1788201443.688967:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715392896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201443.688973:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788201443.693356:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715392896:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201443.693833:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715391360 00000100:00100000:2.0:1788201443.693841:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715391360 00000100:00100000:2.0:1788201443.693887:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715392384 00000100:00100000:2.0:1788201443.693891:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715392384 00000100:00100000:2.0:1788201443.693944:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788201443.693954:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715391360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201443.694055:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715391360:12345-0@lo:400:kworker.0 Request processed in 101us (6371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201443.694062:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788201443.694078:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788201443.694085:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715392384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201443.694113:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715392384:12345-0@lo:400:kworker.0 Request processed in 29us (6239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201443.694119:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788201443.696505:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201443.696566:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715391360:0@lo:400:kworker.0 00000100:00100000:1.0:1788201443.696584:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715392384:0@lo:400:kworker.0 00000100:00100000:0.0:1788201444.175448:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201444.175471:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13336aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715393024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201444.175548:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201444.175617:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715393024 00000100:00100000:0.0:1788201444.175625:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715393024 00000100:00100000:0.0:1788201444.175674:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201444.175684:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715393024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201444.175707:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788201444.175751:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715393024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201444.175759:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201444.175806:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13336aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715393024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201444.175925:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715393152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201444.175960:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201444.176630:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715393152 00000100:00100000:0.0:1788201444.176638:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715393152 00000100:00100000:0.0:1788201444.176674:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788201444.176682:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715393152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201444.176720:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201444.176773:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715393152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201444.176780:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788201444.176817:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715393152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201444.311335:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201444.311382:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201444.311403:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201444.311426:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201444.311447:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201444.311478:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695535488 00000100:00100000:2.0:1788201444.311489:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695535488 00000100:00100000:2.0:1788201444.311554:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695535360 00000100:00100000:2.0:1788201444.311556:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695535360 00000100:00100000:2.0:1788201444.311578:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 51 00000100:00100000:2.0:1788201444.311589:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695535488:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201444.311680:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695535488:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 92us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201444.311689:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 51 00000100:00100000:2.0:1788201444.311707:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 52 00000100:00100000:2.0:1788201444.311715:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695535360:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201444.311739:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695535360:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201444.311745:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 52 00000100:00080000:2.0:1788201444.311764:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201444.311768:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201444.312062:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695534976 00000100:00100000:1.0:1788201444.312067:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695534976 00000100:00100000:1.0:1788201444.312098:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 76 00000100:00100000:1.0:1788201444.312105:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695534976:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201444.312138:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695534976:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 34us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201444.312145:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 76 00000100:00100000:0.0:1788201444.312361:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695535232 00000100:00100000:0.0:1788201444.312366:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695535232 00000100:00100000:0.0:1788201444.312405:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695535104 00000100:00100000:0.0:1788201444.312407:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695535104 00000100:00100000:0.0:1788201444.312427:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1760 00000100:00100000:0.0:1788201444.312434:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2402:x1875060695535232:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201444.312468:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2402:x1875060695535232:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 35us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201444.312475:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1760 00000100:00100000:0.0:1788201444.312488:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1761 00000100:00100000:0.0:1788201444.312495:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2402:x1875060695535104:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201444.312517:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2402:x1875060695535104:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 24us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201444.312523:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1761 00000100:00080000:0.0:1788201444.312545:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201444.312548:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788201444.370558:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788201444.691385:0:100576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000001:00080000:0.0:1788201444.691415:0:100576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1788201444.692082:0:99761:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000001:00080000:2.0:1788201444.692094:0:99761:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901910 is committed 00010000:00010000:0.0:1788201445.391388:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201446.263151:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201446.263183:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715393280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201446.275686:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201446.276648:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715393280 00000100:00100000:3.0:1788201446.276663:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715393280 00000100:00100000:3.0:1788201446.276763:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1788201446.276799:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201446.286245:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715393280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201446.286315:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788201446.286454:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715393280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 234us (10780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201446.298372:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715393280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201446.300845:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:3.0:1788201446.420538:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201447.258795:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201447.258828:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13336aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715393408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201447.258920:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201447.259294:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715393408 00000100:00100000:3.0:1788201447.259307:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715393408 00000100:00100000:3.0:1788201447.259396:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788201447.259409:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715393408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201447.259451:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201447.259520:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715393408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201447.259529:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788201447.259604:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13336aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715393408:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788201447.259758:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788201447.441363:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201448.463313:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201448.783398:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715393664:0@lo:400:kworker.0 00000100:00100000:2.0:1788201448.783482:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715393792:0@lo:400:kworker.0 00000100:00100000:3.0:1788201448.783562:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715393536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201448.783667:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715393920:0@lo:400:kworker.0 00000100:00100000:1.0:1788201448.784335:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201448.785785:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201448.785852:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715394304:0@lo:400:kworker.0 00000100:00100000:2.0:1788201448.785907:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201448.785931:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715394816:0@lo:400:kworker.0 00000100:00100000:2.0:1788201448.785975:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201448.786013:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715395328:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201448.786054:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201448.786077:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788201448.786084:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715394176:0@lo:400:kworker.0 00000100:00100000:2.0:1788201448.786106:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201448.787891:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715394688:0@lo:400:kworker.0 00000100:00100000:2.0:1788201448.787965:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201448.787994:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715395200:0@lo:400:kworker.0 00000100:00100000:2.0:1788201448.788636:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201448.788746:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201448.788765:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715394048:0@lo:400:kworker.0 00000100:00100000:3.0:1788201448.788794:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201448.788814:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715394560:0@lo:400:kworker.0 00000100:00100000:3.0:1788201448.788850:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201448.788870:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715395072:0@lo:400:kworker.0 00000100:00100000:3.0:1788201448.788895:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201448.788953:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715393792 00000100:00100000:3.0:1788201448.788964:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715393792 00000100:00100000:3.0:1788201448.791327:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715394816 00000100:00100000:3.0:1788201448.791344:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715394816 00000100:00100000:3.0:1788201448.791381:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715395328 00000100:00100000:3.0:1788201448.791383:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715395328 00000100:00100000:3.0:1788201448.791396:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715393536 00000100:00100000:3.0:1788201448.791398:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715393536 00000100:00100000:3.0:1788201448.791416:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788201448.791427:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3658:x1875060715393792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201448.791631:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788201448.791643:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715394816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201448.791724:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715394816:12345-0@lo:400:kworker.0 Request processed in 84us (5748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201448.791731:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788201448.791755:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788201448.791760:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715395328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201448.791788:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445371904 avail 1299132416 00000100:00100000:2.0:1788201448.791819:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715395328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (5764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201448.791824:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788201448.791835:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788201448.791840:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13336aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3656:x1875060715393536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201448.791854:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444921344 avail 1298681856 00000100:00100000:2.0:1788201448.791893:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13336aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3656:x1875060715393536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (3148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201448.791899:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788201448.791932:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715394304 00000100:00100000:2.0:1788201448.791936:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715394304 00000100:00100000:2.0:1788201448.791971:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715394176 00000100:00100000:2.0:1788201448.791973:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715394176 00000100:00100000:2.0:1788201448.791982:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715394688 00000100:00100000:2.0:1788201448.791984:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715394688 00000100:00100000:2.0:1788201448.791995:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715395200 00000100:00100000:2.0:1788201448.791998:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715395200 00000100:00100000:2.0:1788201448.792005:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715394560 00000100:00100000:2.0:1788201448.792008:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715394560 00000100:00100000:2.0:1788201448.792039:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1762 00000100:00100000:2.0:1788201448.792044:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715394304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201448.792077:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715394304:12345-0@lo:400:kworker.0 Request processed in 33us (6170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201448.792082:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1762 00000100:00100000:2.0:1788201448.792093:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1763 00000100:00100000:2.0:1788201448.792098:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715394176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201448.792657:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715393792:12345-0@lo:400:kworker.0 Request processed in 1228us (6875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201448.792667:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788201448.792750:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201448.792804:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715394432:0@lo:400:kworker.0 00000100:00100000:3.0:1788201448.792830:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1764 00000100:00100000:0.0:1788201448.792842:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201448.792842:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715394688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201448.792857:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715394944:0@lo:400:kworker.0 00000100:00100000:0.0:1788201448.792877:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201448.792883:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715394688:12345-0@lo:400:kworker.0 Request processed in 45us (4918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201448.792889:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1764 00000100:00100000:3.0:1788201448.792903:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715394432 00000100:00100000:3.0:1788201448.792909:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715394432 00000100:00100000:3.0:1788201448.792934:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1765 00000100:00100000:3.0:1788201448.792940:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715395200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201448.794818:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1766 00000100:00100000:0.0:1788201448.794839:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715394560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201448.796198:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715394560:12345-0@lo:400:kworker.0 Request processed in 1053us (7031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201448.796229:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1766 00000100:00100000:0.0:1788201448.796275:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1767 00000100:00100000:0.0:1788201448.796288:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715394432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201448.796362:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715394432:12345-0@lo:400:kworker.0 Request processed in 80us (3519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201448.796368:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1767 00000100:00100000:0.0:1788201448.796402:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715393664 00000100:00100000:0.0:1788201448.796411:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715393664 00000100:00100000:0.0:1788201448.796467:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788201448.796473:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715393664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201448.796507:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715393664:12345-0@lo:400:kworker.0 Request processed in 34us (12176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201448.796512:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788201448.796667:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715393664:0@lo:400:kworker.0 00000100:00100000:1.0:1788201448.796744:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715394048 00000100:00100000:1.0:1788201448.796748:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715394048 00000100:00100000:1.0:1788201448.796786:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715395072 00000100:00100000:1.0:1788201448.796789:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715395072 00000100:00100000:1.0:1788201448.796808:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715393920 00000100:00100000:1.0:1788201448.796810:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715393920 00000100:00100000:1.0:1788201448.796848:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715394944 00000100:00100000:1.0:1788201448.796851:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715394944 00000100:00100000:1.0:1788201448.796872:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788201448.796878:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12580a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715394048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201448.796988:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12580a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715394048:12345-0@lo:400:kworker.0 Request processed in 110us (8193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201448.796995:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788201448.797010:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788201448.797039:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715395072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201448.797070:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715395072:12345-0@lo:400:kworker.0 Request processed in 55us (8174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201448.797076:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788201448.797086:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788201448.797092:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715393920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201448.797121:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715393920:12345-0@lo:400:kworker.0 Request processed in 29us (4371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201448.797127:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788201448.797137:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201448.797143:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715394944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201448.797170:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715394944:12345-0@lo:400:kworker.0 Request processed in 28us (4292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201448.797176:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201448.797354:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715393920:0@lo:400:kworker.0 00000100:00100000:1.0:1788201448.797369:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715394432:0@lo:400:kworker.0 00000100:00100000:1.0:1788201448.797381:0:3655:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901910 gen 2 00000100:00100000:1.0:1788201448.797407:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715394944:0@lo:400:kworker.0 00000100:00080000:1.0:1788201448.797487:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201448.797492:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201448.797495:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201448.797498:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201448.798834:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715393536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201448.798854:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715394048:0@lo:400:kworker.0 00000100:00100000:1.0:1788201448.798868:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715394560:0@lo:400:kworker.0 00000100:00100000:1.0:1788201448.798881:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788201448.799263:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715394176:12345-0@lo:400:kworker.0 Request processed in 7159us (13150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201448.799276:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1763 00000100:00100000:0.0:1788201448.799305:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715394176:0@lo:400:kworker.0 00000100:00100000:0.0:1788201448.799320:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715394688:0@lo:400:kworker.0 00000100:00100000:0.0:1788201448.799368:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715395328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201448.799381:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715393792:0@lo:400:kworker.0 00000100:00100000:0.0:1788201448.799394:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715394304:0@lo:400:kworker.0 00000100:00100000:0.0:1788201448.799404:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715394816:0@lo:400:kworker.0 00000100:00100000:1.0:1788201448.799488:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715395072:0@lo:400:kworker.0 00000100:00100000:3.0:1788201448.799498:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715395200:12345-0@lo:400:kworker.0 Request processed in 6556us (10863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201448.799506:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1765 00000100:00100000:0.0:1788201448.800680:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715395200:0@lo:400:kworker.0 00000100:00100000:1.0:1788201449.296779:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201449.296804:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715395456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201449.296894:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201449.297137:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715395456 00000100:00100000:2.0:1788201449.297146:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715395456 00000100:00100000:2.0:1788201449.297215:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788201449.297226:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715395456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201449.297257:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201449.297312:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715395456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201449.297333:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788201449.297379:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715395456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201449.301844:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201449.301867:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715395584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201449.301940:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201449.302866:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715395584 00000100:00100000:3.0:1788201449.302876:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715395584 00000100:00100000:3.0:1788201449.302924:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788201449.302933:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715395584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201449.302964:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201449.303049:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715395584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201449.303121:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715395584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201449.305035:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788201449.433012:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201449.433075:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201449.433102:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201449.433122:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201449.433146:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201449.433174:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695535872 00000100:00100000:1.0:1788201449.433185:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695535872 00000100:00100000:1.0:1788201449.433255:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695535744 00000100:00100000:1.0:1788201449.433258:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695535744 00000100:00100000:1.0:1788201449.433292:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1768 00000100:00100000:1.0:1788201449.433317:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2403:x1875060695535872:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201449.433397:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2403:x1875060695535872:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 82us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201449.433405:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1768 00000100:00100000:1.0:1788201449.433424:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1769 00000100:00100000:1.0:1788201449.433430:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2403:x1875060695535744:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201449.433455:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2403:x1875060695535744:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201449.433461:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1769 00000100:00100000:1.0:1788201449.433483:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695536128 00000100:00100000:1.0:1788201449.433487:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695536128 00000100:00100000:1.0:1788201449.433513:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695536000 00000100:00100000:1.0:1788201449.433516:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695536000 00000100:00100000:1.0:1788201449.433548:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 57 00000100:00100000:1.0:1788201449.433556:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695536128:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201449.433584:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695536128:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 30us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201449.433590:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 57 00000100:00100000:1.0:1788201449.433602:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 58 00000100:00100000:1.0:1788201449.433607:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a443800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695536000:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201449.433627:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a443800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695536000:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 21us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201449.433632:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 58 00000100:00080000:1.0:1788201449.433653:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201449.433663:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201449.433666:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201449.433668:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201449.433706:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695535616 00000100:00100000:3.0:1788201449.433714:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695535616 00000100:00100000:3.0:1788201449.433753:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 78 00000100:00100000:3.0:1788201449.433761:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695535616:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201449.433810:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695535616:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 50us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201449.433816:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 78 00010000:00010000:1.0:1788201449.490113:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201449.921794:0:103030:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:3.0:1788201450.511397:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201451.344238:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715395712:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201451.344328:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201451.344869:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715395712 00000100:00100000:2.0:1788201451.344880:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715395712 00000100:00100000:2.0:1788201451.344965:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788201451.344978:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715395712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201451.345009:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201451.345095:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715395712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201451.345103:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788201451.345372:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201451.345412:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715395712:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788201451.541301:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201451.839458:0:103078:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:0.0:1788201452.367353:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715395840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201452.367437:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201452.367593:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715395840 00000100:00100000:3.0:1788201452.367603:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715395840 00000100:00100000:3.0:1788201452.367673:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788201452.367683:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715395840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201452.367711:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201452.367768:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715395840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201452.367776:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788201452.367879:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715395840:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788201452.368192:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788201452.560404:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201453.583297:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201453.904788:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715395968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201453.904867:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201453.905186:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715396224:0@lo:400:kworker.0 00000100:00100000:1.0:1788201453.905219:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201453.905236:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715396736:0@lo:400:kworker.0 00000100:00100000:1.0:1788201453.905262:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201453.905290:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715397248:0@lo:400:kworker.0 00000100:00100000:3.0:1788201453.905305:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715395968 00000100:00100000:1.0:1788201453.905322:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201453.905333:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715395968 00000100:00100000:1.0:1788201453.905347:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788201453.905355:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715396352:0@lo:400:kworker.0 00000100:00100000:1.0:1788201453.905390:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201453.905428:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715396224 00000100:00100000:3.0:1788201453.905434:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715396224 00000100:00100000:3.0:1788201453.905459:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788201453.905472:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715395968:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201453.905534:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715396480:0@lo:400:kworker.0 00000004:00000024:3.0:1788201453.905536:0:66317:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445371904 avail 1299132416 00000100:00100000:0.0:1788201453.905636:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788201453.905652:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715396224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201453.908512:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201453.909247:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715396992:0@lo:400:kworker.0 00000100:00100000:2.0:1788201453.909298:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201453.909323:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715397504:0@lo:400:kworker.0 00000100:00100000:2.0:1788201453.909344:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201453.909373:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788201453.909379:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a442300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715396096:0@lo:400:kworker.0 00000100:00100000:1.0:1788201453.910231:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715397248 00000100:00100000:1.0:1788201453.910241:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715397248 00000100:00100000:1.0:1788201453.910307:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715396352 00000100:00100000:1.0:1788201453.910311:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715396352 00000100:00100000:1.0:1788201453.910327:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715396480 00000100:00100000:1.0:1788201453.910330:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715396480 00000100:00100000:1.0:1788201453.910352:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788201453.910362:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715397248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201453.910969:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201453.911033:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715396608:0@lo:400:kworker.0 00000100:00100000:2.0:1788201453.911092:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201453.911113:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715397120:0@lo:400:kworker.0 00000100:00100000:2.0:1788201453.911146:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201453.911163:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715397632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201453.911186:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201453.911214:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715396736 00000100:00100000:2.0:1788201453.911219:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715396736 00000100:00100000:2.0:1788201453.911249:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715396992 00000100:00100000:2.0:1788201453.911253:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715396992 00000100:00100000:2.0:1788201453.911271:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715397504 00000100:00100000:2.0:1788201453.911274:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715397504 00000100:00100000:2.0:1788201453.911284:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715396608 00000100:00100000:2.0:1788201453.911286:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715396608 00000100:00100000:2.0:1788201453.911295:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715397120 00000100:00100000:2.0:1788201453.911296:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715397120 00000100:00100000:2.0:1788201453.911311:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1770 00000100:00100000:2.0:1788201453.911318:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715396736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201453.911362:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715396736:12345-0@lo:400:kworker.0 Request processed in 43us (6098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201453.911369:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1770 00000100:00100000:2.0:1788201453.911386:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1771 00000100:00100000:2.0:1788201453.911393:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715396992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201453.911564:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715397248:12345-0@lo:400:kworker.0 Request processed in 1202us (6241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201453.911572:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788201453.911590:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788201453.911605:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715396352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201453.911637:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715396352:12345-0@lo:400:kworker.0 Request processed in 35us (6250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201453.911643:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788201453.911655:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788201453.911662:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715396480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201453.911694:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715396480:12345-0@lo:400:kworker.0 Request processed in 33us (3191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201453.911700:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788201453.911726:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1772 00000100:00100000:1.0:1788201453.911733:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715397504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201453.911772:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715397504:12345-0@lo:400:kworker.0 Request processed in 39us (2427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201453.911778:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1772 00000100:00100000:1.0:1788201453.911793:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1773 00000100:00100000:1.0:1788201453.911799:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715396608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201453.911828:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715396608:12345-0@lo:400:kworker.0 Request processed in 29us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201453.911834:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1773 00000100:00100000:1.0:1788201453.911859:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1774 00000100:00100000:1.0:1788201453.911866:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715397120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201453.911896:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715397120:12345-0@lo:400:kworker.0 Request processed in 31us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201453.911901:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1774 00000100:00100000:1.0:1788201453.912049:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715396352:0@lo:400:kworker.0 00000100:00100000:1.0:1788201453.912065:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715396864:0@lo:400:kworker.0 00000100:00100000:1.0:1788201453.912093:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201453.912114:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715396864 00000100:00100000:1.0:1788201453.912129:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715396864 00000100:00100000:1.0:1788201453.912152:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1775 00000100:00100000:1.0:1788201453.912158:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715396864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201453.912187:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715396864:12345-0@lo:400:kworker.0 Request processed in 29us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201453.912194:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1775 00000100:00100000:1.0:1788201453.912216:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715396864:0@lo:400:kworker.0 00000100:00100000:1.0:1788201453.912223:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715397376:0@lo:400:kworker.0 00000100:00100000:1.0:1788201453.912246:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201453.912267:0:101189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715397376 00000100:00100000:1.0:1788201453.912271:0:101189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715397376 00000100:00100000:1.0:1788201453.912297:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788201453.912304:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715397376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201453.912338:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715397376:12345-0@lo:400:kworker.0 Request processed in 34us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201453.912344:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788201453.912375:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715397376:0@lo:400:kworker.0 00000100:00100000:1.0:1788201453.912393:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715396736:0@lo:400:kworker.0 00000100:00100000:3.0:1788201453.912438:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715395968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6958us (7560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201453.912456:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788201453.912494:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715397632 00000100:00100000:3.0:1788201453.912513:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715397632 00000100:00100000:3.0:1788201453.912545:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788201453.912553:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3655:x1875060715397632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201453.912620:0:66317:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444921344 avail 1298681856 00000100:00100000:3.0:1788201453.912671:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3655:x1875060715397632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201453.912678:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788201453.912799:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201453.913783:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695536256 00000100:00100000:3.0:1788201453.913794:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695536256 00000100:00100000:3.0:1788201453.913985:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1732 00000100:00100000:3.0:1788201453.913996:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:77143:x1875060695536256:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:3.0:1788201453.914043:0:69485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444921344 avail 1298681856 00000100:00100000:3.0:1788201453.914276:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:77143:x1875060695536256:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 270us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201453.914285:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1732 00000100:00100000:3.0:1788201453.914315:0:102453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715396096 00000100:00100000:3.0:1788201453.914320:0:102453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715396096 00000100:00100000:3.0:1788201453.914352:0:102453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788201453.914359:0:102453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715396096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201453.914413:0:102453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715396096:12345-0@lo:400:kworker.0 Request processed in 55us (5006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201453.914420:0:102453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788201453.914977:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a442300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715396096:0@lo:400:kworker.0 00000100:00100000:3.0:1788201453.915003:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715396608:0@lo:400:kworker.0 00000100:00100000:3.0:1788201453.915046:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715397120:0@lo:400:kworker.0 00000100:00100000:3.0:1788201453.915070:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715397632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201453.915129:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715396480:0@lo:400:kworker.0 00000100:00100000:3.0:1788201453.915144:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715397504:0@lo:400:kworker.0 00000100:00100000:3.0:1788201453.915162:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715395968:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1788201453.915233:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201453.915239:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201453.915243:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201453.915247:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201453.916785:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715396992:12345-0@lo:400:kworker.0 Request processed in 5381us (7474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201453.916802:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1771 00000100:00100000:1.0:1788201453.917152:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715397248:0@lo:400:kworker.0 00000100:00100000:3.0:1788201453.917465:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715396992:0@lo:400:kworker.0 00000100:00100000:1.0:1788201453.920089:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201453.920223:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695536384 00000100:00100000:3.0:1788201453.920240:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695536384 00000100:00100000:3.0:1788201453.920548:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1733 00000100:00100000:3.0:1788201453.920573:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:77143:x1875060695536384:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:3.0:1788201453.920619:0:69485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445371904 avail 1299132416 00000100:00100000:3.0:1788201453.920718:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:77143:x1875060695536384:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 159us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201453.920726:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1733 00000100:00100000:0.0:1788201453.921736:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715396224:12345-0@lo:400:kworker.0 Request processed in 16083us (16509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201453.921752:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788201453.921977:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715396224:0@lo:400:kworker.0 00000100:00080000:1.0:1788201453.922773:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201453.926114:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201453.926933:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695536512 00000100:00100000:2.0:1788201453.926966:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695536512 00000100:00080000:1.0:1788201453.927070:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201453.927098:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 58 00000100:00100000:2.0:1788201453.927213:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:77143:x1875060695536512:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:2.0:1788201453.927250:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201453.927326:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:77143:x1875060695536512:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 121us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201453.927334:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 58 00000100:00100000:2.0:1788201453.931100:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201453.931564:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695536640 00000100:00100000:1.0:1788201453.931575:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695536640 00000100:00080000:3.0:1788201453.931655:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201453.931978:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 59 00000100:00100000:1.0:1788201453.931990:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:77143:x1875060695536640:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:1.0:1788201453.932052:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201453.933920:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:77143:x1875060695536640:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 1923us (2819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201453.933934:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 59 00000100:00100000:1.0:1788201453.983417:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201453.984549:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695536768 00000100:00100000:2.0:1788201453.984568:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695536768 00000100:00100000:2.0:1788201453.984660:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 743 00000100:00100000:2.0:1788201453.984671:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:71017:x1875060695536768:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201453.984690:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201453.984718:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e3c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786df8 expref: 8 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201453.984741:0:26207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008723a00) 00010000:00010000:2.0:1788201453.984747:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201453.985074:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:71017:x1875060695536768:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 402us (1667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201453.985085:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 743 00000100:00100000:3.0:1788201453.985126:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201453.985211:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695536896 00000100:00100000:2.0:1788201453.985218:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695536896 00000100:00100000:2.0:1788201453.985268:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 744 00000100:00100000:2.0:1788201453.985277:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10a224450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:71018:x1875060695536896:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201453.985287:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 9 locks, starting at 0 00010000:00010000:2.0:1788201453.985316:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc108c75400/0x96d0c9b8c9a1df21 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dd5 expref: 14 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201453.985332:0:26215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x8:0x0].0x0 (ffff8dc004b23800) 00010000:00010000:2.0:1788201453.985348:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1decd lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786db9 expref: 13 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201453.985359:0:26215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x7:0x0].0x0 (ffff8dc108994d00) 00010000:00010000:2.0:1788201453.985370:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1deb1 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786db2 expref: 12 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201453.985380:0:26215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0x0 (ffff8dc006c71800) 00010000:00010000:2.0:1788201453.985390:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0078fc600/0x96d0c9b8c9a1c995 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786967 expref: 11 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201453.985400:0:26215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff8dc1115df600) 00010000:00010000:2.0:1788201453.985419:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1c478 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868f7 expref: 10 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201453.985431:0:26215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x3:0x0].0x0 (ffff8dc107112000) 00010000:00010000:2.0:1788201453.985441:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc100031200/0x96d0c9b8c9a1c948 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78694b expref: 9 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201453.985450:0:26215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff8dc107112e00) 00010000:00010000:2.0:1788201453.985457:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf000/0x96d0c9b8c9a1c41d lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868db expref: 8 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201453.985479:0:26215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x2:0x0].0x0 (ffff8dc1115dfb00) 00010000:00010000:2.0:1788201453.985493:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3a00/0x96d0c9b8c9a1c4a9 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786905 expref: 7 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201453.985501:0:26215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x5:0x0].0x0 (ffff8dc1115df600) 00010000:00010000:2.0:1788201453.985510:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2800/0x96d0c9b8c9a1c44e lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7868e9 expref: 6 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201453.985518:0:26215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x4:0x0].0x0 (ffff8dc107112e00) 00010000:00010000:2.0:1788201453.985523:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201453.985558:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10a224450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:71018:x1875060695536896:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 282us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201453.985565:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 744 00000100:00100000:3.0:1788201454.051740:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201454.051890:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695537024 00000100:00100000:2.0:1788201454.051905:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695537024 00000100:00100000:2.0:1788201454.051987:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1734 00000100:00100000:2.0:1788201454.052001:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:77169:x1875060695537024:12345-192.168.201.20@tcp:101:checkstat.0 00010000:00010000:2.0:1788201454.052067:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201454.052097:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1e3d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786dff expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.052190:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e3dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.052218:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e3dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.052255:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e3dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201454.052314:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788201454.052318:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201454.052366:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e3dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.052394:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1e3d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dff expref: 9 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.052417:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e3dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dff expref: 8 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.052427:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008723a00) 00010000:00010000:2.0:1788201454.052430:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201454.052435:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbd400, rc 0) 00000100:00100000:2.0:1788201454.052521:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:77169:x1875060695537024:12345-192.168.201.20@tcp:101:checkstat.0 Request processed in 522us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201454.052529:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1734 00000100:00100000:0.0:1788201454.057344:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201454.057450:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695537152 00000100:00100000:2.0:1788201454.057464:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695537152 00000100:00100000:2.0:1788201454.057543:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1735 00000100:00100000:2.0:1788201454.057555:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:77169:x1875060695537152:12345-192.168.201.20@tcp:101:checkstat.0 00010000:00010000:2.0:1788201454.057582:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201454.057610:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e3e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786e06 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.057730:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e3ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.057748:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e3ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.057761:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e3ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.057778:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e3f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.057786:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.057792:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201454.057978:0:66312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66312:1875060715397760:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788201454.058088:0:66312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201454.058145:0:66312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105d39480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201454.058417:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715397760 00000100:00100000:0.0:1788201454.058423:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715397760 00000100:00100000:0.0:1788201454.058475:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788201454.058484:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:66312:x1875060715397760:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788201454.058596:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:66312:x1875060715397760:12345-0@lo:1000:mdt00_000.0 Request processed in 113us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201454.058604:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788201454.058733:0:66312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:66312:1875060715397760:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788201454.058792:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1e3f8 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.058805:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1e3f8 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.058813:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1e3f8 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201454.058847:0:66312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1e3f8 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.058863:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e3ea lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.058870:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e3ea lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.058891:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e3ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.058899:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e3ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.058905:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201454.058911:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e3ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.058919:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e3ea lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.058934:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008723a00) 00010000:00010000:2.0:1788201454.058938:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201454.058943:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e3ea lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.058949:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e3ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.058966:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.058977:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e3f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.058983:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e3f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.058989:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201454.058992:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e3f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.058998:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e3f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.059006:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc9f42202 (ffff8dc1421c6d00) 00010000:00010000:2.0:1788201454.059009:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201454.059012:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e3f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.059059:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e3f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.059104:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e3e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e06 expref: 10 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.059129:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1e3f8 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e06 expref: 9 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.059136:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0x0 (ffff8dc1421c6a00) 00010000:00010000:2.0:1788201454.059138:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201454.059147:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbc000, rc 0) 00000100:00100000:2.0:1788201454.059259:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:77169:x1875060695537152:12345-192.168.201.20@tcp:101:checkstat.0 Request processed in 1705us (1929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201454.059266:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1735 00000100:00100000:3.0:1788201454.062440:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201454.062655:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695537280 00000100:00100000:0.0:1788201454.062667:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695537280 00000100:00100000:0.0:1788201454.062741:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1736 00000100:00100000:0.0:1788201454.062752:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:77169:x1875060695537280:12345-192.168.201.20@tcp:101:checkstat.0 00010000:00010000:0.0:1788201454.062777:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201454.062805:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6400/0x96d0c9b8c9a1e3ff lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786e0d expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.062896:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7e00/0x96d0c9b8c9a1e406 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.062912:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7e00/0x96d0c9b8c9a1e406 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.062925:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7e00/0x96d0c9b8c9a1e406 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201454.062987:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x6:0x0]: returning size 4096 00000004:00200000:0.0:1788201454.062992:0:69485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1788201454.063105:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6400/0x96d0c9b8c9a1e3ff lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e0d expref: 7 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.063135:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7e00/0x96d0c9b8c9a1e406 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e0d expref: 6 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.063145:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0x0 (ffff8dc103a9b400) 00010000:00010000:0.0:1788201454.063166:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1788201454.063170:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d7e00, rc 0) 00000100:00100000:0.0:1788201454.063255:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:77169:x1875060695537280:12345-192.168.201.20@tcp:101:checkstat.0 Request processed in 504us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201454.063264:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1736 00000100:00100000:3.0:1788201454.068224:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201454.068413:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695537408 00000100:00100000:1.0:1788201454.068435:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695537408 00000100:00100000:1.0:1788201454.068506:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1737 00000100:00100000:1.0:1788201454.068519:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:77169:x1875060695537408:12345-192.168.201.20@tcp:101:checkstat.0 00010000:00010000:1.0:1788201454.068547:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201454.068573:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1e40d lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786e14 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.068659:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1e414 lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.068676:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1e414 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.068689:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1e414 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.068704:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1e41b lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.068725:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1e41b lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.068732:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1e41b lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.068843:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1e422 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.068852:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1e422 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.068859:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1e422 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201454.068961:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x7:0x0]: returning size 4096 00000004:00200000:1.0:1788201454.068966:0:66313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1788201454.068993:0:66313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1e422 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.069008:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1e414 lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.069048:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1e414 lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.069055:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1e414 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.069062:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1e414 lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.069079:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201454.069084:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1e414 lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.069092:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1e414 lrc: 5/0,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.069108:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0x0 (ffff8dc103a9b400) 00010000:00010000:1.0:1788201454.069112:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201454.069128:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1e414 lrc: 3/0,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.069136:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1e414 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.069155:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1e41b lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.069161:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1e41b lrc: 2/0,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.069168:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1e41b lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.069172:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ece00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201454.069175:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1e41b lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.069181:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1e41b lrc: 4/0,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.069200:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0xd1d4b922 (ffff8dc12f13ab00) 00010000:00010000:1.0:1788201454.069202:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201454.069205:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1e41b lrc: 2/0,0 mode: --/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.069211:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1e41b lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.069254:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1e40d lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e14 expref: 8 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.069270:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1e422 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e14 expref: 7 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.069278:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x7:0x0].0x0 (ffff8dc12f13a700) 00010000:00010000:1.0:1788201454.069281:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201454.069283:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ed800, rc 0) 00000100:00100000:1.0:1788201454.069367:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:77169:x1875060695537408:12345-192.168.201.20@tcp:101:checkstat.0 Request processed in 851us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201454.069376:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1737 00000100:00100000:3.0:1788201454.077581:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201454.077695:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695537536 00000100:00100000:2.0:1788201454.077709:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695537536 00000100:00100000:2.0:1788201454.077791:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1738 00000100:00100000:2.0:1788201454.077803:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:77169:x1875060695537536:12345-192.168.201.20@tcp:101:checkstat.0 00010000:00010000:2.0:1788201454.077835:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201454.077867:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e429 lrc: 2/0,0 mode: --/CR res: [0x2000090a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786e1b expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.077968:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e430 lrc: 3/1,0 mode: --/CR res: [0x2000090a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.077987:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e430 lrc: 3/1,0 mode: CR/CR res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.078002:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e430 lrc: 3/1,0 mode: CR/CR res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.078069:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e437 lrc: 3/1,0 mode: --/PR res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.078077:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e437 lrc: 3/1,0 mode: PR/PR res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.078085:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e437 lrc: 3/1,0 mode: PR/PR res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.078195:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1e43e lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.078224:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1e43e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.078231:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1e43e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201454.078289:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x31:0x0]: returning size 4096 00000004:00200000:2.0:1788201454.078294:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201454.078320:0:66312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1e43e lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.078335:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e430 lrc: 4/1,0 mode: CR/CR res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.078342:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e430 lrc: 4/1,0 mode: CR/CR res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.078348:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e430 lrc: 3/0,0 mode: CR/CR res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.078355:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e430 lrc: 4/0,0 mode: CR/CR res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.078361:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201454.078367:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e430 lrc: 4/0,0 mode: CR/CR res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.078374:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e430 lrc: 5/0,0 mode: CR/CR res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.078389:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x6:0x0].0x0 (ffff8dc1421c6d00) 00010000:00010000:2.0:1788201454.078398:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201454.078404:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e430 lrc: 3/0,0 mode: --/CR res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.078411:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e430 lrc: 0/0,0 mode: --/CR res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.078427:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e437 lrc: 3/1,0 mode: PR/PR res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.078433:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e437 lrc: 2/0,0 mode: PR/PR res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.078439:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e437 lrc: 3/0,0 mode: PR/PR res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.078444:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201454.078447:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e437 lrc: 3/0,0 mode: PR/PR res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.078454:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e437 lrc: 4/0,0 mode: PR/PR res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.078461:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x6:0x0].0xcd52553e (ffff8dc1421c6700) 00010000:00010000:2.0:1788201454.078464:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201454.078467:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e437 lrc: 2/0,0 mode: --/PR res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.078473:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e437 lrc: 0/0,0 mode: --/PR res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.078513:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e429 lrc: 0/0,0 mode: --/CR res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e1b expref: 11 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.078544:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1e43e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e1b expref: 10 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.078551:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x31:0x0].0x0 (ffff8dc12196e700) 00010000:00010000:2.0:1788201454.078554:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201454.078556:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbd600, rc 0) 00000100:00100000:2.0:1788201454.078629:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:77169:x1875060695537536:12345-192.168.201.20@tcp:101:checkstat.0 Request processed in 828us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201454.078637:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1738 00000100:00100000:0.0:1788201454.106356:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201454.106470:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695537792 00000100:00100000:2.0:1788201454.106482:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695537792 00000100:00100000:2.0:1788201454.106555:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1739 00000100:00100000:2.0:1788201454.106565:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:77173:x1875060695537792:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1788201454.106593:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201454.106618:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e445 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786e22 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201454.106755:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x31:0x0]: returning size 4096 00010000:00010000:2.0:1788201454.106918:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e445 lrc: 1/0,0 mode: --/CR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e22 expref: 12 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.106936:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x31:0x0].0x0 (ffff8dc12196e700) 00010000:00010000:2.0:1788201454.106940:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201454.106951:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e445 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e22 expref: 12 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.106995:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbc600, rc 0) 00000100:00100000:2.0:1788201454.107160:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:77173:x1875060695537792:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 595us (820us total) trans 128849018881 rc 301/301 00000100:00100000:2.0:1788201454.107168:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1739 00000100:00100000:3.0:1788201454.114688:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201454.114834:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695537920 00000100:00100000:0.0:1788201454.114853:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695537920 00000100:00100000:0.0:1788201454.114942:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 290 00000100:00100000:0.0:1788201454.114954:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:77173:x1875060695537920:12345-192.168.201.20@tcp:33:lfs.0 00000004:00200000:0.0:1788201454.115152:0:66315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x31:0x0]: returning size 4096 00000004:00200000:0.0:1788201454.115158:0:66315:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1788201454.115296:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:77173:x1875060695537920:12345-192.168.201.20@tcp:33:lfs.0 Request processed in 342us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201454.115304:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 290 00000100:00100000:3.0:1788201454.120309:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201454.120586:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695538176 00000100:00100000:1.0:1788201454.120600:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695538176 00000100:00100000:1.0:1788201454.120675:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 291 00000100:00100000:1.0:1788201454.120688:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:77173:x1875060695538176:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:1.0:1788201454.121062:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:77173:x1875060695538176:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 375us (768us total) trans 128849018882 rc 0/0 00000100:00100000:1.0:1788201454.121071:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 291 00000100:00100000:1.0:1788201454.163715:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201454.164070:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695538432 00000100:00100000:3.0:1788201454.164085:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695538432 00000100:00100000:3.0:1788201454.164166:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1740 00000100:00100000:3.0:1788201454.164178:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:77176:x1875060695538432:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1788201454.164212:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201454.164238:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e453 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786e29 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.164392:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e45a lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.164411:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e45a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.164436:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e45a lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201454.164450:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x31:0x0]: returning size 4096 00010000:00010000:3.0:1788201454.164578:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e453 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e29 expref: 15 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.164598:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e45a lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e29 expref: 14 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.164608:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x31:0x0].0x0 (ffff8dc12196e700) 00010000:00010000:3.0:1788201454.164612:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788201454.164615:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2a00, rc 0) 00000100:00100000:3.0:1788201454.164682:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:77176:x1875060695538432:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 507us (983us total) trans 128849018883 rc 0/0 00000100:00100000:3.0:1788201454.164708:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1740 00000100:00100000:3.0:1788201454.175092:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201454.175279:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695538560 00000100:00100000:2.0:1788201454.175296:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695538560 00000100:00100000:2.0:1788201454.175371:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 292 00000100:00100000:2.0:1788201454.175384:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107db5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:77176:x1875060695538560:12345-192.168.201.20@tcp:33:lfs.0 00000004:00200000:2.0:1788201454.175523:0:79137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x31:0x0]: returning size 4096 00000004:00200000:2.0:1788201454.175528:0:79137:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1788201454.175623:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107db5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:77176:x1875060695538560:12345-192.168.201.20@tcp:33:lfs.0 Request processed in 241us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201454.175632:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 292 00000100:00100000:0.0:1788201454.191823:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201454.191975:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695538688 00000100:00100000:3.0:1788201454.191987:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695538688 00000100:00100000:3.0:1788201454.192100:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1741 00000100:00100000:3.0:1788201454.192139:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:77178:x1875060695538688:12345-192.168.201.20@tcp:101:checkstat.0 00010000:00010000:3.0:1788201454.192169:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201454.192201:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e468 lrc: 2/0,0 mode: --/CR res: [0x2400088d0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786e30 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192302:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e46f lrc: 3/1,0 mode: --/CR res: [0x2400088d0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192320:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e46f lrc: 3/1,0 mode: CR/CR res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192333:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e46f lrc: 3/1,0 mode: CR/CR res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192348:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e476 lrc: 3/1,0 mode: --/PR res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192356:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e476 lrc: 3/1,0 mode: PR/PR res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192362:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e476 lrc: 3/1,0 mode: PR/PR res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192480:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e47d lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192508:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e47d lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192515:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e47d lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201454.192571:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x8:0x0]: returning size 4096 00000004:00200000:3.0:1788201454.192575:0:69485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201454.192602:0:69485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e47d lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192618:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e46f lrc: 4/1,0 mode: CR/CR res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192626:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e46f lrc: 4/1,0 mode: CR/CR res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192633:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e46f lrc: 3/0,0 mode: CR/CR res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192640:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e46f lrc: 4/0,0 mode: CR/CR res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192648:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201454.192653:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e46f lrc: 4/0,0 mode: CR/CR res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192661:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e46f lrc: 5/0,0 mode: CR/CR res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192675:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x6:0x0].0x0 (ffff8dc12196e800) 00010000:00010000:3.0:1788201454.192685:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201454.192691:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e46f lrc: 3/0,0 mode: --/CR res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192699:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e46f lrc: 0/0,0 mode: --/CR res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192716:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e476 lrc: 3/1,0 mode: PR/PR res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192722:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e476 lrc: 2/0,0 mode: PR/PR res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192728:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e476 lrc: 3/0,0 mode: PR/PR res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192733:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201454.192736:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e476 lrc: 3/0,0 mode: PR/PR res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192742:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e476 lrc: 4/0,0 mode: PR/PR res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192749:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x6:0x0].0xf0209d98 (ffff8dc12196e500) 00010000:00010000:3.0:1788201454.192752:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201454.192754:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e476 lrc: 2/0,0 mode: --/PR res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192760:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e476 lrc: 0/0,0 mode: --/PR res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192794:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e468 lrc: 0/0,0 mode: --/CR res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e30 expref: 9 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192822:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e47d lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e30 expref: 8 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.192830:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x8:0x0].0x0 (ffff8dc12196eb00) 00010000:00010000:3.0:1788201454.192832:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201454.192834:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2c00, rc 0) 00000100:00100000:3.0:1788201454.193756:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:77178:x1875060695538688:12345-192.168.201.20@tcp:101:checkstat.0 Request processed in 1636us (1941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201454.193769:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1741 00000100:00100000:0.0:1788201454.211181:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201454.211395:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695538944 00000100:00100000:2.0:1788201454.211409:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695538944 00000100:00100000:2.0:1788201454.211558:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1742 00000100:00100000:2.0:1788201454.211570:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:77179:x1875060695538944:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1788201454.211599:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201454.211626:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e484 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786e37 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201454.211769:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x8:0x0]: returning size 4096 00010000:00010000:2.0:1788201454.212111:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e484 lrc: 1/0,0 mode: --/CR res: [0x2400088d5:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e37 expref: 10 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.212164:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x8:0x0].0x0 (ffff8dc12196eb00) 00010000:00010000:2.0:1788201454.212167:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201454.212173:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e484 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e37 expref: 10 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.212190:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbc600, rc 0) 00000100:00100000:2.0:1788201454.212591:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:77179:x1875060695538944:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 1021us (1425us total) trans 77309411481 rc 301/301 00000100:00100000:2.0:1788201454.212600:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1742 00000100:00100000:0.0:1788201454.216556:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201454.216677:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695539072 00000100:00100000:2.0:1788201454.216692:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695539072 00000100:00100000:2.0:1788201454.216857:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 293 00000100:00100000:2.0:1788201454.216872:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:77179:x1875060695539072:12345-192.168.201.20@tcp:33:lfs.0 00000004:00200000:2.0:1788201454.217046:0:66315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x8:0x0]: returning size 4096 00000004:00200000:2.0:1788201454.217051:0:66315:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1788201454.217671:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:77179:x1875060695539072:12345-192.168.201.20@tcp:33:lfs.0 Request processed in 799us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201454.217680:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 293 00000100:00100000:0.0:1788201454.220749:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201454.220844:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695539328 00000100:00100000:1.0:1788201454.220857:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695539328 00000100:00100000:1.0:1788201454.221065:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 294 00000100:00100000:1.0:1788201454.221077:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:77179:x1875060695539328:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:1.0:1788201454.221632:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:77179:x1875060695539328:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 554us (896us total) trans 77309411482 rc 0/0 00000100:00100000:1.0:1788201454.221641:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 294 00000100:00100000:1.0:1788201454.241322:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201454.241419:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695539584 00000100:00100000:2.0:1788201454.241445:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695539584 00000100:00100000:2.0:1788201454.241526:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1743 00000100:00100000:2.0:1788201454.241539:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:77180:x1875060695539584:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1788201454.241571:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201454.241599:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e492 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786e3e expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.241771:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e499 lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.241789:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e499 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.241804:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e499 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201454.241817:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x8:0x0]: returning size 4096 00010000:00010000:2.0:1788201454.242101:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e492 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e3e expref: 13 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.242146:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e499 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e3e expref: 12 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.242156:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x8:0x0].0x0 (ffff8dc12196eb00) 00010000:00010000:2.0:1788201454.242159:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788201454.242164:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbc800, rc 0) 00000100:00100000:2.0:1788201454.242248:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:77180:x1875060695539584:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 712us (942us total) trans 77309411483 rc 0/0 00000100:00100000:2.0:1788201454.242257:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1743 00000100:00100000:3.0:1788201454.245396:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201454.245927:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695539712 00000100:00100000:0.0:1788201454.245941:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695539712 00000100:00100000:0.0:1788201454.246039:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 295 00000100:00100000:0.0:1788201454.246053:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:77180:x1875060695539712:12345-192.168.201.20@tcp:33:lfs.0 00000004:00200000:0.0:1788201454.246193:0:66315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x8:0x0]: returning size 4096 00000004:00200000:0.0:1788201454.246197:0:66315:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1788201454.246297:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:77180:x1875060695539712:12345-192.168.201.20@tcp:33:lfs.0 Request processed in 246us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201454.246331:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 295 00000100:00100000:3.0:1788201454.257372:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201454.257495:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695539840 00000100:00100000:0.0:1788201454.257509:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695539840 00000100:00100000:0.0:1788201454.257579:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1744 00000100:00100000:0.0:1788201454.257591:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:77181:x1875060695539840:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1788201454.257617:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201454.257645:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1e4a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786e45 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.257726:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6e00/0x96d0c9b8c9a1e4ae lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.257742:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6e00/0x96d0c9b8c9a1e4ae lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.257755:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6e00/0x96d0c9b8c9a1e4ae lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201454.257807:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x6:0x0]: returning size 4096 00000004:00200000:0.0:1788201454.257811:0:69485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201454.257831:0:69485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6e00/0x96d0c9b8c9a1e4ae lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.257859:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1e4a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e45 expref: 14 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.257895:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6e00/0x96d0c9b8c9a1e4ae lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e45 expref: 13 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.257927:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0x0 (ffff8dc103a9b400) 00010000:00010000:0.0:1788201454.257930:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788201454.257934:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d6e00, rc 0) 00000100:00100000:0.0:1788201454.258011:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:77181:x1875060695539840:12345-192.168.201.20@tcp:101:rm.0 Request processed in 422us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201454.258073:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1744 00000100:00100000:1.0:1788201454.261485:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201454.261601:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695540096 00000100:00100000:2.0:1788201454.261615:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695540096 00000100:00100000:2.0:1788201454.261695:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1745 00000100:00100000:2.0:1788201454.261707:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:77181:x1875060695540096:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:2.0:1788201454.261734:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201454.261782:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e4b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786e4c expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201454.261936:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x6:0x0]: returning size 4096 00010000:00010000:2.0:1788201454.262130:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e4b5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e4c expref: 15 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.262149:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc1421c6d00) 00010000:00010000:2.0:1788201454.262152:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201454.262158:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e4b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e4c expref: 15 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.262181:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbc600, rc 0) 00000100:00100000:2.0:1788201454.262314:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:77181:x1875060695540096:12345-192.168.201.20@tcp:101:rm.0 Request processed in 608us (844us total) trans 77309411484 rc 301/301 00000100:00100000:2.0:1788201454.262322:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1745 00000100:00100000:1.0:1788201454.267830:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201454.267950:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695540224 00000100:00100000:0.0:1788201454.267965:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695540224 00000100:00100000:0.0:1788201454.268074:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 296 00000100:00100000:0.0:1788201454.268087:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:77181:x1875060695540224:12345-192.168.201.20@tcp:37:rm.0 00000100:00100000:0.0:1788201454.273630:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:77181:x1875060695540224:12345-192.168.201.20@tcp:37:rm.0 Request processed in 4791us (5063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201454.273658:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 296 00000100:00100000:1.0:1788201454.277181:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201454.277295:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695540480 00000100:00100000:2.0:1788201454.277310:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695540480 00000100:00100000:2.0:1788201454.277393:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 297 00000100:00100000:2.0:1788201454.277407:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13c3d0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:77181:x1875060695540480:12345-192.168.201.20@tcp:35:rm.0 00000100:00100000:2.0:1788201454.277718:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13c3d0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:77181:x1875060695540480:12345-192.168.201.20@tcp:35:rm.0 Request processed in 313us (553us total) trans 77309411485 rc 0/0 00000100:00100000:2.0:1788201454.277726:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 297 00000100:00100000:1.0:1788201454.280916:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201454.281059:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695540736 00000100:00100000:3.0:1788201454.281072:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695540736 00000100:00100000:3.0:1788201454.281148:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1746 00000100:00100000:3.0:1788201454.281161:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:77181:x1875060695540736:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:3.0:1788201454.281193:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201454.281233:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e4c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786e53 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.281390:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e4ca lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.281408:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e4ca lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.281436:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e4ca lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201454.281474:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x6:0x0]: returning size 4096 00010000:00010000:3.0:1788201454.281614:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e4c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e53 expref: 18 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.281642:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e4ca lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e53 expref: 17 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.281652:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0x0 (ffff8dc103a9b400) 00010000:00010000:3.0:1788201454.281655:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788201454.281660:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3000, rc 0) 00000100:00100000:3.0:1788201454.281744:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+17:77181:x1875060695540736:12345-192.168.201.20@tcp:101:rm.0 Request processed in 586us (845us total) trans 77309411486 rc 0/0 00000100:00100000:3.0:1788201454.281752:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1746 00000100:00100000:2.0:1788201454.287368:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201454.287997:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695540864 00000100:00100000:3.0:1788201454.288040:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695540864 00000100:00100000:3.0:1788201454.288171:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1747 00000100:00100000:3.0:1788201454.288185:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+17:77181:x1875060695540864:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:3.0:1788201454.288233:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201454.288266:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e4d8 lrc: 2/0,0 mode: --/CR res: [0x2400088d0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786e5a expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.288353:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e4df lrc: 3/1,0 mode: --/PR res: [0x2400088d0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.288369:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e4df lrc: 3/1,0 mode: PR/PR res: [0x2400088d0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.288406:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e4df lrc: 3/1,0 mode: PR/PR res: [0x2400088d0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201454.288477:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d0:0x6:0x0]: returning size 4096 00000004:00200000:3.0:1788201454.288483:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1788201454.288530:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e4d8 lrc: 0/0,0 mode: --/CR res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e5a expref: 19 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.288551:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e4df lrc: 3/0,0 mode: PR/PR res: [0x2400088d0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e5a expref: 18 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.288561:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x6:0x0].0x0 (ffff8dc12196e500) 00010000:00010000:3.0:1788201454.288564:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201454.288567:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3e00, rc 0) 00000100:00100000:3.0:1788201454.288653:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+18:77181:x1875060695540864:12345-192.168.201.20@tcp:101:rm.0 Request processed in 472us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201454.288661:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1747 00000100:00100000:0.0:1788201454.291837:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201454.291983:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695540992 00000100:00100000:2.0:1788201454.291996:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695540992 00000100:00100000:2.0:1788201454.292093:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1748 00000100:00100000:2.0:1788201454.292105:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:77181:x1875060695540992:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:2.0:1788201454.292173:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201454.292215:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e4e6 lrc: 2/0,0 mode: --/CR res: [0x2000090a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786e61 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.292298:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e4ed lrc: 3/1,0 mode: --/PR res: [0x2000090a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.292316:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e4ed lrc: 3/1,0 mode: PR/PR res: [0x2000090a1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.292329:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e4ed lrc: 3/1,0 mode: PR/PR res: [0x2000090a1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201454.292394:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000090a1:0x6:0x0]: returning size 4096 00000004:00200000:2.0:1788201454.292400:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1788201454.292761:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e4e6 lrc: 0/0,0 mode: --/CR res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e61 expref: 16 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.292784:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e4ed lrc: 3/0,0 mode: PR/PR res: [0x2000090a1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e61 expref: 15 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.292793:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x6:0x0].0x0 (ffff8dc1421c6d00) 00010000:00010000:2.0:1788201454.292796:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788201454.292800:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbd000, rc 0) 00000100:00100000:2.0:1788201454.292982:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:77181:x1875060695540992:12345-192.168.201.20@tcp:101:rm.0 Request processed in 878us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201454.292992:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1748 00000100:00100000:1.0:1788201454.296906:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201454.296986:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695541248 00000100:00100000:0.0:1788201454.297001:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695541248 00000100:00100000:0.0:1788201454.297108:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1749 00000100:00100000:0.0:1788201454.297129:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+18:77181:x1875060695541248:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1788201454.297157:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201454.297184:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1e4f4 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786e68 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201454.297391:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x7:0x0]: returning size 4096 00010000:00010000:0.0:1788201454.297535:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1e4f4 lrc: 1/0,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e68 expref: 20 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.297575:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0x0 (ffff8dc103a9b400) 00010000:00010000:0.0:1788201454.297578:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201454.297585:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1e4f4 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e68 expref: 20 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.297602:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d7000, rc 0) 00000100:00100000:0.0:1788201454.297680:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+19:77181:x1875060695541248:12345-192.168.201.20@tcp:101:rm.0 Request processed in 553us (788us total) trans 77309411487 rc 301/301 00000100:00100000:0.0:1788201454.297690:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1749 00000100:00100000:0.0:1788201454.302605:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201454.302818:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695541376 00000100:00100000:1.0:1788201454.302832:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695541376 00000100:00100000:1.0:1788201454.302911:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 298 00000100:00100000:1.0:1788201454.302923:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+19:77181:x1875060695541376:12345-192.168.201.20@tcp:37:rm.0 00000100:00100000:0.0:1788201454.309636:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+19:77181:x1875060695541376:12345-192.168.201.20@tcp:37:rm.0 Request processed in 6699us (7032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201454.309654:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 298 00000100:00100000:0.0:1788201454.317860:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201454.317965:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695541504 00000100:00100000:2.0:1788201454.317979:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695541504 00000100:00100000:2.0:1788201454.318092:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 299 00000100:00100000:2.0:1788201454.318105:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:77181:x1875060695541504:12345-192.168.201.20@tcp:37:rm.0 00000100:00100000:0.0:1788201454.325291:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:77181:x1875060695541504:12345-192.168.201.20@tcp:37:rm.0 Request processed in 7170us (7430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201454.325309:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 299 00000100:00100000:3.0:1788201454.328886:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201454.329073:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695541760 00000100:00100000:0.0:1788201454.329087:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695541760 00000100:00100000:0.0:1788201454.329168:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 300 00000100:00100000:0.0:1788201454.329180:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+19:77181:x1875060695541760:12345-192.168.201.20@tcp:35:rm.0 00000040:00080000:0.0:1788201454.329712:0:66316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x1:0x0].12, 344 off47736 00000040:00080000:0.0:1788201454.329767:0:66316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x1:0x0].11, 424 off47184 00000004:00080000:0.0:1788201454.329774:0:66316:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc125a96e40 with version 28 00000004:00080000:2.0:1788201454.330330:0:75745:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc007566d80 version 28 rpc_version 28 00000020:00100000:2.0:1788201454.330374:0:75745:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788201454.330385:0:75745:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc004b39500 x1875060715398016/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1560/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201454.330415:0:75745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b39500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715398016:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788201454.330572:0:75745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201454.330652:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105d39480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201454.330697:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715398016 00000100:00100000:0.0:1788201454.330721:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715398016 00000100:00100000:0.0:1788201454.330824:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788201454.330833:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:75745:x1875060715398016:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788201454.331094:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:75745:x1875060715398016:12345-0@lo:1000:osp_up0-1.0 Request processed in 261us (521us total) trans 128849018884 rc 0/0 00000100:00100000:0.0:1788201454.331102:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788201454.331234:0:75745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b39500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715398016:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788201454.331580:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:77181:x1875060695541760:12345-192.168.201.20@tcp:35:rm.0 Request processed in 2399us (2715us total) trans 77309411488 rc 0/0 00000100:00100000:1.0:1788201454.331591:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 300 00000100:00100000:2.0:1788201454.335009:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201454.335137:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695542016 00000100:00100000:3.0:1788201454.335150:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695542016 00000100:00100000:3.0:1788201454.335318:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1750 00000100:00100000:3.0:1788201454.335333:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:77181:x1875060695542016:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:3.0:1788201454.335368:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201454.335395:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e502 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786e6f expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.335627:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e509 lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.335662:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e509 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.335675:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e509 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201454.335690:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x7:0x0]: returning size 4096 00010000:00010000:3.0:1788201454.335817:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e502 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e6f expref: 23 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.335840:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e509 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e6f expref: 22 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.335850:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x7:0x0].0x0 (ffff8dc12f13a700) 00010000:00010000:3.0:1788201454.335853:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788201454.335858:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2200, rc 0) 00000100:00100000:3.0:1788201454.335951:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:77181:x1875060695542016:12345-192.168.201.20@tcp:101:rm.0 Request processed in 621us (956us total) trans 77309411489 rc 0/0 00000100:00100000:3.0:1788201454.335959:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1750 00000100:00100000:2.0:1788201454.342201:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201454.342446:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695542144 00000100:00100000:0.0:1788201454.342460:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695542144 00000100:00100000:0.0:1788201454.342534:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 301 00000100:00100000:0.0:1788201454.342547:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:77181:x1875060695542144:12345-192.168.201.20@tcp:37:rm.0 00000100:00100000:2.0:1788201454.347632:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:77181:x1875060695542144:12345-192.168.201.20@tcp:37:rm.0 Request processed in 5071us (5430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201454.347649:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 301 00000100:00100000:2.0:1788201454.351563:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201454.351678:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695542400 00000100:00100000:1.0:1788201454.351690:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695542400 00000100:00100000:1.0:1788201454.351798:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 302 00000100:00100000:1.0:1788201454.351811:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13c3d2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:77181:x1875060695542400:12345-192.168.201.20@tcp:35:rm.0 00000100:00100000:1.0:1788201454.352217:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13c3d2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:77181:x1875060695542400:12345-192.168.201.20@tcp:35:rm.0 Request processed in 395us (655us total) trans 128849018885 rc 0/0 00000100:00100000:1.0:1788201454.352246:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 302 00000100:00100000:0.0:1788201454.355527:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201454.355658:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695542656 00000100:00100000:2.0:1788201454.355671:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695542656 00000100:00100000:2.0:1788201454.355778:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1751 00000100:00100000:2.0:1788201454.355791:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:77181:x1875060695542656:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:2.0:1788201454.355881:0:66312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788201454.355919:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1e45a lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e29 expref: 16 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.355944:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1e43e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e1b expref: 15 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.355982:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x31:0x0].0x0 (ffff8dc12196e700) 00010000:00010000:2.0:1788201454.355993:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e4ed lrc: 0/0,0 mode: --/PR res: [0x2000090a1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e61 expref: 14 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.356001:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x6:0x0].0x0 (ffff8dc1421c6d00) 00010000:00010000:2.0:1788201454.356010:0:66312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201454.356131:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e517 lrc: 3/0,1 mode: --/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.356147:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e517 lrc: 3/0,1 mode: CW/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.356158:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e517 lrc: 3/0,1 mode: CW/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.356174:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1e51e lrc: 3/0,1 mode: --/PW res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.356181:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1e51e lrc: 3/0,1 mode: PW/PW res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.356187:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1e51e lrc: 3/0,1 mode: PW/PW res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.356301:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e525 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.356313:0:66312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e19e lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dce expref: 13 pid: 102481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.356335:0:66312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e525 lrc: 4/0,1 mode: --/EX res: [0x20000d6f1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.356376:0:66312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e19e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dce expref: 13 pid: 102481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.356391:0:66312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e19e lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dce expref: 13 pid: 102481 timeout: 4405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201454.356406:0:66312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b39c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66312:1875060715398144:192.168.201.20@tcp:104: 00000100:00100000:2.0:1788201454.356755:0:66312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105d39480 going to sleep for 11 seconds 00010000:00010000:3.0:1788201454.361335:0:66312:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.20@tcp) returned -22 from blocking AST (req@00000000ce424ac7 x1875060715398144) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e19e lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dce expref: 13 pid: 102481 timeout: 4405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.361367:0:66312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e19e lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dce expref: 13 pid: 102481 timeout: 4405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.361395:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e19e lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dce expref: 13 pid: 102481 timeout: 4405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201454.361446:0:66312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b39c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:66312:1875060715398144:192.168.201.20@tcp:104: 00010000:00010000:3.0:1788201454.361475:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x31:0x0].0x0 (ffff8dc12196e700) 00010000:00010000:3.0:1788201454.361481:0:66312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e525 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.361492:0:66312:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e525 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.361501:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e525 lrc: 4/0,1 mode: EX/EX res: [0x20000d6f1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.361522:0:66312:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e525 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.361532:0:66312:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e525 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.361539:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e525 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201454.361994:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x31:0x0]: returning size 4096 00010000:00010000:3.0:1788201454.362174:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e525 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.362184:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e525 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.362192:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e525 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.362210:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201454.362215:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e525 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.362223:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e525 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.362235:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x31:0x0].0x0 (ffff8dc12196e700) 00010000:00010000:3.0:1788201454.362239:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201454.362242:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e525 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.362248:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e525 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.362278:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e517 lrc: 4/0,1 mode: CW/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.362284:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e517 lrc: 4/0,1 mode: CW/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.362290:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e517 lrc: 3/0,0 mode: CW/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.362295:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e517 lrc: 4/0,0 mode: CW/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.362300:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201454.362303:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e517 lrc: 4/0,0 mode: CW/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.362320:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e517 lrc: 5/0,0 mode: CW/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.362329:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x6:0x0].0x0 (ffff8dc1421c6700) 00010000:00010000:3.0:1788201454.362331:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201454.362335:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e517 lrc: 3/0,0 mode: --/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.362341:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e517 lrc: 0/0,0 mode: --/CW res: [0x2000090a1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201454.362356:0:66312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003291fbeb reply state 00000000f3f8c256 transno 128849018886 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1e51e lrc: 3/0,1 mode: PW/PW res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.362369:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1e51e lrc: 3/0,1 mode: TXN/TXN res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.362376:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x6:0x0].0xcd52553e (ffff8dc1421c6400) 00010000:00010000:3.0:1788201454.362378:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201454.362382:0:66312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201454.362741:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:77181:x1875060695542656:12345-192.168.201.20@tcp:36:rm.0 Request processed in 6948us (7224us total) trans 128849018886 rc 0/0 00000100:00100000:3.0:1788201454.362752:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1751 00000100:00100000:2.0:1788201454.367382:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201454.367570:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695542784 00000100:00100000:0.0:1788201454.367586:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695542784 00000100:00100000:0.0:1788201454.367699:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 303 00000100:00100000:0.0:1788201454.367712:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:77181:x1875060695542784:12345-192.168.201.20@tcp:37:rm.0 00000100:00100000:2.0:1788201454.374072:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:77181:x1875060695542784:12345-192.168.201.20@tcp:37:rm.0 Request processed in 6345us (6687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201454.374090:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 303 00000100:00100000:3.0:1788201454.379529:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201454.379793:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695543040 00000100:00100000:1.0:1788201454.379806:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695543040 00000100:00100000:1.0:1788201454.379891:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 304 00000100:00100000:1.0:1788201454.379904:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:77181:x1875060695543040:12345-192.168.201.20@tcp:35:rm.0 00000100:00100000:1.0:1788201454.380263:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+23:77181:x1875060695543040:12345-192.168.201.20@tcp:35:rm.0 Request processed in 360us (749us total) trans 77309411490 rc 0/0 00000100:00100000:1.0:1788201454.380272:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 304 00000100:00100000:0.0:1788201454.383683:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201454.383793:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695543296 00000100:00100000:3.0:1788201454.383806:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695543296 00000100:00100000:3.0:1788201454.383889:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1752 00000100:00100000:3.0:1788201454.383902:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+23:77181:x1875060695543296:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:3.0:1788201454.384012:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788201454.384096:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e499 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e3e expref: 23 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384135:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e47d lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e30 expref: 22 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384148:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x8:0x0].0x0 (ffff8dc12196eb00) 00010000:00010000:3.0:1788201454.384165:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e4df lrc: 0/0,0 mode: --/PR res: [0x2400088d0:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e5a expref: 21 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384173:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x6:0x0].0x0 (ffff8dc12196e500) 00010000:00010000:3.0:1788201454.384180:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201454.384210:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e52c lrc: 3/0,1 mode: --/CW res: [0x2400088d0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384225:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e52c lrc: 3/0,1 mode: CW/CW res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384237:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e52c lrc: 3/0,1 mode: CW/CW res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384249:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e533 lrc: 3/0,1 mode: --/PW res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384256:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e533 lrc: 3/0,1 mode: PW/PW res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384263:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e533 lrc: 3/0,1 mode: PW/PW res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384366:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e53a lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384380:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e53a lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384388:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e53a lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201454.384678:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x8:0x0]: returning size 4096 00010000:00010000:3.0:1788201454.384698:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e53a lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384705:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e53a lrc: 2/0,0 mode: EX/EX res: [0x2400088d5:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384711:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e53a lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384717:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201454.384722:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e53a lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384731:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e53a lrc: 4/0,0 mode: EX/EX res: [0x2400088d5:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384741:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x8:0x0].0x0 (ffff8dc12196e400) 00010000:00010000:3.0:1788201454.384744:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201454.384747:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e53a lrc: 2/0,0 mode: --/EX res: [0x2400088d5:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384752:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e53a lrc: 0/0,0 mode: --/EX res: [0x2400088d5:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384774:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e52c lrc: 4/0,1 mode: CW/CW res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384787:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e52c lrc: 4/0,1 mode: CW/CW res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384792:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e52c lrc: 3/0,0 mode: CW/CW res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384797:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e52c lrc: 4/0,0 mode: CW/CW res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384802:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2e00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201454.384805:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e52c lrc: 4/0,0 mode: CW/CW res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384810:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e52c lrc: 5/0,0 mode: CW/CW res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384819:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x6:0x0].0x0 (ffff8dc12196e700) 00010000:00010000:3.0:1788201454.384821:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201454.384824:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e52c lrc: 3/0,0 mode: --/CW res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384831:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e52c lrc: 0/0,0 mode: --/CW res: [0x2400088d0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201454.384842:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ef61279 reply state 0000000051af4694 transno 77309411491 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e533 lrc: 3/0,1 mode: PW/PW res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384854:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e533 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.384860:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x6:0x0].0xf0209d98 (ffff8dc12196e800) 00010000:00010000:3.0:1788201454.384868:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201454.384871:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201454.384967:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:77181:x1875060695543296:12345-192.168.201.20@tcp:36:rm.0 Request processed in 1065us (1299us total) trans 77309411491 rc 0/0 00000100:00100000:3.0:1788201454.384976:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1752 00000100:00100000:3.0:1788201454.388539:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201454.388953:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695543552 00000100:00100000:2.0:1788201454.388968:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695543552 00000100:00100000:2.0:1788201454.391265:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 305 00000100:00100000:2.0:1788201454.391296:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:77181:x1875060695543552:12345-192.168.201.20@tcp:35:rm.0 00000100:00100000:2.0:1788201454.391632:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+23:77181:x1875060695543552:12345-192.168.201.20@tcp:35:rm.0 Request processed in 349us (3108us total) trans 77309411492 rc 0/0 00000100:00100000:2.0:1788201454.391641:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 305 00000100:00100000:3.0:1788201454.393912:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201454.394151:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695543808 00000100:00100000:1.0:1788201454.394164:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695543808 00000100:00100000:1.0:1788201454.394281:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1753 00000100:00100000:1.0:1788201454.394401:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+23:77181:x1875060695543808:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:1.0:1788201454.394488:0:66757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788201454.394523:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1e509 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e6f expref: 23 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.394552:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1e422 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e14 expref: 22 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.394567:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x7:0x0].0x0 (ffff8dc12f13a700) 00010000:00010000:1.0:1788201454.394588:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6e00/0x96d0c9b8c9a1e4ae lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e45 expref: 21 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.394598:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0x0 (ffff8dc103a9b400) 00010000:00010000:1.0:1788201454.394602:0:66757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201454.394650:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1e541 lrc: 3/0,1 mode: --/CW res: [0x2400088d5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.394669:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1e541 lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.394681:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1e541 lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.394697:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1e548 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.394704:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1e548 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.394711:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1e548 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.394812:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1e54f lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.394821:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1e54f lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.394829:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1e54f lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.394849:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1e556 lrc: 3/0,1 mode: --/EX res: [0x2400088d0:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.394857:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1e556 lrc: 3/0,1 mode: EX/EX res: [0x2400088d0:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.394863:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1e556 lrc: 3/0,1 mode: EX/EX res: [0x2400088d0:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.395529:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064ec000/0x96d0c9b8c9a1e55d lrc: 3/0,1 mode: --/EX res: [0x2000090a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.395537:0:66757:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064ec000/0x96d0c9b8c9a1e55d lrc: 3/0,1 mode: --/EX res: [0x2000090a1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.395548:0:66757:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064ec000/0x96d0c9b8c9a1e55d lrc: 3/0,1 mode: --/EX res: [0x2000090a1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201454.395579:0:66757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66757:1875060715398272:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1788201454.395660:0:66757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201454.395714:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715398272 00000100:00100000:1.0:1788201454.395720:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715398272 00000100:00100000:1.0:1788201454.395766:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788201454.395776:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:66757:x1875060715398272:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1788201454.395795:0:101344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201454.395814:0:101344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2800/0x96d0c9b8c9a1e564 lrc: 2/0,0 mode: --/EX res: [0x2000090a1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e55d expref: -99 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.395837:0:101344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2800/0x96d0c9b8c9a1e564 lrc: 3/0,0 mode: EX/EX res: [0x2000090a1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e55d expref: 9 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.395849:0:101344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2800/0x96d0c9b8c9a1e564 lrc: 3/0,0 mode: EX/EX res: [0x2000090a1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e55d expref: 9 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.395858:0:101344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x6:0x0].0x0 (ffff8dc12f13ad00) 00010000:00010000:1.0:1788201454.395861:0:101344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201454.395864:0:101344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e2800, rc 0) 00000100:00100000:1.0:1788201454.395922:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:66757:x1875060715398272:12345-0@lo:101:mdt00_003.0 Request processed in 147us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201454.395929:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788201454.395964:0:66757:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1065c7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201454.395994:0:66757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66757:1875060715398272:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1788201454.396012:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064ec000/0x96d0c9b8c9a1e55d lrc: 4/0,1 mode: EX/EX res: [0x2000090a1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e564 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.396047:0:66757:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064ec000/0x96d0c9b8c9a1e55d lrc: 4/0,1 mode: EX/EX res: [0x2000090a1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e564 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201454.397643:0:66757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66757:1875060715398400:0@lo:403:mdt00_003.0 00000100:00100000:1.0:1788201454.397730:0:66757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201454.397824:0:66757:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1065c7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201454.398340:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715398400 00000100:00100000:0.0:1788201454.398349:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715398400 00000100:00100000:0.0:1788201454.398452:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788201454.398462:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:66757:x1875060715398400:12345-0@lo:403:mdt00_003.0 00000100:00100000:0.0:1788201454.402845:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:66757:x1875060715398400:12345-0@lo:403:mdt00_003.0 Request processed in 4371us (5101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201454.402864:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788201454.403138:0:66757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66757:1875060715398400:0@lo:403:mdt00_003.0 00000040:00080000:3.0:1788201454.406289:0:66757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x1:0x0].13, 936 off48672 00000040:00080000:3.0:1788201454.406679:0:66757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x1:0x0].12, 1016 off48200 00000004:00080000:3.0:1788201454.406688:0:66757:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc006ccf900 with version 29 00000004:00080000:2.0:1788201454.406811:0:75745:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc007566d80 version 29 rpc_version 29 00000020:00100000:2.0:1788201454.406864:0:75745:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788201454.406951:0:75745:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc004be6d80 x1875060715398656/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1976/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201454.407003:0:75745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715398656:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788201454.407277:0:75745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201454.407358:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105d39780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201454.407551:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715398656 00000100:00100000:1.0:1788201454.407563:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715398656 00000100:00100000:1.0:1788201454.407674:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788201454.407687:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:75745:x1875060715398656:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788201454.408225:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:75745:x1875060715398656:12345-0@lo:1000:osp_up0-1.0 Request processed in 539us (947us total) trans 128849018887 rc 0/0 00000100:00100000:1.0:1788201454.408236:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788201454.408371:0:75745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715398656:0@lo:1000:osp_up0-1.0 00000004:00200000:3.0:1788201454.408579:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x7:0x0]: returning size 4096 00010000:00010000:3.0:1788201454.408611:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1e556 lrc: 3/0,1 mode: EX/EX res: [0x2400088d0:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.408622:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1e556 lrc: 2/0,0 mode: EX/EX res: [0x2400088d0:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.408630:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1e556 lrc: 3/0,0 mode: EX/EX res: [0x2400088d0:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.408637:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201454.408642:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1e556 lrc: 3/0,0 mode: EX/EX res: [0x2400088d0:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.408650:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1e556 lrc: 4/0,0 mode: EX/EX res: [0x2400088d0:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.408670:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x6:0x0].0x0 (ffff8dc12f13a400) 00010000:00010000:3.0:1788201454.408673:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201454.408698:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1e556 lrc: 2/0,0 mode: --/EX res: [0x2400088d0:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.408705:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1e556 lrc: 0/0,0 mode: --/EX res: [0x2400088d0:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.408738:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064ec000/0x96d0c9b8c9a1e55d lrc: 4/0,1 mode: EX/EX res: [0x2000090a1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e564 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.408747:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064ec000/0x96d0c9b8c9a1e55d lrc: 4/0,1 mode: EX/EX res: [0x2000090a1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e564 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.408754:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064ec000/0x96d0c9b8c9a1e55d lrc: 3/0,0 mode: EX/EX res: [0x2000090a1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e564 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.408828:0:66757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1788201454.408839:0:66757:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000090a1:0x6:0x0] 00010000:00010000:3.0:1788201454.408847:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1e54f lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.408853:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1e54f lrc: 2/0,0 mode: EX/EX res: [0x2400088d5:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.408859:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1e54f lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.408863:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201454.408867:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1e54f lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.408883:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1e54f lrc: 4/0,0 mode: EX/EX res: [0x2400088d5:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.408903:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x7:0x0].0x0 (ffff8dc12f13a300) 00010000:00010000:3.0:1788201454.408906:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201454.408909:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1e54f lrc: 2/0,0 mode: --/EX res: [0x2400088d5:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.408915:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1e54f lrc: 0/0,0 mode: --/EX res: [0x2400088d5:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.408940:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1e541 lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.408948:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1e541 lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.408954:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1e541 lrc: 3/0,0 mode: CW/CW res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.408960:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1e541 lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.408966:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201454.408969:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1e541 lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.408976:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1e541 lrc: 5/0,0 mode: CW/CW res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.408984:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0x0 (ffff8dc103a9b400) 00010000:00010000:3.0:1788201454.408986:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201454.408990:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1e541 lrc: 3/0,0 mode: --/CW res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.409006:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec600/0x96d0c9b8c9a1e541 lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201454.409042:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e002c9b reply state 000000007583d8dd transno 77309411493 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1e548 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.409059:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1e548 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.409066:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0xd1d4b922 (ffff8dc12f13ab00) 00010000:00010000:3.0:1788201454.409069:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201454.409073:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201454.409183:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:77181:x1875060695543808:12345-192.168.201.20@tcp:36:rm.0 Request processed in 14889us (15282us total) trans 77309411493 rc 0/0 00000100:00100000:3.0:1788201454.409192:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1753 00010000:00010000:0.0:1788201454.413517:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201454.413535:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064ec000/0x96d0c9b8c9a1e55d lrc: 2/0,0 mode: EX/EX res: [0x2000090a1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e564 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.413578:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec000 already unused, calling callback (ffffffffc189cee0) 00010000:00010000:0.0:1788201454.413587:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064ec000/0x96d0c9b8c9a1e55d lrc: 3/0,0 mode: EX/EX res: [0x2000090a1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1e564 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201454.413598:0:6521:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064ec000/0x96d0c9b8c9a1e55d lrc: 3/0,0 mode: EX/EX res: [0x2000090a1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1e564 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.413658:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064ec000/0x96d0c9b8c9a1e55d lrc: 2/0,0 mode: --/EX res: [0x2000090a1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e564 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.413666:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788201454.413727:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1788201454.413777:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064ec000/0x96d0c9b8c9a1e55d lrc: 1/0,0 mode: --/EX res: [0x2000090a1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e564 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.413785:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc1064ec000/0x96d0c9b8c9a1e55d lrc: 0/0,0 mode: --/EX res: [0x2000090a1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e564 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.413815:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201454.413817:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201454.413818:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201454.415068:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715398784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201454.415175:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201454.415478:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201454.415491:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715398912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201454.415531:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201454.415575:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715398912 00000100:00100000:2.0:1788201454.415583:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715398912 00000100:00100000:2.0:1788201454.415645:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788201454.415656:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715398912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201454.415687:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201454.415736:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715398912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201454.415744:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788201454.415810:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715398912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201454.416041:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715398784 00000100:00100000:3.0:1788201454.416046:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715398784 00000100:00100000:3.0:1788201454.416091:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:3.0:1788201454.416099:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3658:x1875060715398784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201454.416123:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201454.416153:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2800/0x96d0c9b8c9a1e564 lrc: 0/0,0 mode: --/EX res: [0x2000090a1:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e55d expref: 10 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.416176:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x6:0x0].0x0 (ffff8dc12f13ad00) 00010000:00010000:3.0:1788201454.416191:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201454.416408:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3658:x1875060715398784:12345-0@lo:103:ldlm_bl.0 Request processed in 309us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201454.416426:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00100000:1.0:1788201454.416589:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715398784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201454.417087:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201454.417135:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201454.417309:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695544192 00000100:00100000:2.0:1788201454.417316:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695544192 00000100:00100000:2.0:1788201454.417363:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 306 00000100:00100000:2.0:1788201454.417372:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:77181:x1875060695544192:12345-192.168.201.20@tcp:35:rm.0 00000100:00100000:2.0:1788201454.417641:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+23:77181:x1875060695544192:12345-192.168.201.20@tcp:35:rm.0 Request processed in 269us (557us total) trans 77309411494 rc 0/0 00000100:00100000:2.0:1788201454.417649:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 306 00000100:00100000:1.0:1788201454.419660:0:9535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695543936 00000100:00100000:1.0:1788201454.419681:0:9535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695543936 00000100:00100000:1.0:1788201454.419797:0:9535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 746 00000100:00100000:1.0:1788201454.419809:0:9535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2400:x1875060695543936:12345-192.168.201.20@tcp:103:rm.0 00010000:00010000:1.0:1788201454.419829:0:9535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201454.419863:0:9535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1e3f8 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e06 expref: 14 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.419898:0:9535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0x0 (ffff8dc1421c6a00) 00010000:00010000:1.0:1788201454.419909:0:9535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201454.419971:0:9535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:2400:x1875060695543936:12345-192.168.201.20@tcp:103:rm.0 Request processed in 163us (2835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201454.419978:0:9535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 746 00000100:00100000:0.0:1788201454.421984:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201454.422145:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695544448 00000100:00100000:3.0:1788201454.422157:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695544448 00000100:00100000:3.0:1788201454.422245:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1754 00000100:00100000:3.0:1788201454.422257:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+23:77181:x1875060695544448:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:3.0:1788201454.422333:0:66312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788201454.422366:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e4ca lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e53 expref: 23 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.422392:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7e00/0x96d0c9b8c9a1e406 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x6:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e0d expref: 22 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.422404:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0x0 (ffff8dc103a9b400) 00010000:00010000:3.0:1788201454.422429:0:66312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201454.422493:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e56b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.422504:0:66312:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e56b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.422515:0:66312:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e56b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201454.422542:0:66312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66312:1875060715399040:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1788201454.422607:0:66312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201454.422648:0:66312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccf780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201454.422920:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715399040 00000100:00100000:0.0:1788201454.422926:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715399040 00000100:00100000:0.0:1788201454.422972:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788201454.422980:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:66312:x1875060715399040:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1788201454.423037:0:66318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201454.423054:0:66318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1e572 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e56b expref: -99 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.423081:0:66318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e3dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dff expref: 12 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.423093:0:66318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1e572 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e56b expref: 10 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.423131:0:66318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e3dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dff expref: 12 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.423146:0:66318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e3dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dff expref: 12 pid: 66314 timeout: 4405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201454.423158:0:66318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:66318:1875060715399168:192.168.201.20@tcp:104: 00000100:00100000:0.0:1788201454.423600:0:66318:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125a96900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201454.423837:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201454.423853:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715399296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201454.423918:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201454.424119:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715399296 00000100:00100000:1.0:1788201454.424127:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715399296 00000100:00100000:1.0:1788201454.424178:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788201454.424188:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715399296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201454.424511:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1788201454.424584:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715399296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 396us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201454.424593:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788201454.424689:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715399296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201454.429989:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201454.430655:0:66318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:66318:1875060715399168:192.168.201.20@tcp:104: 00010000:00010000:1.0:1788201454.430701:0:66318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1e572 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e56b expref: 10 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.430716:0:66318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008723a00) 00010000:00010000:1.0:1788201454.430719:0:66318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201454.430723:0:66318:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1e572 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e56b expref: 10 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.430755:0:66318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d6a00, rc 0) 00000100:00100000:1.0:1788201454.430839:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:66312:x1875060715399040:12345-0@lo:101:mdt00_000.0 Request processed in 7859us (8230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201454.430850:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788201454.430977:0:66312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66312:1875060715399040:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1788201454.431000:0:66312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e56b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e572 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.431056:0:66312:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e56b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e572 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201454.431340:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695544576 00000100:00100000:3.0:1788201454.431351:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695544576 00010000:00010000:3.0:1788201454.431393:0:26207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e3dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dff expref: 13 pid: 66314 timeout: 4405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201454.431462:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2628 00000100:00100000:3.0:1788201454.431474:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:2401:x1875060695544576:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201454.431496:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201454.431503:0:26207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e3dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dff expref: 13 pid: 66314 timeout: 4405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.431517:0:26207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e3dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dff expref: 13 pid: 66314 timeout: 4405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.431543:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e3dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dff expref: 13 pid: 66314 timeout: 4405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.431562:0:26207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008723a00) 00010000:00010000:3.0:1788201454.431566:0:26207:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1e572 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e56b expref: 9 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.431576:0:26207:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1e572 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e56b expref: 9 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.431585:0:26207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1e572 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e56b expref: 9 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.431624:0:26207:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1e572 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e56b expref: 9 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201454.431640:0:26207:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a440e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:26207:1875060715399424:0@lo:105: 00000100:00100000:3.0:1788201454.431699:0:26207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201454.431744:0:26207:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccf840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201454.432171:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715399424 00000100:00100000:1.0:1788201454.432178:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715399424 00000100:00100000:1.0:1788201454.432223:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788201454.432232:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a441880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:26207:x1875060715399424:12345-0@lo:105: 00010000:00010000:1.0:1788201454.432253:0:6515:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e56b lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e572 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.432271:0:6515:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e56b lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e572 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.432281:0:6515:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e56b lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e572 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.432289:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e56b lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x96d0c9b8c9a1e572 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.432298:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e56b lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x96d0c9b8c9a1e572 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.432307:0:6515:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e56b lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x96d0c9b8c9a1e572 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.432331:0:6515:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8dc125ae2e00) 00000100:00100000:1.0:1788201454.432391:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a441880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:26207:x1875060715399424:12345-0@lo:105: Request processed in 160us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201454.432398:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788201454.432452:0:26207:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a440e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:26207:1875060715399424:0@lo:105: 00010000:00010000:1.0:1788201454.432468:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201454.432519:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2401:x1875060695544576:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 1046us (2546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201454.432528:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2628 00010000:00010000:3.0:1788201454.434183:0:66312:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e56b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e572 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.434205:0:66312:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e56b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e572 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201454.434242:0:66312:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1788201454.434311:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3200/0x96d0c9b8c9a1e579 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.434320:0:66312:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3200/0x96d0c9b8c9a1e579 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.434334:0:66312:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3200/0x96d0c9b8c9a1e579 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201454.434362:0:66312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a442300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66312:1875060715399552:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1788201454.434445:0:66312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201454.434483:0:66312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccf000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201454.434713:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715399552 00000100:00100000:1.0:1788201454.434723:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715399552 00000100:00100000:1.0:1788201454.434777:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788201454.434785:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:66312:x1875060715399552:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1788201454.434801:0:66317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201454.434818:0:66317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1e580 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e579 expref: -99 pid: 66317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.434850:0:66317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1e580 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e579 expref: 11 pid: 66317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.434866:0:66317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1e580 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e579 expref: 11 pid: 66317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.434886:0:66317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc9f42202 (ffff8dc12f13a700) 00010000:00010000:1.0:1788201454.434889:0:66317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201454.434894:0:66317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e2c00, rc 0) 00000100:00100000:1.0:1788201454.434939:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:66312:x1875060715399552:12345-0@lo:101:mdt00_000.0 Request processed in 154us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201454.434967:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788201454.435070:0:66312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a442300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66312:1875060715399552:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1788201454.435088:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3200/0x96d0c9b8c9a1e579 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e580 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.435098:0:66312:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3200/0x96d0c9b8c9a1e579 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e580 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201454.435123:0:66312:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1788201454.435166:0:66312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66312:1875060715399680:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788201454.435200:0:66312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201454.435221:0:66312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125a96a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201454.435366:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715399680 00000100:00100000:1.0:1788201454.435370:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715399680 00000100:00100000:1.0:1788201454.435392:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788201454.435396:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:66312:x1875060715399680:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788201454.435460:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:66312:x1875060715399680:12345-0@lo:1000:mdt00_000.0 Request processed in 64us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201454.435465:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788201454.435553:0:66312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66312:1875060715399680:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788201454.435591:0:66312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66312:1875060715399808:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788201454.435610:0:66312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201454.435627:0:66312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125a96a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201454.435678:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715399808 00000100:00100000:3.0:1788201454.435681:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715399808 00000100:00100000:3.0:1788201454.435705:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788201454.435710:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:66312:x1875060715399808:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788201454.435782:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:66312:x1875060715399808:12345-0@lo:1000:mdt00_000.0 Request processed in 72us (171us total) trans 0 rc 1/1 00000100:00100000:3.0:1788201454.435786:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788201454.435842:0:66312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66312:1875060715399808:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788201454.435901:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1e587 lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.435909:0:66312:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1e587 lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.435917:0:66312:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1e587 lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201454.435939:0:66312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66312:1875060715399936:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1788201454.435965:0:66312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201454.435988:0:66312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125a96780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201454.436093:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715399936 00000100:00100000:3.0:1788201454.436103:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715399936 00000100:00100000:3.0:1788201454.436142:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788201454.436149:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:66312:x1875060715399936:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1788201454.436157:0:101344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201454.436173:0:101344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e58e lrc: 2/0,0 mode: --/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e587 expref: -99 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.436190:0:101344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e58e lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e587 expref: 12 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.436199:0:101344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e58e lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e587 expref: 12 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201454.436205:0:101344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0x0 (ffff8dc12196e400) 00010000:00010000:3.0:1788201454.436207:0:101344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201454.436209:0:101344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3e00, rc 0) 00000100:00100000:3.0:1788201454.436231:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:66312:x1875060715399936:12345-0@lo:101:mdt00_000.0 Request processed in 84us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201454.436234:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788201454.436371:0:66312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66312:1875060715399936:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1788201454.436380:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1e587 lrc: 4/0,1 mode: EX/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e58e expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.436387:0:66312:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1e587 lrc: 4/0,1 mode: EX/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e58e expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.436407:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6000/0x96d0c9b8c9a1e595 lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.436423:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6000/0x96d0c9b8c9a1e595 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.436430:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6000/0x96d0c9b8c9a1e595 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201454.436747:0:66312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x1:0x0].14, 432 off49104 00000040:00080000:0.0:1788201454.436787:0:66312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x1:0x0].13, 512 off48712 00000004:00080000:0.0:1788201454.436791:0:66312:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc125a96780 with version 30 00000004:00080000:3.0:1788201454.436960:0:75745:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc007566d80 version 30 rpc_version 30 00000020:00100000:3.0:1788201454.436985:0:75745:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788201454.436994:0:75745:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc13a442300 x1875060715400192/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1504/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201454.437011:0:75745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a442300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715400192:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201454.437084:0:75745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201454.437105:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccf000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201454.437180:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715400192 00000100:00100000:1.0:1788201454.437186:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715400192 00000100:00100000:1.0:1788201454.437214:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788201454.437221:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:75745:x1875060715400192:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788201454.437716:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:75745:x1875060715400192:12345-0@lo:1000:osp_up0-1.0 Request processed in 494us (631us total) trans 128849018888 rc 0/0 00000100:00100000:1.0:1788201454.437724:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788201454.437958:0:75745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a442300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715400192:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1788201454.438162:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x6:0x0]: returning size 4096 00010000:00010000:0.0:1788201454.438182:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6000/0x96d0c9b8c9a1e595 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.438191:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6000/0x96d0c9b8c9a1e595 lrc: 2/0,0 mode: EX/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.438209:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6000/0x96d0c9b8c9a1e595 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.438216:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201454.438221:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6000/0x96d0c9b8c9a1e595 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.438230:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6000/0x96d0c9b8c9a1e595 lrc: 4/0,0 mode: EX/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.438308:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0x0 (ffff8dc103a9b700) 00010000:00010000:0.0:1788201454.438313:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201454.438318:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6000/0x96d0c9b8c9a1e595 lrc: 2/0,0 mode: --/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.438326:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6000/0x96d0c9b8c9a1e595 lrc: 0/0,0 mode: --/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.438348:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1e587 lrc: 4/0,1 mode: EX/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e58e expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.438357:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1e587 lrc: 4/0,1 mode: EX/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e58e expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.438364:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1e587 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e58e expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.438699:0:66312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788201454.438715:0:66312:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1788201454.438723:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e56b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e572 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.438739:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e56b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e572 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.438746:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e56b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e572 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.438775:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201454.438783:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1e587 lrc: 2/0,0 mode: EX/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e58e expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.438790:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7400 already unused, calling callback (ffffffffc189cee0) 00010000:00010000:1.0:1788201454.438796:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1e587 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1e58e expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201454.438804:0:6520:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1e587 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1e58e expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.438840:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1e587 lrc: 2/0,0 mode: --/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e58e expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.438854:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788201454.438969:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715400320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201454.439049:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201454.439099:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715400320 00000100:00100000:2.0:1788201454.439121:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715400320 00010000:00010000:1.0:1788201454.439136:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1e587 lrc: 1/0,0 mode: --/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e58e expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.439143:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1e587 lrc: 0/0,0 mode: --/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e58e expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.439160:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201454.439163:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e56b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e572 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.439169:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2e00 already unused, calling callback (ffffffffc189cee0) 00000100:00100000:2.0:1788201454.439169:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00010000:00010000:1.0:1788201454.439173:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e56b lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1e572 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201454.439178:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+13:3656:x1875060715400320:12345-0@lo:103:ldlm_bl.0 00000004:00010000:1.0:1788201454.439180:0:6520:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e56b lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1e572 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.439191:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201454.439197:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e56b lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e572 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.439203:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201454.439209:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e58e lrc: 0/0,0 mode: --/EX res: [0x2400088d5:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e587 expref: 13 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.439219:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e56b lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e572 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201454.439222:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0x0 (ffff8dc12196e400) 00010000:00010000:1.0:1788201454.439226:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201454.439228:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201454.439230:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201454.439231:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201454.439256:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201454.439267:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715400448:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201454.439309:0:66312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788201454.439314:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2e00/0x96d0c9b8c9a1e56b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e572 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201454.439328:0:66312:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1788201454.439335:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201454.439345:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3200/0x96d0c9b8c9a1e579 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e580 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201454.439353:0:66312:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3200/0x96d0c9b8c9a1e579 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e580 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201454.439591:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:77181:x1875060695544448:12345-192.168.201.20@tcp:36:rm.0 Request processed in 17334us (17619us total) trans 77309411495 rc 0/0 00000100:00100000:0.0:1788201454.439601:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1754 00000100:00100000:1.0:1788201454.440194:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201454.440266:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715400448 00000100:00100000:1.0:1788201454.440275:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715400448 00000100:00100000:1.0:1788201454.440319:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:1.0:1788201454.440328:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+13:3658:x1875060715400448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201454.440343:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201454.440364:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1e572 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e56b expref: 13 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201454.440382:0:26213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008723a00) 00010000:00010000:1.0:1788201454.440387:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201454.440493:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+12:3658:x1875060715400448:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201454.440500:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:1.0:1788201454.440551:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715400448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201454.446524:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3656:x1875060715400320:12345-0@lo:103:ldlm_bl.0 Request processed in 7329us (7457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201454.446545:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00100000:3.0:1788201454.448240:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715400320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201454.548542:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201454.548612:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201454.548655:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201454.548822:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695544832 00000100:00100000:3.0:1788201454.548838:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695544832 00000100:00100000:2.0:1788201454.548885:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695544704 00000100:00100000:2.0:1788201454.548891:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695544704 00000100:00100000:3.0:1788201454.548913:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695544960 00000100:00100000:3.0:1788201454.548916:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695544960 00000100:00100000:2.0:1788201454.548933:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:3.0:1788201454.548939:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 63 00000100:00100000:2.0:1788201454.548944:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695544704:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201454.548945:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133701c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695544832:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201454.549085:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133701c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695544832:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 139us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201454.549093:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 63 00000100:00100000:3.0:1788201454.549124:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 64 00000100:00100000:3.0:1788201454.549131:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695544960:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201454.557149:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695544704:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 8186us (8515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201454.557172:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:3.0:1788201454.563410:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695544960:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 14260us (14735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201454.563431:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 64 00010000:00010000:1.0:1788201454.607703:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201455.637580:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201456.463964:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201456.463998:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715400576:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201456.464130:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201456.464226:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715400576 00000100:00100000:0.0:1788201456.464238:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715400576 00000100:00100000:0.0:1788201456.464317:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788201456.464341:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715400576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201456.464379:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788201456.464438:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715400576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201456.464452:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788201456.464520:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715400576:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788201456.464586:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788201456.655480:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201457.494838:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201457.494865:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715400704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201457.494940:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201457.495000:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715400704 00000100:00100000:3.0:1788201457.495443:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715400704 00000100:00100000:3.0:1788201457.495513:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1788201457.495605:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201457.495640:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715400704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201457.495686:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201457.495788:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715400704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 266us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201457.495795:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788201457.501906:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715400704:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788201457.681067:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201458.703330:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201459.023379:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201459.023403:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715400832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201459.023483:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201459.023891:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715400960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201459.023969:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715400832 00000100:00100000:0.0:1788201459.023977:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715400832 00000100:00100000:0.0:1788201459.024097:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788201459.024108:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715400832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201459.024145:0:66317:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445392384 avail 1299152896 00000100:00100000:2.0:1788201459.024317:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715401088:0@lo:400:kworker.0 00000100:00100000:1.0:1788201459.025222:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201459.025264:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715401472:0@lo:400:kworker.0 00000100:00100000:1.0:1788201459.025296:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201459.025313:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715401984:0@lo:400:kworker.0 00000100:00100000:1.0:1788201459.025351:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201459.025388:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715402496:0@lo:400:kworker.0 00000100:00100000:1.0:1788201459.025411:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201459.025445:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715401472 00000100:00100000:1.0:1788201459.025451:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715401472 00000100:00100000:1.0:1788201459.025523:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715402496 00000100:00100000:1.0:1788201459.025527:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715402496 00000100:00100000:1.0:1788201459.025551:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788201459.025559:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715401472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201459.025609:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715401472:12345-0@lo:400:kworker.0 Request processed in 50us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201459.025616:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788201459.025883:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788201459.025892:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715402496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201459.025926:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715402496:12345-0@lo:400:kworker.0 Request processed in 36us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201459.025932:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788201459.025951:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715401984 00000100:00100000:1.0:1788201459.025955:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715401984 00000100:00100000:1.0:1788201459.025985:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1776 00000100:00100000:1.0:1788201459.025992:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715401984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201459.026062:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715401984:12345-0@lo:400:kworker.0 Request processed in 71us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201459.026067:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1776 00000100:00080000:1.0:1788201459.026090:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201459.026095:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201459.026114:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715401344:0@lo:400:kworker.0 00000100:00100000:1.0:1788201459.026143:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201459.026175:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715401856:0@lo:400:kworker.0 00000100:00100000:1.0:1788201459.026200:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201459.026217:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715402368:0@lo:400:kworker.0 00000100:00100000:1.0:1788201459.026237:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201459.026258:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788201459.026265:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715401216:0@lo:400:kworker.0 00000100:00100000:1.0:1788201459.026287:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201459.026305:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715401728:0@lo:400:kworker.0 00000100:00100000:1.0:1788201459.026325:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201459.026355:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715402240:0@lo:400:kworker.0 00000100:00100000:1.0:1788201459.026376:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201459.026398:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715401344 00000100:00100000:1.0:1788201459.026402:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715401344 00000100:00100000:1.0:1788201459.026431:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715402368 00000100:00100000:1.0:1788201459.026434:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715402368 00000100:00100000:1.0:1788201459.026466:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788201459.026473:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715401344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201459.026806:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715401344:12345-0@lo:400:kworker.0 Request processed in 332us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201459.026813:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788201459.026828:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788201459.026834:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715402368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201459.026861:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715402368:12345-0@lo:400:kworker.0 Request processed in 28us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201459.026867:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1788201459.026879:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201459.026912:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715401344:0@lo:400:kworker.0 00000100:00100000:1.0:1788201459.026922:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715402368:0@lo:400:kworker.0 00000100:00100000:1.0:1788201459.026948:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715401472:0@lo:400:kworker.0 00000100:00100000:1.0:1788201459.026958:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715401984:0@lo:400:kworker.0 00000100:00100000:1.0:1788201459.026968:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715402496:0@lo:400:kworker.0 00000100:00100000:1.0:1788201459.027106:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715400960 00000100:00100000:1.0:1788201459.027111:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715400960 00000100:00100000:1.0:1788201459.027132:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715401216 00000100:00100000:1.0:1788201459.027134:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715401216 00000100:00100000:1.0:1788201459.027142:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715402240 00000100:00100000:1.0:1788201459.027145:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715402240 00000100:00100000:1.0:1788201459.027157:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788201459.027163:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:3657:x1875060715400960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201459.027191:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444933632 avail 1298694144 00000100:00100000:1.0:1788201459.027229:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:3657:x1875060715400960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (2010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201459.027235:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788201459.027250:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788201459.027256:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:3656:x1875060715401216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201459.027286:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:3656:x1875060715401216:12345-0@lo:400:kworker.0 Request processed in 31us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201459.027291:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788201459.027301:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788201459.027306:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715402240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201459.027767:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715402240:12345-0@lo:400:kworker.0 Request processed in 27us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201459.027783:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788201459.027816:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715401216:0@lo:400:kworker.0 00000100:00100000:1.0:1788201459.027826:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715402240:0@lo:400:kworker.0 00000100:00100000:1.0:1788201459.027855:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715400960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201459.027898:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715401856 00000100:00100000:1.0:1788201459.027902:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715401856 00000100:00100000:1.0:1788201459.027940:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715401728 00000100:00100000:1.0:1788201459.027944:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715401728 00000100:00100000:1.0:1788201459.027963:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1777 00000100:00100000:1.0:1788201459.027969:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715401856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201459.028142:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1778 00000100:00100000:0.0:1788201459.028150:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715401728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201459.028187:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715401728:12345-0@lo:400:kworker.0 Request processed in 39us (1861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201459.028193:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1778 00000100:00100000:0.0:1788201459.028227:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715400832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4122us (4744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201459.028233:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1788201459.028261:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201459.028264:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201459.028295:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715401728:0@lo:400:kworker.0 00000100:00100000:0.0:1788201459.028322:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715401856:0@lo:400:kworker.0 00000100:00100000:1.0:1788201459.028703:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715401856:12345-0@lo:400:kworker.0 Request processed in 41us (1808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201459.028710:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1777 00000100:00100000:2.0:1788201459.031067:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201459.031136:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715401600:0@lo:400:kworker.0 00000100:00100000:2.0:1788201459.031178:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201459.031205:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715402112:0@lo:400:kworker.0 00000100:00100000:2.0:1788201459.031227:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201459.031250:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715402624:0@lo:400:kworker.0 00000100:00100000:2.0:1788201459.031286:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201459.031334:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715401600 00000100:00100000:2.0:1788201459.031574:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715401600 00000100:00100000:2.0:1788201459.031691:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715402112 00000100:00100000:2.0:1788201459.031695:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715402112 00000100:00100000:2.0:1788201459.031725:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715402624 00000100:00100000:2.0:1788201459.031728:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715402624 00000100:00100000:2.0:1788201459.031742:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1779 00000100:00100000:2.0:1788201459.031749:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715401600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201459.031805:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715401600:12345-0@lo:400:kworker.0 Request processed in 55us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201459.031811:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1779 00000100:00100000:2.0:1788201459.031827:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1780 00000100:00100000:2.0:1788201459.031833:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715402112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201459.031857:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715402112:12345-0@lo:400:kworker.0 Request processed in 25us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201459.031862:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1780 00000100:00100000:2.0:1788201459.031872:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1781 00000100:00100000:2.0:1788201459.031877:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715402624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201459.031898:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715402624:12345-0@lo:400:kworker.0 Request processed in 21us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201459.031903:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1781 00000100:00080000:2.0:1788201459.031922:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201459.031950:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715401600:0@lo:400:kworker.0 00000100:00100000:2.0:1788201459.031961:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715402112:0@lo:400:kworker.0 00000100:00100000:2.0:1788201459.031981:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715402624:0@lo:400:kworker.0 00000100:00100000:3.0:1788201459.032149:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715400832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201459.033206:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715401088 00000100:00100000:1.0:1788201459.033213:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715401088 00000100:00100000:1.0:1788201459.033267:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788201459.033275:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715401088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201459.033356:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715401088:12345-0@lo:400:kworker.0 Request processed in 82us (2298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201459.033362:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788201459.034076:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715401088:0@lo:400:kworker.0 00000100:00100000:3.0:1788201459.538345:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715402752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201459.538534:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201459.538610:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715402752 00000100:00100000:3.0:1788201459.538619:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715402752 00000100:00100000:3.0:1788201459.538948:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788201459.538959:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715402752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201459.538988:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788201459.539085:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715402752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201459.539093:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788201459.539138:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715402752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201459.542539:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715402880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201459.542607:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201459.542658:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715402880 00000100:00100000:2.0:1788201459.542666:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715402880 00000100:00100000:2.0:1788201459.542709:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788201459.542718:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715402880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201459.542744:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201459.542785:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715402880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201459.542792:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788201459.542845:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715402880:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788201459.548507:0:102447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018888 is committed 00000001:00080000:3.0:1788201459.548537:0:102447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018886 is committed 00010000:00010000:2.0:1788201459.548766:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1e51e lrc: 3/0,1 mode: TXN/TXN res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201459.548781:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1e51e lrc: 2/0,0 mode: TXN/TXN res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201459.548790:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1e51e lrc: 3/0,0 mode: TXN/TXN res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201459.548797:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbca00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201459.548802:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1e51e lrc: 3/0,0 mode: TXN/TXN res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201459.548809:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1e51e lrc: 4/0,0 mode: TXN/TXN res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201459.548842:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x6:0x0].0xcd52553e (ffff8dc1421c6400) 00010000:00010000:2.0:1788201459.548845:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201459.548850:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1e51e lrc: 2/0,0 mode: --/TXN res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201459.548856:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1e51e lrc: 0/0,0 mode: --/TXN res: [0x2000090a1:0x6:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201459.549469:0:75739:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3200/0x96d0c9b8c9a1e579 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1e580 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201459.549483:0:75739:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3200/0x96d0c9b8c9a1e579 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1e580 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201459.549537:0:75739:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3200/0x96d0c9b8c9a1e579 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e580 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201459.549544:0:75739:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201459.549579:0:75739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3200/0x96d0c9b8c9a1e579 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e580 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201459.549595:0:75739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411495 is committed 00000100:00100000:3.0:1788201459.549674:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715403008:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1788201459.549702:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e533 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201459.549710:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e533 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201459.549715:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e533 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201459.549720:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201459.549723:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e533 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201459.549729:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e533 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201459.549739:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x6:0x0].0xf0209d98 (ffff8dc12196e800) 00010000:00010000:2.0:1788201459.549742:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201459.549745:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e533 lrc: 2/0,0 mode: --/TXN res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201459.549749:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201459.549751:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e533 lrc: 0/0,0 mode: --/TXN res: [0x2400088d0:0x6:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201459.549774:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1e548 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201459.549780:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1e548 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201459.549786:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1e548 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201459.549791:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ece00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201459.549793:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1e548 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201459.549798:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1e548 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201459.549805:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x6:0x0].0xd1d4b922 (ffff8dc12f13ab00) 00010000:00010000:2.0:1788201459.549808:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201459.549811:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1e548 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201459.549817:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1e548 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x6:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201459.550118:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715403008 00000100:00100000:1.0:1788201459.550125:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715403008 00000100:00100000:1.0:1788201459.550179:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:1.0:1788201459.550189:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133331500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3657:x1875060715403008:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1788201459.550212:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201459.550229:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1e580 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc9f42202 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e579 expref: 8 pid: 66317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201459.550241:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc9f42202 (ffff8dc12f13a700) 00010000:00010000:1.0:1788201459.550247:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201459.550329:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133331500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715403008:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 141us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201459.550337:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:3.0:1788201459.555662:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715403008:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1788201459.669981:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201459.670062:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201459.670086:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201459.670113:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201459.670150:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201459.670188:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695545600 00000100:00100000:3.0:1788201459.670198:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695545600 00000100:00100000:3.0:1788201459.670260:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695545472 00000100:00100000:3.0:1788201459.670263:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695545472 00000100:00100000:3.0:1788201459.670287:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 69 00000100:00100000:3.0:1788201459.670296:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695545600:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201459.670368:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695545600:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 73us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201459.670375:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 69 00000100:00100000:3.0:1788201459.670391:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 70 00000100:00100000:3.0:1788201459.670397:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695545472:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201459.670420:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695545472:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201459.670426:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 70 00000100:00100000:2.0:1788201459.670708:0:102459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695545088 00000100:00100000:2.0:1788201459.670713:0:102459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695545088 00000100:00100000:2.0:1788201459.670748:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 82 00000100:00100000:2.0:1788201459.670756:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695545088:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201459.670792:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695545088:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 37us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201459.670808:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 82 00000100:00100000:2.0:1788201459.670838:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695545344 00000100:00100000:2.0:1788201459.670841:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695545344 00000100:00100000:2.0:1788201459.670867:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695545216 00000100:00100000:2.0:1788201459.670869:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695545216 00000100:00100000:2.0:1788201459.670889:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1782 00000100:00100000:2.0:1788201459.670896:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695545344:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201459.670929:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695545344:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 34us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201459.670935:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1782 00000100:00100000:2.0:1788201459.670946:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1783 00000100:00100000:2.0:1788201459.670952:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2403:x1875060695545216:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201459.670977:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2403:x1875060695545216:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201459.670983:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1783 00000100:00080000:2.0:1788201459.671002:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201459.671005:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201459.671007:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201459.671009:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788201459.729107:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201460.754712:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201461.583306:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715403136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201461.583392:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201461.584065:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715403136 00000100:00100000:0.0:1788201461.584075:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715403136 00000100:00100000:0.0:1788201461.584145:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788201461.584155:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715403136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201461.584185:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788201461.584246:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715403136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201461.584253:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788201461.584356:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715403136:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788201461.584422:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788201461.775142:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201462.388916:0:103275:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 137b: DNE: create under striped dir, fail MDT2 ========================================================== 14:37:41 (1788201461) 00000100:00100000:2.0:1788201462.608664:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715403264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201462.608746:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201462.608932:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715403264 00000100:00100000:3.0:1788201462.608941:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715403264 00000100:00100000:3.0:1788201462.609039:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788201462.609063:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715403264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201462.609093:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201462.609147:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715403264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201462.609155:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788201462.609201:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715403264:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788201462.609477:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201462.729476:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201462.729576:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695545728 00000100:00100000:1.0:1788201462.729588:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695545728 00000100:00100000:1.0:1788201462.729689:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1755 00000100:00100000:1.0:1788201462.729702:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:77783:x1875060695545728:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:1.0:1788201462.729723:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201462.729755:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1e59c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786e76 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.729818:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1e5a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.729833:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1e5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.729846:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1e5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201462.729896:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788201462.729900:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201462.729922:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1e5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.729948:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1e59c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e76 expref: 8 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.729980:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1e5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e76 expref: 7 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.729990:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008723a00) 00010000:00010000:1.0:1788201462.729993:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201462.729997:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e3000, rc 0) 00000100:00100000:0.0:1788201462.733074:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:77783:x1875060695545728:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 3363us (3594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201462.733089:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1755 00000100:00080000:2.0:1788201462.733678:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201462.754135:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201462.754241:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695545984 00000100:00100000:2.0:1788201462.754250:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695545984 00000100:00100000:2.0:1788201462.754331:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1756 00000100:00100000:2.0:1788201462.754343:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:77783:x1875060695545984:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:2.0:1788201462.754364:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201462.754388:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e5aa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786e7d expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201462.754503:0:69485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:69485:1875060715403392:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788201462.754558:0:69485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201462.754596:0:69485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12580ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201462.754676:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715403392 00000100:00100000:1.0:1788201462.754693:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715403392 00000100:00100000:1.0:1788201462.754744:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788201462.754751:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:69485:x1875060715403392:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788201462.754825:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:69485:x1875060715403392:12345-0@lo:1000:mdt00_004.0 Request processed in 75us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201462.754833:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788201462.754871:0:69485:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018888 gen 3 00000004:00080000:1.0:1788201462.754877:0:69485:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018884 committed transno 128849018888 00000020:00080000:1.0:1788201462.754883:0:69485:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8dc125a96d80 refcount 2 committed 0 result 0 batchid 73014444100 00000020:00080000:1.0:1788201462.754887:0:69485:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc140db9a00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8dc125a96e40 00000020:00080000:1.0:1788201462.754890:0:69485:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000090a1:0x1:0x0].11 00000020:00080000:1.0:1788201462.754893:0:69485:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc140db9800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dc11cce3800 00000020:00080000:1.0:1788201462.754895:0:69485:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2400088d0:0x1:0x0].12 00000004:00080000:1.0:1788201462.754920:0:69485:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018887 committed transno 128849018888 00000020:00080000:1.0:1788201462.754924:0:69485:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8dc006ccfa80 refcount 2 committed 0 result 0 batchid 73014444101 00000020:00080000:1.0:1788201462.754927:0:69485:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc140d8cb00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8dc006ccf900 00000020:00080000:1.0:1788201462.754930:0:69485:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000090a1:0x1:0x0].12 00000020:00080000:1.0:1788201462.754932:0:69485:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc140d8c900 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dc12e6f5a00 00000020:00080000:1.0:1788201462.754935:0:69485:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2400088d0:0x1:0x0].13 00000004:00080000:1.0:1788201462.754947:0:69485:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018888 committed transno 128849018888 00000020:00080000:1.0:1788201462.754951:0:69485:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8dc125a96a80 refcount 2 committed 0 result 0 batchid 73014444102 00000020:00080000:1.0:1788201462.754953:0:69485:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc140db9100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8dc125a96780 00000020:00080000:1.0:1788201462.754956:0:69485:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000090a1:0x1:0x0].13 00000020:00080000:1.0:1788201462.754958:0:69485:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc140db9700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dc11cce3e00 00000020:00080000:1.0:1788201462.754960:0:69485:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2400088d0:0x1:0x0].14 00000100:00100000:1.0:1788201462.754995:0:69485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:69485:1875060715403392:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788201462.755059:0:69485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab57480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:69485:1875060715403520:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788201462.755086:0:69485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201462.755099:0:69485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0034c7240 going to sleep for 11 seconds 00000020:00080000:1.0:1788201462.755111:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444102 committed batchid 73014444099 00000020:00080000:1.0:1788201462.755179:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444099 00000100:00100000:2.0:1788201462.755341:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715403520 00000100:00100000:2.0:1788201462.755346:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715403520 00000100:00100000:2.0:1788201462.755380:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788201462.755387:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:69485:x1875060715403520:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788201462.755467:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:69485:x1875060715403520:12345-0@lo:1000:mdt00_004.0 Request processed in 80us (380us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201462.755474:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788201462.755543:0:69485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab57480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:69485:1875060715403520:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1788201462.755587:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e5b1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201462.755596:0:69485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e5b1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201462.755605:0:69485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e5b1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201462.755616:0:69485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:69485:1875060715403648:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1788201462.755643:0:69485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201462.755665:0:69485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004e40480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201462.755713:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715403648 00000100:00100000:1.0:1788201462.755718:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715403648 00000100:00100000:1.0:1788201462.755747:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788201462.755753:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:69485:x1875060715403648:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1788201462.755760:0:66318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201462.755774:0:66318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1e5b8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e5b1 expref: -99 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.755794:0:66318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1e5a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e76 expref: 6 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.755804:0:66318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1e5b8 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e5b1 expref: 8 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.755824:0:66318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1e5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e76 expref: 6 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.755836:0:66318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1e5a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e76 expref: 6 pid: 66314 timeout: 4414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201462.755846:0:66318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab56d80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:66318:1875060715403776:192.168.201.20@tcp:104: 00000100:00100000:1.0:1788201462.755919:0:66318:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0034c7b40 going to sleep for 11 seconds 00000100:00080000:0.0:1788201462.756382:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201462.763658:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201462.763803:0:66318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab56d80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:66318:1875060715403776:192.168.201.20@tcp:104: 00010000:00010000:1.0:1788201462.763849:0:66318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1e5b8 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e5b1 expref: 8 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.763863:0:66318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008723a00) 00010000:00010000:1.0:1788201462.763867:0:66318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201462.763872:0:66318:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1e5b8 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e5b1 expref: 8 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.763883:0:66318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e3400, rc 0) 00000100:00100000:1.0:1788201462.763946:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:69485:x1875060715403648:12345-0@lo:101:mdt00_004.0 Request processed in 8192us (8302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201462.763956:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788201462.764064:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695546112 00000100:00100000:2.0:1788201462.764073:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695546112 00000100:00100000:3.0:1788201462.764108:0:69485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:69485:1875060715403648:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1788201462.764109:0:26207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1e5a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e76 expref: 7 pid: 66314 timeout: 4414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201462.764125:0:69485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e5b1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e5b8 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201462.764136:0:69485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e5b1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e5b8 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201462.764140:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2629 00000100:00100000:2.0:1788201462.764148:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10a226c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2402:x1875060695546112:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201462.764161:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201462.764175:0:26207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1e5a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e76 expref: 7 pid: 66314 timeout: 4414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.764187:0:26207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1e5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e76 expref: 7 pid: 66314 timeout: 4414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.764209:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1e5a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e76 expref: 7 pid: 66314 timeout: 4414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.764223:0:26207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008723a00) 00010000:00010000:2.0:1788201462.764227:0:26207:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1e5b8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e5b1 expref: 7 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.764236:0:26207:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1e5b8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e5b1 expref: 7 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.764244:0:26207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1e5b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e5b1 expref: 7 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.764284:0:26207:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1e5b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e5b1 expref: 7 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201462.764296:0:26207:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:26207:1875060715403904:0@lo:105: 00000100:00100000:2.0:1788201462.764331:0:26207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201462.764370:0:26207:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12580e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201462.764542:0:95383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715403904 00000100:00100000:0.0:1788201462.764547:0:95383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715403904 00000100:00100000:0.0:1788201462.764582:0:95383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788201462.764589:0:95383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:26207:x1875060715403904:12345-0@lo:105: 00010000:00010000:0.0:1788201462.764598:0:95383:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e5b1 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e5b8 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.764607:0:95383:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e5b1 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e5b8 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.764615:0:95383:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e5b1 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e5b8 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.764632:0:95383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e5b1 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x96d0c9b8c9a1e5b8 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.764639:0:95383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e5b1 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x96d0c9b8c9a1e5b8 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.764646:0:95383:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e5b1 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x96d0c9b8c9a1e5b8 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.764666:0:95383:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8dc125ae2c00) 00000100:00100000:0.0:1788201462.764739:0:95383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:26207:x1875060715403904:12345-0@lo:105: Request processed in 150us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201462.764746:0:95383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00010000:00010000:3.0:1788201462.764811:0:69485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e5b1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e5b8 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201462.764821:0:69485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e5b1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e5b8 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788201462.764842:0:69485:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1788201462.764874:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3000/0x96d0c9b8c9a1e5bf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201462.764882:0:69485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3000/0x96d0c9b8c9a1e5bf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201462.764891:0:69485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3000/0x96d0c9b8c9a1e5bf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201462.764905:0:69485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:69485:1875060715404032:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1788201462.764933:0:69485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201462.764977:0:69485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004e40480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201462.765036:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715404032 00000100:00100000:0.0:1788201462.765040:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715404032 00000100:00100000:0.0:1788201462.765073:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788201462.765080:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:69485:x1875060715404032:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1788201462.765094:0:66317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201462.765109:0:66317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1e5c6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e5bf expref: -99 pid: 66317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.765126:0:66317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1e5c6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e5bf expref: 9 pid: 66317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.765136:0:66317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1e5c6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e5bf expref: 9 pid: 66317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.765156:0:66317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb56adc53 (ffff8dc103a9bf00) 00010000:00010000:0.0:1788201462.765158:0:66317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201462.765161:0:66317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d7a00, rc 0) 00000100:00100000:0.0:1788201462.765192:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:69485:x1875060715404032:12345-0@lo:101:mdt00_004.0 Request processed in 112us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201462.765198:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788201462.765239:0:69485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:69485:1875060715404032:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1788201462.765251:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3000/0x96d0c9b8c9a1e5bf lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e5c6 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.765260:0:69485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3000/0x96d0c9b8c9a1e5bf lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e5c6 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201462.765272:0:69485:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1788201462.765299:0:69485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133702d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:69485:1875060715404160:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788201462.765326:0:69485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201462.765340:0:69485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1065c7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201462.765462:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715404160 00000100:00100000:3.0:1788201462.765467:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715404160 00000100:00100000:3.0:1788201462.765497:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788201462.765503:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:69485:x1875060715404160:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788201462.765560:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:69485:x1875060715404160:12345-0@lo:1000:mdt00_004.0 Request processed in 57us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201462.765567:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788201462.765687:0:69485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133702d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:69485:1875060715404160:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788201462.765795:0:69485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133702d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:69485:1875060715404288:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788201462.765822:0:69485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201462.765883:0:69485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006c0a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201462.767948:0:26207:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:26207:1875060715403904:0@lo:105: 00010000:00010000:2.0:1788201462.767984:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201462.768464:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10a226c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695546112:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 4313us (4814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201462.768476:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2629 00000100:00100000:3.0:1788201462.775954:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715404288 00000100:00100000:3.0:1788201462.776001:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715404288 00000100:00100000:3.0:1788201462.776088:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788201462.776099:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:69485:x1875060715404288:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788201462.777489:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:69485:x1875060715404288:12345-0@lo:1000:mdt00_004.0 Request processed in 1387us (11661us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201462.777501:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788201462.781326:0:69485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133702d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:69485:1875060715404288:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788201462.781464:0:69485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133702d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:69485:1875060715404416:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788201462.781528:0:69485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201462.781566:0:69485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006c0ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201462.781581:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715404416 00000100:00100000:2.0:1788201462.781600:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715404416 00000100:00100000:2.0:1788201462.781651:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788201462.781660:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:69485:x1875060715404416:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788201462.781765:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:69485:x1875060715404416:12345-0@lo:1000:mdt00_004.0 Request processed in 105us (236us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201462.781773:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788201462.781933:0:69485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133702d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:69485:1875060715404416:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788201462.781986:0:69485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133702d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:69485:1875060715404544:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788201462.782008:0:69485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201462.782048:0:69485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006c0a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788201462.782091:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715404544 00000100:00100000:3.0:1788201462.782096:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715404544 00000100:00100000:3.0:1788201462.782130:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788201462.782137:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133702680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:69485:x1875060715404544:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788201462.782197:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133702680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:69485:x1875060715404544:12345-0@lo:1000:mdt00_004.0 Request processed in 61us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201462.782418:0:69485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133702d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:69485:1875060715404544:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788201462.782458:0:69485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133702d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:69485:1875060715404672:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788201462.782481:0:69485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201462.782503:0:69485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006c0ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201462.782537:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788201462.782550:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715404672 00000100:00100000:2.0:1788201462.782555:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715404672 00000100:00100000:2.0:1788201462.782586:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788201462.782593:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:69485:x1875060715404672:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788201462.782662:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:69485:x1875060715404672:12345-0@lo:1000:mdt00_004.0 Request processed in 69us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201462.782668:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788201462.782711:0:69485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133702d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:69485:1875060715404672:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788201462.782758:0:69485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133702d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:69485:1875060715404800:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788201462.782781:0:69485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201462.782803:0:69485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006c0a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788201462.782905:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715404800 00000100:00100000:3.0:1788201462.782909:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715404800 00000100:00100000:3.0:1788201462.782938:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788201462.782945:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:69485:x1875060715404800:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788201462.783006:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:69485:x1875060715404800:12345-0@lo:1000:mdt00_004.0 Request processed in 61us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201462.783045:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788201462.783104:0:69485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133702d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:69485:1875060715404800:0@lo:1000:mdt00_004.0 00000040:00080000:0.0:1788201462.783664:0:69485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x1:0x0].15, 1000 off50104 00000040:00080000:0.0:1788201462.783855:0:69485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x1:0x0].14, 1152 off49864 00000004:00080000:0.0:1788201462.783863:0:69485:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc006c0ac00 with version 31 00000004:00080000:3.0:1788201462.785923:0:75745:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc007566d80 version 31 rpc_version 31 00000020:00100000:3.0:1788201462.785979:0:75745:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788201462.785990:0:75745:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc1060cd500 x1875060715405056/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201462.786031:0:75745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cd500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715405056:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201462.786121:0:75745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201462.786163:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004e406c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201462.786467:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715405056 00000100:00100000:1.0:1788201462.786475:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715405056 00000100:00100000:1.0:1788201462.786533:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788201462.786542:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:75745:x1875060715405056:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788201462.787082:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:75745:x1875060715405056:12345-0@lo:1000:osp_up0-1.0 Request processed in 540us (960us total) trans 128849018889 rc 0/0 00000100:00100000:1.0:1788201462.787090:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788201462.787438:0:75745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cd500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715405056:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1788201462.787537:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x9:0x0]: returning size 4096 00010000:00010000:0.0:1788201462.787566:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1e5cd lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.787583:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1e5cd lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.787607:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1e5cd lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201462.787620:0:69485:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1788201462.787631:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e5b1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e5b8 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.787638:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e5b1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e5b8 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.787645:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e5b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e5b8 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.787669:0:69485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788201462.787674:0:69485:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1788201462.787679:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3000/0x96d0c9b8c9a1e5bf lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e5c6 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.787687:0:69485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3000/0x96d0c9b8c9a1e5bf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e5c6 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.787735:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201462.787742:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e5b1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e5b8 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.787743:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e5aa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e7d expref: 8 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.787752:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2c00 already unused, calling callback (ffffffffc189cee0) 00010000:00010000:1.0:1788201462.787756:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e5b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1e5b8 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.787767:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1e5cd lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e7d expref: 7 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201462.787771:0:24979:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e5b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1e5b8 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.787775:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0x0 (ffff8dc103a9b500) 00010000:00010000:0.0:1788201462.787782:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201462.787786:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d7800, rc 0) 00010000:00010000:1.0:1788201462.787799:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e5b1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e5b8 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.787804:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788201462.787836:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:77783:x1875060695545984:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 33496us (33711us total) trans 77309411496 rc 0/0 00000100:00100000:0.0:1788201462.787844:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1756 00000100:00100000:2.0:1788201462.787858:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715405184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201462.787898:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201462.787975:0:9535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715405184 00000100:00100000:0.0:1788201462.787982:0:9535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715405184 00000100:00100000:0.0:1788201462.788044:0:9535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:0.0:1788201462.788052:0:9535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3656:x1875060715405184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201462.788063:0:9535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201462.788078:0:9535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1e5b8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e5b1 expref: 10 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.788090:0:9535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008723a00) 00010000:00010000:0.0:1788201462.788093:0:9535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201462.788153:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e5b1 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e5b8 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.788163:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e5b1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e5b8 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.788174:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201462.788175:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201462.788177:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201462.793163:0:9535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3656:x1875060715405184:12345-0@lo:103:ldlm_bl.0 Request processed in 5101us (5253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201462.793178:0:9535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00100000:2.0:1788201462.798522:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715405184:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201462.799170:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201462.806118:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201462.806580:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695546240 00000100:00100000:2.0:1788201462.806591:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695546240 00000100:00100000:2.0:1788201462.806652:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1757 00000100:00100000:2.0:1788201462.806663:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:77785:x1875060695546240:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1788201462.806683:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201462.806703:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e5d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786e84 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.806769:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e5db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.806798:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e5db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.806806:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e5db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201462.806842:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788201462.806845:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201462.806859:0:66312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e5db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.806877:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e5d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e84 expref: 8 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.806888:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e5db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e84 expref: 7 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.806894:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008723a00) 00010000:00010000:2.0:1788201462.806897:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201462.806899:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbd000, rc 0) 00000100:00100000:2.0:1788201462.807133:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:77785:x1875060695546240:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 471us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201462.807141:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1757 00000100:00100000:0.0:1788201462.811874:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201462.812176:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695546368 00000100:00100000:1.0:1788201462.812186:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695546368 00000100:00100000:1.0:1788201462.812249:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1758 00000100:00100000:1.0:1788201462.812259:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:77785:x1875060695546368:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1788201462.812280:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201462.812301:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1e5e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786e8b expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.812377:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1e5e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.812409:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1e5e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.812421:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1e5e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.812443:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1e5f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.812454:0:66314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1e5c6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e5bf expref: 8 pid: 66317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.812461:0:66314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1e5f0 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.812494:0:66314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1e5c6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1e5bf expref: 8 pid: 66317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201462.812510:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66314:1875060715405312:0@lo:104: 00000100:00100000:1.0:1788201462.812560:0:66314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201462.812605:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0034c7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788201462.812743:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715405312 00000100:00100000:0.0:1788201462.812748:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715405312 00000100:00100000:0.0:1788201462.812784:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1788201462.812792:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:66314:x1875060715405312:12345-0@lo:104: 00010000:00010000:0.0:1788201462.812805:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3000/0x96d0c9b8c9a1e5bf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1e5c6 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.812875:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788201462.812881:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:66314:x1875060715405312:12345-0@lo:104: Request processed in 90us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201462.812894:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00010000:00010000:1.0:1788201462.813519:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201462.813528:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3000/0x96d0c9b8c9a1e5bf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1e5c6 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.813537:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3000 already unused, calling callback (ffffffffc189cee0) 00010000:00010000:1.0:1788201462.813542:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3000/0x96d0c9b8c9a1e5bf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1e5c6 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201462.813563:0:6520:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3000/0x96d0c9b8c9a1e5bf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1e5c6 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.813593:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3000/0x96d0c9b8c9a1e5bf lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1e5c6 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.813599:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201462.813635:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3000/0x96d0c9b8c9a1e5bf lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1e5c6 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.813643:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc125ae3000/0x96d0c9b8c9a1e5bf lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1e5c6 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.813662:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201462.813664:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201462.813665:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201462.813693:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:66314:1875060715405312:0@lo:104: 00010000:00010000:1.0:1788201462.813719:0:66314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1e5f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201462.813837:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715405440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201462.813882:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201462.814012:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715405440 00000100:00100000:1.0:1788201462.814058:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715405440 00010000:00010000:1.0:1788201462.814080:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1e5c6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1e5bf expref: 9 pid: 66317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201462.814105:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2630 00000100:00100000:1.0:1788201462.814113:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3657:x1875060715405440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201462.814131:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1788201462.817128:0:102447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018889 is committed 00010000:00010000:2.0:1788201462.817253:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1e5c6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1e5bf expref: 8 pid: 66317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.817302:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb56adc53 (ffff8dc103a9bf00) 00010000:00010000:2.0:1788201462.817308:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1e5f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.817318:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1e5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.817325:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1e5f0 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.817361:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201462.817491:0:66314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1e5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.817499:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1e5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201462.817601:0:66314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:66314:1875060715405568:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788201462.817638:0:66314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201462.817673:0:66314:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0034c76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201462.817787:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715405568 00000100:00100000:0.0:1788201462.817794:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715405568 00000100:00100000:0.0:1788201462.817835:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788201462.817843:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:66314:x1875060715405568:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788201462.817911:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:66314:x1875060715405568:12345-0@lo:1000:mdt00_002.0 Request processed in 68us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201462.817918:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788201462.817953:0:66314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:66314:1875060715405568:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788201462.818009:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1e5f7 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.818044:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1e5f7 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.818053:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1e5f7 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201462.818072:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1e5f7 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.818084:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1e5e9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.818091:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1e5e9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.818097:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1e5e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.818114:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1e5e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.818120:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201462.818124:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1e5e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.818131:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1e5e9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.818140:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008723a00) 00010000:00010000:0.0:1788201462.818142:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201462.818146:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1e5e9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.818152:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1e5e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.818163:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1e5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.818168:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1e5f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.818174:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1e5f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.818179:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201462.818182:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1e5f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.818194:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1e5f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.818201:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb56adc53 (ffff8dc103a9bf00) 00010000:00010000:0.0:1788201462.818204:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201462.818206:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1e5f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.818212:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1e5f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.818247:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1e5e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e8b expref: 9 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.818260:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1e5f7 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e8b expref: 8 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.818267:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0x0 (ffff8dc103a9b800) 00010000:00010000:0.0:1788201462.818269:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201462.818271:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d7000, rc 0) 00000100:00100000:0.0:1788201462.818313:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:77785:x1875060695546368:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 6057us (6451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201462.818319:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1758 00000100:00100000:2.0:1788201462.818620:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715405440:12345-0@lo:103:ldlm_bl.0 Request processed in 4507us (4736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201462.818629:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2630 00000100:00100000:3.0:1788201462.820130:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715405440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201462.824353:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201462.824915:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695546496 00000100:00100000:0.0:1788201462.824926:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695546496 00000100:00100000:0.0:1788201462.825003:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1759 00000100:00100000:0.0:1788201462.825113:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:77785:x1875060695546496:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788201462.825158:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201462.825179:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7e00/0x96d0c9b8c9a1e5fe lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786e92 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.825516:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1e605 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.825533:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1e605 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.825545:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1e605 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201462.825597:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x9:0x0]: returning size 4096 00000004:00200000:0.0:1788201462.825602:0:69485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1788201462.825640:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7e00/0x96d0c9b8c9a1e5fe lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e92 expref: 9 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.825658:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1e605 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e92 expref: 8 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.825667:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0x0 (ffff8dc103a9b500) 00010000:00010000:0.0:1788201462.825670:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1788201462.825674:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d6800, rc 0) 00000100:00100000:0.0:1788201462.825804:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:77785:x1875060695546496:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 791us (1470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201462.825811:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1759 00000100:00100000:0.0:1788201462.829368:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201462.829465:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695546624 00000100:00100000:2.0:1788201462.829476:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695546624 00000100:00100000:2.0:1788201462.829537:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1760 00000100:00100000:2.0:1788201462.829547:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133703100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:77785:x1875060695546624:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1788201462.829569:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201462.829590:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e60c lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786e99 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.829654:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1e613 lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.829668:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1e613 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.829679:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1e613 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.829708:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e61a lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.829715:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e61a lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.829723:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e61a lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.829768:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1e613 lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.829776:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1e613 lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.829783:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1e613 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.829789:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1e613 lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.829795:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201462.829799:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1e613 lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.829807:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1e613 lrc: 5/0,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.829819:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0x0 (ffff8dc103a9b500) 00010000:00010000:2.0:1788201462.829823:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201462.829827:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1e613 lrc: 3/0,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.829839:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1e613 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.829853:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e61a lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.829859:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e61a lrc: 2/0,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.829864:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e61a lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.829867:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201462.829869:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e61a lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.829873:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e61a lrc: 4/0,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.829877:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0xd1d4b922 (ffff8dc103a3a300) 00010000:00010000:2.0:1788201462.829879:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201462.829881:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e61a lrc: 2/0,0 mode: --/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.829884:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e61a lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.829908:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e60c lrc: 1/0,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e99 expref: 9 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.829923:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0x0 (ffff8dc103a9b500) 00010000:00010000:2.0:1788201462.829924:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201462.829927:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e60c lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e99 expref: 9 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.829933:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbc800, rc 0) 00000100:00100000:2.0:1788201462.830002:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133703100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:77785:x1875060695546624:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 453us (642us total) trans 0 rc 301/301 00000100:00100000:2.0:1788201462.830011:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1760 00000100:00100000:3.0:1788201462.831197:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201462.831284:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695546752 00000100:00100000:1.0:1788201462.831291:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695546752 00000100:00100000:1.0:1788201462.831358:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 751 00000100:00100000:1.0:1788201462.831367:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2403:x1875060695546752:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201462.831380:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201462.831398:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1e605 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e92 expref: 8 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.831414:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0x0 (ffff8dc103a9b500) 00010000:00010000:1.0:1788201462.831419:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201462.831471:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695546752:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 105us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201462.831477:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 751 00000100:00100000:1.0:1788201462.840634:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201462.840710:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695547008 00000100:00100000:0.0:1788201462.840744:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695547008 00000100:00100000:0.0:1788201462.840805:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1761 00000100:00100000:0.0:1788201462.840816:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:77785:x1875060695547008:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788201462.840835:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201462.840857:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7e00/0x96d0c9b8c9a1e621 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ea0 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201462.840953:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x9:0x0]: returning size 4096 00010000:00010000:0.0:1788201462.841101:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7e00/0x96d0c9b8c9a1e621 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ea0 expref: 9 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.841116:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a9bf00) 00010000:00010000:0.0:1788201462.841119:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201462.841124:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7e00/0x96d0c9b8c9a1e621 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ea0 expref: 9 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201462.841142:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d7e00, rc 0) 00000100:00100000:0.0:1788201462.841199:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:77785:x1875060695547008:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 384us (574us total) trans 77309411497 rc 301/301 00000100:00100000:0.0:1788201462.841205:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1761 00000100:00100000:0.0:1788201462.853871:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201462.854408:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695547264 00000100:00100000:1.0:1788201462.854536:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695547264 00000100:00100000:1.0:1788201462.854651:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1762 00000100:00100000:1.0:1788201462.854674:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:77785:x1875060695547264:12345-192.168.201.20@tcp:36:lfs.0 00010000:00010000:1.0:1788201462.854746:0:69485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201462.854772:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1e5cd lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e7d expref: 8 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.854790:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0x0 (ffff8dc103a9b500) 00010000:00010000:1.0:1788201462.854800:0:69485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201462.854859:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e62f lrc: 3/0,1 mode: --/CW res: [0x2400088d5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.854873:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e62f lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.854894:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e62f lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.854906:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1e636 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.854914:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1e636 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201462.854920:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1e636 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201462.855790:0:69485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400088d0:0x1:0x0].16, 2152 off52256 00000040:00080000:1.0:1788201462.855865:0:69485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000090a1:0x1:0x0].15, 2352 off52216 00000004:00080000:1.0:1788201462.855871:0:69485:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc0034c7a80 with version 32 00000004:00080000:0.0:1788201462.855951:0:75745:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc007566d80 version 32 rpc_version 32 00000020:00100000:0.0:1788201462.855993:0:75745:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788201462.856002:0:75745:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc133702300 x1875060715405824/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201462.856050:0:75745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133702300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715405824:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788201462.856133:0:75745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201462.856172:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc120888600 going to sleep for 11 seconds 00000100:00100000:1.0:1788201462.857091:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715405824 00000100:00100000:1.0:1788201462.857109:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715405824 00000100:00100000:1.0:1788201462.857203:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788201462.857213:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118102c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:75745:x1875060715405824:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788201462.857695:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118102c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:75745:x1875060715405824:12345-0@lo:1000:osp_up0-1.0 Request processed in 482us (1560us total) trans 128849018890 rc 0/0 00000100:00100000:1.0:1788201462.857702:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788201462.857937:0:75745:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018889 gen 3 00000004:00080000:2.0:1788201462.857943:0:75745:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018889 committed transno 128849018889 00000100:00100000:2.0:1788201462.857974:0:75745:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8dc133702300 x1875060715405824/t128849018890(128849018890) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 3960/4320 e 0 to 0 dl 1788201478 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201462.858008:0:75745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133702300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715405824:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1788201462.858156:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e63d lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.858173:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e63d lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.858185:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e63d lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.858205:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e644 lrc: 3/0,1 mode: --/PW res: [0x2400088d0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.858211:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e644 lrc: 3/0,1 mode: PW/PW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.858227:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e644 lrc: 3/0,1 mode: PW/PW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.858256:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbd600/0x96d0c9b8c9a1e64b lrc: 3/0,1 mode: --/PW res: [0x2000090a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.858263:0:69485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbd600/0x96d0c9b8c9a1e64b lrc: 3/0,1 mode: --/PW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.858272:0:69485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbd600/0x96d0c9b8c9a1e64b lrc: 3/0,1 mode: --/PW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201462.858290:0:69485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:69485:1875060715405952:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1788201462.858322:0:69485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201462.860529:0:69485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12580e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201462.861732:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715405952 00000100:00100000:0.0:1788201462.861743:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715405952 00000100:00100000:3.0:1788201462.861897:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788201462.861917:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:69485:x1875060715405952:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1788201462.861944:0:101344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201462.861974:0:101344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1e652 lrc: 2/0,0 mode: --/PW res: [0x2000090a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e64b expref: -99 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201462.862000:0:101344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1e652 lrc: 3/0,0 mode: PW/PW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e64b expref: 9 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201462.862011:0:101344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1e652 lrc: 3/0,0 mode: PW/PW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e64b expref: 9 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201462.862029:0:101344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x7:0x0].0x0 (ffff8dc12196eb00) 00010000:00010000:3.0:1788201462.862031:0:101344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201462.862034:0:101344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2400, rc 0) 00000100:00100000:3.0:1788201462.862098:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:69485:x1875060715405952:12345-0@lo:101:mdt00_004.0 Request processed in 184us (3775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201462.862103:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788201462.862172:0:69485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:69485:1875060715405952:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1788201462.862187:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbd600/0x96d0c9b8c9a1e64b lrc: 4/0,1 mode: PW/PW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e652 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.862195:0:69485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbd600/0x96d0c9b8c9a1e64b lrc: 4/0,1 mode: PW/PW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e652 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201462.862213:0:69485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004541320f reply state 00000000c53fe352 transno 77309411498 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e644 lrc: 3/0,1 mode: PW/PW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.862222:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e644 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.862226:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x7:0x0].0x0 (ffff8dc103a3ac00) 00010000:00010000:2.0:1788201462.862240:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201462.862243:0:69485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201462.862248:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbd600/0x96d0c9b8c9a1e64b lrc: 4/0,1 mode: PW/PW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e652 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.862253:0:69485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbd600/0x96d0c9b8c9a1e64b lrc: 3/0,0 mode: PW/PW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e652 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201462.862262:0:69485:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000090a1:0x7:0x0] 00000004:00010000:2.0:1788201462.862267:0:69485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004541320f reply state 00000000c53fe352 transno 77309411498 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e63d lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.862274:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e63d lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.862279:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xa:0x0].0x0 (ffff8dc103a3a300) 00010000:00010000:2.0:1788201462.862281:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201462.862283:0:69485:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1788201462.862289:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788201462.862300:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e62f lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.862305:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e62f lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.862311:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e62f lrc: 3/0,0 mode: CW/CW res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.862318:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e62f lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.862324:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201462.862328:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e62f lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.862348:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e62f lrc: 5/0,0 mode: CW/CW res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.862360:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0x0 (ffff8dc12f13a100) 00010000:00010000:2.0:1788201462.862362:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201462.862366:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e62f lrc: 3/0,0 mode: --/CW res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.862373:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e62f lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201462.862393:0:69485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004541320f reply state 00000000c53fe352 transno 77309411498 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1e636 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.862402:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1e636 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201462.862406:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0xd1d4b922 (ffff8dc12f13a800) 00010000:00010000:2.0:1788201462.862408:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201462.862409:0:69485:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1788201462.862501:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:77785:x1875060695547264:12345-192.168.201.20@tcp:36:lfs.0 Request processed in 7839us (8639us total) trans 77309411498 rc 0/0 00000100:00100000:2.0:1788201462.862506:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1762 00000100:00100000:1.0:1788201462.866674:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201462.868262:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695547520 00000100:00100000:2.0:1788201462.868275:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695547520 00000100:00100000:2.0:1788201462.869286:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 307 00000100:00100000:2.0:1788201462.869302:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:77785:x1875060695547520:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:2.0:1788201462.869677:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:77785:x1875060695547520:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 378us (3009us total) trans 77309411499 rc 0/0 00000100:00100000:2.0:1788201462.869703:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 307 00000001:00080000:2.0:1788201463.669610:0:102447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018890 is committed 00010000:00010000:0.0:1788201463.669886:0:75739:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbd600/0x96d0c9b8c9a1e64b lrc: 3/0,0 mode: PW/PW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1e652 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201463.669903:0:75739:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbd600/0x96d0c9b8c9a1e64b lrc: 3/0,0 mode: PW/PW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1e652 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201463.669946:0:75739:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbd600/0x96d0c9b8c9a1e64b lrc: 2/0,0 mode: --/PW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e652 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201463.669962:0:75739:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201463.670000:0:75739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbd600/0x96d0c9b8c9a1e64b lrc: 0/0,0 mode: --/PW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e652 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788201463.670043:0:75739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411499 is committed 00000020:00080000:0.0:1788201463.670058:0:75739:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8dc006c0a840 refcount 2 committed 0 result 0 batchid 73014444103 00000020:00080000:0.0:1788201463.670062:0:75739:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc12f1f2100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8dc006c0ac00 00000020:00080000:0.0:1788201463.670065:0:75739:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000090a1:0x1:0x0].14 00000020:00080000:0.0:1788201463.670067:0:75739:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc12f1f2700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dc005dc2000 00000020:00080000:0.0:1788201463.670070:0:75739:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2400088d0:0x1:0x0].15 00000020:00080000:0.0:1788201463.670080:0:75739:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444102 batchid updated 00000020:00080000:0.0:1788201463.670093:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444103 committed batchid 73014444102 00000100:00100000:1.0:1788201463.670269:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715406080:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1788201463.670342:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788201463.671011:0:75759:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc120888cc0 with version 33 00000020:00080000:0.0:1788201463.671053:0:75759:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444100 cancel update log [0x2000090a1:0x1:0x0].11: rc = 0 00000020:00080000:0.0:1788201463.671101:0:75759:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444100 cancel update log [0x2400088d0:0x1:0x0].12: rc = 0 00000004:00080000:0.0:1788201463.671122:0:75759:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc120888480 with version 34 00000020:00080000:0.0:1788201463.671136:0:75759:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444101 cancel update log [0x2000090a1:0x1:0x0].12: rc = 0 00010000:00010000:2.0:1788201463.671276:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1e636 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.671286:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1e636 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.671294:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1e636 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.671300:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201463.671305:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1e636 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.671311:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1e636 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.671329:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0xd1d4b922 (ffff8dc12f13a800) 00010000:00010000:2.0:1788201463.671332:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201463.671337:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1e636 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.671343:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1e636 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.671484:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e63d lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.671491:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e63d lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.671503:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e63d lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.671508:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201463.671511:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e63d lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.671516:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e63d lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.671526:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xa:0x0].0x0 (ffff8dc103a3a300) 00010000:00010000:2.0:1788201463.671529:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201463.671532:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e63d lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.671538:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e63d lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.671550:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e644 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.671555:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e644 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.671561:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e644 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.671565:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201463.671567:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e644 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.671582:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e644 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.671589:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x7:0x0].0x0 (ffff8dc103a3ac00) 00010000:00010000:2.0:1788201463.671591:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201463.671594:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e644 lrc: 2/0,0 mode: --/TXN res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.671599:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e644 lrc: 0/0,0 mode: --/TXN res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788201463.671671:0:75759:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444101 cancel update log [0x2400088d0:0x1:0x0].13: rc = 0 00000004:00080000:0.0:1788201463.671695:0:75759:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc1065c7cc0 with version 35 00000020:00080000:0.0:1788201463.671698:0:75759:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444102 cancel update log [0x2000090a1:0x1:0x0].13: rc = 0 00000020:00080000:0.0:1788201463.671784:0:75759:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444102 cancel update log [0x2400088d0:0x1:0x0].14: rc = 0 00000020:00080000:0.0:1788201463.671791:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444102 00000100:00100000:0.0:1788201463.671812:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715406080 00000100:00100000:0.0:1788201463.671821:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715406080 00000100:00100000:0.0:1788201463.671882:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:0.0:1788201463.671892:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3658:x1875060715406080:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1788201463.671905:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201463.671923:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1e652 lrc: 0/0,0 mode: --/PW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e64b expref: 8 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201463.671935:0:26207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x7:0x0].0x0 (ffff8dc12196eb00) 00010000:00010000:0.0:1788201463.671941:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201463.672010:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+7:3658:x1875060715406080:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 119us (1667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201463.672042:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00100000:0.0:1788201463.672088:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715406080:0@lo:103:jbd2/dm-1-8.0 00000004:00080000:1.0:1788201463.672652:0:75745:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc007566d80 version 33 rpc_version 33 00000020:00100000:1.0:1788201463.672678:0:75745:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788201463.672687:0:75745:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc13ab56300 x1875060715406336/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201463.672720:0:75745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab56300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715406336:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788201463.672764:0:75745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201463.672789:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0034c76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201463.672807:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715406336 00000100:00100000:1.0:1788201463.672811:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715406336 00000100:00100000:1.0:1788201463.672847:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788201463.672855:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:75745:x1875060715406336:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788201463.673000:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:75745:x1875060715406336:12345-0@lo:1000:osp_up0-1.0 Request processed in 145us (236us total) trans 128849018891 rc 0/0 00000100:00100000:1.0:1788201463.673008:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788201463.673066:0:75745:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018890 gen 3 00000004:00080000:1.0:1788201463.673072:0:75745:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018890 committed transno 128849018890 00000020:00080000:1.0:1788201463.673077:0:75745:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8dc0034c70c0 refcount 2 committed 0 result 0 batchid 73014444104 00000020:00080000:1.0:1788201463.673089:0:75745:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc104f06a00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8dc0034c7a80 00000020:00080000:1.0:1788201463.673092:0:75745:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000090a1:0x1:0x0].15 00000020:00080000:1.0:1788201463.673095:0:75745:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc104f06800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dc005c66e00 00000020:00080000:1.0:1788201463.673097:0:75745:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2400088d0:0x1:0x0].16 00000100:00100000:1.0:1788201463.673122:0:75745:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8dc13ab56300 x1875060715406336/t128849018891(128849018891) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788201479 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201463.673139:0:75745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab56300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715406336:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1788201463.673161:0:75745:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc007566d80 version 34 rpc_version 34 00000020:00100000:1.0:1788201463.673173:0:75745:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788201463.673178:0:75745:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc13ab57b80 x1875060715406592/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201463.673191:0:75745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab57b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715406592:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788201463.673218:0:75745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201463.673235:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0034c76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201463.673248:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715406592 00000100:00100000:1.0:1788201463.673251:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715406592 00000100:00100000:1.0:1788201463.673932:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788201463.673941:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:75745:x1875060715406592:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788201463.674101:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:75745:x1875060715406592:12345-0@lo:1000:osp_up0-1.0 Request processed in 160us (881us total) trans 128849018892 rc 0/0 00000100:00100000:1.0:1788201463.674108:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000020:00080000:1.0:1788201463.674126:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 73014444104 committed batchid 73014444102 00000020:00080000:1.0:1788201463.674919:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444102 00000100:00100000:0.0:1788201463.675088:0:75745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab57b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715406592:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1788201463.675100:0:75745:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc007566d80 version 35 rpc_version 35 00000020:00100000:0.0:1788201463.675121:0:75745:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788201463.675127:0:75745:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc133701880 x1875060715406848/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201463.675978:0:75745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715406848:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788201463.676068:0:75745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201463.676098:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121c61780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201463.676667:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715406848 00000100:00100000:1.0:1788201463.676674:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715406848 00000100:00100000:1.0:1788201463.676734:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788201463.676754:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:75745:x1875060715406848:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788201463.676910:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:75745:x1875060715406848:12345-0@lo:1000:osp_up0-1.0 Request processed in 159us (842us total) trans 128849018893 rc 0/0 00000100:00100000:1.0:1788201463.676917:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788201463.676976:0:75745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715406848:0@lo:1000:osp_up0-1.0 00000001:00080000:2.0:1788201463.677791:0:102447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018892 is committed 00000020:00080000:0.0:1788201463.720740:0:75739:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444104 batchid updated 00000020:00080000:0.0:1788201463.720758:0:75739:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 73014444103 batchid updated 00000020:00080000:1.0:1788201463.720824:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444104 00000004:00080000:1.0:1788201463.720885:0:75759:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc0034c7780 with version 36 00000020:00080000:1.0:1788201463.720903:0:75759:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444103 cancel update log [0x2000090a1:0x1:0x0].14: rc = 0 00000020:00080000:1.0:1788201463.720995:0:75759:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444103 cancel update log [0x2400088d0:0x1:0x0].15: rc = 0 00000004:00080000:1.0:1788201463.721045:0:75759:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc0034c7540 with version 37 00000020:00080000:1.0:1788201463.721048:0:75759:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 73014444104 cancel update log [0x2000090a1:0x1:0x0].15: rc = 0 00000020:00080000:1.0:1788201463.721069:0:75759:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 73014444104 cancel update log [0x2400088d0:0x1:0x0].16: rc = 0 00000020:00080000:1.0:1788201463.721078:0:75759:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444104 00000004:00080000:0.0:1788201463.721685:0:75745:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc007566d80 version 36 rpc_version 36 00000020:00100000:0.0:1788201463.721729:0:75745:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788201463.721740:0:75745:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc133701180 x1875060715407104/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201463.721763:0:75745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715407104:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788201463.721826:0:75745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201463.721854:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccf900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201463.722319:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715407104 00000100:00100000:3.0:1788201463.722329:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715407104 00000100:00100000:3.0:1788201463.722401:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788201463.722411:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:75745:x1875060715407104:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201463.722574:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:75745:x1875060715407104:12345-0@lo:1000:osp_up0-1.0 Request processed in 163us (745us total) trans 128849018894 rc 0/0 00000100:00100000:3.0:1788201463.722594:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788201463.722631:0:75745:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018892 gen 3 00000004:00080000:3.0:1788201463.722636:0:75745:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018891 committed transno 128849018892 00000004:00080000:3.0:1788201463.722652:0:75745:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018892 committed transno 128849018892 00000100:00100000:3.0:1788201463.722663:0:75745:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8dc133701880 x1875060715406848/t128849018893(128849018893) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788201479 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201463.722680:0:75745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715407104:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1788201463.722690:0:75745:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc007566d80 version 37 rpc_version 37 00000020:00100000:3.0:1788201463.722702:0:75745:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788201463.722719:0:75745:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc118140e00 x1875060715407360/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201463.722734:0:75745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118140e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715407360:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201463.722764:0:75745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201463.722785:0:75745:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc104ea03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201463.722798:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715407360 00000100:00100000:3.0:1788201463.722801:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715407360 00000100:00100000:3.0:1788201463.722824:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788201463.722830:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:75745:x1875060715407360:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201463.722899:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:75745:x1875060715407360:12345-0@lo:1000:osp_up0-1.0 Request processed in 68us (134us total) trans 128849018895 rc 0/0 00000100:00100000:3.0:1788201463.722905:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788201463.722934:0:75745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118140e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75745:1875060715407360:0@lo:1000:osp_up0-1.0 00000001:00080000:1.0:1788201463.723304:0:102447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018893 is committed 00000001:00080000:2.0:1788201463.733745:0:102447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018895 is committed 00010000:00010000:3.0:1788201463.823738:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201463.847509:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201463.847675:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695547648 00000100:00100000:2.0:1788201463.847687:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695547648 00000100:00100000:2.0:1788201463.847756:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1763 00000100:00100000:2.0:1788201463.847766:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:77794:x1875060695547648:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:2.0:1788201463.847807:0:66312:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444921344 avail 1298681856 00000100:00100000:2.0:1788201463.847878:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:77794:x1875060695547648:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 114us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201463.847885:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1763 00000100:00100000:0.0:1788201463.854953:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201463.855104:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695547776 00000100:00100000:3.0:1788201463.855116:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695547776 00000100:00100000:3.0:1788201463.855199:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1764 00000100:00100000:3.0:1788201463.855209:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:77794:x1875060695547776:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:3.0:1788201463.855263:0:66757:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445359616 avail 1299120128 00000100:00100000:3.0:1788201463.855342:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:77794:x1875060695547776:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 133us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201463.855349:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1764 00000100:00100000:0.0:1788201463.870469:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201463.870633:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695547904 00000100:00100000:3.0:1788201463.870643:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695547904 00000100:00100000:3.0:1788201463.870706:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 68 00000100:00100000:3.0:1788201463.870725:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc108cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:77794:x1875060695547904:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:3.0:1788201463.870750:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201463.870816:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc108cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:77794:x1875060695547904:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 92us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201463.870823:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 68 00000100:00080000:0.0:1788201463.871267:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201463.878361:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201463.878557:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695548032 00000100:00100000:3.0:1788201463.878567:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695548032 00000100:00100000:3.0:1788201463.878638:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 69 00000100:00100000:3.0:1788201463.878649:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:77794:x1875060695548032:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:3.0:1788201463.878680:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788201463.878752:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:77794:x1875060695548032:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 105us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201463.878760:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 69 00000100:00080000:0.0:1788201463.887561:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201463.995839:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201463.995917:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695548288 00000100:00100000:2.0:1788201463.995928:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695548288 00000100:00100000:2.0:1788201463.996000:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1765 00000100:00100000:2.0:1788201463.996011:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:77801:x1875060695548288:12345-192.168.201.20@tcp:36:mcreate.0 00010000:00010000:2.0:1788201463.996102:0:69485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201463.996131:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e5db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e84 expref: 8 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.996175:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008723a00) 00010000:00010000:2.0:1788201463.996180:0:69485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201463.996321:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e659 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.996339:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e659 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.996349:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e659 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.996365:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e660 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.996372:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e660 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.996379:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e660 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.996772:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e659 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.996781:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e659 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.996788:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e659 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.996794:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e659 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.996812:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201463.996817:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e659 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.996825:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e659 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.996834:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008723a00) 00010000:00010000:2.0:1788201463.996837:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201463.996841:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e659 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.996847:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1e659 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201463.996858:0:69485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9df1ffb reply state 00000000205750b5 transno 128849018896 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e660 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.996868:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e660 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201463.996875:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc1421c6a00) 00010000:00010000:2.0:1788201463.996877:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201463.996879:0:69485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201463.996972:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:77801:x1875060695548288:12345-192.168.201.20@tcp:36:mcreate.0 Request processed in 961us (1141us total) trans 128849018896 rc 0/0 00000100:00100000:2.0:1788201463.996980:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1765 00000100:00100000:0.0:1788201464.046752:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201464.046791:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695548416 00000100:00100000:0.0:1788201464.046802:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695548416 00000100:00080000:2.0:1788201464.046853:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201464.046873:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1766 00000100:00100000:0.0:1788201464.046884:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:77804:x1875060695548416:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1788201464.046907:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201464.046927:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6400/0x96d0c9b8c9a1e667 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ea7 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201464.047000:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1e66e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201464.047046:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1e66e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201464.047058:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1e66e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201464.047108:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201464.047113:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201464.047133:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1e66e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201464.047172:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6400/0x96d0c9b8c9a1e667 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ea7 expref: 11 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201464.047191:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1e66e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ea7 expref: 10 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201464.047200:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008723a00) 00010000:00010000:0.0:1788201464.047214:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201464.047218:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d7200, rc 0) 00000100:00100000:0.0:1788201464.047530:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:77804:x1875060695548416:12345-192.168.201.20@tcp:101:rm.0 Request processed in 646us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201464.047539:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1766 00000100:00100000:2.0:1788201464.057178:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201464.057227:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695548544 00000100:00100000:2.0:1788201464.057245:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695548544 00000100:00100000:2.0:1788201464.057295:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1767 00000100:00100000:2.0:1788201464.057304:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:77804:x1875060695548544:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:2.0:1788201464.057322:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201464.057344:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e675 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786eae expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057405:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e67c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057419:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e67c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057430:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e67c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057441:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1e683 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057448:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1e683 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057454:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1e683 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057524:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1e68a lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057532:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1e68a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057538:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1e68a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201464.057583:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x32:0x0]: returning size 0 00000004:00200000:2.0:1788201464.057587:0:66313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201464.057608:0:66313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1e68a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057619:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1e68a lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057628:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e67c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057633:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e67c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057639:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e67c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057645:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e67c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057651:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201464.057655:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e67c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057662:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e67c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057674:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008723a00) 00010000:00010000:2.0:1788201464.057677:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201464.057681:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e67c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057697:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1e67c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057778:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1e683 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057785:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1e683 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057791:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1e683 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057796:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201464.057800:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1e683 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057806:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1e683 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057814:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc1421c6a00) 00010000:00010000:2.0:1788201464.057817:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201464.057821:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1e683 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057827:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1e683 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057851:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e675 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786eae expref: 12 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057878:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1e68a lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786eae expref: 11 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201464.057886:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x32:0x0].0x0 (ffff8dc1421c6300) 00010000:00010000:2.0:1788201464.057888:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788201464.057890:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbda00, rc 0) 00000100:00100000:2.0:1788201464.057958:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:77804:x1875060695548544:12345-192.168.201.20@tcp:101:rm.0 Request processed in 655us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201464.057965:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1767 00000100:00100000:2.0:1788201464.064449:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201464.064493:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695548800 00000100:00100000:3.0:1788201464.064503:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695548800 00000100:00100000:3.0:1788201464.064612:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1768 00000100:00100000:3.0:1788201464.064636:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:77804:x1875060695548800:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:3.0:1788201464.064688:0:66312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788201464.064724:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1e68a lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786eae expref: 11 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.064743:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x32:0x0].0x0 (ffff8dc1421c6300) 00010000:00010000:3.0:1788201464.064760:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1e66e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ea7 expref: 10 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.064768:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008723a00) 00010000:00010000:3.0:1788201464.064772:0:66312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788201464.064792:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1e691 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.064803:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1e691 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.064812:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1e691 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.064821:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e698 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.064828:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e698 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.064833:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e698 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.064919:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e69f lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.064934:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e69f lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.064956:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e69f lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.065210:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e6a6 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.065220:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e6a6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.065228:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e6a6 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.065236:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e6a6 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.065242:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e6a6 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.065257:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e6a6 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.065276:0:66312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201464.065292:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e69f lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.065298:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e69f lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.065305:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e69f lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.065317:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201464.065322:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e69f lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.065330:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e69f lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.065339:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x32:0x0].0x0 (ffff8dc004b23e00) 00010000:00010000:3.0:1788201464.065342:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788201464.065345:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e69f lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.065351:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e69f lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.065366:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1e691 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.065372:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1e691 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.065377:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1e691 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.065383:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1e691 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.065387:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201464.065390:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1e691 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.065406:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1e691 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.065415:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008723a00) 00010000:00010000:3.0:1788201464.065418:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201464.065421:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1e691 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.065427:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1e691 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201464.065437:0:66312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007661f1e5 reply state 00000000a3a19766 transno 128849018897 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e698 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.065448:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e698 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201464.065454:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc1421c6a00) 00010000:00010000:3.0:1788201464.065456:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201464.065459:0:66312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788201464.065533:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:77804:x1875060695548800:12345-192.168.201.20@tcp:36:rm.0 Request processed in 898us (1092us total) trans 128849018897 rc 0/0 00000100:00100000:3.0:1788201464.065541:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1768 00010000:00010000:1.0:1788201464.065612:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201464.065618:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e6a6 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201464.065625:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201464.065628:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e6a6 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201464.065635:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e6a6 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201464.065645:0:24979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x32:0x0].0x0 (ffff8dc004b23e00) 00010000:00010000:1.0:1788201464.065653:0:24979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788201464.065657:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e6a6 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201464.065663:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1e6a6 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201464.065679:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201464.065681:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201464.065682:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201464.143382:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715407616:0@lo:400:kworker.0 00000100:00100000:2.0:1788201464.143400:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715407872:0@lo:400:kworker.0 00000100:00100000:2.0:1788201464.143592:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201464.143632:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715408384:0@lo:400:kworker.0 00000100:00100000:2.0:1788201464.143657:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201464.143675:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715408896:0@lo:400:kworker.0 00000100:00100000:2.0:1788201464.143697:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201464.143735:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788201464.143742:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715407744:0@lo:400:kworker.0 00000100:00100000:2.0:1788201464.143768:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201464.143787:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715408256:0@lo:400:kworker.0 00000100:00100000:2.0:1788201464.143808:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201464.143827:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715408768:0@lo:400:kworker.0 00000100:00100000:2.0:1788201464.143847:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201464.143895:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715407872 00000100:00100000:2.0:1788201464.143903:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715407872 00000100:00100000:2.0:1788201464.143970:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715408384 00000100:00100000:2.0:1788201464.143974:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715408384 00000100:00100000:2.0:1788201464.143995:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715408896 00000100:00100000:2.0:1788201464.143998:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715408896 00000100:00100000:2.0:1788201464.144009:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715408256 00000100:00100000:2.0:1788201464.144011:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715408256 00000100:00100000:2.0:1788201464.144056:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1784 00000100:00100000:2.0:1788201464.144065:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715407872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201464.144119:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715407872:12345-0@lo:400:kworker.0 Request processed in 54us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201464.144126:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1784 00000100:00100000:3.0:1788201464.144353:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715407488:0@lo:400:kworker.0 00000100:00100000:0.0:1788201464.144363:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715407744 00000100:00100000:0.0:1788201464.144367:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715407744 00000100:00100000:3.0:1788201464.144391:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201464.144396:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715408768 00000100:00100000:0.0:1788201464.144399:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715408768 00000100:00100000:3.0:1788201464.144416:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715408000:0@lo:400:kworker.0 00000100:00100000:0.0:1788201464.144418:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788201464.144424:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715407744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201464.144437:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201464.144447:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715408512:0@lo:400:kworker.0 00000100:00100000:0.0:1788201464.144467:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715407744:12345-0@lo:400:kworker.0 Request processed in 44us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201464.144474:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788201464.144475:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201464.144489:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788201464.144493:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201464.144498:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715408640:0@lo:400:kworker.0 00000100:00100000:0.0:1788201464.144508:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715408768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201464.144519:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201464.144534:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715408768:12345-0@lo:400:kworker.0 Request processed in 27us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201464.144540:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788201464.144549:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715408640 00000100:00100000:0.0:1788201464.144551:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715408640 00000100:00100000:3.0:1788201464.144569:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715407488 00000100:00100000:0.0:1788201464.144572:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788201464.144572:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715407488 00000100:00100000:0.0:1788201464.144577:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715408640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201464.144597:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788201464.144603:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715407488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201464.144604:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715408640:12345-0@lo:400:kworker.0 Request processed in 27us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201464.144610:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788201464.144629:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715407488:12345-0@lo:400:kworker.0 Request processed in 27us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201464.144636:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788201464.144661:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715408512 00000100:00100000:3.0:1788201464.144664:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715408512 00000100:00080000:0.0:1788201464.144677:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201464.144681:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201464.144684:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201464.144685:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00080000:0.0:1788201464.144686:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201464.144691:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715408512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201464.144712:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715407744:0@lo:400:kworker.0 00000100:00100000:3.0:1788201464.144718:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715408512:12345-0@lo:400:kworker.0 Request processed in 28us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201464.144722:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715408768:0@lo:400:kworker.0 00000100:00100000:3.0:1788201464.144724:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788201464.144731:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715407872:0@lo:400:kworker.0 00000100:00100000:3.0:1788201464.144748:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715409024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201464.144754:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715408000 00000100:00100000:0.0:1788201464.144757:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715408000 00000100:00100000:3.0:1788201464.144770:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201464.144780:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1785 00000100:00100000:0.0:1788201464.144786:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715408384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201464.144791:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715408640:0@lo:400:kworker.0 00000100:00100000:3.0:1788201464.144799:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715407488:0@lo:400:kworker.0 00000100:00100000:3.0:1788201464.144806:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715408512:0@lo:400:kworker.0 00000100:00100000:3.0:1788201464.144818:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201464.144824:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715408384:12345-0@lo:400:kworker.0 Request processed in 39us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201464.144824:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715409152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201464.144831:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1785 00000100:00100000:0.0:1788201464.144843:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1786 00000100:00100000:0.0:1788201464.144848:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715408896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201464.144850:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201464.144872:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715409024 00000100:00100000:0.0:1788201464.144874:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715408896:12345-0@lo:400:kworker.0 Request processed in 26us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201464.144876:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715409024 00000100:00100000:0.0:1788201464.144880:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1786 00000100:00100000:0.0:1788201464.144891:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1787 00000100:00100000:3.0:1788201464.144892:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715409152 00000100:00100000:3.0:1788201464.144894:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715409152 00000100:00100000:0.0:1788201464.144897:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715408256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201464.144905:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788201464.144910:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715409024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788201464.144926:0:66317:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445359616 avail 1299120128 00000100:00100000:3.0:1788201464.144973:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715409024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201464.144979:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788201464.144991:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788201464.144997:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715409152:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201464.145010:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715408256:12345-0@lo:400:kworker.0 Request processed in 113us (1201us total) trans 0 rc 0/0 00000004:00000024:3.0:1788201464.145011:0:66317:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444921344 avail 1298681856 00000100:00100000:0.0:1788201464.145037:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1787 00000100:00100000:0.0:1788201464.145050:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1788 00000100:00100000:3.0:1788201464.145055:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715409152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201464.145056:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715408000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201464.145061:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788201464.145084:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715408000:12345-0@lo:400:kworker.0 Request processed in 28us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201464.145085:0:3655:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018895 gen 3 00000100:00100000:0.0:1788201464.145089:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1788 00000004:00080000:3.0:1788201464.145090:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018893 committed transno 128849018895 00000100:00080000:0.0:1788201464.145101:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1788201464.145105:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018894 committed transno 128849018895 00000100:00100000:0.0:1788201464.145115:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715408256:0@lo:400:kworker.0 00000004:00080000:3.0:1788201464.145117:0:3655:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018895 committed transno 128849018895 00000100:00100000:0.0:1788201464.145125:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715408384:0@lo:400:kworker.0 00000100:00100000:3.0:1788201464.145129:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715409152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201464.145134:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715408896:0@lo:400:kworker.0 00000100:00100000:3.0:1788201464.145153:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715409024:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201464.145163:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715408000:0@lo:400:kworker.0 00000100:00100000:1.0:1788201464.148084:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201464.148143:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715408128:0@lo:400:kworker.0 00000100:00100000:3.0:1788201464.148163:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715407616 00000100:00100000:3.0:1788201464.148184:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715407616 00000100:00100000:1.0:1788201464.148189:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201464.148259:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788201464.148269:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715407616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201464.148322:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715407616:12345-0@lo:400:kworker.0 Request processed in 55us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201464.148329:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788201464.148360:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715407616:0@lo:400:kworker.0 00000100:00080000:2.0:1788201464.148484:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201464.148685:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715408128 00000100:00100000:0.0:1788201464.148689:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715408128 00000100:00080000:2.0:1788201464.148735:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201464.148740:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1789 00000100:00100000:0.0:1788201464.148748:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715408128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201464.148798:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715408128:12345-0@lo:400:kworker.0 Request processed in 52us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201464.148805:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1789 00000100:00100000:2.0:1788201464.148827:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715408128:0@lo:400:kworker.0 00000100:00100000:2.0:1788201464.668332:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201464.668355:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715409280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201464.668434:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201464.668485:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715409280 00000100:00100000:2.0:1788201464.668493:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715409280 00000100:00100000:2.0:1788201464.668541:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788201464.668551:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715409280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201464.668573:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201464.668617:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715409280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201464.668623:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788201464.668666:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715409280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201464.669251:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715409408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201464.669284:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201464.669362:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715409408 00000100:00100000:1.0:1788201464.669367:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715409408 00000100:00100000:1.0:1788201464.669410:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788201464.669419:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715409408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201464.669439:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1788201464.669474:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715409408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201464.669480:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788201464.669629:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715409408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201464.792304:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201464.792339:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201464.792369:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201464.792393:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201464.792419:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201464.792448:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695549440 00000100:00100000:3.0:1788201464.792456:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695549440 00000100:00100000:3.0:1788201464.792499:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695549312 00000100:00100000:3.0:1788201464.792502:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695549312 00000100:00100000:3.0:1788201464.792522:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 75 00000100:00100000:3.0:1788201464.792531:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695549440:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201464.792599:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695549440:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 69us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201464.792606:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 75 00000100:00100000:3.0:1788201464.792623:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 76 00000100:00100000:3.0:1788201464.792630:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695549312:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201464.792651:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695549312:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201464.792664:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 76 00000100:00100000:3.0:1788201464.792683:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695549184 00000100:00100000:3.0:1788201464.792709:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695549184 00000100:00100000:3.0:1788201464.792743:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695549056 00000100:00100000:3.0:1788201464.792746:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695549056 00000100:00100000:3.0:1788201464.792766:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1790 00000100:00100000:3.0:1788201464.792773:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695549184:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201464.792802:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695549184:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 29us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201464.792808:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1790 00000100:00100000:3.0:1788201464.792820:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1791 00000100:00100000:3.0:1788201464.792826:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2402:x1875060695549056:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201464.792853:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2402:x1875060695549056:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201464.792859:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1791 00000100:00100000:2.0:1788201464.793177:0:102453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695548928 00000100:00100000:2.0:1788201464.793182:0:102453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695548928 00000100:00100000:2.0:1788201464.793223:0:102453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 84 00000100:00100000:2.0:1788201464.793230:0:102453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695548928:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201464.793266:0:102453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695548928:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 37us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201464.793273:0:102453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 84 00000100:00080000:2.0:1788201464.793298:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788201464.853150:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201465.873337:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201466.712193:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00388f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715409536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201466.712278:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201466.713011:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715409536 00000100:00100000:2.0:1788201466.713044:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715409536 00000100:00100000:2.0:1788201466.713106:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788201466.713118:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715409536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201466.713149:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201466.717236:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715409536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4110us (4946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201466.717252:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1788201466.717295:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201466.720865:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00388f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715409536:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788201466.895349:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201467.727296:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201467.727319:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715409664:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201467.727395:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201467.730028:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715409664 00000100:00100000:2.0:1788201467.730046:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715409664 00000100:00100000:2.0:1788201467.730127:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788201467.730140:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715409664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201467.730173:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201467.730266:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715409664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (2871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201467.730285:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1788201467.730441:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201467.730486:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715409664:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788201467.919213:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201468.948608:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201469.263800:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201469.263831:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00388ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715409792:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201469.263939:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201469.264052:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715409792 00000100:00100000:3.0:1788201469.264061:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715409792 00000100:00100000:3.0:1788201469.264293:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788201469.264305:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715409792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788201469.264369:0:66317:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445359616 avail 1299120128 00010000:00000080:3.0:1788201469.264393:0:66317:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc00388c000 x1875060715409792/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:590/0 lens 224/368 e 0 to 0 dl 1788201480 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201469.264450:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715409792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 147us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201469.264458:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788201469.264522:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00388ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715409792:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201469.267433:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201469.267461:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715409920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201469.267551:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201469.267611:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715409920 00000100:00100000:0.0:1788201469.267619:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715409920 00000100:00100000:0.0:1788201469.267676:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788201469.267686:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715409920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201469.267727:0:101344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444921344 avail 1298681856 00000100:00100000:0.0:1788201469.267780:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715409920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201469.267788:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788201469.267845:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715409920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201469.267999:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715410048:0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.268061:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201469.268094:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715410560:0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.268123:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201469.268144:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715411072:0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.268181:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201469.268204:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788201469.268210:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715410176:0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.268251:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201469.268268:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715410688:0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.268288:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201469.268305:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715411200:0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.268325:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201469.268360:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715410048 00000100:00100000:0.0:1788201469.268365:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715410048 00000100:00100000:0.0:1788201469.268397:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788201469.268405:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715410048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.268443:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715410048:12345-0@lo:400:kworker.0 Request processed in 39us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201469.268451:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788201469.268482:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715410560 00000100:00100000:0.0:1788201469.268486:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715410560 00000100:00100000:0.0:1788201469.268525:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715410688 00000100:00100000:0.0:1788201469.268528:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715410688 00000100:00100000:0.0:1788201469.268560:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1792 00000100:00100000:0.0:1788201469.268567:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715410560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.268599:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715410560:12345-0@lo:400:kworker.0 Request processed in 33us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201469.268604:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1792 00000100:00100000:0.0:1788201469.268616:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1793 00000100:00100000:0.0:1788201469.268622:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715410688:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788201469.268636:0:66313:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12f6b0a80 x1875060715410688/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:590/0 lens 224/224 e 0 to 0 dl 1788201480 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201469.268663:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715410688:12345-0@lo:400:kworker.0 Request processed in 41us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201469.268676:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1793 00000100:00100000:0.0:1788201469.268697:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715411072 00000100:00100000:0.0:1788201469.268700:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715411072 00000100:00100000:0.0:1788201469.268727:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715410176 00000100:00100000:0.0:1788201469.268729:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715410176 00000100:00100000:0.0:1788201469.268744:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715411200 00000100:00100000:0.0:1788201469.268746:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715411200 00000100:00100000:0.0:1788201469.268765:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788201469.268771:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715411072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.268803:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715411072:12345-0@lo:400:kworker.0 Request processed in 32us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201469.268809:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788201469.268821:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788201469.268827:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715410176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.268865:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715410176:12345-0@lo:400:kworker.0 Request processed in 39us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201469.268871:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788201469.268883:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788201469.268889:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715411200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.268916:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715411200:12345-0@lo:400:kworker.0 Request processed in 28us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201469.268922:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1788201469.268951:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201469.268956:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201469.268958:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201469.268960:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201469.268977:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715410304:0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.269011:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201469.269053:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715410816:0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.269078:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201469.269106:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715411328:0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.269128:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201469.269147:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788201469.269153:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715410432:0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.269176:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201469.269192:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715410944:0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.269212:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201469.269235:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715410816 00000100:00100000:0.0:1788201469.269239:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715410816 00000100:00100000:0.0:1788201469.269263:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715411328 00000100:00100000:0.0:1788201469.269266:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715411328 00000100:00100000:0.0:1788201469.269275:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715410432 00000100:00100000:0.0:1788201469.269278:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715410432 00000100:00100000:0.0:1788201469.269287:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715410944 00000100:00100000:0.0:1788201469.269290:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715410944 00000100:00100000:0.0:1788201469.269303:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1794 00000100:00100000:0.0:1788201469.269309:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715410816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.269345:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715410816:12345-0@lo:400:kworker.0 Request processed in 36us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201469.269351:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1794 00000100:00100000:0.0:1788201469.269363:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1795 00000100:00100000:0.0:1788201469.269369:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715411328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.269396:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715411328:12345-0@lo:400:kworker.0 Request processed in 28us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201469.269413:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1795 00000100:00100000:0.0:1788201469.269425:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1796 00000100:00100000:0.0:1788201469.269431:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715410432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.269461:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715410432:12345-0@lo:400:kworker.0 Request processed in 31us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201469.269467:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1796 00000100:00100000:0.0:1788201469.269478:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1797 00000100:00100000:0.0:1788201469.269483:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715410944:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788201469.269496:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12fb0df80 x1875060715410944/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:590/0 lens 224/224 e 0 to 0 dl 1788201480 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201469.269523:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715410944:12345-0@lo:400:kworker.0 Request processed in 40us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201469.269528:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1797 00000100:00080000:0.0:1788201469.269543:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201469.269546:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201469.269584:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715410176:0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.269597:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715410688:0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.269607:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715411200:0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.269616:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715410048:0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.269626:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715410560:0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.269637:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715411072:0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.269679:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715410432:0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.269701:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715410944:0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.269712:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715410816:0@lo:400:kworker.0 00000100:00100000:0.0:1788201469.269721:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715411328:0@lo:400:kworker.0 00000100:00100000:3.0:1788201469.272112:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715410304 00000100:00100000:3.0:1788201469.272134:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715410304 00000100:00100000:3.0:1788201469.272237:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788201469.272249:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715410304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201469.272366:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715410304:12345-0@lo:400:kworker.0 Request processed in 119us (3353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201469.272373:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1788201469.272440:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201469.272487:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715410304:0@lo:400:kworker.0 00000001:00080000:2.0:1788201469.277318:0:102447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018897 is committed 00010000:00010000:3.0:1788201469.287769:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e660 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.287797:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e660 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.287807:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e660 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.287814:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201469.287820:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e660 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.287845:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e660 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.287882:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc1421c6a00) 00010000:00010000:3.0:1788201469.287885:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201469.287892:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e660 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.287899:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1e660 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.287925:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e698 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.287931:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e698 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.287937:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e698 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.287942:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201469.287945:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e698 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.287950:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e698 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.287957:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc1421c6a00) 00010000:00010000:3.0:1788201469.287960:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201469.287963:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e698 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201469.287976:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e698 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201469.776161:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201469.776190:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715411456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201469.776292:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201469.776351:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715411456 00000100:00100000:3.0:1788201469.776362:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715411456 00000100:00100000:3.0:1788201469.776418:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788201469.776428:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715411456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201469.776464:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201469.776511:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715411456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201469.776518:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788201469.776571:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715411456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201469.779430:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715411584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201469.779521:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201469.779585:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715411584 00000100:00100000:1.0:1788201469.779600:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715411584 00000100:00100000:1.0:1788201469.779659:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788201469.779669:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715411584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201469.779704:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201469.779754:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715411584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201469.779762:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788201469.779819:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715411584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201469.909004:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201469.909075:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201469.909117:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201469.909144:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201469.909171:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201469.909211:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695549696 00000100:00100000:2.0:1788201469.909224:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695549696 00000100:00100000:2.0:1788201469.909304:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695549824 00000100:00100000:2.0:1788201469.909308:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695549824 00000100:00100000:2.0:1788201469.909355:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1798 00000100:00100000:2.0:1788201469.909369:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695549696:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201469.909471:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695549696:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 105us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201469.909481:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1798 00000100:00100000:2.0:1788201469.909502:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1799 00000100:00100000:2.0:1788201469.909509:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695549824:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000080:2.0:1788201469.909528:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc00388ed80 x1875060695549824/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:590/0 lens 224/224 e 0 to 0 dl 1788201480 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201469.909553:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695549824:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 45us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201469.909569:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1799 00000100:00100000:2.0:1788201469.909594:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695549952 00000100:00100000:2.0:1788201469.909598:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695549952 00000100:00100000:2.0:1788201469.909628:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695550080 00000100:00100000:2.0:1788201469.909630:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695550080 00000100:00100000:2.0:1788201469.909652:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 81 00000100:00100000:2.0:1788201469.909658:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695549952:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201469.909687:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695549952:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 29us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201469.909694:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 81 00000100:00100000:2.0:1788201469.909706:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 82 00000100:00100000:2.0:1788201469.909712:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695550080:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201469.909744:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695550080:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 31us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201469.909751:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 82 00000100:00100000:2.0:1788201469.914888:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695549568 00000100:00100000:2.0:1788201469.914913:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695549568 00000100:00100000:2.0:1788201469.915029:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00100000:2.0:1788201469.915045:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695549568:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201469.915148:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695549568:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 105us (6028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201469.915157:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00080000:2.0:1788201469.915213:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201469.915219:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201469.915223:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201469.915234:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788201469.981099:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201471.005978:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201471.826734:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715411712:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201471.826833:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201471.826895:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715411712 00000100:00100000:1.0:1788201471.826902:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715411712 00000100:00100000:1.0:1788201471.826961:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788201471.826972:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715411712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201471.827004:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201471.827072:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715411712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201471.827080:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788201471.827104:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201471.827142:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715411712:0@lo:13:osp-pre-1-1.0 00000001:02000400:1.0:1788201471.858166:0:103670:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds2 REPLAY BARRIER on lustre-MDT0001 00000100:00100000:3.0:1788201471.928096:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201471.928876:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695550208 00000100:00100000:0.0:1788201471.928888:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695550208 00000100:00100000:0.0:1788201471.929044:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1769 00000100:00100000:0.0:1788201471.929068:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:77875:x1875060695550208:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:0.0:1788201471.929089:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201471.929110:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7e00/0x96d0c9b8c9a1e6ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786eb5 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201471.929711:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1e6b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201471.929726:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1e6b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201471.929739:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1e6b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201471.929781:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201471.929784:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201471.929816:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1e6b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201471.929840:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7e00/0x96d0c9b8c9a1e6ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786eb5 expref: 9 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201471.929875:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1e6b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786eb5 expref: 8 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201471.929883:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008723a00) 00010000:00010000:0.0:1788201471.929886:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201471.929890:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d7400, rc 0) 00000100:00100000:0.0:1788201471.929950:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:77875:x1875060695550208:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 897us (1977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201471.929958:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1769 00000100:00080000:3.0:1788201471.931864:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201471.932940:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201471.934624:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695550336 00000100:00100000:2.0:1788201471.934639:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695550336 00000100:00100000:2.0:1788201471.934705:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1770 00000100:00100000:2.0:1788201471.934718:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:77875:x1875060695550336:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:2.0:1788201471.934739:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201471.934761:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1e6bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ebc expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.934909:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e6c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.934924:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e6c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.934934:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e6c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.934949:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e6c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.934956:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.934963:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.935012:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1e6d0 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.935051:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1e6d0 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.935072:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1e6d0 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201471.935094:0:66312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1e6d0 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.935108:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e6c2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.935114:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e6c2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.935120:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e6c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.935127:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e6c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.935132:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbce00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201471.935136:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e6c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.935144:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e6c2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.935155:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008723a00) 00010000:00010000:2.0:1788201471.935158:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201471.935163:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e6c2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.935169:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e6c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.935188:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.935194:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e6c9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.935199:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.935204:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201471.935207:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.935213:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e6c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.935220:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb56adc53 (ffff8dc1421c6d00) 00010000:00010000:2.0:1788201471.935222:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201471.935225:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e6c9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.935230:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e6c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.935259:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1e6bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ebc expref: 10 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.935272:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1e6d0 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ebc expref: 9 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.935290:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0x0 (ffff8dc103a9b800) 00010000:00010000:2.0:1788201471.935292:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201471.935295:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbca00, rc 0) 00000100:00100000:2.0:1788201471.935364:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:77875:x1875060695550336:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 648us (2429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201471.935382:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1770 00000100:00100000:3.0:1788201471.937892:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201471.937945:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201471.937976:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695550592 00000100:00100000:3.0:1788201471.937984:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695550592 00000100:00100000:3.0:1788201471.938065:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 753 00000100:00100000:3.0:1788201471.938075:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12580b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2400:x1875060695550592:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201471.938089:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201471.938120:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1e6d0 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ebc expref: 9 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201471.938136:0:26215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0x0 (ffff8dc103a9b800) 00010000:00010000:3.0:1788201471.938140:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201471.938189:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12580b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2400:x1875060695550592:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 116us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201471.938197:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 753 00000100:00100000:2.0:1788201471.938912:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695550464 00000100:00100000:2.0:1788201471.938919:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695550464 00000100:00100000:2.0:1788201471.938966:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1771 00000100:00100000:2.0:1788201471.938975:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc125808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:77875:x1875060695550464:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:2.0:1788201471.938991:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201471.939012:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e6d7 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ec3 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.939093:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1e6de lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.939107:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1e6de lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.939119:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1e6de lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201471.939164:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x9:0x0]: returning size 4096 00000004:00200000:2.0:1788201471.939168:0:69485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1788201471.939204:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e6d7 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ec3 expref: 7 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.939236:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1e6de lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ec3 expref: 6 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.939244:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0x0 (ffff8dc1421c6a00) 00010000:00010000:2.0:1788201471.939247:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1788201471.939250:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbd600, rc 0) 00010000:00000080:2.0:1788201471.939257:0:69485:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc125808a80 x1875060695550464/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:592/0 lens 576/584 e 0 to 0 dl 1788201482 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201471.939301:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc125808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:77875:x1875060695550464:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 328us (1416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201471.939309:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1771 00000100:00080000:3.0:1788201471.940283:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201471.949486:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201471.949616:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695550720 00000100:00100000:2.0:1788201471.949626:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695550720 00000100:00100000:2.0:1788201471.949694:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1772 00000100:00100000:2.0:1788201471.949705:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:77875:x1875060695550720:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:2.0:1788201471.949726:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201471.949746:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1e6e5 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786eca expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.949835:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e6ec lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.949849:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e6ec lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.949862:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e6ec lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.949886:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e6f3 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.949894:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e6f3 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.949902:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e6f3 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.949992:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1e6fa lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.950000:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1e6fa lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.950008:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1e6fa lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201471.950122:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788201471.950127:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1788201471.950148:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1e6fa lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.950162:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e6ec lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.950168:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e6ec lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.950174:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e6ec lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.950192:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e6ec lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.950198:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201471.950202:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e6ec lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.950209:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e6ec lrc: 5/0,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.950222:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0x0 (ffff8dc1421c6a00) 00010000:00010000:2.0:1788201471.950225:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201471.950229:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e6ec lrc: 3/0,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.950235:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e6ec lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.950247:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e6f3 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.950253:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e6f3 lrc: 2/0,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.950258:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e6f3 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.950263:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbce00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201471.950266:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e6f3 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.950281:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e6f3 lrc: 4/0,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.950290:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0xd1d4b922 (ffff8dc1421c6d00) 00010000:00010000:2.0:1788201471.950292:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201471.950295:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e6f3 lrc: 2/0,0 mode: --/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.950301:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e6f3 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.950335:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1e6e5 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786eca expref: 8 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.950348:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1e6fa lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786eca expref: 7 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.950354:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xa:0x0].0x0 (ffff8dc1421c6700) 00010000:00010000:2.0:1788201471.950357:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788201471.950359:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbda00, rc 0) 00010000:00000080:2.0:1788201471.950366:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc003a70700 x1875060695550720/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:592/0 lens 584/672 e 0 to 0 dl 1788201482 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201471.950459:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:77875:x1875060695550720:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 756us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201471.950466:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1772 00000100:00100000:2.0:1788201471.955250:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201471.959244:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695550848 00000100:00100000:3.0:1788201471.959266:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695550848 00000100:00100000:3.0:1788201471.959364:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1773 00000100:00100000:3.0:1788201471.959379:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:77875:x1875060695550848:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:3.0:1788201471.959408:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201471.959440:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1e701 lrc: 2/0,0 mode: --/CR res: [0x2400088d0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ed1 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201471.959523:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e708 lrc: 3/1,0 mode: --/PR res: [0x2400088d0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201471.959539:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e708 lrc: 3/1,0 mode: PR/PR res: [0x2400088d0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201471.959553:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e708 lrc: 3/1,0 mode: PR/PR res: [0x2400088d0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201471.959638:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d0:0x7:0x0]: returning size 4096 00000004:00200000:3.0:1788201471.959644:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1788201471.959934:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1e701 lrc: 0/0,0 mode: --/CR res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ed1 expref: 9 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201471.959960:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e708 lrc: 3/0,0 mode: PR/PR res: [0x2400088d0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ed1 expref: 8 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201471.959970:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x7:0x0].0x0 (ffff8dc004b23c00) 00010000:00010000:3.0:1788201471.959973:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201471.959977:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3000, rc 0) 00010000:00000080:3.0:1788201471.959986:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc00388f800 x1875060695550848/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:592/0 lens 576/640 e 0 to 0 dl 1788201482 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201471.960124:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:77875:x1875060695550848:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 740us (4881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201471.960132:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1773 00000100:00100000:1.0:1788201471.964527:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201471.964595:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695550976 00000100:00100000:2.0:1788201471.964620:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695550976 00000100:00100000:2.0:1788201471.964721:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1774 00000100:00100000:2.0:1788201471.964735:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:77875:x1875060695550976:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:2.0:1788201471.964763:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201471.964794:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1e70f lrc: 2/0,0 mode: --/CR res: [0x2000090a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ed8 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.964889:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e716 lrc: 3/1,0 mode: --/PR res: [0x2000090a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.964905:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e716 lrc: 3/1,0 mode: PR/PR res: [0x2000090a1:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.964919:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e716 lrc: 3/1,0 mode: PR/PR res: [0x2000090a1:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201471.964984:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000090a1:0x7:0x0]: returning size 4096 00000004:00200000:2.0:1788201471.964989:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1788201471.965090:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1e70f lrc: 0/0,0 mode: --/CR res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ed8 expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.965106:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e716 lrc: 3/0,0 mode: PR/PR res: [0x2000090a1:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ed8 expref: 9 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.965115:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x7:0x0].0x0 (ffff8dc1421c6d00) 00010000:00010000:2.0:1788201471.965119:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788201471.965123:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbce00, rc 0) 00000100:00100000:2.0:1788201471.965203:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:77875:x1875060695550976:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 472us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201471.965221:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1774 00000100:00100000:3.0:1788201471.971458:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201471.973916:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695551232 00000100:00100000:2.0:1788201471.973938:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695551232 00000100:00100000:2.0:1788201471.974056:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1775 00000100:00100000:2.0:1788201471.974073:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:77875:x1875060695551232:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:2.0:1788201471.974103:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201471.974107:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788201471.974145:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e716 lrc: 0/0,0 mode: --/PR res: [0x2000090a1:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ed8 expref: 9 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.974169:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x7:0x0].0x0 (ffff8dc1421c6d00) 00010000:00010000:2.0:1788201471.974183:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201471.974205:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e71d lrc: 2/0,0 mode: --/CW res: [0x2000090a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786edf expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.974379:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e724 lrc: 3/0,1 mode: --/CW res: [0x2000090a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.974395:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e724 lrc: 3/0,1 mode: CW/CW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.974407:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e724 lrc: 3/0,1 mode: CW/CW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.974422:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e72b lrc: 3/0,1 mode: --/PW res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.974430:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e72b lrc: 3/0,1 mode: PW/PW res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.974457:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e72b lrc: 3/0,1 mode: PW/PW res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201471.975089:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x33:0x0]: returning size 4096 00010000:00010000:2.0:1788201471.975113:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1e732 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.975123:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1e732 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x33:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.975133:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1e732 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x33:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.975148:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e724 lrc: 4/0,1 mode: CW/CW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.975155:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e724 lrc: 4/0,1 mode: CW/CW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.975162:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e724 lrc: 3/0,0 mode: CW/CW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.975169:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e724 lrc: 4/0,0 mode: CW/CW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.975176:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201471.975181:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e724 lrc: 4/0,0 mode: CW/CW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.975190:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e724 lrc: 5/0,0 mode: CW/CW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.975213:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x7:0x0].0x0 (ffff8dc1421c6e00) 00010000:00010000:2.0:1788201471.975216:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201471.975220:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e724 lrc: 3/0,0 mode: --/CW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.975227:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e724 lrc: 0/0,0 mode: --/CW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201471.975242:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008bd8d666 reply state 00000000cc8c5724 transno 128849018898 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e72b lrc: 3/0,1 mode: PW/PW res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.975254:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e72b lrc: 3/0,1 mode: TXN/TXN res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.975260:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x7:0x0].0xcd52553e (ffff8dc1421c6400) 00010000:00010000:2.0:1788201471.975263:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201471.975265:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201471.975304:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e71d lrc: 0/0,0 mode: --/CW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786edf expref: 11 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.975322:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1e732 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x33:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786edf expref: 10 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201471.975330:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x33:0x0].0x0 (ffff8dc1421c6800) 00010000:00010000:2.0:1788201471.975333:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201471.975335:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbc200, rc 0) 00000100:00100000:2.0:1788201471.975437:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:77875:x1875060695551232:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 1369us (3994us total) trans 128849018898 rc 0/0 00000100:00100000:2.0:1788201471.975446:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1775 00000100:00100000:1.0:1788201472.008326:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201472.008482:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695551488 00000100:00100000:2.0:1788201472.008501:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695551488 00000100:00100000:2.0:1788201472.008593:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1776 00000100:00100000:2.0:1788201472.008606:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:77876:x1875060695551488:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:2.0:1788201472.008637:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201472.008642:0:69485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788201472.008679:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1e708 lrc: 0/0,0 mode: --/PR res: [0x2400088d0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ed1 expref: 8 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.008724:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x7:0x0].0x0 (ffff8dc004b23c00) 00010000:00010000:2.0:1788201472.008745:0:69485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201472.008767:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e739 lrc: 2/0,0 mode: --/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ee6 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.008960:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e740 lrc: 3/0,1 mode: --/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.008975:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e740 lrc: 3/0,1 mode: CW/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.008986:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e740 lrc: 3/0,1 mode: CW/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201472.015257:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201472.016077:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e747 lrc: 3/0,1 mode: --/PW res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.016099:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e747 lrc: 3/0,1 mode: PW/PW res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.016111:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e747 lrc: 3/0,1 mode: PW/PW res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201472.017767:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1788201472.017799:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1e74e lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.022452:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1e74e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.022470:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1e74e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.022491:0:69485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e740 lrc: 4/0,1 mode: CW/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.022498:0:69485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e740 lrc: 4/0,1 mode: CW/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.022504:0:69485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e740 lrc: 3/0,0 mode: CW/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.022511:0:69485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e740 lrc: 4/0,0 mode: CW/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.022517:0:69485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201472.022522:0:69485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e740 lrc: 4/0,0 mode: CW/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.022530:0:69485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e740 lrc: 5/0,0 mode: CW/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.022542:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x7:0x0].0x0 (ffff8dc1421c6e00) 00010000:00010000:2.0:1788201472.022546:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201472.022567:0:69485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e740 lrc: 3/0,0 mode: --/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.022573:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1e740 lrc: 0/0,0 mode: --/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201472.022588:0:69485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056bb3598 reply state 000000007a67ebfd transno 77309411500 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e747 lrc: 3/0,1 mode: PW/PW res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.022601:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e747 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.022608:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x7:0x0].0xf0209d98 (ffff8dc1421c6d00) 00010000:00010000:2.0:1788201472.022610:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201472.022614:0:69485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201472.022671:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1e739 lrc: 0/0,0 mode: --/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ee6 expref: 10 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.022691:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1e74e lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ee6 expref: 9 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201472.022699:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xb:0x0].0x0 (ffff8dc1421c6300) 00010000:00010000:2.0:1788201472.022701:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201472.022704:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbc000, rc 0) 00010000:00000080:2.0:1788201472.022713:0:69485:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004eb5f80 x1875060695551488/t77309411500(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:593/0 lens 520/584 e 0 to 0 dl 1788201483 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201472.022818:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:77876:x1875060695551488:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 14214us (14501us total) trans 77309411500 rc 0/0 00000100:00100000:2.0:1788201472.022835:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1776 00000100:00100000:1.0:1788201472.847605:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201472.847632:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715411840:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201472.847705:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201472.847859:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715411840 00000100:00100000:3.0:1788201472.847868:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715411840 00000100:00080000:0.0:1788201472.847923:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201472.847939:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788201472.847950:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715411840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201472.847979:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201472.848054:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715411840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201472.848062:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788201472.848178:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715411840:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788201473.042630:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788201473.883438:0:103767:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788201473.883499:0:103767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1e0e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e0ef expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.883515:0:103767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1e0e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e0ef expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.883521:0:103767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1e0e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e0ef expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.883528:0:103767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1e0e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e0ef expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.883555:0:103767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788201473.883561:0:103767:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788201473.883584:0:103767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788201473.883589:0:103767:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788201473.883596:0:103767:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788201473.883620:0:103767:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788201473.884524:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788201473.884534:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715411968:0@lo:39:umount.0 00010000:00010000:3.0:1788201473.884534:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1e0e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e0ef expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.884560:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed600 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:3.0:1788201473.884565:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1e0e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e0ef expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.884581:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1e0e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1e0ef expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201473.884589:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1e0e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1e0ef expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201473.884595:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788201473.884597:0:6520:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788201473.884600:0:6520:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788201473.884629:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1e0e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e0ef expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.884636:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201473.884669:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1e0e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e0ef expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.884675:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed600/0x96d0c9b8c9a1e0e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e0ef expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.884688:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201473.884689:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201473.884691:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201473.884698:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201473.884709:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715412096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201473.884809:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201473.884877:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715412096 00000100:00100000:3.0:1788201473.884885:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715412096 00000100:00100000:3.0:1788201473.884934:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:3.0:1788201473.884943:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715412096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201473.884955:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201473.884971:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc108c75200/0x96d0c9b8c9a1e0ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e0e8 expref: 24 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.884984:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201473.885039:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+23:3657:x1875060715412096:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201473.885047:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00000100:00100000:3.0:1788201473.885084:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715412096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201473.885687:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201473.886254:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715411968 00000100:00100000:3.0:1788201473.886261:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715411968 00000100:00100000:3.0:1788201473.886453:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1777 00000100:00100000:3.0:1788201473.886461:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875060715411968:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788201473.886512:0:66314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e151 00000100:00080000:3.0:1788201473.886523:0:66314:0:(import.c:65:import_set_state_nolock()) ffff8dc12f1aa800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788201473.888289:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+1:3654:x1875060715411968:12345-0@lo:39:umount.0 Request processed in 1823us (2597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201473.888301:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1777 00000020:00000080:3.0:1788201473.888315:0:66314:0:(genops.c:885:class_export_put()) final put ffff8dc12f1a8800/lustre-MDT0000-lwp-MDT0001_UUID 00000100:00080000:1.0:1788201473.888332:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001db0000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788201473.888344:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715411968:0@lo:39:umount.0 00000020:00000080:3.0:1788201473.888352:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12f1a8800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000100:00080000:1.0:1788201473.888373:0:103767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788201473.888376:0:103767:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788201473.888380:0:103767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788201473.888397:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc12f1aa800 for lustre-MDT0000 00010000:00010000:0.0:1788201473.888612:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201473.889322:0:103767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c75a00/0x96d0c9b8c9a1e104 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e10b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.889336:0:103767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c75a00/0x96d0c9b8c9a1e104 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e10b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.889361:0:103767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c75a00/0x96d0c9b8c9a1e104 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e10b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.889367:0:103767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc108c75a00/0x96d0c9b8c9a1e104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e10b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.889393:0:103767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201473.889400:0:103767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74800/0x96d0c9b8c9a1e0f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e0fd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.889406:0:103767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74800/0x96d0c9b8c9a1e0f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e0fd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.889412:0:103767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74800/0x96d0c9b8c9a1e0f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e0fd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.889418:0:103767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc108c74800/0x96d0c9b8c9a1e0f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e0fd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.889436:0:103767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788201473.889442:0:103767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1e120 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e127 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.889449:0:103767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1e120 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e127 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.889455:0:103767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1e120 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e127 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.889471:0:103767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1e120 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e127 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.889482:0:103767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788201473.889487:0:103767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1e112 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e119 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.889494:0:103767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1e112 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e119 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.889500:0:103767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1e112 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e119 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.889506:0:103767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1e112 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e119 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201473.889516:0:103767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1788201473.889519:0:103767:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1788201473.889549:0:103767:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1788201473.889553:0:103767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='FA') 00000020:00000080:1.0:1788201473.889557:0:103767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1788201473.889562:0:103767:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0001 00010000:00010000:0.0:1788201473.889621:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788201473.889628:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc108c75a00/0x96d0c9b8c9a1e104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e10b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.889635:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75a00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201473.889638:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc108c75a00/0x96d0c9b8c9a1e104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e10b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.889646:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc108c75a00/0x96d0c9b8c9a1e104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1e10b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201473.889653:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc108c75a00/0x96d0c9b8c9a1e104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1e10b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201473.889664:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201473.889667:0:6521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1788201473.889669:0:6521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1788201473.889699:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc108c75a00/0x96d0c9b8c9a1e104 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e10b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.889706:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201473.889726:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc108c75a00/0x96d0c9b8c9a1e104 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e10b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.889733:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc108c75a00/0x96d0c9b8c9a1e104 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e10b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.889746:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201473.889749:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc108c74800/0x96d0c9b8c9a1e0f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e0fd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.889755:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74800 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201473.889758:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc108c74800/0x96d0c9b8c9a1e0f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e0fd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.889765:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc108c74800/0x96d0c9b8c9a1e0f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1e0fd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201473.889782:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc108c74800/0x96d0c9b8c9a1e0f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1e0fd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201473.889787:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201473.889789:0:6521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788201473.889791:0:6521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788201473.889812:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc108c74800/0x96d0c9b8c9a1e0f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e0fd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.889818:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201473.889824:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc108c74800/0x96d0c9b8c9a1e0f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e0fd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.889831:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc108c74800/0x96d0c9b8c9a1e0f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e0fd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.889840:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201473.889843:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1e120 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e127 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.889849:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59a00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201473.889852:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1e120 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e127 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.889858:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1e120 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1e127 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201473.889864:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1e120 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1e127 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201473.889870:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788201473.889872:0:6521:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788201473.889874:0:6521:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788201473.889885:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1e120 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e127 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.889890:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201473.889903:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1e120 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e127 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.889916:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc140d59a00/0x96d0c9b8c9a1e120 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e127 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.889925:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201473.889928:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1e112 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e119 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.889934:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59600 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201473.889937:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1e112 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e119 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.889944:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1e112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1e119 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201473.889950:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1e112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1e119 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201473.889955:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201473.889957:0:6521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788201473.889959:0:6521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788201473.889972:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1e112 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e119 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.889978:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201473.889984:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1e112 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e119 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.889990:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1e112 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e119 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.890009:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201473.890011:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201473.890012:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201473.890063:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715412352:0@lo:103:ldlm_bl.0 00000004:00000080:1.0:1788201473.891226:0:103767:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0001: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:1.0:1788201473.891644:0:75739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411500 is committed 00000020:00000080:1.0:1788201473.891684:0:103767:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 4/9 00000020:00080000:1.0:1788201473.891691:0:103767:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8dc12f3a4800 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201473.891697:0:103767:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8dc00520f800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201473.891702:0:103767:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8dc13f86f800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201473.891715:0:103767:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8dc12e647000 6e293f14-c501-4bc5-9dd4-a18ef02756b4 192.168.201.20@tcp 8 (0 0 3) 0 0 0 1: ffff8dc120196000 77309411500 stale:0 00000020:00080000:1.0:1788201473.891721:0:103767:0:(genops.c:1553:class_disconnect_exports()) OBD device 6 (ffff8dc1060e4d28) has exports, disconnecting them 00000020:00080000:1.0:1788201473.891725:0:103767:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8dc12f3a4800), last request at 1788201433 00000020:00000080:1.0:1788201473.891733:0:103767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1dffa 00000100:00080000:1.0:1788201473.891740:0:103767:0:(import.c:65:import_set_state_nolock()) ffff8dc005d77800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201473.891760:0:103767:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc12f3a4800): rc 0 00000020:00000080:1.0:1788201473.891763:0:103767:0:(genops.c:885:class_export_put()) final put ffff8dc12f3a4800/lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788201473.891868:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201473.891923:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201473.891936:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715412224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201473.891963:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201473.891989:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715412608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201473.892010:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201473.892044:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201473.892049:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715412480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201473.892071:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201473.892100:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715412352 00000100:00100000:0.0:1788201473.892106:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715412352 00000100:00100000:0.0:1788201473.892149:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715412224 00000100:00100000:0.0:1788201473.892152:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715412224 00000100:00100000:0.0:1788201473.892166:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715412608 00000100:00100000:0.0:1788201473.892168:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715412608 00000100:00100000:0.0:1788201473.892181:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715412480 00000100:00100000:0.0:1788201473.892184:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715412480 00000100:00100000:0.0:1788201473.892198:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:0.0:1788201473.892206:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10311ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+26:3656:x1875060715412352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201473.892218:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201473.892236:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ec400/0x96d0c9b8c9a1e0fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e0f6 expref: 26 pid: 102459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.892263:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201473.892296:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10311ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+25:3656:x1875060715412352:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201473.892303:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:0.0:1788201473.892344:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00010000:00010000:2.0:1788201473.892346:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e747 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201473.892351:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715412224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201473.892358:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201473.892360:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e747 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.892366:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e747 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201473.892367:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140d59200/0x96d0c9b8c9a1e10b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e104 expref: 24 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.892372:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbce00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201473.892376:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201473.892377:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e747 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.892384:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e747 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201473.892395:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+23:3656:x1875060715412224:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (432us total) trans 0 rc 0/0 00010000:00010000:2.0:1788201473.892397:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x7:0x0].0xf0209d98 (ffff8dc1421c6d00) 00010000:00010000:2.0:1788201473.892400:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201473.892401:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00010000:00010000:2.0:1788201473.892404:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e747 lrc: 2/0,0 mode: --/TXN res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.892410:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbce00/0x96d0c9b8c9a1e747 lrc: 0/0,0 mode: --/TXN res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201473.892414:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:0.0:1788201473.892419:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+22:3658:x1875060715412608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201473.892426:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201473.892435:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140d58600/0x96d0c9b8c9a1e119 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e112 expref: 22 pid: 102459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201473.892438:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00010000:00010000:0.0:1788201473.892442:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201473.892446:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+21:3658:x1875060715412480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201473.892453:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201473.892461:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1e127 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e120 expref: 21 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201473.892465:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+21:3658:x1875060715412608:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (454us total) trans 0 rc 0/0 00010000:00010000:2.0:1788201473.892470:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201473.892471:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000100:00100000:2.0:1788201473.892494:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+19:3658:x1875060715412480:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201473.892503:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715412480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201473.892505:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:0.0:1788201473.892511:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715412608:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201473.892535:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201473.892540:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201473.892553:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715412224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201473.892560:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715412352:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788201473.893000:0:103767:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8dc00520f800), last request at 1788201469 00000020:00000080:1.0:1788201473.893007:0:103767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d795 00000100:00080000:1.0:1788201473.893036:0:103767:0:(import.c:65:import_set_state_nolock()) ffff8dc00520e000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201473.893054:0:103767:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc00520f800): rc 0 00000020:00000080:1.0:1788201473.893056:0:103767:0:(genops.c:885:class_export_put()) final put ffff8dc00520f800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1788201473.893062:0:103767:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8dc13f86f800), last request at 1788201469 00000020:00000080:1.0:1788201473.893065:0:103767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d6fb 00000100:00080000:1.0:1788201473.893076:0:103767:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86d000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201473.893106:0:103767:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc13f86f800): rc 0 00000020:00000080:1.0:1788201473.893108:0:103767:0:(genops.c:885:class_export_put()) final put ffff8dc13f86f800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00080000:1.0:1788201473.893114:0:103767:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 192.168.201.20@tcp (ffff8dc12e647000), last request at 1788201472 00000020:00000080:1.0:1788201473.893117:0:103767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1bb4f 00000020:00010000:1.0:1788201473.893122:0:103767:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc12e647000: total 3 00000100:00080000:1.0:1788201473.893125:0:103767:0:(import.c:65:import_set_state_nolock()) ffff8dc12e644000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201473.893130:0:103767:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.201.20@tcp (ffff8dc12e647000): rc 0 00000004:00000080:1.0:1788201473.893136:0:103767:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa0dd48667ae0 00000100:00080000:1.0:1788201473.893153:0:103767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788201473.893156:0:103767:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018895 gen 4 00010000:00010000:1.0:1788201473.893272:0:103767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007ade600/0x96d0c9b8c9a1be0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1e1a5 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201473.893296:0:103767:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007ade600/0x96d0c9b8c9a1be0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1e1a5 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201473.893336:0:103767:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1788201473.893362:0:103767:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1788201473.893370:0:103767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc007ade600/0x96d0c9b8c9a1be0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1e1a5 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1788201473.893809:0:13349:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc12e647000: total 3 00010000:00010000:2.0:1788201473.893852:0:13349:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc12e647000, canceled 0 locks, left on hash table 3. 00010000:00010000:2.0:1788201473.893879:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbda00/0x96d0c9b8c9a1e6fa lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786eca expref: 4 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.893926:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc000/0x96d0c9b8c9a1e74e lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ee6 expref: 3 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.893943:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1e6de lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ec3 expref: 2 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201473.893956:0:13349:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc12e647000, canceled 3 locks, left on hash table 0. 00010000:00010000:0.0:1788201473.893986:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201473.894292:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788201473.894317:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12f3a4800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788201473.894363:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc00520f800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788201473.894393:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13f86f800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788201473.894413:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc005d77800 for lustre-MDT0001 00000020:00000080:3.0:1788201473.894418:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc00520e000 for lustre-MDT0001 00000020:00000080:3.0:1788201473.894420:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc13f86d000 for lustre-MDT0001 00010000:00010000:3.0:1788201473.894429:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201473.898108:0:103767:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788201473.898547:0:103767:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788201473.898627:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715412736:0@lo:39:umount.0 00000100:00100000:0.0:1788201473.898697:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201473.899717:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715412736 00000100:00100000:3.0:1788201473.899728:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715412736 00000100:00100000:3.0:1788201473.899818:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788201473.899828:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3654:x1875060715412736:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788201473.899857:0:66318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1dfb4 00000020:00010000:3.0:1788201473.899869:0:66318:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc1401c4800: total 0 00000100:00080000:3.0:1788201473.899874:0:66318:0:(import.c:65:import_set_state_nolock()) ffff8dc12f1ac800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201473.899896:0:66318:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 30, last_transno is 128849018898 00000100:00100000:3.0:1788201473.904313:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875060715412736:12345-0@lo:39:umount.0 Request processed in 4475us (5604us total) trans 128849018899 rc 0/0 00000100:00100000:3.0:1788201473.904328:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000020:00010000:3.0:1788201473.904446:0:6521:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc1401c4800: total 0 00010000:00010000:3.0:1788201473.904450:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201473.904507:0:6521:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc1401c4800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788201473.904556:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008723a00) 00010000:00010000:3.0:1788201473.904560:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788201473.904567:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1e1a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1be0b expref: 4 pid: 102481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201473.904584:0:6521:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc1401c4800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788201473.904594:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201473.904596:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201473.904598:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201473.904665:0:103767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788201473.904670:0:103767:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294969456 gen 4 00000004:00080000:1.0:1788201473.904691:0:103767:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788201473.904765:0:103767:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788201473.904797:0:103767:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788201473.904808:0:103767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788201473.904810:0:103767:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294969442 gen 4 00000004:00080000:1.0:1788201473.904823:0:103767:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788201473.904889:0:103767:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788201473.904897:0:103767:0:(import.c:65:import_set_state_nolock()) ffff8dc1031f8800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788201473.904933:0:103767:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8dc1060e4d28) has no exports 00000040:00080000:1.0:1788201473.905294:0:103767:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000bd1:0x3:0x0] first idx 28, last_idx 30 00000040:00080000:1.0:1788201473.905334:0:103767:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000bd1:0x3:0x0] first idx 29, last_idx 30 00000100:00080000:0.0:1788201473.907668:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc109813800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788201473.907683:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715412736:0@lo:39:umount.0 00000100:00100000:0.0:1788201473.907707:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715412864:0@lo:9:umount.0 00000100:00100000:0.0:1788201473.907780:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788201473.908044:0:103767:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8dc1060e4d28) has no exports 00000100:00100000:0.0:1788201473.908701:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715412992:0@lo:9:umount.0 00000100:00100000:0.0:1788201473.908734:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201473.909344:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715412864 00000100:00100000:3.0:1788201473.909363:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715412864 00000100:00100000:3.0:1788201473.909441:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715412992 00000100:00100000:3.0:1788201473.909445:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715412992 00000100:00100000:0.0:1788201473.909494:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201473.909506:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1875060715412864:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788201473.909543:0:100688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d7e2 00000100:00080000:0.0:1788201473.909552:0:100688:0:(import.c:65:import_set_state_nolock()) ffff8dc001db3800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788201473.909594:0:100688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901910 00000100:00100000:0.0:1788201473.909724:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3654:x1875060715412864:12345-0@lo:9:umount.0 Request processed in 221us (1952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201473.909732:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201473.909748:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788201473.909755:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1875060715412992:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788201473.909765:0:100688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1d7c6 00000100:00080000:0.0:1788201473.909787:0:100688:0:(import.c:65:import_set_state_nolock()) ffff8dc11cdda000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788201473.909810:0:100688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1788201473.909885:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3654:x1875060715412992:12345-0@lo:9:umount.0 Request processed in 132us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201473.909892:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788201473.909939:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc006d84000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788201473.909951:0:3654:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788201473.909953:0:3654:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201473.909956:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715412864:0@lo:9:umount.0 00000100:00080000:0.0:1788201473.909968:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1031f8800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788201473.909990:0:3654:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788201473.909992:0:3654:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201473.909995:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715412992:0@lo:9:umount.0 00000100:00080000:3.0:1788201473.913350:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788201473.913365:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201473.913375:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788201473.926353:0:13349:0:(genops.c:885:class_export_put()) final put ffff8dc12e647000/6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:0.0:1788201473.926474:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12e647000/6e293f14-c501-4bc5-9dd4-a18ef02756b4 for lustre-MDT0001 00010000:00010000:3.0:1788201473.926606:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201473.926610:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201473.926612:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788201473.926641:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc12e644000 for lustre-MDT0001 00000020:01000000:2.0:1788201473.968586:0:103767:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc13a8406c0 - data ffff8dc11d9a7438/ffff8dc1201fe000 00000020:01000000:2.0:1788201473.968765:0:103767:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc004adac60 - data ffff8dc11db71d80/ffff8dc12e6ad400 00000100:00080000:3.0:1788201474.032220:0:103767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201474.032228:0:103767:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018895 gen 5 00000100:00100000:3.0:1788201474.032243:0:103767:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8dc004eb7b80 x1875060715412736/t128849018899(128849018899) o39->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201483 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201474.032269:0:103767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788201474.035057:0:103767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788201474.035066:0:103767:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294969456 gen 5 00000004:00080000:3.0:1788201474.035085:0:103767:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201474.035087:0:103767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788201474.035401:0:75747:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788201474.035406:0:75747:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x48:0x0] index 2 count 1 00000040:00080000:3.0:1788201474.035415:0:75747:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 18 count 2 00000100:00080000:1.0:1788201474.047639:0:103767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788201474.047648:0:103767:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294969442 gen 5 00000004:00080000:1.0:1788201474.047661:0:103767:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201474.047673:0:103767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788201474.048922:0:75749:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788201474.048929:0:75749:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x4a:0x0] index 1 count 1 00000040:00080000:0.0:1788201474.048941:0:75749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 18 count 2 00000020:00000080:1.0:1788201474.050356:0:103767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a16351 00000020:00000080:1.0:1788201474.050367:0:103767:0:(genops.c:885:class_export_put()) final put ffff8dc12587f000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788201474.050886:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12587f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788201474.051417:0:103767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a16366 00000020:00000080:1.0:1788201474.051424:0:103767:0:(genops.c:885:class_export_put()) final put ffff8dc12b7a1800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788201474.051729:0:103767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1788201474.051735:0:103767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201474.051744:0:103767:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788201474.051756:0:103767:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8dc1060e19b8) has no exports 00000004:01000000:1.0:1788201474.051937:0:103767:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788201474.051947:0:103767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a163cf 00000020:00000080:1.0:1788201474.051953:0:103767:0:(genops.c:885:class_export_put()) final put ffff8dc12f3a7800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788201474.052529:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12b7a1800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1788201474.052653:0:103767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788201474.052660:0:103767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201474.052666:0:103767:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788201474.052670:0:103767:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8dc004043370) has no exports 00000020:00000080:1.0:1788201474.052676:0:103767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a163c1 00000020:00000080:1.0:1788201474.052683:0:103767:0:(genops.c:885:class_export_put()) final put ffff8dc10558f800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788201474.053205:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12f3a7800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:1.0:1788201474.054335:0:103767:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788201474.054341:0:103767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788201474.054345:0:103767:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294969442 gen 6 00000004:00080000:1.0:1788201474.054353:0:103767:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201474.054355:0:103767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788201474.054671:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc10558f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788201474.054930:0:103767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201474.054941:0:103767:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788201474.054959:0:103767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a163b3 00000020:00000080:1.0:1788201474.054968:0:103767:0:(genops.c:885:class_export_put()) final put ffff8dc12f3a2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788201474.055344:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1031f8800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788201474.055352:0:76267:0:(genops.c:885:class_export_put()) final put ffff8dc12f3a1800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788201474.055354:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12f3a1800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1788201474.055360:0:76267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788201474.055534:0:103767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788201474.055538:0:103767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201474.055544:0:103767:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788201474.055548:0:103767:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8dc0027d4d28) has no exports 00000020:00000080:1.0:1788201474.055555:0:103767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a163a5 00000020:00000080:1.0:1788201474.055559:0:103767:0:(genops.c:885:class_export_put()) final put ffff8dc006d85800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788201474.055932:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12f3a2800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:1.0:1788201474.056419:0:103767:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788201474.056424:0:103767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788201474.056428:0:103767:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294969456 gen 6 00000004:00080000:1.0:1788201474.056432:0:103767:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201474.056434:0:103767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201474.056465:0:103767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201474.056472:0:103767:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788201474.056486:0:103767:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788201474.056492:0:103767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a16397 00000020:00000080:1.0:1788201474.056498:0:103767:0:(genops.c:885:class_export_put()) final put ffff8dc006d82800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788201474.056502:0:103767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='') 00000020:00000080:1.0:1788201474.056506:0:103767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201474.056509:0:103767:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788201474.056512:0:103767:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8dc12ef64d28) has no exports 00000020:00000080:1.0:1788201474.056517:0:103767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a16390 00000020:00000080:1.0:1788201474.056520:0:103767:0:(genops.c:885:class_export_put()) final put ffff8dc109811000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788201474.056902:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc006d85800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788201474.056918:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc006d84000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788201474.056923:0:76267:0:(genops.c:885:class_export_put()) final put ffff8dc006d80800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788201474.056925:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc006d80800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1788201474.056930:0:76267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788201474.057127:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc006d82800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788201474.057132:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc109811000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788201474.058436:0:103767:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788201474.058443:0:103767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201474.058448:0:103767:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018895 gen 6 00000100:00100000:0.0:1788201474.058456:0:103767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788201474.058514:0:103767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201474.058524:0:103767:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788201474.058550:0:103767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201474.058553:0:103767:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788201474.058559:0:103767:0:(genops.c:885:class_export_put()) final put ffff8dc003952800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788201474.058562:0:103767:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc003952800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788201474.058568:0:103767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788201474.058652:0:103767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1636d 00000020:00000080:0.0:1788201474.058658:0:103767:0:(genops.c:885:class_export_put()) final put ffff8dc12b7a7800/lustre-MDD0001_UUID 00000020:01000000:0.0:1788201474.058662:0:103767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788201474.058665:0:103767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201474.058669:0:103767:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788201474.058672:0:103767:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8dc1060e0000) has no exports 00000020:00000080:0.0:1788201474.058692:0:103767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201474.058695:0:103767:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788201474.058698:0:103767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a16374 00000020:00000080:0.0:1788201474.058702:0:103767:0:(genops.c:885:class_export_put()) final put ffff8dc12b7a2000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788201474.058710:0:103767:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc0053a4000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788201474.058713:0:103767:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc0053a4000 2 00000020:01000004:0.0:1788201474.058716:0:103767:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dc0053a4000 from lustre-MDT0001 00000020:00000080:0.0:1788201474.058760:0:103767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201474.058764:0:103767:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788201474.058776:0:103767:0:(genops.c:885:class_export_put()) final put ffff8dc12587c000/lustre-MDT0001_UUID 00000020:00000080:0.0:1788201474.058779:0:103767:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12587c000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788201474.058785:0:103767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788201474.058818:0:103767:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:0.0:1788201474.058822:0:103767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788201474.058825:0:103767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201474.058828:0:103767:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788201474.058835:0:103767:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8dc003b6d800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788201474.058840:0:103767:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8dc0027d3370) has exports, disconnecting them 00000020:00080000:0.0:1788201474.058844:0:103767:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8dc003b6d800), last request at 1788200333 00000020:00000080:0.0:1788201474.058848:0:103767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1640e 00000020:00080000:0.0:1788201474.058861:0:103767:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc003b6d800): rc 0 00000020:00000080:0.0:1788201474.058865:0:103767:0:(genops.c:885:class_export_put()) final put ffff8dc003b6d800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788201474.059577:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc109813800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788201474.059586:0:76267:0:(genops.c:885:class_export_put()) final put ffff8dc139bc2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788201474.059588:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc139bc2800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788201474.059600:0:76267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788201474.059662:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12b7a7800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788201474.059667:0:76267:0:(genops.c:885:class_export_put()) final put ffff8dc137d30000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788201474.059669:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d30000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788201474.059673:0:76267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788201474.059700:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12b7a2000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788201474.059713:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc003b6d800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788201474.080077:0:103767:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788201474.080086:0:103767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201474.080091:0:103767:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788201474.080098:0:103767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788201474.080130:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc001db0000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788201474.080314:0:103767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201474.080323:0:103767:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788201474.080329:0:103767:0:(genops.c:885:class_export_put()) final put ffff8dc006d87000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788201474.080333:0:103767:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc006d87000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788201474.080342:0:103767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788201474.080429:0:103767:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc0053a4000 1 00000020:00000080:3.0:1788201474.080436:0:103767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a16327 00000020:00000080:3.0:1788201474.080443:0:103767:0:(genops.c:885:class_export_put()) final put ffff8dc13f87f000/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788201474.080452:0:103767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788201474.080460:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13f87f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788201474.080469:0:103767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201474.080473:0:103767:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788201474.080476:0:103767:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8dc12563b370) has no exports 00010000:00010000:0.0:1788201474.088760:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201474.194872:0:103767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201474.194886:0:103767:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788201474.194893:0:103767:0:(genops.c:885:class_export_put()) final put ffff8dc0053a0000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788201474.194898:0:103767:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0053a0000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788201474.194912:0:103767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788201474.195377:0:103767:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dc0053a1800 00000020:02000400:1.0:1788201474.195440:0:103767:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00000100:00100000:3.0:1788201474.383176:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715413120:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201474.383245:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201474.383490:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715413120 00000100:00100000:3.0:1788201474.383497:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715413120 00000100:00100000:3.0:1788201474.383532:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788201474.383540:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3655:x1875060715413120:12345-0@lo:41:osp-pre-1-0.0 00000020:00080000:3.0:1788201474.383547:0:66317:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788201474.383583:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3655:x1875060715413120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 43us (338us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788201474.383590:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:02020000:3.0:1788201474.383633:0:3655:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1788201474.383637:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-osp-MDT0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788201474.383642:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc13f80c800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788201474.383645:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788201474.383651:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc13f80c800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201474.383654:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 4284 00000100:00080000:3.0:1788201474.383660:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8dc13f80c800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201474.383680:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc0058ab480 x1875060715413248/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201474.383709:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715413248:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788201474.383892:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201474.383924:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715413248 00000100:00100000:3.0:1788201474.383927:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715413248 00000100:00100000:3.0:1788201474.383947:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788201474.383952:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3654:x1875060715413248:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1788201474.383970:0:66318:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201474.392226:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715413504:0@lo:400:kworker.0 00000100:00100000:1.0:1788201474.392292:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201474.392325:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715414016:0@lo:400:kworker.0 00000100:00100000:1.0:1788201474.392352:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201474.392379:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788201474.392385:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715413632:0@lo:400:kworker.0 00000100:00100000:1.0:1788201474.392408:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201474.392436:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715414144:0@lo:400:kworker.0 00000100:00100000:1.0:1788201474.392463:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201474.392497:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715414016 00000100:00100000:1.0:1788201474.392505:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715414016 00000100:00100000:1.0:1788201474.392558:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788201474.392569:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715414016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201474.392621:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715414016:12345-0@lo:400:kworker.0 Request processed in 55us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201474.392628:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788201474.392653:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715413376:0@lo:400:kworker.0 00000100:00100000:1.0:1788201474.392676:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201474.392695:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715413888:0@lo:400:kworker.0 00000100:00100000:1.0:1788201474.392717:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201474.392736:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201474.392742:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715413760:0@lo:400:kworker.0 00000100:00100000:1.0:1788201474.392775:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201474.392829:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715414016:0@lo:400:kworker.0 00000100:00100000:2.0:1788201474.398241:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715413504 00000100:00100000:2.0:1788201474.398257:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715413504 00000100:00100000:2.0:1788201474.398294:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715413632 00000100:00100000:2.0:1788201474.398298:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715413632 00000100:00100000:2.0:1788201474.398320:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715414144 00000100:00100000:2.0:1788201474.398324:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715414144 00000100:00100000:2.0:1788201474.398336:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715413376 00000100:00100000:2.0:1788201474.398339:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715413376 00000100:00100000:2.0:1788201474.398353:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715413760 00000100:00100000:2.0:1788201474.398355:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715413760 00000100:00100000:2.0:1788201474.398371:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1800 00000100:00100000:2.0:1788201474.398382:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715413632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201474.398499:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715413632:12345-0@lo:400:kworker.0 Request processed in 118us (6089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201474.398506:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1800 00000100:00100000:2.0:1788201474.398523:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1801 00000100:00100000:2.0:1788201474.398529:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715414144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201474.398560:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715414144:12345-0@lo:400:kworker.0 Request processed in 31us (6095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201474.398565:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1801 00000100:00100000:2.0:1788201474.398576:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1802 00000100:00100000:2.0:1788201474.398582:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715413376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201474.398616:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715413376:12345-0@lo:400:kworker.0 Request processed in 34us (5938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201474.398622:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1802 00000100:00100000:2.0:1788201474.398635:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1778 00000100:00100000:2.0:1788201474.398639:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1875060715413504:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788201474.398645:0:66313:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788201474.398671:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1875060715413504:12345-0@lo:400:kworker.0 Request processed in 31us (6380us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788201474.398677:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1778 00000100:00100000:2.0:1788201474.398687:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1779 00000100:00100000:2.0:1788201474.398691:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1875060715413760:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788201474.398695:0:66313:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788201474.398718:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1875060715413760:12345-0@lo:400:kworker.0 Request processed in 25us (5942us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788201474.398723:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1779 00000100:00100000:2.0:1788201474.398754:0:101189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715413888 00000100:00100000:2.0:1788201474.398758:0:101189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715413888 00000100:00100000:2.0:1788201474.398797:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788201474.398805:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715413888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201474.398839:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715413888:12345-0@lo:400:kworker.0 Request processed in 36us (6121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201474.398845:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1788201474.398893:0:3656:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0001 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788201474.398899:0:3656:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788201474.398903:0:3656:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788201474.398909:0:3656:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201474.398913:0:3656:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 4223 00000100:00080000:2.0:1788201474.398919:0:3656:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8dc1401c2800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201474.399445:0:3656:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc00388dc00 x1875060715414272/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201474.399471:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715413760:0@lo:400:kworker.0 00000100:00100000:2.0:1788201474.399493:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715413376:0@lo:400:kworker.0 00000100:00100000:2.0:1788201474.399504:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715413888:0@lo:400:kworker.0 00000100:00100000:2.0:1788201474.399545:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715413632:0@lo:400:kworker.0 00000100:00100000:2.0:1788201474.399557:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1333bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715414144:0@lo:400:kworker.0 00000100:00080000:3.0:1788201474.399656:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201474.399662:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201474.399664:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201474.400031:0:3657:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788201474.400035:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788201474.400038:0:3657:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788201474.400048:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201474.400052:0:3657:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 4207 00000100:00080000:2.0:1788201474.400058:0:3657:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8dc13f86f000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201474.400075:0:3657:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc00388ea00 x1875060715414400/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201474.400089:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715413504:0@lo:400:kworker.0 00000100:00100000:3.0:1788201474.400220:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00388dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715414272:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788201474.400274:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201474.400302:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00388ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715414400:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788201474.400322:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201474.400356:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715414272 00000100:00100000:3.0:1788201474.400361:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715414272 00000100:00100000:3.0:1788201474.400392:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715414400 00000100:00100000:3.0:1788201474.400395:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715414400 00000100:00100000:3.0:1788201474.400413:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1780 00000100:00100000:3.0:1788201474.400418:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715414272:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1788201474.400437:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201474.400471:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715414272:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 52us (197us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201474.400477:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1780 00000100:00100000:3.0:1788201474.400491:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1781 00000100:00100000:3.0:1788201474.400494:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715414400:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788201474.400503:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201474.400594:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715414400:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 28us (200us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201474.400602:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1781 00000100:00080000:3.0:1788201474.400709:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201474.400714:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201474.400717:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00388dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715414272:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1788201474.400724:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201474.400862:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201474.400866:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00388ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715414400:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788201474.400928:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3654:x1875060715413248:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 16975us (17036us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201474.400936:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:3.0:1788201474.400961:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f80c800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201474.400964:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201474.400974:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715413248:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788201474.900037:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715414528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201474.900120:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201474.900164:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201474.900172:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715414656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201474.900197:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201474.900233:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715414528 00000100:00100000:1.0:1788201474.900241:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715414528 00000100:00100000:1.0:1788201474.900287:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715414656 00000100:00100000:1.0:1788201474.900291:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715414656 00000100:00100000:1.0:1788201474.900320:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788201474.900330:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715414528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201474.900364:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201474.900415:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715414528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201474.900422:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788201474.900443:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788201474.900450:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715414656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201474.900466:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1788201474.900494:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715414656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201474.900501:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788201474.900549:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715414656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201474.900562:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715414528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201475.030911:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201475.030997:0:102459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695551616 00000100:00100000:2.0:1788201475.031008:0:102459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695551616 00000100:00100000:2.0:1788201475.031118:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 87 00000100:00100000:2.0:1788201475.031129:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695551616:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201475.031206:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695551616:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 78us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201475.031214:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 87 00000100:00100000:1.0:1788201475.040213:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201475.040256:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201475.040285:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201475.040316:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201475.040319:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695551744 00000100:00100000:3.0:1788201475.040331:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695551744 00000100:00100000:1.0:1788201475.040343:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695552000 00000100:00100000:1.0:1788201475.040349:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695552000 00000100:00100000:1.0:1788201475.040401:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695552128 00000100:00100000:3.0:1788201475.040404:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695551872 00000100:00100000:1.0:1788201475.040405:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695552128 00000100:00100000:3.0:1788201475.040410:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695551872 00000100:00100000:3.0:1788201475.040435:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1803 00000100:00100000:1.0:1788201475.040442:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00100000:3.0:1788201475.040448:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2401:x1875060695551744:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201475.040456:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695552000:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201475.040537:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2401:x1875060695551744:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 93us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201475.040545:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1803 00000100:00100000:2.0:1788201475.040561:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00100000:3.0:1788201475.040568:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1782 00000100:00100000:2.0:1788201475.040574:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695552128:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201475.040576:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1875060695551872:12345-192.168.201.20@tcp:400:kworker.0 00000020:00080000:3.0:1788201475.040587:0:66314:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.20@tcp 00000100:00100000:1.0:1788201475.042267:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695552000:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 1807us (1999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201475.042275:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1875060695551872:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 1696us (1987us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788201475.042287:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1782 00000100:00100000:1.0:1788201475.042294:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00080000:3.0:1788201475.042328:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201475.042333:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201475.042336:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201475.047255:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695552128:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 6675us (6926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201475.047272:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00100000:2.0:1788201475.047872:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201475.047925:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695552256 00000100:00100000:3.0:1788201475.047935:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695552256 00000100:00100000:3.0:1788201475.047982:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1783 00000100:00100000:3.0:1788201475.047989:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695552256:12345-192.168.201.20@tcp:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1788201475.048037:0:66313:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201475.048085:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695552256:12345-192.168.201.20@tcp:38:ptlrpcd_00_00.0 Request processed in 95us (214us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201475.048105:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1783 00010000:00010000:2.0:1788201475.151369:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201476.176584:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201477.199430:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788201477.461980:0:102447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1788201477.461998:0:102447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018899 is committed 00000020:00000080:2.0:1788201477.462004:0:102447:0:(genops.c:885:class_export_put()) final put ffff8dc1401c4800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788201477.462137:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1401c4800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788201477.462218:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc12f1ac800 for lustre-MDT0000 00000001:00080000:2.0:1788201477.462309:0:102447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018898 is committed 00010000:00010000:3.0:1788201477.463595:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e72b lrc: 3/0,1 mode: TXN/TXN res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201477.463614:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e72b lrc: 2/0,0 mode: TXN/TXN res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201477.463622:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e72b lrc: 3/0,0 mode: TXN/TXN res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201477.463628:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201477.463633:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e72b lrc: 3/0,0 mode: TXN/TXN res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201477.463641:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e72b lrc: 4/0,0 mode: TXN/TXN res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201477.463658:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x7:0x0].0xcd52553e (ffff8dc1421c6400) 00010000:00010000:3.0:1788201477.463662:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201477.463667:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e72b lrc: 2/0,0 mode: --/TXN res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201477.463673:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1e72b lrc: 0/0,0 mode: --/TXN res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201478.223190:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201479.249965:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201479.504628:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201479.504636:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788201479.504641:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201479.504652:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 4325 00000100:00080000:0.0:1788201479.504659:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788201479.504667:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8dc13f86f000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201479.504701:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12f6b3800 x1875060715415040/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201479.504737:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201479.504757:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788201479.504759:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201479.504764:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 4325 00000100:00080000:0.0:1788201479.504767:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788201479.504770:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8dc1401c2800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201479.504784:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12580b100 x1875060715415296/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201479.504794:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201479.504797:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788201479.504799:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc13f80c800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201479.504802:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 4325 00000100:00080000:0.0:1788201479.504804:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788201479.504807:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8dc13f80c800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201479.504820:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc133702680 x1875060715415424/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201479.504894:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715414912:0@lo:400:kworker.0 00000100:00100000:0.0:1788201479.504944:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715415552:0@lo:400:kworker.0 00000100:00100000:1.0:1788201479.504975:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201479.504989:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201479.505290:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715414784:0@lo:400:kworker.0 00000100:00100000:3.0:1788201479.505512:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715415040:0@lo:38:kworker.0 00000100:00100000:1.0:1788201479.508822:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715415808:0@lo:400:kworker.0 00000100:00100000:1.0:1788201479.508891:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201479.508951:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715415552 00000100:00100000:1.0:1788201479.508959:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715415552 00000100:00100000:1.0:1788201479.509040:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788201479.509051:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715415552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201479.509182:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715415552:12345-0@lo:400:kworker.0 Request processed in 133us (4191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201479.509190:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788201479.509245:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715414912 00000100:00100000:1.0:1788201479.509249:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715414912 00000100:00100000:1.0:1788201479.509274:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715415808 00000100:00100000:1.0:1788201479.509276:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715415808 00000100:00100000:1.0:1788201479.509293:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1804 00000100:00100000:1.0:1788201479.509300:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715414912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201479.509337:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715414912:12345-0@lo:400:kworker.0 Request processed in 37us (4363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201479.509343:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1804 00000100:00100000:1.0:1788201479.509354:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1805 00000100:00100000:1.0:1788201479.509360:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715415808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201479.509401:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715415808:12345-0@lo:400:kworker.0 Request processed in 41us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201479.509407:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1805 00000100:00100000:2.0:1788201479.511685:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201479.511755:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715415680:0@lo:400:kworker.0 00000100:00100000:2.0:1788201479.511799:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201479.511842:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715415680 00000100:00100000:2.0:1788201479.511849:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715415680 00000100:00100000:2.0:1788201479.511910:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788201479.511920:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715415680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201479.511967:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715415680:12345-0@lo:400:kworker.0 Request processed in 49us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201479.511973:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788201479.512003:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715415168:0@lo:400:kworker.0 00000100:00100000:2.0:1788201479.512050:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201479.512083:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715415168 00000100:00100000:2.0:1788201479.512086:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715415168 00000100:00100000:2.0:1788201479.512116:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1806 00000100:00100000:2.0:1788201479.512122:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715415168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201479.512156:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715415168:12345-0@lo:400:kworker.0 Request processed in 34us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201479.512162:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1806 00000100:00100000:2.0:1788201479.512198:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715415168:0@lo:400:kworker.0 00000100:00100000:2.0:1788201479.512349:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715415680:0@lo:400:kworker.0 00000100:00080000:2.0:1788201479.512402:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201479.512407:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201479.512410:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201479.512488:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715414912:0@lo:400:kworker.0 00000100:00100000:2.0:1788201479.512501:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715415808:0@lo:400:kworker.0 00000100:00100000:2.0:1788201479.512534:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715414784 00000100:00100000:2.0:1788201479.512538:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715414784 00000100:00100000:2.0:1788201479.512565:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788201479.512572:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:3657:x1875060715414784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201479.512610:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:3657:x1875060715414784:12345-0@lo:400:kworker.0 Request processed in 37us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201479.512616:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788201479.512648:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715414784:0@lo:400:kworker.0 00000001:00100000:2.0:1788201479.513765:0:100576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788201479.513771:0:100576:0:(genops.c:885:class_export_put()) final put ffff8dc11cddb000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788201479.513804:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11cddb000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788201479.513841:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc11cdda000 for lustre-OST0001 00000100:00100000:3.0:1788201479.514032:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201479.514075:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12580b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715415296:0@lo:38:kworker.0 00000100:00100000:3.0:1788201479.514107:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201479.514141:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715415040 00000100:00100000:3.0:1788201479.514147:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715415040 00000100:00100000:3.0:1788201479.514174:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715415296 00000100:00100000:3.0:1788201479.514177:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715415296 00000100:00100000:3.0:1788201479.514193:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1784 00000100:00100000:3.0:1788201479.514199:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715415040:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788201479.514219:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201479.514252:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715415040:12345-0@lo:38:kworker.0 Request processed in 52us (221us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201479.514259:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1784 00000100:00100000:3.0:1788201479.514273:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1785 00000100:00100000:3.0:1788201479.514278:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715415296:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788201479.514287:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201479.514310:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715415296:12345-0@lo:38:kworker.0 Request processed in 31us (201us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201479.514316:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1785 00000100:00080000:3.0:1788201479.514347:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201479.514352:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201479.514355:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12580b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715415296:0@lo:38:kworker.0 00000100:00100000:3.0:1788201479.514362:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715415424:0@lo:38:kworker.0 00000100:00100000:3.0:1788201479.514423:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201479.514448:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715415424 00000100:00100000:3.0:1788201479.514771:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715415424 00000100:00100000:3.0:1788201479.514801:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788201479.514807:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3654:x1875060715415424:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788201479.514819:0:101344:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201479.514933:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3654:x1875060715415424:12345-0@lo:38:kworker.0 Request processed in 47us (431us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201479.514941:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:3.0:1788201479.514971:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f80c800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201479.514976:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201479.514979:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715415424:0@lo:38:kworker.0 00000100:00080000:3.0:1788201479.515006:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201479.515010:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201479.515033:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715415040:0@lo:38:kworker.0 00000100:00100000:0.0:1788201479.520493:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715415552:0@lo:400:kworker.0 00000001:00100000:2.0:1788201479.520701:0:99761:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788201479.520707:0:99761:0:(genops.c:885:class_export_put()) final put ffff8dc001db6800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788201479.531777:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc001db6800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788201479.544259:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc001db3800 for lustre-OST0000 00000100:00100000:0.0:1788201480.015302:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12580b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715416064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201480.015361:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715415936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201480.015383:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201480.015420:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201480.015460:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715416064 00000100:00100000:0.0:1788201480.015468:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715416064 00000100:00100000:1.0:1788201480.015484:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715415936 00000100:00100000:1.0:1788201480.015487:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715415936 00000100:00100000:1.0:1788201480.015529:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788201480.015543:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715415936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201480.015582:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201480.018447:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715415936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2894us (3014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201480.018693:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715415936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201480.019821:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788201480.019844:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715416064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201480.019876:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201480.020040:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715416064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 208us (4655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201480.020048:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788201480.020083:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788201480.020216:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12580b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715416064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201480.147692:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201480.147865:0:102453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695552384 00000100:00100000:0.0:1788201480.147880:0:102453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695552384 00000100:00100000:0.0:1788201480.147959:0:102453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 89 00000100:00100000:0.0:1788201480.147971:0:102453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc121a80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695552384:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201480.148101:0:102453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc121a80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695552384:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 132us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201480.148110:0:102453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 89 00000100:00100000:1.0:1788201480.157191:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201480.157637:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695552512 00000100:00100000:2.0:1788201480.157653:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695552512 00000100:00100000:2.0:1788201480.157770:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1807 00000100:00100000:2.0:1788201480.157782:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2401:x1875060695552512:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201480.157904:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2401:x1875060695552512:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 124us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201480.157912:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1807 00000100:00080000:3.0:1788201480.160405:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201480.161752:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201480.164413:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201480.164473:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201480.164523:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695552768 00000100:00100000:3.0:1788201480.164536:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695552768 00000100:00100000:3.0:1788201480.164610:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695552896 00000100:00100000:3.0:1788201480.164614:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695552896 00000100:00100000:3.0:1788201480.164647:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 89 00000100:00100000:3.0:1788201480.164671:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695552768:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201480.164707:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 90 00000100:00100000:1.0:1788201480.164737:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695552896:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201480.164852:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695552768:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 191us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201480.164862:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 89 00000100:00080000:3.0:1788201480.164902:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201480.164908:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201480.165049:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695552640 00000100:00100000:0.0:1788201480.166320:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695552640 00000100:00100000:0.0:1788201480.166393:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1786 00000100:00100000:0.0:1788201480.166404:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12580b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875060695552640:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:0.0:1788201480.166433:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201480.166549:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695552896:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 1827us (2074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201480.166558:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 90 00000100:00100000:0.0:1788201480.178069:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12580b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875060695552640:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 11652us (16318us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201480.178084:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1786 00010000:00010000:0.0:1788201480.271348:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201481.298093:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201482.319364:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201483.343300:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201484.368066:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201484.623229:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201484.623234:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788201484.623250:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201484.623258:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 4330 00000100:00080000:0.0:1788201484.623262:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788201484.623268:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8dc13f86f000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201484.623285:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc133701880 x1875060715416448/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201484.623310:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201484.623313:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788201484.623314:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201484.623318:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 4330 00000100:00080000:0.0:1788201484.623320:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788201484.623324:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8dc1401c2800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201484.623336:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc133332d80 x1875060715416704/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201484.623345:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201484.623348:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788201484.623349:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc13f80c800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201484.623353:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 4330 00000100:00080000:0.0:1788201484.623356:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788201484.623359:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8dc13f80c800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201484.623373:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc133333480 x1875060715416832/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201484.623437:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715416960:0@lo:400:kworker.0 00000100:00100000:0.0:1788201484.623478:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715416576:0@lo:400:kworker.0 00000100:00100000:0.0:1788201484.623518:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201484.623519:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201484.623594:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715416960 00000100:00100000:0.0:1788201484.623603:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715416960 00000100:00100000:1.0:1788201484.623663:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715416320:0@lo:400:kworker.0 00000100:00100000:0.0:1788201484.623677:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788201484.623685:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715416960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201484.623699:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201484.623724:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715417216:0@lo:400:kworker.0 00000100:00100000:0.0:1788201484.623732:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715416960:12345-0@lo:400:kworker.0 Request processed in 47us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201484.623737:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788201484.623754:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201484.623792:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788201484.623798:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715416192:0@lo:400:kworker.0 00000100:00100000:1.0:1788201484.623826:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201484.623864:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715417088:0@lo:400:kworker.0 00000100:00100000:1.0:1788201484.623888:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201484.623912:0:101189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715417088 00000100:00100000:1.0:1788201484.623916:0:101189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715417088 00000100:00100000:1.0:1788201484.623958:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788201484.623966:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715417088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201484.623972:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715416576 00000100:00100000:0.0:1788201484.623977:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715416576 00000100:00100000:0.0:1788201484.624004:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715416320 00000100:00100000:0.0:1788201484.624007:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715416320 00000100:00100000:1.0:1788201484.624012:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715417088:12345-0@lo:400:kworker.0 Request processed in 46us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201484.624038:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715417216 00000100:00100000:0.0:1788201484.624040:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715417216 00000100:00100000:1.0:1788201484.624047:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788201484.624057:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1808 00000100:00100000:0.0:1788201484.624065:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715416576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201484.624075:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1809 00000100:00100000:1.0:1788201484.624086:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715416320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201484.624112:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715416576:12345-0@lo:400:kworker.0 Request processed in 47us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201484.624118:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1808 00000100:00100000:1.0:1788201484.624128:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715416320:12345-0@lo:400:kworker.0 Request processed in 44us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201484.624134:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1810 00000100:00100000:0.0:1788201484.624140:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715417216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201484.624162:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715417216:12345-0@lo:400:kworker.0 Request processed in 23us (411us total) trans 0 rc 0/0 00000100:00080000:2.0:1788201484.624177:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201484.624187:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201484.624189:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201484.624237:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715416960:0@lo:400:kworker.0 00000100:00100000:2.0:1788201484.624289:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715416192 00000100:00100000:2.0:1788201484.624293:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715416192 00000100:00100000:2.0:1788201484.624319:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788201484.624325:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:3658:x1875060715416192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201484.624358:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007115050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:3658:x1875060715416192:12345-0@lo:400:kworker.0 Request processed in 33us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201484.624364:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788201484.624410:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715416576:0@lo:400:kworker.0 00000100:00100000:2.0:1788201484.624439:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715416192:0@lo:400:kworker.0 00000100:00100000:2.0:1788201484.624450:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715417088:0@lo:400:kworker.0 00000100:00100000:2.0:1788201484.624458:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715416320:0@lo:400:kworker.0 00000100:00100000:2.0:1788201484.624466:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715417216:0@lo:400:kworker.0 00000100:00100000:3.0:1788201484.625473:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715416448:0@lo:38:kworker.0 00000100:00100000:3.0:1788201484.625543:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201484.625572:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715416704:0@lo:38:kworker.0 00000100:00100000:3.0:1788201484.625728:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201484.625747:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715416832:0@lo:38:kworker.0 00000100:00100000:3.0:1788201484.625772:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201484.625811:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715416832 00000100:00100000:3.0:1788201484.625816:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715416832 00000100:00100000:3.0:1788201484.625843:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788201484.625850:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3654:x1875060715416832:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788201484.625869:0:101344:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201484.625906:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3654:x1875060715416832:12345-0@lo:38:kworker.0 Request processed in 55us (133us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201484.625913:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788201484.626109:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715416448 00000100:00100000:3.0:1788201484.626114:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715416448 00000100:00100000:2.0:1788201484.626271:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715416704 00000100:00100000:2.0:1788201484.626283:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715416704 00000100:00100000:1.0:1788201484.626340:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1809 00000100:00080000:1.0:1788201484.631218:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f80c800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201484.631229:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201484.631233:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715416832:0@lo:38:kworker.0 00000100:00100000:0.0:1788201484.632826:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1810 00000100:00100000:3.0:1788201484.634728:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1787 00000100:00100000:3.0:1788201484.634741:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715416448:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788201484.634770:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201484.634863:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715416448:12345-0@lo:38:kworker.0 Request processed in 122us (9318us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201484.634870:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1787 00000100:00080000:1.0:1788201484.636178:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201484.636188:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201484.636198:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715416448:0@lo:38:kworker.0 00000100:00100000:0.0:1788201484.639620:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1788 00000100:00100000:0.0:1788201484.639634:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715416704:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201484.639661:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201484.639821:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715416704:12345-0@lo:38:kworker.0 Request processed in 187us (14092us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201484.639843:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1788 00000100:00080000:1.0:1788201484.643481:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201484.643493:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201484.643498:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715416704:0@lo:38:kworker.0 00000100:00100000:0.0:1788201485.135366:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715417472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201485.135440:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201485.135495:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201485.135502:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715417344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201485.135527:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201485.135618:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715417472 00000100:00100000:3.0:1788201485.135627:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715417472 00000100:00100000:3.0:1788201485.135679:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715417344 00000100:00100000:3.0:1788201485.135682:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715417344 00000100:00100000:3.0:1788201485.135712:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788201485.135722:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715417472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201485.136074:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788201485.136133:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715417472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 411us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201485.136141:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788201485.136160:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788201485.136167:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715417344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201485.136187:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8639040 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201485.136215:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715417344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201485.136221:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788201485.136264:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715417344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201485.136278:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715417472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201485.271563:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201485.271628:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201485.271666:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201485.271709:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201485.271739:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201485.271785:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695553408 00000100:00100000:3.0:1788201485.271796:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695553408 00000100:00100000:3.0:1788201485.271853:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695553536 00000100:00100000:3.0:1788201485.271856:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695553536 00000100:00100000:3.0:1788201485.271877:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 52 00000100:00100000:3.0:1788201485.271887:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2399:x1875060695553408:12345-192.168.201.20@tcp:9:kworker.0 00000100:00100000:2.0:1788201485.271907:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695553024 00000100:00100000:2.0:1788201485.271913:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695553024 00000020:00000080:3.0:1788201485.271918:0:99767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e3c7 00000100:00080000:3.0:1788201485.271929:0:99767:0:(import.c:65:import_set_state_nolock()) ffff8dc0038a9000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788201485.271964:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 91 00000001:00000004:3.0:1788201485.271972:0:99767:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901910 00000100:00100000:2.0:1788201485.271974:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695553024:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201485.272059:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695553024:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 86us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201485.272067:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 91 00000100:00080000:2.0:1788201485.272101:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201485.272105:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201485.272135:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 53 00000100:00100000:2.0:1788201485.272143:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2399:x1875060695553536:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:2.0:1788201485.272157:0:100688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e3ce 00000100:00080000:2.0:1788201485.272164:0:100688:0:(import.c:65:import_set_state_nolock()) ffff8dc003b6b000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788201485.272175:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+2:2399:x1875060695553408:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 287us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201485.272183:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 52 00000001:00000004:2.0:1788201485.272196:0:100688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1788201485.272290:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+2:2399:x1875060695553536:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 148us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201485.272298:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 53 00010000:00010000:2.0:1788201485.272323:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201485.272461:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695553152 00000100:00100000:0.0:1788201485.272466:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695553152 00000100:00100000:0.0:1788201485.272509:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695553280 00000100:00100000:0.0:1788201485.272511:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695553280 00000100:00100000:0.0:1788201485.272528:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1811 00000100:00100000:0.0:1788201485.272535:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2400:x1875060695553152:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201485.272585:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2400:x1875060695553152:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 51us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201485.272593:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1811 00000100:00100000:0.0:1788201485.272609:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1789 00000100:00100000:0.0:1788201485.272615:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2399:x1875060695553280:12345-192.168.201.20@tcp:38:kworker.0 00010000:00010000:1.0:1788201485.272627:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00020000:0.0:1788201485.272636:0:69485:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201485.272669:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2399:x1875060695553280:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 53us (1002us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201485.272677:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1789 00000100:00080000:2.0:1788201485.272881:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788201485.394186:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201486.415240:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201487.444461:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201488.475078:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201489.488224:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201489.744122:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201489.744129:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788201489.744132:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201489.744140:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 4336 00000100:00080000:1.0:1788201489.744146:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788201489.744153:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8dc13f86f000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201489.744176:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004be7100 x1875060715417856/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201489.744208:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201489.744212:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788201489.744214:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201489.744217:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 4336 00000100:00080000:1.0:1788201489.744220:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788201489.744224:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8dc1401c2800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201489.744234:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004be5500 x1875060715418112/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201489.744243:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201489.744247:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788201489.744248:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc13f80c800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201489.744252:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 4336 00000100:00080000:1.0:1788201489.744254:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788201489.744257:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8dc13f80c800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201489.744266:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004be5880 x1875060715418240/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201489.744308:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715417856:0@lo:38:kworker.0 00000100:00100000:1.0:1788201489.744383:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201489.744416:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715418112:0@lo:38:kworker.0 00000100:00100000:1.0:1788201489.744438:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201489.744455:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715418240:0@lo:38:kworker.0 00000100:00100000:1.0:1788201489.744478:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201489.744537:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715417856 00000100:00100000:1.0:1788201489.744546:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715417856 00000100:00100000:1.0:1788201489.744623:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715418112 00000100:00100000:1.0:1788201489.744627:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715418112 00000100:00100000:1.0:1788201489.744647:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1790 00000100:00100000:1.0:1788201489.744654:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715417856:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201489.744675:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201489.744718:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715417856:12345-0@lo:38:kworker.0 Request processed in 62us (334us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201489.744725:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1790 00000100:00100000:1.0:1788201489.744742:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1791 00000100:00100000:1.0:1788201489.744746:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715418112:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201489.744755:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201489.744779:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715418112:12345-0@lo:38:kworker.0 Request processed in 31us (340us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201489.744784:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1791 00000100:00080000:1.0:1788201489.744819:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201489.744824:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201489.744827:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715417856:0@lo:38:kworker.0 00000100:00080000:1.0:1788201489.744835:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201489.744846:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201489.744849:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715418112:0@lo:38:kworker.0 00000100:00100000:0.0:1788201489.746991:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715417600:0@lo:400:kworker.0 00000100:00100000:0.0:1788201489.747090:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201489.747183:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715418496:0@lo:400:kworker.0 00000100:00100000:0.0:1788201489.747214:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201489.747243:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788201489.747250:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715417728:0@lo:400:kworker.0 00000100:00100000:0.0:1788201489.747276:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201489.747296:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715418624:0@lo:400:kworker.0 00000100:00100000:0.0:1788201489.747316:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201489.747349:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715417728 00000100:00100000:0.0:1788201489.747357:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715417728 00000100:00100000:0.0:1788201489.747412:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715418624 00000100:00100000:0.0:1788201489.747415:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715418624 00000100:00100000:0.0:1788201489.747433:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1812 00000100:00100000:0.0:1788201489.747442:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715417728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201489.747508:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715417728:12345-0@lo:400:kworker.0 Request processed in 54us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201489.747516:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1812 00000100:00100000:0.0:1788201489.747533:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1813 00000100:00100000:0.0:1788201489.747540:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715418624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201489.747569:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715418624:12345-0@lo:400:kworker.0 Request processed in 29us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201489.747574:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1813 00000100:00100000:0.0:1788201489.747594:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715418496 00000100:00100000:0.0:1788201489.747597:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715418496 00000100:00100000:0.0:1788201489.747626:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788201489.747634:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715418496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201489.747663:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715418496:12345-0@lo:400:kworker.0 Request processed in 30us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201489.747678:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788201489.747720:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715417728:0@lo:400:kworker.0 00000100:00100000:0.0:1788201489.747730:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715418624:0@lo:400:kworker.0 00000100:00100000:0.0:1788201489.747738:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715418496:0@lo:400:kworker.0 00000100:00100000:1.0:1788201489.749581:0:102459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715417600 00000100:00100000:1.0:1788201489.749593:0:102459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715417600 00000100:00100000:1.0:1788201489.749646:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788201489.749655:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+19:3657:x1875060715417600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201489.749740:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+19:3657:x1875060715417600:12345-0@lo:400:kworker.0 Request processed in 86us (2650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201489.749748:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1788201489.750386:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201489.750393:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201489.750666:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715417984:0@lo:400:kworker.0 00000100:00100000:3.0:1788201489.750731:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201489.750774:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201489.750782:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715418368:0@lo:400:kworker.0 00000100:00100000:3.0:1788201489.750809:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201489.750844:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715418240 00000100:00100000:3.0:1788201489.750850:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715418240 00000100:00100000:3.0:1788201489.750878:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788201489.750883:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3654:x1875060715418240:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788201489.750901:0:66318:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201489.750940:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3654:x1875060715418240:12345-0@lo:38:kworker.0 Request processed in 56us (6460us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201489.750945:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788201489.750965:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715417984 00000100:00100000:3.0:1788201489.750969:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715417984 00000100:00100000:3.0:1788201489.751005:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1814 00000100:00100000:3.0:1788201489.751011:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715417984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201489.751085:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715417984:12345-0@lo:400:kworker.0 Request processed in 73us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201489.751091:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1814 00000100:00100000:3.0:1788201489.751109:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715418368 00000100:00100000:3.0:1788201489.751113:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715418368 00000100:00100000:3.0:1788201489.751139:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788201489.751156:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715418368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201489.751187:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715418368:12345-0@lo:400:kworker.0 Request processed in 32us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201489.751193:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1788201489.751231:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f80c800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201489.751236:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201489.751239:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715418240:0@lo:38:kworker.0 00000100:00080000:3.0:1788201489.751261:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201489.751264:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201489.751283:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715418368:0@lo:400:kworker.0 00000100:00100000:3.0:1788201489.751293:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715417984:0@lo:400:kworker.0 00000100:00100000:0.0:1788201489.754176:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715417600:0@lo:400:kworker.0 00000100:00100000:3.0:1788201490.256735:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00714d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715418752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201490.256822:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201490.257205:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715418752 00000100:00100000:3.0:1788201490.257214:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715418752 00000100:00100000:3.0:1788201490.257269:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788201490.257280:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715418752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201490.257310:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788201490.257548:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715418752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 269us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201490.257555:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788201490.257602:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00714d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715418752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201490.257799:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715418880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201490.257994:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201490.258082:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715418880 00000100:00100000:0.0:1788201490.258087:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715418880 00000100:00100000:0.0:1788201490.258116:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788201490.258121:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715418880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201490.258138:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201490.258516:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715418880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 392us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201490.258523:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788201490.258584:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715418880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201490.388364:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201490.388416:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201490.389565:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695553792 00000100:00100000:1.0:1788201490.389577:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695553792 00000100:00080000:3.0:1788201490.389632:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201490.389661:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1815 00000100:00100000:1.0:1788201490.389671:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2401:x1875060695553792:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201490.389753:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2401:x1875060695553792:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 84us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201490.389761:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1815 00000100:00100000:0.0:1788201490.390109:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695553664 00000100:00100000:0.0:1788201490.390115:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695553664 00000100:00100000:0.0:1788201490.390149:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 93 00000100:00100000:0.0:1788201490.390156:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695553664:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201490.390189:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695553664:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 33us (1846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201490.390196:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 93 00000100:00100000:3.0:1788201490.394643:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201490.394677:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695553920 00000100:00100000:3.0:1788201490.394686:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695553920 00000100:00100000:3.0:1788201490.394932:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1792 00000100:00100000:3.0:1788201490.394940:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695553920:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:3.0:1788201490.394964:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201490.395038:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695553920:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 97us (402us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201490.395045:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1792 00010000:00010000:0.0:1788201490.511206:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788201491.286162:0:100576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:3.0:1788201491.286172:0:100576:0:(genops.c:885:class_export_put()) final put ffff8dc003b68800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:2.0:1788201491.286273:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc003b68800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 for lustre-OST0001 00000020:00000080:2.0:1788201491.286329:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc003b6b000 for lustre-OST0001 00000001:00100000:2.0:1788201491.287407:0:99761:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:2.0:1788201491.287413:0:99761:0:(genops.c:885:class_export_put()) final put ffff8dc0038ac000/6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:1.0:1788201491.287508:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0038ac000/6e293f14-c501-4bc5-9dd4-a18ef02756b4 for lustre-OST0000 00000020:00000080:1.0:1788201491.295504:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc0038a9000 for lustre-OST0000 00010000:00010000:3.0:1788201491.535616:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201492.560258:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201493.585523:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201494.607599:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201494.864748:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201494.864757:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788201494.864762:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201494.864774:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 4341 00000100:00080000:2.0:1788201494.864779:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201494.864789:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8dc13f86f000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201494.864819:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc133701880 x1875060715419264/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201494.864871:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201494.864876:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788201494.864878:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201494.864882:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 4341 00000100:00080000:2.0:1788201494.864884:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201494.864889:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8dc1401c2800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201494.864903:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12f6b3800 x1875060715419520/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201494.864913:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201494.864916:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788201494.864918:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc13f80c800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201494.864921:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 4341 00000100:00080000:2.0:1788201494.864924:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788201494.864928:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8dc13f80c800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201494.864941:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12f6b1c00 x1875060715419648/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201494.865048:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715419136:0@lo:400:kworker.0 00000100:00100000:2.0:1788201494.865206:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201494.865251:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715420032:0@lo:400:kworker.0 00000100:00100000:2.0:1788201494.865273:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201494.865301:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788201494.865306:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715419008:0@lo:400:kworker.0 00000100:00100000:2.0:1788201494.865334:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201494.865359:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715419904:0@lo:400:kworker.0 00000100:00100000:2.0:1788201494.865387:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201494.865429:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715419264:0@lo:38:kworker.0 00000100:00100000:2.0:1788201494.865451:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201494.865467:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715419520:0@lo:38:kworker.0 00000100:00100000:2.0:1788201494.865483:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201494.865496:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715419648:0@lo:38:kworker.0 00000100:00100000:2.0:1788201494.865515:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201494.865672:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715419392:0@lo:400:kworker.0 00000100:00100000:0.0:1788201494.865713:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201494.865740:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201494.865745:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715419776:0@lo:400:kworker.0 00000100:00100000:0.0:1788201494.865764:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201494.865793:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715419136 00000100:00100000:0.0:1788201494.865803:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715419136 00000100:00100000:0.0:1788201494.865856:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715420032 00000100:00100000:0.0:1788201494.865859:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715420032 00000100:00100000:0.0:1788201494.865871:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715419264 00000100:00100000:0.0:1788201494.865873:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715419264 00000100:00100000:0.0:1788201494.865880:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715419520 00000100:00100000:0.0:1788201494.865883:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715419520 00000100:00100000:0.0:1788201494.865890:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715419392 00000100:00100000:0.0:1788201494.865892:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715419392 00000100:00100000:0.0:1788201494.865908:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1816 00000100:00100000:0.0:1788201494.865916:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715419136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201494.865974:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715419136:12345-0@lo:400:kworker.0 Request processed in 58us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201494.865981:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1816 00000100:00100000:0.0:1788201494.865999:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1817 00000100:00100000:0.0:1788201494.866004:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715420032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201494.866052:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715420032:12345-0@lo:400:kworker.0 Request processed in 48us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201494.866057:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1817 00000100:00100000:0.0:1788201494.866067:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1818 00000100:00100000:0.0:1788201494.866072:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715419392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201494.866111:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715419392:12345-0@lo:400:kworker.0 Request processed in 39us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201494.866125:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1818 00000100:00100000:0.0:1788201494.866136:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1793 00000100:00100000:0.0:1788201494.866140:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715419264:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201494.866161:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201494.866186:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715419264:12345-0@lo:38:kworker.0 Request processed in 45us (734us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201494.866191:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1793 00000100:00100000:0.0:1788201494.866199:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1794 00000100:00100000:0.0:1788201494.866203:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715419520:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201494.866210:0:66312:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201494.866226:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715419520:12345-0@lo:38:kworker.0 Request processed in 22us (743us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201494.866231:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1794 00000100:00100000:0.0:1788201494.866246:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715419904 00000100:00100000:0.0:1788201494.866250:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715419904 00000100:00100000:0.0:1788201494.866274:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715419776 00000100:00100000:0.0:1788201494.866276:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715419776 00000100:00100000:0.0:1788201494.866294:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788201494.866299:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715419904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201494.866327:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715419904:12345-0@lo:400:kworker.0 Request processed in 28us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201494.866332:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788201494.866340:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788201494.866345:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715419776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201494.866367:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715419776:12345-0@lo:400:kworker.0 Request processed in 22us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201494.866377:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1788201494.866392:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201494.866396:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201494.866398:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201494.866444:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715419776:0@lo:400:kworker.0 00000100:00100000:0.0:1788201494.866455:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715419392:0@lo:400:kworker.0 00000100:00100000:0.0:1788201494.866494:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715419904:0@lo:400:kworker.0 00000100:00100000:0.0:1788201494.866504:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715419136:0@lo:400:kworker.0 00000100:00100000:0.0:1788201494.866513:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715420032:0@lo:400:kworker.0 00000100:00100000:0.0:1788201494.866578:0:102453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715419008 00000100:00100000:0.0:1788201494.866582:0:102453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715419008 00000100:00100000:0.0:1788201494.866610:0:102453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788201494.866616:0:102453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:3658:x1875060715419008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201494.866650:0:102453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:3658:x1875060715419008:12345-0@lo:400:kworker.0 Request processed in 34us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201494.866656:0:102453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788201494.866699:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715419008:0@lo:400:kworker.0 00000100:00100000:0.0:1788201494.866742:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715419648 00000100:00100000:0.0:1788201494.866746:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715419648 00000100:00100000:0.0:1788201494.866768:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788201494.866773:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3654:x1875060715419648:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201494.866784:0:66317:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201494.866808:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3654:x1875060715419648:12345-0@lo:38:kworker.0 Request processed in 34us (1291us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201494.866820:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:2.0:1788201494.867640:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f80c800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201494.867648:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201494.867653:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715419648:0@lo:38:kworker.0 00000100:00080000:2.0:1788201494.867678:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201494.867682:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201494.867684:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715419264:0@lo:38:kworker.0 00000100:00080000:2.0:1788201494.867692:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201494.867695:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788201494.867705:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715419520:0@lo:38:kworker.0 00000100:00100000:1.0:1788201495.375900:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201495.375934:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00714f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715420160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201495.376053:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201495.376287:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715420160 00000100:00100000:3.0:1788201495.376299:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715420160 00000100:00100000:3.0:1788201495.376366:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788201495.376376:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715420160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201495.376425:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788201495.376479:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715420160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201495.376485:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788201495.377107:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201495.377121:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715420288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201495.377164:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201495.377203:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715420288 00000100:00100000:2.0:1788201495.377208:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715420288 00000100:00100000:2.0:1788201495.377239:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788201495.377247:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715420288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201495.377270:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201495.377310:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715420288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201495.377316:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788201495.377361:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715420288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201495.378497:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00714f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715420160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201495.507924:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201495.508071:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695554048 00000100:00100000:3.0:1788201495.508080:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201495.508101:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695554048 00000100:00100000:3.0:1788201495.508162:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201495.508198:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 95 00000100:00100000:0.0:1788201495.508215:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695554048:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201495.508221:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695554176 00000100:00100000:3.0:1788201495.508231:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695554176 00000100:00100000:3.0:1788201495.508313:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695554304 00000100:00100000:0.0:1788201495.508326:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695554048:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 115us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201495.508328:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695554304 00000100:00100000:0.0:1788201495.508342:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 95 00000100:00100000:3.0:1788201495.508365:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1819 00000100:00100000:3.0:1788201495.508381:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2403:x1875060695554176:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201495.508462:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2403:x1875060695554176:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 87us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201495.508470:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1819 00000100:00100000:3.0:1788201495.508492:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1795 00000100:00100000:3.0:1788201495.508497:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875060695554304:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:3.0:1788201495.508521:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201495.508559:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875060695554304:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 60us (398us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201495.508566:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1795 00000100:00080000:3.0:1788201495.508586:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788201495.643241:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201496.658305:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788201497.227878:0:104386:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788201497.227882:0:104386:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788201497.227884:0:104386:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788201497.228069:0:104386:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dc10630d000 00000020:01000004:1.0:1788201497.228095:0:104386:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1788201497.228109:0:104386:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788201497.228123:0:104386:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8dc1060e0000) 00000020:00000080:1.0:1788201497.228141:0:104386:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788201497.511144:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788201497.511477:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788201497.512985:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788201497.514914:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788201497.515718:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788201497.516042:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788201497.516317:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788201497.516580:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788201497.516828:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788201497.517117:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788201497.517382:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1788201497.517773:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788201497.518054:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788201497.518373:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788201497.522565:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788201497.522866:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788201497.523570:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788201497.523836:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788201497.524927:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788201497.525564:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788201497.525785:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788201497.526704:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788201497.531396:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788201497.533084:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788201497.533581:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788201497.533907:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788201497.534222:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788201497.534478:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788201497.534687:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788201497.534897:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788201497.535241:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788201497.535570:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788201497.535823:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788201497.536070:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788201497.536347:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788201497.536656:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788201497.536897:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788201497.537151:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788201497.537416:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788201497.537635:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788201497.537877:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788201497.538110:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788201497.538379:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788201497.538656:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788201497.542461:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788201497.542809:0:104386:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00080000:01000000:3.0:1788201497.544924:0:104386:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788201497.546281:0:104386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788201497.546290:0:104386:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788201497.546301:0:104386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x96d0c9b8c9a1e75c 00000020:01000004:3.0:1788201497.546308:0:104386:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788201497.546333:0:104386:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.120@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788201497.546337:0:104386:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788201497.546354:0:104386:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788201497.546399:0:104386:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788201497.546404:0:104386:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1788201497.557293:0:104386:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788201497.557336:0:104386:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.120@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1788201497.557341:0:104386:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788201497.557343:0:104386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788201497.557345:0:104386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201497.557346:0:104386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201497.557348:0:104386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201497.557349:0:104386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201497.557351:0:104386:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201497.557353:0:104386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201497.557354:0:104386:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788201497.557369:0:104386:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1788201497.557372:0:104386:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788201497.557373:0:104386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788201497.557374:0:104386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201497.557375:0:104386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201497.557376:0:104386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201497.557377:0:104386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201497.557378:0:104386:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201497.557379:0:104386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201497.557380:0:104386:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788201497.557408:0:104386:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788201497.557429:0:104386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715420416:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788201497.557499:0:104386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.557535:0:104386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0074869c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201497.557609:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715420416 00000100:00100000:0.0:1788201497.557616:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715420416 00000100:00100000:0.0:1788201497.557677:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788201497.557688:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+19:104386:x1875060715420416:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788201497.557717:0:102458:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788201497.557720:0:102458:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788201497.557767:0:102458:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788201497.558541:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+19:104386:x1875060715420416:12345-0@lo:253:mount.lustre.0 Request processed in 849us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201497.558551:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788201497.558699:0:104386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715420416:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788201497.558712:0:104386:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788201497.558714:0:104386:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788201497.558716:0:104386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788201497.558717:0:104386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201497.558719:0:104386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201497.558730:0:104386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201497.558732:0:104386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201497.558733:0:104386:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201497.558735:0:104386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201497.558736:0:104386:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788201497.558756:0:104386:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dc10630d000 from lustre-MDT0001 10000000:01000000:1.0:1788201497.558782:0:104386:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788201497.558786:0:104386:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788201497.558795:0:104386:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8dc12563cd28 local copy 00010000:00010000:1.0:1788201497.558806:0:104386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59800/0x96d0c9b8c9a1e13c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e143 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201497.558889:0:104386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715420544:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201497.558923:0:104386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.558960:0:104386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007486540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201497.561262:0:102459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715420544 00000100:00100000:0.0:1788201497.561275:0:102459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715420544 00000100:00100000:0.0:1788201497.561340:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788201497.561350:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+19:104386:x1875060715420544:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201497.561489:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+19:104386:x1875060715420544:12345-0@lo:501:mount.lustre.0 Request processed in 140us (2565us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201497.561497:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788201497.563184:0:104386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715420544:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788201497.563211:0:104386:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788201497.563250:0:104386:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788201497.563260:0:104386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59800/0x96d0c9b8c9a1e13c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e143 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201497.563271:0:104386:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc140d59800/0x96d0c9b8c9a1e13c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e143 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201497.563305:0:104386:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dc10630d000 10000000:01000000:1.0:1788201497.563310:0:104386:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788201497.563316:0:104386:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8dc10630d000 10000000:01000000:1.0:1788201497.563318:0:104386:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788201497.563322:0:104386:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dc10630d000 from 1 10000000:01000000:1.0:1788201497.563324:0:104386:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788201497.563354:0:104386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1e763 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201497.563389:0:104386:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1e763 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201497.563399:0:104386:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1e763 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201497.563417:0:104386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715420672:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201497.563467:0:104386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.563500:0:104386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007486540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201497.563642:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715420672 00000100:00100000:0.0:1788201497.563654:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715420672 00000100:00100000:0.0:1788201497.563705:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788201497.563714:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:104386:x1875060715420672:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201497.563725:0:102452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201497.563738:0:102452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0056d7e00/0x96d0c9b8c9a1e76a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e763 expref: -99 pid: 102452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201497.563760:0:102452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0056d7e00/0x96d0c9b8c9a1e76a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e763 expref: 20 pid: 102452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201497.563769:0:102452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0056d7e00/0x96d0c9b8c9a1e76a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e763 expref: 20 pid: 102452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201497.563778:0:102452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d7e00, rc 0) 00000100:00100000:0.0:1788201497.563820:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:104386:x1875060715420672:12345-0@lo:101:mount.lustre.0 Request processed in 108us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201497.563826:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788201497.563957:0:104386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715420672:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201497.563968:0:104386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1e763 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e76a expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201497.563977:0:104386:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1e763 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e76a expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201497.563989:0:104386:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788201497.564004:0:104386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1e763 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e76a expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201497.564012:0:104386:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1e763 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e76a expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201497.564040:0:104386:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788201497.564044:0:104386:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788201497.564050:0:104386:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8dc10630d000 10000000:01000000:1.0:1788201497.564052:0:104386:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788201497.564062:0:104386:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788201497.564064:0:104386:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788201497.564078:0:104386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1e771 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201497.564084:0:104386:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1e771 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201497.564090:0:104386:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1e771 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201497.564102:0:104386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715420800:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201497.564260:0:104386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.564286:0:104386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007486540 going to sleep for 11 seconds 00000100:00100000:0.0:1788201497.564324:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715420800 00000100:00100000:0.0:1788201497.564329:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715420800 00000100:00100000:0.0:1788201497.564371:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788201497.564379:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+20:104386:x1875060715420800:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201497.564385:0:102458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201497.564394:0:102458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0056d6000/0x96d0c9b8c9a1e778 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e771 expref: -99 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201497.564408:0:102458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0056d6000/0x96d0c9b8c9a1e778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e771 expref: 21 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201497.564416:0:102458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0056d6000/0x96d0c9b8c9a1e778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e771 expref: 21 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201497.564429:0:102458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d6000, rc 0) 00000100:00100000:0.0:1788201497.564467:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:104386:x1875060715420800:12345-0@lo:101:mount.lustre.0 Request processed in 89us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201497.564473:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788201497.564535:0:104386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715420800:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201497.564546:0:104386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1e771 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e778 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.564554:0:104386:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1e771 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e778 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201497.564750:0:104386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x68:0x0] index 46 count 46 00000040:00080000:3.0:1788201497.565117:0:104386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201497.569683:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].1, 224 off8416 00000040:00080000:3.0:1788201497.569739:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].2, 136 off8552 00000040:00080000:3.0:1788201497.569754:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].3, 176 off8728 00000040:00080000:3.0:1788201497.569767:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].4, 224 off8952 00000040:00080000:3.0:1788201497.569781:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].5, 224 off9176 00000040:00080000:3.0:1788201497.569794:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].6, 120 off9296 00000040:00080000:3.0:1788201497.569808:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].7, 112 off9408 00000040:00080000:3.0:1788201497.569820:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].8, 160 off9568 00000040:00080000:3.0:1788201497.569832:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].9, 224 off9792 00000040:00080000:3.0:1788201497.569844:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].10, 224 off10016 00000040:00080000:3.0:1788201497.569857:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].11, 88 off10104 00000040:00080000:3.0:1788201497.569870:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].12, 144 off10248 00000040:00080000:3.0:1788201497.569881:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].13, 152 off10400 00000040:00080000:3.0:1788201497.569894:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].14, 168 off10568 00000040:00080000:3.0:1788201497.569906:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].15, 224 off10792 00000040:00080000:3.0:1788201497.569919:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].16, 224 off11016 00000040:00080000:3.0:1788201497.569932:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].17, 80 off11096 00000040:00080000:3.0:1788201497.569943:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].18, 224 off11320 00000040:00080000:3.0:1788201497.569954:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].19, 224 off11544 00000040:00080000:3.0:1788201497.569978:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].20, 160 off11704 00000040:00080000:3.0:1788201497.569993:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].21, 224 off11928 00000040:00080000:3.0:1788201497.570005:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].22, 224 off12152 00000040:00080000:3.0:1788201497.570098:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].23, 80 off12232 00000040:00080000:3.0:1788201497.570116:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].24, 224 off12456 00000040:00080000:3.0:1788201497.570142:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].25, 224 off12680 00000040:00080000:3.0:1788201497.570154:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].26, 88 off12768 00000040:00080000:3.0:1788201497.570166:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].27, 144 off12912 00000040:00080000:3.0:1788201497.570179:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].28, 152 off13064 00000040:00080000:3.0:1788201497.570191:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].29, 136 off13200 00000040:00080000:3.0:1788201497.570204:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].30, 224 off13424 00000040:00080000:3.0:1788201497.570219:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].31, 224 off13648 00000040:00080000:3.0:1788201497.570231:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].32, 80 off13728 00000040:00080000:3.0:1788201497.570244:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].33, 224 off13952 00000040:00080000:3.0:1788201497.570256:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].34, 224 off14176 00000040:00080000:3.0:1788201497.570268:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].35, 88 off14264 00000040:00080000:3.0:1788201497.570280:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].36, 144 off14408 00000040:00080000:3.0:1788201497.570292:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].37, 152 off14560 00000040:00080000:3.0:1788201497.570304:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].38, 136 off14696 00000040:00080000:3.0:1788201497.570316:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].39, 224 off14920 00000040:00080000:3.0:1788201497.570422:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].40, 224 off15144 00000040:00080000:3.0:1788201497.570435:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].41, 80 off15224 00000040:00080000:3.0:1788201497.570449:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].42, 224 off15448 00000040:00080000:3.0:1788201497.570463:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].43, 224 off15672 00000040:00080000:3.0:1788201497.570476:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].44, 120 off15792 00000040:00080000:3.0:1788201497.570505:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6d:0x0].45, 224 off16016 00000040:00080000:3.0:1788201497.570511:0:104386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x68:0x0] index 45 count 46 00000100:00100000:3.0:1788201497.570628:0:104386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00714f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715420928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201497.570697:0:104386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201497.570750:0:104386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10555e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201497.570993:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715420928 00000100:00100000:2.0:1788201497.571001:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715420928 00000100:00100000:2.0:1788201497.571080:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788201497.571089:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:104386:x1875060715420928:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201497.571246:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:104386:x1875060715420928:12345-0@lo:501:mount.lustre.0 Request processed in 157us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201497.571254:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788201497.571469:0:104386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00714f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715420928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201497.571517:0:104386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00714f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715421056:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201497.571557:0:104386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201497.571585:0:104386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10555e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201497.571658:0:102453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715421056 00000100:00100000:2.0:1788201497.571663:0:102453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715421056 00000100:00100000:2.0:1788201497.571692:0:102453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788201497.571699:0:102453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+21:104386:x1875060715421056:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201497.571791:0:102453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+21:104386:x1875060715421056:12345-0@lo:503:mount.lustre.0 Request processed in 90us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201497.571798:0:102453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788201497.571910:0:104386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00714f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715421056:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788201497.572440:0:104386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201497.572504:0:104386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00714f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715421184:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201497.572544:0:104386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201497.572630:0:104386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10555e180 going to sleep for 11 seconds 00000100:00100000:1.0:1788201497.572722:0:102459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715421184 00000100:00100000:1.0:1788201497.572727:0:102459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715421184 00000100:00100000:1.0:1788201497.572767:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788201497.572774:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+21:104386:x1875060715421184:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201497.573220:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+21:104386:x1875060715421184:12345-0@lo:502:mount.lustre.0 Request processed in 445us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201497.573227:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788201497.573415:0:104386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00714f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715421184:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201497.573598:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].1, 224 off8416 00000040:00080000:3.0:1788201497.573624:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].2, 136 off8552 00000040:00080000:3.0:1788201497.573637:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].3, 176 off8728 00000040:00080000:3.0:1788201497.573649:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].4, 224 off8952 00000040:00080000:3.0:1788201497.573662:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].5, 224 off9176 00000040:00080000:3.0:1788201497.573673:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].6, 120 off9296 00000040:00080000:3.0:1788201497.573685:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].7, 112 off9408 00000040:00080000:3.0:1788201497.573696:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].8, 160 off9568 00000040:00080000:3.0:1788201497.573709:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].9, 224 off9792 00000040:00080000:3.0:1788201497.573720:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].10, 224 off10016 00000040:00080000:3.0:1788201497.573732:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].11, 88 off10104 00000040:00080000:3.0:1788201497.573743:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].12, 144 off10248 00000040:00080000:3.0:1788201497.573756:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].13, 152 off10400 00000040:00080000:3.0:1788201497.573768:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].14, 168 off10568 00000040:00080000:3.0:1788201497.573781:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].15, 224 off10792 00000040:00080000:3.0:1788201497.573794:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].16, 224 off11016 00000040:00080000:3.0:1788201497.573815:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].17, 80 off11096 00000040:00080000:3.0:1788201497.573828:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].18, 224 off11320 00000040:00080000:3.0:1788201497.573840:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].19, 224 off11544 00000040:00080000:3.0:1788201497.573865:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].20, 160 off11704 00000040:00080000:3.0:1788201497.573878:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].21, 224 off11928 00000040:00080000:3.0:1788201497.573889:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].22, 224 off12152 00000040:00080000:3.0:1788201497.573900:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].23, 80 off12232 00000040:00080000:3.0:1788201497.573911:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].24, 224 off12456 00000040:00080000:3.0:1788201497.573923:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].25, 224 off12680 00000040:00080000:3.0:1788201497.573936:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].26, 88 off12768 00000040:00080000:3.0:1788201497.573948:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].27, 144 off12912 00000040:00080000:3.0:1788201497.573960:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].28, 152 off13064 00000040:00080000:3.0:1788201497.573975:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].29, 136 off13200 00000040:00080000:3.0:1788201497.573987:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].30, 224 off13424 00000040:00080000:3.0:1788201497.574000:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].31, 224 off13648 00000040:00080000:3.0:1788201497.574012:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].32, 80 off13728 00000040:00080000:3.0:1788201497.574270:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].33, 224 off13952 00000040:00080000:3.0:1788201497.574284:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].34, 224 off14176 00000040:00080000:3.0:1788201497.574295:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].35, 88 off14264 00000040:00080000:3.0:1788201497.574310:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].36, 144 off14408 00000040:00080000:3.0:1788201497.574322:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].37, 152 off14560 00000040:00080000:3.0:1788201497.574333:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].38, 136 off14696 00000040:00080000:3.0:1788201497.574345:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].39, 224 off14920 00000040:00080000:3.0:1788201497.574357:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].40, 224 off15144 00000040:00080000:3.0:1788201497.574382:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].41, 80 off15224 00000040:00080000:3.0:1788201497.574396:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].42, 224 off15448 00000040:00080000:3.0:1788201497.574409:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].43, 224 off15672 00000040:00080000:3.0:1788201497.574422:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].44, 120 off15792 00000040:00080000:3.0:1788201497.574435:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].45, 224 off16016 00000040:00080000:3.0:1788201497.574448:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].46, 224 off16240 00000040:00080000:3.0:1788201497.574461:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].47, 120 off16360 00000040:00080000:3.0:1788201497.574474:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].48, 24 off16384 00000100:00100000:3.0:1788201497.574514:0:104386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00714f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715421312:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201497.574562:0:104386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201497.574640:0:104386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10555e180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201497.585845:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715421312 00000100:00100000:0.0:1788201497.585862:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715421312 00000100:00100000:1.0:1788201497.586075:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788201497.586088:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b68b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:104386:x1875060715421312:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201497.586280:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b68b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:104386:x1875060715421312:12345-0@lo:502:mount.lustre.0 Request processed in 194us (11717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201497.586288:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788201497.586445:0:104386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00714f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715421312:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201497.586663:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].49, 224 off16608 00000040:00080000:3.0:1788201497.586707:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].50, 224 off16832 00000040:00080000:3.0:1788201497.586721:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].51, 144 off16976 00000040:00080000:3.0:1788201497.586734:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].52, 224 off17200 00000040:00080000:3.0:1788201497.586747:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].53, 224 off17424 00000040:00080000:3.0:1788201497.586761:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].54, 144 off17568 00000040:00080000:3.0:1788201497.586778:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].55, 224 off17792 00000040:00080000:3.0:1788201497.586792:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].56, 224 off18016 00000040:00080000:3.0:1788201497.586804:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].57, 120 off18136 00000100:00100000:3.0:1788201497.586839:0:104386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00714f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715421440:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201497.586885:0:104386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201497.586916:0:104386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10555e180 going to sleep for 11 seconds 00000100:00100000:1.0:1788201497.587249:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715421440 00000100:00100000:1.0:1788201497.587255:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715421440 00000100:00100000:1.0:1788201497.587305:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788201497.587313:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b68b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:104386:x1875060715421440:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201497.587407:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b68b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+21:104386:x1875060715421440:12345-0@lo:502:mount.lustre.0 Request processed in 95us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201497.587414:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788201497.587508:0:104386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00714f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715421440:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201497.587551:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6e:0x0].58, 224 off18360 00000040:00080000:3.0:1788201497.587559:0:104386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 58 count 58 00000020:01000000:3.0:1788201497.588528:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201497.588540:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201497.588542:0:104390:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788201497.588547:0:104390:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788201497.588550:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201497.588564:0:104390:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8dc12563b370) 00000020:00000080:3.0:1788201497.588586:0:104390:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:3.0:1788201497.588591:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788201497.588679:0:104390:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788201497.588686:0:104390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x96d0c9b8c9a1e786 00000020:00000080:3.0:1788201497.588880:0:104390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788201497.588884:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201497.588888:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201497.588889:0:104390:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788201497.588898:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201497.588901:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201497.588902:0:104390:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788201497.588906:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201497.588913:0:104390:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8dc13f8719b8) 00000020:00000080:3.0:1788201497.588924:0:104390:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:3.0:1788201497.588928:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788201497.588931:0:104390:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788201497.588933:0:104390:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788201497.588938:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788201497.588998:0:104390:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc10630d000 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788201497.589011:0:104390:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8dc13f870000) 00000020:00000080:3.0:1788201497.589060:0:104390:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:3.0:1788201497.589112:0:104390:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788201497.589119:0:104390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x96d0c9b8c9a1e79b 00000020:00000080:3.0:1788201497.589239:0:104390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788201497.589246:0:104390:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788201497.589250:0:104390:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x96d0c9b8c9a1e7a2 00080000:01000000:3.0:1788201497.589254:0:104390:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788201497.589258:0:104390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x96d0c9b8c9a1e7a9 00010000:00010000:3.0:1788201497.682934:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201497.683499:0:104390:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-4 is initialized 00000001:00080000:2.0:1788201497.683817:0:104390:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 0 lr: 0 srv lr: 77309411479 lx: 0 gen 27 00000001:00080000:2.0:1788201497.683862:0:104390:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 6e293f14-c501-4bc5-9dd4-a18ef02756b4 idx: 2 lr: 0 srv lr: 77309411479 lx: 0 gen 24 00000001:00000004:2.0:1788201497.683885:0:104390:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 77309411479 00000001:00080000:2.0:1788201497.683983:0:104390:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1788201497.684055:0:104390:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0001: restore reply ffff8dc1259529c0: xid 1875060695547520, transno 77309411499, client gen 24, slot idx 0 00000001:00080000:2.0:1788201497.684066:0:104390:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0001: restore reply ffff8dc125952240: xid 1875060695547264, transno 77309411498, client gen 24, slot idx 1 00000020:00000080:3.0:1788201497.695344:0:104390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788201497.695373:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201497.695380:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201497.695382:0:104390:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788201497.695385:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201497.695391:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201497.695393:0:104390:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788201497.695396:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788201497.695401:0:104390:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:00000080:3.0:1788201497.695430:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201497.695444:0:104390:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8dc13f874d28) 00000020:00000080:3.0:1788201497.695470:0:104390:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788201497.695482:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788201497.695547:0:104390:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788201497.695553:0:104390:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788201497.695559:0:104390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x96d0c9b8c9a1e7c5 00010000:00080000:3.0:1788201497.695592:0:104390:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc11d639800@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.120@tcp at head 00010000:00010000:3.0:1788201497.697248:0:104390:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-9 is initialized 00000020:00000080:3.0:1788201497.719538:0:104390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788201497.719556:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788201497.719606:0:104390:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788201497.719628:0:104390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x96d0c9b8c9a1e7cc 00000100:00080000:3.0:1788201497.719641:0:104390:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201497.719648:0:104390:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc11d639800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201497.719687:0:104390:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc00714f100 x1875060715421568/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201497.719716:0:104390:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1788201497.719782:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201497.719787:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201497.719790:0:104390:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788201497.719793:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788201497.719796:0:104390:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788201497.719798:0:104390:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201497.719799:0:104390:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201497.719801:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788201497.719804:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201497.719805:0:104390:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788201497.719808:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201497.719813:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201497.719814:0:104390:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788201497.719818:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788201497.719848:0:104390:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788201497.719862:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201497.719873:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201497.719874:0:104390:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788201497.719877:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788201497.719879:0:104390:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1788201497.719880:0:104390:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201497.719881:0:104390:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201497.719882:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788201497.719885:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201497.719886:0:104390:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788201497.719888:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788201497.719891:0:104390:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788201497.719895:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201497.719896:0:104390:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788201497.719899:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788201497.719903:0:104390:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:3.0:1788201497.719926:0:104390:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788201497.719929:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201497.719941:0:104390:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8dc12f0c19b8) 00000020:00000080:3.0:1788201497.719958:0:104390:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788201497.719963:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788201497.720050:0:104390:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788201497.720056:0:104390:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788201497.720065:0:104390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x96d0c9b8c9a1e7da 00010000:00080000:3.0:1788201497.720097:0:104390:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc00520f000@lustre-OST0000-osc-MDT0001: add connection 192.168.201.120@tcp at head 00010000:00010000:3.0:1788201497.720283:0:104390:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-10 is initialized 00000100:00100000:2.0:1788201497.720657:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00714f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715421568:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788201497.720732:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201497.720940:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201497.720945:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788201497.720948:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201497.720954:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 4346 00000100:00080000:1.0:1788201497.720958:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788201497.720962:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8dc13f86f000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201497.720978:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004be6680 x1875060715421824/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201497.721000:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201497.721003:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788201497.721005:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201497.721009:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 4346 00000100:00080000:1.0:1788201497.721011:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788201497.721032:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8dc1401c2800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201497.721044:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004be6d80 x1875060715422080/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201497.721052:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201497.721056:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788201497.721057:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc13f80c800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201497.721060:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 4346 00000100:00080000:1.0:1788201497.721070:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788201497.721074:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8dc13f80c800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201497.721086:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004be4700 x1875060715422208/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201497.721135:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715421952:0@lo:400:kworker.0 00000100:00100000:1.0:1788201497.721168:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.721193:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788201497.721199:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715421696:0@lo:400:kworker.0 00000100:00100000:1.0:1788201497.721219:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.721237:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715422592:0@lo:400:kworker.0 00000100:00100000:1.0:1788201497.721256:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.721283:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715422336:0@lo:400:kworker.0 00000100:00100000:1.0:1788201497.721307:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.721327:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201497.721332:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715422464:0@lo:400:kworker.0 00000100:00100000:1.0:1788201497.721370:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.721402:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715421952 00000100:00100000:1.0:1788201497.721409:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715421952 00000100:00100000:1.0:1788201497.721458:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715421696 00000100:00100000:1.0:1788201497.721461:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715421696 00000100:00100000:1.0:1788201497.721480:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715422592 00000100:00100000:1.0:1788201497.721483:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715422592 00000100:00100000:1.0:1788201497.721497:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1820 00000100:00100000:1.0:1788201497.721505:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715421952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201497.721554:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715421952:12345-0@lo:400:kworker.0 Request processed in 49us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201497.721561:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1820 00000100:00100000:1.0:1788201497.721587:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1821 00000100:00100000:1.0:1788201497.721593:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715421696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201497.721622:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715421696:12345-0@lo:400:kworker.0 Request processed in 29us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201497.721628:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1821 00000100:00100000:1.0:1788201497.721640:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1822 00000100:00100000:1.0:1788201497.721645:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715422592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201497.721670:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715422592:12345-0@lo:400:kworker.0 Request processed in 24us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201497.721676:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1822 00000100:00100000:1.0:1788201497.721698:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715422336 00000100:00100000:1.0:1788201497.721701:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715422336 00000100:00100000:1.0:1788201497.721726:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715422464 00000100:00100000:1.0:1788201497.721729:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715422464 00000100:00100000:1.0:1788201497.721749:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788201497.721755:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715422336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201497.721787:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715422336:12345-0@lo:400:kworker.0 Request processed in 32us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201497.721793:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788201497.721804:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788201497.721809:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10981f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715422464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201497.721835:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10981f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715422464:12345-0@lo:400:kworker.0 Request processed in 26us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201497.721840:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1788201497.722055:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201497.722059:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201497.722061:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201497.722103:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715421696:0@lo:400:kworker.0 00000100:00100000:1.0:1788201497.722114:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715422592:0@lo:400:kworker.0 00000100:00100000:1.0:1788201497.722123:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715421952:0@lo:400:kworker.0 00000100:00100000:1.0:1788201497.722158:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715422464:0@lo:400:kworker.0 00000100:00100000:1.0:1788201497.722166:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715422336:0@lo:400:kworker.0 00000100:00100000:1.0:1788201497.722187:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715421824:0@lo:38:kworker.0 00000100:00100000:1.0:1788201497.722214:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.722233:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715422080:0@lo:38:kworker.0 00000100:00100000:1.0:1788201497.722252:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.722266:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715422208:0@lo:38:kworker.0 00000100:00100000:1.0:1788201497.722285:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.722314:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715421824 00000100:00100000:1.0:1788201497.722317:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715421824 00000100:00100000:1.0:1788201497.722333:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715422080 00000100:00100000:1.0:1788201497.722335:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715422080 00000100:00100000:1.0:1788201497.722346:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1796 00000100:00100000:1.0:1788201497.722351:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13336a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715421824:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788201497.722405:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13336a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715421824:12345-0@lo:38:kworker.0 Request processed in 52us (190us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788201497.722411:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1796 00000100:00100000:1.0:1788201497.722423:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1797 00000100:00100000:1.0:1788201497.722427:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13336b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715422080:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788201497.722452:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13336b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715422080:12345-0@lo:38:kworker.0 Request processed in 23us (199us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788201497.722467:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1797 00000100:00100000:1.0:1788201497.722486:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715421568 00000100:00100000:1.0:1788201497.722489:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715421568 00000100:00100000:1.0:1788201497.722505:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715422208 00000100:00100000:1.0:1788201497.722507:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715422208 00000100:00100000:1.0:1788201497.722515:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788201497.722520:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3654:x1875060715421568:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788201497.722536:0:66317:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4349 last 0 00000020:00000080:1.0:1788201497.722565:0:66317:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x96d0c9b8c9a1e7e1 00000004:00100000:1.0:1788201497.722581:0:66317:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788201497.722668:0:66317:0:(import.c:65:import_set_state_nolock()) ffff8dc106072000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201497.722706:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715421568:12345-0@lo:38:llog_process_th.0 Request processed in 184us (1974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201497.722713:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788201497.722726:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788201497.722730:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13336b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3654:x1875060715422208:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788201497.722757:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13336b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3654:x1875060715422208:12345-0@lo:38:kworker.0 Request processed in 25us (471us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788201497.722763:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:1.0:1788201497.722794:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201497.722799:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788201497.722802:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715421824:0@lo:38:kworker.0 00000100:00080000:1.0:1788201497.722812:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201497.722815:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788201497.722817:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715422080:0@lo:38:kworker.0 00000100:00080000:1.0:1788201497.722837:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f80c800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201497.722840:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788201497.722843:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715422208:0@lo:38:kworker.0 00000100:00100000:1.0:1788201497.722856:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788201497.722862:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 30 00000100:00080000:1.0:1788201497.722869:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788201497.722874:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788201497.722877:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11d639800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788201497.722888:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00714f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715421568:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788201497.722941:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715422720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201497.722966:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.722991:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715422720 00000100:00100000:1.0:1788201497.722994:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715422720 00000100:00100000:1.0:1788201497.723045:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788201497.723052:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715422720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201497.723073:0:66317:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444917248 avail 1298677760 00000100:00100000:1.0:1788201497.723105:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715422720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201497.723110:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788201497.723139:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715422720:0@lo:41:osp-pre-0-1.0 00000040:01000000:0.0:1788201497.733802:0:104390:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788201497.733836:0:104390:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788201497.734293:0:104390:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 17, last_idx 18 00000040:00080000:0.0:1788201497.737484:0:104390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201497.737518:0:104390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].19, 64 off9408 00000040:00080000:0.0:1788201497.737690:0:104390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x4c:0x0].1, 64 off8256 00000040:00080000:3.0:1788201497.742482:0:104395:0:(llog.c:805:llog_process_thread()) index: 18, lh_last_idx: 19 synced_idx: 0 lgh_last_idx: 19 00000040:00080000:3.0:1788201497.742490:0:104395:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x48:0x0] at index 18 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1788201497.742682:0:104395:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 18, last_idx 19 00000040:00080000:3.0:1788201497.742705:0:104395:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x48:0x0] at index 18 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1788201497.742842:0:104395:0:(llog.c:805:llog_process_thread()) index: 19, lh_last_idx: 19 synced_idx: 19 lgh_last_idx: 19 00000040:00080000:3.0:1788201497.742845:0:104395:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x4c:0x0] at index 19 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788201497.743871:0:104390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788201497.743886:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788201497.743921:0:104390:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788201497.743939:0:104390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x96d0c9b8c9a1e7e8 00000100:00080000:1.0:1788201497.743950:0:104390:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201497.743961:0:104390:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8dc00520f000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201497.743998:0:104390:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc133368000 x1875060715422848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201497.744071:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715422848:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788201497.744145:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201497.744275:0:104390:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788201497.744331:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201497.744335:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201497.744337:0:104390:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788201497.744339:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788201497.744342:0:104390:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1788201497.744344:0:104390:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201497.744345:0:104390:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201497.744347:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788201497.744350:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201497.744351:0:104390:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788201497.744353:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788201497.744370:0:104390:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788201497.744373:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201497.744375:0:104390:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788201497.744378:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788201497.744382:0:104390:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:1.0:1788201497.744401:0:104390:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788201497.744403:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201497.744414:0:104390:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8dc1060e4d28) 00000020:00000080:1.0:1788201497.744430:0:104390:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1788201497.744434:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788201497.744493:0:104390:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788201497.744499:0:104390:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788201497.744504:0:104390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x96d0c9b8c9a1e7f6 00010000:00080000:1.0:1788201497.744534:0:104390:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc139bc2800@lustre-OST0001-osc-MDT0001: add connection 192.168.201.120@tcp at head 00010000:00010000:1.0:1788201497.744711:0:104390:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1788201497.744781:0:104390:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788201497.744803:0:104390:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1788201497.745070:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715422848 00000100:00100000:0.0:1788201497.745078:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715422848 00000100:00100000:0.0:1788201497.745109:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788201497.745117:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3654:x1875060715422848:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1788201497.745142:0:100688:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4349 last 0 00000020:00000080:0.0:1788201497.745172:0:100688:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x96d0c9b8c9a1e7fd 00002000:00100000:0.0:1788201497.745185:0:100688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8dc120723000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788201497.745191:0:100688:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1788201497.745193:0:100688:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788201497.745256:0:100688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788201497.745277:0:100688:0:(import.c:65:import_set_state_nolock()) ffff8dc120727800 : changing import state from RECOVER to FULL 00000040:00080000:1.0:1788201497.748524:0:104390:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 17, last_idx 18 00000040:00080000:1.0:1788201497.756595:0:104390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201497.756630:0:104390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].19, 64 off9408 00000040:00080000:1.0:1788201497.756796:0:104390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x4e:0x0].1, 64 off8256 00000100:00100000:0.0:1788201497.758632:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715422848:12345-0@lo:8:llog_process_th.0 Request processed in 13503us (14475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201497.758648:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788201497.764931:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788201497.764947:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 4 00000100:00080000:2.0:1788201497.764958:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788201497.764966:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788201497.764970:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc00520f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000040:00080000:0.0:1788201497.765137:0:104397:0:(llog.c:805:llog_process_thread()) index: 18, lh_last_idx: 19 synced_idx: 0 lgh_last_idx: 19 00000040:00080000:0.0:1788201497.765143:0:104397:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x4a:0x0] at index 18 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1788201497.765387:0:104397:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 18, last_idx 19 00000040:00080000:0.0:1788201497.765415:0:104397:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x4a:0x0] at index 18 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1788201497.765582:0:104397:0:(llog.c:805:llog_process_thread()) index: 19, lh_last_idx: 19 synced_idx: 19 lgh_last_idx: 19 00000040:00080000:0.0:1788201497.765585:0:104397:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x4e:0x0] at index 19 of catalog [0x1:0x5:0x0] 00000004:00080000:2.0:1788201497.765758:0:3654:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788201497.765772:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715422848:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1788201497.765847:0:104395:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788201497.765885:0:104395:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 4349237868686ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788201497.765892:0:104395:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788201497.771672:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715422976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201497.771754:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788201497.776695:0:104387:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788201497.776931:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715422976 00000100:00100000:2.0:1788201497.776943:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715422976 00000100:00100000:2.0:1788201497.777042:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788201497.777053:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715422976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201497.777089:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201497.777216:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715422976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 165us (5462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201497.777223:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788201497.777281:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715422976:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788201497.777535:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1788201497.792586:0:104390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788201497.792603:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788201497.792647:0:104390:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788201497.792667:0:104390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x96d0c9b8c9a1e804 00000100:00080000:1.0:1788201497.792678:0:104390:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201497.792684:0:104390:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8dc139bc2800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201497.792722:0:104390:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc133369880 x1875060715423104/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201497.792755:0:104390:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788201497.792834:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201497.792838:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201497.792840:0:104390:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788201497.792843:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201497.792847:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201497.792849:0:104390:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788201497.792852:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788201497.792854:0:104390:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788201497.792856:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201497.792859:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201497.792860:0:104390:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788201497.792863:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201497.792865:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201497.792866:0:104390:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788201497.792870:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788201497.792875:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201497.792877:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201497.792879:0:104390:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000020:01000000:1.0:1788201497.792898:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788201497.792901:0:104390:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #44 00000020:01000000:1.0:1788201497.792902:0:104390:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201497.792904:0:104390:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201497.792929:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788201497.792932:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201497.792933:0:104390:0:(obd_config.c:1563:class_process_config()) marker 44 (0x6) lustre-MDT0001-m new lustre.pool_134 00000020:01000000:1.0:1788201497.792936:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788201497.792938:0:104390:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #47 00000020:01000000:1.0:1788201497.792939:0:104390:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201497.792941:0:104390:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201497.792942:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788201497.792944:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201497.792946:0:104390:0:(obd_config.c:1563:class_process_config()) marker 47 (0x6) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000020:01000000:1.0:1788201497.792948:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201497.792951:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201497.792952:0:104390:0:(obd_config.c:1563:class_process_config()) marker 48 (0x1) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:1.0:1788201497.792955:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: ce022 00000020:01000000:1.0:1788201497.792962:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201497.792964:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201497.792965:0:104390:0:(obd_config.c:1563:class_process_config()) marker 48 (0x2) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:01000000:1.0:1788201497.792967:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201497.792970:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201497.792971:0:104390:0:(obd_config.c:1563:class_process_config()) marker 51 (0x1) lustre-MDT0001-m del lustre.pool_134 00000020:00000080:1.0:1788201497.792973:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: ce023 00000020:01000000:1.0:1788201497.792981:0:104390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201497.792984:0:104390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201497.792985:0:104390:0:(obd_config.c:1563:class_process_config()) marker 51 (0x2) lustre-MDT0001-m del lustre.pool_134 00000040:00080000:1.0:1788201497.792988:0:104390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6e:0x0] index 59 count 58 00000020:01000000:1.0:1788201497.793079:0:104386:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-58 (rc=0) 10000000:01000000:1.0:1788201497.793112:0:104386:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00000100:00100000:3.0:1788201497.793295:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715423104:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788201497.793382:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201497.793417:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715423104 00000100:00100000:3.0:1788201497.793424:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715423104 00000100:00100000:3.0:1788201497.793456:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788201497.793463:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00714f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3654:x1875060715423104:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1788201497.793490:0:99766:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4349 last 0 00000020:00000080:3.0:1788201497.793514:0:99766:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x96d0c9b8c9a1e80b 00002000:00100000:3.0:1788201497.793528:0:99766:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8dc00520e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788201497.793533:0:99766:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788201497.793536:0:99766:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788201497.793602:0:99766:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788201497.793624:0:99766:0:(import.c:65:import_set_state_nolock()) ffff8dc00520b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201497.793665:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00714f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715423104:12345-0@lo:8:llog_process_th.0 Request processed in 201us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201497.793672:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788201497.793728:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201497.793737:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788201497.793743:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788201497.793747:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788201497.793750:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc139bc2800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788201497.793763:0:3654:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788201497.793768:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715423104:0@lo:8:llog_process_th.0 00010000:00010000:1.0:1788201497.795446:0:104386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1e771 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e778 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201497.795487:0:104386:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1e771 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e778 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201497.795497:0:104386:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc10630d000 from 1 10000000:01000000:1.0:1788201497.795500:0:104386:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788201497.795539:0:104386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1e812 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201497.795546:0:104386:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1e812 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201497.795556:0:104386:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1e812 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201497.795579:0:104386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715423232:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201497.795644:0:104386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.795686:0:104386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004f166c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201497.795958:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715423232 00000100:00100000:3.0:1788201497.795966:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715423232 00000100:00100000:3.0:1788201497.796042:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788201497.796052:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:104386:x1875060715423232:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201497.796073:0:102454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201497.796086:0:102454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc125ae2400/0x96d0c9b8c9a1e819 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e812 expref: -99 pid: 102454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.796109:0:102454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc125ae2400/0x96d0c9b8c9a1e819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e812 expref: 22 pid: 102454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.796133:0:102454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc125ae2400/0x96d0c9b8c9a1e819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e812 expref: 22 pid: 102454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.796141:0:102454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2400, rc 0) 00000100:00100000:3.0:1788201497.796181:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:104386:x1875060715423232:12345-0@lo:101:mount.lustre.0 Request processed in 131us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201497.796188:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788201497.796702:0:104386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715423232:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201497.796718:0:104386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1e812 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e819 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201497.796728:0:104386:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1e812 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e819 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201497.797382:0:104386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715423360:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788201497.797432:0:104386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.797473:0:104386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004f166c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201497.797660:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715423360 00000100:00100000:2.0:1788201497.797666:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715423360 00000100:00100000:2.0:1788201497.797706:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788201497.797714:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+22:104386:x1875060715423360:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788201497.797733:0:102458:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788201497.797755:0:102458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788201497.797760:0:102458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788201497.797763:0:102458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788201497.797766:0:102458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788201497.797768:0:102458:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 135 00000100:00100000:2.0:1788201497.797877:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+22:104386:x1875060715423360:12345-0@lo:256:mount.lustre.0 Request processed in 163us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201497.797884:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788201497.797916:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201497.797925:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715423488:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201497.797955:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201497.797990:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715423488 00000100:00100000:2.0:1788201497.797994:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715423488 00000100:00100000:2.0:1788201497.798062:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788201497.798070:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715423488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201497.798094:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201497.798307:0:104386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715423360:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788201497.798936:0:104386:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000100:00100000:2.0:1788201497.798996:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715423488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 926us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201497.799005:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1788201497.799046:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201497.799453:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715423488:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1788201497.799575:0:104397:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788201497.799664:0:104397:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 4349271647666ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788201497.799671:0:104397:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00010000:1.0:1788201497.801148:0:104386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1e812 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e819 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201497.801165:0:104386:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1e812 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e819 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201497.801173:0:104386:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc10630d000 from 1 10000000:01000000:1.0:1788201497.801176:0:104386:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788201497.801220:0:104386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e820 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201497.801228:0:104386:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e820 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201497.801238:0:104386:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e820 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201497.801259:0:104386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715423616:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201497.801322:0:104386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.801368:0:104386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004f166c0 going to sleep for 11 seconds 00000004:00080000:2.0:1788201497.801976:0:104387:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788201497.802397:0:102453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715423616 00000100:00100000:2.0:1788201497.802405:0:102453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715423616 00000100:00100000:2.0:1788201497.802462:0:102453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788201497.802472:0:102453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:104386:x1875060715423616:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201497.802488:0:102453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201497.802504:0:102453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006dbda00/0x96d0c9b8c9a1e827 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e820 expref: -99 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201497.802557:0:102453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006dbda00/0x96d0c9b8c9a1e827 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e820 expref: 23 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201497.802567:0:102453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006dbda00/0x96d0c9b8c9a1e827 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e820 expref: 23 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201497.802577:0:102453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbda00, rc 0) 00000100:00100000:2.0:1788201497.802668:0:102453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+23:104386:x1875060715423616:12345-0@lo:101:mount.lustre.0 Request processed in 198us (1346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201497.802675:0:102453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788201497.804422:0:104386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715423616:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201497.804449:0:104386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e820 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e827 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201497.804464:0:104386:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e820 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e827 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201497.804751:0:104386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6a:0x0] index 7 count 7 00000040:00080000:1.0:1788201497.805089:0:104386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201497.805836:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6f:0x0].1, 224 off8416 00000040:00080000:1.0:1788201497.805864:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6f:0x0].2, 112 off8528 00000040:00080000:1.0:1788201497.805877:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6f:0x0].3, 224 off8752 00000040:00080000:1.0:1788201497.805889:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6f:0x0].4, 224 off8976 00000040:00080000:1.0:1788201497.805901:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6f:0x0].5, 112 off9088 00000040:00080000:1.0:1788201497.805918:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6f:0x0].6, 224 off9312 00000040:00080000:1.0:1788201497.805922:0:104386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6a:0x0] index 6 count 7 00000100:00100000:1.0:1788201497.805997:0:104386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715423744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201497.806113:0:104386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.808063:0:104386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004f16f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201497.808322:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715423744 00000100:00100000:3.0:1788201497.808332:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715423744 00000100:00100000:3.0:1788201497.808402:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788201497.808413:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:104386:x1875060715423744:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201497.808570:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:104386:x1875060715423744:12345-0@lo:501:mount.lustre.0 Request processed in 159us (2457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201497.808578:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788201497.808710:0:104386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715423744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201497.808763:0:104386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715423872:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201497.808825:0:104386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.808850:0:104386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004f16f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201497.809112:0:102459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715423872 00000100:00100000:3.0:1788201497.809127:0:102459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715423872 00000100:00100000:3.0:1788201497.809155:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788201497.809162:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+23:104386:x1875060715423872:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201497.809258:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+23:104386:x1875060715423872:12345-0@lo:503:mount.lustre.0 Request processed in 95us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201497.809271:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788201497.809716:0:104386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715423872:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788201497.810271:0:104386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201497.810346:0:104386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715424000:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201497.810411:0:104386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.810493:0:104386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004f166c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201497.813059:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715424000 00000100:00100000:3.0:1788201497.813076:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715424000 00000100:00100000:3.0:1788201497.813389:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788201497.813400:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:104386:x1875060715424000:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201497.813668:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:104386:x1875060715424000:12345-0@lo:502:mount.lustre.0 Request processed in 269us (3256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201497.813675:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788201497.814445:0:104386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715424000:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201497.814798:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x70:0x0].1, 224 off8416 00000040:00080000:0.0:1788201497.814830:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x70:0x0].2, 112 off8528 00000040:00080000:0.0:1788201497.814845:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x70:0x0].3, 224 off8752 00000040:00080000:0.0:1788201497.814858:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x70:0x0].4, 224 off8976 00000040:00080000:0.0:1788201497.814869:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x70:0x0].5, 112 off9088 00000100:00100000:0.0:1788201497.814905:0:104386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133330380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715424128:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201497.814962:0:104386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201497.815069:0:104386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140ffb300 going to sleep for 11 seconds 00000100:00100000:2.0:1788201497.815352:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715424128 00000100:00100000:2.0:1788201497.815369:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715424128 00000100:00100000:2.0:1788201497.815495:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788201497.815505:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+23:104386:x1875060715424128:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201497.815643:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+23:104386:x1875060715424128:12345-0@lo:502:mount.lustre.0 Request processed in 138us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201497.815650:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788201497.815723:0:104386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133330380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715424128:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201497.815780:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x70:0x0].6, 224 off9312 00000040:00080000:1.0:1788201497.815791:0:104386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:3.0:1788201497.817936:0:104399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201497.817951:0:104399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201497.817954:0:104399:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788201497.817962:0:104399:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc10630d000 00000020:00000080:3.0:1788201497.817966:0:104399:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788201497.817974:0:104399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201497.817977:0:104399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201497.817978:0:104399:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788201497.817981:0:104399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201497.817983:0:104399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201497.817984:0:104399:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788201497.817988:0:104399:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc10630d000 00000020:00000080:3.0:1788201497.817989:0:104399:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788201497.818410:0:104399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201497.818417:0:104399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201497.818419:0:104399:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788201497.818423:0:104399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x70:0x0] index 7 count 7 00000020:01000000:3.0:1788201497.820457:0:104386:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1788201497.820499:0:104386:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201497.820520:0:104386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e820 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e827 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.820533:0:104386:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e820 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e827 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201497.820602:0:104386:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788201497.820605:0:104386:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dc10630d000 10000000:01000000:3.0:1788201497.820608:0:104386:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dc10630d000 10000000:01000000:3.0:1788201497.820612:0:104386:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201497.820617:0:104386:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc10630d000 from 1 10000000:01000000:3.0:1788201497.820620:0:104386:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201497.820658:0:104386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e82e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.820666:0:104386:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e82e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.820679:0:104386:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e82e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201497.820706:0:104386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715424256:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201497.820786:0:104386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201497.820828:0:104386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f17b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201497.825080:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715424256 00000100:00100000:2.0:1788201497.825094:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715424256 00000100:00100000:2.0:1788201497.825277:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788201497.825289:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:104386:x1875060715424256:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201497.825305:0:102452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201497.825323:0:102452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006dbc000/0x96d0c9b8c9a1e835 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e82e expref: -99 pid: 102452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201497.825376:0:102452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006dbc000/0x96d0c9b8c9a1e835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e82e expref: 24 pid: 102452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201497.825388:0:102452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006dbc000/0x96d0c9b8c9a1e835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e82e expref: 24 pid: 102452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201497.825397:0:102452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbc000, rc 0) 00000100:00100000:2.0:1788201497.825508:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:104386:x1875060715424256:12345-0@lo:101:mount.lustre.0 Request processed in 220us (4721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201497.825515:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788201497.832969:0:104386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715424256:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201497.833054:0:104386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e82e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e835 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201497.833070:0:104386:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e82e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e835 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201497.833497:0:104386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6c:0x0] index 52 count 51 00000040:00080000:0.0:1788201497.833774:0:104386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201497.833960:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].1, 224 off8416 00000040:00080000:0.0:1788201497.833985:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].2, 120 off8536 00000040:00080000:0.0:1788201497.833998:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].3, 168 off8704 00000040:00080000:0.0:1788201497.834011:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].4, 224 off8928 00000040:00080000:1.0:1788201497.839690:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].5, 224 off9152 00000040:00080000:1.0:1788201497.839732:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].6, 120 off9272 00000040:00080000:1.0:1788201497.839748:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].7, 168 off9440 00000040:00080000:1.0:1788201497.839762:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].8, 224 off9664 00000040:00080000:1.0:1788201497.839776:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].9, 224 off9888 00000040:00080000:1.0:1788201497.839788:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].10, 120 off10008 00000040:00080000:1.0:1788201497.839803:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].11, 224 off10232 00000040:00080000:1.0:1788201497.839818:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].12, 224 off10456 00000040:00080000:1.0:1788201497.839832:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].13, 88 off10544 00000040:00080000:1.0:1788201497.839847:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].14, 128 off10672 00000040:00080000:1.0:1788201497.839861:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].15, 144 off10816 00000040:00080000:1.0:1788201497.839874:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].16, 160 off10976 00000040:00080000:1.0:1788201497.839888:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].17, 224 off11200 00000040:00080000:1.0:1788201497.839901:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].18, 224 off11424 00000040:00080000:1.0:1788201497.839913:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].19, 80 off11504 00000040:00080000:1.0:1788201497.839926:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].20, 224 off11728 00000040:00080000:1.0:1788201497.839942:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].21, 224 off11952 00000040:00080000:1.0:1788201497.839955:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].22, 88 off12040 00000040:00080000:1.0:1788201497.839968:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].23, 128 off12168 00000040:00080000:1.0:1788201497.839982:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].24, 144 off12312 00000040:00080000:1.0:1788201497.839995:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].25, 160 off12472 00000040:00080000:1.0:1788201497.840009:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].26, 224 off12696 00000040:00080000:1.0:1788201497.840098:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].27, 224 off12920 00000040:00080000:1.0:1788201497.840114:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].28, 80 off13000 00000040:00080000:1.0:1788201497.840450:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].29, 224 off13224 00000040:00080000:1.0:1788201497.840464:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].30, 224 off13448 00000040:00080000:1.0:1788201497.840476:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].31, 88 off13536 00000040:00080000:1.0:1788201497.840488:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].32, 128 off13664 00000040:00080000:1.0:1788201497.840500:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].33, 144 off13808 00000040:00080000:1.0:1788201497.840513:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].34, 128 off13936 00000040:00080000:1.0:1788201497.840525:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].35, 224 off14160 00000040:00080000:1.0:1788201497.840539:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].36, 224 off14384 00000040:00080000:1.0:1788201497.840552:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].37, 80 off14464 00000040:00080000:1.0:1788201497.840566:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].38, 224 off14688 00000040:00080000:1.0:1788201497.840591:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].39, 224 off14912 00000040:00080000:1.0:1788201497.840604:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].40, 88 off15000 00000040:00080000:1.0:1788201497.840616:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].41, 128 off15128 00000040:00080000:1.0:1788201497.840628:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].42, 144 off15272 00000040:00080000:1.0:1788201497.840640:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].43, 128 off15400 00000040:00080000:1.0:1788201497.840651:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].44, 224 off15624 00000040:00080000:1.0:1788201497.840664:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].45, 224 off15848 00000040:00080000:1.0:1788201497.840679:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].46, 80 off15928 00000040:00080000:1.0:1788201497.840692:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].47, 224 off16152 00000040:00080000:1.0:1788201497.840703:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].48, 232 off16384 00000040:00080000:1.0:1788201497.840876:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].49, 224 off16608 00000040:00080000:1.0:1788201497.840897:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].50, 120 off16728 00000040:00080000:1.0:1788201497.840915:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x71:0x0].51, 224 off16952 00000040:00080000:1.0:1788201497.840921:0:104386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6c:0x0] index 51 count 51 00000100:00100000:1.0:1788201497.841083:0:104386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13336a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715424384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201497.841315:0:104386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.841520:0:104386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004f16d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201497.841608:0:102459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715424384 00000100:00100000:2.0:1788201497.841616:0:102459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715424384 00000100:00100000:2.0:1788201497.841678:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788201497.841688:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+24:104386:x1875060715424384:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201497.841844:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+24:104386:x1875060715424384:12345-0@lo:501:mount.lustre.0 Request processed in 156us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201497.841852:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788201497.842557:0:104386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13336a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715424384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201497.842615:0:104386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13336a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715424512:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201497.842681:0:104386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.842710:0:104386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004f16d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201497.842878:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715424512 00000100:00100000:2.0:1788201497.842884:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715424512 00000100:00100000:2.0:1788201497.842923:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788201497.842931:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:104386:x1875060715424512:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201497.843090:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:104386:x1875060715424512:12345-0@lo:503:mount.lustre.0 Request processed in 158us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201497.843097:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788201497.843261:0:104386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13336a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715424512:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788201497.843723:0:104386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201497.843800:0:104386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13336a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715424640:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201497.843842:0:104386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.843873:0:104386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004f16d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201497.844374:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715424640 00000100:00100000:2.0:1788201497.844380:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715424640 00000100:00100000:2.0:1788201497.844426:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788201497.844435:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:104386:x1875060715424640:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201497.844544:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:104386:x1875060715424640:12345-0@lo:502:mount.lustre.0 Request processed in 110us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201497.844553:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788201497.845245:0:104386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13336a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715424640:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201497.845444:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].1, 224 off8416 00000040:00080000:0.0:1788201497.845472:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].2, 120 off8536 00000040:00080000:0.0:1788201497.845484:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].3, 168 off8704 00000040:00080000:0.0:1788201497.845497:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].4, 224 off8928 00000040:00080000:0.0:1788201497.845509:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].5, 224 off9152 00000040:00080000:0.0:1788201497.845521:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].6, 120 off9272 00000040:00080000:0.0:1788201497.845533:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].7, 168 off9440 00000040:00080000:0.0:1788201497.845546:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].8, 224 off9664 00000040:00080000:0.0:1788201497.845557:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].9, 224 off9888 00000040:00080000:0.0:1788201497.845569:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].10, 120 off10008 00000040:00080000:0.0:1788201497.845581:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].11, 224 off10232 00000040:00080000:0.0:1788201497.845591:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].12, 224 off10456 00000040:00080000:0.0:1788201497.845603:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].13, 88 off10544 00000040:00080000:0.0:1788201497.845614:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].14, 128 off10672 00000040:00080000:0.0:1788201497.845625:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].15, 144 off10816 00000040:00080000:0.0:1788201497.845637:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].16, 160 off10976 00000040:00080000:0.0:1788201497.845648:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].17, 224 off11200 00000040:00080000:0.0:1788201497.845670:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].18, 224 off11424 00000040:00080000:0.0:1788201497.845684:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].19, 80 off11504 00000040:00080000:0.0:1788201497.845695:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].20, 224 off11728 00000040:00080000:0.0:1788201497.845707:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].21, 224 off11952 00000040:00080000:0.0:1788201497.845720:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].22, 88 off12040 00000040:00080000:0.0:1788201497.845734:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].23, 128 off12168 00000040:00080000:0.0:1788201497.845748:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].24, 144 off12312 00000040:00080000:0.0:1788201497.845759:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].25, 160 off12472 00000040:00080000:0.0:1788201497.845772:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].26, 224 off12696 00000040:00080000:0.0:1788201497.845784:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].27, 224 off12920 00000040:00080000:0.0:1788201497.845799:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].28, 80 off13000 00000040:00080000:0.0:1788201497.845810:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].29, 224 off13224 00000040:00080000:0.0:1788201497.845822:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].30, 224 off13448 00000040:00080000:0.0:1788201497.845834:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].31, 88 off13536 00000040:00080000:0.0:1788201497.845846:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].32, 128 off13664 00000040:00080000:0.0:1788201497.845857:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].33, 144 off13808 00000040:00080000:0.0:1788201497.845868:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].34, 128 off13936 00000040:00080000:0.0:1788201497.845880:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].35, 224 off14160 00000040:00080000:0.0:1788201497.845894:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].36, 224 off14384 00000040:00080000:0.0:1788201497.845907:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].37, 80 off14464 00000040:00080000:0.0:1788201497.845918:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].38, 224 off14688 00000040:00080000:0.0:1788201497.845930:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].39, 224 off14912 00000040:00080000:0.0:1788201497.845941:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].40, 88 off15000 00000040:00080000:0.0:1788201497.845954:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].41, 128 off15128 00000040:00080000:0.0:1788201497.845967:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].42, 144 off15272 00000040:00080000:0.0:1788201497.845978:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].43, 128 off15400 00000040:00080000:0.0:1788201497.845991:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].44, 224 off15624 00000040:00080000:0.0:1788201497.846005:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].45, 224 off15848 00000040:00080000:0.0:1788201497.847288:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].46, 80 off15928 00000040:00080000:0.0:1788201497.847331:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].47, 224 off16152 00000040:00080000:0.0:1788201497.847345:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].48, 232 off16384 00000100:00100000:0.0:1788201497.847418:0:104386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715424768:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201497.847505:0:104386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201497.847560:0:104386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140ffbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201497.847863:0:102453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715424768 00000100:00100000:2.0:1788201497.847871:0:102453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715424768 00000100:00100000:2.0:1788201497.847928:0:102453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788201497.847938:0:102453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:104386:x1875060715424768:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201497.848195:0:102453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:104386:x1875060715424768:12345-0@lo:502:mount.lustre.0 Request processed in 257us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201497.848203:0:102453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788201497.848370:0:104386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715424768:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201497.848570:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].49, 224 off16608 00000040:00080000:0.0:1788201497.848594:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].50, 120 off16728 00000040:00080000:0.0:1788201497.848607:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].51, 224 off16952 00000040:00080000:0.0:1788201497.848618:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].52, 224 off17176 00000040:00080000:0.0:1788201497.848630:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].53, 112 off17288 00000040:00080000:0.0:1788201497.848641:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].54, 224 off17512 00000040:00080000:0.0:1788201497.848653:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].55, 224 off17736 00000040:00080000:0.0:1788201497.848664:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].56, 136 off17872 00000040:00080000:0.0:1788201497.848678:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].57, 224 off18096 00000040:00080000:0.0:1788201497.848690:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].58, 224 off18320 00000040:00080000:0.0:1788201497.848701:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].59, 136 off18456 00000040:00080000:0.0:1788201497.848713:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].60, 224 off18680 00000040:00080000:0.0:1788201497.848726:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].61, 224 off18904 00000040:00080000:0.0:1788201497.848741:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].62, 112 off19016 00000100:00100000:0.0:1788201497.848769:0:104386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715424896:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201497.848813:0:104386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201497.848836:0:104386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140ffbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201497.848898:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715424896 00000100:00100000:2.0:1788201497.848904:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715424896 00000100:00100000:2.0:1788201497.848944:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788201497.848952:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:104386:x1875060715424896:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201497.849071:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:104386:x1875060715424896:12345-0@lo:502:mount.lustre.0 Request processed in 119us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201497.849077:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788201497.850205:0:104386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133332d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715424896:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201497.850296:0:104386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x72:0x0].63, 224 off19240 00000040:00080000:0.0:1788201497.850312:0:104386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 00000020:01000004:2.0:1788201497.854749:0:104402:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788201497.854772:0:104402:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8dc0027d0000) 00000020:00000080:2.0:1788201497.854803:0:104402:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1788201497.854886:0:104402:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc10630d000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788201497.854892:0:104402:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc10630d000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788201497.854895:0:104402:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc10630d000 3 00010000:00080000:2.0:1788201497.854927:0:104402:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc110779800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.120@tcp at head 00010000:00010000:3.0:1788201497.859788:0:104402:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-12 is initialized 00000020:00000080:3.0:1788201497.860078:0:104402:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788201497.860134:0:104402:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788201497.860147:0:104402:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x96d0c9b8c9a1e843 00000100:00080000:3.0:1788201497.860157:0:104402:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201497.860162:0:104402:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc110779800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201497.860196:0:104402:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc007158000 x1875060715425024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201497.860225:0:104402:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788201497.862552:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715425024:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788201497.862638:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201497.862725:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715425024 00000100:00100000:0.0:1788201497.862733:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715425024 00000100:00100000:0.0:1788201497.862773:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1798 00000100:00100000:0.0:1788201497.862796:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715425024:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788201497.862828:0:66312:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 4349 last 0 00000020:00000080:0.0:1788201497.862868:0:66312:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x96d0c9b8c9a1e84a 00000004:00100000:0.0:1788201497.862883:0:66312:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788201497.862917:0:66312:0:(import.c:65:import_set_state_nolock()) ffff8dc103484800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201497.862981:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875060715425024:12345-0@lo:38:llog_process_th.0 Request processed in 184us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201497.862988:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1798 00000040:00080000:1.0:1788201497.863684:0:104402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x72:0x0] index 64 count 63 00000020:01000000:0.0:1788201497.863839:0:104386:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:0.0:1788201497.863873:0:104386:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201497.863898:0:104386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e82e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e835 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201497.863911:0:104386:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e82e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e835 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788201497.863974:0:104386:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788201497.863977:0:104386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788201497.863978:0:104386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201497.863980:0:104386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201497.863981:0:104386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201497.863982:0:104386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201497.863983:0:104386:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201497.863985:0:104386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201497.863987:0:104386:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788201497.863991:0:104386:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1788201497.863993:0:104386:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788201497.863994:0:104386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788201497.863995:0:104386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201497.863996:0:104386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201497.863997:0:104386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201497.863999:0:104386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201497.864005:0:104386:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201497.864006:0:104386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201497.864006:0:104386:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788201497.864053:0:104386:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788201497.864070:0:104386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715425152:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788201497.864135:0:104386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201497.864169:0:102459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715425152 00000100:00100000:0.0:1788201497.864175:0:102459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715425152 00000100:00100000:0.0:1788201497.864219:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788201497.864228:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+24:104386:x1875060715425152:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788201497.864254:0:102459:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788201497.864266:0:102459:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788201497.864393:0:104386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140ffbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201497.864684:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788201497.864702:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 30 00000100:00080000:3.0:1788201497.864710:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788201497.864715:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788201497.864718:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc110779800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788201497.864726:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715425024:0@lo:38:llog_process_th.0 00000001:00100000:3.0:1788201497.866700:0:102447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788201497.866796:0:102459:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788201497.866852:0:102459:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788201497.868242:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+24:104386:x1875060715425152:12345-0@lo:253:mount.lustre.0 Request processed in 4008us (4100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201497.868255:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788201497.868403:0:104386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:104386:1875060715425152:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788201497.868431:0:104386:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788201497.868435:0:104386:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788201497.868437:0:104386:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788201497.868438:0:104386:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201497.868440:0:104386:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201497.868441:0:104386:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201497.868443:0:104386:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201497.868444:0:104386:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201497.868446:0:104386:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201497.868447:0:104386:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788201497.868463:0:104386:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788201497.880314:0:102456:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788201497.880326:0:102456:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788201497.880363:0:102456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e851 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.880383:0:102456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc108c75c00/0x96d0c9b8c9a1e06a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ddc expref: 9 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.880392:0:102456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc108c75000/0x96d0c9b8c9a1e08d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e086 expref: 23 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.880399:0:102456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc125ae2400/0x96d0c9b8c9a1e819 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e812 expref: 23 pid: 102454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.880406:0:102456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e851 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.880452:0:102456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc125ae2400/0x96d0c9b8c9a1e819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1e812 expref: 23 pid: 102454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.880468:0:102456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc125ae2400/0x96d0c9b8c9a1e819 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1e812 expref: 23 pid: 102454 timeout: 4449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201497.880483:0:102456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:102456:1875060715425280:0@lo:104: 00000100:00100000:3.0:1788201497.880558:0:102456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201497.880611:0:102456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc108c75000/0x96d0c9b8c9a1e08d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1e086 expref: 23 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.880621:0:102456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc108c75000/0x96d0c9b8c9a1e08d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1e086 expref: 23 pid: 102453 timeout: 4449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201497.880630:0:102456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:102456:1875060715425408:0@lo:104: 00000100:00100000:3.0:1788201497.880649:0:102456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201497.880676:0:102456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc108c75c00/0x96d0c9b8c9a1e06a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ddc expref: 9 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.880686:0:102456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc108c75c00/0x96d0c9b8c9a1e06a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ddc expref: 9 pid: 102453 timeout: 4449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201497.880696:0:102456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:102456:1875060715425536:192.168.201.20@tcp:104: 00000100:00100000:3.0:1788201497.880743:0:102456:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0034c7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201497.880781:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715425280 00000100:00100000:3.0:1788201497.880789:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715425280 00000100:00100000:3.0:1788201497.880831:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715425408 00000100:00100000:3.0:1788201497.880834:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715425408 00000100:00100000:3.0:1788201497.880851:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1788201497.880859:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007159c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+4:102456:x1875060715425280:12345-0@lo:104: 00010000:00010000:3.0:1788201497.880871:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1e812 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1e819 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.880917:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788201497.880923:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007159c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+4:102456:x1875060715425280:12345-0@lo:104: Request processed in 64us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201497.880938:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1788201497.880971:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1788201497.880977:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007159180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+3:102456:x1875060715425408:12345-0@lo:104: 00010000:00010000:3.0:1788201497.880984:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc006dbdc00/0x96d0c9b8c9a1e086 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1e08d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.881046:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788201497.881052:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007159180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+3:102456:x1875060715425408:12345-0@lo:104: Request processed in 76us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201497.881058:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00010000:00010000:3.0:1788201497.881182:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201497.881189:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1e812 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1e819 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.881196:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2c00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:3.0:1788201497.881200:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1e812 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1e819 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.881208:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1e812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1e819 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201497.881216:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1e812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1e819 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201497.881222:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201497.881249:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1e812 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1e819 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.881256:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201497.881282:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1e812 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1e819 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.881289:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1e812 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1e819 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.881304:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201497.881307:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc006dbdc00/0x96d0c9b8c9a1e086 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1e08d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.881312:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbdc00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:3.0:1788201497.881315:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc006dbdc00/0x96d0c9b8c9a1e086 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1e08d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.881321:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc006dbdc00/0x96d0c9b8c9a1e086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1e08d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201497.881328:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc006dbdc00/0x96d0c9b8c9a1e086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1e08d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201497.881333:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201497.881344:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc006dbdc00/0x96d0c9b8c9a1e086 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1e08d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.881350:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201497.881368:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc006dbdc00/0x96d0c9b8c9a1e086 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1e08d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.881375:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc006dbdc00/0x96d0c9b8c9a1e086 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1e08d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.881390:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201497.881398:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201497.881400:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201497.881441:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715425792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201497.881476:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201497.881500:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201497.881505:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715425664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201497.881521:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201497.881544:0:9535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715425792 00000100:00100000:3.0:1788201497.881549:0:9535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715425792 00010000:00010000:3.0:1788201497.881565:0:9535:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc108c75000/0x96d0c9b8c9a1e08d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1e086 expref: 24 pid: 102453 timeout: 4449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201497.881583:0:9535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715425664 00000100:00100000:3.0:1788201497.881586:0:9535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715425664 00010000:00010000:3.0:1788201497.881596:0:9535:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc125ae2400/0x96d0c9b8c9a1e819 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1e812 expref: 25 pid: 102454 timeout: 4449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201497.881611:0:9535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631 00000100:00100000:3.0:1788201497.881617:0:9535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9b18af6-fecc-4172-82c2-66531890fe11+25:3658:x1875060715425792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201497.881627:0:9535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201497.881631:0:9535:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc108c75000/0x96d0c9b8c9a1e08d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1e086 expref: 25 pid: 102453 timeout: 4449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.881640:0:9535:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc108c75000/0x96d0c9b8c9a1e08d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1e086 expref: 25 pid: 102453 timeout: 4449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.881654:0:9535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201497.881679:0:9535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9b18af6-fecc-4172-82c2-66531890fe11+25:3658:x1875060715425792:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201497.881685:0:9535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631 00000100:00100000:3.0:1788201497.881706:0:9535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632 00000100:00100000:3.0:1788201497.881712:0:9535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715425664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201497.881719:0:9535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201497.881723:0:9535:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc125ae2400/0x96d0c9b8c9a1e819 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1e812 expref: 24 pid: 102454 timeout: 4449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.881732:0:9535:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc125ae2400/0x96d0c9b8c9a1e819 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1e812 expref: 24 pid: 102454 timeout: 4449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.881741:0:9535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201497.881762:0:9535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715425664:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201497.881768:0:9535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632 00000100:00100000:3.0:1788201497.881810:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715425664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201497.881820:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715425792:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201497.881849:0:102456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae2400/0x96d0c9b8c9a1e819 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1e812 expref: 23 pid: 102454 timeout: 4449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201497.881858:0:102456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:102456:1875060715425280:0@lo:104: 00010000:00010000:3.0:1788201497.881867:0:102456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc108c75000/0x96d0c9b8c9a1e08d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1e086 expref: 22 pid: 102453 timeout: 4449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201497.881874:0:102456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:102456:1875060715425408:0@lo:104: 00010000:00010000:3.0:1788201497.882278:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201497.887791:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201497.887830:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695554432 00000100:00100000:3.0:1788201497.887839:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695554432 00010000:00010000:3.0:1788201497.887894:0:26213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc108c75c00/0x96d0c9b8c9a1e06a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ddc expref: 10 pid: 102453 timeout: 4449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201497.887929:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2633 00000100:00100000:3.0:1788201497.887939:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695554432:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201497.888271:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201497.888279:0:26213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc108c75c00/0x96d0c9b8c9a1e06a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ddc expref: 10 pid: 102453 timeout: 4449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.888292:0:26213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc108c75c00/0x96d0c9b8c9a1e06a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ddc expref: 10 pid: 102453 timeout: 4449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.888313:0:26213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e851 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.888320:0:26213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e851 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788201497.888335:0:26213:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008011934s 00010000:00010000:3.0:1788201497.888339:0:26213:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e851 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.888346:0:26213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e851 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.888352:0:26213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e851 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.888371:0:26213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e851 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.888388:0:26213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201497.888392:0:26213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e851 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.888400:0:26213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e851 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.888408:0:26213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e851 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.888423:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201497.888475:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695554432:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 538us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201497.888484:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2633 00010000:00010000:3.0:1788201497.889313:0:102456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc108c75c00/0x96d0c9b8c9a1e06a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ddc expref: 9 pid: 102453 timeout: 4449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201497.889331:0:102456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:102456:1875060715425536:192.168.201.20@tcp:104: 00010000:00010000:3.0:1788201497.889374:0:102456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e851 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.889383:0:102456:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e851 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.889390:0:102456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e851 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201497.889396:0:102456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e851 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788201497.892698:0:104386:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0001: committed batchid 73014444104 00000040:01000000:1.0:1788201497.899650:0:104386:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:1.0:1788201497.901729:0:104408:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788201497.902278:0:104386:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1788201497.903287:0:104409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104409:1875060715425920:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1788201497.903625:0:104386:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788201497.903663:0:104386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201497.905278:0:104409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.905345:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715425920 00000100:00100000:1.0:1788201497.905365:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715425920 00000100:00100000:1.0:1788201497.905417:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788201497.905426:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:104409:x1875060715425920:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788201497.905517:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:104409:x1875060715425920:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 92us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201497.905524:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788201497.905554:0:104409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13ab40e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201497.905580:0:104409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104409:1875060715425920:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1788201497.905613:0:104409:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788201497.905651:0:104409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104409:1875060715426048:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788201497.905684:0:104409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.905708:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715426048 00000100:00100000:1.0:1788201497.905726:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715426048 00000100:00100000:1.0:1788201497.905750:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788201497.905757:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13336aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:104409:x1875060715426048:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788201497.905843:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13336aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:104409:x1875060715426048:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 86us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201497.905849:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788201497.905865:0:104409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13ab40e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201497.905876:0:104409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104409:1875060715426048:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788201497.905932:0:104409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:104409:1875060715426176:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788201497.905958:0:104409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.905987:0:66324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715426176 00000100:00100000:1.0:1788201497.905991:0:66324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715426176 00000100:00100000:1.0:1788201497.906042:0:66324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788201497.906048:0:66324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:104409:x1875060715426176:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788201497.906081:0:66324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:104409:x1875060715426176:12345-0@lo:900:lod0001_rec0000.0 Request processed in 32us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201497.906087:0:66324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788201497.906102:0:104409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13ab40480 going to sleep for 11 seconds 00000004:00000080:2.0:1788201497.906291:0:104386:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788201497.906303:0:104386:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788201497.906392:0:104386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201497.907205:0:104409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:104409:1875060715426176:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788201497.907261:0:104409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104409:1875060715426304:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788201497.907301:0:104409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.907336:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715426304 00000100:00100000:1.0:1788201497.907340:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715426304 00000100:00100000:1.0:1788201497.907382:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788201497.907390:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13336a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:104409:x1875060715426304:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788201497.907468:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13336a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:104409:x1875060715426304:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 78us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201497.907474:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788201497.907496:0:104409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13ab40e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201497.907514:0:104409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104409:1875060715426304:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788201497.907578:0:104409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104409:1875060715426432:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788201497.907630:0:104409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.907650:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715426432 00000100:00100000:1.0:1788201497.907654:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715426432 00000100:00100000:1.0:1788201497.907675:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788201497.907681:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:104409:x1875060715426432:12345-0@lo:1000:lod0001_rec0000.0 00000020:00080000:3.0:1788201497.908093:0:104407:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 73014444104 00000020:00080000:3.0:1788201497.908099:0:104407:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444104 00000040:00080000:2.0:1788201497.910883:0:104386:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788201497.911501:0:104386:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788201497.911537:0:104386:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1788201497.911660:0:104386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788201497.912220:0:104386:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x40:0x0] (8/32) registered 00000100:00100000:1.0:1788201497.912879:0:104409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13ab40900 going to sleep for 11 seconds 00000040:00080000:0.0:1788201497.914582:0:104408:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x2400013a0:0x3:0x0] first idx 14, last_idx 15 00000040:00080000:0.0:1788201497.914669:0:104408:0:(llog.c:805:llog_process_thread()) index: 15, lh_last_idx: 15 synced_idx: 15 lgh_last_idx: 15 00000040:00080000:0.0:1788201497.914673:0:104408:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x2400088d0:0x1:0x0] at index 15 of catalog [0x2400013a0:0x3:0x0] 00000040:00080000:0.0:1788201497.914860:0:104408:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x2400088d0:0x1:0x0] at index 15 of catalog [0x2400013a0:0x3:0x0] 00000040:00080000:0.0:1788201497.914876:0:104408:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400013a0:0x3:0x0] index 15 count 1 00000004:00080000:0.0:1788201497.914922:0:104408:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1788201497.918117:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:104409:x1875060715426432:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 10426us (10477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201497.918132:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788201497.920587:0:104409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104409:1875060715426432:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788201497.920650:0:104409:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000bd1:0x3:0x0] first idx 28, last_idx 30 00000100:00100000:0.0:1788201497.920791:0:104409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104409:1875060715426560:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788201497.920880:0:104409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201497.920919:0:104409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007486d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201497.921044:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715426560 00000100:00100000:1.0:1788201497.921051:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715426560 00000100:00100000:1.0:1788201497.921107:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788201497.921117:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:104409:x1875060715426560:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788201497.924789:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:104409:x1875060715426560:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 3660us (3896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201497.924803:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788201497.924901:0:104409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104409:1875060715426560:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1788201497.924961:0:104409:0:(llog.c:805:llog_process_thread()) index: 29, lh_last_idx: 30 synced_idx: 0 lgh_last_idx: 30 00000040:00080000:2.0:1788201497.924965:0:104409:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x2000090a1:0x1:0x0] at index 29 of catalog [0x200000bd1:0x3:0x0] 00000100:00100000:2.0:1788201497.925070:0:104409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0078e3480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104409:1875060715426688:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788201497.925110:0:104409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201497.925163:0:104409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140ffbe40 going to sleep for 11 seconds 00010000:00080000:3.0:1788201497.925714:0:104386:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0001, 2 recoverable clients, last_transno 77309411499 00000100:00100000:1.0:1788201497.926095:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715426688 00000100:00100000:1.0:1788201497.926103:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715426688 00000100:00100000:1.0:1788201497.926153:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788201497.926162:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:104409:x1875060715426688:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788201497.926247:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:104409:x1875060715426688:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 86us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201497.926254:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788201497.926330:0:104409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0078e3480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104409:1875060715426688:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788201497.926421:0:104409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b0e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104409:1875060715426816:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788201497.926479:0:104409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201497.926519:0:104409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102a8a480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201497.926564:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715426816 00000100:00100000:1.0:1788201497.926569:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715426816 00000100:00100000:1.0:1788201497.926599:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788201497.926606:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:104409:x1875060715426816:12345-0@lo:1000:lod0001_rec0000.0 00010000:00080000:3.0:1788201497.927560:0:104410:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0001: started recovery thread pid 104410 00010000:02000000:3.0:1788201497.927577:0:104410:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0001: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1788201497.927581:0:104410:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788201497.927585:0:104410:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:1.0:1788201497.927680:0:104386:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788201497.927713:0:104386:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788201497.927732:0:104386:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788201497.927752:0:104386:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788201497.928608:0:104386:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788201497.928891:0:104386:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788201497.954194:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:104409:x1875060715426816:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 27582us (27709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201497.954209:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788201497.954343:0:104409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b0e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104409:1875060715426816:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788201497.954484:0:104409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104409:1875060715426944:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788201497.954524:0:104409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201497.954558:0:104409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007486d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201497.955100:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715426944 00000100:00100000:1.0:1788201497.955108:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715426944 00000100:00100000:1.0:1788201497.955163:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788201497.955172:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:104409:x1875060715426944:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788201497.955255:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:104409:x1875060715426944:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 83us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201497.955262:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788201497.955329:0:104409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104409:1875060715426944:0@lo:1000:lod0001_rec0000.0 00000004:00080000:0.0:1788201497.955383:0:104409:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc007486540 with version 1 00000040:00080000:0.0:1788201497.955410:0:104409:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000bd1:0x3:0x0] first idx 29, last_idx 30 00000004:00080000:0.0:1788201497.955422:0:104409:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc140ffbe40 with version 2 00000040:00080000:0.0:1788201497.955426:0:104409:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x2000090a1:0x1:0x0] at index 29 of catalog [0x200000bd1:0x3:0x0] 00000004:00080000:2.0:1788201497.956247:0:104392:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc10555e300 version 1 rpc_version 1 00000020:00100000:2.0:1788201497.956272:0:104392:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788201497.956281:0:104392:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc12f6b3800 x1875060715427200/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201497.956300:0:104392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b3800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715427200:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788201497.956344:0:104392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201497.956436:0:104392:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005040e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201497.970528:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715427200 00000100:00100000:1.0:1788201497.970546:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715427200 00000100:00100000:1.0:1788201497.972282:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788201497.972296:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:104392:x1875060715427200:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788201497.972600:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:104392:x1875060715427200:12345-0@lo:1000:osp_up0-1.0 Request processed in 306us (16254us total) trans 128849018900 rc 0/0 00000100:00100000:1.0:1788201497.972622:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788201497.972688:0:104392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b3800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715427200:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1788201497.972703:0:104392:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc10555e300 version 2 rpc_version 2 00000020:00100000:1.0:1788201497.972725:0:104392:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788201497.972732:0:104392:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc133369880 x1875060715427456/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201497.972752:0:104392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133369880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715427456:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788201497.972791:0:104392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201497.972812:0:104392:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13ab40840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201497.972826:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715427456 00000100:00100000:1.0:1788201497.972831:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715427456 00000100:00100000:1.0:1788201497.972854:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788201497.972859:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:104392:x1875060715427456:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788201497.972952:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:104392:x1875060715427456:12345-0@lo:1000:osp_up0-1.0 Request processed in 92us (160us total) trans 128849018901 rc 0/0 00000100:00100000:1.0:1788201497.972959:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788201497.972997:0:104392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133369880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715427456:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788201497.980594:0:104409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133700a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104409:1875060715427584:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788201497.980700:0:104409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201497.980745:0:104409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc102a8a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201497.989503:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715427584 00000100:00100000:2.0:1788201497.989521:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715427584 00000100:00100000:2.0:1788201497.989613:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788201497.989625:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:104409:x1875060715427584:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788201497.989909:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:104409:x1875060715427584:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 286us (9208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201497.989917:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788201497.990112:0:104409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133700a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104409:1875060715427584:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1788201497.990165:0:104409:0:(llog.c:805:llog_process_thread()) index: 30, lh_last_idx: 30 synced_idx: 30 lgh_last_idx: 30 00000040:00080000:2.0:1788201497.990170:0:104409:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x2000090a1:0x2:0x0] at index 30 of catalog [0x200000bd1:0x3:0x0] 00000100:00100000:2.0:1788201497.990247:0:104409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f6b0e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104409:1875060715427712:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788201497.990287:0:104409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201497.990325:0:104409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004b1c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788201497.990382:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715427712 00000100:00100000:3.0:1788201497.990388:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715427712 00000100:00100000:3.0:1788201497.990426:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788201497.990434:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0078e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:104409:x1875060715427712:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788201497.990490:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0078e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:104409:x1875060715427712:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 57us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201497.990495:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788201497.990561:0:104409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f6b0e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:104409:1875060715427712:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1788201497.990600:0:104409:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788201497.990637:0:104409:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc004b1c540 with version 3 00000004:00080000:2.0:1788201497.990683:0:104409:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc004b1cf00 with version 4 00000040:00080000:2.0:1788201497.990687:0:104409:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x2000090a1:0x2:0x0] at index 30 of catalog [0x200000bd1:0x3:0x0] 00000040:00080000:2.0:1788201497.990700:0:104409:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000bd1:0x3:0x0] index 30 count 1 00000004:00080000:2.0:1788201497.990760:0:104409:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788201497.990764:0:104409:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000004:00080000:3.0:1788201497.990865:0:104392:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc10555e300 version 3 rpc_version 3 00000020:00100000:3.0:1788201497.990884:0:104392:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788201497.990892:0:104392:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc007158a80 x1875060715427968/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201497.990907:0:104392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715427968:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201497.990939:0:104392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201497.990957:0:104392:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fae1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201497.990972:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715427968 00000100:00100000:3.0:1788201497.990975:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715427968 00000100:00100000:3.0:1788201497.990998:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788201497.991003:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:104392:x1875060715427968:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201497.991245:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:104392:x1875060715427968:12345-0@lo:1000:osp_up0-1.0 Request processed in 240us (304us total) trans 128849018902 rc 0/0 00000100:00100000:3.0:1788201497.991253:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788201497.991291:0:104392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715427968:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1788201497.991301:0:104392:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc10555e300 version 4 rpc_version 4 00000020:00100000:3.0:1788201497.991313:0:104392:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788201497.991318:0:104392:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc007158000 x1875060715428224/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201497.991331:0:104392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715428224:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201497.991366:0:104392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201497.991380:0:104392:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fae1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201497.991392:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715428224 00000100:00100000:3.0:1788201497.991395:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715428224 00000100:00100000:3.0:1788201497.991419:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788201497.991425:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:104392:x1875060715428224:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201497.991511:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:104392:x1875060715428224:12345-0@lo:1000:osp_up0-1.0 Request processed in 85us (144us total) trans 128849018903 rc 0/0 00000100:00100000:3.0:1788201497.991518:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788201497.991548:0:104392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715428224:0@lo:1000:osp_up0-1.0 00010000:00080000:3.0:1788201497.994106:0:104410:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:3.0:1788201498.735513:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201499.360994:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201499.361127:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695554560 00000100:00100000:3.0:1788201499.361138:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695554560 00000100:00100000:3.0:1788201499.361199:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 119 00000100:00100000:3.0:1788201499.361210:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695554560:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201499.361246:0:102458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201499.361265:0:102458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e858 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786eed expref: -99 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201499.361294:0:102458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e858 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786eed expref: 10 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201499.361305:0:102458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e858 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786eed expref: 10 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201499.361315:0:102458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2c00, rc 0) 00000100:00100000:3.0:1788201499.361398:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695554560:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 190us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201499.361406:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 119 00000100:00100000:3.0:1788201499.370604:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201499.370675:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695554688 00000100:00100000:2.0:1788201499.370686:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695554688 00000100:00100000:2.0:1788201499.370756:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 120 00000100:00100000:2.0:1788201499.370767:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695554688:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201499.370793:0:102454:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1788201499.370823:0:102454:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201499.370827:0:102454:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 136 00000100:00100000:2.0:1788201499.376562:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695554688:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 Request processed in 5784us (5956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201499.376578:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 120 00000100:00100000:1.0:1788201499.378563:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201499.378664:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695554816 00000100:00100000:2.0:1788201499.378674:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695554816 00000100:00100000:2.0:1788201499.378720:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1799 00000100:00100000:2.0:1788201499.378728:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875060695554816:12345-192.168.201.20@tcp:38:ll_cfg_requeue.0 00010000:00080000:2.0:1788201499.378758:0:66314:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '6e293f14-c501-4bc5-9dd4-a18ef02756b4' at ffff8dc006e37000, cookie 0x96d0c9b8c9a1e7b7 00010000:00080000:2.0:1788201499.378764:0:66314:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp recovering/t77309411500 exp ffff8dc006e37000 cur 4350 last 1788201497 00010000:02000400:2.0:1788201499.378772:0:66314:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0001: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1788201499.378778:0:66314:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1788201499.378797:0:66314:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788201499.378932:0:66314:0:(import.c:65:import_set_state_nolock()) ffff8dc11077f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201499.383855:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695554816:12345-192.168.201.20@tcp:38:ll_cfg_requeue.0 Request processed in 5113us (5288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201499.383871:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1799 00000100:00100000:3.0:1788201499.392561:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201499.392680:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695551488 00000100:00100000:1.0:1788201499.392691:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695551488 00000100:00100000:1.0:1788201499.392762:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1800 00000100:00100000:1.0:1788201499.392775:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695551488:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00080000:1.0:1788201499.392797:0:66757:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 77309411500, current: 77309411500, replaying 00000100:00100000:1.0:1788201499.392816:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695551488:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 44us (265us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201499.392840:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1800 00010000:00080000:3.0:1788201499.392893:0:104410:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 10000000:01000000:3.0:1788201499.535092:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788201499.535101:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc10630d000 from 136 10000000:01000000:3.0:1788201499.535106:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788201499.535155:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e85f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201499.535166:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e85f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201499.535176:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e85f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201499.535224:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715428352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201499.535299:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201499.535345:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1060ca3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201499.535416:0:102459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715428352 00000100:00100000:0.0:1788201499.535425:0:102459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715428352 00000100:00100000:0.0:1788201499.535481:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788201499.535490:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715428352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201499.535502:0:102459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201499.535515:0:102459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0056d6e00/0x96d0c9b8c9a1e866 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e85f expref: -99 pid: 102459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201499.535537:0:102459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0056d6e00/0x96d0c9b8c9a1e866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e85f expref: 23 pid: 102459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201499.535546:0:102459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0056d6e00/0x96d0c9b8c9a1e866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e85f expref: 23 pid: 102459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201499.535567:0:102459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d6e00, rc 0) 00000100:00100000:0.0:1788201499.535617:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715428352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201499.535624:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788201499.535805:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715428352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201499.535821:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e85f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e866 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201499.535829:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e85f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e866 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201499.535879:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715428480:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788201499.535912:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201499.535940:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13ab40840 going to sleep for 11 seconds 00000100:00100000:3.0:1788201499.536180:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715428480 00000100:00100000:3.0:1788201499.536185:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715428480 00000100:00100000:3.0:1788201499.536285:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788201499.536294:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004326050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715428480:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788201499.536309:0:102452:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788201499.536336:0:102452:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788201499.536340:0:102452:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 136 00000100:00100000:3.0:1788201499.536419:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004326050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715428480:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201499.536426:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788201499.536502:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715428480:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788201499.536548:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788201499.536556:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e85f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e866 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201499.536565:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e85f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e866 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201499.536574:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788201499.536576:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc12f19b800 from 136 10000000:01000000:1.0:1788201499.536578:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788201499.536595:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1e86d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201499.536602:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1e86d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201499.536618:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1e86d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201499.536632:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715428608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201499.536658:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201499.536687:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13ab40840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201499.537741:0:102453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715428608 00000100:00100000:0.0:1788201499.537752:0:102453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715428608 00000100:00100000:0.0:1788201499.537791:0:102453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788201499.537799:0:102453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715428608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201499.537812:0:102453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201499.537827:0:102453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0056d6600/0x96d0c9b8c9a1e874 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1e86d expref: -99 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201499.537848:0:102453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0056d6600/0x96d0c9b8c9a1e874 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e86d expref: 24 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201499.537859:0:102453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0056d6600/0x96d0c9b8c9a1e874 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e86d expref: 24 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201499.537867:0:102453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d6600, rc 0) 00000100:00100000:0.0:1788201499.537918:0:102453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715428608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201499.537924:0:102453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788201499.538583:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715428608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201499.538601:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1e86d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e874 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201499.538611:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1e86d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e874 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201499.540377:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133368e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715428736:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788201499.540448:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201499.540491:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13ab40840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201499.540539:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715428736 00000100:00100000:2.0:1788201499.540548:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715428736 00000100:00100000:2.0:1788201499.540605:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788201499.540623:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715428736:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201499.540651:0:102458:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788201499.540673:0:102458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201499.540676:0:102458:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 136 00000100:00100000:2.0:1788201499.540799:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715428736:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 177us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201499.540812:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788201499.546555:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133368e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715428736:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788201499.546640:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788201499.546650:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1e86d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e874 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201499.546662:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1e86d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e874 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201499.791312:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201500.495607:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715428864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201500.495683:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201500.495807:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715428864 00000100:00100000:0.0:1788201500.495816:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715428864 00000100:00100000:0.0:1788201500.495880:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788201500.495892:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715428864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201500.495921:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201500.495974:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715428864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201500.495980:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1788201500.496097:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201500.496134:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715428864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201500.496482:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201500.496492:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715428992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201500.496524:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201500.496602:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715428992 00000100:00100000:0.0:1788201500.496607:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715428992 00000100:00100000:0.0:1788201500.496647:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788201500.496656:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715428992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201500.496672:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788201500.496706:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715428992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201500.496712:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1788201500.496770:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201500.496794:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715428992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201500.634955:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201500.635002:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201500.635116:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695555072 00000100:00100000:1.0:1788201500.635126:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695555072 00000100:00100000:0.0:1788201500.635630:0:102453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695554944 00000100:00100000:0.0:1788201500.635636:0:102453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695554944 00000100:00100000:0.0:1788201500.635670:0:102453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 125 00000100:00100000:0.0:1788201500.635679:0:102453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695554944:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201500.635746:0:102453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695554944:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 68us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201500.635754:0:102453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 125 00000100:00100000:1.0:1788201500.635940:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1823 00000100:00100000:1.0:1788201500.635952:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2400:x1875060695555072:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201500.635993:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2400:x1875060695555072:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 45us (991us total) trans 0 rc 0/0 00000100:00080000:0.0:1788201500.638501:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201500.639344:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1823 00010000:00010000:3.0:1788201500.815242:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201501.843445:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201502.865222:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201502.997453:0:104651:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1788201503.056211:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201503.056218:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788201503.056222:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201503.056234:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8dc13f86f000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201503.056463:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc133701880 x1875060715429504/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201503.056502:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201503.056505:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788201503.056507:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201503.056512:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8dc1401c2800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201503.056524:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc133331880 x1875060715429760/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201503.056533:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201503.056536:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788201503.056538:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc13f80c800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201503.056542:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8dc13f80c800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201503.056553:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004eb5180 x1875060715429888/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201503.056616:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715429632:0@lo:400:kworker.0 00000100:00100000:0.0:1788201503.056682:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201503.056714:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715430400:0@lo:400:kworker.0 00000100:00100000:0.0:1788201503.056756:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201503.056782:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788201503.056788:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715429376:0@lo:400:kworker.0 00000100:00100000:0.0:1788201503.056810:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201503.056829:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12fb0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715430272:0@lo:400:kworker.0 00000100:00100000:0.0:1788201503.056853:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201503.056886:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715430784:0@lo:400:kworker.0 00000100:00100000:0.0:1788201503.056911:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201503.056960:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715429632 00000100:00100000:0.0:1788201503.056967:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715429632 00000100:00100000:3.0:1788201503.057380:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715429120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201503.057412:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201503.057433:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715430016:0@lo:400:kworker.0 00000100:00100000:2.0:1788201503.057717:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715429376 00000100:00100000:2.0:1788201503.057723:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715429376 00000100:00100000:2.0:1788201503.057755:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715430272 00000100:00100000:2.0:1788201503.057758:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715430272 00000100:00100000:2.0:1788201503.057770:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715430784 00000100:00100000:2.0:1788201503.057772:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715430784 00000100:00100000:2.0:1788201503.057786:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1824 00000100:00100000:2.0:1788201503.057795:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715429632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201503.057994:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201503.058013:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715430528:0@lo:400:kworker.0 00000100:00100000:3.0:1788201503.058431:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201503.058521:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788201503.058529:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715429248:0@lo:400:kworker.0 00000100:00100000:3.0:1788201503.058557:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201503.058583:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715430144:0@lo:400:kworker.0 00000100:00100000:3.0:1788201503.058616:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201503.058636:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715430656:0@lo:400:kworker.0 00000100:00100000:3.0:1788201503.058658:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201503.058699:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715429504:0@lo:38:kworker.0 00000100:00100000:3.0:1788201503.058728:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201503.058741:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715429760:0@lo:38:kworker.0 00000100:00100000:3.0:1788201503.058762:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201503.058774:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715429888:0@lo:38:kworker.0 00000100:00100000:3.0:1788201503.058793:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201503.058825:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715430400 00000100:00100000:3.0:1788201503.058830:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715430400 00000100:00100000:3.0:1788201503.058880:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715429120 00000100:00100000:3.0:1788201503.058884:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715429120 00000100:00100000:3.0:1788201503.058895:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715429888 00000100:00100000:3.0:1788201503.058898:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715429888 00000100:00100000:3.0:1788201503.058907:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788201503.058914:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:3656:x1875060715430400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201503.059706:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715429632:12345-0@lo:400:kworker.0 Request processed in 1908us (3020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201503.059719:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1824 00000100:00100000:2.0:1788201503.059742:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715429504 00000100:00100000:2.0:1788201503.059747:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715429504 00000100:00100000:2.0:1788201503.059762:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715429760 00000100:00100000:2.0:1788201503.059764:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715429760 00000100:00100000:2.0:1788201503.059775:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1825 00000100:00100000:2.0:1788201503.059789:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715429376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201503.060130:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:3656:x1875060715430400:12345-0@lo:400:kworker.0 Request processed in 1213us (3371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201503.060138:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788201503.060160:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788201503.060169:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3657:x1875060715429120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201503.060195:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444970496 avail 1298731008 00000100:00100000:3.0:1788201503.060240:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3657:x1875060715429120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (2826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201503.060247:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788201503.060283:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788201503.060288:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f2e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3654:x1875060715429888:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788201503.060309:0:66318:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff8dc006e35800, cookie 0x96d0c9b8c9a1e7b0 00010000:00080000:3.0:1788201503.060315:0:66318:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff8dc006e35800 cur 4354 last 1788201497 00000004:00100000:3.0:1788201503.060334:0:66318:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788201503.060557:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201503.060574:0:66318:0:(import.c:65:import_set_state_nolock()) ffff8dc137d34800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201503.060577:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1826 00000100:00100000:1.0:1788201503.060588:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715430272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201503.060636:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715430272:12345-0@lo:400:kworker.0 Request processed in 50us (3782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201503.060646:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1826 00000100:00100000:3.0:1788201503.060648:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f2e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715429888:12345-0@lo:38:kworker.0 Request processed in 354us (1849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201503.060658:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788201503.060665:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1827 00000100:00100000:1.0:1788201503.060673:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715430784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201503.060694:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715430016 00000100:00100000:3.0:1788201503.060702:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715430016 00000100:00100000:1.0:1788201503.060706:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715430784:12345-0@lo:400:kworker.0 Request processed in 32us (3792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201503.060713:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1827 00000100:00100000:1.0:1788201503.060728:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1801 00000100:00100000:1.0:1788201503.060733:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f2e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715429504:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788201503.060748:0:69485:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 4354 last 0 00000100:00100000:3.0:1788201503.060750:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715430528 00000100:00100000:3.0:1788201503.060756:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715430528 00000100:00100000:3.0:1788201503.060773:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715430144 00000100:00100000:3.0:1788201503.060775:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715430144 00000100:00100000:3.0:1788201503.060791:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715430656 00000100:00100000:3.0:1788201503.060793:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715430656 00000100:00100000:3.0:1788201503.060811:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788201503.060818:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715430016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201503.060857:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715430016:12345-0@lo:400:kworker.0 Request processed in 40us (2862us total) trans 0 rc 0/0 00000020:00000080:1.0:1788201503.060860:0:69485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x96d0c9b8c9a1e87b 00000100:00100000:3.0:1788201503.060866:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000004:00100000:1.0:1788201503.060873:0:69485:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1788201503.060883:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788201503.060892:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715430528:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788201503.060908:0:69485:0:(import.c:65:import_set_state_nolock()) ffff8dc006d83800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201503.060923:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715430528:12345-0@lo:400:kworker.0 Request processed in 32us (2490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201503.060929:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788201503.060958:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788201503.060959:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f2e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875060715429504:12345-0@lo:38:kworker.0 Request processed in 222us (2227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201503.060970:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1801 00000100:00100000:3.0:1788201503.060970:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715430144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201503.060992:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1802 00000100:00100000:1.0:1788201503.060999:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715429760:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788201503.061011:0:69485:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 4354 last 0 00000020:00000080:1.0:1788201503.061055:0:69485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x96d0c9b8c9a1e882 00000100:00100000:0.0:1788201503.061123:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715429376:0@lo:400:kworker.0 00000100:00100000:0.0:1788201503.061139:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12fb0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715430272:0@lo:400:kworker.0 00000100:00100000:0.0:1788201503.061149:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715430784:0@lo:400:kworker.0 00000100:00100000:0.0:1788201503.061162:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715429632:0@lo:400:kworker.0 00000100:00100000:0.0:1788201503.061178:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc118141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715430400:0@lo:400:kworker.0 00000100:00100000:3.0:1788201503.062164:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715430144:12345-0@lo:400:kworker.0 Request processed in 1194us (3542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201503.062174:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788201503.062195:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788201503.062203:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f2e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715430656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201503.062244:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f2e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715430656:12345-0@lo:400:kworker.0 Request processed in 43us (3585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201503.062249:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788201503.062290:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715429248 00000100:00100000:3.0:1788201503.062296:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715429248 00000100:00100000:3.0:1788201503.062336:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788201503.062343:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715429248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201503.062381:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715429248:12345-0@lo:400:kworker.0 Request processed in 39us (3822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201503.062386:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788201503.062451:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715429248:0@lo:400:kworker.0 00000100:00100000:3.0:1788201503.062465:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715430144:0@lo:400:kworker.0 00000100:00100000:3.0:1788201503.062825:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715430656:0@lo:400:kworker.0 00000100:00100000:3.0:1788201503.062850:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715429120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201503.062862:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715430016:0@lo:400:kworker.0 00000100:00100000:3.0:1788201503.062873:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715430528:0@lo:400:kworker.0 00010000:00080000:3.0:1788201503.062920:0:104410:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788201503.062924:0:104410:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 77309411500 00000020:00080000:3.0:1788201503.062930:0:104410:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:3.0:1788201503.062933:0:104410:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 77309411500, next_transno: 77309411500 00010000:00080000:3.0:1788201503.062937:0:104410:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (77309411500) 00000020:00080000:3.0:1788201503.062939:0:104410:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:3.0:1788201503.062949:0:104410:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695551488 t77309411500 from 192.168.201.20@tcp req@ffff8dc00715b800 x1875060695551488/t0(77309411500) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:620/0 lens 520/0 e 0 to 0 dl 1788201510 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'mkdir.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1788201503.062972:0:104410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201503.062997:0:104410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1e889 lrc: 2/0,0 mode: --/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ee6 expref: -99 pid: 104410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788201503.063953:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc133701880 x1875060715429504/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201503.063970:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 19 00000100:00080000:3.0:1788201503.064796:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-lwp-OST0000: lwp recover req@ffff8dc133701880 x1875060715429504/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201528 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201503.064805:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788201503.064810:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788201503.064814:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788201503.064820:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715429504:0@lo:38:kworker.0 00000100:00080000:3.0:1788201503.064848:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:3.0:1788201503.064856:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f80c800 lustre-MDT0001_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1788201503.064860:0:3654:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0001_UUID 00000100:00080000:3.0:1788201503.064862:0:3654:0:(recover.c:53:ptlrpc_replay_next()) import ffff8dc13f80c800 from lustre-MDT0001_UUID committed 0 last 0 00000100:00080000:3.0:1788201503.064872:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f80c800 lustre-MDT0001_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00080000:0.0:1788201503.070380:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201503.070392:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201503.071393:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715429376:12345-0@lo:400:kworker.0 Request processed in 11596us (14574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201503.071408:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1825 00000100:00100000:3.0:1788201503.074200:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715429888:0@lo:38:kworker.0 00000004:00100000:1.0:1788201503.074254:0:69485:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788201503.074314:0:69485:0:(import.c:65:import_set_state_nolock()) ffff8dc006d86800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201503.074402:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875060715429760:12345-0@lo:38:kworker.0 Request processed in 13401us (15637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201503.074412:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1802 00010000:00080000:3.0:1788201503.074568:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc133331880 x1875060715429760/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201503.074586:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 19 00000004:00080000:1.0:1788201503.074835:0:104410:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 10940us 00000100:00080000:3.0:1788201503.075383:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-lwp-OST0001: lwp recover req@ffff8dc133331880 x1875060715429760/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201528 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201503.075393:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788201503.075398:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788201503.075403:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788201503.075408:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715429760:0@lo:38:kworker.0 00010000:00080000:0.0:1788201503.075759:0:104655:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0001-osp-MDT0000 to lustre-MDT0001_UUID@0@lo 00010000:00010000:0.0:1788201503.075765:0:104655:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0001-osp-MDT0000 (0) 00010000:00010000:0.0:1788201503.075770:0:104655:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0001-osp-MDT0000 00000100:00080000:0.0:1788201503.080740:0:104655:0:(import.c:65:import_set_state_nolock()) ffff8dc13f80c800 lustre-MDT0001_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1788201503.080924:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715430912:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1788201503.080991:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201503.081085:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715430912 00000100:00100000:0.0:1788201503.081094:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715430912 00000100:00100000:0.0:1788201503.081143:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788201503.081154:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715430912:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1788201503.081173:0:66318:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc12f2e3b80 x1875060715430912/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:624/0 lens 224/0 e 0 to 0 dl 1788201514 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201503.081185:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715430912:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 34us (195us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201503.081191:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00010000:00010000:1.0:1788201503.096596:0:104410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1e890 lrc: 3/0,1 mode: --/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 104410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.096615:0:104410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1e890 lrc: 3/0,1 mode: CW/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 104410 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.096629:0:104410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1e890 lrc: 3/0,1 mode: CW/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 104410 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.096643:0:104410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1e897 lrc: 3/0,1 mode: --/PW res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 104410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.096650:0:104410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1e897 lrc: 3/0,1 mode: PW/PW res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 104410 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.096656:0:104410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1e897 lrc: 3/0,1 mode: PW/PW res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 104410 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201503.097412:0:104410:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xb:0x0]: returning size 4096 00010000:00010000:1.0:1788201503.097431:0:104410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1e89e lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 104410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.097440:0:104410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1e89e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 104410 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.097448:0:104410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1e89e lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 104410 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.097461:0:104410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1e890 lrc: 3/0,1 mode: CW/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 104410 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.097467:0:104410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1e890 lrc: 2/0,0 mode: CW/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 104410 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.097475:0:104410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1e890 lrc: 3/0,0 mode: CW/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 104410 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.097481:0:104410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201503.097484:0:104410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1e890 lrc: 3/0,0 mode: CW/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 104410 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.097492:0:104410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1e890 lrc: 4/0,0 mode: CW/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 104410 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.097503:0:104410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x7:0x0].0x0 (ffff8dc1115dfb00) 00010000:00010000:1.0:1788201503.097506:0:104410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201503.097511:0:104410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1e890 lrc: 2/0,0 mode: --/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 104410 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.097526:0:104410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1e890 lrc: 0/0,0 mode: --/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 104410 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201503.097540:0:104410:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d462217 reply state 00000000b60310b8 transno 77309411500 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1e897 lrc: 3/0,1 mode: PW/PW res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 104410 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.097551:0:104410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1e897 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 104410 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.097557:0:104410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x7:0x0].0xf0209d98 (ffff8dc0084fb300) 00010000:00010000:1.0:1788201503.097560:0:104410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201503.097563:0:104410:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201503.097622:0:104410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2400/0x96d0c9b8c9a1e889 lrc: 0/0,0 mode: --/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ee6 expref: 9 pid: 104410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.097645:0:104410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1e89e lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ee6 expref: 8 pid: 104410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.097652:0:104410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xb:0x0].0x0 (ffff8dc0084fb800) 00010000:00010000:1.0:1788201503.097655:0:104410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201503.097658:0:104410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e2e00, rc 0) 00010000:00080000:1.0:1788201503.097733:0:104410:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 101 seconds 00000020:00080000:1.0:1788201503.097759:0:104410:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:1.0:1788201503.097763:0:104410:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 77309411501 00000020:00080000:1.0:1788201503.097768:0:104410:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:1.0:1788201503.097771:0:104410:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 77309411501 00000100:00100000:0.0:1788201503.103580:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201503.103618:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695555200 00000100:00100000:0.0:1788201503.103634:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695555200 00000100:00100000:0.0:1788201503.103695:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1828 00000100:00100000:0.0:1788201503.103707:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2399:x1875060695555200:12345-192.168.201.20@tcp:400:ldlm_lock_repla.0 00010000:00080000:0.0:1788201503.103732:0:66757:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc10604bb80 x1875060695555200/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:624/0 lens 224/0 e 0 to 0 dl 1788201514 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201503.103749:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2399:x1875060695555200:12345-192.168.201.20@tcp:400:ldlm_lock_repla.0 Request processed in 46us (179us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201503.103757:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1828 00000020:00080000:1.0:1788201503.104459:0:104410:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:1.0:1788201503.104464:0:104410:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 77309411501 00010000:00080000:1.0:1788201503.104474:0:104410:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1788201503.104476:0:104410:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:1.0:1788201503.104482:0:104410:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1788201503.104484:0:104410:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1788201503.104589:0:104410:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378624 00000001:00080000:2.0:1788201503.108753:0:104387:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 77309411500 is committed 00010000:00010000:0.0:1788201503.108933:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1e897 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 104410 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.108945:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1e897 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 104410 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.108953:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1e897 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 104410 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.108959:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201503.108964:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1e897 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 104410 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.108972:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1e897 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 104410 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.108998:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1e897 lrc: 2/0,0 mode: --/TXN res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 104410 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.109004:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1e897 lrc: 0/0,0 mode: --/TXN res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 104410 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1788201503.113688:0:104387:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000001:00100000:2.0:1788201503.113699:0:104387:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788201503.113761:0:104410:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1788201503.113802:0:104410:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0001: cancel recovery timer 00010000:00080000:1.0:1788201503.113819:0:104410:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8dc12f2e3b80 x1875060715430912/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:624/0 lens 224/0 e 0 to 0 dl 1788201514 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788201503.113952:0:104410:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.201.20@tcp: req@ffff8dc10604bb80 x1875060695555200/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:624/0 lens 224/0 e 0 to 0 dl 1788201514 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1788201503.114008:0:104410:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0001: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:2.0:1788201503.114235:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f80c800 lustre-MDT0001_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1788201503.114244:0:3654:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8dc106048e00 x1875060715430912/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201519 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201503.114254:0:3654:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8dc106048e00 x1875060715430912/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201519 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201503.114261:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f80c800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788201503.114286:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-osp-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1788201503.114293:0:3654:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000624e48db): req@ffff8dc0058a9f80 x1875060715413120/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201490 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201503.114308:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715430912:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788201503.114375:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201503.114435:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715413120 00000100:00100000:0.0:1788201503.114486:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201503.114497:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715431040:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201503.114524:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715413120 00000100:00100000:0.0:1788201503.114528:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201503.114646:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715431040 00000100:00100000:2.0:1788201503.114651:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715431040 00000100:00100000:0.0:1788201503.120245:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788201503.120338:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3655:x1875060715413120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201503.120380:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445404672 avail 1299165184 00000100:00100000:0.0:1788201503.120469:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3655:x1875060715413120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 146us (6094us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201503.120476:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788201503.120499:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788201503.120505:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715431040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201503.120516:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445404672 avail 1299165184 00000100:00100000:0.0:1788201503.120536:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715431040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 32us (6011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201503.120542:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788201503.121118:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715431040:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201503.121130:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715413120:0@lo:41:osp-pre-1-0.0 00000004:00000080:1.0:1788201503.153921:0:104410:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa0dd48667e10 00100000:10000000:1.0:1788201503.153937:0:104410:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000004:00080000:3.0:1788201503.156928:0:104398:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x603:0x0] 00000100:00100000:3.0:1788201503.156980:0:104398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f2e0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:104398:1875060715431168:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788201503.157121:0:104396:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x602:0x0] 00000100:00100000:0.0:1788201503.157143:0:104396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:104396:1875060715431296:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788201503.157193:0:104396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201503.157229:0:104396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007110900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201503.157297:0:104398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201503.157320:0:104398:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125706000 going to sleep for 11 seconds 00000100:00100000:1.0:1788201503.157681:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715431296 00000100:00100000:1.0:1788201503.157688:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715431296 00000100:00100000:1.0:1788201503.157741:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715431168 00000100:00100000:1.0:1788201503.157745:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715431168 00000100:00100000:1.0:1788201503.157765:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201503.157775:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:104396:x1875060715431296:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788201503.157804:0:101192:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1569 -> diff = -31 00002000:02000040:1.0:1788201503.157810:0:101192:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:1539 to 0x280000400:1569) 00000100:00100000:0.0:1788201503.158106:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788201503.158117:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:104398:x1875060715431168:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788201503.158142:0:101189:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1569 -> diff = -30 00002000:02000040:0.0:1788201503.158146:0:101189:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:1540 to 0x2c0000400:1569) 00002000:00010000:2.0:1788201503.175009:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x621:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201503.175037:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e8a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x621:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.175054:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x621:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:2.0:1788201503.175072:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x621:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201503.175079:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e8a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.175097:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e8a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.175107:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e8a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.175116:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e8a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.175138:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201503.175175:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201503.175183:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e8a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.175196:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201503.175208:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e8a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.175219:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e8a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.175238:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e8a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.175246:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1e8a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.175275:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201503.175277:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201503.175278:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201503.187367:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x620:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201503.187380:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e8ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x620:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.187395:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x620:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:2.0:1788201503.187400:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x620:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201503.187406:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e8ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.187420:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e8ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.187432:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e8ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.187447:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e8ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.187468:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201503.187514:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201503.187523:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e8ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.187533:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbca00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201503.187538:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e8ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.187547:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e8ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.187566:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e8ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.187593:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e8ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.187611:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201503.187613:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201503.187615:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201503.187957:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x61f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201503.187965:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e8b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x61f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.187975:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x61f:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:2.0:1788201503.187979:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x61f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201503.187984:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e8b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.187994:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e8b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.188002:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e8b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.188010:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e8b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.188245:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201503.188349:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201503.188354:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e8b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.188368:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201503.188372:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e8b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.188380:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e8b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x61f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.188393:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e8b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x61f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.188400:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e8b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x61f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.188414:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.188416:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.188417:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201503.188486:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x61e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201503.188493:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e8ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x61e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.188502:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x61e:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:2.0:1788201503.188505:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x61e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201503.188510:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e8ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.188519:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e8ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.188534:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e8ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.188541:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e8ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.188558:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201503.188985:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201503.188992:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e8ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.189002:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201503.189005:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e8ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.189058:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e8ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x61e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.189072:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e8ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x61e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.189080:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e8ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x61e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.189095:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201503.189096:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201503.189105:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788201503.191529:0:99761:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00002000:00010000:2.0:1788201503.191641:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x61d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201503.191653:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e8c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x61d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.191672:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x61d:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:2.0:1788201503.191676:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x61d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201503.191684:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e8c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.191699:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e8c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.191710:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e8c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.191718:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e8c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.191768:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201503.191819:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201503.191832:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e8c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.191842:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbce00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201503.191847:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e8c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.191856:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e8c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x61d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.191876:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e8c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x61d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.191884:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1e8c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x61d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.191915:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.191917:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.191920:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201503.192970:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x621:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201503.192979:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd77ae97/0x96d0c9b8c9a1e8c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x621:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.192991:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x621:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:1.0:1788201503.192996:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x621:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201503.193001:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd77ae97/0x96d0c9b8c9a1e8c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.193191:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd77ae97/0x96d0c9b8c9a1e8c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.193203:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd77ae97/0x96d0c9b8c9a1e8c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.193210:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd77ae97/0x96d0c9b8c9a1e8c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.193272:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201503.193980:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x620:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201503.193988:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1e8cf lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x620:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.193998:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x620:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:1.0:1788201503.194002:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x620:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201503.194008:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1e8cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.194055:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1e8cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.194064:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1e8cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.194072:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1e8cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.194248:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201503.194257:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd77ae97/0x96d0c9b8c9a1e8c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.194275:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201503.194287:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd77ae97/0x96d0c9b8c9a1e8c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.194295:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd77ae97/0x96d0c9b8c9a1e8c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.194312:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd77ae97/0x96d0c9b8c9a1e8c8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.194318:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd77ae97/0x96d0c9b8c9a1e8c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x621:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.194335:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201503.194339:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1e8cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.194345:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201503.194348:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1e8cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.194355:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1e8cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.194363:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1e8cf lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.194371:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.194379:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.194381:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201503.194465:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788201503.194471:0:101189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1e8cf lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x620:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201503.194787:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x61c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201503.194795:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000279447c9/0x96d0c9b8c9a1e8d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x61c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.194807:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x61c:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:2.0:1788201503.194811:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x61c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201503.194816:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000279447c9/0x96d0c9b8c9a1e8d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.194827:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000279447c9/0x96d0c9b8c9a1e8d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.194835:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000279447c9/0x96d0c9b8c9a1e8d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.194843:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000279447c9/0x96d0c9b8c9a1e8d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1788201503.195687:0:100576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00002000:00010000:1.0:1788201503.196284:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x61f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201503.196404:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1e8dd lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x61f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.196422:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x61f:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:1.0:1788201503.196426:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x61f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201503.196432:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1e8dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x61f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.196445:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1e8dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x61f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.196467:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1e8dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x61f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.196475:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1e8dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x61f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.196536:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201503.196544:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000279447c9/0x96d0c9b8c9a1e8d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x61c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.196552:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbdc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201503.196557:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000279447c9/0x96d0c9b8c9a1e8d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x61c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.196566:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000279447c9/0x96d0c9b8c9a1e8d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x61c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.196594:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000279447c9/0x96d0c9b8c9a1e8d6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x61c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.196605:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201503.196609:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1e8dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x61f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.196616:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201503.196619:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1e8dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x61f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.196626:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1e8dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x61f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.196647:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1e8dd lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x61f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.196654:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.196656:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.196658:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201503.199434:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788201503.199449:0:101189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1e8dd lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x61f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.200047:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.200054:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201503.200297:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x61e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201503.200305:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd596986/0x96d0c9b8c9a1e8e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x61e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.200320:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x61e:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:1.0:1788201503.200324:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x61e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201503.200331:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd596986/0x96d0c9b8c9a1e8e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x61e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.200345:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd596986/0x96d0c9b8c9a1e8e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x61e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.200355:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd596986/0x96d0c9b8c9a1e8e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x61e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.200375:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd596986/0x96d0c9b8c9a1e8e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x61e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.200377:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201503.200391:0:101192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000279447c9/0x96d0c9b8c9a1e8d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x61c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.200396:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201503.200606:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201503.200614:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd596986/0x96d0c9b8c9a1e8e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x61e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.200623:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201503.200627:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd596986/0x96d0c9b8c9a1e8e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x61e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.200635:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd596986/0x96d0c9b8c9a1e8e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x61e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.200652:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd596986/0x96d0c9b8c9a1e8e4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x61e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.200658:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd596986/0x96d0c9b8c9a1e8e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x61e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.200672:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.200681:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.200683:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201503.201826:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x61d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201503.201836:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000587aac9c/0x96d0c9b8c9a1e8eb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x61d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.201848:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x61d:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:1.0:1788201503.201853:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x61d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201503.201858:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000587aac9c/0x96d0c9b8c9a1e8eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x61d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.201869:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000587aac9c/0x96d0c9b8c9a1e8eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x61d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.201878:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000587aac9c/0x96d0c9b8c9a1e8eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x61d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.201886:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000587aac9c/0x96d0c9b8c9a1e8eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x61d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.201963:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201503.202350:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201503.202357:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000587aac9c/0x96d0c9b8c9a1e8eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x61d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.202365:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201503.202369:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000587aac9c/0x96d0c9b8c9a1e8eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x61d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.202380:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000587aac9c/0x96d0c9b8c9a1e8eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x61d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.202395:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000587aac9c/0x96d0c9b8c9a1e8eb lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x61d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.202402:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000587aac9c/0x96d0c9b8c9a1e8eb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x61d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.202419:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.202421:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.202422:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201503.202552:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x61c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201503.202559:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f86fea35/0x96d0c9b8c9a1e8f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x61c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.202700:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x61c:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:1.0:1788201503.202703:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x61c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201503.202709:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f86fea35/0x96d0c9b8c9a1e8f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x61c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.202721:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f86fea35/0x96d0c9b8c9a1e8f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x61c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.202729:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f86fea35/0x96d0c9b8c9a1e8f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x61c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.202736:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f86fea35/0x96d0c9b8c9a1e8f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x61c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.202795:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201503.204521:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x61b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201503.204538:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e8f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x61b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.204565:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x61b:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:2.0:1788201503.204570:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x61b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201503.204578:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e8f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.204596:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e8f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.204607:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e8f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.204616:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e8f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201503.208116:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x61b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201503.208132:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1e900 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x61b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.208150:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x61b:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:1.0:1788201503.208154:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x61b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201503.208160:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1e900 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x61b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.208176:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1e900 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x61b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.208200:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1e900 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x61b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.208208:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1e900 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x61b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.208745:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201503.208754:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f86fea35/0x96d0c9b8c9a1e8f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x61c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.208763:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201503.208767:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f86fea35/0x96d0c9b8c9a1e8f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x61c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.208784:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f86fea35/0x96d0c9b8c9a1e8f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x61c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.208801:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f86fea35/0x96d0c9b8c9a1e8f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x61c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.208808:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f86fea35/0x96d0c9b8c9a1e8f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x61c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.208823:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201503.208827:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e8f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x61b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.208834:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201503.208837:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e8f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x61b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.208844:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e8f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x61b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.208854:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e8f9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x61b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.208864:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201503.208867:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1e900 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x61b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.208878:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201503.208881:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1e900 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x61b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.208888:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1e900 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x61b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.208898:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1e900 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x61b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.208906:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.208907:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.208909:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.217902:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201503.217919:0:101192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e8f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x61b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.218127:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201503.220605:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x61a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201503.220620:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000583840ff/0x96d0c9b8c9a1e907 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.220635:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x61a:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:3.0:1788201503.220640:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x61a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201503.220646:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000583840ff/0x96d0c9b8c9a1e907 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.220672:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000583840ff/0x96d0c9b8c9a1e907 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.220682:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000583840ff/0x96d0c9b8c9a1e907 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.220691:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000583840ff/0x96d0c9b8c9a1e907 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.220718:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201503.220734:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201503.220743:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000583840ff/0x96d0c9b8c9a1e907 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.220753:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201503.220758:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000583840ff/0x96d0c9b8c9a1e907 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.220769:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000583840ff/0x96d0c9b8c9a1e907 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.220801:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000583840ff/0x96d0c9b8c9a1e907 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.220811:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000583840ff/0x96d0c9b8c9a1e907 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.220829:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.220832:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.220835:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201503.221401:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x619:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201503.221408:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1e90e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.221479:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x619:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:3.0:1788201503.221483:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x619:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201503.221487:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1e90e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.221498:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1e90e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.221506:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1e90e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.221525:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1e90e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.221549:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201503.221558:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201503.221564:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1e90e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.221574:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201503.221578:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1e90e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.221586:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1e90e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.221600:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1e90e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.221608:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1e90e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.221637:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.221639:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.221641:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201503.225553:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x618:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201503.225572:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1e915 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x618:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.225593:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201503.225593:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x618:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:3.0:1788201503.225603:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x618:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201503.225605:0:101189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1e900 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x61b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.225614:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1e915 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.225635:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1e915 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.225641:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201503.225646:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1e915 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.225655:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1e915 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.225675:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201503.225684:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201503.225689:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1e915 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.225713:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201503.225718:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1e915 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.225726:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1e915 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.225747:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1e915 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.225756:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1e915 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.225776:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201503.225779:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201503.225783:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201503.226726:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x617:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1788201503.226734:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x61a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201503.226736:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018d01b30/0x96d0c9b8c9a1e91c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x617:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.226744:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1e923 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.226751:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x617:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:1.0:1788201503.226756:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x61a:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:3.0:1788201503.226758:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x617:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201503.226764:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x61a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201503.226768:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018d01b30/0x96d0c9b8c9a1e91c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.226770:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1e923 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.226794:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018d01b30/0x96d0c9b8c9a1e91c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.226795:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1e923 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.226806:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1e923 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.226815:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018d01b30/0x96d0c9b8c9a1e91c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.226827:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018d01b30/0x96d0c9b8c9a1e91c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.226836:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1e923 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.226859:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788201503.227498:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x616:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201503.227506:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f3c2521/0x96d0c9b8c9a1e92a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x616:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.227516:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x616:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:3.0:1788201503.227520:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x616:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201503.227526:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f3c2521/0x96d0c9b8c9a1e92a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.227536:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f3c2521/0x96d0c9b8c9a1e92a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.227545:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f3c2521/0x96d0c9b8c9a1e92a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.227552:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f3c2521/0x96d0c9b8c9a1e92a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.234359:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788201503.234661:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201503.234672:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018d01b30/0x96d0c9b8c9a1e91c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.234685:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201503.234690:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018d01b30/0x96d0c9b8c9a1e91c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.234701:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018d01b30/0x96d0c9b8c9a1e91c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.234722:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018d01b30/0x96d0c9b8c9a1e91c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.234730:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018d01b30/0x96d0c9b8c9a1e91c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.234752:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201503.234756:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1e923 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.234763:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201503.234773:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1e923 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.234782:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1e923 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.234793:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1e923 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.234800:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc19a00c/0x96d0c9b8c9a1e923 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x61a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.234814:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201503.234818:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f3c2521/0x96d0c9b8c9a1e92a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.234825:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201503.234829:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f3c2521/0x96d0c9b8c9a1e92a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.234836:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f3c2521/0x96d0c9b8c9a1e92a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.234844:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f3c2521/0x96d0c9b8c9a1e92a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.234851:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.234857:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.234859:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201503.236210:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x619:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201503.236219:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1e931 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.236234:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x619:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:0.0:1788201503.236239:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x619:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201503.236245:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1e931 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.236660:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1e931 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.236671:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1e931 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.236679:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1e931 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.236700:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201503.237117:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201503.237125:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1e931 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.237134:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201503.237138:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1e931 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.237147:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1e931 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.237165:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1e931 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.237172:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc7a7904/0x96d0c9b8c9a1e931 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x619:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.237194:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201503.237196:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201503.237199:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.237352:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201503.237737:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x618:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201503.237744:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000062e8506/0x96d0c9b8c9a1e938 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x618:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.237754:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x618:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:0.0:1788201503.237758:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x618:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201503.237764:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000062e8506/0x96d0c9b8c9a1e938 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.237784:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000062e8506/0x96d0c9b8c9a1e938 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.237793:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000062e8506/0x96d0c9b8c9a1e938 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.237800:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000062e8506/0x96d0c9b8c9a1e938 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.237910:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201503.237920:0:101192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f3c2521/0x96d0c9b8c9a1e92a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201503.240656:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x615:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201503.240670:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1e93f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x615:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.240688:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x615:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:3.0:1788201503.240693:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x615:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201503.240700:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1e93f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.240713:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1e93f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.240722:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1e93f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.240729:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1e93f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.248107:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201503.248120:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000062e8506/0x96d0c9b8c9a1e938 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.248131:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201503.248135:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000062e8506/0x96d0c9b8c9a1e938 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.248151:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000062e8506/0x96d0c9b8c9a1e938 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.248169:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000062e8506/0x96d0c9b8c9a1e938 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.248177:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201503.248180:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1e93f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.248185:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201503.248187:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1e93f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.248191:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1e93f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.248196:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1e93f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.248200:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.248201:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.248202:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201503.254461:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201503.254542:0:101192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1e93f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.254595:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.254715:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201503.255214:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x614:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201503.255223:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1e946 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x614:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.255238:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x614:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:3.0:1788201503.255243:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x614:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201503.255249:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1e946 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.255352:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1e946 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.255363:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1e946 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.255372:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1e946 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.256325:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201503.257412:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201503.257423:0:101189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000062e8506/0x96d0c9b8c9a1e938 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x618:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.257870:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201503.257884:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1e946 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788201503.261129:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x617:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201503.261142:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012faec32/0x96d0c9b8c9a1e94d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x617:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.261159:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x617:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:0.0:1788201503.261164:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x617:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201503.261170:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012faec32/0x96d0c9b8c9a1e94d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.261183:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012faec32/0x96d0c9b8c9a1e94d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.261217:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012faec32/0x96d0c9b8c9a1e94d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.261225:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012faec32/0x96d0c9b8c9a1e94d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.261247:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201503.261768:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201503.261778:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1e946 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.261790:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1e946 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.261809:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1e946 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.261816:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1e946 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.261844:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201503.261849:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012faec32/0x96d0c9b8c9a1e94d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.261856:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201503.261860:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012faec32/0x96d0c9b8c9a1e94d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.261866:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012faec32/0x96d0c9b8c9a1e94d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.261890:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012faec32/0x96d0c9b8c9a1e94d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.261898:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012faec32/0x96d0c9b8c9a1e94d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x617:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.261911:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.261913:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.261916:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.261924:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201503.262665:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x616:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201503.262675:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000356154cf/0x96d0c9b8c9a1e954 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x616:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.262687:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x616:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:0.0:1788201503.262691:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x616:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201503.262698:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000356154cf/0x96d0c9b8c9a1e954 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.262711:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000356154cf/0x96d0c9b8c9a1e954 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.262722:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000356154cf/0x96d0c9b8c9a1e954 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.262730:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000356154cf/0x96d0c9b8c9a1e954 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.262808:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201503.262893:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201503.262899:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000356154cf/0x96d0c9b8c9a1e954 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.262906:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201503.262909:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000356154cf/0x96d0c9b8c9a1e954 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.262917:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000356154cf/0x96d0c9b8c9a1e954 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.262931:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000356154cf/0x96d0c9b8c9a1e954 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.262938:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000356154cf/0x96d0c9b8c9a1e954 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x616:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.262952:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.262954:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.262956:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201503.263286:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x615:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201503.263292:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1e95b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x615:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.263302:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x615:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:1.0:1788201503.263306:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x615:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201503.263310:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1e95b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.263320:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1e95b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.263329:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1e95b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.263337:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1e95b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.263357:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201503.263585:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201503.263592:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1e95b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.263600:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201503.263604:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1e95b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.263612:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1e95b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.263625:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1e95b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.263632:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007880eaf8/0x96d0c9b8c9a1e95b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x615:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.263659:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.263660:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.263662:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201503.263793:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x614:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201503.263799:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1e962 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x614:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.263807:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x614:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:1.0:1788201503.263811:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x614:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201503.263815:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1e962 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.263835:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1e962 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.263843:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1e962 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.263850:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1e962 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.263871:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201503.264148:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x613:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201503.264154:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa42974e/0x96d0c9b8c9a1e969 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x613:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.264163:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x613:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:1.0:1788201503.264166:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x613:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201503.264169:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa42974e/0x96d0c9b8c9a1e969 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.264178:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa42974e/0x96d0c9b8c9a1e969 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.264185:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa42974e/0x96d0c9b8c9a1e969 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.264202:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa42974e/0x96d0c9b8c9a1e969 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.264229:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788201503.264256:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201503.264272:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1e962 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.264282:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201503.264294:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1e962 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.264302:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1e962 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.264315:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1e962 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.264322:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000033e9d44/0x96d0c9b8c9a1e962 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x614:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.264336:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201503.264339:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa42974e/0x96d0c9b8c9a1e969 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.264345:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201503.264348:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa42974e/0x96d0c9b8c9a1e969 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.264355:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa42974e/0x96d0c9b8c9a1e969 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.264363:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa42974e/0x96d0c9b8c9a1e969 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.264370:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa42974e/0x96d0c9b8c9a1e969 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.264389:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.264391:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.264393:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201503.264636:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x613:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201503.264642:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1e970 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x613:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.264650:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x613:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:0.0:1788201503.264664:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x613:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201503.264668:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1e970 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.264677:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1e970 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.264685:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1e970 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.264692:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1e970 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.264707:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201503.264715:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201503.264720:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1e970 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.264738:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201503.264741:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1e970 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.264748:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1e970 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.264759:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1e970 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.264766:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1e970 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x613:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.264782:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.264784:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.264786:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.265087:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201503.265167:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x612:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201503.265173:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0a7d527/0x96d0c9b8c9a1e977 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x612:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.265182:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x612:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:0.0:1788201503.265185:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x612:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201503.265189:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0a7d527/0x96d0c9b8c9a1e977 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.265198:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0a7d527/0x96d0c9b8c9a1e977 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.265214:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0a7d527/0x96d0c9b8c9a1e977 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.265221:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0a7d527/0x96d0c9b8c9a1e977 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.265316:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788201503.266054:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x611:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201503.266062:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1e97e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x611:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.266073:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x611:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:0.0:1788201503.266076:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x611:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201503.266082:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1e97e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.266093:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1e97e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.266102:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1e97e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.266109:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1e97e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201503.266270:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x612:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201503.266277:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efb0ef6b/0x96d0c9b8c9a1e985 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x612:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.266286:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x612:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:1.0:1788201503.266289:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x612:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201503.266294:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efb0ef6b/0x96d0c9b8c9a1e985 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.266303:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efb0ef6b/0x96d0c9b8c9a1e985 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.266310:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efb0ef6b/0x96d0c9b8c9a1e985 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.266316:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efb0ef6b/0x96d0c9b8c9a1e985 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.266673:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788201503.266681:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0a7d527/0x96d0c9b8c9a1e977 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.266689:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201503.266693:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0a7d527/0x96d0c9b8c9a1e977 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.266701:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0a7d527/0x96d0c9b8c9a1e977 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.266716:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0a7d527/0x96d0c9b8c9a1e977 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.266724:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0a7d527/0x96d0c9b8c9a1e977 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.266742:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201503.266745:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1e97e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.266751:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201503.266761:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1e97e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.266770:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1e97e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.266780:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1e97e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.266786:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201503.266790:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efb0ef6b/0x96d0c9b8c9a1e985 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.266794:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201503.266797:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efb0ef6b/0x96d0c9b8c9a1e985 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.266801:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efb0ef6b/0x96d0c9b8c9a1e985 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.266806:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efb0ef6b/0x96d0c9b8c9a1e985 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.266811:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.266812:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.266813:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.268887:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788201503.268900:0:101192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1e97e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.269295:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201503.269770:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x610:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201503.269780:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062e8506/0x96d0c9b8c9a1e98c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.269794:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x610:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:0.0:1788201503.269799:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x610:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201503.269804:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000062e8506/0x96d0c9b8c9a1e98c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.269816:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000062e8506/0x96d0c9b8c9a1e98c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.269825:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000062e8506/0x96d0c9b8c9a1e98c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.269833:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000062e8506/0x96d0c9b8c9a1e98c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.269859:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201503.270189:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201503.270197:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000062e8506/0x96d0c9b8c9a1e98c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.270216:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201503.270221:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000062e8506/0x96d0c9b8c9a1e98c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.270230:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000062e8506/0x96d0c9b8c9a1e98c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.270248:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000062e8506/0x96d0c9b8c9a1e98c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.270255:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000062e8506/0x96d0c9b8c9a1e98c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.270284:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.270286:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.270288:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201503.270858:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x60f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201503.270866:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1e993 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.270884:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x60f:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:0.0:1788201503.270888:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x60f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201503.270893:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1e993 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.270903:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1e993 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.270911:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1e993 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.270918:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1e993 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.270941:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201503.271180:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201503.271186:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1e993 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.271193:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201503.271196:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1e993 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.271226:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1e993 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.271239:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1e993 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.271246:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b32a6ce8/0x96d0c9b8c9a1e993 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.271272:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.271274:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.271276:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201503.271589:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x60e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201503.271595:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bccf566/0x96d0c9b8c9a1e99a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.271603:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x60e:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:0.0:1788201503.271607:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x60e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201503.271611:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bccf566/0x96d0c9b8c9a1e99a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.271621:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bccf566/0x96d0c9b8c9a1e99a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.271636:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bccf566/0x96d0c9b8c9a1e99a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.271644:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009bccf566/0x96d0c9b8c9a1e99a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.271658:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201503.271703:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201503.271711:0:101189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efb0ef6b/0x96d0c9b8c9a1e985 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x612:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.272855:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201503.272865:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009bccf566/0x96d0c9b8c9a1e99a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.272875:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201503.272880:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009bccf566/0x96d0c9b8c9a1e99a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.272889:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009bccf566/0x96d0c9b8c9a1e99a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.272919:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009bccf566/0x96d0c9b8c9a1e99a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.272940:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bccf566/0x96d0c9b8c9a1e99a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.272960:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.272961:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.272963:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.272971:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201503.277380:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x60d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201503.277394:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e7cbbed/0x96d0c9b8c9a1e9a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.277411:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x60d:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:1.0:1788201503.277416:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x60d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201503.277421:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e7cbbed/0x96d0c9b8c9a1e9a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.277435:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e7cbbed/0x96d0c9b8c9a1e9a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.277444:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e7cbbed/0x96d0c9b8c9a1e9a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.277452:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e7cbbed/0x96d0c9b8c9a1e9a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201503.277469:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201503.281408:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201503.281423:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e7cbbed/0x96d0c9b8c9a1e9a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.281438:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201503.281444:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e7cbbed/0x96d0c9b8c9a1e9a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.281457:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e7cbbed/0x96d0c9b8c9a1e9a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.281479:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e7cbbed/0x96d0c9b8c9a1e9a1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.281487:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e7cbbed/0x96d0c9b8c9a1e9a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.281511:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.281533:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.281535:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201503.281642:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x611:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201503.281649:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e9a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x611:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.281661:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x611:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:2.0:1788201503.281665:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x611:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201503.281672:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e9a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.281684:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e9a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.281693:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e9a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.281701:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e9a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.281724:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201503.281734:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201503.281739:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e9a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.281746:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201503.281749:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e9a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.281769:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e9a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.281779:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e9a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.281786:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1e9a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x611:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.281800:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.281801:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.281803:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788201503.283195:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x60c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201503.283206:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1e9af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.283220:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x60c:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:0.0:1788201503.283224:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x60c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201503.283229:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1e9af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.283242:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1e9af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.283252:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1e9af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.283271:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1e9af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.283313:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788201503.291243:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x60b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201503.291269:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1e9b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.291288:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x60b:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:0.0:1788201503.291292:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x60b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201503.291299:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1e9b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.291314:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1e9b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.291325:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1e9b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.291333:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1e9b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.291362:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788201503.293595:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x60a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201503.293607:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000356154cf/0x96d0c9b8c9a1e9bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.293625:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x60a:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:0.0:1788201503.293635:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x60a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201503.293641:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000356154cf/0x96d0c9b8c9a1e9bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.293654:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000356154cf/0x96d0c9b8c9a1e9bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.293664:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000356154cf/0x96d0c9b8c9a1e9bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.293673:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000356154cf/0x96d0c9b8c9a1e9bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.293695:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788201503.294052:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x609:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201503.294058:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1e9c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.294066:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x609:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:0.0:1788201503.294069:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x609:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201503.294073:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1e9c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.294081:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1e9c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.294089:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1e9c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.294104:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1e9c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.294120:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788201503.294210:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788201503.294217:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1e9af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.294225:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201503.294230:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1e9af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.294239:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1e9af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.294256:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1e9af lrc: 1/0,0 mode: --/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.294973:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788201503.294981:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1e9b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.294989:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201503.294992:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1e9b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.295000:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1e9b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.295012:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1e9b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.295048:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000981814d6/0x96d0c9b8c9a1e9b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.295069:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201503.295073:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000356154cf/0x96d0c9b8c9a1e9bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.295079:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201503.295083:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000356154cf/0x96d0c9b8c9a1e9bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.295091:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000356154cf/0x96d0c9b8c9a1e9bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.295100:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000356154cf/0x96d0c9b8c9a1e9bd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.295106:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000356154cf/0x96d0c9b8c9a1e9bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.295138:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201503.295142:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1e9c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.295149:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201503.295159:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1e9c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.295167:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1e9c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.295178:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1e9c4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.295184:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2a8b35f/0x96d0c9b8c9a1e9c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.295195:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.295196:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.295198:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.295205:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201503.295274:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x610:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201503.295280:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000279447c9/0x96d0c9b8c9a1e9cb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.295289:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x610:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:2.0:1788201503.295293:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x610:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201503.295299:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000279447c9/0x96d0c9b8c9a1e9cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.295308:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000279447c9/0x96d0c9b8c9a1e9cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.295328:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000279447c9/0x96d0c9b8c9a1e9cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.295340:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000279447c9/0x96d0c9b8c9a1e9cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.295354:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201503.295362:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201503.295366:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000279447c9/0x96d0c9b8c9a1e9cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.295372:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbdc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201503.295376:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000279447c9/0x96d0c9b8c9a1e9cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.295382:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000279447c9/0x96d0c9b8c9a1e9cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.295387:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.295393:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000279447c9/0x96d0c9b8c9a1e9cb lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.295399:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000279447c9/0x96d0c9b8c9a1e9cb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.295411:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.295419:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.295420:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201503.297471:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x60f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201503.297484:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e9d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.297501:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x60f:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:2.0:1788201503.297506:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x60f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201503.297512:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e9d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.297525:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e9d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.297536:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e9d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.297543:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e9d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.297701:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201503.298143:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ae39ec7/0x96d0c9b8c9a1e9af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.298169:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201503.298174:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e9d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.298193:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201503.298198:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e9d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.298208:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e9d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.298225:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e9d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.298233:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1e9d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.298246:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.298248:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.298250:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201503.299067:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x608:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201503.299077:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b840617e/0x96d0c9b8c9a1e9d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.299089:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x608:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:2.0:1788201503.299093:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x608:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201503.299099:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b840617e/0x96d0c9b8c9a1e9d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.299117:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b840617e/0x96d0c9b8c9a1e9d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.299127:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b840617e/0x96d0c9b8c9a1e9d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.299136:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b840617e/0x96d0c9b8c9a1e9d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.299152:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201503.299334:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x60e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201503.299340:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e9e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.299350:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x60e:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:2.0:1788201503.299353:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x60e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201503.299358:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e9e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.299367:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e9e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.299376:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e9e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.299394:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e9e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.299409:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788201503.299419:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201503.299423:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b840617e/0x96d0c9b8c9a1e9d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.299430:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201503.299434:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b840617e/0x96d0c9b8c9a1e9d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.299443:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b840617e/0x96d0c9b8c9a1e9d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.299457:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b840617e/0x96d0c9b8c9a1e9d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.299465:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b840617e/0x96d0c9b8c9a1e9d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.299497:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201503.299502:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e9e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.299520:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201503.299523:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e9e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.299531:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e9e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.299543:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e9e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.299550:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1e9e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.299562:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.299563:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.299566:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201503.299600:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x607:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201503.299606:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d38d639/0x96d0c9b8c9a1e9e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.299614:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x607:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:2.0:1788201503.299617:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x607:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201503.299621:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d38d639/0x96d0c9b8c9a1e9e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.299630:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d38d639/0x96d0c9b8c9a1e9e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.299644:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d38d639/0x96d0c9b8c9a1e9e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.299652:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d38d639/0x96d0c9b8c9a1e9e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.299672:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201503.300861:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201503.300870:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d38d639/0x96d0c9b8c9a1e9e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.301057:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201503.301062:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d38d639/0x96d0c9b8c9a1e9e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.301074:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d38d639/0x96d0c9b8c9a1e9e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.301100:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d38d639/0x96d0c9b8c9a1e9e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.301108:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d38d639/0x96d0c9b8c9a1e9e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.301126:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.301127:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.301129:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201503.302310:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201503.302320:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201503.302973:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x606:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201503.302983:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e9ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.302998:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x606:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:2.0:1788201503.303003:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x606:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201503.303009:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e9ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.303049:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e9ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.303058:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e9ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.303065:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e9ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.303107:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201503.303464:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201503.303471:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e9ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.303491:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201503.303495:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e9ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.303503:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e9ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.303519:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e9ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.303525:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1e9ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.303543:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201503.303545:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201503.303546:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201503.305409:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x605:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201503.305421:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e9f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.305439:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x605:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:2.0:1788201503.305444:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x605:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201503.305450:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e9f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.305462:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e9f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.305472:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e9f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.305480:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e9f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.305496:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201503.305529:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x60d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201503.305535:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1e9fc lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.305543:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x60d:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:3.0:1788201503.305546:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x60d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201503.305550:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1e9fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.305558:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1e9fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.305574:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1e9fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.305580:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1e9fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.305595:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201503.305605:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201503.305610:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e9f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.305617:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbca00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201503.305621:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e9f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.305629:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e9f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.305644:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e9f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.305652:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1e9f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.305667:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201503.305676:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1e9fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.305679:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201503.305683:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201503.305686:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1e9fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.305693:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1e9fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.305703:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1e9fc lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.305709:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1e9fc lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.305722:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201503.305723:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201503.305725:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201503.306335:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x60c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201503.306343:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f3c2521/0x96d0c9b8c9a1ea03 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.306354:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x60c:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:3.0:1788201503.306359:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x60c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201503.306364:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f3c2521/0x96d0c9b8c9a1ea03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.306388:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f3c2521/0x96d0c9b8c9a1ea03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.306396:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f3c2521/0x96d0c9b8c9a1ea03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.306403:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f3c2521/0x96d0c9b8c9a1ea03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.306424:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201503.307216:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x60b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201503.307225:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093eaf47a/0x96d0c9b8c9a1ea0a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.307236:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x60b:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:3.0:1788201503.307240:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x60b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201503.307246:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093eaf47a/0x96d0c9b8c9a1ea0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.307255:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093eaf47a/0x96d0c9b8c9a1ea0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.307275:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093eaf47a/0x96d0c9b8c9a1ea0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.307294:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093eaf47a/0x96d0c9b8c9a1ea0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.307309:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201503.307319:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201503.307323:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f3c2521/0x96d0c9b8c9a1ea03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.307330:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201503.307334:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f3c2521/0x96d0c9b8c9a1ea03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.307341:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f3c2521/0x96d0c9b8c9a1ea03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.307355:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f3c2521/0x96d0c9b8c9a1ea03 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.307362:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f3c2521/0x96d0c9b8c9a1ea03 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.307380:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201503.307384:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093eaf47a/0x96d0c9b8c9a1ea0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.307402:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201503.307407:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093eaf47a/0x96d0c9b8c9a1ea0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.307415:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093eaf47a/0x96d0c9b8c9a1ea0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.307426:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201503.307428:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093eaf47a/0x96d0c9b8c9a1ea0a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.307437:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093eaf47a/0x96d0c9b8c9a1ea0a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.307452:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201503.307455:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201503.307458:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201503.307477:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x604:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201503.307485:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1ea11 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.307496:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x604:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:2.0:1788201503.307505:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x604:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201503.307511:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1ea11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.307524:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1ea11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.307533:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1ea11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.307541:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1ea11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.307562:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201503.308004:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x60a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201503.308012:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1ea18 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.308070:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x60a:0x0].0x0 since=4354s v=(0 0) 00002000:00010000:2.0:1788201503.308071:0:101192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x603:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201503.308075:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x60a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201503.308079:0:101192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1ea1f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.308081:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1ea18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.308098:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x603:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:2.0:1788201503.308103:0:101192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x603:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201503.308103:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1ea18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.308109:0:101192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1ea1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.308139:0:101192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1ea1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.308148:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1ea18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.308149:0:101192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1ea1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.308160:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1ea18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.308167:0:101192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1ea1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.308189:0:101192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201503.308200:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:2.0:1788201503.308222:0:101192:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:1538 00002000:00010000:3.0:1788201503.308572:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x609:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201503.308645:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004346370c/0x96d0c9b8c9a1ea26 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.308654:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x609:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:3.0:1788201503.308657:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x609:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201503.308662:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004346370c/0x96d0c9b8c9a1ea26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.308672:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004346370c/0x96d0c9b8c9a1ea26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.308680:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004346370c/0x96d0c9b8c9a1ea26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.308687:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004346370c/0x96d0c9b8c9a1ea26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.308712:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788201503.308720:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788201503.308725:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1ea11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.308732:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201503.308736:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1ea11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.308743:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1ea11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.308756:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1ea11 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.308764:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1ea11 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.308780:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788201503.308784:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1ea1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.308790:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201503.308793:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1ea1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.308811:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1ea1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.308823:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1ea1f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.308829:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1ea1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.308918:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201503.308923:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1ea18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.308929:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201503.308933:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1ea18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.308940:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1ea18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.308950:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1ea18 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.308957:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cda539d/0x96d0c9b8c9a1ea18 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.308980:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201503.308984:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004346370c/0x96d0c9b8c9a1ea26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.308990:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201503.308993:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004346370c/0x96d0c9b8c9a1ea26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.309001:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004346370c/0x96d0c9b8c9a1ea26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.309010:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004346370c/0x96d0c9b8c9a1ea26 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.309366:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004346370c/0x96d0c9b8c9a1ea26 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.309383:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201503.309384:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201503.309386:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201503.309788:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x608:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201503.309794:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1ea2d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.309804:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x608:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:3.0:1788201503.309813:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x608:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201503.309818:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1ea2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.309829:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1ea2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.309837:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1ea2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.309918:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1ea2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.309938:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201503.309947:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201503.309951:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1ea2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.309958:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201503.309962:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1ea2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.309969:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1ea2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.309981:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1ea2d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.309998:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba0e6512/0x96d0c9b8c9a1ea2d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.310091:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201503.310094:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201503.310096:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201503.310451:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x607:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201503.310457:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018d01b30/0x96d0c9b8c9a1ea34 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.310466:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x607:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:3.0:1788201503.310469:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x607:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201503.310473:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018d01b30/0x96d0c9b8c9a1ea34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.310482:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018d01b30/0x96d0c9b8c9a1ea34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.310490:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018d01b30/0x96d0c9b8c9a1ea34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.310498:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018d01b30/0x96d0c9b8c9a1ea34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.310513:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201503.310527:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201503.310531:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018d01b30/0x96d0c9b8c9a1ea34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.310539:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201503.310542:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018d01b30/0x96d0c9b8c9a1ea34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.310549:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018d01b30/0x96d0c9b8c9a1ea34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.310560:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018d01b30/0x96d0c9b8c9a1ea34 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.310567:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018d01b30/0x96d0c9b8c9a1ea34 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.310833:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201503.310836:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201503.310838:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201503.310955:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:104396:x1875060715431296:12345-0@lo:5:osp-pre-0-1.0 Request processed in 153175us (153755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201503.310968:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00010000:2.0:1788201503.311005:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.311012:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201503.311073:0:104396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:104396:1875060715431296:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788201503.311090:0:104396:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x621:0x0] from OST, last_created [0x280000400:0x621:0x0]last_used is [0x280000400:0x602:0x0] 00000100:00100000:2.0:1788201503.311151:0:104396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e41880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:104396:1875060715431552:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788201503.311189:0:104396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201503.311234:0:104396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140ffb600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201503.311250:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715431424:0@lo:13:osp-pre-0-1.0 00002000:00010000:3.0:1788201503.311290:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x606:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1788201503.311291:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201503.311299:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1ea3b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.311309:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x606:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:3.0:1788201503.311313:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x606:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201503.311318:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1ea3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201503.311334:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715431552 00000100:00100000:2.0:1788201503.311342:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715431552 00010000:00010000:3.0:1788201503.311358:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1ea3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.311367:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1ea3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.311374:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1ea3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201503.311385:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00010000:00010000:3.0:1788201503.311390:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788201503.311396:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:104396:x1875060715431552:12345-0@lo:5:osp-pre-0-1.0 00010000:00010000:3.0:1788201503.311399:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201503.311404:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1ea3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.311411:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201503.311415:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1ea3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.311423:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1ea3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788201503.311434:0:99764:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 1570 00010000:00010000:3.0:1788201503.311436:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1ea3b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.311446:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fa5efbd/0x96d0c9b8c9a1ea3b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.311469:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201503.311470:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201503.311472:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201503.311532:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715431424 00000100:00100000:2.0:1788201503.311537:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715431424 00000100:00100000:2.0:1788201503.311572:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788201503.311579:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715431424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201503.311592:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 896 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201503.311632:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715431424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201503.311639:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788201503.311672:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715431424:0@lo:13:osp-pre-0-1.0 00002000:00010000:3.0:1788201503.311823:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x605:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201503.311830:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000583840ff/0x96d0c9b8c9a1ea42 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.311838:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x605:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:3.0:1788201503.311841:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x605:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201503.311916:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000583840ff/0x96d0c9b8c9a1ea42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.311927:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000583840ff/0x96d0c9b8c9a1ea42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.311935:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000583840ff/0x96d0c9b8c9a1ea42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.311942:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000583840ff/0x96d0c9b8c9a1ea42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.311960:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201503.312861:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201503.312869:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000583840ff/0x96d0c9b8c9a1ea42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.312880:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201503.312884:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000583840ff/0x96d0c9b8c9a1ea42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.312907:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000583840ff/0x96d0c9b8c9a1ea42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.312923:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000583840ff/0x96d0c9b8c9a1ea42 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.312932:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000583840ff/0x96d0c9b8c9a1ea42 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201503.312965:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.312967:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201503.312969:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201503.314170:0:101189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x604:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201503.314181:0:101189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1ea49 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.314207:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x604:0x0].0x0 since=4354s v=(0 0) 00010000:00010000:3.0:1788201503.314211:0:101189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x604:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201503.314217:0:101189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1ea49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.314228:0:101189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1ea49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.314237:0:101189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1ea49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.314244:0:101189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1ea49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201503.314271:0:101189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788201503.316570:0:101189:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000400:1539 00000100:00100000:3.0:1788201503.316696:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:104398:x1875060715431168:12345-0@lo:5:osp-pre-1-1.0 Request processed in 158576us (159393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201503.316710:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788201503.318063:0:104398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f2e0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:104398:1875060715431168:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788201503.318081:0:104398:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x621:0x0] from OST, last_created [0x2c0000400:0x621:0x0]last_used is [0x2c0000400:0x603:0x0] 00000100:00100000:1.0:1788201503.318153:0:104398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d55880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:104398:1875060715431808:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788201503.318204:0:104398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201503.318240:0:104398:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc120888a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201503.318285:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201503.318297:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715431680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201503.318326:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201503.318356:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715431808 00000100:00100000:1.0:1788201503.318363:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715431808 00000100:00100000:1.0:1788201503.318406:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788201503.318415:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:104398:x1875060715431808:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788201503.318453:0:99766:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 1570 00000100:00100000:1.0:1788201503.318599:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715431680 00000100:00100000:1.0:1788201503.318603:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715431680 00000100:00100000:1.0:1788201503.318633:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788201503.318641:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715431680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201503.318654:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 896 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201503.318693:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715431680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201503.318700:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788201503.318742:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715431680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201503.321465:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:104396:x1875060715431552:12345-0@lo:5:osp-pre-0-1.0 Request processed in 10066us (10270us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1788201503.321480:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:2.0:1788201503.321511:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201503.321519:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1ea49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.321533:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201503.321539:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1ea49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.321551:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1ea49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.321575:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1ea49 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.321583:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000722c38c4/0x96d0c9b8c9a1ea49 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201503.321624:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.321626:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.321627:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201503.321634:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201503.321673:0:104396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e41880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:104396:1875060715431552:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788201503.321688:0:104396:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x621:0x0]-[0x280000400:0x641:0x0] 00000100:00100000:2.0:1788201503.321729:0:104396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e40e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:104396:1875060715431936:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788201503.324011:0:104396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201503.324068:0:104396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140ffb600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201503.324113:0:66324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715431936 00000100:00100000:2.0:1788201503.324121:0:66324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715431936 00000100:00100000:2.0:1788201503.324170:0:66324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788201503.324180:0:66324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:104396:x1875060715431936:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788201503.324243:0:66324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:104396:x1875060715431936:12345-0@lo:900:osp-pre-0-1.0 Request processed in 64us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201503.324251:0:66324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788201503.324307:0:104396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e40e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:104396:1875060715431936:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788201503.326531:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:104398:x1875060715431808:12345-0@lo:5:osp-pre-1-1.0 Request processed in 8110us (8321us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788201503.326543:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788201503.326753:0:104398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d55880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:104398:1875060715431808:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788201503.326769:0:104398:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x621:0x0]-[0x2c0000400:0x641:0x0] 00000100:00100000:3.0:1788201503.326813:0:104398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f2e3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:104398:1875060715432064:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788201503.326937:0:104398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201503.326967:0:104398:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f60900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201503.327901:0:66324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715432064 00000100:00100000:2.0:1788201503.327911:0:66324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715432064 00000100:00100000:2.0:1788201503.327957:0:66324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788201503.327967:0:66324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f2e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:104398:x1875060715432064:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788201503.328074:0:66324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f2e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:104398:x1875060715432064:12345-0@lo:900:osp-pre-1-1.0 Request processed in 108us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201503.328081:0:66324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201503.328276:0:104398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f2e3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:104398:1875060715432064:0@lo:900:osp-pre-1-1.0 00000001:00080000:2.0:1788201503.580473:0:102447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018903 is committed 00010000:00010000:3.0:1788201503.887997:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788201504.139550:0:104707:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788201504.141735:0:104707:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788201504.659941:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201504.659991:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201504.660066:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201504.660123:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695555584 00000100:00100000:3.0:1788201504.660143:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695555584 00000100:00100000:3.0:1788201504.660223:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695555456 00000100:00100000:3.0:1788201504.660227:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695555456 00000100:00100000:2.0:1788201504.660284:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695555328 00000100:00100000:2.0:1788201504.660296:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695555328 00000100:00100000:3.0:1788201504.660304:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1829 00000100:00100000:3.0:1788201504.660320:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2400:x1875060695555584:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201504.660366:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 127 00000100:00100000:2.0:1788201504.660379:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc140c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695555328:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201504.660455:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc140c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695555328:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 79us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201504.660465:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 127 00000100:00100000:1.0:1788201504.660479:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1830 00000100:00100000:1.0:1788201504.660495:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2400:x1875060695555456:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201504.660566:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2400:x1875060695555456:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 70us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201504.660596:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1830 00000100:00100000:3.0:1788201504.660764:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2400:x1875060695555584:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 448us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201504.660771:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1829 00000100:00080000:3.0:1788201504.660793:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788201504.911536:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788201505.004429:0:104757:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788201505.004602:0:104757:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788201505.615675:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715432192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201505.615750:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201505.616236:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201505.616255:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715432320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201505.616299:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201505.616543:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715432192 00000100:00100000:0.0:1788201505.616552:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715432192 00000100:00100000:0.0:1788201505.616617:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715432320 00000100:00100000:0.0:1788201505.616620:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715432320 00000100:00100000:0.0:1788201505.616639:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788201505.616649:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715432192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201505.616677:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201505.616725:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715432192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201505.616733:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788201505.616749:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788201505.616756:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715432320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201505.616773:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788201505.616801:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715432320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201505.616807:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788201505.616849:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715432320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201505.616863:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715432192:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788201505.618135:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201505.618141:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788201505.936609:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201506.963476:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201507.094851:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201507.095955:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695555712 00000100:00100000:0.0:1788201507.096061:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695555712 00000100:00100000:0.0:1788201507.096209:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1803 00000100:00100000:0.0:1788201507.096225:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f2e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:78193:x1875060695555712:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:0.0:1788201507.096261:0:66313:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444970496 avail 1298731008 00000100:00100000:0.0:1788201507.096341:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f2e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:78193:x1875060695555712:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 123us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201507.096349:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1803 00000100:00080000:1.0:1788201507.097773:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201507.103422:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201507.103871:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695555840 00000100:00100000:1.0:1788201507.103881:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695555840 00000100:00080000:3.0:1788201507.104053:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201507.104128:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1804 00000100:00100000:1.0:1788201507.104214:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:78193:x1875060695555840:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:1.0:1788201507.104253:0:69485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445404672 avail 1299165184 00000100:00100000:1.0:1788201507.104387:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:78193:x1875060695555840:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 177us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201507.104394:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1804 00000100:00100000:2.0:1788201507.119094:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201507.119618:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695555968 00000100:00100000:3.0:1788201507.119630:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695555968 00000100:00100000:3.0:1788201507.119690:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 60 00000100:00100000:3.0:1788201507.119698:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2399:x1875060695555968:12345-192.168.201.20@tcp:8:lfs.0 00010000:00080000:3.0:1788201507.119732:0:101191:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp t8589934594 exp 0000000000000000 cur 4358 last 0 00000020:00000080:3.0:1788201507.120113:0:101191:0:(genops.c:1385:class_connect()) connect: client 6e293f14-c501-4bc5-9dd4-a18ef02756b4, cookie 0x96d0c9b8c9a1ea50 00002000:00100000:3.0:1788201507.120128:0:101191:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6e293f14-c501-4bc5-9dd4-a18ef02756b4/ffff8dc137d36800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8359936 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788201507.120216:0:101191:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788201507.120287:0:101191:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788201507.120323:0:101191:0:(import.c:65:import_set_state_nolock()) ffff8dc137d30800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201507.120450:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695555968:12345-192.168.201.20@tcp:8:lfs.0 Request processed in 750us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201507.120477:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 60 00000100:00100000:2.0:1788201507.137554:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201507.140004:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695556096 00000100:00100000:0.0:1788201507.140053:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695556096 00000100:00100000:0.0:1788201507.140170:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 96 00000100:00100000:0.0:1788201507.140183:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:78193:x1875060695556096:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:0.0:1788201507.140238:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201507.140325:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:78193:x1875060695556096:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 146us (2781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201507.140333:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 96 00000100:00080000:3.0:1788201507.141221:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201507.145140:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201507.145308:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695556224 00000100:00100000:0.0:1788201507.145319:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695556224 00000100:00100000:0.0:1788201507.145366:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 61 00000100:00100000:0.0:1788201507.145373:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2399:x1875060695556224:12345-192.168.201.20@tcp:8:lfs.0 00010000:00080000:0.0:1788201507.145409:0:101192:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp t0 exp 0000000000000000 cur 4358 last 0 00000020:00000080:0.0:1788201507.145438:0:101192:0:(genops.c:1385:class_connect()) connect: client 6e293f14-c501-4bc5-9dd4-a18ef02756b4, cookie 0x96d0c9b8c9a1ea57 00002000:00100000:0.0:1788201507.145450:0:101192:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6e293f14-c501-4bc5-9dd4-a18ef02756b4/ffff8dc103483000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788201507.145459:0:101192:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788201507.145536:0:101192:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788201507.145567:0:101192:0:(import.c:65:import_set_state_nolock()) ffff8dc103487800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201507.145716:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695556224:12345-192.168.201.20@tcp:8:lfs.0 Request processed in 341us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201507.145724:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 61 00000100:00100000:2.0:1788201507.156571:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201507.156744:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695556352 00000100:00100000:0.0:1788201507.156755:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695556352 00000100:00100000:0.0:1788201507.157008:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 97 00000100:00100000:0.0:1788201507.157051:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:78193:x1875060695556352:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:0.0:1788201507.157080:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3923513344 avail 3691991040 00000100:00080000:3.0:1788201507.157289:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201507.157341:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:78193:x1875060695556352:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 322us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201507.157350:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 97 00010000:00010000:3.0:1788201507.984304:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201508.175282:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201508.175310:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715432448:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201508.175383:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201508.175450:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715432448 00000100:00100000:2.0:1788201508.175467:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715432448 00000100:00100000:2.0:1788201508.175565:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788201508.175580:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715432448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201508.175634:0:66317:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445404672 avail 1299165184 00000100:00100000:3.0:1788201508.175669:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715432832:0@lo:400:kworker.0 00000100:00100000:3.0:1788201508.175723:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201508.175881:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc133331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715432576:0@lo:400:kworker.0 00000100:00100000:0.0:1788201508.175931:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715432704:0@lo:400:kworker.0 00000100:00100000:3.0:1788201508.176130:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715433344:0@lo:400:kworker.0 00000100:00100000:3.0:1788201508.176158:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201508.176187:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715433856:0@lo:400:kworker.0 00000100:00100000:3.0:1788201508.176210:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201508.176249:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715432832 00000100:00100000:3.0:1788201508.176257:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715432832 00000100:00100000:3.0:1788201508.176317:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1831 00000100:00100000:3.0:1788201508.176328:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715432832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201508.176380:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715432832:12345-0@lo:400:kworker.0 Request processed in 54us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201508.176387:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1831 00000100:00100000:3.0:1788201508.176412:0:101189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715433344 00000100:00100000:3.0:1788201508.176415:0:101189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715433344 00000100:00100000:3.0:1788201508.176443:0:101189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715433856 00000100:00100000:3.0:1788201508.176446:0:101189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715433856 00000100:00100000:3.0:1788201508.176465:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788201508.176471:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715433344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201508.176500:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715433344:12345-0@lo:400:kworker.0 Request processed in 29us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201508.176506:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788201508.176536:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788201508.176542:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715433856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201508.176571:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715433856:12345-0@lo:400:kworker.0 Request processed in 29us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201508.176577:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1788201508.176594:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201508.176598:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201508.176639:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715432832:0@lo:400:kworker.0 00000100:00100000:3.0:1788201508.176650:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715433344:0@lo:400:kworker.0 00000100:00100000:3.0:1788201508.176660:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715433856:0@lo:400:kworker.0 00000100:00100000:3.0:1788201508.177156:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715432960:0@lo:400:kworker.0 00000100:00100000:3.0:1788201508.177203:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201508.177227:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715433472:0@lo:400:kworker.0 00000100:00100000:3.0:1788201508.177250:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201508.177270:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715433984:0@lo:400:kworker.0 00000100:00100000:3.0:1788201508.177292:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201508.179674:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715432448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4082us (4274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201508.179696:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788201508.181218:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715432960 00000100:00100000:2.0:1788201508.181237:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715432960 00000100:00100000:2.0:1788201508.181316:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715433472 00000100:00100000:2.0:1788201508.181336:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715433472 00000100:00100000:2.0:1788201508.181353:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715433984 00000100:00100000:2.0:1788201508.181355:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715433984 00000100:00100000:2.0:1788201508.181371:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1832 00000100:00100000:2.0:1788201508.181381:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715432960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201508.182293:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715432960:12345-0@lo:400:kworker.0 Request processed in 907us (5083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201508.182306:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1832 00000100:00100000:2.0:1788201508.182336:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1833 00000100:00100000:2.0:1788201508.182354:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715433472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201508.182417:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715433472:12345-0@lo:400:kworker.0 Request processed in 75us (5166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201508.182429:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1833 00000100:00100000:2.0:1788201508.182442:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1834 00000100:00100000:2.0:1788201508.182449:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715433984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201508.182583:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715433984:12345-0@lo:400:kworker.0 Request processed in 130us (5286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201508.182590:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1834 00000100:00080000:2.0:1788201508.182626:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201508.182715:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715432960:0@lo:400:kworker.0 00000100:00100000:1.0:1788201508.182725:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201508.182826:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715433472:0@lo:400:kworker.0 00000100:00100000:2.0:1788201508.183306:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715433984:0@lo:400:kworker.0 00000100:00100000:1.0:1788201508.183328:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12580a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715433088:0@lo:400:kworker.0 00000100:00100000:1.0:1788201508.183383:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201508.183415:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715433600:0@lo:400:kworker.0 00000100:00100000:2.0:1788201508.183447:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715433088 00000100:00100000:1.0:1788201508.183448:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201508.183457:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715433088 00000100:00100000:1.0:1788201508.183489:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715434112:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201508.183536:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201508.183594:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715432448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201508.183613:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1835 00000100:00100000:2.0:1788201508.183628:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715433088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201508.183660:0:102459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715432576 00000100:00100000:1.0:1788201508.183669:0:102459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715432576 00000100:00100000:1.0:1788201508.183726:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788201508.183818:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13c3ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715432576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201508.183841:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715433088:12345-0@lo:400:kworker.0 Request processed in 99us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201508.183853:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1835 00000100:00100000:1.0:1788201508.183877:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13c3ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715432576:12345-0@lo:400:kworker.0 Request processed in 141us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201508.183886:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1788201508.183898:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201508.183932:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715433600 00000100:00100000:1.0:1788201508.184010:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715433600 00000100:00100000:1.0:1788201508.184064:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715434112 00000100:00100000:1.0:1788201508.184067:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715434112 00000100:00100000:1.0:1788201508.184078:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788201508.184084:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715433600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201508.184117:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715433600:12345-0@lo:400:kworker.0 Request processed in 34us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201508.184123:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788201508.184134:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788201508.184139:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715434112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201508.184160:0:101344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444970496 avail 1298731008 00000100:00100000:1.0:1788201508.184200:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715434112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201508.184206:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788201508.184236:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc133331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715432576:0@lo:400:kworker.0 00000100:00100000:1.0:1788201508.184248:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12580a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715433088:0@lo:400:kworker.0 00000100:00100000:1.0:1788201508.184268:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018903 gen 2 00000004:00080000:1.0:1788201508.184274:0:3658:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018900 committed transno 128849018903 00000004:00080000:1.0:1788201508.184295:0:3658:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018901 committed transno 128849018903 00000004:00080000:1.0:1788201508.184307:0:3658:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018902 committed transno 128849018903 00000004:00080000:1.0:1788201508.184324:0:3658:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018903 committed transno 128849018903 00000100:00100000:1.0:1788201508.184335:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715433600:0@lo:400:kworker.0 00000100:00100000:1.0:1788201508.184349:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715434112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201508.184638:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201508.184722:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715433216:0@lo:400:kworker.0 00000100:00100000:0.0:1788201508.184833:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201508.184860:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0058a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715433728:0@lo:400:kworker.0 00000100:00100000:0.0:1788201508.184891:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201508.184975:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715433216 00000100:00100000:2.0:1788201508.184985:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715433216 00000100:00100000:3.0:1788201508.185056:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715433728 00000100:00100000:3.0:1788201508.185063:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715433728 00000100:00100000:2.0:1788201508.185089:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788201508.185101:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715433216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201508.185196:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715433216:12345-0@lo:400:kworker.0 Request processed in 97us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201508.185207:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715433216:0@lo:400:kworker.0 00000100:00100000:1.0:1788201508.185496:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715432704 00000100:00100000:1.0:1788201508.185501:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715432704 00000100:00100000:2.0:1788201508.185588:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788201508.185612:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1836 00000100:00100000:1.0:1788201508.185627:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715432704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201508.185686:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715432704:12345-0@lo:400:kworker.0 Request processed in 66us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201508.185693:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1836 00000100:00100000:0.0:1788201508.185814:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715432704:0@lo:400:kworker.0 00000100:00100000:3.0:1788201508.185884:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788201508.185898:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715433728:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788201508.185919:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201508.185928:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201508.186120:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715433728:12345-0@lo:400:kworker.0 Request processed in 227us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201508.186127:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788201508.186239:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0058a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715433728:0@lo:400:kworker.0 00000100:00100000:1.0:1788201508.691585:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12ee2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715434240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201508.691651:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201508.691708:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715434240 00000100:00100000:1.0:1788201508.691715:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715434240 00000100:00100000:1.0:1788201508.691901:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788201508.691911:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715434240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201508.691938:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201508.691980:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715434240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201508.691987:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788201508.692123:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12ee2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715434240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201508.695883:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715434368:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201508.695976:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201508.699331:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715434368 00000100:00100000:3.0:1788201508.699346:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715434368 00000100:00100000:3.0:1788201508.699422:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788201508.699432:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715434368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201508.699463:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201508.699545:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715434368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (3568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201508.699552:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788201508.699625:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715434368:0@lo:13:osp-pre-0-1.0 00000001:00100000:1.0:1788201508.707005:0:99761:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000001:00080000:1.0:1788201508.707079:0:99761:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901911 is committed 00000001:00100000:3.0:1788201508.707644:0:100576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000001:00080000:3.0:1788201508.707660:0:100576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:2.0:1788201509.014001:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201509.858910:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201509.858949:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201509.858977:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201509.858995:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201509.859040:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201509.859066:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695556736 00000100:00100000:1.0:1788201509.859074:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695556736 00000100:00100000:3.0:1788201509.859080:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695556480 00000100:00100000:3.0:1788201509.859084:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695556480 00000100:00100000:1.0:1788201509.859134:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695556608 00000100:00100000:1.0:1788201509.859138:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695556608 00000100:00100000:1.0:1788201509.859170:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1837 00000100:00100000:1.0:1788201509.859179:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12ee2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695556736:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201509.859228:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 129 00000100:00100000:3.0:1788201509.859236:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695556480:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201509.859247:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12ee2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695556736:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 70us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201509.859254:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1837 00000100:00100000:3.0:1788201509.859259:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695556480:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201509.859264:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 129 00000100:00100000:1.0:1788201509.859272:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1838 00000100:00100000:1.0:1788201509.859278:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12580a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2403:x1875060695556608:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201509.859290:0:101189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695556992 00000100:00100000:3.0:1788201509.859293:0:101189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695556992 00000100:00100000:1.0:1788201509.859299:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12580a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2403:x1875060695556608:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 22us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201509.859305:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1838 00000100:00100000:3.0:1788201509.859319:0:101189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695556864 00000100:00080000:1.0:1788201509.859320:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201509.859322:0:101189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695556864 00000100:00080000:1.0:1788201509.859323:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201509.859325:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201509.859334:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201509.859341:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 107 00000100:00100000:3.0:1788201509.859347:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695556992:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201509.859370:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695556992:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 24us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201509.859376:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 107 00000100:00100000:3.0:1788201509.859387:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 108 00000100:00100000:3.0:1788201509.859397:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695556864:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201509.859418:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695556864:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 22us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201509.859424:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 108 00010000:00010000:2.0:1788201510.036486:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201510.740454:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201510.740477:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715434496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201510.740549:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201510.740599:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715434496 00000100:00100000:3.0:1788201510.740606:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715434496 00000100:00100000:3.0:1788201510.740659:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788201510.740668:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715434496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201510.740699:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788201510.740739:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715434496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201510.740746:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:3.0:1788201510.740767:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201510.740813:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715434496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201510.742845:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715434624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201510.742930:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201510.743075:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715434624 00000100:00100000:2.0:1788201510.743082:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715434624 00000100:00100000:2.0:1788201510.743139:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788201510.743150:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12fb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715434624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201510.743172:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201510.743229:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12fb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715434624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201510.743236:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:0.0:1788201510.743351:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201510.743383:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715434624:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788201511.055937:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201512.080374:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201513.107274:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201513.300310:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715434752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201513.300410:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201513.300462:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201513.300469:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715434880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201513.300495:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201513.300529:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715434752 00000100:00100000:1.0:1788201513.300538:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715434752 00000100:00100000:1.0:1788201513.300594:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715434880 00000100:00100000:1.0:1788201513.300597:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715434880 00000100:00100000:1.0:1788201513.300618:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788201513.300628:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc133369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715434752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201513.300674:0:101344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444970496 avail 1298731008 00000100:00100000:1.0:1788201513.300731:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc133369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715434752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201513.300740:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788201513.300761:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788201513.300766:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f6b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715434880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201513.300784:0:101344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445404672 avail 1299165184 00000100:00100000:1.0:1788201513.300810:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f6b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715434880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 44us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201513.300816:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788201513.300864:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715434880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201513.300876:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715434752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201513.301822:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715435136:0@lo:400:kworker.0 00000100:00100000:1.0:1788201513.301886:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201513.301915:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715435648:0@lo:400:kworker.0 00000100:00100000:1.0:1788201513.301943:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201513.301969:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715436160:0@lo:400:kworker.0 00000100:00100000:1.0:1788201513.301991:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201513.302174:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788201513.302181:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715435008:0@lo:400:kworker.0 00000100:00100000:1.0:1788201513.302211:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201513.302240:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715435520:0@lo:400:kworker.0 00000100:00100000:1.0:1788201513.302265:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201513.302280:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715436032:0@lo:400:kworker.0 00000100:00100000:1.0:1788201513.302299:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201513.302327:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715435392:0@lo:400:kworker.0 00000100:00100000:1.0:1788201513.302354:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201513.302373:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715435904:0@lo:400:kworker.0 00000100:00100000:1.0:1788201513.302516:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201513.302577:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788201513.302583:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715435264:0@lo:400:kworker.0 00000100:00100000:1.0:1788201513.302611:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201513.302702:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715435648 00000100:00100000:0.0:1788201513.302711:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715435648 00000100:00100000:0.0:1788201513.302772:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715436160 00000100:00100000:0.0:1788201513.302776:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715436160 00000100:00100000:0.0:1788201513.302798:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715436032 00000100:00100000:0.0:1788201513.302802:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715436032 00000100:00100000:0.0:1788201513.302828:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788201513.302837:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715435648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201513.302900:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715435648:12345-0@lo:400:kworker.0 Request processed in 65us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201513.302908:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788201513.302926:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788201513.302931:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a443800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715436160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201513.302956:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a443800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715436160:12345-0@lo:400:kworker.0 Request processed in 25us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201513.302961:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788201513.302972:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788201513.302978:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715436032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201513.303038:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715436032:12345-0@lo:400:kworker.0 Request processed in 60us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201513.303044:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1788201513.303125:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201513.303130:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201513.306685:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715435776:0@lo:400:kworker.0 00000100:00100000:1.0:1788201513.306774:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201513.307156:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715436288:0@lo:400:kworker.0 00000100:00100000:1.0:1788201513.307194:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201513.307234:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715435136 00000100:00100000:3.0:1788201513.307246:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715435136 00000100:00100000:3.0:1788201513.307321:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715435520 00000100:00100000:3.0:1788201513.307326:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715435520 00000100:00100000:3.0:1788201513.307343:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715435392 00000100:00100000:3.0:1788201513.307346:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715435392 00000100:00100000:3.0:1788201513.307361:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715435904 00000100:00100000:3.0:1788201513.307364:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715435904 00000100:00100000:3.0:1788201513.307375:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715435264 00000100:00100000:3.0:1788201513.307378:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715435264 00000100:00100000:3.0:1788201513.307430:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1839 00000100:00100000:3.0:1788201513.307441:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715435136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201513.307512:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715435136:12345-0@lo:400:kworker.0 Request processed in 73us (5625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201513.307520:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1839 00000100:00100000:3.0:1788201513.307539:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1840 00000100:00100000:3.0:1788201513.307546:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715435520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201513.307577:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715435520:12345-0@lo:400:kworker.0 Request processed in 32us (5311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201513.307583:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1840 00000100:00100000:3.0:1788201513.307592:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1841 00000100:00100000:3.0:1788201513.307598:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715435392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201513.307628:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715435392:12345-0@lo:400:kworker.0 Request processed in 30us (5274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201513.307634:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1841 00000100:00100000:3.0:1788201513.307644:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1842 00000100:00100000:3.0:1788201513.307650:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1333bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715435904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201513.307678:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1333bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715435904:12345-0@lo:400:kworker.0 Request processed in 29us (5163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201513.307684:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1842 00000100:00100000:3.0:1788201513.307694:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1843 00000100:00100000:3.0:1788201513.307702:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715435264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201513.307729:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715435264:12345-0@lo:400:kworker.0 Request processed in 28us (5117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201513.307735:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1843 00000100:00100000:3.0:1788201513.307769:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715435776 00000100:00100000:3.0:1788201513.307774:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715435776 00000100:00100000:3.0:1788201513.307822:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788201513.307828:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715435776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201513.307866:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715435776:12345-0@lo:400:kworker.0 Request processed in 37us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201513.307872:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1788201513.307894:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201513.307899:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201513.307901:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201513.308144:0:102453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715435008 00000100:00100000:0.0:1788201513.308158:0:102453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715435008 00000100:00100000:0.0:1788201513.308204:0:102453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788201513.308212:0:102453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715435008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201513.308256:0:102453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715435008:12345-0@lo:400:kworker.0 Request processed in 46us (6043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201513.308263:0:102453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788201513.309328:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715435008:0@lo:400:kworker.0 00000100:00100000:0.0:1788201513.309351:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715435520:0@lo:400:kworker.0 00000100:00100000:0.0:1788201513.309366:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901911 gen 2 00000100:00100000:0.0:1788201513.309467:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715436032:0@lo:400:kworker.0 00000100:00100000:0.0:1788201513.309489:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715435136:0@lo:400:kworker.0 00000100:00100000:0.0:1788201513.309504:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715435648:0@lo:400:kworker.0 00000100:00100000:0.0:1788201513.309523:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788201513.309535:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715436160:0@lo:400:kworker.0 00000100:00100000:1.0:1788201513.310450:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715435392:0@lo:400:kworker.0 00000100:00100000:1.0:1788201513.310485:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715435904:0@lo:400:kworker.0 00000100:00100000:1.0:1788201513.310513:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715435264:0@lo:400:kworker.0 00000100:00100000:1.0:1788201513.310527:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715435776:0@lo:400:kworker.0 00000100:00100000:3.0:1788201513.310656:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715436288 00000100:00100000:3.0:1788201513.310664:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715436288 00000100:00100000:3.0:1788201513.310758:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1844 00000100:00100000:3.0:1788201513.310770:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715436288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201513.310877:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715436288:12345-0@lo:400:kworker.0 Request processed in 109us (3681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201513.310884:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1844 00000100:00100000:1.0:1788201513.310943:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715436288:0@lo:400:kworker.0 00000001:02000400:1.0:1788201513.563586:0:104950:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 00000100:00100000:0.0:1788201513.808627:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201513.808661:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715436416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201513.808758:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201513.809101:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201513.809113:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1060cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715436544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201513.809145:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201513.809269:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715436416 00000100:00100000:2.0:1788201513.809281:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715436416 00000100:00100000:2.0:1788201513.809337:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715436544 00000100:00100000:2.0:1788201513.809340:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715436544 00000100:00100000:2.0:1788201513.809379:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788201513.809389:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715436416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201513.809425:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201513.809551:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715436416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 163us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201513.809560:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788201513.809581:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788201513.809588:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715436544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201513.809606:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201513.809645:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715436544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201513.809651:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788201513.809704:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1060cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715436544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201513.812713:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715436416:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788201514.128410:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201514.965144:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201514.965195:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201514.965313:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695557248 00000100:00100000:0.0:1788201514.965324:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695557248 00000100:00100000:0.0:1788201514.965414:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1845 00000100:00100000:0.0:1788201514.965426:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00388f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2402:x1875060695557248:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201514.965519:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00388f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2402:x1875060695557248:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 96us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201514.965527:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1845 00000100:00080000:1.0:1788201514.965597:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201514.966007:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695557120 00000100:00100000:3.0:1788201514.966013:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695557120 00000100:00100000:3.0:1788201514.966102:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 131 00000100:00100000:3.0:1788201514.966110:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695557120:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201514.966154:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695557120:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 45us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201514.966161:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 131 00000100:00100000:1.0:1788201514.966970:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201514.967004:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201514.967071:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201514.967138:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695557504 00000100:00100000:0.0:1788201514.967145:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695557504 00000100:00100000:0.0:1788201514.967193:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695557632 00000100:00100000:0.0:1788201514.967196:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695557632 00000100:00100000:0.0:1788201514.967220:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 113 00000100:00100000:0.0:1788201514.967228:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695557504:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201514.967271:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695557504:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 44us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201514.967277:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 113 00000100:00100000:0.0:1788201514.967303:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 114 00000100:00100000:0.0:1788201514.967311:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695557632:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201514.967336:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695557632:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201514.967342:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 114 00000100:00080000:1.0:1788201514.967678:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201514.967682:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201514.967731:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695557376 00000100:00100000:3.0:1788201514.967736:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695557376 00000100:00100000:3.0:1788201514.967787:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1846 00000100:00100000:3.0:1788201514.967795:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695557376:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201514.967852:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695557376:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 58us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201514.967859:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1846 00000100:00080000:1.0:1788201514.968009:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788201515.151381:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201515.156730:0:104999:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:1.0:1788201515.856487:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201515.856513:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715436672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201515.856518:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201515.856531:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715436800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201515.858728:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201515.858850:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715436672 00000100:00100000:3.0:1788201515.858860:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715436672 00000100:00100000:3.0:1788201515.858941:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788201515.858952:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715436672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201515.858982:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1788201515.859084:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201515.861856:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201515.861960:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715436800 00000100:00100000:0.0:1788201515.861969:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715436800 00000100:00100000:0.0:1788201515.862082:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788201515.862093:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715436800:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788201515.862104:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788201515.862124:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201515.862206:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715436800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201515.862231:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788201515.862257:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715436800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201515.864401:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715436672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5445us (5672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201515.864415:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788201515.864558:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13ab55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715436672:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788201516.179484:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201517.139634:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201517.139821:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695557760 00000100:00100000:3.0:1788201517.139831:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695557760 00000100:00100000:3.0:1788201517.139909:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1805 00000100:00100000:3.0:1788201517.139921:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:78661:x1875060695557760:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:3.0:1788201517.139959:0:66314:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444970496 avail 1298731008 00000100:00080000:1.0:1788201517.140165:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201517.140239:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:78661:x1875060695557760:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 319us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201517.140247:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1805 00000100:00100000:2.0:1788201517.145429:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201517.145556:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695557888 00000100:00100000:0.0:1788201517.145566:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695557888 00000100:00100000:0.0:1788201517.145654:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1806 00000100:00100000:0.0:1788201517.145666:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:78661:x1875060695557888:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:0.0:1788201517.145706:0:66312:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445404672 avail 1299165184 00000100:00100000:0.0:1788201517.145784:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:78661:x1875060695557888:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 120us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201517.145792:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1806 00000100:00080000:1.0:1788201517.145929:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201517.161601:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201517.163365:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695558016 00000100:00100000:0.0:1788201517.163378:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695558016 00000100:00100000:0.0:1788201517.163462:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 106 00000100:00100000:0.0:1788201517.163472:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:78661:x1875060695558016:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:0.0:1788201517.163500:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201517.163572:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:78661:x1875060695558016:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 102us (1994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201517.163579:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 106 00000100:00080000:1.0:1788201517.163673:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201517.167549:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201517.167655:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695558144 00000100:00100000:3.0:1788201517.167680:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695558144 00000100:00100000:3.0:1788201517.167766:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 107 00000100:00100000:3.0:1788201517.167780:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:78661:x1875060695558144:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:3.0:1788201517.167827:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788201517.167939:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:78661:x1875060695558144:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 162us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201517.167948:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 107 00000100:00080000:1.0:1788201517.167964:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788201517.199247:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201517.257532:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201517.257610:0:9535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695558272 00000100:00100000:0.0:1788201517.257626:0:9535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695558272 00000100:00100000:0.0:1788201517.257785:0:9535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 759 00000100:00100000:0.0:1788201517.257797:0:9535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10a226050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:71017:x1875060695558272:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201517.257814:0:9535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788201517.257840:0:9535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1e6b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786eb5 expref: 9 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.257888:0:9535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008723a00) 00010000:00010000:0.0:1788201517.257907:0:9535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1e732 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x33:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786edf expref: 8 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.257918:0:9535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x33:0x0].0x0 (ffff8dc1421c6800) 00010000:00010000:0.0:1788201517.257929:0:9535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1e5f7 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786e8b expref: 7 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.257938:0:9535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0x0 (ffff8dc103a9b800) 00010000:00010000:0.0:1788201517.257944:0:9535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201517.258084:0:9535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10a226050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:71017:x1875060695558272:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 223us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201517.258092:0:9535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 759 00000100:00100000:2.0:1788201517.332129:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201517.332251:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695558400 00000100:00100000:0.0:1788201517.332264:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695558400 00000100:00100000:0.0:1788201517.332588:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1807 00000100:00100000:0.0:1788201517.332602:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1060cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:78689:x1875060695558400:12345-192.168.201.20@tcp:101:checkstat.0 00010000:00010000:0.0:1788201517.332631:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201517.332662:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ea5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ef4 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.332755:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1ea65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.332774:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1ea65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.332823:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1ea65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201517.332897:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201517.332902:0:66313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201517.332929:0:66313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1ea65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.332961:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ea5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ef4 expref: 8 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.332981:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1ea65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ef4 expref: 7 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.332992:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a9b800) 00010000:00010000:0.0:1788201517.332996:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201517.332999:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d7400, rc 0) 00000100:00100000:0.0:1788201517.333146:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1060cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:78689:x1875060695558400:12345-192.168.201.20@tcp:101:checkstat.0 Request processed in 546us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201517.333154:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1807 00000100:00100000:2.0:1788201517.338149:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201517.341904:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695558528 00000100:00100000:1.0:1788201517.341927:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695558528 00000100:00100000:3.0:1788201517.342929:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1808 00000100:00100000:3.0:1788201517.342950:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:78689:x1875060695558528:12345-192.168.201.20@tcp:101:checkstat.0 00010000:00010000:3.0:1788201517.342982:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201517.343012:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2800/0x96d0c9b8c9a1ea6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786efb expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343129:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1ea73 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343148:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1ea73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343163:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1ea73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343181:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1ea7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343189:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1ea7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343195:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1ea7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343281:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1ea81 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343307:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1ea81 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343314:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1ea81 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201517.343544:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1ea81 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343561:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1ea73 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343569:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1ea73 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343576:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1ea73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343582:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1ea73 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343588:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2e00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201517.343593:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1ea73 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343601:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1ea73 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343616:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a9b800) 00010000:00010000:3.0:1788201517.343619:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201517.343624:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1ea73 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343637:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1ea73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343654:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1ea7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343660:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1ea7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343666:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1ea7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343672:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201517.343675:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1ea7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343681:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1ea7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343689:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb56adc53 (ffff8dc008611400) 00010000:00010000:3.0:1788201517.343691:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201517.343694:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1ea7a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343700:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1ea7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343738:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2800/0x96d0c9b8c9a1ea6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786efb expref: 9 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343764:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1ea81 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786efb expref: 8 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.343771:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0x0 (ffff8dc008611900) 00010000:00010000:3.0:1788201517.343773:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201517.343775:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3800, rc 0) 00000100:00100000:3.0:1788201517.343914:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:78689:x1875060695558528:12345-192.168.201.20@tcp:101:checkstat.0 Request processed in 970us (5780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201517.343923:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1808 00000100:00100000:3.0:1788201517.354287:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201517.354503:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695558656 00000100:00100000:0.0:1788201517.354519:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695558656 00000100:00100000:0.0:1788201517.354603:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1809 00000100:00100000:0.0:1788201517.354616:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:78689:x1875060695558656:12345-192.168.201.20@tcp:101:checkstat.0 00010000:00010000:0.0:1788201517.354647:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201517.354676:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ea88 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786f02 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.354930:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6400/0x96d0c9b8c9a1ea8f lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.354948:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6400/0x96d0c9b8c9a1ea8f lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.354963:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6400/0x96d0c9b8c9a1ea8f lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201517.355001:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x9:0x0]: returning size 4096 00000004:00200000:0.0:1788201517.355005:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1788201517.355126:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ea88 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f02 expref: 9 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.355146:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6400/0x96d0c9b8c9a1ea8f lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f02 expref: 8 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.355157:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0x0 (ffff8dc103a9bf00) 00010000:00010000:0.0:1788201517.355160:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1788201517.355164:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d6400, rc 0) 00000100:00100000:0.0:1788201517.355548:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:78689:x1875060695558656:12345-192.168.201.20@tcp:101:checkstat.0 Request processed in 932us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201517.355558:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1809 00000100:00100000:2.0:1788201517.377732:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201517.377925:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695558784 00000100:00100000:0.0:1788201517.377940:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695558784 00000100:00100000:0.0:1788201517.378059:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1810 00000100:00100000:0.0:1788201517.378071:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0058a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:78689:x1875060695558784:12345-192.168.201.20@tcp:101:checkstat.0 00010000:00010000:0.0:1788201517.378122:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201517.378150:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ea96 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786f09 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.378256:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ea9d lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.378274:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ea9d lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.378287:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ea9d lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.378305:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1eaa4 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.378311:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1eaa4 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.378318:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1eaa4 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.378551:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1eaab lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.378561:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1eaab lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.378569:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1eaab lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201517.378659:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788201517.378673:0:66313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1788201517.378704:0:66313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1eaab lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.378720:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ea9d lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.378727:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ea9d lrc: 4/1,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.378734:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ea9d lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.378739:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ea9d lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.378745:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201517.378750:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ea9d lrc: 4/0,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.378758:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ea9d lrc: 5/0,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.378773:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0x0 (ffff8dc103a9bf00) 00010000:00010000:0.0:1788201517.378991:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201517.379000:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ea9d lrc: 3/0,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.379009:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ea9d lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.379069:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1eaa4 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.379088:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1eaa4 lrc: 2/0,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.379093:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1eaa4 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.379098:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201517.379101:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1eaa4 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.379107:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1eaa4 lrc: 4/0,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.379116:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0xd1d4b922 (ffff8dc103a9bd00) 00010000:00010000:0.0:1788201517.379119:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201517.379121:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1eaa4 lrc: 2/0,0 mode: --/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.379127:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1eaa4 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.379172:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ea96 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f09 expref: 10 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.379186:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1eaab lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0xa:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f09 expref: 9 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.379193:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xa:0x0].0x0 (ffff8dc103a9b400) 00010000:00010000:0.0:1788201517.379195:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201517.379203:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d6c00, rc 0) 00000100:00100000:0.0:1788201517.379297:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0058a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:78689:x1875060695558784:12345-192.168.201.20@tcp:101:checkstat.0 Request processed in 1228us (1580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201517.379307:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1810 00000100:00100000:2.0:1788201517.391067:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201517.392537:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695558912 00000100:00100000:3.0:1788201517.392555:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695558912 00000100:00100000:3.0:1788201517.392759:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1811 00000100:00100000:3.0:1788201517.392771:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:78689:x1875060695558912:12345-192.168.201.20@tcp:101:checkstat.0 00010000:00010000:3.0:1788201517.392799:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201517.392829:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2800/0x96d0c9b8c9a1eab2 lrc: 2/0,0 mode: --/CR res: [0x2000090a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786f10 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.392960:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1eab9 lrc: 3/1,0 mode: --/CR res: [0x2000090a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.392976:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1eab9 lrc: 3/1,0 mode: CR/CR res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.392989:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1eab9 lrc: 3/1,0 mode: CR/CR res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.393053:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1eac0 lrc: 3/1,0 mode: --/PR res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.393063:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1eac0 lrc: 3/1,0 mode: PR/PR res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.393070:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1eac0 lrc: 3/1,0 mode: PR/PR res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.393190:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1eac7 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.393198:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1eac7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x33:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.393204:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1eac7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x33:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201517.393255:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x33:0x0]: returning size 4096 00000004:00200000:3.0:1788201517.393259:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201517.393281:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1eac7 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x33:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.393295:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1eab9 lrc: 4/1,0 mode: CR/CR res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.393301:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1eab9 lrc: 4/1,0 mode: CR/CR res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.393307:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1eab9 lrc: 3/0,0 mode: CR/CR res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.393386:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1eab9 lrc: 4/0,0 mode: CR/CR res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.393393:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201517.393398:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1eab9 lrc: 4/0,0 mode: CR/CR res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.393407:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1eab9 lrc: 5/0,0 mode: CR/CR res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.393420:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x7:0x0].0x0 (ffff8dc008611400) 00010000:00010000:3.0:1788201517.393423:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201517.393428:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1eab9 lrc: 3/0,0 mode: --/CR res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.393440:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1eab9 lrc: 0/0,0 mode: --/CR res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.393454:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1eac0 lrc: 3/1,0 mode: PR/PR res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.393460:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1eac0 lrc: 2/0,0 mode: PR/PR res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.393466:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1eac0 lrc: 3/0,0 mode: PR/PR res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.393469:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2e00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201517.393472:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1eac0 lrc: 3/0,0 mode: PR/PR res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.393487:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1eac0 lrc: 4/0,0 mode: PR/PR res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.393495:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x7:0x0].0xcd52553e (ffff8dc008611700) 00010000:00010000:3.0:1788201517.393497:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201517.393500:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1eac0 lrc: 2/0,0 mode: --/PR res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.393506:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1eac0 lrc: 0/0,0 mode: --/PR res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.393538:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2800/0x96d0c9b8c9a1eab2 lrc: 0/0,0 mode: --/CR res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f10 expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.393554:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1eac7 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x33:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f10 expref: 9 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.393561:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x33:0x0].0x0 (ffff8dc008611800) 00010000:00010000:3.0:1788201517.393564:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201517.393566:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2000, rc 0) 00000100:00100000:3.0:1788201517.393651:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:78689:x1875060695558912:12345-192.168.201.20@tcp:101:checkstat.0 Request processed in 882us (2646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201517.393660:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1811 00000100:00100000:3.0:1788201517.417190:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201517.417534:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695559168 00000100:00100000:0.0:1788201517.417552:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695559168 00000100:00100000:0.0:1788201517.417699:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1812 00000100:00100000:0.0:1788201517.417712:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:78693:x1875060695559168:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788201517.417743:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201517.417778:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1eace lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786f17 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201517.417933:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x33:0x0]: returning size 4096 00010000:00010000:0.0:1788201517.418141:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1eace lrc: 1/0,0 mode: --/CR res: [0x20000d6f1:0x33:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f17 expref: 11 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.418161:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x33:0x0].0x0 (ffff8dc008611800) 00010000:00010000:0.0:1788201517.418165:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201517.418170:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1eace lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x33:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f17 expref: 11 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.418185:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d7800, rc 0) 00000100:00100000:0.0:1788201517.418331:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:78693:x1875060695559168:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 621us (1157us total) trans 128849018904 rc 301/301 00000100:00100000:0.0:1788201517.418339:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1812 00000100:00100000:3.0:1788201517.420706:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201517.420779:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695559296 00000100:00100000:1.0:1788201517.420793:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695559296 00000100:00100000:1.0:1788201517.420863:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 308 00000100:00100000:1.0:1788201517.420877:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13c3d3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:78693:x1875060695559296:12345-192.168.201.20@tcp:33:lfs.0 00000004:00200000:1.0:1788201517.421002:0:66316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x33:0x0]: returning size 4096 00000004:00200000:1.0:1788201517.421007:0:66316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1788201517.421115:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13c3d3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:78693:x1875060695559296:12345-192.168.201.20@tcp:33:lfs.0 Request processed in 241us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201517.421122:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 308 00000100:00100000:2.0:1788201517.424191:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201517.424300:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695559552 00000100:00100000:0.0:1788201517.424314:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695559552 00000100:00100000:0.0:1788201517.424401:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 309 00000100:00100000:0.0:1788201517.424418:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:78693:x1875060695559552:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:0.0:1788201517.424874:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:78693:x1875060695559552:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 455us (694us total) trans 128849018905 rc 0/0 00000100:00100000:0.0:1788201517.424883:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 309 00000100:00100000:3.0:1788201517.438206:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201517.440422:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695559808 00000100:00100000:0.0:1788201517.440442:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695559808 00000100:00100000:1.0:1788201517.440875:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1813 00000100:00100000:1.0:1788201517.440890:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:78694:x1875060695559808:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1788201517.440921:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201517.440946:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1eadc lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786f1e expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.441719:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1eae3 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.441740:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1eae3 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x33:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.441753:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1eae3 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x33:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201517.441768:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x33:0x0]: returning size 4096 00010000:00010000:1.0:1788201517.441956:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1eadc lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x33:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f1e expref: 14 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.441979:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1eae3 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x33:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f1e expref: 13 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.441989:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x33:0x0].0x0 (ffff8dc008611800) 00010000:00010000:1.0:1788201517.441993:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788201517.441997:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e3600, rc 0) 00000100:00100000:1.0:1788201517.442153:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:78694:x1875060695559808:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 1266us (3963us total) trans 128849018906 rc 0/0 00000100:00100000:1.0:1788201517.443503:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1813 00000100:00100000:3.0:1788201517.444393:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201517.444492:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695559936 00000100:00100000:0.0:1788201517.444505:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695559936 00000100:00100000:0.0:1788201517.444568:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 310 00000100:00100000:0.0:1788201517.444581:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:78694:x1875060695559936:12345-192.168.201.20@tcp:33:lfs.0 00000004:00200000:0.0:1788201517.444710:0:79137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x33:0x0]: returning size 4096 00000004:00200000:0.0:1788201517.444715:0:79137:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1788201517.444814:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:78694:x1875060695559936:12345-192.168.201.20@tcp:33:lfs.0 Request processed in 235us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201517.444822:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 310 00000100:00100000:3.0:1788201517.460179:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201517.460363:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695560064 00000100:00100000:2.0:1788201517.460379:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695560064 00000100:00100000:2.0:1788201517.460457:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1814 00000100:00100000:2.0:1788201517.460472:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:78695:x1875060695560064:12345-192.168.201.20@tcp:101:checkstat.0 00010000:00010000:2.0:1788201517.460501:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201517.460536:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1eaf1 lrc: 2/0,0 mode: --/CR res: [0x2400088d0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786f25 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.460625:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1eaf8 lrc: 3/1,0 mode: --/CR res: [0x2400088d0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.460647:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1eaf8 lrc: 3/1,0 mode: CR/CR res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.460662:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1eaf8 lrc: 3/1,0 mode: CR/CR res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.460677:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1eaff lrc: 3/1,0 mode: --/PR res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.460684:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1eaff lrc: 3/1,0 mode: PR/PR res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.460691:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1eaff lrc: 3/1,0 mode: PR/PR res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.460798:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1eb06 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.460806:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1eb06 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.460825:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1eb06 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201517.460881:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xb:0x0]: returning size 4096 00000004:00200000:2.0:1788201517.460885:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201517.460912:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1eb06 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.460928:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1eaf8 lrc: 4/1,0 mode: CR/CR res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.460935:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1eaf8 lrc: 4/1,0 mode: CR/CR res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.460942:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1eaf8 lrc: 3/0,0 mode: CR/CR res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.460949:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1eaf8 lrc: 4/0,0 mode: CR/CR res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.460956:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201517.460962:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1eaf8 lrc: 4/0,0 mode: CR/CR res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.460970:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1eaf8 lrc: 5/0,0 mode: CR/CR res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.460983:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x7:0x0].0x0 (ffff8dc11248cb00) 00010000:00010000:2.0:1788201517.460986:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201517.460991:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1eaf8 lrc: 3/0,0 mode: --/CR res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.461008:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1eaf8 lrc: 0/0,0 mode: --/CR res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.461061:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1eaff lrc: 3/1,0 mode: PR/PR res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.461068:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1eaff lrc: 2/0,0 mode: PR/PR res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.461073:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1eaff lrc: 3/0,0 mode: PR/PR res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.461078:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201517.461081:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1eaff lrc: 3/0,0 mode: PR/PR res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.461087:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1eaff lrc: 4/0,0 mode: PR/PR res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.461095:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x7:0x0].0xf0209d98 (ffff8dc11248c300) 00010000:00010000:2.0:1788201517.461097:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201517.461101:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1eaff lrc: 2/0,0 mode: --/PR res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.461106:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1eaff lrc: 0/0,0 mode: --/PR res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.461142:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1eaf1 lrc: 0/0,0 mode: --/CR res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f25 expref: 11 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.461173:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1eb06 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f25 expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.461182:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xb:0x0].0x0 (ffff8dc0084fb800) 00010000:00010000:2.0:1788201517.461184:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201517.461187:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbca00, rc 0) 00000100:00100000:2.0:1788201517.461278:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:78695:x1875060695560064:12345-192.168.201.20@tcp:101:checkstat.0 Request processed in 810us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201517.461286:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1814 00000100:00100000:3.0:1788201517.488721:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201517.488858:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695560320 00000100:00100000:0.0:1788201517.488873:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695560320 00000100:00100000:0.0:1788201517.488954:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1815 00000100:00100000:0.0:1788201517.488968:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:78696:x1875060695560320:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788201517.489006:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201517.489087:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1eb0d lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786f2c expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201517.489252:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xb:0x0]: returning size 4096 00010000:00010000:0.0:1788201517.489411:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1eb0d lrc: 1/0,0 mode: --/CR res: [0x2400088d5:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f2c expref: 12 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.489453:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xb:0x0].0x0 (ffff8dc0084fb800) 00010000:00010000:0.0:1788201517.489456:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201517.489464:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1eb0d lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f2c expref: 12 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.489480:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d7800, rc 0) 00000100:00100000:0.0:1788201517.489570:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:78696:x1875060695560320:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 605us (865us total) trans 81604378625 rc 301/301 00000100:00100000:0.0:1788201517.489578:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1815 00000100:00100000:3.0:1788201517.492885:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201517.493167:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695560448 00000100:00100000:1.0:1788201517.493181:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695560448 00000100:00100000:1.0:1788201517.493266:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 311 00000100:00100000:1.0:1788201517.493278:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:78696:x1875060695560448:12345-192.168.201.20@tcp:33:lfs.0 00000004:00200000:1.0:1788201517.493403:0:66316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xb:0x0]: returning size 4096 00000004:00200000:1.0:1788201517.493408:0:66316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1788201517.493504:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:78696:x1875060695560448:12345-192.168.201.20@tcp:33:lfs.0 Request processed in 228us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201517.493513:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 311 00000100:00100000:3.0:1788201517.505949:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201517.511928:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695560704 00000100:00100000:0.0:1788201517.511951:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695560704 00000100:00100000:0.0:1788201517.512129:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 312 00000100:00100000:0.0:1788201517.512143:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:78696:x1875060695560704:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:0.0:1788201517.512480:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:78696:x1875060695560704:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 338us (6546us total) trans 81604378626 rc 0/0 00000100:00100000:0.0:1788201517.512489:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 312 00000100:00100000:3.0:1788201517.545079:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201517.545267:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695560960 00000100:00100000:1.0:1788201517.545282:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695560960 00000100:00100000:1.0:1788201517.545362:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1816 00000100:00100000:1.0:1788201517.545374:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:78697:x1875060695560960:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1788201517.545407:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201517.545436:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1eb1b lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786f33 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.545591:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1eb22 lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.545772:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1eb22 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.545791:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1eb22 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201517.545870:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xb:0x0]: returning size 4096 00010000:00010000:1.0:1788201517.546104:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1eb1b lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f33 expref: 15 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.546125:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1eb22 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f33 expref: 14 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.546135:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xb:0x0].0x0 (ffff8dc0084fb800) 00010000:00010000:1.0:1788201517.546138:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788201517.546143:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e2600, rc 0) 00000100:00100000:1.0:1788201517.546271:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:78697:x1875060695560960:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 898us (1207us total) trans 81604378627 rc 0/0 00000100:00100000:1.0:1788201517.546281:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1816 00000100:00100000:3.0:1788201517.560161:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201517.560345:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695561088 00000100:00100000:2.0:1788201517.560359:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695561088 00000100:00100000:2.0:1788201517.560437:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 313 00000100:00100000:2.0:1788201517.560451:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13c3d2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:78697:x1875060695561088:12345-192.168.201.20@tcp:33:lfs.0 00000004:00200000:2.0:1788201517.560577:0:66315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xb:0x0]: returning size 4096 00000004:00200000:2.0:1788201517.560582:0:66315:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1788201517.560701:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13c3d2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:78697:x1875060695561088:12345-192.168.201.20@tcp:33:lfs.0 Request processed in 253us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201517.560710:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 313 00000100:00100000:3.0:1788201517.581454:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201517.588937:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695561216 00000100:00100000:2.0:1788201517.588958:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695561216 00000100:00100000:2.0:1788201517.589121:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1817 00000100:00100000:2.0:1788201517.589137:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:78698:x1875060695561216:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:2.0:1788201517.589164:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201517.589197:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1eb30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786f3a expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201517.589324:0:66757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID:66757:1875060715436928:0@lo:900:mdt00_003.0 00000100:00100000:2.0:1788201517.589401:0:66757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201517.589483:0:66757:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a875e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201517.590803:0:66323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715436928 00000100:00100000:3.0:1788201517.590829:0:66323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715436928 00000100:00100000:3.0:1788201517.590894:0:66323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788201517.590905:0:66323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:66757:x1875060715436928:12345-0@lo:900:mdt00_003.0 00000100:00100000:3.0:1788201517.591063:0:66323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:66757:x1875060715436928:12345-0@lo:900:mdt00_003.0 Request processed in 160us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201517.591072:0:66323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201517.591271:0:66757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID:66757:1875060715436928:0@lo:900:mdt00_003.0 00000100:00100000:1.0:1788201517.591370:0:66757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66757:1875060715437056:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788201517.591421:0:66757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201517.591460:0:66757:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0074869c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201517.592888:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715437056 00000100:00100000:3.0:1788201517.592904:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715437056 00000100:00100000:3.0:1788201517.592981:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788201517.592992:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:66757:x1875060715437056:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788201517.593175:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:66757:x1875060715437056:12345-0@lo:1000:mdt00_003.0 Request processed in 184us (1752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201517.593184:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788201517.593373:0:66757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66757:1875060715437056:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788201517.593496:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1eb37 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.593518:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1eb37 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.593532:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1eb37 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201517.593595:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x9:0x0]: returning size 4096 00000004:00200000:2.0:1788201517.593599:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201517.593663:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1eb37 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.593707:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1eb30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f3a expref: 16 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.593735:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1eb37 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f3a expref: 15 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.593747:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0x0 (ffff8dc103a9bf00) 00010000:00010000:2.0:1788201517.593751:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788201517.593755:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbd800, rc 0) 00000100:00100000:2.0:1788201517.593834:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:78698:x1875060695561216:12345-192.168.201.20@tcp:101:rm.0 Request processed in 4702us (12398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201517.593859:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1817 00000100:00100000:3.0:1788201517.598751:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201517.612460:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695561472 00000100:00100000:0.0:1788201517.612483:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695561472 00000100:00100000:0.0:1788201517.612582:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1818 00000100:00100000:0.0:1788201517.612596:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:78698:x1875060695561472:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1788201517.612626:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201517.612659:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1eb3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786f41 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201517.612801:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x9:0x0]: returning size 4096 00010000:00010000:0.0:1788201517.612963:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1eb3e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f41 expref: 17 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.612982:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a9b500) 00010000:00010000:0.0:1788201517.612986:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201517.612992:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1eb3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f41 expref: 17 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.613048:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d7800, rc 0) 00000100:00100000:0.0:1788201517.613136:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:78698:x1875060695561472:12345-192.168.201.20@tcp:101:rm.0 Request processed in 544us (14400us total) trans 81604378628 rc 301/301 00000100:00100000:0.0:1788201517.613145:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1818 00000100:00100000:3.0:1788201517.617494:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201517.617598:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695561600 00000100:00100000:0.0:1788201517.617612:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695561600 00000100:00100000:0.0:1788201517.617686:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 314 00000100:00100000:0.0:1788201517.617698:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:78698:x1875060695561600:12345-192.168.201.20@tcp:37:rm.0 00000100:00100000:2.0:1788201517.626871:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:78698:x1875060695561600:12345-192.168.201.20@tcp:37:rm.0 Request processed in 9157us (9374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201517.626891:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 314 00000100:00100000:3.0:1788201517.635933:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201517.636168:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695561856 00000100:00100000:1.0:1788201517.636183:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695561856 00000100:00100000:1.0:1788201517.636261:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 315 00000100:00100000:1.0:1788201517.636275:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:78698:x1875060695561856:12345-192.168.201.20@tcp:35:rm.0 00000100:00100000:1.0:1788201517.636594:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+17:78698:x1875060695561856:12345-192.168.201.20@tcp:35:rm.0 Request processed in 321us (676us total) trans 81604378629 rc 0/0 00000100:00100000:1.0:1788201517.636602:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 315 00000100:00100000:3.0:1788201517.639939:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201517.640388:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695562112 00000100:00100000:1.0:1788201517.640403:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695562112 00000100:00100000:1.0:1788201517.640488:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1819 00000100:00100000:1.0:1788201517.640500:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10785aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+17:78698:x1875060695562112:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:1.0:1788201517.640534:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201517.640566:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1eb4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786f48 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.640706:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1eb53 lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.640724:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1eb53 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.640737:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1eb53 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201517.640750:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x9:0x0]: returning size 4096 00010000:00010000:1.0:1788201517.640879:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1eb4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f48 expref: 20 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.640907:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1eb53 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f48 expref: 19 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.640933:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0x0 (ffff8dc103a9bf00) 00010000:00010000:1.0:1788201517.640937:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788201517.640941:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e2400, rc 0) 00000100:00100000:1.0:1788201517.641103:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10785aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+19:78698:x1875060695562112:12345-192.168.201.20@tcp:101:rm.0 Request processed in 603us (1178us total) trans 81604378630 rc 0/0 00000100:00100000:1.0:1788201517.641110:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1819 00000100:00100000:0.0:1788201517.654741:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201517.654917:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695562240 00000100:00100000:3.0:1788201517.654930:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695562240 00000100:00100000:3.0:1788201517.655195:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1820 00000100:00100000:3.0:1788201517.655307:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+19:78698:x1875060695562240:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:3.0:1788201517.655429:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201517.655461:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2800/0x96d0c9b8c9a1eb61 lrc: 2/0,0 mode: --/CR res: [0x2400088d0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786f4f expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.655545:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1eb68 lrc: 3/1,0 mode: --/PR res: [0x2400088d0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.655563:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1eb68 lrc: 3/1,0 mode: PR/PR res: [0x2400088d0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.655580:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1eb68 lrc: 3/1,0 mode: PR/PR res: [0x2400088d0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201517.655662:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d0:0x7:0x0]: returning size 4096 00000004:00200000:3.0:1788201517.655669:0:69485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1788201517.655726:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2800/0x96d0c9b8c9a1eb61 lrc: 0/0,0 mode: --/CR res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f4f expref: 21 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.655750:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1eb68 lrc: 3/0,0 mode: PR/PR res: [0x2400088d0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f4f expref: 20 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.655761:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x7:0x0].0x0 (ffff8dc008611400) 00010000:00010000:3.0:1788201517.655764:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201517.655769:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2e00, rc 0) 00000100:00100000:3.0:1788201517.656136:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:78698:x1875060695562240:12345-192.168.201.20@tcp:101:rm.0 Request processed in 832us (1407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201517.659767:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1820 00000100:00100000:1.0:1788201517.660197:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201517.660316:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695562368 00000100:00100000:0.0:1788201517.660329:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695562368 00000100:00100000:0.0:1788201517.660388:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1821 00000100:00100000:0.0:1788201517.660400:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:78698:x1875060695562368:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1788201517.660427:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201517.660458:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7600/0x96d0c9b8c9a1eb6f lrc: 2/0,0 mode: --/CR res: [0x2000090a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786f56 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.660545:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1eb76 lrc: 3/1,0 mode: --/PR res: [0x2000090a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.660582:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1eb76 lrc: 3/1,0 mode: PR/PR res: [0x2000090a1:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.660599:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1eb76 lrc: 3/1,0 mode: PR/PR res: [0x2000090a1:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201517.660672:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000090a1:0x7:0x0]: returning size 4096 00000004:00200000:0.0:1788201517.660679:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1788201517.660727:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7600/0x96d0c9b8c9a1eb6f lrc: 0/0,0 mode: --/CR res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f56 expref: 15 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.660746:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1eb76 lrc: 3/0,0 mode: PR/PR res: [0x2000090a1:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f56 expref: 14 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.660756:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x7:0x0].0x0 (ffff8dc103a9b500) 00010000:00010000:0.0:1788201517.660759:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788201517.660763:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d7c00, rc 0) 00000100:00100000:0.0:1788201517.660842:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:78698:x1875060695562368:12345-192.168.201.20@tcp:101:rm.0 Request processed in 444us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201517.660849:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1821 00000100:00100000:1.0:1788201517.665619:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201517.665691:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695562624 00000100:00100000:0.0:1788201517.665707:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695562624 00000100:00100000:0.0:1788201517.665785:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1822 00000100:00100000:0.0:1788201517.665796:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:78698:x1875060695562624:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1788201517.665824:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201517.665852:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1eb7d lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786f5d expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201517.666108:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788201517.666234:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1eb7d lrc: 1/0,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f5d expref: 22 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.666249:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0x0 (ffff8dc103a9bf00) 00010000:00010000:0.0:1788201517.666252:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201517.666256:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1eb7d lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f5d expref: 22 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.666268:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d6a00, rc 0) 00000100:00100000:0.0:1788201517.666329:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+21:78698:x1875060695562624:12345-192.168.201.20@tcp:101:rm.0 Request processed in 537us (728us total) trans 81604378631 rc 301/301 00000100:00100000:0.0:1788201517.666335:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1822 00000100:00100000:3.0:1788201517.674535:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201517.676150:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695562752 00000100:00100000:2.0:1788201517.676171:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695562752 00000100:00100000:2.0:1788201517.676253:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 316 00000100:00100000:2.0:1788201517.676268:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+21:78698:x1875060695562752:12345-192.168.201.20@tcp:37:rm.0 00000100:00100000:2.0:1788201517.684005:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+21:78698:x1875060695562752:12345-192.168.201.20@tcp:37:rm.0 Request processed in 7725us (9469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201517.684073:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 316 00000100:00100000:1.0:1788201517.688390:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201517.688506:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695562880 00000100:00100000:0.0:1788201517.688520:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695562880 00000100:00100000:0.0:1788201517.688626:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 317 00000100:00100000:0.0:1788201517.688635:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:78698:x1875060695562880:12345-192.168.201.20@tcp:37:rm.0 00000100:00100000:0.0:1788201517.693777:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:78698:x1875060695562880:12345-192.168.201.20@tcp:37:rm.0 Request processed in 5124us (5381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201517.693795:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 317 00000100:00100000:1.0:1788201517.700381:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201517.704564:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695563136 00000100:00100000:2.0:1788201517.704586:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695563136 00000100:00100000:2.0:1788201517.704694:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 318 00000100:00100000:2.0:1788201517.704707:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13c3d3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+21:78698:x1875060695563136:12345-192.168.201.20@tcp:35:rm.0 00000100:00100000:2.0:1788201517.705084:0:79137:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001-mdtlov_UUID:79137:1875060715437184:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1788201517.705175:0:79137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201517.705246:0:79137:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a875840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201517.705269:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715437184 00000100:00100000:0.0:1788201517.705276:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715437184 00000100:00100000:0.0:1788201517.705334:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788201517.705344:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:79137:x1875060715437184:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1788201517.705442:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:79137:x1875060715437184:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 99us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201517.705469:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788201517.709747:0:79137:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001-mdtlov_UUID:79137:1875060715437184:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1788201517.709944:0:79137:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001-mdtlov_UUID:79137:1875060715437312:0@lo:700:mdt_rdpg00_002.0 00000100:00100000:2.0:1788201517.710091:0:79137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201517.710165:0:79137:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a875e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201517.710278:0:92515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715437312 00000100:00100000:3.0:1788201517.710303:0:92515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715437312 00000100:00100000:3.0:1788201517.710359:0:92515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788201517.710370:0:92515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:lustre-MDT0001-mdtlov_UUID+5:79137:x1875060715437312:12345-0@lo:700:mdt_rdpg00_002.0 00000100:00100000:3.0:1788201517.710451:0:92515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:lustre-MDT0001-mdtlov_UUID+5:79137:x1875060715437312:12345-0@lo:700:mdt_rdpg00_002.0 Request processed in 83us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201517.710460:0:92515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788201517.710548:0:79137:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0001-mdtlov_UUID:79137:1875060715437312:0@lo:700:mdt_rdpg00_002.0 00000040:00080000:2.0:1788201517.710697:0:79137:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201517.710724:0:79137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd1:0x3:0x0].31, 64 off34752 00000004:00080000:2.0:1788201517.710733:0:79137:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc13a875e40 with version 5 00000040:00080000:2.0:1788201517.710804:0:79137:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201517.710815:0:79137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd1:0x3:0x0].32, 64 off34816 00000004:00080000:2.0:1788201517.710819:0:79137:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc0010ebcc0 with version 6 00000040:00080000:2.0:1788201517.711249:0:79137:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788201517.711785:0:104392:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc10555e300 version 5 rpc_version 5 00000020:00100000:3.0:1788201517.711827:0:104392:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788201517.711837:0:104392:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc10785bb80 x1875060715437568/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201517.711862:0:104392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10785bb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715437568:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201517.711926:0:104392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201517.711965:0:104392:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f60f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201517.712046:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715437568 00000100:00100000:1.0:1788201517.712055:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715437568 00000040:00080000:2.0:1788201517.712109:0:79137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400013a0:0x3:0x0].16, 64 off33792 00000100:00100000:1.0:1788201517.712118:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788201517.712138:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:104392:x1875060715437568:12345-0@lo:1000:osp_up0-1.0 00000040:00080000:2.0:1788201517.712451:0:79137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x1:0x0].1, 344 off33112 00000040:00080000:2.0:1788201517.712583:0:79137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000e691:0x1:0x0].1, 424 off33192 00000004:00080000:2.0:1788201517.712592:0:79137:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc13a875f00 with version 7 00000001:00080000:2.0:1788201517.720506:0:102447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018907 is committed 00000001:00080000:2.0:1788201517.720530:0:102447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018906 is committed 00000100:00100000:1.0:1788201517.721371:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:104392:x1875060715437568:12345-0@lo:1000:osp_up0-1.0 Request processed in 9232us (9435us total) trans 128849018907 rc 0/0 00000100:00100000:1.0:1788201517.721391:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000004:00080000:3.0:1788201517.721561:0:104392:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018907 committed transno 128849018907 00000100:00100000:3.0:1788201517.721568:0:104392:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018907 gen 2 00000100:00100000:3.0:1788201517.721594:0:104392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10785bb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715437568:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1788201517.721629:0:104392:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc10555e300 version 6 rpc_version 6 00000020:00100000:3.0:1788201517.721660:0:104392:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788201517.721669:0:104392:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc10785bb80 x1875060715437824/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201517.721693:0:104392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10785bb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715437824:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201517.721740:0:104392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201517.721779:0:104392:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f60f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201517.721840:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715437824 00000100:00100000:1.0:1788201517.721849:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715437824 00000100:00100000:1.0:1788201517.721938:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788201517.721950:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:104392:x1875060715437824:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:0.0:1788201517.743363:0:102447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018908 is committed 00000100:00100000:1.0:1788201517.743763:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:104392:x1875060715437824:12345-0@lo:1000:osp_up0-1.0 Request processed in 21804us (22012us total) trans 128849018908 rc 0/0 00000100:00100000:1.0:1788201517.743781:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000004:00080000:3.0:1788201517.744077:0:104392:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018908 committed transno 128849018908 00000100:00100000:3.0:1788201517.744084:0:104392:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018908 gen 2 00000100:00100000:3.0:1788201517.744101:0:104392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10785bb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715437824:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1788201517.744147:0:104392:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc10555e300 version 7 rpc_version 7 00000020:00100000:3.0:1788201517.744178:0:104392:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788201517.744187:0:104392:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc10785bb80 x1875060715438080/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201517.744209:0:104392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10785bb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715438080:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201517.744253:0:104392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201517.744290:0:104392:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f60a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201517.744364:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715438080 00000100:00100000:1.0:1788201517.744379:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715438080 00000100:00100000:1.0:1788201517.744436:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788201517.744446:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10785ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:104392:x1875060715438080:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788201517.745706:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10785ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:104392:x1875060715438080:12345-0@lo:1000:osp_up0-1.0 Request processed in 1259us (1450us total) trans 128849018909 rc 0/0 00000100:00100000:1.0:1788201517.745715:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788201517.753221:0:104392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10785bb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715438080:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788201517.753870:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13c3d3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:78698:x1875060695563136:12345-192.168.201.20@tcp:35:rm.0 Request processed in 49160us (53500us total) trans 81604378632 rc 0/0 00000100:00100000:0.0:1788201517.753883:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 318 00000100:00100000:1.0:1788201517.760831:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201517.760940:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695563392 00000100:00100000:3.0:1788201517.760952:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695563392 00000100:00100000:3.0:1788201517.761069:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1823 00000100:00100000:3.0:1788201517.761080:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+22:78698:x1875060695563392:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:3.0:1788201517.761105:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201517.761126:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2800/0x96d0c9b8c9a1eb8b lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786f64 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.761292:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1eb92 lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.761306:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1eb92 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.761317:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1eb92 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201517.761328:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788201517.761423:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2800/0x96d0c9b8c9a1eb8b lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f64 expref: 25 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.761442:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1eb92 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f64 expref: 24 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.761466:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xa:0x0].0x0 (ffff8dc103a9b400) 00010000:00010000:3.0:1788201517.761469:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788201517.761473:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2a00, rc 0) 00000100:00100000:3.0:1788201517.761528:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+24:78698:x1875060695563392:12345-192.168.201.20@tcp:101:rm.0 Request processed in 450us (708us total) trans 81604378633 rc 0/0 00000100:00100000:3.0:1788201517.761535:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1823 00000100:00100000:3.0:1788201517.773325:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201517.773571:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695563520 00000100:00100000:0.0:1788201517.773581:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695563520 00000100:00100000:0.0:1788201517.773637:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 319 00000100:00100000:0.0:1788201517.773646:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10785a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:78698:x1875060695563520:12345-192.168.201.20@tcp:37:rm.0 00000100:00100000:1.0:1788201517.786494:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10785a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:78698:x1875060695563520:12345-192.168.201.20@tcp:37:rm.0 Request processed in 12837us (13166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201517.786508:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 319 00000100:00100000:1.0:1788201517.791438:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201517.791561:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695563776 00000100:00100000:0.0:1788201517.791572:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695563776 00000100:00100000:0.0:1788201517.791637:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 320 00000100:00100000:0.0:1788201517.791649:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:78698:x1875060695563776:12345-192.168.201.20@tcp:35:rm.0 00000100:00100000:0.0:1788201517.791901:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:78698:x1875060695563776:12345-192.168.201.20@tcp:35:rm.0 Request processed in 253us (471us total) trans 128849018910 rc 0/0 00000100:00100000:0.0:1788201517.791909:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 320 00000100:00100000:3.0:1788201517.794754:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201517.797342:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695564032 00000100:00100000:1.0:1788201517.797360:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695564032 00000100:00100000:1.0:1788201517.797445:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1824 00000100:00100000:1.0:1788201517.797456:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:78698:x1875060695564032:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:1.0:1788201517.797516:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788201517.797545:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1eae3 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x33:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f1e expref: 12 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.797571:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2000/0x96d0c9b8c9a1eac7 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x33:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f10 expref: 11 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.797586:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x33:0x0].0x0 (ffff8dc008611800) 00010000:00010000:1.0:1788201517.797605:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1eb76 lrc: 0/0,0 mode: --/PR res: [0x2000090a1:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f56 expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.797615:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x7:0x0].0x0 (ffff8dc103a9b500) 00010000:00010000:1.0:1788201517.797639:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201517.797664:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1eba0 lrc: 3/0,1 mode: --/CW res: [0x2000090a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.797675:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1eba0 lrc: 3/0,1 mode: CW/CW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.797683:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1eba0 lrc: 3/0,1 mode: CW/CW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.798881:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1eba7 lrc: 3/0,1 mode: --/PW res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.798894:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1eba7 lrc: 3/0,1 mode: PW/PW res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.798903:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1eba7 lrc: 3/0,1 mode: PW/PW res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.798990:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ebae lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.798998:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ebae lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.799004:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ebae lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201517.799259:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x33:0x0]: returning size 4096 00010000:00010000:1.0:1788201517.799273:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ebae lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.799279:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ebae lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.799298:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ebae lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.799304:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201517.799309:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ebae lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.799317:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ebae lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.799327:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x33:0x0].0x0 (ffff8dc0054e4400) 00010000:00010000:1.0:1788201517.799330:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201517.799335:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ebae lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.799341:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ebae lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.799367:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1eba0 lrc: 4/0,1 mode: CW/CW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.799373:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1eba0 lrc: 4/0,1 mode: CW/CW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.799379:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1eba0 lrc: 3/0,0 mode: CW/CW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.799385:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1eba0 lrc: 4/0,0 mode: CW/CW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.799389:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201517.799399:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1eba0 lrc: 4/0,0 mode: CW/CW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.799405:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1eba0 lrc: 5/0,0 mode: CW/CW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.799414:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x7:0x0].0x0 (ffff8dc0054e4000) 00010000:00010000:1.0:1788201517.799416:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201517.799419:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1eba0 lrc: 3/0,0 mode: --/CW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.799424:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1eba0 lrc: 0/0,0 mode: --/CW res: [0x2000090a1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201517.799436:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009cda29ee reply state 0000000089f3d99c transno 128849018911 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1eba7 lrc: 3/0,1 mode: PW/PW res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.799445:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1eba7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.799451:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x7:0x0].0xcd52553e (ffff8dc0054e4500) 00010000:00010000:1.0:1788201517.799453:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201517.799456:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201517.799548:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:78698:x1875060695564032:12345-192.168.201.20@tcp:36:rm.0 Request processed in 2089us (4804us total) trans 128849018911 rc 0/0 00000100:00100000:1.0:1788201517.799556:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1824 00000100:00100000:3.0:1788201517.802363:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201517.802440:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695564160 00000100:00100000:1.0:1788201517.802455:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695564160 00000100:00100000:1.0:1788201517.802527:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 321 00000100:00100000:1.0:1788201517.802539:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10785a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+24:78698:x1875060695564160:12345-192.168.201.20@tcp:37:rm.0 00000100:00100000:1.0:1788201517.806968:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10785a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+24:78698:x1875060695564160:12345-192.168.201.20@tcp:37:rm.0 Request processed in 4423us (4612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201517.806992:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 321 00000100:00100000:3.0:1788201517.810444:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201517.810546:0:79137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695564416 00000100:00100000:0.0:1788201517.810562:0:79137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695564416 00000100:00100000:0.0:1788201517.810640:0:79137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 322 00000100:00100000:0.0:1788201517.810650:0:79137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10785b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+24:78698:x1875060695564416:12345-192.168.201.20@tcp:35:rm.0 00000100:00100000:0.0:1788201517.810970:0:79137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10785b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+25:78698:x1875060695564416:12345-192.168.201.20@tcp:35:rm.0 Request processed in 320us (540us total) trans 81604378634 rc 0/0 00000100:00100000:0.0:1788201517.810978:0:79137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 322 00000100:00100000:2.0:1788201517.813523:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201517.813940:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695564672 00000100:00100000:0.0:1788201517.813953:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695564672 00000100:00100000:0.0:1788201517.814046:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1825 00000100:00100000:0.0:1788201517.814057:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc103189050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+25:78698:x1875060695564672:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:0.0:1788201517.814116:0:66312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788201517.814143:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1eb22 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f33 expref: 25 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.814164:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1eb06 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f25 expref: 24 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.814175:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xb:0x0].0x0 (ffff8dc0084fb800) 00010000:00010000:0.0:1788201517.814185:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2e00/0x96d0c9b8c9a1eb68 lrc: 0/0,0 mode: --/PR res: [0x2400088d0:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f4f expref: 23 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.814193:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x7:0x0].0x0 (ffff8dc008611400) 00010000:00010000:0.0:1788201517.814202:0:66312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201517.814225:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7600/0x96d0c9b8c9a1ebb5 lrc: 3/0,1 mode: --/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.814238:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7600/0x96d0c9b8c9a1ebb5 lrc: 3/0,1 mode: CW/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.814246:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7600/0x96d0c9b8c9a1ebb5 lrc: 3/0,1 mode: CW/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.814259:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ebbc lrc: 3/0,1 mode: --/PW res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.814267:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ebbc lrc: 3/0,1 mode: PW/PW res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.814287:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ebbc lrc: 3/0,1 mode: PW/PW res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.814365:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ebc3 lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.814376:0:66312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1e89e lrc: 2/0,0 mode: PR/PR res: [0x2400088d5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ee6 expref: 22 pid: 104410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.814385:0:66312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ebc3 lrc: 4/0,1 mode: --/EX res: [0x2400088d5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.814415:0:66312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1e89e lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ee6 expref: 22 pid: 104410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.814429:0:66312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1e89e lrc: 4/0,0 mode: PR/PR res: [0x2400088d5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ee6 expref: 22 pid: 104410 timeout: 4469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201517.814443:0:66312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:66312:1875060715438208:192.168.201.20@tcp:104: 00000100:00100000:0.0:1788201517.814527:0:66312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc00750d6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788201517.820647:0:66312:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.20@tcp) returned -22 from blocking AST (req@00000000f1ea768b x1875060715438208) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1e89e lrc: 4/0,0 mode: PR/PR res: [0x2400088d5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ee6 expref: 22 pid: 104410 timeout: 4469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.820672:0:66312:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1e89e lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ee6 expref: 22 pid: 104410 timeout: 4469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.820713:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1e89e lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ee6 expref: 22 pid: 104410 timeout: 4469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201517.820731:0:66312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:66312:1875060715438208:192.168.201.20@tcp:104: 00010000:00010000:2.0:1788201517.820755:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xb:0x0].0x0 (ffff8dc0084fb800) 00010000:00010000:2.0:1788201517.820761:0:66312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ebc3 lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.820782:0:66312:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ebc3 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.820806:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ebc3 lrc: 4/0,1 mode: EX/EX res: [0x2400088d5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.820829:0:66312:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ebc3 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.820839:0:66312:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ebc3 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.820845:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ebc3 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201517.821402:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1788201517.821418:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ebc3 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.821426:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ebc3 lrc: 2/0,0 mode: EX/EX res: [0x2400088d5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.821433:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ebc3 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.821439:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201517.821444:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ebc3 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.821452:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ebc3 lrc: 4/0,0 mode: EX/EX res: [0x2400088d5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.821462:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xb:0x0].0x0 (ffff8dc0084fb800) 00010000:00010000:2.0:1788201517.821465:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201517.821476:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ebc3 lrc: 2/0,0 mode: --/EX res: [0x2400088d5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.821483:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ebc3 lrc: 0/0,0 mode: --/EX res: [0x2400088d5:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.821508:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7600/0x96d0c9b8c9a1ebb5 lrc: 4/0,1 mode: CW/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.821515:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7600/0x96d0c9b8c9a1ebb5 lrc: 4/0,1 mode: CW/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.821521:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7600/0x96d0c9b8c9a1ebb5 lrc: 3/0,0 mode: CW/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.821527:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7600/0x96d0c9b8c9a1ebb5 lrc: 4/0,0 mode: CW/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.821532:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201517.821535:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7600/0x96d0c9b8c9a1ebb5 lrc: 4/0,0 mode: CW/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.821541:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7600/0x96d0c9b8c9a1ebb5 lrc: 5/0,0 mode: CW/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.821550:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x7:0x0].0x0 (ffff8dc1030a7300) 00010000:00010000:2.0:1788201517.821552:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201517.821555:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7600/0x96d0c9b8c9a1ebb5 lrc: 3/0,0 mode: --/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.821561:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7600/0x96d0c9b8c9a1ebb5 lrc: 0/0,0 mode: --/CW res: [0x2400088d0:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201517.821574:0:66312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021e4424c reply state 0000000086da6eec transno 81604378635 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ebbc lrc: 3/0,1 mode: PW/PW res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.821590:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ebbc lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.821596:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x7:0x0].0xf0209d98 (ffff8dc1030a7400) 00010000:00010000:2.0:1788201517.821598:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201517.821601:0:66312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201517.821679:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc103189050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+23:78698:x1875060695564672:12345-192.168.201.20@tcp:36:rm.0 Request processed in 7623us (8161us total) trans 81604378635 rc 0/0 00000100:00100000:2.0:1788201517.821698:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1825 00000100:00100000:1.0:1788201517.826163:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201517.826261:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695564928 00000100:00100000:0.0:1788201517.826269:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695564928 00000100:00100000:0.0:1788201517.826326:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 323 00000100:00100000:0.0:1788201517.826336:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13c3d3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+23:78698:x1875060695564928:12345-192.168.201.20@tcp:35:rm.0 00000100:00100000:0.0:1788201517.826560:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13c3d3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+24:78698:x1875060695564928:12345-192.168.201.20@tcp:35:rm.0 Request processed in 224us (405us total) trans 81604378636 rc 0/0 00000100:00100000:0.0:1788201517.826568:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 323 00000100:00100000:1.0:1788201517.836612:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201517.836742:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695565184 00000100:00100000:0.0:1788201517.836753:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695565184 00000100:00100000:0.0:1788201517.836818:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1826 00000100:00100000:0.0:1788201517.836829:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+24:78698:x1875060695565184:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:0.0:1788201517.836888:0:66757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788201517.836916:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae2a00/0x96d0c9b8c9a1eb92 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f64 expref: 24 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.836940:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1eaab lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f09 expref: 23 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.836952:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xa:0x0].0x0 (ffff8dc103a9b400) 00010000:00010000:0.0:1788201517.836969:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1eb37 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f3a expref: 22 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.836978:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0x0 (ffff8dc103a9bf00) 00010000:00010000:0.0:1788201517.836981:0:66757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201517.837000:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1ebca lrc: 3/0,1 mode: --/CW res: [0x2400088d5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.837081:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1ebca lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.837092:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1ebca lrc: 3/0,1 mode: CW/CW res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.837107:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ebd1 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.837115:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ebd1 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.837140:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ebd1 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.837227:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ebd8 lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.837236:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ebd8 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.837242:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ebd8 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.837259:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1ebdf lrc: 3/0,1 mode: --/EX res: [0x2400088d0:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.837266:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1ebdf lrc: 3/0,1 mode: EX/EX res: [0x2400088d0:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.837271:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1ebdf lrc: 3/0,1 mode: EX/EX res: [0x2400088d0:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.837306:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ebe6 lrc: 3/0,1 mode: --/EX res: [0x2000090a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.837313:0:66757:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ebe6 lrc: 3/0,1 mode: --/EX res: [0x2000090a1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.837321:0:66757:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ebe6 lrc: 3/0,1 mode: --/EX res: [0x2000090a1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201517.837342:0:66757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66757:1875060715438336:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1788201517.837400:0:66757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201517.837427:0:66757:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1065c7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201517.837604:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715438336 00000100:00100000:1.0:1788201517.837609:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715438336 00000100:00100000:1.0:1788201517.837650:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788201517.837658:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:66757:x1875060715438336:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1788201517.837673:0:101344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201517.837689:0:101344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1ebed lrc: 2/0,0 mode: --/EX res: [0x2000090a1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ebe6 expref: -99 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.837707:0:101344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1ebed lrc: 3/0,0 mode: EX/EX res: [0x2000090a1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ebe6 expref: 7 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.837718:0:101344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1ebed lrc: 3/0,0 mode: EX/EX res: [0x2000090a1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ebe6 expref: 7 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.837725:0:101344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x7:0x0].0x0 (ffff8dc0054e4000) 00010000:00010000:1.0:1788201517.837728:0:101344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201517.837731:0:101344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e3600, rc 0) 00000100:00100000:1.0:1788201517.837776:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:66757:x1875060715438336:12345-0@lo:101:mdt00_003.0 Request processed in 118us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201517.837782:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788201517.838888:0:66757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66757:1875060715438336:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1788201517.838907:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ebe6 lrc: 4/0,1 mode: EX/EX res: [0x2000090a1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ebed expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.838923:0:66757:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ebe6 lrc: 4/0,1 mode: EX/EX res: [0x2000090a1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ebed expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201517.839610:0:66757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66757:1875060715438464:0@lo:403:mdt00_003.0 00000100:00100000:0.0:1788201517.839670:0:66757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201517.839945:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715438464 00000100:00100000:1.0:1788201517.839952:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715438464 00000100:00100000:1.0:1788201517.840044:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788201517.840055:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:66757:x1875060715438464:12345-0@lo:403:mdt00_003.0 00000100:00100000:1.0:1788201517.841708:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:66757:x1875060715438464:12345-0@lo:403:mdt00_003.0 Request processed in 1650us (2031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201517.841719:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788201517.842053:0:66757:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1065c7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201517.842084:0:66757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66757:1875060715438464:0@lo:403:mdt00_003.0 00000040:00080000:0.0:1788201517.843057:0:66757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x1:0x0].2, 936 off34048 00000100:00100000:0.0:1788201517.843282:0:66757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66757:1875060715438592:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788201517.843333:0:66757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201517.844573:0:66757:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10a1bd240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201517.845648:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715438592 00000100:00100000:3.0:1788201517.845660:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715438592 00000100:00100000:3.0:1788201517.845847:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788201517.845857:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:66757:x1875060715438592:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788201517.845981:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:66757:x1875060715438592:12345-0@lo:1000:mdt00_003.0 Request processed in 124us (2647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201517.845988:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788201517.846096:0:66757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66757:1875060715438592:0@lo:1000:mdt00_003.0 00000040:00080000:0.0:1788201517.846142:0:66757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000e691:0x1:0x0].2, 1016 off34208 00000004:00080000:0.0:1788201517.846154:0:66757:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc1065c7cc0 with version 8 00000004:00080000:3.0:1788201517.846220:0:104392:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc10555e300 version 8 rpc_version 8 00000020:00100000:3.0:1788201517.846247:0:104392:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788201517.846254:0:104392:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc107859500 x1875060715438848/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1976/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201517.846274:0:104392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc107859500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715438848:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201517.846314:0:104392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201517.846341:0:104392:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f606c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201517.846392:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715438848 00000100:00100000:1.0:1788201517.846397:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715438848 00000100:00100000:1.0:1788201517.846435:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788201517.846444:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10785b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:104392:x1875060715438848:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788201517.846672:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10785b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:104392:x1875060715438848:12345-0@lo:1000:osp_up0-1.0 Request processed in 229us (357us total) trans 128849018912 rc 0/0 00000100:00100000:1.0:1788201517.846679:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788201517.846996:0:104392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc107859500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715438848:0@lo:1000:osp_up0-1.0 00000004:00200000:1.0:1788201517.847334:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788201517.847356:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1ebdf lrc: 3/0,1 mode: EX/EX res: [0x2400088d0:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.847365:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1ebdf lrc: 2/0,0 mode: EX/EX res: [0x2400088d0:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.847371:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1ebdf lrc: 3/0,0 mode: EX/EX res: [0x2400088d0:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.847376:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201517.847380:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1ebdf lrc: 3/0,0 mode: EX/EX res: [0x2400088d0:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.847386:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1ebdf lrc: 4/0,0 mode: EX/EX res: [0x2400088d0:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.847400:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x7:0x0].0x0 (ffff8dc1030a7a00) 00010000:00010000:1.0:1788201517.847403:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201517.847422:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1ebdf lrc: 2/0,0 mode: --/EX res: [0x2400088d0:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.847428:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1ebdf lrc: 0/0,0 mode: --/EX res: [0x2400088d0:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.847449:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ebe6 lrc: 4/0,1 mode: EX/EX res: [0x2000090a1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ebed expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.847457:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ebe6 lrc: 4/0,1 mode: EX/EX res: [0x2000090a1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ebed expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.847463:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ebe6 lrc: 3/0,0 mode: EX/EX res: [0x2000090a1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ebed expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.847487:0:66757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788201517.847497:0:66757:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000090a1:0x7:0x0] 00010000:00010000:1.0:1788201517.847503:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ebd8 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.847509:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ebd8 lrc: 2/0,0 mode: EX/EX res: [0x2400088d5:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.847514:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ebd8 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.847518:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201517.847521:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ebd8 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.847527:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ebd8 lrc: 4/0,0 mode: EX/EX res: [0x2400088d5:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.847546:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xa:0x0].0x0 (ffff8dc1030a7900) 00010000:00010000:1.0:1788201517.847548:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201517.847552:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ebd8 lrc: 2/0,0 mode: --/EX res: [0x2400088d5:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.847557:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ebd8 lrc: 0/0,0 mode: --/EX res: [0x2400088d5:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.847575:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1ebca lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.847580:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1ebca lrc: 4/0,1 mode: CW/CW res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.847585:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1ebca lrc: 3/0,0 mode: CW/CW res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.847591:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1ebca lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.847595:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201517.847598:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1ebca lrc: 4/0,0 mode: CW/CW res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.847604:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1ebca lrc: 5/0,0 mode: CW/CW res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.847611:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0x0 (ffff8dc103a9bf00) 00010000:00010000:1.0:1788201517.847613:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201517.847616:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1ebca lrc: 3/0,0 mode: --/CW res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.847630:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1ebca lrc: 0/0,0 mode: --/CW res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201517.847640:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008acaed9 reply state 00000000ca1d0654 transno 81604378637 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ebd1 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.847652:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ebd1 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.847658:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0xd1d4b922 (ffff8dc1030a7b00) 00010000:00010000:1.0:1788201517.847660:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201517.847663:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201517.847821:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201517.847829:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ebe6 lrc: 2/0,0 mode: EX/EX res: [0x2000090a1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1ebed expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.847835:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7a00 already unused, calling callback (ffffffffc189cee0) 00010000:00010000:2.0:1788201517.847839:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ebe6 lrc: 3/0,0 mode: EX/EX res: [0x2000090a1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1ebed expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201517.847847:0:13349:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ebe6 lrc: 3/0,0 mode: EX/EX res: [0x2000090a1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1ebed expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.847879:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ebe6 lrc: 2/0,0 mode: --/EX res: [0x2000090a1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ebed expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.847885:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201517.847921:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ebe6 lrc: 1/0,0 mode: --/EX res: [0x2000090a1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ebed expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.847929:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ebe6 lrc: 0/0,0 mode: --/EX res: [0x2000090a1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ebed expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201517.847948:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1788201517.847952:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201517.847953:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201517.847955:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201517.847961:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715438976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201517.848036:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201517.848066:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715438976 00000100:00100000:3.0:1788201517.848078:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715438976 00000100:00100000:3.0:1788201517.848127:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:3.0:1788201517.848135:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3655:x1875060715438976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201517.848145:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201517.848160:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1ebed lrc: 0/0,0 mode: --/EX res: [0x2000090a1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ebe6 expref: 8 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.848172:0:26213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x7:0x0].0x0 (ffff8dc0054e4000) 00010000:00010000:3.0:1788201517.848179:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201517.848213:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715438976:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201517.848220:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:2.0:1788201517.848297:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715438976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201517.848432:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+23:78698:x1875060695565184:12345-192.168.201.20@tcp:36:rm.0 Request processed in 11603us (11829us total) trans 81604378637 rc 0/0 00000100:00100000:1.0:1788201517.848440:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1826 00000100:00100000:3.0:1788201517.855178:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201517.855223:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201517.855319:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695565312 00000100:00100000:2.0:1788201517.855329:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695565312 00000100:00100000:2.0:1788201517.855401:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 761 00000100:00100000:2.0:1788201517.855411:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107858e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2402:x1875060695565312:12345-192.168.201.20@tcp:103:rm.0 00010000:00010000:2.0:1788201517.855426:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201517.855450:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3800/0x96d0c9b8c9a1ea81 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786efb expref: 11 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.855471:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0x0 (ffff8dc008611900) 00010000:00010000:2.0:1788201517.855482:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201517.855529:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107858e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2402:x1875060695565312:12345-192.168.201.20@tcp:103:rm.0 Request processed in 120us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201517.855536:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 761 00000100:00100000:0.0:1788201517.856219:0:66315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695565568 00000100:00100000:0.0:1788201517.856240:0:66315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695565568 00000100:00100000:0.0:1788201517.856317:0:66315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 324 00000100:00100000:0.0:1788201517.856327:0:66315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+23:78698:x1875060695565568:12345-192.168.201.20@tcp:35:rm.0 00000100:00100000:0.0:1788201517.856522:0:66315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+24:78698:x1875060695565568:12345-192.168.201.20@tcp:35:rm.0 Request processed in 196us (1298us total) trans 81604378638 rc 0/0 00000100:00100000:0.0:1788201517.856530:0:66315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 324 00000100:00100000:1.0:1788201517.858805:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201517.858904:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695565824 00000100:00100000:2.0:1788201517.858912:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695565824 00000100:00100000:2.0:1788201517.858971:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1827 00000100:00100000:2.0:1788201517.858981:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+24:78698:x1875060695565824:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:2.0:1788201517.859077:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788201517.859102:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1eb53 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f48 expref: 24 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.859147:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6400/0x96d0c9b8c9a1ea8f lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0x9:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f02 expref: 23 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.859158:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0x0 (ffff8dc103a9bf00) 00010000:00010000:2.0:1788201517.859168:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201517.859221:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbc200/0x96d0c9b8c9a1ebf4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.859229:0:66313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbc200/0x96d0c9b8c9a1ebf4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.859238:0:66313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbc200/0x96d0c9b8c9a1ebf4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201517.859260:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715439104:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1788201517.859309:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201517.859359:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0010ebcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201517.859525:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715439104 00000100:00100000:1.0:1788201517.859530:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715439104 00000100:00100000:1.0:1788201517.859572:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788201517.859580:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:66313:x1875060715439104:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1788201517.859594:0:66317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201517.859609:0:66317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1ebfb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ebf4 expref: -99 pid: 66317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.859630:0:66317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1ea65 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ef4 expref: 9 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.859639:0:66317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1ebfb lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ebf4 expref: 8 pid: 66317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.859672:0:66317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1ea65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ef4 expref: 9 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.859882:0:66317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1ea65 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ef4 expref: 9 pid: 66313 timeout: 4469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201517.859898:0:66317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be4e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:66317:1875060715439232:192.168.201.20@tcp:104: 00000100:00100000:1.0:1788201517.859970:0:66317:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007486180 going to sleep for 11 seconds 00000100:00100000:3.0:1788201517.862222:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201517.862357:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695565952 00000100:00100000:0.0:1788201517.862364:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695565952 00010000:00010000:0.0:1788201517.862400:0:26207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1ea65 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ef4 expref: 10 pid: 66313 timeout: 4469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201517.862441:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2634 00000100:00100000:0.0:1788201517.862451:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2400:x1875060695565952:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201517.862464:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201517.862469:0:26207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1ea65 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ef4 expref: 10 pid: 66313 timeout: 4469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.862483:0:26207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1ea65 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ef4 expref: 10 pid: 66313 timeout: 4469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.862504:0:26207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a9b800) 00010000:00010000:0.0:1788201517.862509:0:26207:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1ebfb lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ebf4 expref: 8 pid: 66317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.862520:0:26207:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1ebfb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ebf4 expref: 8 pid: 66317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.862547:0:26207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1ebfb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ebf4 expref: 8 pid: 66317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.862582:0:26207:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1ebfb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ebf4 expref: 8 pid: 66317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201517.862598:0:26207:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:26207:1875060715439360:0@lo:105: 00000100:00100000:0.0:1788201517.862641:0:26207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201517.862702:0:26207:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10a1bdcc0 going to sleep for 11 seconds 00010000:00010000:1.0:1788201517.862799:0:66317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1ea65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ef4 expref: 10 pid: 66313 timeout: 4469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201517.862816:0:66317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be4e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:66317:1875060715439232:192.168.201.20@tcp:104: 00010000:00010000:1.0:1788201517.862841:0:66317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1ebfb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ebf4 expref: 8 pid: 66317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.862848:0:66317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a9b800) 00010000:00010000:1.0:1788201517.862851:0:66317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201517.862853:0:66317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e3800, rc 0) 00000100:00100000:1.0:1788201517.862903:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:66313:x1875060715439104:12345-0@lo:101:mdt00_001.0 Request processed in 3324us (3593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201517.862910:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788201517.863046:0:95383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715439360 00000100:00100000:2.0:1788201517.863051:0:95383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715439360 00000100:00100000:2.0:1788201517.863088:0:95383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1788201517.863095:0:95383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:26207:x1875060715439360:12345-0@lo:105: 00010000:00010000:2.0:1788201517.863105:0:95383:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbc200/0x96d0c9b8c9a1ebf4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ebfb expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.863116:0:95383:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbc200/0x96d0c9b8c9a1ebf4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ebfb expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.863124:0:95383:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbc200/0x96d0c9b8c9a1ebf4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ebfb expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.863139:0:95383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbc200/0x96d0c9b8c9a1ebf4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x96d0c9b8c9a1ebfb expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.863147:0:95383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbc200/0x96d0c9b8c9a1ebf4 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x96d0c9b8c9a1ebfb expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.863154:0:95383:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbc200/0x96d0c9b8c9a1ebf4 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x96d0c9b8c9a1ebfb expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.863166:0:95383:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8dc006dbc200) 00000100:00100000:2.0:1788201517.863218:0:95383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:26207:x1875060715439360:12345-0@lo:105: Request processed in 123us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201517.863224:0:95383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1788201517.863307:0:26207:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:26207:1875060715439360:0@lo:105: 00010000:00010000:1.0:1788201517.863319:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201517.863362:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2400:x1875060695565952:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 912us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201517.863378:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2634 00000100:00100000:0.0:1788201517.864145:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715439104:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1788201517.864163:0:66313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbc200/0x96d0c9b8c9a1ebf4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ebfb expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201517.864186:0:66313:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1788201517.864224:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6200/0x96d0c9b8c9a1ec02 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.864233:0:66313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6200/0x96d0c9b8c9a1ec02 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.864242:0:66313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6200/0x96d0c9b8c9a1ec02 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201517.864257:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715439488:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1788201517.864296:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201517.864331:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10a1bde40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201517.864473:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715439488 00000100:00100000:2.0:1788201517.864479:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715439488 00000100:00100000:2.0:1788201517.864517:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788201517.864525:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:66313:x1875060715439488:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1788201517.864540:0:66318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201517.864554:0:66318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1ec09 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ec02 expref: -99 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.864576:0:66318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1ec09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ec02 expref: 9 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.864589:0:66318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1ec09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ec02 expref: 9 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201517.864611:0:66318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb56adc53 (ffff8dc11248c800) 00010000:00010000:2.0:1788201517.864614:0:66318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201517.864617:0:66318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbc600, rc 0) 00000100:00100000:2.0:1788201517.864671:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715439488:12345-0@lo:101:mdt00_001.0 Request processed in 145us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201517.864677:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788201517.864802:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715439488:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1788201517.864817:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6200/0x96d0c9b8c9a1ec02 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ec09 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.864826:0:66313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6200/0x96d0c9b8c9a1ec02 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ec09 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201517.864838:0:66313:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1788201517.864867:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715439616:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201517.864906:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201517.864931:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10a1bd780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201517.864981:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715439616 00000100:00100000:1.0:1788201517.864986:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715439616 00000100:00100000:1.0:1788201517.865046:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788201517.865054:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13f805c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715439616:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201517.865135:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13f805c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715439616:12345-0@lo:1000:mdt00_001.0 Request processed in 82us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201517.865142:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788201517.865451:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715439616:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201517.865493:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715439744:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201517.865546:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201517.865569:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10a1bd780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201517.865681:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715439744 00000100:00100000:1.0:1788201517.865685:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715439744 00000100:00100000:1.0:1788201517.865717:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788201517.865724:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715439744:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201517.865841:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715439744:12345-0@lo:1000:mdt00_001.0 Request processed in 116us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201517.865847:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788201517.866161:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715439744:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201517.866204:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715439872:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201517.866229:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201517.866283:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10a1bd780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201517.866503:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715439872 00000100:00100000:2.0:1788201517.866508:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715439872 00000100:00100000:2.0:1788201517.866573:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788201517.866581:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715439872:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788201517.866686:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715439872:12345-0@lo:1000:mdt00_001.0 Request processed in 106us (456us total) trans 0 rc 1/1 00000100:00100000:2.0:1788201517.866693:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788201517.866753:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715439872:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788201517.866818:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6c00/0x96d0c9b8c9a1ec10 lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.866827:0:66313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6c00/0x96d0c9b8c9a1ec10 lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.866835:0:66313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6c00/0x96d0c9b8c9a1ec10 lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201517.866859:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715440000:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1788201517.866884:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201517.867049:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10a1bde40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201517.867160:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715440000 00000100:00100000:1.0:1788201517.867165:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715440000 00000100:00100000:1.0:1788201517.867188:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788201517.867194:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715440000:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1788201517.867203:0:101344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201517.867219:0:101344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1ec17 lrc: 2/0,0 mode: --/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ec10 expref: -99 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.867240:0:101344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1ec17 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ec10 expref: 10 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.867253:0:101344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1ec17 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ec10 expref: 10 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.867267:0:101344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0x0 (ffff8dc0054e4400) 00010000:00010000:1.0:1788201517.867269:0:101344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201517.867273:0:101344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e3000, rc 0) 00000100:00100000:1.0:1788201517.867300:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:66313:x1875060715440000:12345-0@lo:101:mdt00_001.0 Request processed in 106us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201517.867307:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788201517.867374:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715440000:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1788201517.867387:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6c00/0x96d0c9b8c9a1ec10 lrc: 4/0,1 mode: EX/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ec17 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.867396:0:66313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6c00/0x96d0c9b8c9a1ec10 lrc: 4/0,1 mode: EX/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ec17 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.867417:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ec1e lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.867425:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ec1e lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.867434:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ec1e lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201517.867737:0:66313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x1:0x0].3, 432 off34480 00000040:00080000:0.0:1788201517.868354:0:66313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000e691:0x1:0x0].3, 512 off34720 00000004:00080000:0.0:1788201517.868362:0:66313:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc10a1bde40 with version 9 00000004:00080000:1.0:1788201517.868431:0:104392:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc10555e300 version 9 rpc_version 9 00000020:00100000:1.0:1788201517.868453:0:104392:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788201517.868462:0:104392:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc004be5c00 x1875060715440256/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1504/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201517.868478:0:104392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be5c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715440256:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788201517.868515:0:104392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201517.868545:0:104392:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007486180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201517.868602:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715440256 00000100:00100000:0.0:1788201517.868607:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715440256 00000100:00100000:0.0:1788201517.868637:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788201517.868644:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:104392:x1875060715440256:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788201517.869097:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:104392:x1875060715440256:12345-0@lo:1000:osp_up0-1.0 Request processed in 452us (580us total) trans 128849018913 rc 0/0 00000100:00100000:0.0:1788201517.869121:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788201517.869581:0:104392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be5c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715440256:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1788201517.869626:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0x9:0x0]: returning size 4096 00010000:00010000:0.0:1788201517.869644:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ec1e lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.869653:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ec1e lrc: 2/0,0 mode: EX/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.869661:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ec1e lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.869667:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201517.869671:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ec1e lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.869678:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ec1e lrc: 4/0,0 mode: EX/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.869691:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0x0 (ffff8dc1030a7f00) 00010000:00010000:0.0:1788201517.869693:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201517.869698:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ec1e lrc: 2/0,0 mode: --/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.869703:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ec1e lrc: 0/0,0 mode: --/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.869722:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6c00/0x96d0c9b8c9a1ec10 lrc: 4/0,1 mode: EX/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ec17 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.869729:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6c00/0x96d0c9b8c9a1ec10 lrc: 4/0,1 mode: EX/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ec17 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.869749:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6c00/0x96d0c9b8c9a1ec10 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ec17 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.869859:0:66313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788201517.869874:0:66313:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1788201517.869882:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbc200/0x96d0c9b8c9a1ebf4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ebfb expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.869890:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbc200/0x96d0c9b8c9a1ebf4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ebfb expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.869895:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbc200/0x96d0c9b8c9a1ebf4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ebfb expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.869926:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201517.869932:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6c00/0x96d0c9b8c9a1ec10 lrc: 2/0,0 mode: EX/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1ec17 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.869939:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6c00 already unused, calling callback (ffffffffc189cee0) 00010000:00010000:1.0:1788201517.869943:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6c00/0x96d0c9b8c9a1ec10 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1ec17 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201517.869951:0:24979:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6c00/0x96d0c9b8c9a1ec10 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1ec17 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.869979:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6c00/0x96d0c9b8c9a1ec10 lrc: 2/0,0 mode: --/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ec17 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.869992:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201517.870055:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6c00/0x96d0c9b8c9a1ec10 lrc: 1/0,0 mode: --/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ec17 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.870063:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6c00/0x96d0c9b8c9a1ec10 lrc: 0/0,0 mode: --/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ec17 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.870079:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201517.870083:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbc200/0x96d0c9b8c9a1ebf4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1ebfb expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.870088:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc200 already unused, calling callback (ffffffffc189cee0) 00010000:00010000:1.0:1788201517.870092:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbc200/0x96d0c9b8c9a1ebf4 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1ebfb expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201517.870099:0:24979:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbc200/0x96d0c9b8c9a1ebf4 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1ebfb expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.870116:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbc200/0x96d0c9b8c9a1ebf4 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ebfb expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.870122:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201517.870128:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbc200/0x96d0c9b8c9a1ebf4 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ebfb expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201517.870136:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201517.870137:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201517.870139:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201517.870216:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715440512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201517.870260:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201517.870312:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201517.870319:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715440384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201517.870341:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201517.870423:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715440512 00000100:00100000:3.0:1788201517.870429:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715440512 00000100:00100000:3.0:1788201517.870473:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715440384 00000100:00100000:3.0:1788201517.870477:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715440384 00000100:00100000:3.0:1788201517.870500:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:3.0:1788201517.870507:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+12:3658:x1875060715440512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201517.870519:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201517.870536:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3800/0x96d0c9b8c9a1ebfb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ebf4 expref: 12 pid: 66317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.870549:0:26213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a9b800) 00010000:00010000:3.0:1788201517.870556:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201517.870591:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+11:3658:x1875060715440512:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201517.870604:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00000100:00100000:3.0:1788201517.870620:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:3.0:1788201517.870627:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+10:3658:x1875060715440384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201517.870635:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201517.870645:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1ec17 lrc: 0/0,0 mode: --/EX res: [0x2400088d5:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ec10 expref: 10 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.870655:0:26213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0x0 (ffff8dc0054e4400) 00010000:00010000:3.0:1788201517.870661:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201517.870683:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+9:3658:x1875060715440384:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201517.870688:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000100:00100000:3.0:1788201517.870717:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715440384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201517.870726:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715440512:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201517.870938:0:66313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788201517.870945:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc006dbc200/0x96d0c9b8c9a1ebf4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ebfb expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201517.870964:0:66313:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1788201517.870970:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6200/0x96d0c9b8c9a1ec02 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ec09 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201517.870978:0:66313:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6200/0x96d0c9b8c9a1ec02 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ec09 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201517.871089:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201517.871242:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+23:78698:x1875060695565824:12345-192.168.201.20@tcp:36:rm.0 Request processed in 12259us (12443us total) trans 81604378639 rc 0/0 00000100:00100000:0.0:1788201517.871261:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1827 00010000:00010000:2.0:1788201518.224527:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201518.416400:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715440640:0@lo:400:kworker.0 00000100:00100000:3.0:1788201518.416481:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201518.416549:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715440640 00000100:00100000:3.0:1788201518.416557:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715440640 00000100:00100000:3.0:1788201518.416602:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788201518.416611:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715440640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201518.416657:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715440640:12345-0@lo:400:kworker.0 Request processed in 47us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201518.416664:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788201518.416720:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715440640:0@lo:400:kworker.0 00000100:00100000:3.0:1788201518.419167:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715440896:0@lo:400:kworker.0 00000100:00100000:3.0:1788201518.419247:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201518.419307:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201518.419314:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715441024:0@lo:400:kworker.0 00000100:00100000:3.0:1788201518.419339:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201518.419373:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715440768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201518.419399:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201518.419418:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715441280:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201518.419436:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201518.419562:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715440768 00000100:00100000:2.0:1788201518.419571:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715440768 00000100:00100000:2.0:1788201518.419618:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715441280 00000100:00100000:2.0:1788201518.419621:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715441280 00000100:00100000:2.0:1788201518.419639:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788201518.419648:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3656:x1875060715440768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201518.419683:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444945920 avail 1298706432 00000100:00100000:1.0:1788201518.420177:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788201518.425298:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10785ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715441280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201518.425352:0:101344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445371904 avail 1299132416 00000100:00100000:1.0:1788201518.425444:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10785ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715441280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5259us (6005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201518.425455:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788201518.425568:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715441152:0@lo:400:kworker.0 00000100:00100000:1.0:1788201518.425611:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201518.425663:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715440896 00000100:00100000:1.0:1788201518.425671:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715440896 00000100:00100000:1.0:1788201518.425741:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715441024 00000100:00100000:1.0:1788201518.425745:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715441024 00000100:00100000:1.0:1788201518.425767:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715441152 00000100:00100000:1.0:1788201518.425770:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715441152 00000100:00100000:1.0:1788201518.425794:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1847 00000100:00100000:1.0:1788201518.425801:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10785b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715440896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201518.425842:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10785b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715440896:12345-0@lo:400:kworker.0 Request processed in 41us (6596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201518.425849:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1847 00000100:00100000:1.0:1788201518.425864:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1848 00000100:00100000:1.0:1788201518.425869:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715441024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201518.425913:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715441024:12345-0@lo:400:kworker.0 Request processed in 44us (6573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201518.425920:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1848 00000100:00100000:1.0:1788201518.425934:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1849 00000100:00100000:1.0:1788201518.425940:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715441152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201518.425992:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715441152:12345-0@lo:400:kworker.0 Request processed in 51us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201518.426012:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1849 00000100:00080000:1.0:1788201518.426049:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201518.426053:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201518.426081:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715441152:0@lo:400:kworker.0 00000100:00100000:1.0:1788201518.426177:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715441024:0@lo:400:kworker.0 00000100:00100000:1.0:1788201518.426191:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715440896:0@lo:400:kworker.0 00000100:00100000:0.0:1788201518.426960:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201518.426972:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715441408:0@lo:400:kworker.0 00000100:00100000:0.0:1788201518.427039:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201518.427083:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715441408 00000100:00100000:0.0:1788201518.427092:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715441408 00000100:00100000:0.0:1788201518.427144:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1850 00000100:00100000:0.0:1788201518.427152:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715441408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201518.427192:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715441408:12345-0@lo:400:kworker.0 Request processed in 41us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201518.427199:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1850 00000100:00080000:0.0:1788201518.427215:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201518.427234:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715441408:0@lo:400:kworker.0 00000100:00100000:0.0:1788201518.427266:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715441536:0@lo:400:kworker.0 00000100:00100000:0.0:1788201518.427306:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201518.427352:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715441664:0@lo:400:kworker.0 00000100:00100000:0.0:1788201518.427374:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201518.427413:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201518.427419:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715441792:0@lo:400:kworker.0 00000100:00100000:0.0:1788201518.427442:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201518.427478:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715441792 00000100:00100000:0.0:1788201518.427482:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715441792 00000100:00100000:0.0:1788201518.427510:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1851 00000100:00100000:0.0:1788201518.427516:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715441792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201518.427551:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715441792:12345-0@lo:400:kworker.0 Request processed in 35us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201518.427569:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1851 00000100:00100000:0.0:1788201518.427598:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715441792:0@lo:400:kworker.0 00000100:00100000:0.0:1788201518.427627:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201518.427634:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715441920:0@lo:400:kworker.0 00000100:00100000:0.0:1788201518.427658:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201518.427682:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715441536 00000100:00100000:0.0:1788201518.427686:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715441536 00000100:00100000:0.0:1788201518.427714:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715441664 00000100:00100000:0.0:1788201518.427717:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715441664 00000100:00100000:0.0:1788201518.427733:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715441920 00000100:00100000:0.0:1788201518.427736:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715441920 00000100:00100000:0.0:1788201518.427755:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788201518.427761:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715441536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201518.427798:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715441536:12345-0@lo:400:kworker.0 Request processed in 36us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201518.427804:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788201518.427816:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788201518.427822:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715441664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201518.427855:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715441664:12345-0@lo:400:kworker.0 Request processed in 33us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201518.427860:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788201518.427871:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788201518.427877:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715441920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201518.427904:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715441920:12345-0@lo:400:kworker.0 Request processed in 27us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201518.427909:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1788201518.427930:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201518.427933:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201518.427956:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715441920:0@lo:400:kworker.0 00000100:00100000:0.0:1788201518.427965:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715441536:0@lo:400:kworker.0 00000100:00100000:0.0:1788201518.427986:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715441664:0@lo:400:kworker.0 00000100:00100000:0.0:1788201518.428053:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715442048:0@lo:400:kworker.0 00000100:00100000:0.0:1788201518.428078:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201518.428145:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715442048 00000100:00100000:0.0:1788201518.428150:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715442048 00000100:00100000:0.0:1788201518.428178:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788201518.428185:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715442048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201518.428219:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715442048:12345-0@lo:400:kworker.0 Request processed in 34us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201518.428226:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:0.0:1788201518.428241:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201518.428255:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715442048:0@lo:400:kworker.0 00000100:00100000:2.0:1788201518.436334:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3656:x1875060715440768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 16677us (16924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201518.436350:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788201518.447587:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715440768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201518.447613:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715441280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201518.927295:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715442176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201518.927395:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201518.927767:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715442176 00000100:00100000:1.0:1788201518.927779:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715442176 00000100:00100000:1.0:1788201518.927843:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788201518.927853:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715442176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201518.927890:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201518.927946:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715442176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201518.927952:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788201518.928047:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715442176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201518.928487:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201518.928500:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715442304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201518.928543:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201518.929671:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715442304 00000100:00100000:2.0:1788201518.929685:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715442304 00000100:00100000:2.0:1788201518.929755:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788201518.929766:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715442304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201518.929803:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201518.929915:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715442304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 151us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201518.929923:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788201518.930485:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715442304:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788201519.250329:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201520.085185:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201520.085235:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201520.085270:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201520.085299:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201520.085322:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201520.085443:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695566592 00000100:00100000:0.0:1788201520.085455:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695566592 00000100:00100000:0.0:1788201520.085530:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695566464 00000100:00100000:0.0:1788201520.085532:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695566464 00000100:00100000:0.0:1788201520.085556:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 119 00000100:00100000:0.0:1788201520.085568:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10785a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695566592:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201520.085658:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10785a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695566592:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 92us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201520.085667:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 119 00000100:00100000:0.0:1788201520.085688:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 120 00000100:00100000:0.0:1788201520.085712:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10785b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695566464:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201520.085751:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10785b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695566464:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 41us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201520.085756:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 120 00000100:00100000:0.0:1788201520.085776:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695566336 00000100:00100000:0.0:1788201520.085780:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695566336 00000100:00100000:0.0:1788201520.085811:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695566208 00000100:00100000:0.0:1788201520.085813:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695566208 00000100:00100000:0.0:1788201520.085830:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1852 00000100:00100000:0.0:1788201520.085835:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10785b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+23:2400:x1875060695566336:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201520.085867:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10785b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+23:2400:x1875060695566336:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 32us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201520.085872:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1852 00000100:00100000:0.0:1788201520.085882:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1853 00000100:00100000:0.0:1788201520.085887:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10785a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2400:x1875060695566208:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201520.085908:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10785a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2400:x1875060695566208:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 21us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201520.085913:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1853 00000100:00080000:3.0:1788201520.086168:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201520.086174:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201520.086177:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201520.086179:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201520.086238:0:102459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695566080 00000100:00100000:1.0:1788201520.086243:0:102459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695566080 00000100:00100000:1.0:1788201520.086290:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 133 00000100:00100000:1.0:1788201520.086308:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695566080:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201520.086337:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695566080:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 32us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201520.086344:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 133 00010000:00010000:1.0:1788201520.280087:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201520.976418:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715442432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201520.976525:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201520.982487:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10785aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715442560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201520.982595:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201520.982693:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715442432 00000100:00100000:2.0:1788201520.982705:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715442432 00000100:00100000:2.0:1788201520.982782:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715442560 00000100:00100000:2.0:1788201520.982786:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715442560 00000100:00100000:2.0:1788201520.982807:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788201520.982818:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715442432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201520.982859:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201520.982943:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715442432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (6419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201520.982963:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788201520.982983:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788201520.982991:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715442560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201520.983010:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3923513344 avail 3691991040 00000100:00080000:3.0:1788201520.986375:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201520.986389:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201520.990808:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715442560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7801us (8196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201520.990844:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788201520.990962:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715442432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201520.995393:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10785aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715442560:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788201521.301673:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201522.321657:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201523.343405:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201523.535327:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201523.535363:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715442688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201523.535467:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201523.535531:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715442688 00000100:00100000:1.0:1788201523.535541:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715442688 00000100:00100000:1.0:1788201523.535608:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788201523.535620:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3656:x1875060715442688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201523.535667:0:101344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444945920 avail 1298706432 00000100:00100000:1.0:1788201523.535726:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3656:x1875060715442688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201523.535734:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788201523.535810:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715442688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201523.535918:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715442816:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201523.535947:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201523.536042:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715442816 00000100:00100000:2.0:1788201523.536048:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715442816 00000100:00100000:2.0:1788201523.536082:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788201523.536091:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715442816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201523.536112:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445376000 avail 1299136512 00000100:00100000:2.0:1788201523.536187:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715442816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201523.536194:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788201523.536210:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715442816:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201523.545221:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715442944:0@lo:400:kworker.0 00000100:00100000:1.0:1788201523.545317:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201523.545563:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715443072:0@lo:400:kworker.0 00000100:00100000:0.0:1788201523.545602:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201523.545674:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715443072 00000100:00100000:0.0:1788201523.545684:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715443072 00000100:00100000:0.0:1788201523.545748:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1854 00000100:00100000:0.0:1788201523.545760:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715443072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201523.545818:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715443072:12345-0@lo:400:kworker.0 Request processed in 61us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201523.545825:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1854 00000100:00100000:0.0:1788201523.545875:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715443072:0@lo:400:kworker.0 00000100:00100000:3.0:1788201523.545955:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715442944 00000100:00100000:3.0:1788201523.545961:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715442944 00000100:00100000:3.0:1788201523.546008:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788201523.546056:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13c3c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715442944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201523.549643:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715443584:0@lo:400:kworker.0 00000100:00100000:2.0:1788201523.549732:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201523.549797:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715444096:0@lo:400:kworker.0 00000100:00100000:2.0:1788201523.549819:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201523.549842:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788201523.549847:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715443456:0@lo:400:kworker.0 00000100:00100000:2.0:1788201523.549874:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201523.549895:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715443968:0@lo:400:kworker.0 00000100:00100000:2.0:1788201523.549925:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201523.549961:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715443584 00000100:00100000:2.0:1788201523.549970:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715443584 00000100:00100000:2.0:1788201523.550049:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715444096 00000100:00100000:2.0:1788201523.550052:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715444096 00000100:00100000:2.0:1788201523.550074:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715443968 00000100:00100000:2.0:1788201523.550076:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715443968 00000100:00100000:2.0:1788201523.550096:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788201523.550122:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715443584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201523.550179:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715443584:12345-0@lo:400:kworker.0 Request processed in 59us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201523.550187:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788201523.550204:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788201523.550210:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715444096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201523.550233:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715444096:12345-0@lo:400:kworker.0 Request processed in 24us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201523.550238:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788201523.550247:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788201523.550252:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715443968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201523.550272:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715443968:12345-0@lo:400:kworker.0 Request processed in 21us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201523.550278:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788201523.550298:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715443456 00000100:00100000:2.0:1788201523.550301:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715443456 00000100:00100000:2.0:1788201523.550328:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1855 00000100:00100000:2.0:1788201523.550334:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715443456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201523.550518:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715443200:0@lo:400:kworker.0 00000100:00100000:0.0:1788201523.550554:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201523.550577:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715443712:0@lo:400:kworker.0 00000100:00100000:0.0:1788201523.550595:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201523.550609:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715444224:0@lo:400:kworker.0 00000100:00100000:0.0:1788201523.550626:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201523.550643:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788201523.550648:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715443328:0@lo:400:kworker.0 00000100:00100000:0.0:1788201523.550668:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201523.550681:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715443840:0@lo:400:kworker.0 00000100:00100000:0.0:1788201523.550698:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201523.550717:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715443712 00000100:00100000:0.0:1788201523.550720:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715443712 00000100:00100000:0.0:1788201523.550747:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788201523.550753:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715443712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201523.550784:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715443712:12345-0@lo:400:kworker.0 Request processed in 31us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201523.550801:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788201523.550820:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715443200 00000100:00100000:0.0:1788201523.550823:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715443200 00000100:00100000:0.0:1788201523.550840:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715444224 00000100:00100000:0.0:1788201523.550842:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715444224 00000100:00100000:0.0:1788201523.550851:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715443328 00000100:00100000:0.0:1788201523.550853:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715443328 00000100:00100000:0.0:1788201523.550865:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715443840 00000100:00100000:0.0:1788201523.550867:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715443840 00000100:00100000:0.0:1788201523.550880:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1856 00000100:00100000:0.0:1788201523.550885:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715443200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201523.550925:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715443200:12345-0@lo:400:kworker.0 Request processed in 40us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201523.550931:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1856 00000100:00100000:0.0:1788201523.550942:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1857 00000100:00100000:0.0:1788201523.550947:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715444224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201523.550969:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715444224:12345-0@lo:400:kworker.0 Request processed in 22us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201523.550975:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1857 00000100:00100000:0.0:1788201523.550983:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1858 00000100:00100000:0.0:1788201523.550988:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715443328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201523.551007:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715443328:12345-0@lo:400:kworker.0 Request processed in 19us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201523.551012:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1858 00000100:00100000:0.0:1788201523.551042:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1859 00000100:00100000:0.0:1788201523.551048:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715443840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201523.551080:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715443840:12345-0@lo:400:kworker.0 Request processed in 32us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201523.551086:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1859 00000100:00100000:0.0:1788201523.551130:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715443328:0@lo:400:kworker.0 00000100:00100000:0.0:1788201523.551139:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715443840:0@lo:400:kworker.0 00000100:00100000:0.0:1788201523.551148:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715443200:0@lo:400:kworker.0 00000100:00100000:0.0:1788201523.551156:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715443712:0@lo:400:kworker.0 00000100:00100000:0.0:1788201523.551163:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715444224:0@lo:400:kworker.0 00000100:00100000:0.0:1788201523.551319:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715443968:0@lo:400:kworker.0 00000100:00100000:0.0:1788201523.551331:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715443584:0@lo:400:kworker.0 00000100:00100000:0.0:1788201523.551353:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715444096:0@lo:400:kworker.0 00000100:00100000:2.0:1788201523.551764:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715443456:12345-0@lo:400:kworker.0 Request processed in 1428us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201523.551773:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1855 00000100:00080000:2.0:1788201523.553650:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201523.553664:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201523.553676:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201523.553680:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201523.554959:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715443456:0@lo:400:kworker.0 00000001:00080000:0.0:1788201523.556986:0:102447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018913 is committed 00000001:00080000:0.0:1788201523.557053:0:102447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018911 is committed 00010000:00010000:2.0:1788201523.557257:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1eba7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201523.557294:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1eba7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201523.557303:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1eba7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201523.557310:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201523.557316:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1eba7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201523.557325:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1eba7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201523.557438:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000090a1:0x7:0x0].0xcd52553e (ffff8dc0054e4500) 00010000:00010000:2.0:1788201523.557443:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201523.557449:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1eba7 lrc: 2/0,0 mode: --/TXN res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201523.557455:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1eba7 lrc: 0/0,0 mode: --/TXN res: [0x2000090a1:0x7:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201523.558734:0:104387:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6200/0x96d0c9b8c9a1ec02 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1ec09 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201523.558755:0:104387:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6200/0x96d0c9b8c9a1ec02 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1ec09 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201523.558817:0:104387:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6200/0x96d0c9b8c9a1ec02 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ec09 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201523.558840:0:104387:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201523.558870:0:104387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6200/0x96d0c9b8c9a1ec02 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ec09 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788201523.558894:0:104387:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378639 is committed 00000100:00100000:2.0:1788201523.558958:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201523.558982:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715444352:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1788201523.559099:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788201523.559285:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ebbc lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201523.559296:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ebbc lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201523.559303:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ebbc lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201523.559310:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201523.559322:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ebbc lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201523.559330:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ebbc lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201523.559410:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d0:0x7:0x0].0xf0209d98 (ffff8dc1030a7400) 00010000:00010000:0.0:1788201523.559414:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201523.559419:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ebbc lrc: 2/0,0 mode: --/TXN res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201523.559426:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ebbc lrc: 0/0,0 mode: --/TXN res: [0x2400088d0:0x7:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201523.559452:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ebd1 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201523.559460:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ebd1 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201523.559466:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ebd1 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201523.559472:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201523.559475:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ebd1 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201523.559481:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ebd1 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201523.559489:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0x9:0x0].0xd1d4b922 (ffff8dc1030a7b00) 00010000:00010000:0.0:1788201523.559492:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201523.559502:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ebd1 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201523.559508:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ebd1 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0x9:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201523.560095:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715444352 00000100:00100000:0.0:1788201523.560110:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715444352 00000100:00100000:0.0:1788201523.560194:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:0.0:1788201523.560205:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715444352:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1788201523.560223:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201523.560248:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1ec09 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb56adc53 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ec02 expref: 6 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201523.560264:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb56adc53 (ffff8dc11248c800) 00010000:00010000:0.0:1788201523.560273:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201523.560725:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715442944:0@lo:400:kworker.0 00000100:00100000:3.0:1788201523.565715:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13c3c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715442944:12345-0@lo:400:kworker.0 Request processed in 19645us (20381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201523.565737:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788201523.569612:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715444352:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 9395us (10499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201523.569631:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00100000:2.0:1788201523.575123:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715444352:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1788201524.049826:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201524.049859:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715444480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201524.049967:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201524.051851:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715444480 00000100:00100000:2.0:1788201524.051871:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715444480 00000100:00100000:2.0:1788201524.051960:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788201524.051973:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715444480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201524.052057:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201524.052192:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715444480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 221us (2225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201524.052201:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788201524.052392:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715444480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201524.053237:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715444608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201524.053305:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201524.053415:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715444608 00000100:00100000:0.0:1788201524.053424:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715444608 00000100:00100000:0.0:1788201524.053478:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788201524.053490:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715444608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201524.053521:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201524.053580:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715444608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201524.053609:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788201524.053656:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715444608:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788201524.374180:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201525.210521:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201525.210574:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201525.210603:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201525.210630:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201525.210653:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201525.210702:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695567232 00000100:00100000:3.0:1788201525.210714:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695567232 00000100:00100000:3.0:1788201525.210801:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695567104 00000100:00100000:3.0:1788201525.210805:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695567104 00000100:00100000:3.0:1788201525.210830:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 125 00000100:00100000:3.0:1788201525.210842:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695567232:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201525.210944:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695567232:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 103us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201525.210952:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 125 00000100:00100000:3.0:1788201525.210972:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 126 00000100:00100000:3.0:1788201525.210979:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695567104:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201525.211005:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695567104:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201525.211012:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 126 00000100:00080000:3.0:1788201525.211073:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201525.211078:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201525.211403:0:102453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695566720 00000100:00100000:0.0:1788201525.211409:0:102453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695566720 00000100:00100000:0.0:1788201525.211453:0:102453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 135 00000100:00100000:0.0:1788201525.211462:0:102453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695566720:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201525.211502:0:102453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695566720:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 41us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201525.211509:0:102453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 135 00000100:00100000:0.0:1788201525.211545:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695566976 00000100:00100000:0.0:1788201525.211550:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695566976 00000100:00100000:0.0:1788201525.211588:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695566848 00000100:00100000:0.0:1788201525.211591:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695566848 00000100:00100000:0.0:1788201525.211614:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1860 00000100:00100000:0.0:1788201525.211620:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695566976:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201525.211654:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695566976:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 34us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201525.211660:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1860 00000100:00100000:0.0:1788201525.211671:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1861 00000100:00100000:0.0:1788201525.211677:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695566848:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201525.211702:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695566848:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 24us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201525.211708:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1861 00000100:00080000:0.0:1788201525.211825:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201525.211837:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:3.0:1788201525.348013:0:105195:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 137c: DNE: create under striped dir, fail MDT1/MDT2 ========================================================== 14:38:43 (1788201523) 00010000:00010000:3.0:1788201525.401948:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201525.708618:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201525.709792:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695567360 00000100:00100000:3.0:1788201525.709810:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695567360 00000100:00100000:3.0:1788201525.709904:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1828 00000100:00100000:3.0:1788201525.709917:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:79301:x1875060695567360:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:3.0:1788201525.709942:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201525.709972:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1ec25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786f6b expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201525.710080:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2800/0x96d0c9b8c9a1ec2c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201525.710095:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2800/0x96d0c9b8c9a1ec2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201525.710111:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2800/0x96d0c9b8c9a1ec2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201525.710173:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788201525.710177:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201525.710747:0:66312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2800/0x96d0c9b8c9a1ec2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201525.710785:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1ec25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f6b expref: 8 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201525.710808:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2800/0x96d0c9b8c9a1ec2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f6b expref: 7 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201525.710834:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008611d00) 00010000:00010000:3.0:1788201525.710838:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201525.710842:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2800, rc 0) 00000100:00100000:3.0:1788201525.711297:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:79301:x1875060695567360:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 1381us (2691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201525.711306:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1828 00000100:00100000:3.0:1788201525.730403:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201525.730543:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695567616 00000100:00100000:1.0:1788201525.730556:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695567616 00000100:00100000:1.0:1788201525.730621:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1829 00000100:00100000:1.0:1788201525.730632:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10785aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:79301:x1875060695567616:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:1.0:1788201525.730653:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201525.730657:0:66757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788201525.730685:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2800/0x96d0c9b8c9a1ec2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f6b expref: 7 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.730724:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008611d00) 00010000:00010000:1.0:1788201525.730735:0:66757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201525.730751:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ec33 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786f72 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.730855:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1ec3a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.730867:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1ec3a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.730888:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1ec3a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.730919:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ec41 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe888c80e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.730926:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ec41 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.730933:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ec41 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201525.731410:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x34:0x0]: returning size 4096 00010000:00010000:1.0:1788201525.731427:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1ec48 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.731436:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1ec48 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.731443:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1ec48 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.731454:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1ec3a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.731461:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1ec3a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.731467:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1ec3a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.731474:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1ec3a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.731480:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201525.731492:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1ec3a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.731501:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1ec3a lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.731510:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0084fbe00) 00010000:00010000:1.0:1788201525.731513:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201525.731518:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1ec3a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.731525:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1ec3a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201525.731539:0:66757:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000980f5ae6 reply state 00000000b1cf7958 transno 128849018914 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ec41 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.731551:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ec41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.731558:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe888c80e (ffff8dc0084fb400) 00010000:00010000:1.0:1788201525.731560:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201525.731562:0:66757:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201525.731593:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ec33 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f72 expref: 9 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.731611:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1ec48 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f72 expref: 8 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.731619:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0x0 (ffff8dc0084fb200) 00010000:00010000:1.0:1788201525.731621:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201525.731631:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e3600, rc 0) 00000100:00100000:1.0:1788201525.731715:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10785aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:79301:x1875060695567616:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 1084us (1318us total) trans 128849018914 rc 0/0 00000100:00100000:1.0:1788201525.731723:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1829 00000100:00100000:1.0:1788201525.773825:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201525.773974:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695567744 00000100:00100000:0.0:1788201525.773983:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695567744 00000100:00100000:1.0:1788201525.774131:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1830 00000100:00100000:1.0:1788201525.774141:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:79302:x1875060695567744:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1788201525.774162:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201525.774181:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ec4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786f79 expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.774235:0:69485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1ec56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.774245:0:69485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1ec56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.774253:0:69485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1ec56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201525.774288:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788201525.774290:0:69485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201525.774305:0:69485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1ec56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 69485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.774323:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ec4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f79 expref: 11 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.774347:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1ec56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f79 expref: 10 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.774372:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0084fbe00) 00010000:00010000:1.0:1788201525.774374:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201525.774377:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e3c00, rc 0) 00000100:00100000:1.0:1788201525.774503:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:79302:x1875060695567744:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 364us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201525.774509:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1830 00000100:00100000:3.0:1788201525.776959:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201525.777272:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695567872 00000100:00100000:2.0:1788201525.777281:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695567872 00000100:00100000:2.0:1788201525.777331:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1831 00000100:00100000:2.0:1788201525.777339:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:79302:x1875060695567872:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1788201525.777355:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201525.777372:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1ec5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786f80 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777422:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ec64 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777446:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ec64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777454:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ec64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777461:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ec6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777466:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ec6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777470:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ec6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777537:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1ec72 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777542:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1ec72 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777546:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1ec72 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201525.777576:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x34:0x0]: returning size 4096 00000004:00200000:2.0:1788201525.777579:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201525.777595:0:66312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1ec72 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777608:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ec64 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777626:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ec64 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777644:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ec64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777652:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ec64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777657:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201525.777668:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ec64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777676:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ec64 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777687:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0084fbe00) 00010000:00010000:2.0:1788201525.777689:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201525.777694:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ec64 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777700:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ec64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777713:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ec6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777719:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ec6b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777724:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ec6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777735:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbca00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201525.777738:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ec6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777743:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ec6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777762:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe888c80e (ffff8dc0084fb400) 00010000:00010000:2.0:1788201525.777764:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201525.777767:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ec6b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777772:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ec6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777796:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1ec5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f80 expref: 12 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777807:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1ec72 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f80 expref: 11 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.777813:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0x0 (ffff8dc0084fb200) 00010000:00010000:2.0:1788201525.777815:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788201525.777817:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbd400, rc 0) 00000100:00100000:2.0:1788201525.777883:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:79302:x1875060695567872:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 543us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201525.777891:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1831 00000100:00100000:3.0:1788201525.788262:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201525.788380:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695568000 00000100:00100000:1.0:1788201525.788391:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695568000 00000100:00100000:1.0:1788201525.788501:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1832 00000100:00100000:1.0:1788201525.788512:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:79302:x1875060695568000:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1788201525.788532:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201525.788553:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ec79 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786f87 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.788619:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ec80 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.788644:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ec80 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.788655:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ec80 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.788677:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1ec87 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.788684:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1ec87 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.788709:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1ec87 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.788766:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ec80 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.788773:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ec80 lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.788779:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ec80 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.788785:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ec80 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.788790:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201525.788794:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ec80 lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.788800:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ec80 lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.788811:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0x0 (ffff8dc0084fb200) 00010000:00010000:1.0:1788201525.788814:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201525.788819:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ec80 lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.788824:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ec80 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.788837:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1ec87 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.788849:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1ec87 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.788855:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1ec87 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.788859:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201525.788862:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1ec87 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.788877:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1ec87 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.788886:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0xd1d4b922 (ffff8dc0084fb300) 00010000:00010000:1.0:1788201525.788888:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201525.788891:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1ec87 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.788897:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1ec87 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.788933:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ec79 lrc: 1/0,0 mode: --/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f87 expref: 12 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.788944:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0x0 (ffff8dc0084fb200) 00010000:00010000:1.0:1788201525.788946:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201525.788950:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ec79 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f87 expref: 12 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.788970:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e2400, rc 0) 00000100:00100000:1.0:1788201525.789094:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:79302:x1875060695568000:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 583us (842us total) trans 0 rc 301/301 00000100:00100000:1.0:1788201525.789102:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1832 00000100:00100000:3.0:1788201525.789998:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201525.790099:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695568128 00000100:00100000:2.0:1788201525.790114:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695568128 00000100:00100000:2.0:1788201525.790168:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 765 00000100:00100000:2.0:1788201525.790179:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1059b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2401:x1875060695568128:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201525.790191:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201525.790207:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1ec72 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f80 expref: 11 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.790222:0:26207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0x0 (ffff8dc0084fb200) 00010000:00010000:2.0:1788201525.790226:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201525.790257:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1059b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2401:x1875060695568128:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 81us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201525.790263:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 765 00000100:00100000:2.0:1788201525.803310:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201525.803449:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695568384 00000100:00100000:1.0:1788201525.803458:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695568384 00000100:00100000:1.0:1788201525.803547:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1833 00000100:00100000:1.0:1788201525.803556:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:79302:x1875060695568384:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1788201525.803574:0:69485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201525.803590:0:69485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ec8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786f8e expref: -99 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201525.804011:0:69485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x34:0x0]: returning size 4096 00010000:00010000:1.0:1788201525.804227:0:69485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ec8e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f8e expref: 12 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.804240:0:69485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0084fbe00) 00010000:00010000:1.0:1788201525.804242:0:69485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201525.804245:0:69485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ec8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f8e expref: 12 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.804256:0:69485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e2400, rc 0) 00000100:00100000:1.0:1788201525.804346:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:79302:x1875060695568384:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 791us (1048us total) trans 128849018915 rc 301/301 00000100:00100000:1.0:1788201525.804352:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1833 00000100:00100000:3.0:1788201525.806218:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201525.806281:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695568640 00000100:00100000:0.0:1788201525.806289:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695568640 00000100:00100000:0.0:1788201525.806338:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1834 00000100:00100000:0.0:1788201525.806345:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:79302:x1875060695568640:12345-192.168.201.20@tcp:36:lfs.0 00000100:00100000:0.0:1788201525.806477:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715444736:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201525.806527:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201525.806554:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc119a800c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201525.807447:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715444736 00000100:00100000:3.0:1788201525.807455:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715444736 00000100:00100000:3.0:1788201525.807574:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788201525.807586:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:66313:x1875060715444736:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788201525.807690:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:66313:x1875060715444736:12345-0@lo:1000:mdt00_001.0 Request processed in 107us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201525.807698:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788201525.807784:0:66313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018913 gen 2 00000004:00080000:0.0:1788201525.807791:0:66313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018909 committed transno 128849018913 00000020:00080000:0.0:1788201525.807797:0:66313:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8dc13a875840 refcount 2 committed 0 result 0 batchid 77309411500 00000020:00080000:0.0:1788201525.807801:0:66313:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc1097fa600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8dc13a875f00 00000020:00080000:0.0:1788201525.807804:0:66313:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x20000e691:0x1:0x0].1 00000020:00080000:0.0:1788201525.807806:0:66313:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc1097faa00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dc0075eb800 00000020:00080000:0.0:1788201525.807809:0:66313:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2400090a0:0x1:0x0].1 00000004:00080000:0.0:1788201525.807878:0:66313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018912 committed transno 128849018913 00000020:00080000:0.0:1788201525.807883:0:66313:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8dc11199e180 refcount 2 committed 0 result 0 batchid 77309411501 00000020:00080000:0.0:1788201525.807886:0:66313:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc140d8cf00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8dc1065c7cc0 00000020:00080000:0.0:1788201525.807890:0:66313:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x20000e691:0x1:0x0].2 00000020:00080000:0.0:1788201525.807892:0:66313:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc140d8c100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dc006c5be00 00000020:00080000:0.0:1788201525.807894:0:66313:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2400090a0:0x1:0x0].2 00000004:00080000:0.0:1788201525.807904:0:66313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018913 committed transno 128849018913 00000020:00080000:0.0:1788201525.807907:0:66313:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8dc10a1bd780 refcount 2 committed 0 result 0 batchid 77309411502 00000020:00080000:0.0:1788201525.807910:0:66313:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc140d8c600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8dc10a1bde40 00000020:00080000:0.0:1788201525.807922:0:66313:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x20000e691:0x1:0x0].3 00000020:00080000:0.0:1788201525.807925:0:66313:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc140d8cc00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dc006c5b400 00000020:00080000:0.0:1788201525.807927:0:66313:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2400090a0:0x1:0x0].3 00000100:00100000:0.0:1788201525.807944:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715444736:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201525.808012:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715444864:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201525.808077:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788201525.808137:0:104407:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411502 committed batchid 73014444104 00000020:00080000:1.0:1788201525.808225:0:104407:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444104 00000100:00100000:0.0:1788201525.810428:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc119a80cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201525.810890:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715444864 00000100:00100000:2.0:1788201525.810899:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715444864 00000100:00100000:3.0:1788201525.811083:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788201525.811108:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:66313:x1875060715444864:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788201525.811253:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:66313:x1875060715444864:12345-0@lo:1000:mdt00_001.0 Request processed in 160us (3174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201525.811261:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788201525.811351:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715444864:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201525.811423:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715444992:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201525.811459:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201525.812087:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc119a800c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201525.812183:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715444992 00000100:00100000:1.0:1788201525.812191:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715444992 00000100:00100000:1.0:1788201525.812225:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788201525.812233:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:66313:x1875060715444992:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201525.812311:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:66313:x1875060715444992:12345-0@lo:1000:mdt00_001.0 Request processed in 79us (851us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201525.812318:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788201525.812442:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715444992:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788201525.812554:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1ec9c lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201525.812566:0:66313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1ec9c lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201525.812575:0:66313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1ec9c lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201525.812589:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715445120:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1788201525.812619:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201525.812654:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0034c7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201525.812894:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715445120 00000100:00100000:1.0:1788201525.812900:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715445120 00000100:00100000:1.0:1788201525.812919:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788201525.812925:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:66313:x1875060715445120:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1788201525.812935:0:101344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201525.812950:0:101344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1eca3 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ec9c expref: -99 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.812976:0:101344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1ec48 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f72 expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.812986:0:101344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1eca3 lrc: 4/0,0 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ec9c expref: 6 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.813009:0:101344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1ec48 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f72 expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.813064:0:101344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1ec48 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f72 expref: 10 pid: 66757 timeout: 4477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201525.813171:0:101344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:101344:1875060715445248:192.168.201.20@tcp:104: 00000100:00100000:1.0:1788201525.813307:0:101344:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1065c7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201525.815419:0:101344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:101344:1875060715445248:192.168.201.20@tcp:104: 00010000:00010000:1.0:1788201525.815450:0:101344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1eca3 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ec9c expref: 6 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.815464:0:101344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0x0 (ffff8dc0084fb200) 00010000:00010000:1.0:1788201525.815467:0:101344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201525.815471:0:101344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1eca3 lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ec9c expref: 6 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.815481:0:101344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e2600, rc 0) 00000100:00100000:1.0:1788201525.815546:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:66313:x1875060715445120:12345-0@lo:101:mdt00_001.0 Request processed in 2620us (2926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201525.815554:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788201525.815644:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715445120:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1788201525.815674:0:66313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1ec9c lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1eca3 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201525.815700:0:66313:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1ec9c lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1eca3 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201525.816257:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201525.816499:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695568768 00000100:00100000:2.0:1788201525.816507:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695568768 00010000:00010000:2.0:1788201525.816538:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1ec48 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f72 expref: 11 pid: 66757 timeout: 4477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201525.816616:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2635 00000100:00100000:2.0:1788201525.816626:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2401:x1875060695568768:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788201525.816652:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201525.816659:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1ec48 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f72 expref: 11 pid: 66757 timeout: 4477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.816680:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1ec48 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f72 expref: 11 pid: 66757 timeout: 4477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.816708:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3600/0x96d0c9b8c9a1ec48 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f72 expref: 11 pid: 66757 timeout: 4477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.816878:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0x0 (ffff8dc0084fb200) 00010000:00010000:2.0:1788201525.816886:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1eca3 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ec9c expref: 5 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.816895:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1eca3 lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ec9c expref: 5 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.816903:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1eca3 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ec9c expref: 5 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.816937:0:6519:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1eca3 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ec9c expref: 5 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201525.816952:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6519:1875060715445376:0@lo:105: 00000100:00100000:2.0:1788201525.816999:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201525.817100:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc107276600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201525.817269:0:6516:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788201525.817288:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715445376 00000100:00100000:3.0:1788201525.817293:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715445376 00000100:00100000:3.0:1788201525.817331:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1788201525.817338:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc35450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6519:x1875060715445376:12345-0@lo:105: 00010000:00010000:3.0:1788201525.817348:0:6516:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1ec9c lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1eca3 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201525.817358:0:6516:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1ec9c lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1eca3 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201525.817366:0:6516:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1ec9c lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1eca3 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201525.817373:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1ec9c lrc: 5/0,1 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x96d0c9b8c9a1eca3 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201525.817380:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1ec9c lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x96d0c9b8c9a1eca3 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201525.817390:0:6516:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1ec9c lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x96d0c9b8c9a1eca3 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201525.817418:0:6516:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8dc0056d7400) 00000100:00100000:3.0:1788201525.817459:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc35450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6519:x1875060715445376:12345-0@lo:105: Request processed in 121us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201525.817466:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1788201525.817532:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6519:1875060715445376:0@lo:105: 00010000:00010000:3.0:1788201525.817551:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201525.817595:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2401:x1875060695568768:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 970us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201525.817602:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2635 00010000:00010000:1.0:1788201525.817659:0:66313:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1ec9c lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1eca3 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.817677:0:66313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1ec9c lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1eca3 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201525.817698:0:66313:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x34:0x0] 00010000:00010000:1.0:1788201525.817744:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ecaa lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.817752:0:66313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ecaa lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.817769:0:66313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ecaa lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201525.817784:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715445504:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1788201525.817813:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201525.817829:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1065c7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201525.818164:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715445504 00000100:00100000:2.0:1788201525.818170:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715445504 00000100:00100000:2.0:1788201525.818211:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788201525.818220:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:66313:x1875060715445504:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1788201525.818236:0:66318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201525.818252:0:66318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ecb1 lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ecaa expref: -99 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.818298:0:66318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ecb1 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ecaa expref: 7 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.818310:0:66318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ecb1 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ecaa expref: 7 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201525.818318:0:66318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0xd1d4b922 (ffff8dc11248ca00) 00010000:00010000:2.0:1788201525.818321:0:66318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201525.818324:0:66318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbca00, rc 0) 00000100:00100000:2.0:1788201525.818376:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:66313:x1875060715445504:12345-0@lo:101:mdt00_001.0 Request processed in 157us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201525.818382:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788201525.818704:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715445504:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1788201525.818718:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ecaa lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ecb1 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.818793:0:66313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ecaa lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ecb1 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201525.818808:0:66313:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x34:0x0] 00000100:00100000:1.0:1788201525.818844:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715445632:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201525.818886:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201525.818915:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007486300 going to sleep for 11 seconds 00000100:00100000:2.0:1788201525.818978:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715445632 00000100:00100000:2.0:1788201525.818983:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715445632 00000100:00100000:2.0:1788201525.819230:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788201525.819239:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:66313:x1875060715445632:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788201525.819311:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:66313:x1875060715445632:12345-0@lo:1000:mdt00_001.0 Request processed in 72us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201525.819318:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788201525.819399:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715445632:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201525.820253:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715445760:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201525.820295:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201525.820323:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1065c7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201525.823035:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715445760 00000100:00100000:2.0:1788201525.823052:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715445760 00000100:00100000:2.0:1788201525.823123:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788201525.823134:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:66313:x1875060715445760:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788201525.823292:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:66313:x1875060715445760:12345-0@lo:1000:mdt00_001.0 Request processed in 159us (2996us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201525.823300:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788201525.823325:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715445760:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201525.823446:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715445888:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201525.823762:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201525.823797:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc119a800c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201525.823901:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715445888 00000100:00100000:2.0:1788201525.823907:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715445888 00000100:00100000:2.0:1788201525.823943:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788201525.823951:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:66313:x1875060715445888:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788201525.824051:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:66313:x1875060715445888:12345-0@lo:1000:mdt00_001.0 Request processed in 100us (288us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201525.824058:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788201525.824154:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715445888:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201525.824209:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715446016:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201525.824240:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201525.824265:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007486780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201525.824321:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715446016 00000100:00100000:3.0:1788201525.824326:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715446016 00000100:00100000:3.0:1788201525.824362:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788201525.824369:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:66313:x1875060715446016:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788201525.824433:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:66313:x1875060715446016:12345-0@lo:1000:mdt00_001.0 Request processed in 64us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201525.824440:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788201525.824531:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715446016:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201525.824570:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715446144:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201525.824590:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201525.824618:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007486780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201525.824769:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715446144 00000100:00100000:0.0:1788201525.824774:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715446144 00000100:00100000:0.0:1788201525.824811:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788201525.824819:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:66313:x1875060715446144:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788201525.824905:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:66313:x1875060715446144:12345-0@lo:1000:mdt00_001.0 Request processed in 86us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201525.824912:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788201525.824933:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715446144:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201525.824971:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715446272:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788201525.824994:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201525.825034:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007486780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201525.825101:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715446272 00000100:00100000:2.0:1788201525.825106:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715446272 00000100:00100000:2.0:1788201525.825135:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788201525.825141:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:66313:x1875060715446272:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788201525.825202:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:66313:x1875060715446272:12345-0@lo:1000:mdt00_001.0 Request processed in 61us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201525.825208:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788201525.825261:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715446272:0@lo:1000:mdt00_001.0 00000040:00080000:1.0:1788201525.825973:0:66313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x1:0x0].4, 2152 off36632 00000040:00080000:1.0:1788201525.826084:0:66313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000e691:0x1:0x0].4, 2352 off37072 00000004:00080000:1.0:1788201525.826090:0:66313:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc007486d80 with version 10 00000004:00080000:0.0:1788201525.826303:0:104392:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc10555e300 version 10 rpc_version 10 00000020:00100000:0.0:1788201525.826331:0:104392:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788201525.826339:0:104392:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc12efc8a80 x1875060715446528/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201525.826356:0:104392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715446528:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788201525.826400:0:104392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201525.826438:0:104392:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0034c7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201525.826486:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715446528 00000100:00100000:2.0:1788201525.826491:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715446528 00000100:00100000:2.0:1788201525.826527:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788201525.826534:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:104392:x1875060715446528:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788201525.827070:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:104392:x1875060715446528:12345-0@lo:1000:osp_up0-1.0 Request processed in 536us (668us total) trans 128849018916 rc 0/0 00000100:00100000:2.0:1788201525.827079:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788201525.827889:0:104392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715446528:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1788201525.828107:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ecb8 lrc: 3/0,1 mode: --/PW res: [0x2400088d5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.828123:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ecb8 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.828136:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ecb8 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.828151:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ecbf lrc: 3/0,1 mode: --/PW res: [0x2400090a0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.828158:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ecbf lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.828164:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ecbf lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.828189:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1ecc6 lrc: 3/0,1 mode: --/PW res: [0x20000e691:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.828195:0:66313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1ecc6 lrc: 3/0,1 mode: --/PW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.828213:0:66313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1ecc6 lrc: 3/0,1 mode: --/PW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201525.828228:0:66313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715446656:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1788201525.828263:0:66313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201525.828288:0:66313:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007486300 going to sleep for 11 seconds 00000100:00100000:3.0:1788201525.828357:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715446656 00000100:00100000:3.0:1788201525.828363:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715446656 00000100:00100000:3.0:1788201525.828395:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788201525.828402:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:66313:x1875060715446656:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1788201525.828417:0:66317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201525.828431:0:66317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3a00/0x96d0c9b8c9a1eccd lrc: 2/0,0 mode: --/PW res: [0x20000e691:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ecc6 expref: -99 pid: 66317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201525.828449:0:66317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3a00/0x96d0c9b8c9a1eccd lrc: 3/0,0 mode: PW/PW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ecc6 expref: 9 pid: 66317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201525.828459:0:66317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3a00/0x96d0c9b8c9a1eccd lrc: 3/0,0 mode: PW/PW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ecc6 expref: 9 pid: 66317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201525.828467:0:66317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000e691:0x3:0x0].0x0 (ffff8dc008611f00) 00010000:00010000:3.0:1788201525.828470:0:66317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201525.828474:0:66317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3a00, rc 0) 00000100:00100000:3.0:1788201525.828508:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:66313:x1875060715446656:12345-0@lo:101:mdt00_001.0 Request processed in 106us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201525.828519:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788201525.828622:0:66313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66313:1875060715446656:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1788201525.828634:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1ecc6 lrc: 4/0,1 mode: PW/PW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1eccd expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.828643:0:66313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1ecc6 lrc: 4/0,1 mode: PW/PW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1eccd expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201525.828660:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c83eb16 reply state 00000000f9249524 transno 81604378640 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ecbf lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.828671:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ecbf lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.828688:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x3:0x0].0x0 (ffff8dc0084fb100) 00010000:00010000:1.0:1788201525.828691:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201525.828693:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201525.828699:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1ecc6 lrc: 4/0,1 mode: PW/PW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1eccd expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.828707:0:66313:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1ecc6 lrc: 3/0,0 mode: PW/PW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1eccd expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788201525.828731:0:66313:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000e691:0x3:0x0] 00000004:00010000:1.0:1788201525.828737:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c83eb16 reply state 00000000f9249524 transno 81604378640 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ecb8 lrc: 3/0,1 mode: PW/PW res: [0x2400088d5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.828744:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ecb8 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.828750:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xc:0x0].0x0 (ffff8dc0084fb800) 00010000:00010000:1.0:1788201525.828752:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201525.828754:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1788201525.828758:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xc:0x0]: returning size 4096 00000004:00080000:1.0:1788201525.828763:0:66313:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x34:0x0] 00010000:00010000:1.0:1788201525.828769:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1ec9c lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1eca3 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.828776:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1ec9c lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1eca3 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.828784:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1ec9c lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1eca3 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.828800:0:66313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788201525.828803:0:66313:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x34:0x0] 00010000:00010000:1.0:1788201525.828807:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ecaa lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ecb1 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201525.828814:0:66313:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ecaa lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ecb1 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201525.828833:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201525.828841:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1ec9c lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1eca3 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201525.828851:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7400 already unused, calling callback (ffffffffc189cee0) 00010000:00010000:0.0:1788201525.828857:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1ec9c lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1eca3 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201525.828881:0:6520:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1ec9c lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1eca3 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201525.828908:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:79302:x1875060695568640:12345-192.168.201.20@tcp:36:lfs.0 Request processed in 22559us (22691us total) trans 81604378640 rc 0/0 00010000:00010000:0.0:1788201525.828909:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1ec9c lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1eca3 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201525.828919:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1834 00010000:00010000:0.0:1788201525.828924:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201525.828954:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1ec9c lrc: 1/0,0 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1eca3 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201525.828962:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1788201525.828963:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7400/0x96d0c9b8c9a1ec9c lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1eca3 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201525.828973:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715446784:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201525.828985:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201525.828989:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201525.828992:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201525.829004:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201525.829069:0:9535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715446784 00000100:00100000:0.0:1788201525.829075:0:9535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715446784 00000100:00100000:0.0:1788201525.829232:0:9535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00000100:00100000:0.0:1788201525.829241:0:9535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3656:x1875060715446784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201525.829258:0:9535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201525.829272:0:9535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2600/0x96d0c9b8c9a1eca3 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ec9c expref: 9 pid: 101344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201525.829284:0:9535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0x0 (ffff8dc0084fb200) 00010000:00010000:0.0:1788201525.829292:0:9535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201525.829336:0:9535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3656:x1875060715446784:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201525.829342:0:9535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00000100:00100000:2.0:1788201525.829511:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715446784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201525.831515:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201525.831569:0:66316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695569024 00000100:00100000:1.0:1788201525.831579:0:66316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695569024 00000100:00100000:1.0:1788201525.831631:0:66316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 325 00000100:00100000:1.0:1788201525.831779:0:66316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:79302:x1875060695569024:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:1.0:1788201525.832038:0:66316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:79302:x1875060695569024:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 262us (528us total) trans 128849018917 rc 0/0 00000100:00100000:1.0:1788201525.832172:0:66316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 325 00000100:00100000:3.0:1788201526.095254:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715446912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201526.095322:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201526.095550:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715446912 00000100:00100000:2.0:1788201526.095558:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715446912 00000100:00100000:2.0:1788201526.095611:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788201526.095621:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715446912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201526.095668:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201526.096033:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715446912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 396us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201526.096042:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:2.0:1788201526.096063:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201526.096122:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201526.096132:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715447040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201526.096162:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201526.096203:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715447040 00000100:00100000:2.0:1788201526.096207:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715447040 00000100:00100000:2.0:1788201526.096233:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788201526.096239:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715447040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201526.096255:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201526.096287:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715447040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201526.096293:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1788201526.096306:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201526.096333:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715447040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201526.102645:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715446912:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788201526.417521:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201526.627559:0:104387:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ecaa lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1ecb1 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201526.627580:0:104387:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ecaa lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1ecb1 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.627627:0:104387:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ecaa lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ecb1 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.627635:0:104387:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201526.627661:0:104387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ecaa lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ecb1 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.627695:0:104387:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1ecc6 lrc: 3/0,0 mode: PW/PW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1eccd expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201526.627704:0:104387:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1ecc6 lrc: 3/0,0 mode: PW/PW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1eccd expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.627722:0:104387:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1ecc6 lrc: 2/0,0 mode: --/PW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1eccd expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.627728:0:104387:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201526.627880:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ecb8 lrc: 3/0,1 mode: TXN/TXN res: [0x2400088d5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.627888:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ecb8 lrc: 2/0,0 mode: TXN/TXN res: [0x2400088d5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.627895:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ecb8 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.627901:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201526.627906:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ecb8 lrc: 3/0,0 mode: TXN/TXN res: [0x2400088d5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.627913:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ecb8 lrc: 4/0,0 mode: TXN/TXN res: [0x2400088d5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.627928:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xc:0x0].0x0 (ffff8dc0084fb800) 00010000:00010000:0.0:1788201526.627932:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201526.627936:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ecb8 lrc: 2/0,0 mode: --/TXN res: [0x2400088d5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.627942:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ecb8 lrc: 0/0,0 mode: --/TXN res: [0x2400088d5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.627966:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ecbf lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.627973:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ecbf lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.627979:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ecbf lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.627984:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201526.627987:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ecbf lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.627993:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ecbf lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.628000:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x3:0x0].0x0 (ffff8dc0084fb100) 00010000:00010000:0.0:1788201526.628002:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201526.628005:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ecbf lrc: 2/0,0 mode: --/TXN res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.628011:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ecbf lrc: 0/0,0 mode: --/TXN res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201526.628054:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201526.628070:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715447168:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1788201526.628136:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201526.628175:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715447296:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1788201526.628197:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201526.628236:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715447168 00000100:00100000:0.0:1788201526.628244:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715447168 00010000:00010000:2.0:1788201526.630686:0:104387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1ecc6 lrc: 0/0,0 mode: --/PW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1eccd expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788201526.630721:0:104387:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378640 is committed 00000020:00080000:2.0:1788201526.630737:0:104387:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411502 batchid updated 00000100:00100000:0.0:1788201526.630824:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715447296 00000100:00100000:0.0:1788201526.630835:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715447296 00000100:00100000:1.0:1788201526.630935:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:1.0:1788201526.630947:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3657:x1875060715447168:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1788201526.630963:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201526.630989:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ecb1 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ecaa expref: 9 pid: 66318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201526.631003:0:26207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0xd1d4b922 (ffff8dc11248ca00) 00010000:00010000:1.0:1788201526.631011:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201526.631111:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3657:x1875060715447168:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 167us (2974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201526.631138:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00000100:00100000:1.0:1788201526.631158:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 768 00000100:00100000:1.0:1788201526.631164:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+7:3655:x1875060715447296:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1788201526.631174:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201526.631185:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3a00/0x96d0c9b8c9a1eccd lrc: 0/0,0 mode: --/PW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ecc6 expref: 7 pid: 66317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201526.631195:0:26207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000e691:0x3:0x0].0x0 (ffff8dc008611f00) 00010000:00010000:1.0:1788201526.631201:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201526.631232:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715447296:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 68us (3033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201526.631238:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 768 00000020:00080000:1.0:1788201526.631255:0:104407:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411502 00000004:00080000:1.0:1788201526.631311:0:104407:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc004bde480 with version 11 00000020:00080000:1.0:1788201526.631322:0:104407:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411500 cancel update log [0x20000e691:0x1:0x0].1: rc = 0 00000100:00100000:2.0:1788201526.631453:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715447168:0@lo:103:jbd2/dm-1-8.0 00000020:00080000:1.0:1788201526.631633:0:104407:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411500 cancel update log [0x2400090a0:0x1:0x0].1: rc = 0 00000004:00080000:1.0:1788201526.631656:0:104407:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc004bdecc0 with version 12 00000020:00080000:1.0:1788201526.631660:0:104407:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411501 cancel update log [0x20000e691:0x1:0x0].2: rc = 0 00000020:00080000:1.0:1788201526.631678:0:104407:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411501 cancel update log [0x2400090a0:0x1:0x0].2: rc = 0 00000004:00080000:1.0:1788201526.631698:0:104407:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc004bde540 with version 13 00000020:00080000:1.0:1788201526.631701:0:104407:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411502 cancel update log [0x20000e691:0x1:0x0].3: rc = 0 00000020:00080000:1.0:1788201526.631719:0:104407:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411502 cancel update log [0x2400090a0:0x1:0x0].3: rc = 0 00000020:00080000:1.0:1788201526.631724:0:104407:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411502 00000004:00080000:1.0:1788201526.631733:0:104392:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc10555e300 version 11 rpc_version 11 00000020:00100000:1.0:1788201526.631765:0:104392:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788201526.631773:0:104392:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc004b3b480 x1875060715447552/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201526.631794:0:104392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3b480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715447552:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788201526.631832:0:104392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201526.631903:0:104392:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125a96180 going to sleep for 11 seconds 00000100:00100000:1.0:1788201526.631931:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715447296:0@lo:103:jbd2/dm-1-8.0 00000001:00080000:0.0:1788201526.632843:0:102447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018917 is committed 00000001:00080000:0.0:1788201526.632865:0:102447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018916 is committed 00010000:00010000:0.0:1788201526.632891:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ec41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.632900:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ec41 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.632908:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ec41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.632915:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201526.632920:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ec41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.632927:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ec41 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.632940:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe888c80e (ffff8dc0084fb400) 00010000:00010000:0.0:1788201526.632943:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201526.632948:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ec41 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.632955:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ec41 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201526.635952:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715447552 00000100:00100000:2.0:1788201526.635967:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715447552 00000100:00100000:2.0:1788201526.637153:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788201526.637172:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:104392:x1875060715447552:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201526.640362:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:104392:x1875060715447552:12345-0@lo:1000:osp_up0-1.0 Request processed in 3188us (8520us total) trans 128849018918 rc 0/0 00000100:00100000:3.0:1788201526.640378:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788201526.645541:0:104392:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018916 gen 2 00000004:00080000:2.0:1788201526.645555:0:104392:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018916 committed transno 128849018916 00000020:00080000:2.0:1788201526.645562:0:104392:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8dc007486780 refcount 2 committed 0 result 0 batchid 77309411503 00000020:00080000:2.0:1788201526.645567:0:104392:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc109786800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8dc007486d80 00000020:00080000:2.0:1788201526.645571:0:104392:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x20000e691:0x1:0x0].4 00000020:00080000:2.0:1788201526.645574:0:104392:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc109786500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dc00737b400 00000020:00080000:2.0:1788201526.645598:0:104392:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2400090a0:0x1:0x0].4 00000100:00100000:2.0:1788201526.645659:0:104392:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8dc004b3b480 x1875060715447552/t128849018918(128849018918) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788201542 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201526.645680:0:104392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3b480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715447552:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1788201526.645693:0:104392:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc10555e300 version 12 rpc_version 12 00000020:00100000:2.0:1788201526.645719:0:104392:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788201526.645725:0:104392:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc13a91ce00 x1875060715447808/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201526.645745:0:104392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91ce00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715447808:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788201526.645809:0:104392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201526.645870:0:104392:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc107276d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201526.646052:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715447808 00000100:00100000:3.0:1788201526.646059:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715447808 00000100:00100000:3.0:1788201526.646107:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788201526.646117:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:104392:x1875060715447808:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201526.646270:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:104392:x1875060715447808:12345-0@lo:1000:osp_up0-1.0 Request processed in 154us (460us total) trans 128849018919 rc 0/0 00000100:00100000:3.0:1788201526.646279:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000020:00080000:0.0:1788201526.646381:0:104407:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411503 committed batchid 77309411502 00000020:00080000:0.0:1788201526.646422:0:104407:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411502 00000100:00100000:2.0:1788201526.648573:0:104392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91ce00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715447808:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1788201526.648590:0:104392:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc10555e300 version 13 rpc_version 13 00000020:00100000:2.0:1788201526.648628:0:104392:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788201526.648634:0:104392:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc13a91d880 x1875060715448064/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201526.648656:0:104392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91d880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715448064:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788201526.648712:0:104392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201526.648764:0:104392:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc107276d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788201526.648825:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715448064 00000100:00100000:3.0:1788201526.648832:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715448064 00000100:00100000:3.0:1788201526.648899:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788201526.648909:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:104392:x1875060715448064:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201526.649094:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:104392:x1875060715448064:12345-0@lo:1000:osp_up0-1.0 Request processed in 186us (381us total) trans 128849018920 rc 0/0 00000100:00100000:3.0:1788201526.649102:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788201526.649369:0:104392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91d880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715448064:0@lo:1000:osp_up0-1.0 00000020:00080000:2.0:1788201526.661052:0:104387:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411503 batchid updated 00000020:00080000:2.0:1788201526.661080:0:104407:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411503 00000004:00080000:2.0:1788201526.661139:0:104407:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc107276d80 with version 14 00000020:00080000:2.0:1788201526.661149:0:104407:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411503 cancel update log [0x20000e691:0x1:0x0].4: rc = 0 00000020:00080000:2.0:1788201526.661221:0:104407:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411503 cancel update log [0x2400090a0:0x1:0x0].4: rc = 0 00000020:00080000:2.0:1788201526.661244:0:104407:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411503 00000004:00080000:2.0:1788201526.661254:0:104392:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc10555e300 version 14 rpc_version 14 00000020:00100000:2.0:1788201526.661283:0:104392:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788201526.661294:0:104392:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc13a91ed80 x1875060715448320/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201526.661317:0:104392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91ed80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715448320:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788201526.661456:0:104392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201526.661561:0:104392:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc107276600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201526.661584:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715448320 00000100:00100000:2.0:1788201526.661590:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715448320 00000100:00100000:2.0:1788201526.661694:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788201526.661704:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:104392:x1875060715448320:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:3.0:1788201526.663644:0:102447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018920 is committed 00000100:00100000:2.0:1788201526.663840:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:104392:x1875060715448320:12345-0@lo:1000:osp_up0-1.0 Request processed in 2134us (2381us total) trans 128849018921 rc 0/0 00000100:00100000:2.0:1788201526.663861:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788201526.663964:0:104392:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018920 gen 2 00000004:00080000:3.0:1788201526.663971:0:104392:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018918 committed transno 128849018920 00000004:00080000:3.0:1788201526.663998:0:104392:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018919 committed transno 128849018920 00000004:00080000:3.0:1788201526.664007:0:104392:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018920 committed transno 128849018920 00000100:00100000:3.0:1788201526.664125:0:104392:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8dc13a91ed80 x1875060715448320/t128849018921(128849018921) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788201542 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201526.664146:0:104392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91ed80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:104392:1875060715448320:0@lo:1000:osp_up0-1.0 00000001:00080000:3.0:1788201526.665556:0:102447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018921 is committed 00000100:00100000:2.0:1788201526.751718:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201526.752248:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695569152 00000100:00100000:0.0:1788201526.752259:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695569152 00000100:00100000:0.0:1788201526.752317:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1835 00000100:00100000:0.0:1788201526.752429:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:79311:x1875060695569152:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:0.0:1788201526.752476:0:66757:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444929536 avail 1298690048 00000100:00100000:0.0:1788201526.754355:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:79311:x1875060695569152:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 2020us (2640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201526.754369:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1835 00000100:00100000:2.0:1788201526.768615:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201526.768700:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695569280 00000100:00100000:3.0:1788201526.768711:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695569280 00000100:00100000:3.0:1788201526.768786:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1836 00000100:00100000:3.0:1788201526.768797:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:79311:x1875060695569280:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:3.0:1788201526.768847:0:69485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445363712 avail 1299124224 00000100:00100000:3.0:1788201526.768927:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:79311:x1875060695569280:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 131us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201526.768935:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1836 00000100:00100000:3.0:1788201526.779409:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201526.779490:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695569408 00000100:00100000:1.0:1788201526.779503:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695569408 00000100:00100000:1.0:1788201526.779568:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 116 00000100:00100000:1.0:1788201526.779579:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:79311:x1875060695569408:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:1.0:1788201526.779604:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1788201526.779679:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:79311:x1875060695569408:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 101us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201526.779687:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 116 00000100:00100000:2.0:1788201526.789372:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201526.797813:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695569536 00000100:00100000:1.0:1788201526.797829:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695569536 00000100:00100000:1.0:1788201526.797949:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 117 00000100:00100000:1.0:1788201526.797961:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:79311:x1875060695569536:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:1.0:1788201526.797988:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201526.798091:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:79311:x1875060695569536:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 132us (8730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201526.798099:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 117 00000100:00100000:3.0:1788201526.899177:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201526.903110:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695569792 00000100:00100000:0.0:1788201526.903124:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695569792 00000100:00100000:0.0:1788201526.903201:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1837 00000100:00100000:0.0:1788201526.903219:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:79318:x1875060695569792:12345-192.168.201.20@tcp:36:mcreate.0 00010000:00010000:0.0:1788201526.903277:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201526.903305:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1ec56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f79 expref: 7 pid: 69485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.903325:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0084fbe00) 00010000:00010000:0.0:1788201526.903336:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201526.903398:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ecd4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.903410:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ecd4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.903420:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ecd4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.903430:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1ecdb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.903448:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1ecdb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.903455:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1ecdb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.903807:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ecd4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.903817:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ecd4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.903823:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ecd4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.903829:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ecd4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.903835:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201526.903839:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ecd4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.903845:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ecd4 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.903866:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc1030a7200) 00010000:00010000:0.0:1788201526.903869:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201526.903873:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ecd4 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.903879:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ecd4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201526.903901:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005771875e reply state 00000000c612f71a transno 128849018922 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1ecdb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.903911:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1ecdb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.903918:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc1030a7f00) 00010000:00010000:0.0:1788201526.903920:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201526.903923:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788201526.903999:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:79318:x1875060695569792:12345-192.168.201.20@tcp:36:mcreate.0 Request processed in 781us (4833us total) trans 128849018922 rc 0/0 00000100:00100000:0.0:1788201526.904006:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1837 00000100:00100000:0.0:1788201526.932925:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201526.933088:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695569920 00000100:00100000:1.0:1788201526.933099:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695569920 00000100:00100000:1.0:1788201526.933165:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1838 00000100:00100000:1.0:1788201526.933194:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:79321:x1875060695569920:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:1.0:1788201526.933312:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201526.933336:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1ece2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786f95 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201526.933407:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1ece9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201526.933424:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1ece9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201526.933438:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1ece9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201526.933501:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788201526.933504:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201526.933523:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1ece9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201526.933548:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1ece2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f95 expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201526.933567:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1ece9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f95 expref: 9 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201526.933575:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0084fb300) 00010000:00010000:1.0:1788201526.933578:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201526.933582:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e3c00, rc 0) 00000100:00100000:1.0:1788201526.933727:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:79321:x1875060695569920:12345-192.168.201.20@tcp:101:rm.0 Request processed in 535us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201526.933744:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1838 00000100:00100000:0.0:1788201526.937982:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201526.938383:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695570048 00000100:00100000:2.0:1788201526.938392:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695570048 00000100:00100000:2.0:1788201526.938434:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1839 00000100:00100000:2.0:1788201526.938440:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:79321:x1875060695570048:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:2.0:1788201526.938459:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201526.938478:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ecf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786f9c expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.938539:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ecf7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.938563:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ecf7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.938572:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ecf7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.938580:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1ecfe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.938585:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1ecfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.938588:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1ecfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.938952:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1ed05 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.938961:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1ed05 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.938969:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1ed05 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201526.939151:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x35:0x0]: returning size 0 00000004:00200000:2.0:1788201526.939155:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201526.939319:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1ed05 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.939330:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1ed05 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.939337:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ecf7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.939341:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ecf7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.939345:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ecf7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.939349:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ecf7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.939360:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201526.939363:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ecf7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.939368:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ecf7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.939377:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0084fb300) 00010000:00010000:0.0:1788201526.939379:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201526.939382:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ecf7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.939386:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ecf7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.939395:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1ecfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.939398:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1ecfe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.939402:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1ecfe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.939405:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201526.939407:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1ecfe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.939410:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1ecfe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.939420:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc1030a7f00) 00010000:00010000:0.0:1788201526.939422:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201526.939424:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1ecfe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.939427:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1ecfe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.939447:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ecf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f9c expref: 11 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.939456:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1ed05 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f9c expref: 10 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201526.939461:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x35:0x0].0x0 (ffff8dc12f13a600) 00010000:00010000:0.0:1788201526.939463:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788201526.939465:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbc200, rc 0) 00000100:00100000:0.0:1788201526.939532:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:79321:x1875060695570048:12345-192.168.201.20@tcp:101:rm.0 Request processed in 1090us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201526.939537:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1839 00000100:00100000:3.0:1788201526.942452:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201526.942530:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695570304 00000100:00100000:2.0:1788201526.942539:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695570304 00000100:00100000:2.0:1788201526.942587:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1840 00000100:00100000:2.0:1788201526.942593:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:79321:x1875060695570304:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:2.0:1788201526.942637:0:66312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788201526.942670:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc200/0x96d0c9b8c9a1ed05 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f9c expref: 10 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.942682:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x35:0x0].0x0 (ffff8dc12f13a600) 00010000:00010000:2.0:1788201526.942694:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3c00/0x96d0c9b8c9a1ece9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786f95 expref: 9 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.942700:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc0084fb300) 00010000:00010000:2.0:1788201526.942704:0:66312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201526.942720:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1ed0c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.942729:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1ed0c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.942735:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1ed0c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.942740:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1ed13 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.942745:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1ed13 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.942749:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1ed13 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.942808:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1ed1a lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.942812:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1ed1a lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.942823:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1ed1a lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.943052:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1ed21 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.943059:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1ed21 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.943064:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1ed21 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.943068:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1ed21 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.943072:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1ed21 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.943075:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1ed21 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.943089:0:66312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201526.943103:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1ed1a lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.943118:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1ed1a lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.943124:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1ed1a lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.943130:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201526.943134:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201526.943141:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1ed21 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.943141:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1ed1a lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201526.943147:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201526.943150:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1ed1a lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201526.943151:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1ed21 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x35:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201526.943160:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1ed21 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.943160:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x35:0x0].0x0 (ffff8dc12f13ae00) 00010000:00010000:2.0:1788201526.943163:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201526.943166:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1ed1a lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201526.943168:0:24979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x35:0x0].0x0 (ffff8dc12f13ae00) 00010000:00010000:1.0:1788201526.943170:0:24979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788201526.943172:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc600/0x96d0c9b8c9a1ed1a lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201526.943173:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1ed21 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x35:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201526.943179:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1ed21 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.943189:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1ed0c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201526.943190:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201526.943192:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201526.943194:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201526.943195:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1ed0c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.943201:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1ed0c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.943207:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1ed0c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.943212:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201526.943215:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1ed0c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.943220:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1ed0c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.943239:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12f13ad00) 00010000:00010000:2.0:1788201526.943241:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201526.943244:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1ed0c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.943250:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd000/0x96d0c9b8c9a1ed0c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201526.943263:0:66312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000303477f7 reply state 0000000038ab3bf0 transno 128849018923 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1ed13 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.943272:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1ed13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201526.943277:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc1030a7f00) 00010000:00010000:2.0:1788201526.943278:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201526.943280:0:66312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201526.943343:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:79321:x1875060695570304:12345-192.168.201.20@tcp:36:rm.0 Request processed in 748us (896us total) trans 128849018923 rc 0/0 00000100:00100000:2.0:1788201526.943351:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1840 00010000:00010000:2.0:1788201527.441406:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201528.468711:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201528.663279:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715448576:0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.663752:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715448832:0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.663842:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201528.663882:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc107858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715449344:0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.663909:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201528.663930:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715449856:0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.663952:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201528.663984:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788201528.663991:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715448448:0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.664043:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201528.664069:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715448960:0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.664091:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201528.664109:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc107859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715449472:0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.664142:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201528.664160:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715449984:0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.664183:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201528.664213:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715448704:0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.664236:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201528.664252:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10785bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715449216:0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.664272:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201528.664288:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715449728:0@lo:400:kworker.0 00000100:00100000:2.0:1788201528.664528:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201528.664567:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc107859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715449088:0@lo:400:kworker.0 00000100:00100000:2.0:1788201528.664667:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201528.664693:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715449600:0@lo:400:kworker.0 00000100:00100000:2.0:1788201528.664715:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201528.664753:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715450112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201528.665245:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201528.665304:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715448832 00000100:00100000:1.0:1788201528.665312:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715448832 00000100:00100000:1.0:1788201528.665360:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715448960 00000100:00100000:1.0:1788201528.665364:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715448960 00000100:00100000:1.0:1788201528.665377:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715449472 00000100:00100000:1.0:1788201528.665380:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715449472 00000100:00100000:1.0:1788201528.665390:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715449984 00000100:00100000:1.0:1788201528.665393:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715449984 00000100:00100000:1.0:1788201528.665402:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715448704 00000100:00100000:1.0:1788201528.665405:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715448704 00000100:00100000:1.0:1788201528.665414:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715448576 00000100:00100000:1.0:1788201528.665417:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715448576 00000100:00100000:1.0:1788201528.665432:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1862 00000100:00100000:1.0:1788201528.665448:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715448832:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788201528.665471:0:66757:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004b39f80 x1875060715448832/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:649/0 lens 224/224 e 0 to 0 dl 1788201539 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201528.665516:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715448832:12345-0@lo:400:kworker.0 Request processed in 69us (1674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201528.665523:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1862 00000100:00100000:1.0:1788201528.665542:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1863 00000100:00100000:1.0:1788201528.665549:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715448960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.665579:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715448960:12345-0@lo:400:kworker.0 Request processed in 30us (1486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201528.665743:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201528.665869:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1863 00000100:00100000:1.0:1788201528.665885:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1864 00000100:00100000:1.0:1788201528.665892:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715449472:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788201528.665906:0:66757:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004b3a300 x1875060715449472/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:649/0 lens 224/224 e 0 to 0 dl 1788201539 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201528.665939:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715449472:12345-0@lo:400:kworker.0 Request processed in 48us (1797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201528.665945:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1864 00000100:00100000:1.0:1788201528.665958:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1865 00000100:00100000:1.0:1788201528.665963:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715449984:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788201528.665974:0:66757:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004b38380 x1875060715449984/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:649/0 lens 224/224 e 0 to 0 dl 1788201539 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201528.665999:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715449984:12345-0@lo:400:kworker.0 Request processed in 36us (1816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201528.666030:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1865 00000100:00100000:1.0:1788201528.666044:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1866 00000100:00100000:1.0:1788201528.666050:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715448704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.666083:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715448704:12345-0@lo:400:kworker.0 Request processed in 34us (1847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201528.666088:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1866 00000100:00100000:1.0:1788201528.666099:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1867 00000100:00100000:1.0:1788201528.666105:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715448576:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788201528.666116:0:66757:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11cc44700 x1875060715448576/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:649/0 lens 224/224 e 0 to 0 dl 1788201539 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201528.666237:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715449088 00000100:00100000:2.0:1788201528.666242:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715449088 00000100:00100000:2.0:1788201528.666266:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715449600 00000100:00100000:2.0:1788201528.666269:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715449600 00000100:00100000:2.0:1788201528.666279:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715450112 00000100:00100000:2.0:1788201528.666282:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715450112 00000100:00100000:2.0:1788201528.666665:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788201528.666674:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3657:x1875060715449088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201528.666733:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3657:x1875060715449088:12345-0@lo:400:kworker.0 Request processed in 60us (2066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201528.666739:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788201528.666755:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788201528.666762:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715449600:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788201528.666776:0:66318:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11cc44e00 x1875060715449600/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:649/0 lens 224/224 e 0 to 0 dl 1788201539 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201528.666890:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715448576:12345-0@lo:400:kworker.0 Request processed in 784us (2362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201528.666897:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1867 00000100:00100000:1.0:1788201528.666922:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715449344 00000100:00100000:1.0:1788201528.666927:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715449344 00000100:00100000:1.0:1788201528.666961:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715449856 00000100:00100000:1.0:1788201528.666964:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715449856 00000100:00100000:1.0:1788201528.666981:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715449216 00000100:00100000:1.0:1788201528.666984:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715449216 00000100:00100000:1.0:1788201528.667002:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715449728 00000100:00100000:1.0:1788201528.667005:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715449728 00000100:00100000:1.0:1788201528.667042:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788201528.667049:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715449344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.667082:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715449344:12345-0@lo:400:kworker.0 Request processed in 34us (3173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201528.667089:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788201528.667107:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788201528.667112:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715449856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201528.668723:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715449600:12345-0@lo:400:kworker.0 Request processed in 1958us (4003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201528.668734:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788201528.668760:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788201528.668768:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715450112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201528.668806:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445363712 avail 1299124224 00000100:00100000:2.0:1788201528.668853:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715450112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (4076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201528.668859:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:2.0:1788201528.668881:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201528.668890:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201528.668893:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201528.668895:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201528.668938:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715450112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201528.668953:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715448576:0@lo:400:kworker.0 00000100:00100000:2.0:1788201528.668962:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc107859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715449088:0@lo:400:kworker.0 00000100:00100000:2.0:1788201528.668972:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715449600:0@lo:400:kworker.0 00000100:00100000:2.0:1788201528.668996:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201528.669005:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715450240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201528.669055:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201528.669098:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715450240 00000100:00100000:2.0:1788201528.669103:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715450240 00000100:00100000:2.0:1788201528.669144:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788201528.669150:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715450240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201528.669167:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444929536 avail 1298690048 00010000:00000080:2.0:1788201528.669178:0:66318:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11cc44380 x1875060715450240/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:649/0 lens 224/368 e 0 to 0 dl 1788201539 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201528.669215:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715450240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201528.669222:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788201528.669251:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715450240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201528.669683:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715448448 00000100:00100000:3.0:1788201528.669689:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715448448 00000100:00100000:3.0:1788201528.669734:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788201528.669742:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715448448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201528.669857:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715448448:12345-0@lo:400:kworker.0 Request processed in 115us (5813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201528.669864:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788201528.669905:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788201528.669914:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715449216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201528.669956:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715449216:12345-0@lo:400:kworker.0 Request processed in 44us (5683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201528.669963:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788201528.669977:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788201528.669984:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715449728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201528.670009:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715449728:12345-0@lo:400:kworker.0 Request processed in 25us (4765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201528.670039:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788201528.670989:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715449856:12345-0@lo:400:kworker.0 Request processed in 3871us (7031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201528.670999:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788201528.671084:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715448448:0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.671100:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715448960:0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.671112:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc107859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715449472:0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.671123:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715449984:0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.671671:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715448832:0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.671685:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc107858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715449344:0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.671695:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715449856:0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.671747:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715448704:0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.671758:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10785bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715449216:0@lo:400:kworker.0 00000100:00100000:1.0:1788201528.671769:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715449728:0@lo:400:kworker.0 00000100:00100000:0.0:1788201529.167530:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715450368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201529.167608:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201529.167678:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715450368 00000100:00100000:0.0:1788201529.167685:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715450368 00000100:00100000:0.0:1788201529.167737:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788201529.167747:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715450368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201529.167783:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201529.169966:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715450368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2216us (2353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201529.169979:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788201529.170620:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715450496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201529.170669:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201529.171550:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715450496 00000100:00100000:0.0:1788201529.171560:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715450496 00000100:00100000:0.0:1788201529.171625:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788201529.171635:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715450496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201529.171663:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788201529.171722:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715450496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201529.171728:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788201529.172989:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715450368:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201529.173083:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715450496:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788201529.487204:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201530.324325:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201530.324442:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201530.324479:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201530.324499:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201530.324542:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695570816 00000100:00100000:3.0:1788201530.324563:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695570816 00000100:00100000:3.0:1788201530.324630:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 131 00000100:00100000:3.0:1788201530.324640:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695570816:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201530.324711:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695570816:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 72us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201530.324718:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 131 00000100:00100000:3.0:1788201530.324744:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695570432 00000100:00100000:3.0:1788201530.324748:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695570432 00000100:00100000:3.0:1788201530.324775:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 137 00000100:00100000:3.0:1788201530.324782:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695570432:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201530.324826:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695570432:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 45us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201530.324833:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 137 00000100:00100000:0.0:1788201530.327061:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201530.327190:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695570944 00000100:00100000:3.0:1788201530.327199:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695570944 00000100:00100000:3.0:1788201530.327250:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 132 00000100:00100000:3.0:1788201530.327259:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695570944:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201530.327333:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695570944:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 75us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201530.327340:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 132 00000100:00100000:2.0:1788201530.327455:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695570560 00000100:00100000:2.0:1788201530.327461:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695570560 00000100:00100000:2.0:1788201530.327503:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695570688 00000100:00100000:2.0:1788201530.327506:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695570688 00000100:00100000:2.0:1788201530.327537:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1868 00000100:00100000:2.0:1788201530.327544:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2401:x1875060695570560:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201530.327633:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1869 00000100:00100000:3.0:1788201530.327642:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695570688:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201530.327672:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695570688:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 33us (3172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201530.327679:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1869 00010000:00000080:2.0:1788201530.327758:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12efc8e00 x1875060695570560/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:651/0 lens 224/224 e 0 to 0 dl 1788201541 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201530.327786:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2401:x1875060695570560:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 244us (3473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201530.327804:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1868 00000100:00080000:2.0:1788201530.327824:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201530.327828:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201530.327830:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201530.327832:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788201530.512718:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201531.221180:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201531.221204:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715450624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201531.221276:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201531.221519:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715450624 00000100:00100000:0.0:1788201531.221528:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715450624 00000100:00100000:0.0:1788201531.221599:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788201531.221610:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715450624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201531.221641:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201531.221703:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715450624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201531.221711:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788201531.221769:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715450624:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788201531.221954:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201531.222485:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715450752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201531.222523:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201531.222914:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715450752 00000100:00100000:3.0:1788201531.222920:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715450752 00000100:00100000:3.0:1788201531.222974:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788201531.222982:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715450752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201531.223044:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788201531.223253:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715450752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201531.223309:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715450752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 327us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201531.223316:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1788201531.223621:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788201531.545056:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201532.559797:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788201532.570189:0:102447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018923 is committed 00010000:00010000:1.0:1788201532.570291:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1ecdb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201532.570304:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1ecdb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201532.570313:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1ecdb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201532.570325:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201532.570331:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1ecdb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201532.570338:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1ecdb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201532.570357:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc1030a7f00) 00010000:00010000:1.0:1788201532.570360:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201532.570365:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1ecdb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201532.570372:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1ecdb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201532.570390:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1ed13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201532.570396:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1ed13 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201532.570402:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1ed13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201532.570408:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201532.570411:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1ed13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201532.570417:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1ed13 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201532.570435:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc1030a7f00) 00010000:00010000:1.0:1788201532.570438:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201532.570440:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1ed13 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201532.570446:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1ed13 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:02000400:1.0:1788201533.393308:0:105590:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00010000:00010000:3.0:1788201533.589175:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201533.775244:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715450880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201533.775317:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201533.775398:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715450880 00000100:00100000:2.0:1788201533.775406:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715450880 00000100:00100000:2.0:1788201533.775453:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788201533.775461:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715450880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201533.775493:0:101344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444929536 avail 1298690048 00010000:00000080:2.0:1788201533.775509:0:101344:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11cc45500 x1875060715450880/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:654/0 lens 224/368 e 0 to 0 dl 1788201544 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201533.775572:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715450880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201533.775579:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788201533.775626:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715450880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201533.775769:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201533.775779:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715451008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201533.775808:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201533.775835:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715451008 00000100:00100000:1.0:1788201533.775839:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715451008 00000100:00100000:1.0:1788201533.775866:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788201533.775873:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715451008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201533.775891:0:66317:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445363712 avail 1299124224 00000100:00100000:1.0:1788201533.775936:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715451008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201533.775943:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788201533.775973:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715451008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201533.776266:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715451264:0@lo:400:kworker.0 00000100:00100000:0.0:1788201533.776302:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201533.776322:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715451776:0@lo:400:kworker.0 00000100:00100000:0.0:1788201533.776344:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201533.776360:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715452288:0@lo:400:kworker.0 00000100:00100000:0.0:1788201533.776380:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201533.776396:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788201533.776402:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715451136:0@lo:400:kworker.0 00000100:00100000:0.0:1788201533.776431:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201533.776457:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715451648:0@lo:400:kworker.0 00000100:00100000:0.0:1788201533.776477:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201533.776492:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715452160:0@lo:400:kworker.0 00000100:00100000:0.0:1788201533.776510:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201533.776536:0:102459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715451136 00000100:00100000:0.0:1788201533.776540:0:102459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715451136 00000100:00100000:0.0:1788201533.776570:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788201533.776578:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715451136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201533.776611:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715451136:12345-0@lo:400:kworker.0 Request processed in 34us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201533.776629:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788201533.776659:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715451264 00000100:00100000:0.0:1788201533.776662:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715451264 00000100:00100000:0.0:1788201533.776692:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715451648 00000100:00100000:0.0:1788201533.776695:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715451648 00000100:00100000:0.0:1788201533.776711:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870 00000100:00100000:0.0:1788201533.776718:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715451264:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788201533.776740:0:69485:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc005d56300 x1875060715451264/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:654/0 lens 224/224 e 0 to 0 dl 1788201544 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201533.776781:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715451264:12345-0@lo:400:kworker.0 Request processed in 63us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201533.776787:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870 00000100:00100000:0.0:1788201533.776799:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871 00000100:00100000:0.0:1788201533.776806:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715451648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201533.776831:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715451648:12345-0@lo:400:kworker.0 Request processed in 26us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201533.776837:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871 00000100:00080000:0.0:1788201533.776856:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201533.776861:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201533.776883:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715451136:0@lo:400:kworker.0 00000100:00100000:0.0:1788201533.776893:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715451648:0@lo:400:kworker.0 00000100:00100000:0.0:1788201533.776901:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715451264:0@lo:400:kworker.0 00000100:00100000:1.0:1788201533.776996:0:101189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715451776 00000100:00100000:1.0:1788201533.777000:0:101189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715451776 00000100:00100000:1.0:1788201533.777060:0:101189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715452288 00000100:00100000:1.0:1788201533.777063:0:101189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715452288 00000100:00100000:1.0:1788201533.777079:0:101189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715452160 00000100:00100000:1.0:1788201533.777081:0:101189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715452160 00000100:00100000:1.0:1788201533.777097:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788201533.777108:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715451776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201533.777140:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715451776:12345-0@lo:400:kworker.0 Request processed in 33us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201533.777146:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788201533.777156:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788201533.777161:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715452288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201533.777180:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715452288:12345-0@lo:400:kworker.0 Request processed in 20us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201533.777185:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788201533.777193:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788201533.777198:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715452160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201533.777215:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715452160:12345-0@lo:400:kworker.0 Request processed in 17us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201533.777220:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788201533.777249:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715451392:0@lo:400:kworker.0 00000100:00100000:1.0:1788201533.777270:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201533.777284:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715451904:0@lo:400:kworker.0 00000100:00100000:1.0:1788201533.777300:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201533.777312:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715452416:0@lo:400:kworker.0 00000100:00100000:1.0:1788201533.777327:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201533.777340:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201533.777344:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715451520:0@lo:400:kworker.0 00000100:00100000:1.0:1788201533.777359:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201533.777369:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715452032:0@lo:400:kworker.0 00000100:00100000:1.0:1788201533.777392:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201533.777410:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715451392 00000100:00100000:1.0:1788201533.777413:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715451392 00000100:00100000:1.0:1788201533.777431:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715452416 00000100:00100000:1.0:1788201533.777433:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715452416 00000100:00100000:1.0:1788201533.777440:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715451520 00000100:00100000:1.0:1788201533.777442:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715451520 00000100:00100000:1.0:1788201533.777451:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715452032 00000100:00100000:1.0:1788201533.777452:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715452032 00000100:00100000:1.0:1788201533.777461:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872 00000100:00100000:1.0:1788201533.777466:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715451392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201533.777492:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715451392:12345-0@lo:400:kworker.0 Request processed in 26us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201533.777498:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872 00000100:00100000:1.0:1788201533.777507:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1873 00000100:00100000:1.0:1788201533.777512:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715452416:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788201533.777520:0:66757:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc005abc380 x1875060715452416/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:654/0 lens 224/224 e 0 to 0 dl 1788201544 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201533.777540:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715452416:12345-0@lo:400:kworker.0 Request processed in 28us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201533.777545:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1873 00000100:00100000:1.0:1788201533.777553:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1874 00000100:00100000:1.0:1788201533.777558:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715451520:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788201533.777566:0:66757:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc005abf480 x1875060715451520/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:654/0 lens 224/224 e 0 to 0 dl 1788201544 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201533.777584:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715451520:12345-0@lo:400:kworker.0 Request processed in 26us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201533.777596:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1874 00000100:00100000:1.0:1788201533.777606:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1875 00000100:00100000:1.0:1788201533.777610:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715452032:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788201533.777619:0:66757:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004be7800 x1875060715452032/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:654/0 lens 224/224 e 0 to 0 dl 1788201544 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201533.777638:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715452032:12345-0@lo:400:kworker.0 Request processed in 28us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201533.777643:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1875 00000100:00100000:1.0:1788201533.777657:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715451904 00000100:00100000:1.0:1788201533.777659:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715451904 00000100:00100000:1.0:1788201533.777677:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788201533.777682:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715451904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201533.777706:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715451904:12345-0@lo:400:kworker.0 Request processed in 24us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201533.777712:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788201533.777752:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715452160:0@lo:400:kworker.0 00000100:00100000:1.0:1788201533.777762:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715451776:0@lo:400:kworker.0 00000100:00100000:1.0:1788201533.777771:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715452288:0@lo:400:kworker.0 00000100:00100000:1.0:1788201533.777798:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715451520:0@lo:400:kworker.0 00000100:00100000:1.0:1788201533.777807:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715452032:0@lo:400:kworker.0 00000100:00100000:1.0:1788201533.777815:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715451392:0@lo:400:kworker.0 00000100:00100000:1.0:1788201533.777824:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715451904:0@lo:400:kworker.0 00000100:00100000:1.0:1788201533.777840:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715452416:0@lo:400:kworker.0 00000100:00080000:0.0:1788201533.778312:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201533.778316:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201533.778318:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201533.778326:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201534.266775:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201534.267843:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695571072 00000100:00100000:0.0:1788201534.267855:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695571072 00000100:00100000:0.0:1788201534.267944:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1841 00000100:00100000:0.0:1788201534.267956:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:79397:x1875060695571072:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:0.0:1788201534.267978:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201534.268003:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ed28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786fa3 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.268090:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1ed2f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.268100:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1ed2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.268109:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1ed2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201534.268146:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201534.268149:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201534.268168:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1ed2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.268191:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ed28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fa3 expref: 8 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.268221:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1ed2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fa3 expref: 7 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.268229:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc1030a7100) 00010000:00010000:0.0:1788201534.268241:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201534.268245:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d7800, rc 0) 00010000:00000080:0.0:1788201534.268252:0:66757:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11cd19500 x1875060695571072/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:655/0 lens 576/688 e 0 to 0 dl 1788201545 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201534.268313:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:79397:x1875060695571072:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 360us (1548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201534.268321:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1841 00000100:00080000:3.0:1788201534.269282:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201534.274792:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201534.274948:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695571200 00000100:00100000:0.0:1788201534.274959:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695571200 00000100:00100000:0.0:1788201534.275048:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1842 00000100:00100000:0.0:1788201534.275057:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:79397:x1875060695571200:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:0.0:1788201534.275085:0:66312:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444929536 avail 1298690048 00010000:00000080:0.0:1788201534.275102:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc003a73b80 x1875060695571200/t0(0) o41->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:655/0 lens 224/368 e 0 to 0 dl 1788201545 ref 1 fl Interpret:/200/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201534.275155:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:79397:x1875060695571200:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 100us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201534.275160:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1842 00000100:00100000:0.0:1788201534.286889:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201534.286962:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695571328 00000100:00100000:2.0:1788201534.286972:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695571328 00000100:00100000:2.0:1788201534.287067:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1843 00000100:00100000:2.0:1788201534.287078:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:79397:x1875060695571328:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:2.0:1788201534.287111:0:69485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445363712 avail 1299124224 00000100:00100000:2.0:1788201534.287178:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:79397:x1875060695571328:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 101us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201534.287186:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1843 00000100:00080000:3.0:1788201534.287747:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201534.289480:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715452544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201534.289555:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201534.289626:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715452544 00000100:00100000:2.0:1788201534.289633:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715452544 00000100:00100000:2.0:1788201534.289673:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788201534.289681:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715452544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201534.289709:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201534.289764:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715452544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201534.289772:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788201534.289829:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715452544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201534.291993:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201534.292049:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695571456 00000100:00100000:3.0:1788201534.292056:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695571456 00000100:00100000:3.0:1788201534.292107:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 123 00000100:00100000:3.0:1788201534.292117:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:79397:x1875060695571456:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:3.0:1788201534.292144:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201534.292200:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:79397:x1875060695571456:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 83us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201534.292207:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 123 00000100:00080000:3.0:1788201534.292228:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201534.293817:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715452672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201534.293880:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201534.293952:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715452672 00000100:00100000:2.0:1788201534.293958:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715452672 00000100:00100000:2.0:1788201534.293997:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788201534.294006:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715452672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201534.294042:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201534.294085:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715452672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201534.294092:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788201534.294133:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715452672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201534.294571:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201534.294589:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695571584 00000100:00100000:1.0:1788201534.294591:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695571584 00000100:00100000:1.0:1788201534.294615:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 125 00000100:00100000:1.0:1788201534.294621:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:79397:x1875060695571584:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:1.0:1788201534.294630:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201534.294661:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:79397:x1875060695571584:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 42us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201534.294665:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 125 00000100:00080000:1.0:1788201534.294678:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201534.380704:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201534.380793:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695571840 00000100:00100000:0.0:1788201534.380804:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695571840 00000100:00100000:0.0:1788201534.380869:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1844 00000100:00100000:0.0:1788201534.380881:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:79404:x1875060695571840:12345-192.168.201.20@tcp:36:mcreate.0 00010000:00010000:0.0:1788201534.380935:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201534.380963:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1ed2f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fa3 expref: 7 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.380992:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc1030a7100) 00010000:00010000:0.0:1788201534.381005:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201534.381178:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ed36 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.381192:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ed36 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.381287:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ed36 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.381306:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ed3d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.381314:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ed3d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.381322:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ed3d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.381782:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ed36 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.381792:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ed36 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.381798:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ed36 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.381804:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ed36 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.381820:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201534.381825:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ed36 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.381832:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ed36 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.381843:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc1030a7300) 00010000:00010000:0.0:1788201534.381846:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201534.381850:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ed36 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.381857:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ed36 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201534.381872:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0c0bc90 reply state 00000000a9ce3f68 transno 128849018924 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ed3d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.381882:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ed3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.381889:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc1030a7f00) 00010000:00010000:0.0:1788201534.381891:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201534.381894:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:0.0:1788201534.381922:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11cd18e00 x1875060695571840/t128849018924(0) o36->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:655/0 lens 528/448 e 0 to 0 dl 1788201545 ref 1 fl Interpret:/200/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201534.382225:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:79404:x1875060695571840:12345-192.168.201.20@tcp:36:mcreate.0 Request processed in 1346us (1528us total) trans 128849018924 rc 0/0 00000100:00100000:0.0:1788201534.382234:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1844 00000100:00100000:3.0:1788201534.424079:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201534.424175:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695571968 00000100:00100000:0.0:1788201534.424185:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695571968 00000100:00100000:0.0:1788201534.424247:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1845 00000100:00100000:0.0:1788201534.424257:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:79407:x1875060695571968:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1788201534.424279:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201534.424301:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ed44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786faa expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.424377:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1ed4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.424391:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1ed4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.424403:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1ed4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201534.424443:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201534.424446:0:66313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201534.424464:0:66313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1ed4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.424488:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ed44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786faa expref: 10 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.424504:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1ed4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786faa expref: 9 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.424513:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc1030a7300) 00010000:00010000:0.0:1788201534.424516:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201534.424527:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d7800, rc 0) 00010000:00000080:0.0:1788201534.424534:0:66313:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11cd19180 x1875060695571968/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:655/0 lens 576/688 e 0 to 0 dl 1788201545 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788201534.424597:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:79407:x1875060695571968:12345-192.168.201.20@tcp:101:rm.0 Request processed in 341us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201534.424605:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1845 00000100:00100000:1.0:1788201534.429256:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201534.429354:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695572096 00000100:00100000:3.0:1788201534.429365:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695572096 00000100:00100000:3.0:1788201534.429455:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1846 00000100:00100000:3.0:1788201534.429466:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:79407:x1875060695572096:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:3.0:1788201534.429497:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201534.429518:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1ed52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786fb1 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.429581:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1ed59 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.429596:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1ed59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.429608:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1ed59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.429630:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1ed60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.429638:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1ed60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.429646:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1ed60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.429752:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1ed67 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.429761:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1ed67 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x36:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.429767:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1ed67 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x36:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201534.429813:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x36:0x0]: returning size 0 00000004:00200000:3.0:1788201534.429817:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201534.429837:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1ed67 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x36:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.429848:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1ed67 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.429857:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1ed59 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.429864:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1ed59 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.429880:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1ed59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.429887:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1ed59 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.429893:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201534.429897:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1ed59 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.429904:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1ed59 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.429916:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc1030a7300) 00010000:00010000:3.0:1788201534.429919:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201534.429924:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1ed59 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.429929:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1ed59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.429939:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1ed60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.429945:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1ed60 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.429951:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1ed60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.429955:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201534.429966:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1ed60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.429972:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1ed60 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.429980:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc1030a7f00) 00010000:00010000:3.0:1788201534.429983:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201534.429985:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1ed60 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.429991:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1ed60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.430047:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1ed52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fb1 expref: 11 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.430062:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1ed67 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fb1 expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.430070:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x36:0x0].0x0 (ffff8dc008611100) 00010000:00010000:3.0:1788201534.430073:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788201534.430075:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3200, rc 0) 00010000:00000080:3.0:1788201534.430083:0:66757:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc003a70e00 x1875060695572096/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:655/0 lens 600/584 e 0 to 0 dl 1788201545 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201534.430141:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:79407:x1875060695572096:12345-192.168.201.20@tcp:101:rm.0 Request processed in 677us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201534.430148:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1846 00000100:00100000:3.0:1788201534.443770:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201534.443860:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695572352 00000100:00100000:0.0:1788201534.443873:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695572352 00000100:00100000:0.0:1788201534.443951:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1847 00000100:00100000:0.0:1788201534.443963:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:79407:x1875060695572352:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:0.0:1788201534.444617:0:66314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788201534.444648:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1ed67 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fb1 expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.444667:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x36:0x0].0x0 (ffff8dc008611100) 00010000:00010000:0.0:1788201534.444683:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1ed4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786faa expref: 9 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.444692:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc1030a7300) 00010000:00010000:0.0:1788201534.444700:0:66314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201534.444739:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ed6e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.444753:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ed6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.444763:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ed6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.444787:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ed75 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.444797:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ed75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.444803:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ed75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.444954:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ed7c lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.444963:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ed7c lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.444971:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ed7c lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.445463:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ed83 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.445473:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ed83 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.445545:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ed83 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.445554:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ed83 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.445561:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ed83 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.445574:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ed83 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.445638:0:66314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201534.445658:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ed7c lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.445664:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ed7c lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.445670:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ed7c lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.445676:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201534.445681:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ed7c lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.445687:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ed7c lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.445699:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x36:0x0].0x0 (ffff8dc1030a7b00) 00010000:00010000:0.0:1788201534.445701:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201534.445705:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ed7c lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.445710:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ed7c lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.445739:0:66314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ed6e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.445755:0:66314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ed6e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.445760:0:66314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ed6e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.445766:0:66314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ed6e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.445771:0:66314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201534.445774:0:66314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ed6e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.445780:0:66314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ed6e lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.445788:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc1030a7100) 00010000:00010000:0.0:1788201534.445791:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201534.445793:0:66314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ed6e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.445799:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1ed6e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201534.445814:0:66314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a831b11 reply state 000000002b09ca1b transno 128849018925 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ed75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.445825:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ed75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201534.445831:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc1030a7f00) 00010000:00010000:0.0:1788201534.445839:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201534.445842:0:66314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:0.0:1788201534.445865:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11cd19f80 x1875060695572352/t128849018925(0) o36->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:655/0 lens 512/456 e 0 to 0 dl 1788201545 ref 1 fl Interpret:/200/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201534.445933:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:79407:x1875060695572352:12345-192.168.201.20@tcp:36:rm.0 Request processed in 1973us (2172us total) trans 128849018925 rc 0/0 00000100:00100000:0.0:1788201534.445941:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1847 00010000:00010000:3.0:1788201534.456328:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201534.456343:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ed83 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.456354:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201534.456359:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ed83 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.456369:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ed83 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.456387:0:24979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x36:0x0].0x0 (ffff8dc1030a7b00) 00010000:00010000:3.0:1788201534.456390:0:24979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788201534.456394:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ed83 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.456400:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7000/0x96d0c9b8c9a1ed83 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201534.456422:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201534.456424:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201534.456426:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201534.607230:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201535.451511:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201535.451555:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201535.451583:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201535.451602:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201535.451624:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201535.451658:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695572736 00000100:00100000:0.0:1788201535.451666:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695572736 00000100:00100000:0.0:1788201535.451722:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695572608 00000100:00100000:0.0:1788201535.451725:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695572608 00000100:00100000:0.0:1788201535.451747:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1876 00000100:00100000:0.0:1788201535.451756:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695572736:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000080:0.0:1788201535.451785:0:69485:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc005d54000 x1875060695572736/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:656/0 lens 224/224 e 0 to 0 dl 1788201546 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201535.451835:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695572736:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 80us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201535.451843:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1876 00000100:00100000:0.0:1788201535.451860:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1877 00000100:00100000:0.0:1788201535.451866:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2401:x1875060695572608:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000080:0.0:1788201535.451879:0:69485:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc005d55500 x1875060695572608/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:656/0 lens 224/224 e 0 to 0 dl 1788201546 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201535.451912:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2401:x1875060695572608:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 47us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201535.451918:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1877 00000100:00100000:0.0:1788201535.451938:0:101189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695572992 00000100:00100000:0.0:1788201535.451941:0:101189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695572992 00000100:00100000:0.0:1788201535.451961:0:101189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695572864 00000100:00100000:0.0:1788201535.451964:0:101189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695572864 00000100:00100000:0.0:1788201535.451980:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 137 00000100:00100000:0.0:1788201535.451987:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695572992:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201535.452010:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695572992:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 24us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201535.452052:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 137 00000100:00100000:0.0:1788201535.452065:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 138 00000100:00100000:0.0:1788201535.452072:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695572864:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201535.452095:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695572864:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 24us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201535.452101:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 138 00000100:00100000:1.0:1788201535.452463:0:102458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695572480 00000100:00100000:1.0:1788201535.452468:0:102458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695572480 00000100:00100000:1.0:1788201535.452503:0:102458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 139 00000100:00100000:1.0:1788201535.452510:0:102458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695572480:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201535.452542:0:102458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695572480:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 33us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201535.452547:0:102458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 139 00010000:00010000:0.0:1788201535.631173:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201536.337920:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715452800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201536.337988:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201536.338175:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715452800 00000100:00100000:2.0:1788201536.338183:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715452800 00000100:00100000:2.0:1788201536.338337:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788201536.338347:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715452800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201536.338376:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201536.338448:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715452800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201536.338455:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788201536.338504:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715452800:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788201536.338544:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201536.339760:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201536.339777:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715452928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201536.339842:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201536.339916:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715452928 00000100:00100000:2.0:1788201536.339923:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715452928 00000100:00100000:2.0:1788201536.340032:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788201536.340043:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715452928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201536.340068:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201536.340128:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715452928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201536.340144:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788201536.340185:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715452928:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788201536.340415:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788201536.655175:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201537.693182:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201538.708390:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201538.898113:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715453056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201538.898179:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201538.898255:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715453056 00000100:00100000:2.0:1788201538.898263:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715453056 00000100:00100000:2.0:1788201538.898309:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788201538.898318:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715453056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201538.898349:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444929536 avail 1298690048 00010000:00000080:2.0:1788201538.898365:0:66318:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11cc46300 x1875060715453056/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:659/0 lens 224/368 e 0 to 0 dl 1788201549 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201538.898409:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715453056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201538.898417:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788201538.898462:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715453056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201538.909737:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715453440:0@lo:400:kworker.0 00000100:00100000:2.0:1788201538.909815:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201538.909885:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715453952:0@lo:400:kworker.0 00000100:00100000:2.0:1788201538.909911:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201538.909935:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715454464:0@lo:400:kworker.0 00000100:00100000:2.0:1788201538.909956:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201538.909985:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788201538.909992:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715453568:0@lo:400:kworker.0 00000100:00100000:2.0:1788201538.910057:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201538.910081:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715454080:0@lo:400:kworker.0 00000100:00100000:2.0:1788201538.910103:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201538.910125:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715454592:0@lo:400:kworker.0 00000100:00100000:2.0:1788201538.910145:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201538.910184:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715453440 00000100:00100000:2.0:1788201538.910191:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715453440 00000100:00100000:2.0:1788201538.910241:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715453568 00000100:00100000:2.0:1788201538.910244:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715453568 00000100:00100000:2.0:1788201538.910262:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715454592 00000100:00100000:2.0:1788201538.910265:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715454592 00000100:00100000:2.0:1788201538.910279:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1878 00000100:00100000:2.0:1788201538.910288:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715453440:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788201538.910311:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11cc45880 x1875060715453440/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:659/0 lens 224/224 e 0 to 0 dl 1788201549 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201538.910356:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715453440:12345-0@lo:400:kworker.0 Request processed in 69us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201538.910363:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1878 00000100:00100000:2.0:1788201538.910380:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1879 00000100:00100000:2.0:1788201538.910386:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715453568:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788201538.910397:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11cc47100 x1875060715453568/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:659/0 lens 224/224 e 0 to 0 dl 1788201549 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201538.910426:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715453568:12345-0@lo:400:kworker.0 Request processed in 39us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201538.910431:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1879 00000100:00100000:2.0:1788201538.910442:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1880 00000100:00100000:2.0:1788201538.910455:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715454592:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788201538.910466:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11cc45f80 x1875060715454592/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:659/0 lens 224/224 e 0 to 0 dl 1788201549 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201538.910498:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715454592:12345-0@lo:400:kworker.0 Request processed in 44us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201538.910504:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1880 00000100:00100000:2.0:1788201538.910523:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715453952 00000100:00100000:2.0:1788201538.910527:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715453952 00000100:00100000:2.0:1788201538.910552:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715454464 00000100:00100000:2.0:1788201538.910555:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715454464 00000100:00100000:2.0:1788201538.910573:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715454080 00000100:00100000:2.0:1788201538.910576:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715454080 00000100:00100000:2.0:1788201538.910594:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788201538.910600:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715453952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201538.910634:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715453952:12345-0@lo:400:kworker.0 Request processed in 34us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201538.910654:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788201538.910667:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788201538.910672:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715454464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201538.910704:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715454464:12345-0@lo:400:kworker.0 Request processed in 32us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201538.910710:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788201538.910720:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788201538.910725:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715454080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201538.910756:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715454080:12345-0@lo:400:kworker.0 Request processed in 31us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201538.910769:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:2.0:1788201538.910795:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201538.910799:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201538.910801:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201538.910803:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201538.910835:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715453568:0@lo:400:kworker.0 00000100:00100000:2.0:1788201538.910844:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715454080:0@lo:400:kworker.0 00000100:00100000:2.0:1788201538.910852:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715454592:0@lo:400:kworker.0 00000100:00100000:2.0:1788201538.910861:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715453440:0@lo:400:kworker.0 00000100:00100000:2.0:1788201538.910868:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715453952:0@lo:400:kworker.0 00000100:00100000:2.0:1788201538.910875:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715454464:0@lo:400:kworker.0 00000100:00100000:3.0:1788201538.911549:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715453312:0@lo:400:kworker.0 00000100:00100000:3.0:1788201538.911592:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201538.911617:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715453312 00000100:00100000:2.0:1788201538.911622:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715453312 00000100:00100000:3.0:1788201538.911623:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715453824:0@lo:400:kworker.0 00000100:00100000:3.0:1788201538.911660:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201538.911668:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1881 00000100:00100000:2.0:1788201538.911674:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715453312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201538.911678:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715454336:0@lo:400:kworker.0 00010000:00000080:2.0:1788201538.911687:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc120090000 x1875060715453312/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:659/0 lens 224/224 e 0 to 0 dl 1788201549 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201538.911709:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201538.911719:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715453312:12345-0@lo:400:kworker.0 Request processed in 46us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201538.911724:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1881 00000100:00080000:2.0:1788201538.911738:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201538.911744:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715453312:0@lo:400:kworker.0 00000100:00100000:3.0:1788201538.911756:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1788201538.911765:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715453184:0@lo:400:kworker.0 00000100:00100000:3.0:1788201538.911792:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201538.911816:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715453696:0@lo:400:kworker.0 00000100:00100000:3.0:1788201538.911837:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201538.911859:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715453696 00000100:00100000:3.0:1788201538.911859:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715454208:0@lo:400:kworker.0 00000100:00100000:2.0:1788201538.911862:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715453696 00000100:00100000:3.0:1788201538.911879:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201538.911887:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715454208 00000100:00100000:3.0:1788201538.911894:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715454720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201538.911895:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715454208 00000100:00100000:3.0:1788201538.911913:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201538.911914:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1882 00000100:00100000:2.0:1788201538.911920:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715453696:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788201538.911931:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc120091f80 x1875060715453696/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:659/0 lens 224/224 e 0 to 0 dl 1788201549 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201538.911967:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715453696:12345-0@lo:400:kworker.0 Request processed in 48us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201538.911973:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1882 00000100:00100000:2.0:1788201538.911985:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1883 00000100:00100000:2.0:1788201538.911990:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715454208:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788201538.912000:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc120092d80 x1875060715454208/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:659/0 lens 224/224 e 0 to 0 dl 1788201549 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201538.912045:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715454208:12345-0@lo:400:kworker.0 Request processed in 54us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201538.912050:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1883 00000100:00080000:2.0:1788201538.912063:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201538.912076:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715453824 00000100:00100000:2.0:1788201538.912079:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715453824 00000100:00100000:2.0:1788201538.912099:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715454720 00000100:00100000:2.0:1788201538.912101:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715454720 00000100:00100000:2.0:1788201538.912110:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788201538.912115:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3658:x1875060715453824:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788201538.912127:0:66318:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc120092300 x1875060715453824/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:659/0 lens 224/224 e 0 to 0 dl 1788201549 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201538.912154:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3658:x1875060715453824:12345-0@lo:400:kworker.0 Request processed in 39us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201538.912169:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788201538.912180:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788201538.912185:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715454720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201538.912208:0:66318:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445363712 avail 1299124224 00010000:00000080:2.0:1788201538.912218:0:66318:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc120090a80 x1875060715454720/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:659/0 lens 224/368 e 0 to 0 dl 1788201549 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201538.912248:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715454720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201538.912254:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788201538.912279:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715453696:0@lo:400:kworker.0 00000100:00100000:2.0:1788201538.912289:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715454208:0@lo:400:kworker.0 00000100:00100000:2.0:1788201538.912301:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715454720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201538.912309:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715453824:0@lo:400:kworker.0 00000100:00100000:1.0:1788201538.914732:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715454336 00000100:00100000:1.0:1788201538.914743:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715454336 00000100:00100000:1.0:1788201538.914852:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788201538.914862:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715454336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201538.914941:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715454336:12345-0@lo:400:kworker.0 Request processed in 80us (3230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201538.914948:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1788201538.914972:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201538.915013:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715454336:0@lo:400:kworker.0 00000100:00100000:1.0:1788201538.916611:0:102453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715453184 00000100:00100000:1.0:1788201538.916620:0:102453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715453184 00000100:00100000:1.0:1788201538.916671:0:102453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788201538.916679:0:102453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715453184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201538.916742:0:102453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715453184:12345-0@lo:400:kworker.0 Request processed in 64us (4949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201538.916749:0:102453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788201538.916801:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715453184:0@lo:400:kworker.0 00000100:00100000:3.0:1788201539.407452:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715454848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201539.407530:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201539.408056:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715454976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201539.408087:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201539.408201:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715454848 00000100:00100000:1.0:1788201539.408210:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715454848 00000100:00100000:1.0:1788201539.408266:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715454976 00000100:00100000:1.0:1788201539.408270:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715454976 00000100:00100000:1.0:1788201539.408287:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788201539.408296:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715454848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201539.408327:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201539.408399:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715454848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201539.408407:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788201539.408427:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788201539.408433:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715454976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201539.408448:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1788201539.408478:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715454976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201539.408484:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788201539.408585:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715454848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201539.408676:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715454976:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788201539.727348:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788201540.435543:0:102447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018925 is committed 00010000:00010000:1.0:1788201540.443715:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ed3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.443733:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ed3d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.443741:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ed3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.443747:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201540.443752:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ed3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.443759:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ed3d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.443776:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc1030a7f00) 00010000:00010000:1.0:1788201540.443780:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201540.443783:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ed3d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.443802:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ed3d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.443822:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ed75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.443829:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ed75 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.443835:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ed75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.443841:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201540.443844:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ed75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.443851:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ed75 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.443859:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc1030a7f00) 00010000:00010000:1.0:1788201540.443862:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201540.443865:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ed75 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.443871:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ed75 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:02000400:2.0:1788201540.512850:0:105985:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds2 REPLAY BARRIER on lustre-MDT0001 00000100:00100000:0.0:1788201540.574586:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201540.574645:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201540.574650:0:102454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695573120 00000100:00100000:3.0:1788201540.574662:0:102454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695573120 00000100:00100000:3.0:1788201540.574721:0:102454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 141 00000100:00100000:3.0:1788201540.574732:0:102454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13ab49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695573120:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201540.574806:0:102454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13ab49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695573120:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 76us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201540.574815:0:102454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 141 00000100:00100000:2.0:1788201540.575084:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695573248 00000100:00100000:2.0:1788201540.575090:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695573248 00000100:00100000:2.0:1788201540.575137:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1884 00000100:00100000:2.0:1788201540.575146:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695573248:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000080:2.0:1788201540.575165:0:69485:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc005d54700 x1875060695573248/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:661/0 lens 224/224 e 0 to 0 dl 1788201551 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201540.575193:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695573248:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 49us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201540.575200:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1884 00000100:00080000:2.0:1788201540.575581:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201540.576721:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201540.576808:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201540.576836:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201540.576900:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695573376 00000100:00100000:2.0:1788201540.576907:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695573376 00000100:00100000:2.0:1788201540.576956:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1885 00000100:00100000:2.0:1788201540.576964:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2403:x1875060695573376:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000080:2.0:1788201540.576987:0:66313:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11cc46d80 x1875060695573376/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:661/0 lens 224/224 e 0 to 0 dl 1788201551 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201540.577060:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2403:x1875060695573376:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 96us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201540.577067:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1885 00000100:00100000:3.0:1788201540.577124:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695573504 00000100:00100000:3.0:1788201540.577129:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695573504 00000100:00100000:3.0:1788201540.577164:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695573632 00000100:00100000:3.0:1788201540.577168:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695573632 00000100:00100000:3.0:1788201540.577191:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 143 00000100:00100000:3.0:1788201540.577198:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695573504:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201540.577228:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695573504:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 31us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201540.577234:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 143 00000100:00100000:3.0:1788201540.577248:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 144 00000100:00100000:3.0:1788201540.577255:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10785bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695573632:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201540.577280:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10785bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695573632:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201540.577286:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 144 00000100:00080000:2.0:1788201540.577447:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201540.577453:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201540.577455:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201540.615559:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201540.615649:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695573760 00000100:00100000:2.0:1788201540.615659:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695573760 00000100:00100000:2.0:1788201540.615776:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1848 00000100:00100000:2.0:1788201540.615789:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:79478:x1875060695573760:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:2.0:1788201540.615811:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201540.615837:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1ed8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786fb8 expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.615918:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ed91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.615932:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ed91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.615953:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ed91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201540.615998:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788201540.616002:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201540.616050:0:66314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ed91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.616078:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1ed8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fb8 expref: 8 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.616095:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ed91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fb8 expref: 7 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.616104:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12f13af00) 00010000:00010000:2.0:1788201540.616106:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201540.616110:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbd800, rc 0) 00010000:00000080:2.0:1788201540.616119:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc005d55f80 x1875060695573760/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:661/0 lens 576/688 e 0 to 0 dl 1788201551 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201540.616182:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:79478:x1875060695573760:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 396us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201540.616191:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1848 00000100:00100000:0.0:1788201540.627250:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201540.628054:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695573888 00000100:00100000:1.0:1788201540.628066:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695573888 00000100:00100000:1.0:1788201540.628139:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1849 00000100:00100000:1.0:1788201540.628151:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:79478:x1875060695573888:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:1.0:1788201540.628191:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201540.628212:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ed98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786fbf expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628276:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1ed9f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628291:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1ed9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628303:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1ed9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628318:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1eda6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628340:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1eda6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628349:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1eda6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628430:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1edad lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628439:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1edad lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628446:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1edad lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201540.628480:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x34:0x0]: returning size 4096 00000004:00200000:1.0:1788201540.628489:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201540.628508:0:66312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1edad lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628521:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1ed9f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628529:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1ed9f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628536:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1ed9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628543:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1ed9f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628549:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2e00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201540.628553:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1ed9f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628562:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1ed9f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628574:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12f13af00) 00010000:00010000:1.0:1788201540.628577:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201540.628581:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1ed9f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628588:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1ed9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628602:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1eda6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628630:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1eda6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628636:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1eda6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628641:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201540.628645:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1eda6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628651:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1eda6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628660:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe888c80e (ffff8dc10bed3400) 00010000:00010000:1.0:1788201540.628662:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201540.628665:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1eda6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628672:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1eda6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628706:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ed98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fbf expref: 9 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628723:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1edad lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fbf expref: 8 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.628731:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0x0 (ffff8dc10bed3200) 00010000:00010000:1.0:1788201540.628733:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201540.628743:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e2c00, rc 0) 00010000:00000080:1.0:1788201540.628752:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc005d54a80 x1875060695573888/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:661/0 lens 592/584 e 0 to 0 dl 1788201551 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201540.628829:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:79478:x1875060695573888:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 681us (1589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201540.628837:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1849 00000100:00100000:2.0:1788201540.640218:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201540.640312:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695574016 00000100:00100000:3.0:1788201540.640323:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695574016 00000100:00100000:3.0:1788201540.640398:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1850 00000100:00100000:3.0:1788201540.640548:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:79478:x1875060695574016:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:3.0:1788201540.640571:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201540.640592:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1edb4 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786fc6 expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.640667:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1edbb lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.640682:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1edbb lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.640706:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1edbb lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.640723:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1edc2 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.640731:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1edc2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.640737:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1edc2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201540.640851:0:66757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120093100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:66757:1875060715455104:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788201540.640916:0:66757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201540.640956:0:66757:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10a1bde40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201540.641014:0:66318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715455104 00000100:00100000:1.0:1788201540.641051:0:66318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715455104 00000100:00100000:1.0:1788201540.641089:0:66318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788201540.641097:0:66318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:66757:x1875060715455104:12345-0@lo:1000:mdt00_003.0 00010000:00000080:1.0:1788201540.641136:0:66318:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc120092680 x1875060715455104/t0(0) o1000->lustre-MDT0000-mdtlov_UUID@0@lo:661/0 lens 304/4320 e 0 to 0 dl 1788201551 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201540.641181:0:66318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:66757:x1875060715455104:12345-0@lo:1000:mdt00_003.0 Request processed in 84us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201540.641189:0:66318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788201540.642120:0:66757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120093100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:66757:1875060715455104:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788201540.642177:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1edc9 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.642189:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1edc9 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.642197:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1edc9 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201540.642218:0:66757:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1edc9 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.642231:0:66757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1edbb lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.642248:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1edbb lrc: 4/1,0 mode: CR/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.642255:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1edbb lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.642261:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1edbb lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.642267:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201540.642272:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1edbb lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.642281:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1edbb lrc: 5/0,0 mode: CR/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.642295:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0x0 (ffff8dc10bed3200) 00010000:00010000:3.0:1788201540.642298:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201540.642303:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1edbb lrc: 3/0,0 mode: --/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.642310:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2600/0x96d0c9b8c9a1edbb lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.642323:0:66757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1edc2 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.642329:0:66757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1edc2 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.642335:0:66757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1edc2 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.642347:0:66757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201540.642350:0:66757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1edc2 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.642356:0:66757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1edc2 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.642376:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0xd1d4b922 (ffff8dc12196eb00) 00010000:00010000:3.0:1788201540.642379:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201540.642712:0:66757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1edc2 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.642720:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1edc2 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.642762:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1edb4 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fc6 expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.642777:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1edc9 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fc6 expref: 9 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.642785:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xc:0x0].0x0 (ffff8dc12196ec00) 00010000:00010000:3.0:1788201540.642788:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788201540.642790:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3200, rc 0) 00010000:00000080:3.0:1788201540.642797:0:66757:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc107858e00 x1875060695574016/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:661/0 lens 584/584 e 0 to 0 dl 1788201551 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201540.642908:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:79478:x1875060695574016:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 2490us (2687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201540.642925:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1850 00000100:00100000:0.0:1788201540.649755:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201540.649850:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695574144 00000100:00100000:2.0:1788201540.649860:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695574144 00000100:00100000:2.0:1788201540.649926:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1851 00000100:00100000:2.0:1788201540.649937:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:79478:x1875060695574144:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:2.0:1788201540.649968:0:66314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201540.649990:0:66314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1edd0 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786fcd expref: -99 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.650068:0:66314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1edd7 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.650080:0:66314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1edd7 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.650094:0:66314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1edd7 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66314 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201540.650184:0:66314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xc:0x0]: returning size 4096 00000004:00200000:2.0:1788201540.650189:0:66314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1788201540.650224:0:66314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1edd0 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fcd expref: 8 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.650240:0:66314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1edd7 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fcd expref: 7 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.650248:0:66314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xc:0x0].0x0 (ffff8dc12f13a100) 00010000:00010000:2.0:1788201540.650251:0:66314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1788201540.650255:0:66314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbd200, rc 0) 00010000:00000080:2.0:1788201540.650262:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc005d55180 x1875060695574144/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:661/0 lens 576/672 e 0 to 0 dl 1788201551 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201540.650324:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:79478:x1875060695574144:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 389us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201540.650331:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1851 00000100:00100000:2.0:1788201540.652861:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201540.654452:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695574272 00000100:00100000:3.0:1788201540.654464:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695574272 00000100:00100000:3.0:1788201540.654532:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1852 00000100:00100000:3.0:1788201540.654544:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:79478:x1875060695574272:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:3.0:1788201540.654565:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201540.654587:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1edde lrc: 2/0,0 mode: --/CR res: [0x2400090a0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786fd4 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.654654:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1ede5 lrc: 3/1,0 mode: --/PR res: [0x2400090a0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.654668:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1ede5 lrc: 3/1,0 mode: PR/PR res: [0x2400090a0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.654679:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1ede5 lrc: 3/1,0 mode: PR/PR res: [0x2400090a0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201540.654727:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a0:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788201540.654732:0:66312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1788201540.654772:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3000/0x96d0c9b8c9a1edde lrc: 0/0,0 mode: --/CR res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fd4 expref: 9 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.654787:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1ede5 lrc: 3/0,0 mode: PR/PR res: [0x2400090a0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fd4 expref: 8 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201540.654796:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x3:0x0].0x0 (ffff8dc12196eb00) 00010000:00010000:3.0:1788201540.654799:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788201540.654810:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae3400, rc 0) 00010000:00000080:3.0:1788201540.654818:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc107859180 x1875060695574272/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:661/0 lens 576/640 e 0 to 0 dl 1788201551 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788201540.654890:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:79478:x1875060695574272:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 348us (2034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201540.654908:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1852 00000100:00100000:3.0:1788201540.656777:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201540.656998:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695574400 00000100:00100000:1.0:1788201540.657006:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695574400 00000100:00100000:1.0:1788201540.657082:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1853 00000100:00100000:1.0:1788201540.657092:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:79478:x1875060695574400:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:1.0:1788201540.657108:0:66757:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201540.657127:0:66757:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1edec lrc: 2/0,0 mode: --/CR res: [0x20000e691:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786fdb expref: -99 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.657175:0:66757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1edf3 lrc: 3/1,0 mode: --/PR res: [0x20000e691:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.657187:0:66757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1edf3 lrc: 3/1,0 mode: PR/PR res: [0x20000e691:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.657204:0:66757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1edf3 lrc: 3/1,0 mode: PR/PR res: [0x20000e691:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66757 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201540.657243:0:66757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000e691:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788201540.657248:0:66757:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1788201540.657278:0:66757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1edec lrc: 0/0,0 mode: --/CR res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fdb expref: 11 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.657294:0:66757:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1edf3 lrc: 3/0,0 mode: PR/PR res: [0x20000e691:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fdb expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.657303:0:66757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000e691:0x3:0x0].0x0 (ffff8dc10bed3400) 00010000:00010000:1.0:1788201540.657306:0:66757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788201540.657310:0:66757:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e2e00, rc 0) 00010000:00000080:1.0:1788201540.657317:0:66757:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc120093100 x1875060695574400/t0(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:661/0 lens 576/640 e 0 to 0 dl 1788201551 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201540.657376:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:79478:x1875060695574400:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 285us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201540.657383:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1853 00000100:00100000:0.0:1788201540.661945:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201540.662054:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695574656 00000100:00100000:2.0:1788201540.662064:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695574656 00000100:00100000:2.0:1788201540.662117:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1854 00000100:00100000:2.0:1788201540.662127:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:79478:x1875060695574656:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:2.0:1788201540.662147:0:66313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201540.662150:0:66313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788201540.662175:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1edf3 lrc: 0/0,0 mode: --/PR res: [0x20000e691:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fdb expref: 10 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.662192:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000e691:0x3:0x0].0x0 (ffff8dc10bed3400) 00010000:00010000:2.0:1788201540.662214:0:66313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201540.662231:0:66313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1edfa lrc: 2/0,0 mode: --/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786fe2 expref: -99 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.662353:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ee01 lrc: 3/0,1 mode: --/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.662367:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ee01 lrc: 3/0,1 mode: CW/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.662377:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ee01 lrc: 3/0,1 mode: CW/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.662390:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1ee08 lrc: 3/0,1 mode: --/PW res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.662397:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1ee08 lrc: 3/0,1 mode: PW/PW res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.662404:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1ee08 lrc: 3/0,1 mode: PW/PW res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201540.662888:0:66313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x37:0x0]: returning size 4096 00010000:00010000:2.0:1788201540.662904:0:66313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1ee0f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.662914:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1ee0f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.662921:0:66313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1ee0f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.662931:0:66313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ee01 lrc: 4/0,1 mode: CW/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.662937:0:66313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ee01 lrc: 4/0,1 mode: CW/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.662942:0:66313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ee01 lrc: 3/0,0 mode: CW/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.662948:0:66313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ee01 lrc: 4/0,0 mode: CW/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.662954:0:66313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbca00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201540.662958:0:66313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ee01 lrc: 4/0,0 mode: CW/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.662965:0:66313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ee01 lrc: 5/0,0 mode: CW/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.662973:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000e691:0x3:0x0].0x0 (ffff8dc12f13ab00) 00010000:00010000:2.0:1788201540.662976:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201540.662987:0:66313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ee01 lrc: 3/0,0 mode: --/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.662993:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbca00/0x96d0c9b8c9a1ee01 lrc: 0/0,0 mode: --/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201540.663006:0:66313:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0b7cfbd reply state 00000000104701e3 transno 128849018926 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1ee08 lrc: 3/0,1 mode: PW/PW res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.663042:0:66313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1ee08 lrc: 3/0,1 mode: TXN/TXN res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.663049:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000e691:0x3:0x0].0xcd52553e (ffff8dc12f13ac00) 00010000:00010000:2.0:1788201540.663051:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201540.663054:0:66313:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201540.663086:0:66313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd400/0x96d0c9b8c9a1edfa lrc: 0/0,0 mode: --/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fe2 expref: 12 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.663104:0:66313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1ee0f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fe2 expref: 11 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201540.663112:0:66313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x37:0x0].0x0 (ffff8dc12f13a000) 00010000:00010000:2.0:1788201540.663114:0:66313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201540.663116:0:66313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbd600, rc 0) 00010000:00000080:2.0:1788201540.663125:0:66313:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc005d55880 x1875060695574656/t128849018926(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:661/0 lens 520/584 e 0 to 0 dl 1788201551 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788201540.663196:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:79478:x1875060695574656:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 1070us (1261us total) trans 128849018926 rc 0/0 00000100:00100000:2.0:1788201540.663204:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1854 00000100:00100000:3.0:1788201540.691182:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201540.691390:0:66312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695574912 00000100:00100000:1.0:1788201540.691401:0:66312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695574912 00000100:00100000:1.0:1788201540.691452:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1855 00000100:00100000:1.0:1788201540.691463:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:79479:x1875060695574912:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00010000:1.0:1788201540.691482:0:66312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201540.691486:0:66312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788201540.691511:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc125ae3400/0x96d0c9b8c9a1ede5 lrc: 0/0,0 mode: --/PR res: [0x2400090a0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fd4 expref: 8 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.691536:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x3:0x0].0x0 (ffff8dc12196eb00) 00010000:00010000:1.0:1788201540.691545:0:66312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201540.691561:0:66312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ee16 lrc: 2/0,0 mode: --/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786fe9 expref: -99 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.691695:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee1d lrc: 3/0,1 mode: --/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.691709:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee1d lrc: 3/0,1 mode: CW/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.691719:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee1d lrc: 3/0,1 mode: CW/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.691732:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1ee24 lrc: 3/0,1 mode: --/PW res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.691739:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1ee24 lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.691745:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1ee24 lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201540.692247:0:66312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xd:0x0]: returning size 4096 00010000:00010000:1.0:1788201540.692264:0:66312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1ee2b lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.692273:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1ee2b lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.692282:0:66312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1ee2b lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.692302:0:66312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee1d lrc: 4/0,1 mode: CW/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.692309:0:66312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee1d lrc: 4/0,1 mode: CW/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.692316:0:66312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee1d lrc: 3/0,0 mode: CW/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.692323:0:66312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee1d lrc: 4/0,0 mode: CW/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.692330:0:66312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201540.692334:0:66312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee1d lrc: 4/0,0 mode: CW/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.692342:0:66312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee1d lrc: 5/0,0 mode: CW/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.692353:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x3:0x0].0x0 (ffff8dc10bed3c00) 00010000:00010000:1.0:1788201540.692355:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201540.692359:0:66312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee1d lrc: 3/0,0 mode: --/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.692365:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee1d lrc: 0/0,0 mode: --/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201540.692378:0:66312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3b9a5b3 reply state 00000000cc8c5724 transno 81604378641 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1ee24 lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.692389:0:66312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1ee24 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.692402:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x3:0x0].0xf0209d98 (ffff8dc10bed3300) 00010000:00010000:1.0:1788201540.692405:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201540.692407:0:66312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788201540.692435:0:66312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ee16 lrc: 0/0,0 mode: --/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fe9 expref: 10 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.692452:0:66312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1ee2b lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fe9 expref: 9 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201540.692460:0:66312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xd:0x0].0x0 (ffff8dc10bed3400) 00010000:00010000:1.0:1788201540.692462:0:66312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201540.692465:0:66312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e3400, rc 0) 00010000:00000080:1.0:1788201540.692473:0:66312:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc120093b80 x1875060695574912/t81604378641(0) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:661/0 lens 520/584 e 0 to 0 dl 1788201551 ref 1 fl Interpret:/600/0 rc 0/0 job:'mkdir.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788201540.692560:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:79479:x1875060695574912:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 1097us (1387us total) trans 81604378641 rc 0/0 00000100:00100000:1.0:1788201540.692568:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1855 00010000:00010000:2.0:1788201540.758478:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201541.455683:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc107859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715455232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201541.455683:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201541.455697:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715455360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201541.466235:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201541.466718:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715455232 00000100:00100000:2.0:1788201541.466729:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715455232 00000100:00100000:2.0:1788201541.466796:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788201541.466805:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715455232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201541.466838:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201541.466913:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715455232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201541.466920:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788201541.467136:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201541.467202:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715455360 00000100:00100000:2.0:1788201541.467207:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715455360 00000100:00100000:2.0:1788201541.467237:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788201541.467243:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715455360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201541.467261:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201541.467297:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715455360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201541.467302:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788201541.467388:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715455360:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788201541.467449:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201541.467453:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201541.467474:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc107859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715455232:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788201541.775228:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788201542.586343:0:106082:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788201542.586401:0:106082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e82e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e835 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.586416:0:106082:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e82e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e835 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.586424:0:106082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e82e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e835 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.586431:0:106082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e82e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e835 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.586477:0:106082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788201542.586483:0:106082:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788201542.586509:0:106082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201542.586514:0:106082:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788201542.586520:0:106082:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788201542.586545:0:106082:0:(import.c:65:import_set_state_nolock()) ffff8dc110779800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788201542.586616:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc107859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715455488:0@lo:39:umount.0 00010000:00010000:3.0:1788201542.586670:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788201542.586687:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788201542.586687:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e82e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e835 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201542.586699:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3c00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:3.0:1788201542.586704:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e82e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e835 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201542.586713:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e82e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1e835 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201542.586721:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e82e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1e835 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201542.586727:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788201542.586729:0:6521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788201542.586739:0:6521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788201542.586765:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e82e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e835 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201542.586771:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788201542.586789:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e82e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e835 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201542.586796:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3c00/0x96d0c9b8c9a1e82e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e835 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201542.586806:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201542.586808:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201542.586810:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201542.586821:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715455616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201542.586853:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201542.586904:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715455616 00000100:00100000:3.0:1788201542.586910:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715455616 00000100:00100000:1.0:1788201542.586957:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715455488 00000100:00100000:1.0:1788201542.586962:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715455488 00000100:00100000:1.0:1788201542.587010:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1856 00000100:00100000:1.0:1788201542.587046:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875060715455488:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788201542.587070:0:66314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e84a 00000100:00080000:1.0:1788201542.587078:0:66314:0:(import.c:65:import_set_state_nolock()) ffff8dc103484800 : changing import state from FULL to CLOSED 00010000:00000080:1.0:1788201542.587114:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc00715ad80 x1875060715455488/t0(0) o39->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:663/0 lens 224/224 e 0 to 0 dl 1788201553 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788201542.587124:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201542.587162:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+1:3654:x1875060715455488:12345-0@lo:39:umount.0 Request processed in 118us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201542.587176:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1856 00000020:00000080:1.0:1788201542.587188:0:66314:0:(genops.c:885:class_export_put()) final put ffff8dc103480000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1788201542.587227:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc103480000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788201542.587284:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc103484800 for lustre-MDT0000 00000100:00080000:0.0:1788201542.587339:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc110779800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788201542.587356:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc107859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715455488:0@lo:39:umount.0 00000100:00080000:2.0:1788201542.587405:0:106082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201542.587408:0:106082:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788201542.587412:0:106082:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1788201542.587858:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00000100:00100000:3.0:1788201542.587868:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715455616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201542.587880:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201542.587897:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006dbc000/0x96d0c9b8c9a1e835 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e82e expref: 24 pid: 102452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201542.587910:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201542.587949:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+23:3658:x1875060715455616:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201542.587956:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00000100:00100000:3.0:1788201542.587995:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715455616:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201542.588299:0:106082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1e771 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e778 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588310:0:106082:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1e771 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e778 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588318:0:106082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1e771 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e778 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588325:0:106082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1e771 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e778 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588349:0:106082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201542.588355:0:106082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e85f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e866 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588373:0:106082:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e85f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e866 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588379:0:106082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e85f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e866 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588384:0:106082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e85f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e866 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588404:0:106082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788201542.588411:0:106082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e820 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e827 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588417:0:106082:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e820 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e827 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588423:0:106082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e820 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e827 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588432:0:106082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e820 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e827 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588443:0:106082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788201542.588448:0:106082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1e763 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e76a expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588453:0:106082:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1e763 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e76a expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588467:0:106082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1e763 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e76a expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588472:0:106082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1e763 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e76a expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588484:0:106082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1788201542.588487:0:106082:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:2.0:1788201542.588511:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788201542.588516:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1e771 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e778 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588522:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3e00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788201542.588525:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1e771 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e778 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588532:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1e771 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1e778 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201542.588539:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1e771 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1e778 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201542.588545:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788201542.588547:0:6520:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1788201542.588549:0:6520:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1788201542.588569:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1e771 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e778 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588574:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201542.588610:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788201542.588610:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1e771 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e778 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201542.588620:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e85f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e866 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588621:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1e771 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e778 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201542.588643:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3e00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201542.588647:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e85f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e866 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588648:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201542.588655:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e820 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e827 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201542.588660:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e85f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1e866 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588662:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3200 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788201542.588669:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e820 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e827 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201542.588672:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e85f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1e866 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588681:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e820 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1e827 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201542.588688:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e820 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1e827 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201542.588692:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788201542.588698:0:6520:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788201542.588701:0:6520:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1788201542.588705:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201542.588709:0:24979:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788201542.588711:0:24979:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788201542.588718:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e820 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e827 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588726:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201542.588732:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e85f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e866 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588734:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e820 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e827 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201542.588749:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201542.588753:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3200/0x96d0c9b8c9a1e820 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e827 expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201542.588765:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e85f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e866 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201542.588780:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3e00/0x96d0c9b8c9a1e85f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e866 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588781:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201542.588788:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1e763 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e76a expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588795:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2200 already unused, calling callback (ffffffffc1280c20) 00010000:00010000:1.0:1788201542.588797:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1788201542.588799:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1e763 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e76a expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201542.588807:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201542.588810:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1e763 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1e76a expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201542.588811:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1788201542.588820:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1e763 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1e76a expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201542.588825:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788201542.588827:0:6520:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788201542.588829:0:6520:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788201542.588842:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1e763 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e76a expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588848:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201542.588854:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1e763 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e76a expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588861:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1e763 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e76a expref: -99 pid: 104386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201542.588870:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201542.588872:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201542.588878:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788201542.588894:0:106082:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788201542.588897:0:106082:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='FA') 00000020:00000080:2.0:1788201542.588901:0:106082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1788201542.588905:0:106082:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0001 00010000:00010000:3.0:1788201542.588980:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201542.588997:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc107859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715455744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201542.589073:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201542.589117:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201542.589123:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715455872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201542.589147:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201542.589170:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715456000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201542.589192:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201542.589211:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201542.589217:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715456128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201542.589236:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201542.589265:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715455744 00000100:00100000:3.0:1788201542.589271:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715455744 00000100:00100000:3.0:1788201542.589305:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715455872 00000100:00100000:3.0:1788201542.589308:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715455872 00000100:00100000:3.0:1788201542.589324:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715456000 00000100:00100000:3.0:1788201542.589326:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715456000 00000100:00100000:3.0:1788201542.589338:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715456128 00000100:00100000:3.0:1788201542.589340:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715456128 00000100:00100000:3.0:1788201542.589356:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:3.0:1788201542.589364:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+26:3655:x1875060715455744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201542.589375:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201542.589389:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0056d6000/0x96d0c9b8c9a1e778 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e771 expref: 26 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201542.589401:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201542.589436:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+25:3655:x1875060715455744:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201542.589455:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00100000:3.0:1788201542.589473:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00000100:00100000:3.0:1788201542.589480:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1059b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715455872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201542.589489:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201542.589500:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006dbda00/0x96d0c9b8c9a1e827 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e820 expref: 24 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201542.589510:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201542.589534:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1059b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+23:3655:x1875060715455872:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201542.589540:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00000100:00100000:3.0:1788201542.589593:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:3.0:1788201542.589601:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+22:3657:x1875060715456000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201542.589609:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201542.589618:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0056d6e00/0x96d0c9b8c9a1e866 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e85f expref: 22 pid: 102459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201542.589628:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201542.589657:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+21:3657:x1875060715456000:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201542.589663:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00100000:3.0:1788201542.589676:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:3.0:1788201542.589769:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+20:3657:x1875060715456128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201542.589778:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201542.589788:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0056d7e00/0x96d0c9b8c9a1e76a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e763 expref: 20 pid: 102452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201542.589807:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201542.589829:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+19:3657:x1875060715456128:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201542.589835:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00100000:3.0:1788201542.589881:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715456128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201542.589892:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715456000:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201542.589913:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201542.589928:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715455872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201542.589937:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc107859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715455744:0@lo:103:ldlm_bl.0 00000004:00000080:2.0:1788201542.591429:0:106082:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0001: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:1.0:1788201542.591947:0:104387:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378641 is committed 00010000:00010000:0.0:1788201542.591991:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1ee24 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201542.592002:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1ee24 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201542.592009:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1ee24 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201542.592037:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201542.592042:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1ee24 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201542.592049:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1ee24 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201542.592067:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x3:0x0].0xf0209d98 (ffff8dc10bed3300) 00010000:00010000:0.0:1788201542.592070:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201542.592088:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1ee24 lrc: 2/0,0 mode: --/TXN res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201542.592095:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3000/0x96d0c9b8c9a1ee24 lrc: 0/0,0 mode: --/TXN res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66312 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788201542.592279:0:106082:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 4/9 00000020:00080000:2.0:1788201542.592287:0:106082:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8dc006d81800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788201542.592294:0:106082:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8dc006d81000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788201542.592301:0:106082:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8dc006e37000 6e293f14-c501-4bc5-9dd4-a18ef02756b4 192.168.201.20@tcp 7 (0 0 2) 0 0 0 0: 0000000000000000 81604378641 stale:0 00000020:00080000:2.0:1788201542.592305:0:106082:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8dc006e35800 lustre-MDT0000-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788201542.592311:0:106082:0:(genops.c:1553:class_disconnect_exports()) OBD device 6 (ffff8dc13f8719b8) has exports, disconnecting them 00000020:00080000:2.0:1788201542.592315:0:106082:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8dc006d81800), last request at 1788201538 00000020:00000080:2.0:1788201542.592323:0:106082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e882 00000100:00080000:2.0:1788201542.592335:0:106082:0:(import.c:65:import_set_state_nolock()) ffff8dc006d86800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788201542.592445:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788201542.592452:0:106082:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc006d81800): rc 0 00000020:00000080:2.0:1788201542.592456:0:106082:0:(genops.c:885:class_export_put()) final put ffff8dc006d81800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1788201542.592472:0:106082:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8dc006d81000), last request at 1788201538 00000020:00000080:2.0:1788201542.592475:0:106082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e87b 00000100:00080000:2.0:1788201542.592481:0:106082:0:(import.c:65:import_set_state_nolock()) ffff8dc006d83800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788201542.592487:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc006d81800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00080000:2.0:1788201542.592501:0:106082:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc006d81000): rc 0 00000020:00000080:2.0:1788201542.592505:0:106082:0:(genops.c:885:class_export_put()) final put ffff8dc006d81000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00080000:2.0:1788201542.592511:0:106082:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 192.168.201.20@tcp (ffff8dc006e37000), last request at 1788201540 00000020:00000080:2.0:1788201542.592521:0:106082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e7b7 00000020:00010000:2.0:1788201542.592530:0:106082:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc006e37000: total 2 00000100:00080000:2.0:1788201542.592534:0:106082:0:(import.c:65:import_set_state_nolock()) ffff8dc11077f000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788201542.592540:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc006d86800 for lustre-MDT0001 00000020:00000080:1.0:1788201542.592549:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc006d81000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1788201542.592573:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc006d83800 for lustre-MDT0001 00000020:00010000:3.0:1788201542.592623:0:6520:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc006e37000: total 0 00010000:00010000:3.0:1788201542.592667:0:6520:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc006e37000, canceled 0 locks, left on hash table 2. 00000020:00080000:2.0:1788201542.592697:0:106082:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.201.20@tcp (ffff8dc006e37000): rc 0 00000020:00080000:2.0:1788201542.592702:0:106082:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8dc006e35800), last request at 1788201497 00000020:00000080:2.0:1788201542.592713:0:106082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e7b0 00000100:00080000:2.0:1788201542.592719:0:106082:0:(import.c:65:import_set_state_nolock()) ffff8dc137d34800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788201542.592802:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc12e6e3400/0x96d0c9b8c9a1ee2b lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fe9 expref: 3 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201542.592827:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc006dbd200/0x96d0c9b8c9a1edd7 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fcd expref: 2 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788201542.592841:0:106082:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc006e35800): rc 0 00000020:00000080:2.0:1788201542.592846:0:106082:0:(genops.c:885:class_export_put()) final put ffff8dc006e35800/lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788201542.592846:0:6520:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc006e37000, canceled 2 locks, left on hash table 0. 00000004:00000080:2.0:1788201542.592865:0:106082:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa0dd40c97ae0 00000100:00080000:2.0:1788201542.592884:0:106082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201542.592887:0:106082:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018920 gen 3 00000100:00100000:2.0:1788201542.592896:0:106082:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8dc13a91ed80 x1875060715448320/t128849018921(128849018921) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788201542 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788201542.592905:0:106082:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018921 committed transno 128849018920 00000020:00000080:1.0:1788201542.593062:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc006e35800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788201542.593104:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc137d34800 for lustre-MDT0001 00000100:00080000:2.0:1788201542.595348:0:106082:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788201542.595381:0:106082:0:(import.c:65:import_set_state_nolock()) ffff8dc11d639800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788201542.595620:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715456256:0@lo:39:umount.0 00000100:00100000:1.0:1788201542.595709:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201542.595841:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715456256 00000100:00100000:2.0:1788201542.595849:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715456256 00000100:00100000:2.0:1788201542.595906:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788201542.595917:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875060715456256:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788201542.595946:0:101344:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e7e1 00000100:00080000:2.0:1788201542.595954:0:101344:0:(import.c:65:import_set_state_nolock()) ffff8dc106072000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788201542.596028:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201542.596090:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788201542.596095:0:101344:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 30, last_transno is 128849018926 00010000:00000080:2.0:1788201542.596271:0:101344:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc003a73800 x1875060715456256/t128849018927(0) o39->lustre-MDT0001-mdtlov_UUID@0@lo:663/0 lens 224/224 e 0 to 0 dl 1788201553 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201542.596426:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+3:3654:x1875060715456256:12345-0@lo:39:umount.0 Request processed in 510us (716us total) trans 128849018927 rc 0/0 00000100:00100000:2.0:1788201542.596435:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:1.0:1788201542.596635:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11d639800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788201542.596644:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715456256:0@lo:39:umount.0 00010000:00010000:2.0:1788201542.597138:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201542.601745:0:106082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788201542.601754:0:106082:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901911 gen 3 00000004:00080000:1.0:1788201542.601785:0:106082:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788201542.601849:0:106082:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788201542.601877:0:106082:0:(import.c:65:import_set_state_nolock()) ffff8dc00520f000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788201542.601896:0:106082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788201542.601898:0:106082:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1788201542.601911:0:106082:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201542.601926:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715456384:0@lo:9:umount.0 00000100:00080000:1.0:1788201542.601969:0:106082:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788201542.601979:0:106082:0:(import.c:65:import_set_state_nolock()) ffff8dc139bc2800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788201542.602002:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788201542.602041:0:106082:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8dc13f8719b8) has no exports 00000100:00100000:0.0:1788201542.602084:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715456512:0@lo:9:umount.0 00000100:00100000:0.0:1788201542.602109:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201542.602352:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715456384 00000100:00100000:1.0:1788201542.602360:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715456384 00000100:00100000:1.0:1788201542.602436:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715456512 00000100:00100000:1.0:1788201542.602441:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715456512 00000100:00100000:1.0:1788201542.602469:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788201542.602478:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1875060715456384:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788201542.602505:0:101188:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e7fd 00000100:00080000:1.0:1788201542.602514:0:101188:0:(import.c:65:import_set_state_nolock()) ffff8dc120727800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788201542.602556:0:101188:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901911 00000100:00100000:1.0:1788201542.602719:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3654:x1875060715456384:12345-0@lo:9:umount.0 Request processed in 242us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201542.602727:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788201542.602743:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788201542.602749:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1875060715456512:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788201542.602774:0:101188:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e80b 00000100:00080000:1.0:1788201542.602781:0:101188:0:(import.c:65:import_set_state_nolock()) ffff8dc00520b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788201542.602803:0:101188:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788201542.602878:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3654:x1875060715456512:12345-0@lo:9:umount.0 Request processed in 128us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201542.602884:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00010000:1.0:1788201542.602909:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201542.602953:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201542.602958:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788201542.602964:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201542.602991:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc139bc2800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788201542.603010:0:3654:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788201542.603012:0:3654:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201542.603041:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715456512:0@lo:9:umount.0 00000100:00080000:0.0:1788201542.603055:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc00520f000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788201542.603063:0:3654:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788201542.603064:0:3654:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201542.603067:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715456384:0@lo:9:umount.0 00000040:00080000:0.0:1788201542.604319:0:106082:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000bd1:0x3:0x0] first idx 30, last_idx 32 00000040:00080000:0.0:1788201542.604435:0:106082:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000bd1:0x3:0x0] first idx 31, last_idx 32 00000020:00080000:0.0:1788201542.604837:0:106082:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8dc13f8719b8) has no exports 00000020:00000080:3.0:1788201542.643654:0:6520:0:(genops.c:885:class_export_put()) final put ffff8dc006e37000/6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:1.0:1788201542.644079:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc006e37000/6e293f14-c501-4bc5-9dd4-a18ef02756b4 for lustre-MDT0001 00000020:00000080:1.0:1788201542.644156:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc11077f000 for lustre-MDT0001 00010000:00010000:2.0:1788201542.644778:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201542.644782:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201542.644803:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788201542.666532:0:106082:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc004ada960 - data ffff8dc11d993bd0/ffff8dc109b80000 00000020:01000000:1.0:1788201542.666849:0:106082:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc125776f60 - data ffff8dc0021fed80/ffff8dc003929800 00000100:00080000:0.0:1788201542.705316:0:106082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201542.705325:0:106082:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018920 gen 4 00000100:00100000:0.0:1788201542.705339:0:106082:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8dc13a91ed80 x1875060715456256/t128849018927(128849018927) o39->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201552 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201542.705382:0:106082:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788201542.707460:0:106082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788201542.707466:0:106082:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901911 gen 4 00000004:00080000:0.0:1788201542.707482:0:106082:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201542.707485:0:106082:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788201542.707988:0:104395:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788201542.707993:0:104395:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x4c:0x0] index 1 count 1 00000040:00080000:1.0:1788201542.708003:0:104395:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 19 count 2 00000100:00080000:0.0:1788201542.708640:0:106082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788201542.708644:0:106082:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:0.0:1788201542.708661:0:106082:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201542.708664:0:106082:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788201542.709102:0:104397:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788201542.709107:0:104397:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x4e:0x0] index 1 count 1 00000040:00080000:1.0:1788201542.709127:0:104397:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 19 count 2 00000020:00000080:0.0:1788201542.709950:0:106082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e786 00000020:00000080:0.0:1788201542.709960:0:106082:0:(genops.c:885:class_export_put()) final put ffff8dc11d63e000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788201542.710616:0:106082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e79b 00000020:00000080:0.0:1788201542.710623:0:106082:0:(genops.c:885:class_export_put()) final put ffff8dc1257f7800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788201542.710628:0:106082:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1788201542.710633:0:106082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201542.710641:0:106082:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788201542.710645:0:106082:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8dc12563b370) has no exports 00000004:01000000:0.0:1788201542.710798:0:106082:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788201542.710807:0:106082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e804 00000020:00000080:0.0:1788201542.710812:0:106082:0:(genops.c:885:class_export_put()) final put ffff8dc006d86000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788201542.710816:0:106082:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788201542.710820:0:106082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201542.710824:0:106082:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788201542.710827:0:106082:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8dc1060e4d28) has no exports 00000020:00000080:0.0:1788201542.710833:0:106082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e7f6 00000020:00000080:0.0:1788201542.710836:0:106082:0:(genops.c:885:class_export_put()) final put ffff8dc139bc5800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1788201542.711195:0:106082:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788201542.711199:0:106082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788201542.711202:0:106082:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1788201542.711208:0:106082:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201542.711210:0:106082:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788201542.711257:0:106082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201542.711264:0:106082:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788201542.711270:0:106082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e7e8 00000020:00000080:0.0:1788201542.711274:0:106082:0:(genops.c:885:class_export_put()) final put ffff8dc1257f2800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788201542.711278:0:106082:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788201542.711281:0:106082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201542.711284:0:106082:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788201542.711286:0:106082:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8dc12f0c19b8) has no exports 00000020:00000080:0.0:1788201542.711290:0:106082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e7da 00000020:00000080:0.0:1788201542.711292:0:106082:0:(genops.c:885:class_export_put()) final put ffff8dc00520c800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1788201542.711602:0:106082:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788201542.711605:0:106082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788201542.711607:0:106082:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901911 gen 5 00000004:00080000:0.0:1788201542.711610:0:106082:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201542.711612:0:106082:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788201542.711636:0:106082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201542.711641:0:106082:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1788201542.711652:0:106082:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788201542.711657:0:106082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e7cc 00000020:00000080:0.0:1788201542.711661:0:106082:0:(genops.c:885:class_export_put()) final put ffff8dc13aa9a800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788201542.711665:0:106082:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='') 00000020:00000080:0.0:1788201542.711668:0:106082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201542.711671:0:106082:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788201542.711674:0:106082:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8dc13f874d28) has no exports 00000020:00000080:0.0:1788201542.711677:0:106082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e7c5 00000020:00000080:0.0:1788201542.711680:0:106082:0:(genops.c:885:class_export_put()) final put ffff8dc11d63a000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788201542.712463:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d63e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788201542.712476:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1257f7800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1788201542.712481:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc006d86000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788201542.712485:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc139bc5800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788201542.712491:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc139bc2800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788201542.712496:0:93109:0:(genops.c:885:class_export_put()) final put ffff8dc1257f3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788201542.712499:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1257f3000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1788201542.712502:0:93109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788201542.712596:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1257f2800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788201542.712601:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc00520c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788201542.712604:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc00520f000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788201542.712609:0:93109:0:(genops.c:885:class_export_put()) final put ffff8dc1257f6000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788201542.712611:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1257f6000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788201542.712614:0:93109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788201542.712642:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13aa9a800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788201542.712646:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d63a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788201542.714129:0:106082:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1788201542.714135:0:106082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788201542.714138:0:106082:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018920 gen 5 00000100:00100000:1.0:1788201542.714153:0:106082:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201542.714210:0:106082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201542.714218:0:106082:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788201542.714242:0:106082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201542.714245:0:106082:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788201542.714248:0:106082:0:(genops.c:885:class_export_put()) final put ffff8dc0039c3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788201542.714251:0:106082:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0039c3000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1788201542.714264:0:106082:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788201542.714347:0:106082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e7a2 00000020:00000080:1.0:1788201542.714353:0:106082:0:(genops.c:885:class_export_put()) final put ffff8dc1257f5000/lustre-MDD0001_UUID 00000020:01000000:1.0:1788201542.714358:0:106082:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1788201542.714360:0:106082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201542.714364:0:106082:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788201542.714367:0:106082:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8dc13f870000) has no exports 00000020:00000080:1.0:1788201542.714381:0:106082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201542.714383:0:106082:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1788201542.714385:0:106082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e7a9 00000020:00000080:1.0:1788201542.714387:0:106082:0:(genops.c:885:class_export_put()) final put ffff8dc1257f0800/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1788201542.714391:0:106082:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc10630d000 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1788201542.714394:0:106082:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc10630d000 2 00000020:01000004:1.0:1788201542.714396:0:106082:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dc10630d000 from lustre-MDT0001 00000020:00000080:1.0:1788201542.714408:0:106082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201542.714409:0:106082:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1788201542.714411:0:106082:0:(genops.c:885:class_export_put()) final put ffff8dc11d63e800/lustre-MDT0001_UUID 00000020:00000080:1.0:1788201542.714412:0:106082:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d63e800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1788201542.714417:0:106082:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1788201542.714439:0:106082:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:1.0:1788201542.714442:0:106082:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1788201542.714444:0:106082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201542.714446:0:106082:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788201542.714451:0:106082:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8dc137d34000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201542.714456:0:106082:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8dc0027d0000) has exports, disconnecting them 00000020:00080000:1.0:1788201542.714460:0:106082:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8dc137d34000), last request at 1788201497 00000020:00000080:1.0:1788201542.714464:0:106082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e843 00000020:00080000:1.0:1788201542.714476:0:106082:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc137d34000): rc 0 00000020:00000080:1.0:1788201542.714479:0:106082:0:(genops.c:885:class_export_put()) final put ffff8dc137d34000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788201542.714840:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc11d639800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788201542.714848:0:93109:0:(genops.c:885:class_export_put()) final put ffff8dc1257f0000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788201542.714850:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1257f0000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788201542.714854:0:93109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788201542.714906:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1257f5000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788201542.714915:0:93109:0:(genops.c:885:class_export_put()) final put ffff8dc005faa800/lustre-MDD0001_UUID 00000020:00000080:3.0:1788201542.714917:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005faa800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788201542.714921:0:93109:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788201542.714944:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1257f0800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788201542.714947:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d34000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788201542.792087:0:106082:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788201542.792095:0:106082:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201542.792099:0:106082:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788201542.792106:0:106082:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788201542.792143:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc110779800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788201542.792323:0:106082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201542.792333:0:106082:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788201542.792338:0:106082:0:(genops.c:885:class_export_put()) final put ffff8dc110778000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788201542.792342:0:106082:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110778000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788201542.792354:0:106082:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788201542.792440:0:106082:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc10630d000 1 00000020:00000080:3.0:1788201542.792445:0:106082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e75c 00000020:00000080:3.0:1788201542.792452:0:106082:0:(genops.c:885:class_export_put()) final put ffff8dc0039c6000/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788201542.792460:0:106082:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788201542.792466:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0039c6000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788201542.792474:0:106082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201542.792478:0:106082:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788201542.792482:0:106082:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8dc1060e0000) has no exports 00010000:00010000:3.0:1788201542.849257:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788201542.983098:0:106082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201542.983110:0:106082:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788201542.983116:0:106082:0:(genops.c:885:class_export_put()) final put ffff8dc106308000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788201542.983120:0:106082:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc106308000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788201542.983133:0:106082:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788201542.983254:0:106082:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dc10630b000 00000020:02000400:0.0:1788201542.983349:0:106082:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1788201543.888211:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201544.015388:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715456896:0@lo:400:kworker.0 00000100:00100000:1.0:1788201544.015465:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201544.015500:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715457408:0@lo:400:kworker.0 00000100:00100000:1.0:1788201544.015527:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201544.015571:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788201544.015578:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715457024:0@lo:400:kworker.0 00000100:00100000:1.0:1788201544.015601:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201544.015620:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715457536:0@lo:400:kworker.0 00000100:00100000:1.0:1788201544.015641:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201544.015676:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715456896 00000100:00100000:1.0:1788201544.015684:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715456896 00000100:00100000:1.0:1788201544.015721:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715457024 00000100:00100000:1.0:1788201544.015724:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715457024 00000100:00100000:1.0:1788201544.015762:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1886 00000100:00100000:1.0:1788201544.015772:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715457024:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788201544.015794:0:69485:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc003a71f80 x1875060715457024/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:665/0 lens 224/224 e 0 to 0 dl 1788201555 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201544.015836:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715457024:12345-0@lo:400:kworker.0 Request processed in 66us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201544.015843:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1886 00000100:00100000:1.0:1788201544.015863:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1857 00000100:00100000:1.0:1788201544.015882:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1875060715456896:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788201544.015889:0:69485:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788201544.015914:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1875060715456896:12345-0@lo:400:kworker.0 Request processed in 46us (449us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788201544.015920:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1857 00000100:00100000:1.0:1788201544.015939:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715457408 00000100:00100000:1.0:1788201544.015949:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715457408 00000100:00100000:1.0:1788201544.015978:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715457536 00000100:00100000:1.0:1788201544.015981:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715457536 00000100:00100000:1.0:1788201544.016002:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788201544.016009:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715457408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201544.016074:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715457408:12345-0@lo:400:kworker.0 Request processed in 66us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201544.016080:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788201544.016090:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788201544.016096:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715457536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201544.016119:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715457536:12345-0@lo:400:kworker.0 Request processed in 23us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201544.016125:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:1.0:1788201544.016149:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201544.016152:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201544.016155:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201544.016190:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715457024:0@lo:400:kworker.0 00000100:00100000:1.0:1788201544.016202:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715457536:0@lo:400:kworker.0 00000100:00080000:1.0:1788201544.016211:0:3657:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788201544.016215:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788201544.016219:0:3657:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788201544.016224:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201544.016228:0:3657:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 4354 00000100:00080000:1.0:1788201544.016234:0:3657:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8dc13f86f000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201544.016253:0:3657:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc106048a80 x1875060715457792/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201544.016278:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715456896:0@lo:400:kworker.0 00000100:00100000:1.0:1788201544.016291:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715457408:0@lo:400:kworker.0 00000100:00100000:1.0:1788201544.016317:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715457792:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788201544.016342:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201544.016370:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715457792 00000100:00100000:1.0:1788201544.016373:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715457792 00000100:00100000:1.0:1788201544.016392:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1858 00000100:00100000:1.0:1788201544.016397:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715457792:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1788201544.016413:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201544.016444:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715457792:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 45us (101us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201544.016450:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1858 00000100:00080000:1.0:1788201544.016470:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201544.016474:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201544.016477:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715457792:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788201544.016787:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715456768:0@lo:400:kworker.0 00000100:00100000:2.0:1788201544.016817:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201544.016834:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715457280:0@lo:400:kworker.0 00000100:00100000:2.0:1788201544.016854:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201544.016884:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788201544.016889:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715456640:0@lo:400:kworker.0 00000100:00100000:2.0:1788201544.016913:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201544.016937:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715457152:0@lo:400:kworker.0 00000100:00100000:2.0:1788201544.016955:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201544.016967:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715457664:0@lo:400:kworker.0 00000100:00100000:2.0:1788201544.016982:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201544.017003:0:66317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715457280 00000100:00100000:2.0:1788201544.017006:0:66317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715457280 00000100:00100000:2.0:1788201544.017045:0:66317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788201544.017050:0:66317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3656:x1875060715457280:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788201544.017055:0:66317:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788201544.017082:0:66317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3656:x1875060715457280:12345-0@lo:400:kworker.0 Request processed in 31us (226us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788201544.017087:0:66317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788201544.017103:0:102452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715456640 00000100:00100000:2.0:1788201544.017106:0:102452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715456640 00000100:00100000:2.0:1788201544.017124:0:102452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788201544.017130:0:102452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:3656:x1875060715456640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201544.017158:0:102452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:3656:x1875060715456640:12345-0@lo:400:kworker.0 Request processed in 28us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201544.017175:0:102452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788201544.017206:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715456640:0@lo:400:kworker.0 00000100:00080000:2.0:1788201544.017215:0:3656:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-osp-MDT0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788201544.017219:0:3656:0:(import.c:65:import_set_state_nolock()) ffff8dc13f80c800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788201544.017222:0:3656:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788201544.017227:0:3656:0:(import.c:65:import_set_state_nolock()) ffff8dc13f80c800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201544.017230:0:3656:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 4354 00000100:00080000:2.0:1788201544.017235:0:3656:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8dc13f80c800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201544.017251:0:3656:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12b637b80 x1875060715457920/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201544.017264:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715457280:0@lo:400:kworker.0 00000100:00100000:1.0:1788201544.018677:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715456768 00000100:00100000:1.0:1788201544.018688:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715456768 00000100:00100000:1.0:1788201544.018754:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715457152 00000100:00100000:1.0:1788201544.018757:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715457152 00000100:00100000:1.0:1788201544.018772:0:66313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715457664 00000100:00100000:1.0:1788201544.018775:0:66313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715457664 00000100:00100000:1.0:1788201544.018791:0:66313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1887 00000100:00100000:1.0:1788201544.018799:0:66313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715456768:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788201544.018819:0:66313:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc13a91d880 x1875060715456768/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:665/0 lens 224/224 e 0 to 0 dl 1788201555 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201544.018959:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1888 00000100:00100000:3.0:1788201544.018969:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715457664:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788201544.018980:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc13a91d180 x1875060715457664/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:665/0 lens 224/224 e 0 to 0 dl 1788201555 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201544.019088:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201544.022002:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1859 00000100:00100000:0.0:1788201544.022037:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1875060715457152:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788201544.022049:0:66757:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788201544.022520:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715457664:12345-0@lo:400:kworker.0 Request processed in 3550us (5532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201544.022531:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1888 00000100:00100000:1.0:1788201544.026946:0:66313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715456768:12345-0@lo:400:kworker.0 Request processed in 8138us (10119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201544.026961:0:66313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1887 00000100:00100000:1.0:1788201544.027087:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715457664:0@lo:400:kworker.0 00000100:00100000:1.0:1788201544.027102:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715456768:0@lo:400:kworker.0 00000100:00100000:1.0:1788201544.029282:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715457920:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788201544.029369:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201544.029532:0:101344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715457920 00000100:00100000:2.0:1788201544.029558:0:101344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715457920 00000100:00100000:2.0:1788201544.029603:0:101344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788201544.029611:0:101344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3654:x1875060715457920:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1788201544.029632:0:101344:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201544.029684:0:101344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3654:x1875060715457920:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 72us (314us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201544.029691:0:101344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:1.0:1788201544.029845:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f80c800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201544.029851:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201544.029855:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715457920:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1788201544.037069:0:3656:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0001 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788201544.037077:0:3656:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788201544.037082:0:3656:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788201544.037087:0:3656:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201544.037091:0:3656:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 4354 00000100:00080000:1.0:1788201544.037101:0:3656:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8dc1401c2800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201544.037132:0:3656:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc10604b480 x1875060715458048/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201544.037160:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715457152:0@lo:400:kworker.0 00000100:00100000:3.0:1788201544.037262:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715458048:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788201544.037306:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201544.037458:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715458048 00000100:00100000:1.0:1788201544.037466:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715458048 00000100:00100000:1.0:1788201544.037510:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1860 00000100:00100000:1.0:1788201544.037529:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715458048:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1788201544.037568:0:66314:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201544.037612:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715458048:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 82us (305us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201544.037618:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1860 00000100:00080000:3.0:1788201544.037740:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201544.037745:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201544.037748:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715458048:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788201544.038000:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1875060715457152:12345-0@lo:400:kworker.0 Request processed in 15985us (21041us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788201544.038007:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1859 00010000:00010000:0.0:1788201544.912251:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201545.689124:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201545.689163:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201545.689232:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201545.689252:0:102459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695575040 00000100:00100000:3.0:1788201545.689256:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201545.689262:0:102459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695575040 00000100:00100000:0.0:1788201545.689313:0:102459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 143 00000100:00100000:0.0:1788201545.689323:0:102459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695575040:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201545.689389:0:102459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695575040:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 68us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201545.689397:0:102459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 143 00000100:00100000:3.0:1788201545.689502:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201545.689538:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695575552 00000100:00100000:3.0:1788201545.689542:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695575552 00000100:00100000:0.0:1788201545.689558:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695575424 00000100:00100000:0.0:1788201545.689562:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695575424 00000100:00100000:3.0:1788201545.689582:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 147 00000100:00100000:0.0:1788201545.689587:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 148 00000100:00100000:3.0:1788201545.689589:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695575552:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201545.689593:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12bfd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695575424:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201545.689628:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695575552:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 39us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201545.689635:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 147 00000100:00100000:2.0:1788201545.690777:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695575296 00000100:00100000:2.0:1788201545.690786:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695575296 00000100:00100000:2.0:1788201545.690825:0:69485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695575168 00000100:00100000:2.0:1788201545.690840:0:69485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695575168 00000100:00100000:2.0:1788201545.690882:0:69485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1889 00000100:00100000:2.0:1788201545.690891:0:69485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2403:x1875060695575168:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000080:2.0:1788201545.690914:0:69485:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004b38700 x1875060695575168/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:666/0 lens 224/224 e 0 to 0 dl 1788201556 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201545.691116:0:66312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1861 00000100:00100000:3.0:1788201545.691121:0:66312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875060695575296:12345-192.168.201.20@tcp:400:kworker.0 00000020:00080000:3.0:1788201545.691129:0:66312:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.20@tcp 00000100:00100000:0.0:1788201545.693333:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12bfd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695575424:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 3728us (3820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201545.693347:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 148 00000100:00100000:2.0:1788201545.695478:0:69485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2403:x1875060695575168:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 4579us (6210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201545.695568:0:69485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1889 00000100:00100000:3.0:1788201545.696130:0:66312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875060695575296:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 5004us (6964us total) trans 0 rc -107/-107 00000100:00080000:0.0:1788201545.696137:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201545.696142:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201545.696144:0:66312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1861 00000100:00080000:0.0:1788201545.696145:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201545.703837:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201545.703896:0:66757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695575680 00000100:00100000:1.0:1788201545.703907:0:66757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695575680 00000100:00100000:1.0:1788201545.703965:0:66757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1862 00000100:00100000:1.0:1788201545.703974:0:66757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695575680:12345-192.168.201.20@tcp:38:ptlrpcd_01_01.0 00010000:00020000:1.0:1788201545.704117:0:66757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201545.704186:0:66757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875060695575680:12345-192.168.201.20@tcp:38:ptlrpcd_01_01.0 Request processed in 211us (358us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201545.704194:0:66757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1862 00010000:00010000:2.0:1788201545.936178:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201546.578521:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201546.578543:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715458176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201546.578613:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201546.578666:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715458176 00000100:00100000:3.0:1788201546.578673:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715458176 00000100:00100000:3.0:1788201546.578728:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788201546.578737:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715458176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201546.578765:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8638144 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201546.578808:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715458176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201546.578830:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788201546.578875:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715458176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201546.580106:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715458304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201546.580154:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201546.580201:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715458304 00000100:00100000:2.0:1788201546.580207:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715458304 00000100:00100000:2.0:1788201546.580245:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788201546.580253:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715458304:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788201546.580370:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201546.580375:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788201546.582000:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8666816 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201546.582096:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715458304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1839us (1937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201546.582106:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788201546.582173:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715458304:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788201546.582736:0:102447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1788201546.582747:0:102447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018927 is committed 00000020:00000080:3.0:1788201546.582751:0:102447:0:(genops.c:885:class_export_put()) final put ffff8dc106070000/lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1788201546.582767:0:102447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018926 is committed 00010000:00010000:2.0:1788201546.583371:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1ee08 lrc: 3/0,1 mode: TXN/TXN res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.583384:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1ee08 lrc: 2/0,0 mode: TXN/TXN res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.583391:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1ee08 lrc: 3/0,0 mode: TXN/TXN res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.583404:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201546.583409:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1ee08 lrc: 3/0,0 mode: TXN/TXN res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.583417:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1ee08 lrc: 4/0,0 mode: TXN/TXN res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.583435:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000e691:0x3:0x0].0xcd52553e (ffff8dc12f13ac00) 00010000:00010000:2.0:1788201546.583438:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201546.583442:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1ee08 lrc: 2/0,0 mode: --/TXN res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.583449:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbc800/0x96d0c9b8c9a1ee08 lrc: 0/0,0 mode: --/TXN res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66313 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788201546.583702:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc106070000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788201546.583755:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc106072000 for lustre-MDT0000 00000020:01000004:3.0:1788201546.641563:0:106283:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788201546.641615:0:106283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1e047 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e04e expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201546.641631:0:106283:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1e047 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e04e expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201546.641638:0:106283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1e047 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e04e expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201546.641667:0:106283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1e047 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e04e expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201546.641694:0:106283:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788201546.641700:0:106283:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788201546.641727:0:106283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201546.641731:0:106283:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788201546.641736:0:106283:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788201546.641761:0:106283:0:(import.c:65:import_set_state_nolock()) ffff8dc1201c9000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788201546.641794:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715458432:0@lo:39:umount.0 00000100:00100000:3.0:1788201546.641866:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201546.642383:0:66314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715458432 00000100:00100000:2.0:1788201546.642392:0:66314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715458432 00000100:00100000:2.0:1788201546.642443:0:66314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1863 00000100:00100000:2.0:1788201546.642452:0:66314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875060715458432:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788201546.642476:0:66314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e15f 00000100:00080000:2.0:1788201546.642482:0:66314:0:(import.c:65:import_set_state_nolock()) ffff8dc13339e800 : changing import state from FULL to CLOSED 00010000:00000080:2.0:1788201546.642518:0:66314:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc004b39180 x1875060715458432/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:667/0 lens 224/224 e 0 to 0 dl 1788201557 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201546.642566:0:66314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3654:x1875060715458432:12345-0@lo:39:umount.0 Request processed in 115us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201546.642573:0:66314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1863 00000020:00000080:2.0:1788201546.642583:0:66314:0:(genops.c:885:class_export_put()) final put ffff8dc13339d000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1788201546.642606:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201546.642620:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1e047 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e04e expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.642628:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ede00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788201546.642632:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1e047 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e04e expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.642642:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1e047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1e04e expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201546.642651:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1e047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1e04e expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201546.642657:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788201546.642660:0:24979:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788201546.642662:0:24979:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788201546.642688:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1e047 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e04e expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.642694:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201546.642711:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1e047 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e04e expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.642718:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064ede00/0x96d0c9b8c9a1e047 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e04e expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.642730:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201546.642732:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201546.642733:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201546.642745:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715458560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201546.642776:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201546.642844:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715458560 00000100:00100000:2.0:1788201546.642848:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715458560 00000100:00100000:2.0:1788201546.642878:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:2.0:1788201546.642885:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+19:3658:x1875060715458560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201546.642894:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201546.642909:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc108c74c00/0x96d0c9b8c9a1e04e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e047 expref: 19 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.642922:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201546.642947:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+18:3658:x1875060715458560:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201546.642954:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000020:00000080:2.0:1788201546.642977:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13339d000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788201546.643039:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc13339e800 for lustre-MDT0000 00000100:00100000:2.0:1788201546.643070:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715458560:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788201546.643098:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1201c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788201546.643106:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715458432:0@lo:39:umount.0 00000100:00080000:3.0:1788201546.644944:0:106283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201546.644951:0:106283:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788201546.644957:0:106283:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788201546.645952:0:106283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d58800/0x96d0c9b8c9a1df59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1df60 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201546.645968:0:106283:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d58800/0x96d0c9b8c9a1df59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1df60 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201546.645976:0:106283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d58800/0x96d0c9b8c9a1df59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1df60 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201546.645983:0:106283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc140d58800/0x96d0c9b8c9a1df59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1df60 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201546.646005:0:106283:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201546.646051:0:106283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1e86d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e874 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201546.646059:0:106283:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1e86d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e874 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201546.646066:0:106283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1e86d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e874 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201546.646073:0:106283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1e86d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e874 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201546.646096:0:106283:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201546.646103:0:106283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1e039 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1e040 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201546.646110:0:106283:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1e039 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1e040 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201546.646117:0:106283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1e039 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e040 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201546.646124:0:106283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1e039 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1e040 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201546.646135:0:106283:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788201546.646140:0:106283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1df4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1df52 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201546.646147:0:106283:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1df4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1df52 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201546.646159:0:106283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1df4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1df52 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201546.646166:0:106283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1df4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1df52 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201546.646174:0:106283:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788201546.646177:0:106283:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788201546.646207:0:106283:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788201546.646211:0:106283:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1788201546.646214:0:106283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1788201546.646220:0:106283:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:2.0:1788201546.647646:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788201546.647658:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc140d58800/0x96d0c9b8c9a1df59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1df60 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.647667:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58800 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788201546.647672:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d58800/0x96d0c9b8c9a1df59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1df60 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.647681:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc140d58800/0x96d0c9b8c9a1df59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1df60 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201546.647708:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d58800/0x96d0c9b8c9a1df59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1df60 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201546.647714:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788201546.647717:0:6520:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1788201546.647720:0:6520:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000004:00000080:3.0:1788201546.647758:0:106283:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00010000:00010000:2.0:1788201546.647760:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc140d58800/0x96d0c9b8c9a1df59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1df60 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.647766:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201546.647797:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc140d58800/0x96d0c9b8c9a1df59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1df60 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.647804:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc140d58800/0x96d0c9b8c9a1df59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1df60 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.647819:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788201546.647823:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1e86d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e874 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.647828:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3a00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788201546.647831:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1e86d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e874 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.647837:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1e86d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1e874 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201546.647842:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1e86d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1e874 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201546.647857:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788201546.647859:0:6520:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788201546.647861:0:6520:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788201546.647873:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1e86d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e874 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.647878:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201546.647884:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1e86d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e874 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.647889:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1e86d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e874 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.647905:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201546.647909:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1e039 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e040 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.647913:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74a00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788201546.647916:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1e039 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1e040 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.647922:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1e039 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1e040 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201546.647927:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1e039 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1e040 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201546.647932:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788201546.647934:0:6520:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788201546.647940:0:6520:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00000080:3.0:1788201546.647943:0:106283:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 3/7 00000020:00080000:3.0:1788201546.647950:0:106283:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc12f1ad800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1788201546.647951:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1e039 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e040 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788201546.647956:0:106283:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc13339a000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1788201546.647957:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:3.0:1788201546.647963:0:106283:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc1401c5800 6e293f14-c501-4bc5-9dd4-a18ef02756b4 192.168.201.20@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 128849018926 stale:0 00000020:00080000:3.0:1788201546.647969:0:106283:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff8dc12f3099b8) has exports, disconnecting them 00000020:00080000:3.0:1788201546.647973:0:106283:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc12f1ad800), last request at 1788201544 00000020:00000080:3.0:1788201546.647979:0:106283:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e158 00010000:00010000:2.0:1788201546.647984:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1e039 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e040 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788201546.647987:0:106283:0:(import.c:65:import_set_state_nolock()) ffff8dc12f1a9000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788201546.647990:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1e039 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1e040 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.648000:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00080000:3.0:1788201546.648000:0:106283:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc12f1ad800): rc 0 00000020:00000080:3.0:1788201546.648002:0:106283:0:(genops.c:885:class_export_put()) final put ffff8dc12f1ad800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:2.0:1788201546.648003:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1df4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1df52 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.648008:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58e00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788201546.648011:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1df4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1df52 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788201546.648012:0:106283:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc13339a000), last request at 1788201544 00010000:00010000:2.0:1788201546.648033:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1df4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1df52 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788201546.648037:0:106283:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e14a 10000000:00010000:2.0:1788201546.648039:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1df4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1df52 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201546.648044:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000100:00080000:3.0:1788201546.648044:0:106283:0:(import.c:65:import_set_state_nolock()) ffff8dc13339c000 : changing import state from FULL to CLOSED 10000000:01000000:2.0:1788201546.648046:0:6520:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788201546.648048:0:6520:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788201546.648059:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1df4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1df52 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.648064:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201546.648076:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1df4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1df52 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788201546.648079:0:106283:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc13339a000): rc 0 00010000:00010000:2.0:1788201546.648083:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc140d58e00/0x96d0c9b8c9a1df4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1df52 expref: -99 pid: 102446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788201546.648085:0:106283:0:(genops.c:885:class_export_put()) final put ffff8dc13339a000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788201546.648090:0:106283:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.201.20@tcp (ffff8dc1401c5800), last request at 1788201545 00000020:00000080:3.0:1788201546.648094:0:106283:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1dfbb 00010000:00010000:2.0:1788201546.648095:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201546.648096:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201546.648098:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00010000:3.0:1788201546.648103:0:106283:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc1401c5800: total 2 00000100:00080000:3.0:1788201546.648105:0:106283:0:(import.c:65:import_set_state_nolock()) ffff8dc104282000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788201546.648113:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715458688:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788201546.648114:0:106283:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.201.20@tcp (ffff8dc1401c5800): rc 0 00000004:00000080:3.0:1788201546.648119:0:106283:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa0dd40d7fae0 00000100:00080000:3.0:1788201546.648136:0:106283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788201546.648140:0:106283:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:2.0:1788201546.648175:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201546.648220:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201546.648225:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715458816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201546.648244:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00010000:2.0:1788201546.648267:0:6520:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc1401c5800: total 2 00010000:00010000:2.0:1788201546.648302:0:6520:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc1401c5800, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1788201546.648332:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd800/0x96d0c9b8c9a1ed91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fb8 expref: 5 pid: 66314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.648355:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc006dbd600/0x96d0c9b8c9a1ee0f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fe2 expref: 4 pid: 66313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.648380:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3200/0x96d0c9b8c9a1edc9 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fc6 expref: 3 pid: 66757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.648397:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1edad lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fbf expref: 2 pid: 66312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201546.648411:0:6520:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc1401c5800, canceled 4 locks, left on hash table 0. 00010000:00010000:0.0:1788201546.648634:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201546.648641:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201546.651102:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715458944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201546.651186:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201546.651245:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201546.651252:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715459072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201546.651276:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201546.651312:0:9535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715458688 00000100:00100000:0.0:1788201546.651319:0:9535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715458688 00000100:00100000:0.0:1788201546.651369:0:9535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715458816 00000100:00100000:0.0:1788201546.651373:0:9535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715458816 00000100:00100000:0.0:1788201546.651393:0:9535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715458944 00000100:00100000:0.0:1788201546.651396:0:9535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715458944 00000100:00100000:0.0:1788201546.651413:0:9535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715459072 00000100:00100000:0.0:1788201546.651415:0:9535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715459072 00000100:00100000:0.0:1788201546.651429:0:9535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:1.0:1788201546.651435:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 776 00000100:00100000:0.0:1788201546.651437:0:9535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9b18af6-fecc-4172-82c2-66531890fe11+21:3655:x1875060715458688:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201546.651443:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+21:3655:x1875060715458816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201546.651451:0:9535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201546.651451:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201546.651468:0:9535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140d58000/0x96d0c9b8c9a1df60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1df59 expref: 21 pid: 102452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201546.651468:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0056d6600/0x96d0c9b8c9a1e874 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e86d expref: 21 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201546.651484:0:9535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201546.651495:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201546.651529:0:9535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c9b18af6-fecc-4172-82c2-66531890fe11+19:3655:x1875060715458688:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (3352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201546.651529:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+19:3655:x1875060715458816:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (3282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201546.651537:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 776 00000100:00080000:3.0:1788201546.655644:0:106283:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788201546.655657:0:106283:0:(import.c:65:import_set_state_nolock()) ffff8dc13f80c800 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:0.0:1788201546.660107:0:9535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00000100:00100000:3.0:1788201546.660135:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 777 00000100:00100000:3.0:1788201546.660161:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007159500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+18:3657:x1875060715458944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201546.660181:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201546.660207:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140d59c00/0x96d0c9b8c9a1e040 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e039 expref: 18 pid: 102459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201546.660225:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201546.660314:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007159500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+17:3657:x1875060715458944:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (9128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201546.660321:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 777 00000100:00100000:3.0:1788201546.660350:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:3.0:1788201546.660357:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1059bb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+16:3657:x1875060715459072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201546.660366:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201546.660375:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ed000/0x96d0c9b8c9a1df52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1df4b expref: 16 pid: 102452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201546.660389:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201546.660425:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1059bb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+15:3657:x1875060715459072:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (9148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201546.660431:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000020:00000080:3.0:1788201546.660455:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12f1ad800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788201546.660528:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13339a000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788201546.660550:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc12f1a9000 for lustre-MDT0000 00000020:00000080:3.0:1788201546.660553:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc13339c000 for lustre-MDT0000 00010000:00010000:1.0:1788201546.661090:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201546.663776:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715459072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201546.663793:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715458944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201546.664071:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715458816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201546.664081:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715458688:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788201546.665124:0:106283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788201546.665130:0:106283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901910 gen 3 00000004:00080000:1.0:1788201546.665154:0:106283:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788201546.665254:0:106283:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788201546.665290:0:106283:0:(import.c:65:import_set_state_nolock()) ffff8dc005a48000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788201546.665312:0:106283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788201546.665315:0:106283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1788201546.665323:0:106283:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788201546.665424:0:106283:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788201546.665432:0:106283:0:(import.c:65:import_set_state_nolock()) ffff8dc1031fb000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788201546.665473:0:106283:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8dc12f3099b8) has no exports 00000100:00100000:0.0:1788201546.665541:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715459200:0@lo:9:umount.0 00000100:00100000:0.0:1788201546.665605:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201546.665636:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715459200 00000100:00100000:0.0:1788201546.665640:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715459328:0@lo:9:umount.0 00000100:00100000:3.0:1788201546.665643:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715459200 00000100:00100000:0.0:1788201546.665660:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201546.665683:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715459328 00000100:00100000:3.0:1788201546.665686:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715459328 00000100:00100000:0.0:1788201546.665695:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788201546.665705:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715459200:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788201546.665729:0:100688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e016 00000100:00080000:0.0:1788201546.665738:0:100688:0:(import.c:65:import_set_state_nolock()) ffff8dc005d76000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788201546.665789:0:100688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901911 00000100:00100000:0.0:1788201546.665910:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3654:x1875060715459200:12345-0@lo:9:umount.0 Request processed in 207us (305us total) trans 0 rc 0/0 00000100:00080000:1.0:1788201546.665965:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc005a48000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788201546.665974:0:3654:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788201546.665976:0:3654:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788201546.665979:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715459200:0@lo:9:umount.0 00010000:00010000:1.0:1788201546.668742:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201546.671953:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788201546.671980:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715459328:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788201546.672026:0:99767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e024 00000100:00080000:3.0:1788201546.672038:0:99767:0:(import.c:65:import_set_state_nolock()) ffff8dc005d76800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788201546.672131:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00010000:0.0:1788201546.672168:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788201546.674413:0:6520:0:(genops.c:885:class_export_put()) final put ffff8dc1401c5800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:2.0:1788201546.674449:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1401c5800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 for lustre-MDT0000 00000020:00080000:1.0:1788201546.674474:0:106283:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8dc12f3099b8) has no exports 00000020:00000080:2.0:1788201546.674493:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc104282000 for lustre-MDT0000 00010000:00010000:2.0:1788201546.674529:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201546.674532:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201546.674534:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788201546.677806:0:99767:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788201546.678046:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3654:x1875060715459328:12345-0@lo:9:umount.0 Request processed in 6073us (12377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201546.678058:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1788201546.678180:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1031fb000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788201546.678200:0:3654:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788201546.678203:0:3654:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201546.678207:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715459328:0@lo:9:umount.0 00000020:00000080:1.0:1788201546.734145:0:106283:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1dfd0 00000020:00000080:1.0:1788201546.734161:0:106283:0:(genops.c:885:class_export_put()) final put ffff8dc12f3a5000/lustre-QMT0000_UUID 00000020:01000000:1.0:1788201546.734179:0:106283:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788201546.735987:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12f3a5000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788201546.736280:0:106283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201546.736292:0:106283:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788201546.736296:0:106283:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8dc004fd4d28) has no exports 00000020:00000080:2.0:1788201546.736712:0:106283:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1dfc9 00000020:00000080:2.0:1788201546.736721:0:106283:0:(genops.c:885:class_export_put()) final put ffff8dc0059d2800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788201546.736777:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0059d2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788201546.736785:0:106283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201546.736792:0:106283:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788201546.736795:0:106283:0:(genops.c:885:class_export_put()) final put ffff8dc0059d0000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788201546.736798:0:106283:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0059d0000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788201546.736802:0:106283:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1788201546.737068:0:106283:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc002582f00 - data ffff8dc0020d8288/ffff8dc13f802400 00000020:01000000:2.0:1788201546.737273:0:106283:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc007b82f00 - data ffff8dc1338c3360/ffff8dc140c0a400 00000100:00080000:2.0:1788201546.830278:0:106283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788201546.830287:0:106283:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788201546.830294:0:106283:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788201546.831147:0:106283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788201546.831151:0:106283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901910 gen 4 00000004:00080000:2.0:1788201546.831161:0:106283:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201546.831162:0:106283:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788201546.831270:0:102466:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788201546.831275:0:102466:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x78:0x0] index 1 count 1 00000040:00080000:2.0:1788201546.831284:0:102466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 30 count 2 00000100:00080000:2.0:1788201546.831733:0:106283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788201546.831751:0:106283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788201546.831757:0:106283:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201546.831758:0:106283:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788201546.831853:0:102468:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788201546.831855:0:102468:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x7a:0x0] index 1 count 1 00000040:00080000:2.0:1788201546.831860:0:102468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 30 count 2 00000020:00000080:3.0:1788201546.841770:0:106283:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1df7c 00000020:00000080:3.0:1788201546.841784:0:106283:0:(genops.c:885:class_export_put()) final put ffff8dc005d70800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788201546.842648:0:106283:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1df91 00000020:00000080:3.0:1788201546.842657:0:106283:0:(genops.c:885:class_export_put()) final put ffff8dc11077f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201546.842744:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005d70800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788201546.842919:0:106283:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788201546.842927:0:106283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201546.842948:0:106283:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788201546.842953:0:106283:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8dc12f30cd28) has no exports 00000004:01000000:3.0:1788201546.843144:0:106283:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788201546.843153:0:106283:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e01d 00000020:00000080:3.0:1788201546.843158:0:106283:0:(genops.c:885:class_export_put()) final put ffff8dc110737000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788201546.843163:0:106283:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788201546.843167:0:106283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201546.843174:0:106283:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788201546.843177:0:106283:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8dc1256399b8) has no exports 00000020:00000080:3.0:1788201546.843182:0:106283:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e00f 00000020:00000080:3.0:1788201546.843185:0:106283:0:(genops.c:885:class_export_put()) final put ffff8dc110731800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788201546.843541:0:106283:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788201546.843547:0:106283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788201546.843551:0:106283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1788201546.843556:0:106283:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201546.843558:0:106283:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788201546.843592:0:106283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201546.843599:0:106283:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201546.843604:0:106283:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e001 00000020:00000080:3.0:1788201546.843609:0:106283:0:(genops.c:885:class_export_put()) final put ffff8dc110731000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788201546.843612:0:106283:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788201546.843616:0:106283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201546.843620:0:106283:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788201546.843622:0:106283:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8dc1060e3370) has no exports 00000020:00000080:3.0:1788201546.843626:0:106283:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1dff3 00000020:00000080:3.0:1788201546.843629:0:106283:0:(genops.c:885:class_export_put()) final put ffff8dc005a4d000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788201546.844141:0:106283:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788201546.844145:0:106283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788201546.844147:0:106283:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901910 gen 5 00000004:00080000:3.0:1788201546.844151:0:106283:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201546.844152:0:106283:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788201546.844178:0:106283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201546.844191:0:106283:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788201546.844201:0:106283:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788201546.844207:0:106283:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1dfe5 00000020:00000080:3.0:1788201546.844212:0:106283:0:(genops.c:885:class_export_put()) final put ffff8dc006d87800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788201546.844216:0:106283:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='F') 00000020:00000080:3.0:1788201546.844219:0:106283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201546.844223:0:106283:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788201546.844225:0:106283:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8dc139bb99b8) has no exports 00000020:00000080:3.0:1788201546.844229:0:106283:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1dfde 00000020:00000080:3.0:1788201546.844232:0:106283:0:(genops.c:885:class_export_put()) final put ffff8dc004014000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788201546.845572:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11077f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788201546.845588:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110737000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788201546.845593:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110731800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788201546.845598:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1031fb000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788201546.845605:0:76267:0:(genops.c:885:class_export_put()) final put ffff8dc110732000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201546.845607:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110732000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788201546.845611:0:76267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201546.845713:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110731000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788201546.845719:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005a4d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788201546.845723:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc005a48000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788201546.845728:0:76267:0:(genops.c:885:class_export_put()) final put ffff8dc004015000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201546.845730:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc004015000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788201546.845733:0:76267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201546.845761:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc006d87800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788201546.845765:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc004014000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788201546.846886:0:106283:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788201546.846893:0:106283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788201546.846898:0:106283:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788201546.846905:0:106283:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788201546.846998:0:106283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201546.847011:0:106283:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201546.847080:0:106283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201546.847090:0:106283:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201546.847095:0:106283:0:(genops.c:885:class_export_put()) final put ffff8dc11cdd8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201546.847099:0:106283:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11cdd8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788201546.847106:0:106283:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201546.847282:0:106283:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1df98 00000020:00000080:2.0:1788201546.847289:0:106283:0:(genops.c:885:class_export_put()) final put ffff8dc11077e000/lustre-MDD0000_UUID 00000020:01000000:2.0:1788201546.847295:0:106283:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788201546.847299:0:106283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201546.847304:0:106283:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788201546.847307:0:106283:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8dc12f308000) has no exports 00000020:00000080:2.0:1788201546.847327:0:106283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201546.847330:0:106283:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788201546.847334:0:106283:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1df9f 00000020:00000080:2.0:1788201546.847337:0:106283:0:(genops.c:885:class_export_put()) final put ffff8dc11077b000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788201546.847343:0:106283:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc12f19b800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788201546.847347:0:106283:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc12f19b800 3 00000020:01000004:2.0:1788201546.847350:0:106283:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dc12f19b800 from lustre-MDT0000 00000020:00000080:2.0:1788201546.847366:0:106283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201546.847369:0:106283:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788201546.847372:0:106283:0:(genops.c:885:class_export_put()) final put ffff8dc005d74800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788201546.847374:0:106283:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005d74800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788201546.847380:0:106283:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788201546.847406:0:106283:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1788201546.847410:0:106283:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788201546.847412:0:106283:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788201546.847415:0:106283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201546.847418:0:106283:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788201546.847426:0:106283:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8dc1401c6800 93ba7067-43b5-4e46-8db7-27c040fa03d9 192.168.201.20@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788201546.847432:0:106283:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8dc004014800 c9b18af6-fecc-4172-82c2-66531890fe11 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788201546.847436:0:106283:0:(genops.c:1553:class_disconnect_exports()) OBD device 3 (ffff8dc139bb8000) has exports, disconnecting them 00000020:00080000:2.0:1788201546.847447:0:106283:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.201.20@tcp (ffff8dc1401c6800), last request at 1788201433 00000020:00000080:2.0:1788201546.847469:0:106283:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1dfad 00000020:00010000:2.0:1788201546.847473:0:106283:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc1401c6800: total 2 00000100:00080000:2.0:1788201546.847477:0:106283:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c4000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788201546.847489:0:106283:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.201.20@tcp (ffff8dc1401c6800): rc 0 00000020:00080000:2.0:1788201546.847492:0:106283:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8dc004014800), last request at 1788201432 00000020:00000080:2.0:1788201546.847548:0:106283:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1df44 00000020:00010000:2.0:1788201546.847552:0:106283:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc004014800: total 2 00000100:00080000:2.0:1788201546.847555:0:106283:0:(import.c:65:import_set_state_nolock()) ffff8dc004013800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788201546.847563:0:106283:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc004014800): rc 0 00000020:00080000:2.0:1788201546.847567:0:106283:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8dc139bb8000) has no exports 00000100:00100000:2.0:1788201546.847639:0:102452:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8dc13a304000:102452] 0 exiting: rc = 1 00000020:00010000:1.0:1788201546.847902:0:24979:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc1401c6800: total 2 00010000:00010000:1.0:1788201546.847943:0:24979:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc1401c6800, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1788201546.847973:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1e078 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786dea expref: 5 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201546.847990:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006dbc400/0x96d0c9b8c9a1e071 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786de3 expref: 4 pid: 102452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201546.848000:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc108c74600/0x96d0c9b8c9a1e07f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786df1 expref: 3 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201546.848011:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae2c00/0x96d0c9b8c9a1e858 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786eed expref: 2 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201546.848055:0:24979:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc1401c6800, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1788201546.848074:0:24979:0:(genops.c:885:class_export_put()) final put ffff8dc1401c6800/93ba7067-43b5-4e46-8db7-27c040fa03d9 00000020:00010000:1.0:1788201546.848079:0:24979:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc004014800: total 3 00010000:00010000:1.0:1788201546.848081:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201546.848097:0:24979:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc004014800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788201546.848113:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc108c75e00/0x96d0c9b8c9a1e0a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e0a2 expref: 9 pid: 102459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201546.848124:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc108c74200/0x96d0c9b8c9a1e09b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e094 expref: 8 pid: 102454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201546.848134:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140d59400/0x96d0c9b8c9a1e0b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e0b0 expref: 7 pid: 102454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201546.848144:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae3600/0x96d0c9b8c9a1e135 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e12e expref: 6 pid: 102454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201546.848155:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064eda00/0x96d0c9b8c9a1e0c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e0be expref: 5 pid: 102453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201546.848165:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064edc00/0x96d0c9b8c9a1e0d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e0cc expref: 4 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201546.848174:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ed400/0x96d0c9b8c9a1e0e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e0da expref: 3 pid: 102454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201546.848186:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006dbcc00/0x96d0c9b8c9a1e143 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1e13c expref: 2 pid: 102459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201546.848207:0:24979:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc004014800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1788201546.848220:0:24979:0:(genops.c:885:class_export_put()) final put ffff8dc004014800/c9b18af6-fecc-4172-82c2-66531890fe11 00010000:00010000:1.0:1788201546.848225:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201546.848227:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201546.848228:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201546.848235:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201546.848265:0:102453:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8dc13a305000:102453] 1 exiting: rc = 0 00000020:00000080:1.0:1788201546.848308:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc13f80c800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788201546.848314:0:76267:0:(genops.c:885:class_export_put()) final put ffff8dc004017000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788201546.848316:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc004017000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788201546.848323:0:76267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201546.848415:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11077e000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788201546.848419:0:76267:0:(genops.c:885:class_export_put()) final put ffff8dc005d71000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788201546.848421:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005d71000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788201546.848425:0:76267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788201546.848527:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11077b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788201546.848532:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1401c6800/93ba7067-43b5-4e46-8db7-27c040fa03d9 for MGS 00000020:00000080:1.0:1788201546.848558:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc004014800/c9b18af6-fecc-4172-82c2-66531890fe11 for MGS 00000020:00000080:1.0:1788201546.848569:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1401c4000 for MGS 00000020:00000080:1.0:1788201546.848572:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc004013800 for MGS 00000100:00100000:1.0:1788201546.850126:0:102459:0:(service.c:3183:ptlrpc_main()) ll_mgs_0004: service thread [ffff8dc11cd59800:102459] 4 exiting: rc = 0 00000100:00100000:2.0:1788201546.851208:0:102458:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff8dc10a190400:102458] 3 exiting: rc = 0 00000100:00100000:1.0:1788201546.852276:0:102454:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8dc0024a6c00:102454] 2 exiting: rc = 0 00000100:00100000:2.0:1788201546.852454:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852464:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852471:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852478:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852483:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852489:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852494:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852500:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852521:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852527:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852533:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852540:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852546:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852553:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852559:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852565:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852571:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852578:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852584:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852604:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852610:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852616:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852622:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852627:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852633:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852638:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852644:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852650:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852656:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852662:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852668:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852673:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852679:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852684:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852689:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852695:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852701:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852707:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852712:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852719:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852724:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852730:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852735:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852741:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852747:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852752:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852758:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852764:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852770:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852776:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852783:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852789:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852795:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852801:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852824:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852830:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852836:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852843:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852850:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852855:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852861:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852868:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852874:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201546.852879:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1788201546.853976:0:106283:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc12f4262a0 - data ffff8dc13392c288/ffff8dc13c3c8800 00000020:01000000:2.0:1788201546.856064:0:106283:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc00532ff00 - data ffff8dc0021541b0/ffff8dc12eddfc00 00000020:00000080:2.0:1788201546.856606:0:106283:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1df3d 00000020:00000080:2.0:1788201546.856618:0:106283:0:(genops.c:885:class_export_put()) final put ffff8dc004016800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788201546.856643:0:106283:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc12f19b800 from MGS, refs=2 00000020:01000004:2.0:1788201546.856647:0:106283:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc12f19b800 2 00000020:01000004:2.0:1788201546.856650:0:106283:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dc12f19b800 from MGS 00000020:00000080:2.0:1788201546.856673:0:106283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201546.856680:0:106283:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788201546.856682:0:106283:0:(genops.c:885:class_export_put()) final put ffff8dc1090d2800/MGS 00000020:00000080:2.0:1788201546.856685:0:106283:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1090d2800/MGS for MGS 00000020:01000000:2.0:1788201546.856693:0:106283:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788201546.856759:0:106283:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788201546.856763:0:106283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201546.856771:0:106283:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788201546.856779:0:106283:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8dc1201cb000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788201546.856785:0:106283:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8dc0027d19b8) has exports, disconnecting them 00000020:00080000:2.0:1788201546.856790:0:106283:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8dc1201cb000), last request at 1788201433 00000020:00000080:2.0:1788201546.856794:0:106283:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1e05c 00000020:00080000:2.0:1788201546.856805:0:106283:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc1201cb000): rc 0 00000020:00000080:1.0:1788201546.856927:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc004016800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788201546.857904:0:106283:0:(genops.c:885:class_export_put()) final put ffff8dc1201cb000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788201546.858762:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1201cb000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788201546.909679:0:106283:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788201546.909688:0:106283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788201546.909707:0:106283:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788201546.909714:0:106283:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201546.909756:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1201c9000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788201546.909963:0:106283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201546.909975:0:106283:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788201546.909980:0:106283:0:(genops.c:885:class_export_put()) final put ffff8dc1201ca000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788201546.909984:0:106283:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1201ca000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788201546.910006:0:106283:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788201546.910092:0:106283:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc12f19b800 1 00000020:00000080:1.0:1788201546.910099:0:106283:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1df2f 00000020:00000080:1.0:1788201546.910105:0:106283:0:(genops.c:885:class_export_put()) final put ffff8dc1090d1000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788201546.910114:0:106283:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788201546.910122:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1090d1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788201546.910134:0:106283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201546.910138:0:106283:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788201546.910142:0:106283:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8dc139bbcd28) has no exports 00010000:00010000:0.0:1788201547.026183:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788201547.038489:0:106283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201547.038523:0:106283:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788201547.038529:0:106283:0:(genops.c:885:class_export_put()) final put ffff8dc12f19d800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788201547.038533:0:106283:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12f19d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788201547.038546:0:106283:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788201547.038664:0:106283:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dc12f19a800 00000020:01000000:2.0:1788201547.038684:0:106283:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788201547.038688:0:106283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201547.038692:0:106283:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788201547.038696:0:106283:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8dc13f873370) has no exports 00000100:00100000:0.0:1788201547.039239:0:66313:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8dc11cd55600:66313] 1 exiting: rc = 0 00000100:00100000:2.0:1788201547.042347:0:66314:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8dc119936200:66314] 2 exiting: rc = 0 00000100:00100000:2.0:1788201547.042573:0:66312:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8dc11cd54200:66312] 0 exiting: rc = 1 00000100:00100000:3.0:1788201547.043772:0:69485:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8dc12b8b0400:69485] 4 exiting: rc = 0 00000100:00100000:3.0:1788201547.075862:0:66757:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8dc005c6b800:66757] 3 exiting: rc = 0 00000100:00100000:2.0:1788201547.076304:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076313:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076321:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076328:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076336:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076343:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076351:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076358:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076364:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076371:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076377:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076383:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076389:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076398:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076404:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076410:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076416:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076422:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076428:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076434:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076440:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076446:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076454:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076476:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076482:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076489:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076494:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076530:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076537:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076542:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076547:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076552:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076558:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076564:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076570:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076576:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076582:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076587:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076593:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076599:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076608:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076614:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076620:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076627:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076634:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076641:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076647:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076653:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076659:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076664:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076670:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076675:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076681:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076687:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076693:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076699:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076704:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076710:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076723:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076729:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076734:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076740:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076746:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.076751:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788201547.079840:0:66315:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8dc119937c00:66315] 0 exiting: rc = 1 00000100:00100000:1.0:1788201547.079992:0:66316:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8dc125a2b000:66316] 1 exiting: rc = 0 00000100:00100000:3.0:1788201547.080251:0:79137:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff8dc005fb8400:79137] 2 exiting: rc = 0 00000100:00100000:2.0:1788201547.080374:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080382:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080388:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080393:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080400:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080406:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080412:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080418:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080424:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080431:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080437:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080443:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080449:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080454:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080460:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080466:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080473:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080480:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080486:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080492:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080514:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080521:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080528:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080533:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080540:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080545:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080551:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080558:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080564:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080584:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080590:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080596:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080602:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080608:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080614:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080620:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080626:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080631:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080637:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080643:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080649:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080656:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080662:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080667:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080674:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080680:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080684:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080690:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080696:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080701:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080707:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080717:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080723:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080730:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080737:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080744:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080750:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080759:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080766:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080772:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080778:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080784:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080789:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.080801:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201547.081660:0:66318:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8dc001e45c00:66318] 1 exiting: rc = 0 00000100:00100000:2.0:1788201547.081786:0:101344:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8dc005815400:101344] 2 exiting: rc = 0 00000100:00100000:0.0:1788201547.082533:0:66317:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8dc001e45e00:66317] 0 exiting: rc = 1 00000100:00100000:3.0:1788201547.084013:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084183:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084191:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084202:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084210:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084219:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084225:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084230:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084244:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084252:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084258:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084264:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084271:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084277:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084283:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084289:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084303:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084323:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084330:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084337:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084344:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084364:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084370:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084377:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084383:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084389:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084396:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084402:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084408:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084414:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084428:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084435:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084441:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084448:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084453:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084460:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084466:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084472:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084479:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084493:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084508:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084516:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084522:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084527:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084533:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084540:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084555:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084562:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084569:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084574:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084580:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084585:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084591:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084597:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084603:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084609:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084622:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084630:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084635:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084641:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084647:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084654:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084660:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788201547.084666:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201547.100688:0:66319:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8dc001e44e00:66319] 0 exiting: rc = 1 00000100:00100000:1.0:1788201547.100775:0:66320:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8dc119937a00:66320] 1 exiting: rc = 0 00000100:00100000:2.0:1788201547.100857:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100865:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100871:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100875:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100878:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100882:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100886:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100890:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100893:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100896:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100900:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100903:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100906:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100909:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100912:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100915:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100918:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100921:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100924:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100926:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100929:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100932:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100934:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100937:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100940:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100943:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100946:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100949:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100952:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100955:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100958:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100969:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100973:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100976:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100990:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100994:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.100998:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101001:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101005:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101008:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101011:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101032:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101036:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101039:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101042:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101045:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101048:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101052:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101055:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101058:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101061:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101064:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101067:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101069:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101072:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101074:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101077:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101080:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101082:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101085:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101088:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101091:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101094:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101098:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788201547.101396:0:92515:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0002: service thread [ffff8dc006ddf600:92515] 2 exiting: rc = 0 00000100:00100000:1.0:1788201547.101446:0:66321:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8dc0074be600:66321] 0 exiting: rc = 1 00000100:00100000:0.0:1788201547.101604:0:66322:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8dc11ccb9800:66322] 1 exiting: rc = 0 00000100:00100000:2.0:1788201547.101786:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101792:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101797:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101802:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101808:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101822:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101827:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101831:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101836:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101841:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101847:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101854:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101860:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101866:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101871:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101876:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101881:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101886:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101891:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101896:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101901:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101907:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101913:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101918:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101923:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101929:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101934:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101939:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101944:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101949:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.101954:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102094:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102103:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102108:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102114:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102119:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102124:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102129:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102134:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102139:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102152:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102157:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102162:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102167:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102171:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102176:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102181:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102186:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102191:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102195:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102200:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102204:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102209:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102214:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102220:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102225:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102230:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102234:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102239:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102245:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102250:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102254:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102258:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.102263:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103234:0:66324:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8dc11ccb8400:66324] 1 exiting: rc = 0 00000100:00100000:3.0:1788201547.103497:0:66323:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8dc0074bf000:66323] 0 exiting: rc = 1 00000100:00100000:2.0:1788201547.103600:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103608:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103614:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103619:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103624:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103628:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103633:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103638:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103643:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103648:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103664:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103670:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103675:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103681:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103686:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103692:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103697:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103702:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103707:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103713:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103718:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103723:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103727:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103732:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103737:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103742:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103747:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103753:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103758:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103762:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103768:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103773:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103779:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103784:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103789:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103794:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103800:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103805:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103810:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103815:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103821:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103826:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103831:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103836:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103841:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103854:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103859:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103864:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103869:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103874:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103879:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103884:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103890:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103895:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103900:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103905:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103911:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103916:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103921:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103926:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103931:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103936:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103941:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.103946:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.104467:0:66327:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8dc005fb9c00:66327] 2 exiting: rc = 0 00000100:00100000:2.0:1788201547.104652:0:66325:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8dc005fb8200:66325] 0 exiting: rc = 1 00000100:00100000:3.0:1788201547.104931:0:66326:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8dc005fb9800:66326] 1 exiting: rc = 0 00000100:00100000:2.0:1788201547.105056:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105062:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105068:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105073:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105079:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105084:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105105:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105111:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105117:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105123:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105128:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105134:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105139:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105145:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105162:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105167:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105173:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105179:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105184:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105190:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105196:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105202:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105208:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105213:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105218:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105223:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105229:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105235:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105241:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105246:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105266:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105273:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105279:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105285:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105291:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105296:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105302:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105308:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105425:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105431:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105438:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105444:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105449:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105454:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105460:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105466:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105473:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105478:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105484:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105507:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105514:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105519:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105525:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105531:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105552:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105559:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105564:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105570:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105576:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105582:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105588:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105593:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105600:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201547.105606:0:106283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788201547.113779:0:106283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201547.113793:0:106283:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788201547.113799:0:106283:0:(genops.c:885:class_export_put()) final put ffff8dc005fac800/MDS_uuid 00000020:00000080:2.0:1788201547.113803:0:106283:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005fac800/MDS_uuid for MDS 00000020:01000000:2.0:1788201547.113810:0:106283:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788201547.113962:0:106283:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788201548.050727:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788201548.637398:0:100576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201548.637408:0:100576:0:(genops.c:885:class_export_put()) final put ffff8dc005d71800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788201548.637436:0:100576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788201548.637438:0:100576:0:(genops.c:885:class_export_put()) final put ffff8dc00520e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788201548.637625:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005d71800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788201548.637686:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc00520e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788201548.637703:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc005d76800 for lustre-OST0001 00000020:00000080:2.0:1788201548.637708:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc00520b800 for lustre-OST0001 00000001:00100000:2.0:1788201548.637734:0:99761:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201548.637738:0:99761:0:(genops.c:885:class_export_put()) final put ffff8dc005d72000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788201548.637749:0:99761:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788201548.637751:0:99761:0:(genops.c:885:class_export_put()) final put ffff8dc120723000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788201548.637761:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005d72000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788201548.637776:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc120723000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788201548.637789:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc005d76000 for lustre-OST0000 00000020:00000080:2.0:1788201548.637802:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc120727800 for lustre-OST0000 00010000:00010000:1.0:1788201549.071435:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201549.135573:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715459456:0@lo:400:kworker.0 00000400:00000100:3.0:1788201549.135640:0:3655:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715459456 offset 0 length 224: 4 00000100:00100000:2.0:1788201549.135895:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715459584:0@lo:400:kworker.0 00000400:00000100:2.0:1788201549.135923:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875060715459584 offset 0 length 224: 4 00000100:00080000:0.0:1788201549.136168:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201549.136173:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788201549.136176:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201549.136182:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 4395 00000100:00080000:0.0:1788201549.136316:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788201549.136323:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8dc13f86f000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201549.136346:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc00715a680 x1875060715459712/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201549.139680:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715459712:0@lo:38:kworker.0 00000400:00000100:1.0:1788201549.139741:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875060715459712 offset 0 length 520: 4 00000100:00100000:3.0:1788201549.140094:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:0.0:1788201549.140310:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201549.140316:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788201549.140320:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201549.140326:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 4395 00000100:00080000:0.0:1788201549.140331:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788201549.140337:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8dc1401c2800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201549.140359:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc00715aa00 x1875060715459968/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201549.140513:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715459840:0@lo:400:kworker.0 00000400:00000100:3.0:1788201549.140540:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875060715459840 offset 0 length 224: 4 00000100:00100000:1.0:1788201549.140707:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715459968:0@lo:38:kworker.0 00000400:00000100:1.0:1788201549.140729:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875060715459968 offset 0 length 520: 4 00010000:00010000:1.0:1788201550.095912:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1788201550.807093:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 12 match 1875060695576064 offset 0 length 520: 4 00000400:00000100:0.0:1788201550.807121:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695575808 offset 0 length 224: 4 00000100:00100000:0.0:1788201550.807150:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000400:00000100:0.0:1788201550.807180:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 12 match 1875060695575936 offset 0 length 224: 4 00000100:00100000:0.0:1788201550.807203:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201550.807530:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695576192 00000100:00100000:1.0:1788201550.807542:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695576192 00000100:00100000:1.0:1788201550.807614:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695576320 00000100:00100000:1.0:1788201550.807618:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695576320 00000100:00100000:1.0:1788201550.807645:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 149 00000100:00100000:1.0:1788201550.807656:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695576192:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201550.807728:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695576192:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 74us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201550.807736:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 149 00000100:00100000:1.0:1788201550.807755:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 150 00000100:00100000:1.0:1788201550.807762:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695576320:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201550.807805:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695576320:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 43us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201550.807811:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 150 00000100:00080000:0.0:1788201550.808641:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201550.808646:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788201551.119904:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201552.147002:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201553.176473:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201554.191639:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201554.256074:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201554.256081:0:57134:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788201554.256087:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715460096:0@lo:400:kworker.0 00000100:00080000:1.0:1788201554.256094:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201554.256099:0:57134:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788201554.256131:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715460224:0@lo:400:kworker.0 00000400:00000100:3.0:1788201554.256143:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715460096 offset 0 length 224: 4 00000400:00000100:1.0:1788201554.256166:0:3655:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875060715460224 offset 0 length 224: 4 00000100:00100000:1.0:1788201554.256195:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201554.256203:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715460352:0@lo:400:kworker.0 00000400:00000100:1.0:1788201554.256240:0:3655:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875060715460352 offset 0 length 224: 4 00010000:00010000:0.0:1788201555.216808:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1788201555.924703:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 12 match 1875060695576576 offset 0 length 224: 4 00000400:00000100:3.0:1788201555.924729:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695576448 offset 0 length 224: 4 00000100:00100000:0.0:1788201555.929249:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201555.929429:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201555.938539:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695576704 00000100:00100000:1.0:1788201555.938557:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695576704 00000100:00100000:1.0:1788201555.938653:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695576832 00000100:00100000:1.0:1788201555.938657:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695576832 00000100:00100000:1.0:1788201555.939415:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 66 00000100:00100000:1.0:1788201555.939433:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2399:x1875060695576704:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:1.0:1788201555.939463:0:99764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1ea50 00000100:00080000:1.0:1788201555.939471:0:99764:0:(import.c:65:import_set_state_nolock()) ffff8dc137d30800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788201555.939515:0:99764:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901911 00000100:00100000:1.0:1788201555.939660:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+2:2399:x1875060695576704:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 233us (10420us total) trans 0 rc 0/0 00000100:00080000:0.0:1788201555.939711:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201555.939716:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201555.945705:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 67 00000100:00100000:3.0:1788201555.945728:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2399:x1875060695576832:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:3.0:1788201555.945780:0:101191:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1ea57 00000100:00080000:3.0:1788201555.945790:0:101191:0:(import.c:65:import_set_state_nolock()) ffff8dc103487800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788201555.945848:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 66 00000001:00000004:3.0:1788201555.945861:0:101191:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:1.0:1788201555.945892:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201555.945933:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201555.946046:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+2:2399:x1875060695576832:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 327us (16616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201555.946053:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 67 00010000:00010000:1.0:1788201556.240815:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201557.265295:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201558.292856:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201559.311211:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201559.376523:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201559.376529:0:57134:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201559.376568:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201559.376572:0:57134:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788201559.376588:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201559.376603:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715460736:0@lo:400:kworker.0 00000400:00000100:3.0:1788201559.376652:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875060715460736 offset 0 length 224: 4 00000100:00100000:0.0:1788201559.376978:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715460480:0@lo:400:kworker.0 00000400:00000100:0.0:1788201559.377005:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715460480 offset 0 length 224: 4 00000100:00100000:0.0:1788201559.377075:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201559.377082:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715460608:0@lo:400:kworker.0 00000400:00000100:0.0:1788201559.377100:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875060715460608 offset 0 length 224: 4 00010000:00010000:1.0:1788201560.336261:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1788201561.045161:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695576960 offset 0 length 224: 4 00000400:00000100:0.0:1788201561.052135:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 12 match 1875060695577088 offset 0 length 224: 4 00010000:00010000:2.0:1788201561.366972:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788201561.428090:0:99761:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:2.0:1788201561.428104:0:99761:0:(genops.c:885:class_export_put()) final put ffff8dc137d36800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000001:00100000:3.0:1788201561.428225:0:100576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:3.0:1788201561.428230:0:100576:0:(genops.c:885:class_export_put()) final put ffff8dc103483000/6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:1.0:1788201561.428642:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d36800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 for lustre-OST0000 00000020:00000080:1.0:1788201561.428699:0:57134:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc103483000/6e293f14-c501-4bc5-9dd4-a18ef02756b4 for lustre-OST0001 00000020:00000080:1.0:1788201561.428722:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc137d30800 for lustre-OST0000 00000020:00000080:1.0:1788201561.428729:0:57134:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc103487800 for lustre-OST0001 00010000:00010000:0.0:1788201562.384846:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201563.432088:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201564.503912:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201564.506219:0:3654:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201549/real 1788201549] req@ffff8dc00715aa00 x1875060715459968/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201564 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201564.506260:0:3654:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dc00715aa00 x1875060715459968/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201564 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201564.506272:0:3654:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201549/real 1788201549] req@ffff8dc00715a680 x1875060715459712/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201564 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201564.506285:0:3654:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dc00715a680 x1875060715459712/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201564 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201564.506309:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201564.506343:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788201564.506348:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715459968:0@lo:38:kworker.0 00000100:00080000:2.0:1788201564.506356:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201564.506362:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788201564.506365:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715459712:0@lo:38:kworker.0 00000100:00080000:1.0:1788201564.506633:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201564.506638:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788201564.506642:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201564.506648:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 4400 00000100:00080000:1.0:1788201564.506668:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201564.506676:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8dc13f86f000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201564.506712:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc10604b100 x1875060715461120/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201564.506735:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1788201564.506735:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715460864:0@lo:400:kworker.0 00000100:00080000:1.0:1788201564.506738:0:57134:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788201564.506740:0:57134:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201564.506743:0:57134:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 4400 00000100:00080000:1.0:1788201564.506745:0:57134:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201564.506749:0:57134:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8dc1401c2800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201564.506759:0:57134:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc106049180 x1875060715461376/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201564.506784:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715460992:0@lo:400:kworker.0 00000400:00000100:2.0:1788201564.506801:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715460864 offset 0 length 224: 4 00000400:00000100:1.0:1788201564.506808:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875060715460992 offset 0 length 224: 4 00000100:00100000:2.0:1788201564.511498:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715461248:0@lo:400:kworker.0 00000400:00000100:2.0:1788201564.517421:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875060715461248 offset 0 length 224: 4 00000100:00100000:2.0:1788201564.517528:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715461120:0@lo:38:kworker.0 00000400:00000100:2.0:1788201564.517552:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875060715461120 offset 0 length 520: 4 00000100:00100000:2.0:1788201564.517566:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715461376:0@lo:38:kworker.0 00000400:00000100:2.0:1788201564.517593:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875060715461376 offset 0 length 520: 4 00000400:00000100:1.0:1788201565.140427:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 12 match 1875060695577472 offset 0 length 520: 4 00000400:00000100:1.0:1788201565.149436:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695577216 offset 0 length 224: 4 00000400:00000100:1.0:1788201565.149786:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 12 match 1875060695577344 offset 0 length 224: 4 00000100:00000400:0.0:1788201565.462003:0:3655:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201549/real 1788201549] req@ffff8dc007158e00 x1875060715459456/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788201565 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201565.517369:0:3655:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8dc007158e00 x1875060715459456/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788201565 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201565.517389:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788201565.517394:0:3655:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788201565.517398:0:3655:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.120@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788201565.517400:0:3655:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788201565.517404:0:3655:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc007158e00 x1875060715459456/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788201565 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201565.517415:0:3655:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc106049c00 x1875060715460096/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201570 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201565.517440:0:3655:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc004b38e00 x1875060715460480/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201575 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201565.517458:0:3655:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc106049500 x1875060715460864/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201580 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788201565.517473:0:3655:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788201565.517488:0:3655:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788201565.517489:0:3655:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788201565.517493:0:3655:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:0.0:1788201565.517549:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715460096:0@lo:400:kworker.0 00000100:00100000:0.0:1788201565.517606:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715460480:0@lo:400:kworker.0 00000100:00000400:0.0:1788201565.517634:0:3656:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201549/real 1788201549] req@ffff8dc007159c00 x1875060715459584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201565 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201565.517653:0:3656:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8dc007159c00 x1875060715459584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201565 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201565.517661:0:3656:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788201565.517665:0:3656:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788201565.517670:0:3656:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00100000:0.0:1788201565.517688:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715460864:0@lo:400:kworker.0 00000100:00100000:0.0:1788201565.517695:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715459584:0@lo:400:kworker.0 00000100:00080000:0.0:1788201565.517723:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201565.517729:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788201565.517732:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201565.517738:0:93109:0:(import.c:510:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 4284 00000100:00080000:0.0:1788201565.517749:0:93109:0:(import.c:624:import_select_connection()) MGC192.168.201.120@tcp: import ffff8dc104280800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201565.517786:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc007159c00 x1875060715461504/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201565.517818:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201565.517822:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201565.517824:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201565.517835:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4290 00000100:00080000:0.0:1788201565.517839:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc11ccfb000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201565.517857:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc00715bb80 x1875060715461632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201565.517867:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201565.517871:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201565.517890:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201565.517893:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788201565.517912:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201565.517924:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715461760:0@lo:400:kworker.0 00000400:00000100:0.0:1788201565.517988:0:3656:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875060715461760 offset 0 length 224: 4 00000100:00100000:0.0:1788201565.518091:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715459456:0@lo:400:kworker.0 00000100:00100000:3.0:1788201565.519290:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715461504:0@lo:250:kworker.0 00000400:00000100:3.0:1788201565.519344:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715461504 offset 0 length 520: 4 00000100:00100000:3.0:1788201565.519384:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715461632:0@lo:38:kworker.0 00000400:00000100:3.0:1788201565.519405:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875060715461632 offset 0 length 520: 4 00000100:00000400:0.0:1788201565.520324:0:3658:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201549/real 1788201549] req@ffff8dc007159f80 x1875060715459840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201565 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201565.520354:0:3658:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8dc007159f80 x1875060715459840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201565 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201565.520365:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788201565.520369:0:3658:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788201565.520375:0:3658:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00100000:0.0:1788201565.520401:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715459840:0@lo:400:kworker.0 00000100:00080000:0.0:1788201565.520534:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201565.520539:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201565.520550:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201565.520553:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201565.520556:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201565.520562:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4290 00000100:00080000:0.0:1788201565.520571:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc1401c3800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201565.520607:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc007159f80 x1875060715461888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201565.520627:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201565.520631:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788201565.527137:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715461888:0@lo:38:kworker.0 00000400:00000100:0.0:1788201565.527240:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875060715461888 offset 0 length 520: 4 00010000:00010000:3.0:1788201565.528097:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1788201566.171276:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695577600 offset 0 length 520: 4 00000400:00000100:0.0:1788201566.171309:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 12 match 1875060695577728 offset 0 length 520: 4 00010000:00010000:0.0:1788201566.544556:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201567.567253:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201568.604668:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201569.552100:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201569.552124:0:57134:0:(pinger.c:247:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201569.552127:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201569.552247:0:57134:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201569.552251:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201569.552254:0:57134:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201569.552257:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201569.552267:0:57134:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201569.552270:0:57134:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201569.552273:0:57134:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788201569.636008:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201570.647451:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1788201570.660257:0:3655:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201554/real 1788201554] req@ffff8dc106048700 x1875060715460352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201570 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201570.660312:0:3655:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8dc106048700 x1875060715460352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201570 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201570.660323:0:3655:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff8dc1401c3800 already not connected (conn 10, was 9): CONNECTING 00000100:00000400:3.0:1788201570.660331:0:3655:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201554/real 1788201554] req@ffff8dc10604ad80 x1875060715460224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201570 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201570.660343:0:3655:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8dc10604ad80 x1875060715460224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201570 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201570.660350:0:3655:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff8dc11ccfb000 already not connected (conn 10, was 9): CONNECTING 00000100:00100000:3.0:1788201570.660369:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715460352:0@lo:400:kworker.0 00000100:00100000:3.0:1788201570.660443:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715460224:0@lo:400:kworker.0 00010000:00010000:0.0:1788201571.663219:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201572.696782:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788201573.398954:0:107383:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788201573.398960:0:107383:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788201573.398962:0:107383:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788201573.399113:0:107383:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dc0053a5000 00000020:01000004:1.0:1788201573.399129:0:107383:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788201573.399139:0:107383:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788201573.399153:0:107383:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8dc1060e4d28) 00000020:00000080:1.0:1788201573.399169:0:107383:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00000020:01000004:0.0:1788201573.490711:0:107388:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788201573.490715:0:107388:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788201573.490717:0:107388:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788201573.490865:0:107388:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dc12f00a800 00000020:01000004:0.0:1788201573.490884:0:107388:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788201573.490896:0:107388:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788201573.490910:0:107388:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8dc12f30b370) 00000020:00000080:0.0:1788201573.490927:0:107388:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788201573.567080:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788201573.572079:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788201573.576255:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788201573.576930:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788201573.577184:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788201573.577471:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788201573.577711:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788201573.577953:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788201573.578302:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788201573.579107:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788201573.579573:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788201573.580396:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1788201573.582213:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788201573.582592:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788201573.590528:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788201573.594986:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788201573.595484:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788201573.596053:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788201573.596329:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788201573.596670:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788201573.596896:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1788201573.597165:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1788201573.597430:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1788201573.597741:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1788201573.598209:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788201573.598577:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1788201573.598808:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788201573.599120:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788201573.599455:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1788201573.599690:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788201573.599939:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788201573.600195:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1788201573.600489:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788201573.600688:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788201573.600900:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1788201573.601318:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788201573.601735:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788201573.601999:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788201573.602271:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788201573.602560:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788201573.602797:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788201573.603069:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1788201573.603315:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788201573.603588:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788201573.603782:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1788201573.604036:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788201573.604253:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788201573.605820:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1788201573.606254:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1788201573.606571:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788201573.607651:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788201573.607933:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788201573.609778:0:107383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:2.0:1788201573.612227:0:107383:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788201573.612476:0:107383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788201573.612483:0:107383:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788201573.612496:0:107383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1ee40 00000020:01000004:2.0:1788201573.612504:0:107383:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788201573.612526:0:107383:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788201573.612532:0:107383:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dc0053a5000 from MGS 00000020:01000004:2.0:1788201573.612535:0:107383:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788201573.612545:0:107383:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8dc0027d19b8) 00000020:00000080:2.0:1788201573.612556:0:107383:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:2.0:1788201573.612619:0:107383:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc0053a5000 from MGS, refs=2 00080000:01000000:2.0:1788201573.612624:0:107383:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788201573.612629:0:107383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1ee4e 00010000:00010000:2.0:1788201573.612744:0:107383:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-2 is initialized 00000040:01000000:1.0:1788201573.619601:0:107383:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788201573.622097:0:107394:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788201573.622189:0:107383:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788201573.622235:0:107383:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788201573.625058:0:107383:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788201573.625309:0:107383:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201573.625553:0:107383:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788201573.625560:0:107383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788201573.627455:0:107383:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788201573.627467:0:107383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788201573.627794:0:107383:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788201573.627871:0:107383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788201573.631755:0:107383:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788201573.631781:0:107383:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1788201573.631783:0:107383:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.120@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1788201573.631788:0:107383:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.120@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:2.0:1788201573.631793:0:107383:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8dc104280800 already not connected (conn 81, was 0): CONNECTING 00000100:00100000:2.0:1788201573.631811:0:107383:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00100000:10000000:1.0:1788201573.680442:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788201573.680749:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1788201573.682710:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788201573.683122:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1788201573.683310:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788201573.683629:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788201573.683876:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788201573.684132:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1788201573.684440:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788201573.684675:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788201573.684923:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1788201573.685306:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788201573.685652:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788201573.685870:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788201573.687162:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788201573.687500:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788201573.687698:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788201573.687971:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788201573.688771:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788201573.689121:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1788201573.689462:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788201573.689658:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1788201573.689864:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788201573.690114:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788201573.690308:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1788201573.690648:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788201573.690897:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1788201573.691198:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788201573.691432:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1788201573.691755:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788201573.692074:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1788201573.692285:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788201573.692526:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788201573.692756:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788201573.693527:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1788201573.693738:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1788201573.693987:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1788201573.694213:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788201573.694869:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788201573.695244:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788201573.700274:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788201573.701144:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788201573.701620:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788201573.703095:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1788201573.704250:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1788201573.704647:0:107388:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00080000:01000000:0.0:1788201573.710411:0:107388:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788201573.710653:0:107388:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788201573.710663:0:107388:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788201573.710676:0:107388:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x96d0c9b8c9a1ee55 00000020:01000004:0.0:1788201573.710683:0:107388:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00010000:00010000:1.0:1788201573.712367:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201574.735417:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201574.735468:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201574.735494:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201574.735497:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201574.735501:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201574.735504:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201574.735507:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201574.735510:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201574.735513:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201574.735515:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201574.735518:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788201575.695164:0:3654:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201565/real 1788201565] req@ffff8dc007159f80 x1875060715461888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201575 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201575.695200:0:3654:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dc007159f80 x1875060715461888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201575 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201575.695230:0:3654:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201565/real 1788201565] req@ffff8dc007159c00 x1875060715461504/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788201575 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201575.695244:0:3654:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dc007159c00 x1875060715461504/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788201575 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201575.695254:0:3654:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201565/real 1788201565] req@ffff8dc00715bb80 x1875060715461632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201575 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201575.695265:0:3654:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dc00715bb80 x1875060715461632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201575 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201575.695285:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201575.695308:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788201575.695312:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715461888:0@lo:38:kworker.0 00000100:00080000:1.0:1788201575.695318:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201575.695323:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788201575.695338:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715461504:0@lo:250:kworker.0 00000100:00080000:1.0:1788201575.695342:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201575.695347:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788201575.695350:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715461632:0@lo:38:kworker.0 00000100:00080000:2.0:1788201575.695495:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201575.695500:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788201575.695503:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201575.695508:0:41592:0:(import.c:510:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 4416 00000100:00080000:2.0:1788201575.695513:0:41592:0:(import.c:589:import_select_connection()) MGC192.168.201.120@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788201575.695519:0:41592:0:(import.c:624:import_select_connection()) MGC192.168.201.120@tcp: import ffff8dc104280800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201575.695552:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12b634700 x1875060715462016/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:3.0:1788201575.695631:0:107383:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:3.0:1788201575.695648:0:107383:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc140d58400/0x96d0c9b8c9a1e12e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1e135 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201575.695659:0:107383:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d58400/0x96d0c9b8c9a1e12e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1e135 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201575.695666:0:107383:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788201575.695677:0:107383:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201575.695686:0:107383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc140d58400/0x96d0c9b8c9a1e12e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1e135 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201575.695704:0:107383:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1e094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1e09b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201575.695711:0:107383:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1e094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1e09b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201575.695724:0:107383:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201575.695728:0:107383:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201575.695732:0:107383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc108c74000/0x96d0c9b8c9a1e094 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1e09b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201575.695753:0:107383:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc108c74400/0x96d0c9b8c9a1e0a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1e0a9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201575.695768:0:107383:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc108c74400/0x96d0c9b8c9a1e0a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1e0a9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201575.695774:0:107383:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201575.695778:0:107383:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201575.695782:0:107383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc108c74400/0x96d0c9b8c9a1e0a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1e0a9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201575.695791:0:107383:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc108c75600/0x96d0c9b8c9a1e0be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1e0c5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201575.695798:0:107383:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc108c75600/0x96d0c9b8c9a1e0be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1e0c5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201575.695804:0:107383:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201575.695807:0:107383:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201575.695810:0:107383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc108c75600/0x96d0c9b8c9a1e0be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1e0c5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201575.695820:0:107383:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1e0cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1e0d3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201575.695837:0:107383:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1e0cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1e0d3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201575.695843:0:107383:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201575.695846:0:107383:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201575.695850:0:107383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1e0cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1e0d3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201575.695860:0:107383:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc140d59800/0x96d0c9b8c9a1e13c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1e143 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201575.695867:0:107383:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d59800/0x96d0c9b8c9a1e13c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1e143 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201575.695873:0:107383:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788201575.695884:0:107383:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201575.695888:0:107383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc140d59800/0x96d0c9b8c9a1e13c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1e143 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201575.695900:0:107383:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc108c74e00/0x96d0c9b8c9a1e0b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1e0b7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201575.695906:0:107383:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc108c74e00/0x96d0c9b8c9a1e0b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1e0b7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201575.695912:0:107383:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788201575.695915:0:107383:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201575.695919:0:107383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc108c74e00/0x96d0c9b8c9a1e0b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1e0b7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201575.695938:0:107383:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1e0da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1e0e1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788201575.695945:0:107383:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1e0da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1e0e1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201575.695950:0:107383:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788201575.695952:0:107383:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788201575.695957:0:107383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064ecc00/0x96d0c9b8c9a1e0da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1e0e1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788201575.695970:0:107383:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8dc104280800 already not connected (conn 82, was 0): CONNECTING 00000100:00080000:3.0:1788201575.695975:0:107383:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00000400:0.0:1788201575.696101:0:3656:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201559/real 1788201559] req@ffff8dc004b3a680 x1875060715460736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201575 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201575.696121:0:3656:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8dc004b3a680 x1875060715460736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201575 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201575.696128:0:3656:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff8dc1401c3800 already not connected (conn 10, was 9): DISCONN 00000100:00100000:0.0:1788201575.696140:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715460736:0@lo:400:kworker.0 00000100:00100000:1.0:1788201575.697878:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715462016:0@lo:250:kworker.0 00000100:00100000:1.0:1788201575.698059:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201575.698156:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715462016 00000100:00100000:0.0:1788201575.698164:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715462016 00000100:00100000:0.0:1788201575.698215:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201575.698223:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3654:x1875060715462016:12345-0@lo:250:kworker.0 00010000:00080000:0.0:1788201575.698249:0:107396:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c9b18af6-fecc-4172-82c2-66531890fe11@0@lo t0 exp 0000000000000000 cur 4427 last 0 00000020:00000080:0.0:1788201575.698275:0:107396:0:(genops.c:1385:class_connect()) connect: client c9b18af6-fecc-4172-82c2-66531890fe11, cookie 0x96d0c9b8c9a1ee5c 00000100:00080000:0.0:1788201575.698418:0:107396:0:(import.c:65:import_set_state_nolock()) ffff8dc005a48800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788201575.698866:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201575.698871:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201575.698874:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201575.698879:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4416 00000100:00080000:2.0:1788201575.698883:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788201575.698888:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc11ccfb000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201575.698914:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12b636d80 x1875060715462144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201575.703342:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715462144:0@lo:38:kworker.0 00000400:00000100:1.0:1788201575.703407:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875060715462144 offset 0 length 520: 4 00000100:00100000:0.0:1788201575.703543:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+5:3654:x1875060715462016:12345-0@lo:250:kworker.0 Request processed in 5317us (5481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201575.703556:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788201575.706255:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.120@tcp: connect to target with instance 0 10000000:01000000:1.0:1788201575.706287:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:02000400:1.0:1788201575.706293:0:3654:0:(import.c:1284:ptlrpc_connect_interpret()) Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x96d0c9b8c9a1ee5c 00000100:00080000:2.0:1788201575.713052:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201575.713063:0:41592:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201575.713066:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201575.713088:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201575.713092:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201575.713100:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4416 00000100:00080000:2.0:1788201575.713107:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788201575.713114:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc1401c3800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201575.713154:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12b634380 x1875060715462272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201575.713172:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201575.713176:0:41592:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201575.720367:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:1.0:1788201575.720381:0:3654:0:(import.c:1674:ptlrpc_import_recovery_state_machine()) evicted from MGS@0@lo; invalidating 00000100:00100000:3.0:1788201575.721366:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715462016:0@lo:250:kworker.0 00000100:00100000:3.0:1788201575.721405:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715462272:0@lo:38:kworker.0 00000400:00000100:3.0:1788201575.721460:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875060715462272 offset 0 length 520: 4 00000100:00080000:0.0:1788201575.721546:0:107383:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished EVICTED, rc = 0 00000020:01000004:0.0:1788201575.721571:0:107383:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788201575.721582:0:107383:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788201575.721597:0:107383:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8dc12f308000) 00000020:00000080:0.0:1788201575.721614:0:107383:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type mds with refcount 2 00000020:01000004:3.0:1788201575.725487:0:107388:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.120@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788201575.725494:0:107388:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.120@tcp 1/d0:i1:r0:or0:EVICTED 00000020:01000004:3.0:1788201575.725505:0:107388:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000100:00080000:1.0:1788201575.729354:0:107400:0:(import.c:1598:ptlrpc_invalidate_import_thread()) thread invalidate import MGC192.168.201.120@tcp to MGS@0@lo 00000100:00100000:1.0:1788201575.729361:0:107400:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788201575.729366:0:107400:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00080000:1.0:1788201575.729377:0:107400:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:1.0:1788201575.729383:0:107400:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from RECOVER to FULL 10000000:01000000:1.0:1788201575.729385:0:107400:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788201575.729847:0:107400:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:1.0:1788201575.729852:0:107400:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) MGC192.168.201.120@tcp: Connection restored to 0@lo (at 0@lo) 00000020:01000000:1.0:1788201575.729884:0:41592:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.201.120@tcp 10000000:01000000:1.0:1788201575.730854:0:41592:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1788201575.730859:0:41592:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788201575.730862:0:41592:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788201575.730863:0:41592:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201575.730865:0:41592:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201575.730867:0:41592:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201575.730868:0:41592:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201575.730870:0:41592:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201575.730872:0:41592:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201575.730873:0:41592:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1788201575.731011:0:41592:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1788201575.731034:0:41592:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1788201575.731036:0:41592:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788201575.731038:0:41592:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788201575.731039:0:41592:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201575.731040:0:41592:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201575.731041:0:41592:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201575.731042:0:41592:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201575.731043:0:41592:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788201575.731044:0:41592:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201575.731045:0:41592:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1788201575.731068:0:41592:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1788201575.731190:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715462400:0@lo:253:kworker.0 00000100:00100000:1.0:1788201575.731264:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201575.731327:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715462400 00000100:00100000:1.0:1788201575.731333:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715462400 00000100:00100000:1.0:1788201575.731374:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201575.731383:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+5:3656:x1875060715462400:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788201575.731411:0:107398:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 10000000:01000000:1.0:1788201575.731535:0:107402:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788201575.731631:0:107398:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 136 00000100:00100000:0.0:1788201575.737102:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201575.737123:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715462528:0@lo:253:kworker.0 00000100:00100000:0.0:1788201575.737216:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201575.737281:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715462528 00000100:00100000:0.0:1788201575.737288:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715462528 00000100:00100000:0.0:1788201575.737331:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788201575.737340:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+6:3658:x1875060715462528:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788201575.737370:0:107396:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:0.0:1788201575.741422:0:107383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788201575.741633:0:107383:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788201575.741640:0:107383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788201575.747553:0:107383:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788201575.747568:0:107383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788201575.748406:0:107383:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788201575.748414:0:107383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00000400:1.0:1788201575.749086:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201559/real 1788201559] req@ffff8dc004b3aa00 x1875060715460608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201575 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201575.749115:0:3657:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8dc004b3aa00 x1875060715460608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201575 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201575.749124:0:3657:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff8dc11ccfb000 already not connected (conn 11, was 9): CONNECTING 00000100:00100000:1.0:1788201575.749143:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715460608:0@lo:400:kworker.0 00000100:00100000:0.0:1788201575.749435:0:107383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788201575.749599:0:107383:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788201575.749604:0:107383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788201575.750891:0:107383:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788201575.751013:0:107383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 20000000:01000000:0.0:1788201575.754146:0:107407:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788201575.754162:0:107407:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788201575.754167:0:107407:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788201575.754170:0:107407:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788201575.757170:0:107407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 20000000:01000000:0.0:1788201575.757687:0:107398:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788201575.757716:0:107398:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:0.0:1788201575.759158:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1788201575.761803:0:107398:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788201575.761835:0:107398:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788201575.761948:0:107396:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788201575.762047:0:107402:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788201575.762053:0:107402:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788201575.762089:0:107402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ee6a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201575.762110:0:107402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ee6a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788201575.762121:0:107402:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000069140s 00010000:00010000:3.0:1788201575.762145:0:107402:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ee6a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201575.762153:0:107402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ee6a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201575.762160:0:107402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ee6a lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201575.762167:0:107402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ee6a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201575.762173:0:107402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201575.762178:0:107402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ee6a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201575.762200:0:107402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ee6a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201575.762216:0:107402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ee6a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201575.762224:0:107402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ee6a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201575.762238:0:107402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ee6a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201575.762287:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+6:3656:x1875060715462400:12345-0@lo:253:kworker.0 Request processed in 30899us (31017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201575.762301:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:0.0:1788201575.762532:0:3656:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788201575.762536:0:3656:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788201575.762546:0:3656:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201575.762547:0:3656:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201575.762549:0:3656:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201575.762550:0:3656:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201575.762552:0:3656:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788201575.762554:0:3656:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201575.762556:0:3656:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788201575.762560:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715462400:0@lo:253:kworker.0 20000000:01000000:1.0:1788201575.780633:0:107396:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788201575.780655:0:107396:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788201575.781133:0:107402:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788201575.781145:0:107402:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788201575.781180:0:107402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1ee71 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201575.781411:0:107402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1ee71 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788201575.781426:0:107402:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000282761s 00010000:00010000:3.0:1788201575.781433:0:107402:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1ee71 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201575.781440:0:107402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1ee71 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201575.781448:0:107402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1ee71 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201575.781456:0:107402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1ee71 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201575.781462:0:107402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201575.781468:0:107402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1ee71 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201575.781478:0:107402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1ee71 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201575.781494:0:107402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1ee71 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201575.781503:0:107402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1ee71 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201575.781510:0:107402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae3000/0x96d0c9b8c9a1ee71 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201575.784605:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+5:3658:x1875060715462528:12345-0@lo:253:kworker.0 Request processed in 47257us (47380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201575.784620:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:2.0:1788201575.784728:0:3658:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788201575.784732:0:3658:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788201575.784746:0:3658:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201575.784747:0:3658:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201575.784749:0:3658:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201575.784750:0:3658:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201575.784752:0:3658:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788201575.784753:0:3658:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201575.784755:0:3658:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788201575.784758:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715462528:0@lo:253:kworker.0 00000100:00100000:2.0:1788201575.835714:0:107383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201575.835926:0:107383:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788201575.835932:0:107383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788201575.837524:0:107383:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788201575.837540:0:107383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788201575.846275:0:107383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201575.846473:0:107383:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788201575.846479:0:107383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788201575.848079:0:107383:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788201575.848088:0:107383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788201575.849335:0:107383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201575.849515:0:107383:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788201575.849521:0:107383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788201575.850152:0:107383:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788201575.850161:0:107383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788201575.860500:0:107383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788201575.860684:0:107383:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788201575.860691:0:107383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788201575.867303:0:107383:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788201575.867320:0:107383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788201575.916439:0:107383:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788201575.916632:0:107383:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788201575.916638:0:107383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788201575.918436:0:107383:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788201575.918447:0:107383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788201575.922679:0:107383:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788201575.922694:0:107383:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788201575.925466:0:107383:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788201575.925499:0:107383:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788201575.925506:0:107383:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788201575.925609:0:107383:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788201575.925642:0:107383:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.120@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788201575.925647:0:107383:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788201575.925648:0:107383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788201575.925650:0:107383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201575.925652:0:107383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201575.925653:0:107383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201575.925655:0:107383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201575.925656:0:107383:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201575.925658:0:107383:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788201575.925663:0:107383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201575.925664:0:107383:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788201575.925667:0:107383:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788201575.925669:0:107383:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788201575.925670:0:107383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788201575.925671:0:107383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201575.925672:0:107383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201575.925673:0:107383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201575.925674:0:107383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201575.925675:0:107383:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201575.925677:0:107383:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788201575.925678:0:107383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201575.925679:0:107383:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788201575.925705:0:107383:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788201575.925724:0:107383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715462656:0@lo:253:mount.lustre.0 00000020:01000004:3.0:1788201575.925992:0:107388:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 00000100:00100000:0.0:1788201575.926146:0:107383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201575.926185:0:107383:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006ccf840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201575.926519:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715462656 00000100:00100000:2.0:1788201575.926528:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715462656 00000100:00100000:2.0:1788201575.926580:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201575.926591:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+5:107383:x1875060715462656:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788201575.926634:0:107397:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788201575.926637:0:107397:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788201575.926640:0:107397:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1788201575.926648:0:107397:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788201575.928361:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+5:107383:x1875060715462656:12345-0@lo:253:mount.lustre.0 Request processed in 1764us (2207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201575.928373:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201575.928496:0:107383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715462656:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788201575.928509:0:107383:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788201575.928512:0:107383:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788201575.928514:0:107383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788201575.928516:0:107383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201575.928517:0:107383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201575.928518:0:107383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201575.928519:0:107383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201575.928520:0:107383:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201575.928522:0:107383:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788201575.928523:0:107383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201575.928540:0:107383:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788201575.928563:0:107383:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dc0053a5000 from lustre-MDT0000 10000000:01000000:1.0:1788201575.928592:0:107383:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788201575.928594:0:107383:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788201575.928602:0:107383:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dc0053a5000 10000000:01000000:1.0:1788201575.928606:0:107383:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788201575.928611:0:107383:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8dc0053a5000 10000000:01000000:1.0:1788201575.928614:0:107383:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788201575.928617:0:107383:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dc0053a5000 from 1 10000000:01000000:1.0:1788201575.928620:0:107383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788201575.928656:0:107383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ee78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201575.928669:0:107383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ee78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201575.928678:0:107383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ee78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201575.928695:0:107383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715462784:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201575.928728:0:107383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201575.928775:0:107383:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038b7000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201575.930122:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715462784 00000100:00100000:2.0:1788201575.930133:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715462784 00000100:00100000:2.0:1788201575.930175:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201575.930184:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+5:107383:x1875060715462784:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201575.930199:0:107397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201575.930219:0:107397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006dbdc00/0x96d0c9b8c9a1ee7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ee78 expref: -99 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201575.930247:0:107397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006dbdc00/0x96d0c9b8c9a1ee7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ee78 expref: 6 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201575.930257:0:107397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006dbdc00/0x96d0c9b8c9a1ee7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ee78 expref: 6 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201575.930283:0:107397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbdc00, rc 0) 00000100:00100000:2.0:1788201575.930348:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+6:107383:x1875060715462784:12345-0@lo:101:mount.lustre.0 Request processed in 163us (1618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201575.930354:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201575.932641:0:107383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715462784:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201575.932679:0:107383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ee78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ee7f expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201575.932695:0:107383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ee78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ee7f expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201575.932717:0:107383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788201575.933054:0:107383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ee78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ee7f expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201575.933062:0:107383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ee78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ee7f expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201575.933072:0:107383:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788201575.933078:0:107383:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788201575.933084:0:107383:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8dc0053a5000 10000000:01000000:1.0:1788201575.933087:0:107383:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788201575.933090:0:107383:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788201575.933093:0:107383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788201575.933127:0:107383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201575.933134:0:107383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201575.933143:0:107383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201575.933162:0:107383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715462912:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201575.933228:0:107383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201575.933277:0:107383:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038b7000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201575.933713:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715462912 00000100:00100000:2.0:1788201575.933726:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715462912 00000100:00100000:2.0:1788201575.935302:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201575.935314:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+6:107383:x1875060715462912:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201575.935331:0:107397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201575.935350:0:107397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006dbce00/0x96d0c9b8c9a1ee8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ee86 expref: -99 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201575.935376:0:107397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006dbce00/0x96d0c9b8c9a1ee8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ee86 expref: 7 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201575.935387:0:107397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006dbce00/0x96d0c9b8c9a1ee8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ee86 expref: 7 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201575.935398:0:107397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbce00, rc 0) 00000100:00100000:2.0:1788201575.939101:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+7:107383:x1875060715462912:12345-0@lo:101:mount.lustre.0 Request processed in 3780us (5863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201575.939113:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201575.941323:0:107383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715462912:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201575.941350:0:107383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ee8d expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201575.941364:0:107383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ee8d expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201575.941487:0:107383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715463040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201575.941544:0:107383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201575.941591:0:107383:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038b7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201575.941724:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715463040 00000100:00100000:0.0:1788201575.941732:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715463040 00000100:00100000:0.0:1788201575.941797:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788201575.941807:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+7:107383:x1875060715463040:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201575.941957:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+8:107383:x1875060715463040:12345-0@lo:501:mount.lustre.0 Request processed in 151us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201575.941965:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788201575.942551:0:107383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715463040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201575.942583:0:107383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715463168:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201575.942627:0:107383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201575.942656:0:107383:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038b7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201575.942712:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715463168 00000100:00100000:0.0:1788201575.942717:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715463168 00000100:00100000:0.0:1788201575.942757:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788201575.942764:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+8:107383:x1875060715463168:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201575.943554:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+8:107383:x1875060715463168:12345-0@lo:503:mount.lustre.0 Request processed in 788us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201575.943563:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788201575.943656:0:107383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715463168:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201575.944879:0:107420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:107420:1875060715463296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201575.944940:0:107420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201575.944982:0:107420:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038b7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201575.945174:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715463296 00000100:00100000:2.0:1788201575.945181:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715463296 00000100:00100000:2.0:1788201575.945227:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788201575.945236:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:107420:x1875060715463296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201575.953390:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:107420:x1875060715463296:12345-0@lo:502:llog_process_th.0 Request processed in 8144us (8439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201575.953433:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788201575.953960:0:107420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:107420:1875060715463296:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201575.954055:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201575.954069:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201575.954072:0:107420:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788201575.954078:0:107420:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788201575.954081:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201575.954099:0:107420:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8dc1060e19b8) 00000020:00000080:1.0:1788201575.954121:0:107420:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:1.0:1788201575.954127:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788201575.954241:0:107420:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788201575.954255:0:107420:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1ee9b 00000020:00000080:1.0:1788201575.954494:0:107420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788201575.954500:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201575.954504:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201575.954511:0:107420:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788201575.954515:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201575.954519:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201575.954521:0:107420:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788201575.954524:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201575.954532:0:107420:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8dc1060e3370) 00000020:00000080:1.0:1788201575.954544:0:107420:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:1.0:1788201575.954548:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788201575.954551:0:107420:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788201575.954554:0:107420:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788201575.954561:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788201575.954610:0:107420:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc0053a5000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788201575.954621:0:107420:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8dc1060e0000) 00000020:00000080:1.0:1788201575.954632:0:107420:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:1.0:1788201575.954685:0:107420:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788201575.954691:0:107420:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1eeb0 00000020:00000080:1.0:1788201575.954795:0:107420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788201575.954801:0:107420:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788201575.954805:0:107420:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x96d0c9b8c9a1eeb7 00080000:01000000:1.0:1788201575.954809:0:107420:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788201575.954813:0:107420:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1eebe 00010000:00010000:3.0:1788201576.058329:0:107420:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-3 is initialized 00000001:00080000:3.0:1788201576.058479:0:107420:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 0 srv lr: 128849018898 lx: 0 gen 25 00000001:00080000:3.0:1788201576.058522:0:107420:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 6e293f14-c501-4bc5-9dd4-a18ef02756b4 idx: 2 lr: 124554051765 srv lr: 128849018898 lx: 0 gen 24 00000001:00000004:3.0:1788201576.058543:0:107420:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 31, last_transno is 128849018898 00000001:00080000:3.0:1788201576.058640:0:107420:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1788201576.058691:0:107420:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc005c6cc00: xid 1875060695568384, transno 128849018915, client gen 24, slot idx 0 00000001:00080000:3.0:1788201576.058701:0:107420:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc005c6c3c0: xid 1875060695569024, transno 128849018917, client gen 24, slot idx 1 00000001:00080000:3.0:1788201576.058706:0:107420:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc005c6cb40: xid 1875060715448064, transno 128849018920, client gen 25, slot idx 2 00000001:00080000:3.0:1788201576.058711:0:107420:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc005c6c600: xid 1875060715448320, transno 128849018921, client gen 25, slot idx 3 00000001:00080000:3.0:1788201576.058715:0:107420:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc005c6c780: xid 1875060695484032, transno 124554051729, client gen 24, slot idx 4 00000001:00080000:3.0:1788201576.058720:0:107420:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc005c6c540: xid 1875060695483008, transno 124554051723, client gen 24, slot idx 5 00000001:00080000:3.0:1788201576.058724:0:107420:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc005c6cd80: xid 1875060695483008, transno 124554051724, client gen 24, slot idx 6 00000020:00000080:3.0:1788201576.059189:0:107420:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8dc12f0c0000) 00000020:00000080:3.0:1788201576.059206:0:107420:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type qmt with refcount 2 00080000:01000000:3.0:1788201576.059268:0:107420:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788201576.059276:0:107420:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1eeda 00000020:00000080:3.0:1788201576.066447:0:107420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788201576.077915:0:107420:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x96d0c9b8c9a1eee1 00000020:00000080:0.0:1788201576.078333:0:107420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788201576.078344:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201576.078350:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201576.078353:0:107420:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788201576.078356:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788201576.078358:0:107420:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1788201576.078360:0:107420:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788201576.078361:0:107420:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788201576.078363:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788201576.078365:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201576.078367:0:107420:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788201576.078369:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201576.078374:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201576.078375:0:107420:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788201576.078380:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788201576.078428:0:107420:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788201576.078445:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201576.078449:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201576.078450:0:107420:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788201576.078453:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201576.078456:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201576.078458:0:107420:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788201576.078461:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788201576.078467:0:107420:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:00000080:0.0:1788201576.078490:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201576.078504:0:107420:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8dc12f3099b8) 00000020:00000080:0.0:1788201576.078520:0:107420:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788201576.078525:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788201576.078576:0:107420:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788201576.078581:0:107420:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788201576.078586:0:107420:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1eeef 00010000:00080000:0.0:1788201576.078614:0:107420:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc005d73000@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:0.0:1788201576.082259:0:107420:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-5 is initialized 00000020:00000080:1.0:1788201576.086743:0:107420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201576.086767:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788201576.086810:0:107420:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788201576.086835:0:107420:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1eef6 00000100:00080000:1.0:1788201576.086847:0:107420:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201576.086852:0:107420:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8dc005d73000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201576.086888:0:107420:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc10604a300 x1875060715463424/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201576.086981:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715463424:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201576.087088:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201576.087267:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715463424 00000100:00100000:2.0:1788201576.087274:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715463424 00000100:00100000:2.0:1788201576.087301:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788201576.087308:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715463424:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788201576.087325:0:99775:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1788201576.087973:0:107420:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788201576.088073:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201576.088079:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201576.088091:0:107420:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788201576.088096:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788201576.088098:0:107420:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1788201576.088099:0:107420:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201576.088101:0:107420:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201576.088102:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788201576.088105:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201576.088106:0:107420:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788201576.088109:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788201576.088113:0:107420:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788201576.088116:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201576.088117:0:107420:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788201576.088120:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788201576.088124:0:107420:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:1.0:1788201576.088143:0:107420:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788201576.088146:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201576.088159:0:107420:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8dc139bbcd28) 00000020:00000080:1.0:1788201576.088174:0:107420:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1788201576.088178:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788201576.088234:0:107420:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788201576.088240:0:107420:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788201576.088244:0:107420:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1ef04 00010000:00080000:1.0:1788201576.088269:0:107420:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc1259e7000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:1.0:1788201576.088486:0:107420:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-6 is initialized 00000100:00080000:0.0:1788201576.088886:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201576.088892:0:41592:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201576.088895:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201576.088898:0:41592:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:01000000:1.0:1788201576.092598:0:107420:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788201576.092626:0:107420:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788201576.092929:0:107420:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 29, last_idx 30 00000040:00080000:1.0:1788201576.093680:0:107420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201576.093708:0:107420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].31, 64 off10176 00000040:00080000:1.0:1788201576.093937:0:107420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x7c:0x0].1, 64 off8256 00000040:00080000:1.0:1788201576.094471:0:107426:0:(llog.c:805:llog_process_thread()) index: 30, lh_last_idx: 31 synced_idx: 0 lgh_last_idx: 31 00000040:00080000:1.0:1788201576.094477:0:107426:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x78:0x0] at index 30 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788201576.094597:0:107426:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 30, last_idx 31 00000040:00080000:1.0:1788201576.094612:0:107426:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x78:0x0] at index 30 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788201576.094716:0:107426:0:(llog.c:805:llog_process_thread()) index: 31, lh_last_idx: 31 synced_idx: 31 lgh_last_idx: 31 00000040:00080000:1.0:1788201576.094719:0:107426:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x7c:0x0] at index 31 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1788201576.095207:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715463424:12345-0@lo:38:llog_process_th.0 Request processed in 7893us (8114us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201576.095220:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788201576.095313:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc005d73000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201576.095319:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201576.095323:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715463424:0@lo:38:llog_process_th.0 00000020:00000080:1.0:1788201576.096905:0:107420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201576.096991:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788201576.097085:0:107420:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788201576.097107:0:107420:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1ef0b 00000100:00080000:0.0:1788201576.097117:0:107420:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788201576.097122:0:107420:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dc1259e7000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201576.097157:0:107420:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc00715b100 x1875060715463552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201576.097181:0:107420:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788201576.097254:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201576.097258:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201576.097260:0:107420:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788201576.097263:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788201576.097266:0:107420:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1788201576.097268:0:107420:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788201576.097270:0:107420:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788201576.097272:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788201576.097274:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201576.097276:0:107420:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788201576.097278:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788201576.097282:0:107420:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788201576.097285:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201576.097287:0:107420:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788201576.097290:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788201576.097294:0:107420:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:0.0:1788201576.097323:0:107420:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788201576.097326:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201576.097337:0:107420:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8dc12f30cd28) 00000020:00000080:0.0:1788201576.097350:0:107420:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:0.0:1788201576.097355:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788201576.097412:0:107420:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788201576.097418:0:107420:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788201576.097423:0:107420:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1ef19 00010000:00080000:0.0:1788201576.097452:0:107420:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc004011000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:0.0:1788201576.097671:0:107420:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-7 is initialized 00000040:01000000:0.0:1788201576.097739:0:107420:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788201576.097755:0:107420:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788201576.098411:0:107420:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 29, last_idx 30 00000100:00100000:3.0:1788201576.098816:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715463552:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788201576.098887:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.099410:0:101189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715463552 00000100:00100000:1.0:1788201576.099418:0:101189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715463552 00000100:00100000:1.0:1788201576.099457:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788201576.099464:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3654:x1875060715463552:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1788201576.099492:0:101189:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4427 last 0 00000020:00000080:1.0:1788201576.099518:0:101189:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1ef20 00002000:00100000:1.0:1788201576.099531:0:101189:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8dc11ccfb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788201576.099534:0:101189:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788201576.099537:0:101189:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788201576.099587:0:101189:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788201576.099608:0:101189:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccff000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201576.099659:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715463552:12345-0@lo:8:llog_process_th.0 Request processed in 194us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.099666:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1788201576.099703:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201576.099707:0:41592:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201576.099711:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201576.099713:0:41592:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788201576.099742:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788201576.099750:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 4 00000100:00080000:1.0:1788201576.100336:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788201576.100341:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788201576.100344:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1259e7000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000040:00080000:0.0:1788201576.100657:0:107420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201576.100686:0:107420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].31, 64 off10176 00000040:00080000:0.0:1788201576.100861:0:107420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x7e:0x0].1, 64 off8256 00000004:00080000:1.0:1788201576.101094:0:3654:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788201576.101103:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715463552:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1788201576.101310:0:107426:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788201576.101363:0:107426:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 4427573346228ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788201576.101370:0:107426:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000040:00080000:3.0:1788201576.102524:0:107428:0:(llog.c:805:llog_process_thread()) index: 30, lh_last_idx: 31 synced_idx: 0 lgh_last_idx: 31 00000040:00080000:3.0:1788201576.102530:0:107428:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x7a:0x0] at index 30 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1788201576.102685:0:107428:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 30, last_idx 31 00000040:00080000:3.0:1788201576.102702:0:107428:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x7a:0x0] at index 30 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1788201576.102851:0:107428:0:(llog.c:805:llog_process_thread()) index: 31, lh_last_idx: 31 synced_idx: 31 lgh_last_idx: 31 00000040:00080000:3.0:1788201576.102855:0:107428:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x7e:0x0] at index 31 of catalog [0x1:0x5:0x0] 00000004:00080000:0.0:1788201576.105626:0:107389:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000020:00000080:3.0:1788201576.107199:0:107420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201576.107213:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788201576.107255:0:107420:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788201576.107282:0:107420:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1ef27 00000100:00080000:3.0:1788201576.107308:0:107420:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201576.107315:0:107420:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dc004011000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201576.107351:0:107420:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004b38a80 x1875060715463680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201576.107436:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715463680:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788201576.107508:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788201576.107564:0:107420:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788201576.107622:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201576.107627:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201576.107629:0:107420:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788201576.107632:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201576.107636:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201576.107637:0:107420:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788201576.107641:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788201576.107643:0:107420:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788201576.107645:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201576.107647:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201576.107649:0:107420:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788201576.107651:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201576.107668:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201576.107670:0:107420:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788201576.107674:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788201576.107680:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201576.107682:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201576.107684:0:107420:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000020:01000000:3.0:1788201576.107686:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788201576.107689:0:107420:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #43 00000020:01000000:3.0:1788201576.107691:0:107420:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201576.107693:0:107420:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000100:00100000:3.0:1788201576.107716:0:107420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:107420:1875060715463808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201576.107770:0:107420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201576.107788:0:107420:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13ab40000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201576.109395:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715463680 00000100:00100000:0.0:1788201576.109409:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715463680 00000100:00100000:0.0:1788201576.109457:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788201576.109465:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3654:x1875060715463680:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1788201576.109495:0:99766:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4427 last 0 00000020:00000080:0.0:1788201576.109528:0:99766:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1ef2e 00002000:00100000:0.0:1788201576.109544:0:99766:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8dc004017800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788201576.109549:0:99766:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788201576.109552:0:99766:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788201576.109662:0:99766:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788201576.109688:0:99766:0:(import.c:65:import_set_state_nolock()) ffff8dc004012800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201576.111056:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715463808 00000100:00100000:3.0:1788201576.111068:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715463808 00000100:00100000:3.0:1788201576.111124:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201576.111134:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+8:107420:x1875060715463808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201576.112110:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715463936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201576.112173:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201576.112224:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715463936 00000100:00100000:3.0:1788201576.112228:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715463936 00000100:00100000:3.0:1788201576.112269:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788201576.112276:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715463936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201576.112299:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201576.112337:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715463936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201576.112356:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788201576.112404:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715463936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201576.112523:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+8:107420:x1875060715463808:12345-0@lo:502:llog_process_th.0 Request processed in 1389us (4762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201576.112533:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201576.112617:0:107420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:107420:1875060715463808:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201576.112653:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788201576.112660:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201576.112663:0:107420:0:(obd_config.c:1563:class_process_config()) marker 43 (0x6) lustre-MDT0000-m new lustre.pool_134 00000020:01000000:3.0:1788201576.112667:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788201576.112671:0:107420:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #46 00000020:01000000:3.0:1788201576.112673:0:107420:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201576.112675:0:107420:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201576.112677:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788201576.112679:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201576.112681:0:107420:0:(obd_config.c:1563:class_process_config()) marker 46 (0x6) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:01000000:3.0:1788201576.112683:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201576.112687:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201576.112689:0:107420:0:(obd_config.c:1563:class_process_config()) marker 47 (0x1) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1788201576.112692:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: ce022 00000020:01000000:3.0:1788201576.112702:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201576.112704:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201576.112706:0:107420:0:(obd_config.c:1563:class_process_config()) marker 47 (0x2) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:01000000:3.0:1788201576.112708:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201576.112711:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201576.112713:0:107420:0:(obd_config.c:1563:class_process_config()) marker 50 (0x1) lustre-MDT0000-m del lustre.pool_134 00000020:00000080:3.0:1788201576.112716:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1788201576.112750:0:107420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:107420:1875060715464064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201576.112795:0:107420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201576.112825:0:107420:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13ab40000 going to sleep for 11 seconds 00000100:00100000:2.0:1788201576.112953:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715464064 00000100:00100000:2.0:1788201576.112958:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715464064 00000100:00100000:2.0:1788201576.112991:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788201576.113008:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:107420:x1875060715464064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201576.113117:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:107420:x1875060715464064:12345-0@lo:502:llog_process_th.0 Request processed in 109us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201576.113124:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788201576.113281:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201576.113287:0:41592:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201576.113290:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201576.113294:0:41592:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788201576.113401:0:107420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:107420:1875060715464064:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201576.113423:0:107420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201576.113427:0:107420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201576.113429:0:107420:0:(obd_config.c:1563:class_process_config()) marker 50 (0x2) lustre-MDT0000-m del lustre.pool_134 00000040:00080000:3.0:1788201576.113433:0:107420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000100:00100000:0.0:1788201576.113721:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715463680:12345-0@lo:8:llog_process_th.0 Request processed in 4254us (6211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201576.113731:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000020:01000000:0.0:1788201576.113774:0:107383:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-58 (rc=0) 10000000:01000000:0.0:1788201576.113795:0:107383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788201576.113816:0:107383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ee8d expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.113829:0:107383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ee8d expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201576.113837:0:107383:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc0053a5000 from 1 10000000:01000000:0.0:1788201576.113840:0:107383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788201576.113870:0:107383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ef35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.113879:0:107383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ef35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.113888:0:107383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ef35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201576.113905:0:107383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715464192:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201576.113937:0:107383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788201576.114052:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201576.114208:0:107383:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10554f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788201576.114269:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715464192 00000100:00100000:2.0:1788201576.114274:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715464192 00000100:00100000:2.0:1788201576.114340:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201576.114358:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:107383:x1875060715464192:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201576.114369:0:107398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201576.114384:0:107398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006dbc800/0x96d0c9b8c9a1ef3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ef35 expref: -99 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.114418:0:107398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006dbc800/0x96d0c9b8c9a1ef3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ef35 expref: 9 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.114428:0:107398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006dbc800/0x96d0c9b8c9a1ef3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ef35 expref: 9 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.114437:0:107398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbc800, rc 0) 00000100:00100000:2.0:1788201576.114480:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+9:107383:x1875060715464192:12345-0@lo:101:mount.lustre.0 Request processed in 124us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201576.114487:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201576.114558:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788201576.114567:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788201576.114574:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788201576.114579:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788201576.114583:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc004011000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788201576.114594:0:3654:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788201576.114600:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715463680:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788201576.114708:0:107383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715464192:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201576.114722:0:107383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ef35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ef3c expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.114749:0:107383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ef35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ef3c expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201576.115348:0:107383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715464448:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788201576.115391:0:107383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.115613:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201576.115623:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715464320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201576.115651:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.115688:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715464320 00000100:00100000:1.0:1788201576.115694:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715464320 00000100:00100000:1.0:1788201576.115746:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788201576.115755:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715464320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201576.115786:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201576.115823:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715464320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.115830:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788201576.115866:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715464320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201576.125875:0:107383:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10554f840 going to sleep for 11 seconds 00000100:00080000:0.0:1788201576.133202:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788201576.133221:0:107428:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788201576.133300:0:107428:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 4427605282903ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788201576.133307:0:107428:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1788201576.135890:0:107389:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788201576.136051:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715464448 00000100:00100000:3.0:1788201576.136062:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715464448 00000100:00100000:3.0:1788201576.136149:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788201576.136160:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+9:107383:x1875060715464448:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788201576.136185:0:107396:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788201576.136211:0:107396:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788201576.136215:0:107396:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788201576.136218:0:107396:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 138 00000100:00100000:3.0:1788201576.136340:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+9:107383:x1875060715464448:12345-0@lo:256:mount.lustre.0 Request processed in 182us (20948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201576.136348:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788201576.136469:0:107383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715464448:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788201576.137255:0:107383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788201576.137275:0:107383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ef35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ef3c expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.137287:0:107383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ef35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ef3c expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201576.137295:0:107383:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc0053a5000 from 1 10000000:01000000:0.0:1788201576.137298:0:107383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201576.137331:0:107383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ef43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.137340:0:107383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ef43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.137350:0:107383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ef43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201576.137379:0:107383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715464576:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201576.137420:0:107383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201576.137452:0:107383:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10554f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201576.137476:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715464576 00000100:00100000:0.0:1788201576.137481:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715464576 00000100:00100000:0.0:1788201576.137506:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201576.137514:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+9:107383:x1875060715464576:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201576.137524:0:107397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201576.137538:0:107397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ef4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ef43 expref: -99 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.137561:0:107397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ef4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ef43 expref: 10 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.137572:0:107397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ef4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ef43 expref: 10 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.137581:0:107397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d7c00, rc 0) 00000100:00100000:0.0:1788201576.137614:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:107383:x1875060715464576:12345-0@lo:101:mount.lustre.0 Request processed in 101us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201576.137621:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788201576.138861:0:107383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715464576:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201576.138885:0:107383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ef43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ef4a expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.138898:0:107383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ef43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ef4a expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201576.138985:0:107383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715464704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201576.139055:0:107383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201576.139078:0:107383:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10554f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201576.139105:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715464704 00000100:00100000:0.0:1788201576.139110:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715464704 00000100:00100000:0.0:1788201576.139136:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201576.139143:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:107383:x1875060715464704:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201576.139269:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:107383:x1875060715464704:12345-0@lo:501:mount.lustre.0 Request processed in 125us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201576.139276:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201576.139315:0:107383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715464704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201576.139342:0:107383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715464832:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201576.139379:0:107383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201576.139391:0:107383:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103892900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201576.139403:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715464832 00000100:00100000:0.0:1788201576.139406:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715464832 00000100:00100000:0.0:1788201576.139421:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201576.139427:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:107383:x1875060715464832:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201576.139495:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:107383:x1875060715464832:12345-0@lo:503:mount.lustre.0 Request processed in 67us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201576.139503:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201576.139539:0:107383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715464832:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201576.148234:0:107430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:107430:1875060715464960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201576.148331:0:107430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201576.148427:0:107430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1038926c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201576.150827:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715464960 00000100:00100000:2.0:1788201576.150842:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715464960 00000100:00100000:2.0:1788201576.150936:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788201576.150947:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:107430:x1875060715464960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201576.153546:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:107430:x1875060715464960:12345-0@lo:502:llog_process_th.0 Request processed in 2595us (5208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201576.153559:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201576.153739:0:107430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:107430:1875060715464960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201576.153789:0:107430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201576.153798:0:107430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201576.153800:0:107430:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788201576.153808:0:107430:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc0053a5000 00000020:00000080:1.0:1788201576.153811:0:107430:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788201576.153819:0:107430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201576.153821:0:107430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201576.153822:0:107430:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788201576.153824:0:107430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201576.153826:0:107430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201576.153828:0:107430:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788201576.153832:0:107430:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc0053a5000 00000020:00000080:1.0:1788201576.153834:0:107430:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788201576.155379:0:107430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:107430:1875060715465088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201576.155446:0:107430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.161408:0:107430:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10bf5db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201576.165914:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715465088 00000100:00100000:3.0:1788201576.165929:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715465088 00000100:00100000:3.0:1788201576.166106:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788201576.166116:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+10:107430:x1875060715465088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201576.166898:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+10:107430:x1875060715465088:12345-0@lo:502:llog_process_th.0 Request processed in 781us (11449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201576.166908:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788201576.166961:0:107430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:107430:1875060715465088:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201576.167008:0:107430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201576.167034:0:107430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201576.167037:0:107430:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788201576.167042:0:107430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788201576.167281:0:107383:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1788201576.167302:0:107383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201576.167328:0:107383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ef43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ef4a expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.167340:0:107383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ef43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ef4a expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201576.167398:0:107383:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788201576.167401:0:107383:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dc0053a5000 10000000:01000000:1.0:1788201576.167405:0:107383:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dc0053a5000 10000000:01000000:1.0:1788201576.167409:0:107383:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788201576.167414:0:107383:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc0053a5000 from 1 10000000:01000000:1.0:1788201576.167417:0:107383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788201576.167448:0:107383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3800/0x96d0c9b8c9a1ef51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.167457:0:107383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3800/0x96d0c9b8c9a1ef51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.167468:0:107383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3800/0x96d0c9b8c9a1ef51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201576.167489:0:107383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715465216:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201576.167528:0:107383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.167555:0:107383:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007566900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201576.168859:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715465216 00000100:00100000:2.0:1788201576.168870:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715465216 00000100:00100000:2.0:1788201576.168915:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788201576.168924:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:107383:x1875060715465216:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201576.168938:0:107397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201576.168954:0:107397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006dbd800/0x96d0c9b8c9a1ef58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ef51 expref: -99 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.168979:0:107397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006dbd800/0x96d0c9b8c9a1ef58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ef51 expref: 11 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.169008:0:107397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006dbd800/0x96d0c9b8c9a1ef58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ef51 expref: 11 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.169030:0:107397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbd800, rc 0) 00000100:00100000:2.0:1788201576.169095:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:107383:x1875060715465216:12345-0@lo:101:mount.lustre.0 Request processed in 171us (1566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201576.169101:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788201576.169443:0:107383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715465216:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201576.169463:0:107383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3800/0x96d0c9b8c9a1ef51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ef58 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.169473:0:107383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3800/0x96d0c9b8c9a1ef51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ef58 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201576.169537:0:107383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715465344:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201576.169570:0:107383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.169603:0:107383:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007566900 going to sleep for 11 seconds 00000100:00100000:2.0:1788201576.169878:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715465344 00000100:00100000:2.0:1788201576.169883:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715465344 00000100:00100000:2.0:1788201576.169917:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788201576.169924:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:107383:x1875060715465344:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201576.170083:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:107383:x1875060715465344:12345-0@lo:501:mount.lustre.0 Request processed in 159us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201576.170091:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788201576.170297:0:107383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715465344:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201576.170325:0:107383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715465472:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201576.170363:0:107383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.170423:0:107383:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007566900 going to sleep for 11 seconds 00000100:00100000:0.0:1788201576.171860:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715465472 00000100:00100000:0.0:1788201576.171870:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715465472 00000100:00100000:2.0:1788201576.173286:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788201576.173305:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:107383:x1875060715465472:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201576.173453:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:107383:x1875060715465472:12345-0@lo:503:mount.lustre.0 Request processed in 153us (3089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201576.173461:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788201576.173721:0:107383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715465472:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201576.174330:0:107433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:107433:1875060715465600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201576.174376:0:107433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.174416:0:107433:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007566e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201576.174459:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715465600 00000100:00100000:2.0:1788201576.174466:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715465600 00000100:00100000:2.0:1788201576.174500:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788201576.174508:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:107433:x1875060715465600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201576.174599:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:107433:x1875060715465600:12345-0@lo:502:llog_process_th.0 Request processed in 91us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201576.174616:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788201576.174684:0:107433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:107433:1875060715465600:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788201576.174751:0:107433:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788201576.174866:0:107433:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8dc139bb8000) 00000020:00000080:1.0:1788201576.174890:0:107433:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1788201576.174971:0:107433:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc0053a5000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788201576.174976:0:107433:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc0053a5000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788201576.174978:0:107433:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc0053a5000 4 00010000:00080000:1.0:1788201576.175045:0:107433:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc11cdd9800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:1.0:1788201576.177256:0:107433:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-8 is initialized 00000020:00000080:1.0:1788201576.177496:0:107433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788201576.177531:0:107433:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788201576.177541:0:107433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x96d0c9b8c9a1ef66 00000100:00080000:1.0:1788201576.177550:0:107433:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201576.177555:0:107433:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dc11cdd9800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201576.177584:0:107433:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc10604b800 x1875060715465728/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201576.177614:0:107433:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788201576.177645:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201576.177649:0:41592:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201576.177652:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201576.177655:0:41592:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788201576.177837:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715465728:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788201576.177899:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201576.177961:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715465728 00000100:00100000:0.0:1788201576.177967:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715465728 00000100:00100000:0.0:1788201576.178012:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201576.178040:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715465728:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788201576.178089:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715465728:12345-0@lo:38:llog_process_th.0 Request processed in 49us (189us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788201576.178095:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201576.178131:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788201576.178138:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11cdd9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201576.178141:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788201576.178144:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715465728:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788201576.178325:0:107433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:107433:1875060715465856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201576.178364:0:107433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.178380:0:107433:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007566480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201576.178396:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715465856 00000100:00100000:1.0:1788201576.178399:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715465856 00000100:00100000:1.0:1788201576.178428:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788201576.178434:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:107433:x1875060715465856:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201576.178526:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:107433:x1875060715465856:12345-0@lo:502:llog_process_th.0 Request processed in 92us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.178533:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788201576.178571:0:107433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:107433:1875060715465856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201576.178602:0:107433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:107433:1875060715465984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201576.178628:0:107433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.178645:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715465984 00000100:00100000:1.0:1788201576.178648:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715465984 00000100:00100000:1.0:1788201576.178665:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788201576.178670:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005871850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:107433:x1875060715465984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201576.178717:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005871850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:107433:x1875060715465984:12345-0@lo:502:llog_process_th.0 Request processed in 46us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.178724:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788201576.179622:0:107433:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007566480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201576.179638:0:107433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:107433:1875060715465984:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788201576.179663:0:107433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:3.0:1788201576.179861:0:107383:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:3.0:1788201576.179884:0:107383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201576.179899:0:107383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3800/0x96d0c9b8c9a1ef51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ef58 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201576.179922:0:107383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3800/0x96d0c9b8c9a1ef51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ef58 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788201576.179971:0:107383:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788201576.179973:0:107383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201576.179975:0:107383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201576.179976:0:107383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201576.179977:0:107383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201576.179978:0:107383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201576.179980:0:107383:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201576.179981:0:107383:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201576.179983:0:107383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201576.179985:0:107383:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788201576.179988:0:107383:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788201576.179990:0:107383:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788201576.179991:0:107383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201576.180004:0:107383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201576.180005:0:107383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201576.180006:0:107383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201576.180007:0:107383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201576.180008:0:107383:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201576.180010:0:107383:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201576.180011:0:107383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201576.180012:0:107383:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788201576.180046:0:107383:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788201576.180058:0:107383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715466112:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788201576.180097:0:107383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201576.180117:0:107383:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13ab40180 going to sleep for 11 seconds 00000100:00100000:1.0:1788201576.180181:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715466112 00000100:00100000:1.0:1788201576.180186:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715466112 00000100:00100000:1.0:1788201576.180215:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788201576.180223:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005872450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:107383:x1875060715466112:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788201576.180245:0:107398:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788201576.180257:0:107398:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788201576.190637:0:107398:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788201576.190675:0:107398:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788201576.191193:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005872450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:107383:x1875060715466112:12345-0@lo:253:mount.lustre.0 Request processed in 10965us (11090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.191206:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788201576.191329:0:107383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107383:1875060715466112:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788201576.191344:0:107383:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788201576.191348:0:107383:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788201576.191350:0:107383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788201576.191351:0:107383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201576.191352:0:107383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201576.191354:0:107383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201576.191355:0:107383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201576.191356:0:107383:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201576.191358:0:107383:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788201576.191360:0:107383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201576.191361:0:107383:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788201576.191389:0:107383:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788201576.192892:0:107402:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788201576.192898:0:107402:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788201576.192919:0:107402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ef6d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201576.192937:0:107402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc006dbc800/0x96d0c9b8c9a1ef3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ef35 expref: 10 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201576.192955:0:107402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ef6d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201576.192991:0:107402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc006dbc800/0x96d0c9b8c9a1ef3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1ef35 expref: 10 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201576.193429:0:107402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc006dbc800/0x96d0c9b8c9a1ef3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ef35 expref: 10 pid: 107398 timeout: 4527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201576.193445:0:107402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:107402:1875060715466240:0@lo:104: 00000100:00100000:0.0:1788201576.193588:0:107402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201576.193638:0:107402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13ab40e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201576.193698:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715466240 00000100:00100000:2.0:1788201576.193705:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715466240 00000100:00100000:2.0:1788201576.193905:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1788201576.193916:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9b18af6-fecc-4172-82c2-66531890fe11+3:107402:x1875060715466240:12345-0@lo:104: 00010000:00010000:2.0:1788201576.193929:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ef35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1ef3c expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.194004:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788201576.194011:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c9b18af6-fecc-4172-82c2-66531890fe11+3:107402:x1875060715466240:12345-0@lo:104: Request processed in 98us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201576.194038:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1788201576.194289:0:107402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:107402:1875060715466240:0@lo:104: 00010000:00010000:0.0:1788201576.194308:0:107402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ef6d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.194438:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201576.194444:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ef35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1ef3c expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.194452:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6a00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788201576.194457:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ef35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1ef3c expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.194466:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ef35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1ef3c expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201576.194473:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ef35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1ef3c expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201576.194479:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201576.194554:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ef35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1ef3c expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.194562:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788201576.194608:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715466368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201576.194642:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201576.194708:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715466368 00000100:00100000:0.0:1788201576.194713:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715466368 00010000:00010000:0.0:1788201576.194732:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc006dbc800/0x96d0c9b8c9a1ef3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ef35 expref: 11 pid: 107398 timeout: 4527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201576.194773:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2636 00000100:00100000:0.0:1788201576.194780:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+11:3656:x1875060715466368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201576.194790:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201576.194796:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc006dbc800/0x96d0c9b8c9a1ef3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ef35 expref: 11 pid: 107398 timeout: 4527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.194807:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc006dbc800/0x96d0c9b8c9a1ef3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ef35 expref: 11 pid: 107398 timeout: 4527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.194821:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006dbc800/0x96d0c9b8c9a1ef3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1ef35 expref: 11 pid: 107398 timeout: 4527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.194834:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ef6d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.194843:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ef6d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788201576.194856:0:6519:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001957934s 00010000:00010000:0.0:1788201576.194866:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ef6d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.194874:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ef6d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.194881:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ef6d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.194887:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ef6d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.194892:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201576.194897:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ef6d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.194903:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ef6d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.194917:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ef6d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.194925:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201576.195119:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ef35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1ef3c expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.195128:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1ef35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1ef3c expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.195141:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201576.195143:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201576.195145:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201576.195425:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c9b18af6-fecc-4172-82c2-66531890fe11+10:3656:x1875060715466368:12345-0@lo:103:ldlm_bl.0 Request processed in 644us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201576.195433:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2636 00010000:00010000:0.0:1788201576.195454:0:107402:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ef6d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.195463:0:107402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ef6d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.195480:0:107402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae3c00/0x96d0c9b8c9a1ef6d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201576.195528:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715466368:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788201576.201986:0:107383:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411350 00000040:01000000:1.0:1788201576.202395:0:107383:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788201576.205832:0:107439:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788201576.206173:0:107383:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1788201576.206494:0:107439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201576.208827:0:107439:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788201576.208919:0:107439:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000020:00080000:3.0:1788201576.209491:0:107438:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411350 00000020:00080000:3.0:1788201576.209497:0:107438:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411350 00000100:00080000:1.0:1788201576.212032:0:107440:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8dc106048700 x1875060715466496/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201576.212047:0:107440:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a49b000 going to sleep for 0 seconds 00000040:01000000:0.0:1788201576.212627:0:107383:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788201576.212667:0:107383:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788201576.215321:0:107383:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788201576.215341:0:107383:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788201576.215422:0:107383:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201576.217704:0:107383:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788201576.218522:0:107383:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788201576.223893:0:107383:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788201576.224055:0:107383:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788201576.224541:0:107383:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x56:0x0] (8/32) registered 00010000:00080000:1.0:1788201576.229711:0:107383:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 128849018921 00010000:00080000:3.0:1788201576.235284:0:107441:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 107441 00010000:02000000:3.0:1788201576.235302:0:107441:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1788201576.235307:0:107441:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788201576.235312:0:107441:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:1.0:1788201576.236013:0:107383:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788201576.236047:0:107383:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788201576.236093:0:107383:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788201576.236113:0:107383:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 10000000:01000000:3.0:1788201576.238784:0:107388:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000020:00000004:0.0:1788201576.246479:0:107383:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788201576.246730:0:107383:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:01000000:0.0:1788201576.258126:0:107388:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788201576.258165:0:107388:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.120@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1788201576.258170:0:107388:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788201576.258172:0:107388:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788201576.258174:0:107388:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201576.258175:0:107388:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201576.258176:0:107388:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201576.258178:0:107388:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201576.258179:0:107388:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201576.258181:0:107388:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201576.258183:0:107388:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788201576.258186:0:107388:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1788201576.258189:0:107388:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788201576.258190:0:107388:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788201576.258191:0:107388:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201576.258192:0:107388:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201576.258193:0:107388:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201576.258199:0:107388:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201576.258200:0:107388:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201576.258201:0:107388:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201576.258202:0:107388:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788201576.258226:0:107388:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788201576.258246:0:107388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715466624:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788201576.258313:0:107388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.258352:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715466624 00000100:00100000:0.0:1788201576.258356:0:107388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc00745d840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201576.258360:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715466624 00000100:00100000:1.0:1788201576.258406:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201576.258416:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005870450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:107388:x1875060715466624:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788201576.258446:0:107397:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788201576.258449:0:107397:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1788201576.258457:0:107397:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788201576.265237:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005870450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:107388:x1875060715466624:12345-0@lo:253:mount.lustre.0 Request processed in 6813us (6915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.265251:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788201576.266309:0:107388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715466624:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788201576.266325:0:107388:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788201576.266328:0:107388:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788201576.266330:0:107388:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788201576.266332:0:107388:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201576.266333:0:107388:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201576.266334:0:107388:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201576.266335:0:107388:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201576.266336:0:107388:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201576.266339:0:107388:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201576.266340:0:107388:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788201576.266362:0:107388:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dc12f00a800 from lustre-MDT0001 10000000:01000000:1.0:1788201576.266392:0:107388:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788201576.266395:0:107388:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788201576.266403:0:107388:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8dc12563cd28 local copy 10000000:01000000:1.0:1788201576.266408:0:107388:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788201576.266440:0:107388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ef74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.266451:0:107388:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ef74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.266467:0:107388:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ef74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201576.266487:0:107388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715466752:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201576.266532:0:107388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.266570:0:107388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140a45480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201576.274229:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715466752 00000100:00100000:0.0:1788201576.274243:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715466752 00000100:00100000:0.0:1788201576.274359:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788201576.274372:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005873050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:107388:x1875060715466752:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201576.274388:0:107398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201576.274407:0:107398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0056d6600/0x96d0c9b8c9a1ef7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ef74 expref: -99 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.274436:0:107398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0056d6600/0x96d0c9b8c9a1ef7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ef74 expref: 11 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.274447:0:107398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0056d6600/0x96d0c9b8c9a1ef7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ef74 expref: 11 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.274457:0:107398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d6600, rc 0) 00000100:00100000:0.0:1788201576.274528:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005873050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:107388:x1875060715466752:12345-0@lo:101:mount.lustre.0 Request processed in 160us (7996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201576.274534:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788201576.276192:0:107388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715466752:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201576.276218:0:107388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ef74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x96d0c9b8c9a1ef7b expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.276229:0:107388:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ef74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x96d0c9b8c9a1ef7b expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201576.276346:0:107388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715466880:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201576.276393:0:107388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.276427:0:107388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140a45480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201576.276446:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715466880 00000100:00100000:1.0:1788201576.276451:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715466880 00000100:00100000:1.0:1788201576.276486:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788201576.276493:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:107388:x1875060715466880:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201576.276562:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:107388:x1875060715466880:12345-0@lo:501:mount.lustre.0 Request processed in 69us (168us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201576.276568:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788201576.276608:0:107388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715466880:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788201576.276618:0:107388:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788201576.276643:0:107388:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788201576.276648:0:107388:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ef74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x96d0c9b8c9a1ef7b expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.276656:0:107388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ef74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000400000000 nid: local remote: 0x96d0c9b8c9a1ef7b expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.276663:0:107388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ef74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000400000000 nid: local remote: 0x96d0c9b8c9a1ef7b expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.276679:0:107388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788201576.276704:0:107388:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dc12f00a800 10000000:01000000:1.0:1788201576.276709:0:107388:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788201576.276715:0:107388:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8dc12f00a800 10000000:01000000:1.0:1788201576.276717:0:107388:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788201576.276720:0:107388:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dc12f00a800 from 1 10000000:01000000:1.0:1788201576.276723:0:107388:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788201576.276741:0:107388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2600/0x96d0c9b8c9a1ef82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.276748:0:107388:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2600/0x96d0c9b8c9a1ef82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.276755:0:107388:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2600/0x96d0c9b8c9a1ef82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201576.276766:0:107388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715467008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201576.276789:0:107388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.276800:0:107388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140a45240 going to sleep for 11 seconds 00010000:00010000:1.0:1788201576.276812:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201576.276825:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ef74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x96d0c9b8c9a1ef7b expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.276831:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2000 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201576.276834:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ef74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x96d0c9b8c9a1ef7b expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.276843:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ef74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0x96d0c9b8c9a1ef7b expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201576.276849:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ef74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0x96d0c9b8c9a1ef7b expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201576.276855:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201576.276870:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ef74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x96d0c9b8c9a1ef7b expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.276876:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201576.276893:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ef74 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x96d0c9b8c9a1ef7b expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.276899:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2000/0x96d0c9b8c9a1ef74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x96d0c9b8c9a1ef7b expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.276912:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201576.276914:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201576.276916:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201576.276924:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715467008 00000100:00100000:1.0:1788201576.276927:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715467008 00000100:00100000:1.0:1788201576.278916:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788201576.279001:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:107388:x1875060715467008:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201576.279049:0:107396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201576.279071:0:107396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc12e6e3000/0x96d0c9b8c9a1ef89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ef82 expref: -99 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.279098:0:107396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc12e6e3000/0x96d0c9b8c9a1ef89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ef82 expref: 12 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.279110:0:107396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc12e6e3000/0x96d0c9b8c9a1ef89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ef82 expref: 12 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.279120:0:107396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e3000, rc 0) 00000100:00100000:1.0:1788201576.279181:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+12:107388:x1875060715467008:12345-0@lo:101:mount.lustre.0 Request processed in 255us (2391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.279188:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788201576.279238:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715467136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201576.279267:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.279319:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715467136 00000100:00100000:1.0:1788201576.279325:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715467136 00000100:00100000:1.0:1788201576.279360:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:1.0:1788201576.279367:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+12:3657:x1875060715467136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201576.279377:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201576.279390:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0056d6600/0x96d0c9b8c9a1ef7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ef74 expref: 12 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.279403:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201576.279431:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c9b18af6-fecc-4172-82c2-66531890fe11+11:3657:x1875060715467136:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.279437:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:1.0:1788201576.279478:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715467136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201576.279511:0:107388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715467008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201576.279524:0:107388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2600/0x96d0c9b8c9a1ef82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ef89 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.279535:0:107388:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2600/0x96d0c9b8c9a1ef82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ef89 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201576.279547:0:107388:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788201576.279558:0:107388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2600/0x96d0c9b8c9a1ef82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ef89 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.279566:0:107388:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2600/0x96d0c9b8c9a1ef82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ef89 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201576.279574:0:107388:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788201576.279578:0:107388:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788201576.279584:0:107388:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8dc12f00a800 10000000:01000000:1.0:1788201576.279586:0:107388:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788201576.279590:0:107388:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788201576.279593:0:107388:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788201576.279612:0:107388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ef90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.279620:0:107388:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ef90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.279628:0:107388:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ef90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201576.279654:0:107388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715467264:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201576.279680:0:107388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.279694:0:107388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140a45240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201576.279708:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715467264 00000100:00100000:1.0:1788201576.279712:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715467264 00000100:00100000:1.0:1788201576.280859:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788201576.280880:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:107388:x1875060715467264:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201576.280892:0:107398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201576.280905:0:107398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1ef97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1ef90 expref: -99 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.280926:0:107398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1ef97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ef90 expref: 12 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.281032:0:107398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1ef97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ef90 expref: 12 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.281041:0:107398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e3a00, rc 0) 00000100:00100000:1.0:1788201576.281101:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+12:107388:x1875060715467264:12345-0@lo:101:mount.lustre.0 Request processed in 227us (1420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.281108:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788201576.283228:0:107388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715467264:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201576.283253:0:107388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ef90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ef97 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.283282:0:107388:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ef90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ef97 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788201576.283496:0:107388:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6e:0x0] index 59 count 58 00000040:00080000:0.0:1788201576.284293:0:107388:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201576.284521:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].1, 224 off8416 00000040:00080000:0.0:1788201576.284547:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].2, 136 off8552 00000040:00080000:0.0:1788201576.284560:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].3, 176 off8728 00000040:00080000:0.0:1788201576.284572:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].4, 224 off8952 00000040:00080000:0.0:1788201576.284584:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].5, 224 off9176 00000040:00080000:0.0:1788201576.284596:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].6, 120 off9296 00000040:00080000:0.0:1788201576.284608:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].7, 112 off9408 00000040:00080000:0.0:1788201576.284620:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].8, 160 off9568 00000040:00080000:0.0:1788201576.284632:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].9, 224 off9792 00000040:00080000:0.0:1788201576.284644:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].10, 224 off10016 00000040:00080000:0.0:1788201576.284656:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].11, 88 off10104 00000040:00080000:0.0:1788201576.284668:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].12, 144 off10248 00000040:00080000:0.0:1788201576.284680:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].13, 152 off10400 00000040:00080000:0.0:1788201576.284692:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].14, 168 off10568 00000040:00080000:0.0:1788201576.284704:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].15, 224 off10792 00000040:00080000:0.0:1788201576.284717:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].16, 224 off11016 00000040:00080000:0.0:1788201576.284729:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].17, 80 off11096 00000040:00080000:0.0:1788201576.284877:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].18, 224 off11320 00000040:00080000:0.0:1788201576.284897:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].19, 224 off11544 00000040:00080000:0.0:1788201576.284911:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].20, 160 off11704 00000040:00080000:0.0:1788201576.284924:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].21, 224 off11928 00000040:00080000:0.0:1788201576.284937:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].22, 224 off12152 00000040:00080000:0.0:1788201576.284949:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].23, 80 off12232 00000040:00080000:0.0:1788201576.284961:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].24, 224 off12456 00000040:00080000:0.0:1788201576.284974:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].25, 224 off12680 00000040:00080000:0.0:1788201576.285012:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].26, 88 off12768 00000040:00080000:0.0:1788201576.285052:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].27, 144 off12912 00000040:00080000:0.0:1788201576.285064:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].28, 152 off13064 00000040:00080000:0.0:1788201576.285076:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].29, 136 off13200 00000040:00080000:0.0:1788201576.285091:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].30, 224 off13424 00000040:00080000:0.0:1788201576.285104:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].31, 224 off13648 00000040:00080000:0.0:1788201576.285116:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].32, 80 off13728 00000040:00080000:0.0:1788201576.285128:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].33, 224 off13952 00000040:00080000:0.0:1788201576.285139:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].34, 224 off14176 00000040:00080000:0.0:1788201576.285151:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].35, 88 off14264 00000040:00080000:0.0:1788201576.285163:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].36, 144 off14408 00000040:00080000:0.0:1788201576.285174:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].37, 152 off14560 00000040:00080000:0.0:1788201576.285186:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].38, 136 off14696 00000040:00080000:0.0:1788201576.285198:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].39, 224 off14920 00000040:00080000:0.0:1788201576.287874:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].40, 224 off15144 00000040:00080000:0.0:1788201576.287911:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].41, 80 off15224 00000040:00080000:0.0:1788201576.287924:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].42, 224 off15448 00000040:00080000:0.0:1788201576.287937:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].43, 224 off15672 00000040:00080000:0.0:1788201576.287950:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].44, 120 off15792 00000040:00080000:0.0:1788201576.287965:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].45, 224 off16016 00000040:00080000:0.0:1788201576.287978:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].46, 224 off16240 00000040:00080000:0.0:1788201576.288030:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].47, 120 off16360 00000040:00080000:0.0:1788201576.288049:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].48, 24 off16384 00000040:00080000:0.0:1788201576.288211:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].49, 224 off16608 00000040:00080000:0.0:1788201576.288230:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].50, 224 off16832 00000040:00080000:0.0:1788201576.288243:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].51, 144 off16976 00000040:00080000:0.0:1788201576.288255:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].52, 224 off17200 00000040:00080000:0.0:1788201576.288267:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].53, 224 off17424 00000040:00080000:0.0:1788201576.288279:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].54, 144 off17568 00000040:00080000:0.0:1788201576.288291:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].55, 224 off17792 00000040:00080000:0.0:1788201576.288566:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].56, 224 off18016 00000040:00080000:0.0:1788201576.288584:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].57, 120 off18136 00000040:00080000:0.0:1788201576.288604:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x73:0x0].58, 224 off18360 00000040:00080000:0.0:1788201576.288627:0:107388:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6e:0x0] index 58 count 58 00000100:00100000:0.0:1788201576.289432:0:107388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715467392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201576.289507:0:107388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201576.289555:0:107388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc00745df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788201576.289843:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715467392 00000100:00100000:1.0:1788201576.289852:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715467392 00000100:00100000:1.0:1788201576.289909:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788201576.289918:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+12:107388:x1875060715467392:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201576.290203:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+12:107388:x1875060715467392:12345-0@lo:501:mount.lustre.0 Request processed in 285us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.290222:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788201576.291105:0:107388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715467392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201576.291159:0:107388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715467520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201576.291214:0:107388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201576.291248:0:107388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a875b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788201576.291323:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715467520 00000100:00100000:1.0:1788201576.291329:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715467520 00000100:00100000:1.0:1788201576.291498:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788201576.291508:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+12:107388:x1875060715467520:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201576.296956:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+12:107388:x1875060715467520:12345-0@lo:503:mount.lustre.0 Request processed in 5441us (5733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201576.296970:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788201576.297098:0:107388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715467520:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788201576.297573:0:107388:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788201576.297667:0:107388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715467648:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201576.297718:0:107388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201576.297749:0:107388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a875b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201576.297836:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715467648 00000100:00100000:2.0:1788201576.297842:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715467648 00000100:00100000:2.0:1788201576.297877:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788201576.297891:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+12:107388:x1875060715467648:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201576.301903:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+12:107388:x1875060715467648:12345-0@lo:502:mount.lustre.0 Request processed in 4003us (4175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201576.301917:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788201576.302011:0:107388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715467648:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788201576.302274:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].1, 224 off8416 00000040:00080000:2.0:1788201576.302304:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].2, 136 off8552 00000040:00080000:2.0:1788201576.302318:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].3, 176 off8728 00000040:00080000:2.0:1788201576.302331:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].4, 224 off8952 00000040:00080000:2.0:1788201576.302342:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].5, 224 off9176 00000040:00080000:2.0:1788201576.302356:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].6, 120 off9296 00000040:00080000:2.0:1788201576.302370:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].7, 112 off9408 00000040:00080000:2.0:1788201576.302383:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].8, 160 off9568 00000040:00080000:2.0:1788201576.302396:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].9, 224 off9792 00000040:00080000:2.0:1788201576.302409:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].10, 224 off10016 00000040:00080000:2.0:1788201576.302422:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].11, 88 off10104 00000040:00080000:2.0:1788201576.302436:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].12, 144 off10248 00000040:00080000:2.0:1788201576.302451:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].13, 152 off10400 00000040:00080000:2.0:1788201576.302464:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].14, 168 off10568 00000040:00080000:2.0:1788201576.302476:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].15, 224 off10792 00000040:00080000:2.0:1788201576.302489:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].16, 224 off11016 00000040:00080000:2.0:1788201576.302502:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].17, 80 off11096 00000040:00080000:2.0:1788201576.302516:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].18, 224 off11320 00000040:00080000:2.0:1788201576.302529:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].19, 224 off11544 00000040:00080000:2.0:1788201576.302541:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].20, 160 off11704 00000040:00080000:2.0:1788201576.302555:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].21, 224 off11928 00000040:00080000:2.0:1788201576.302569:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].22, 224 off12152 00000040:00080000:2.0:1788201576.302582:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].23, 80 off12232 00000040:00080000:2.0:1788201576.302594:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].24, 224 off12456 00000040:00080000:2.0:1788201576.302608:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].25, 224 off12680 00000040:00080000:2.0:1788201576.302633:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].26, 88 off12768 00000040:00080000:2.0:1788201576.302646:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].27, 144 off12912 00000040:00080000:2.0:1788201576.302660:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].28, 152 off13064 00000040:00080000:2.0:1788201576.302674:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].29, 136 off13200 00000040:00080000:2.0:1788201576.302687:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].30, 224 off13424 00000040:00080000:2.0:1788201576.302700:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].31, 224 off13648 00000040:00080000:2.0:1788201576.302714:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].32, 80 off13728 00000040:00080000:2.0:1788201576.302727:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].33, 224 off13952 00000040:00080000:2.0:1788201576.302739:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].34, 224 off14176 00000040:00080000:2.0:1788201576.302751:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].35, 88 off14264 00000040:00080000:2.0:1788201576.302766:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].36, 144 off14408 00000040:00080000:2.0:1788201576.302778:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].37, 152 off14560 00000040:00080000:2.0:1788201576.302791:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].38, 136 off14696 00000040:00080000:2.0:1788201576.302803:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].39, 224 off14920 00000040:00080000:2.0:1788201576.302815:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].40, 224 off15144 00000040:00080000:2.0:1788201576.302827:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].41, 80 off15224 00000040:00080000:2.0:1788201576.302839:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].42, 224 off15448 00000040:00080000:2.0:1788201576.302852:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].43, 224 off15672 00000040:00080000:2.0:1788201576.302866:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].44, 120 off15792 00000040:00080000:2.0:1788201576.302879:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].45, 224 off16016 00000040:00080000:2.0:1788201576.302891:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].46, 224 off16240 00000040:00080000:2.0:1788201576.302903:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].47, 120 off16360 00000040:00080000:2.0:1788201576.302914:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].48, 24 off16384 00000100:00100000:2.0:1788201576.302962:0:107388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715467776:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201576.303072:0:107388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201576.303100:0:107388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a875b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201576.303330:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715467776 00000100:00100000:3.0:1788201576.303337:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715467776 00000100:00100000:3.0:1788201576.303385:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788201576.303395:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+12:107388:x1875060715467776:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201576.304361:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+12:107388:x1875060715467776:12345-0@lo:502:mount.lustre.0 Request processed in 965us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201576.304370:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788201576.305776:0:107388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715467776:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788201576.306138:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].49, 224 off16608 00000040:00080000:2.0:1788201576.306168:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].50, 224 off16832 00000040:00080000:2.0:1788201576.306182:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].51, 144 off16976 00000040:00080000:2.0:1788201576.306195:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].52, 224 off17200 00000040:00080000:2.0:1788201576.306218:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].53, 224 off17424 00000040:00080000:2.0:1788201576.306232:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].54, 144 off17568 00000040:00080000:2.0:1788201576.306244:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].55, 224 off17792 00000040:00080000:2.0:1788201576.306256:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].56, 224 off18016 00000040:00080000:2.0:1788201576.306269:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].57, 120 off18136 00000100:00100000:2.0:1788201576.306300:0:107388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715467904:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201576.307481:0:107388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201576.307534:0:107388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a875b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201576.307569:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715467904 00000100:00100000:2.0:1788201576.307575:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715467904 00000100:00100000:2.0:1788201576.307622:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788201576.307632:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+12:107388:x1875060715467904:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201576.307862:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+12:107388:x1875060715467904:12345-0@lo:502:mount.lustre.0 Request processed in 232us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201576.307871:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788201576.307943:0:107388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715467904:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788201576.308034:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x74:0x0].58, 224 off18360 00000040:00080000:2.0:1788201576.308047:0:107388:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 58 count 58 00000020:01000000:0.0:1788201576.319378:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201576.319392:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201576.319395:0:107443:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788201576.319400:0:107443:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788201576.319403:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201576.319419:0:107443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8dc004043370) 00000020:00000080:0.0:1788201576.319445:0:107443:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1788201576.319450:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788201576.319519:0:107443:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788201576.319528:0:107443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x96d0c9b8c9a1efa5 00000020:00000080:0.0:1788201576.319766:0:107443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788201576.319771:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201576.319775:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201576.319776:0:107443:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788201576.319779:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201576.319782:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201576.319784:0:107443:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788201576.319787:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201576.319794:0:107443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8dc0040419b8) 00000020:00000080:0.0:1788201576.319806:0:107443:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1788201576.319811:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788201576.319813:0:107443:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788201576.319816:0:107443:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788201576.319821:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788201576.319866:0:107443:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc12f00a800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788201576.319878:0:107443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8dc004040000) 00000020:00000080:0.0:1788201576.319887:0:107443:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1788201576.319938:0:107443:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788201576.319951:0:107443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x96d0c9b8c9a1efba 00000020:00000080:0.0:1788201576.320087:0:107443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788201576.320094:0:107443:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788201576.320099:0:107443:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x96d0c9b8c9a1efc1 00080000:01000000:0.0:1788201576.320104:0:107443:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788201576.320107:0:107443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x96d0c9b8c9a1efc8 00000100:00100000:3.0:1788201576.350735:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201576.351473:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695577856 00000100:00100000:2.0:1788201576.351484:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695577856 00000100:00100000:2.0:1788201576.351523:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00100000:2.0:1788201576.351532:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2399:x1875060695577856:12345-192.168.201.20@tcp:250:kworker.0 00010000:00080000:2.0:1788201576.351559:0:107397:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 93ba7067-43b5-4e46-8db7-27c040fa03d9@192.168.201.20@tcp t0 exp 0000000000000000 cur 4427 last 0 00000020:00000080:2.0:1788201576.351586:0:107397:0:(genops.c:1385:class_connect()) connect: client 93ba7067-43b5-4e46-8db7-27c040fa03d9, cookie 0x96d0c9b8c9a1efcf 00000100:00080000:2.0:1788201576.351712:0:107397:0:(import.c:65:import_set_state_nolock()) ffff8dc11d438800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201576.351829:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+5:2399:x1875060695577856:12345-192.168.201.20@tcp:250:kworker.0 Request processed in 296us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201576.351848:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00100000:0.0:1788201576.364883:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201576.365235:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695577984 00000100:00100000:1.0:1788201576.365247:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695577984 00000100:00100000:1.0:1788201576.366973:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1 00000100:00100000:1.0:1788201576.366985:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875060695577984:12345-192.168.201.20@tcp:38:kworker.0 00010000:00080000:1.0:1788201576.367037:0:107405:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '6e293f14-c501-4bc5-9dd4-a18ef02756b4' at ffff8dc12587a800, cookie 0x96d0c9b8c9a1eecc 00010000:00080000:1.0:1788201576.367044:0:107405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp recovering/t128849018922 exp ffff8dc12587a800 cur 4427 last 1788201576 00010000:02000400:1.0:1788201576.367052:0:107405:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:1.0:1788201576.389766:0:107405:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1788201576.389797:0:107405:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788201576.395013:0:107405:0:(import.c:65:import_set_state_nolock()) ffff8dc12b6ba800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201576.395117:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695577984:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 28126us (30237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.395130:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1 00000100:00100000:1.0:1788201576.405121:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201576.405217:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695569792 00000100:00100000:0.0:1788201576.405227:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695569792 00000100:00100000:0.0:1788201576.405286:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:0.0:1788201576.405298:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695569792:12345-192.168.201.20@tcp:36:mcreate.0 00010000:00080000:0.0:1788201576.405319:0:107404:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 128849018922, current: 128849018922, replaying 00000100:00100000:0.0:1788201576.405332:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695569792:12345-192.168.201.20@tcp:36:mcreate.0 Request processed in 38us (223us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201576.405337:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2 00010000:00080000:3.0:1788201576.406603:0:107441:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:2.0:1788201576.432728:0:107443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-4 is initialized 00000001:00080000:0.0:1788201576.437011:0:107443:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 0 lr: 0 srv lr: 81604378624 lx: 0 gen 27 00000001:00080000:0.0:1788201576.437080:0:107443:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 6e293f14-c501-4bc5-9dd4-a18ef02756b4 idx: 2 lr: 77309411500 srv lr: 81604378624 lx: 0 gen 24 00000001:00000004:0.0:1788201576.437106:0:107443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 20, last_transno is 81604378624 00000001:00080000:0.0:1788201576.437198:0:107443:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:0.0:1788201576.437275:0:107443:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0001: restore reply ffff8dc00745df00: xid 1875060695565824, transno 81604378639, client gen 24, slot idx 0 00000001:00080000:0.0:1788201576.437285:0:107443:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0001: restore reply ffff8dc00745d840: xid 1875060695568640, transno 81604378640, client gen 24, slot idx 1 00000020:00000080:2.0:1788201576.442383:0:107443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788201576.442397:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201576.442405:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201576.442407:0:107443:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788201576.442412:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201576.442418:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201576.442420:0:107443:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788201576.442423:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788201576.442428:0:107443:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:00000080:2.0:1788201576.442456:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201576.442471:0:107443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8dc0027d0000) 00000020:00000080:2.0:1788201576.442499:0:107443:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1788201576.442505:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788201576.442583:0:107443:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788201576.442589:0:107443:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788201576.442595:0:107443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x96d0c9b8c9a1efeb 00010000:00080000:2.0:1788201576.442625:0:107443:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc11d439000@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.120@tcp at head 00010000:00010000:2.0:1788201576.449398:0:107443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-9 is initialized 00000020:00000080:2.0:1788201576.461062:0:107443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788201576.461115:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788201576.461166:0:107443:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788201576.461192:0:107443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x96d0c9b8c9a1eff2 00000100:00080000:2.0:1788201576.461203:0:107443:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201576.461210:0:107443:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc11d439000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201576.461245:0:107443:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12b637800 x1875060715468032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201576.461271:0:107443:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788201576.461312:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201576.461316:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201576.461319:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201576.461322:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1788201576.461377:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201576.461382:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201576.461384:0:107443:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788201576.461386:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788201576.461389:0:107443:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788201576.461390:0:107443:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201576.461392:0:107443:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201576.461393:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788201576.461395:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201576.461397:0:107443:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788201576.461399:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201576.461404:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201576.461405:0:107443:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788201576.461409:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788201576.461438:0:107443:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788201576.461452:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201576.461455:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201576.461457:0:107443:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788201576.461460:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788201576.461461:0:107443:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1788201576.461463:0:107443:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201576.461464:0:107443:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201576.461466:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788201576.461469:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201576.461470:0:107443:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788201576.461472:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788201576.461476:0:107443:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788201576.461484:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201576.461486:0:107443:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788201576.461490:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788201576.461494:0:107443:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:2.0:1788201576.461518:0:107443:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788201576.461521:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201576.461533:0:107443:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8dc0027d3370) 00000020:00000080:2.0:1788201576.461548:0:107443:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1788201576.461552:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788201576.461610:0:107443:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788201576.461616:0:107443:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788201576.461621:0:107443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x96d0c9b8c9a1f000 00010000:00080000:2.0:1788201576.461651:0:107443:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc11d43c800@lustre-OST0000-osc-MDT0001: add connection 192.168.201.120@tcp at head 00000100:00100000:0.0:1788201576.462058:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715468032:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788201576.462125:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201576.462201:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715468032 00000100:00100000:0.0:1788201576.462222:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715468032 00000100:00100000:0.0:1788201576.462259:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201576.462267:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715468032:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788201576.462298:0:99776:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8dc12587c800, cookie 0x96d0c9b8c9a1eec5 00000100:00100000:0.0:1788201576.462337:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715468032:12345-0@lo:38:llog_process_th.0 Request processed in 69us (211us total) trans 0 rc -114/-114 00000100:00100000:0.0:1788201576.462345:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:02020000:0.0:1788201576.462381:0:3654:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_connect to node 0@lo failed: rc = -114 00000100:00100000:0.0:1788201576.462386:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788201576.462393:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201576.462396:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-114) 00000100:00100000:0.0:1788201576.462400:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715468032:0@lo:38:llog_process_th.0 00010000:00010000:2.0:1788201576.462890:0:107443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-10 is initialized 00000040:01000000:2.0:1788201576.465359:0:107443:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788201576.465385:0:107443:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788201576.465888:0:107443:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 18, last_idx 19 00000040:00080000:2.0:1788201576.474099:0:107443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201576.474129:0:107443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].20, 64 off9472 00000040:00080000:2.0:1788201576.474245:0:107443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x50:0x0].1, 64 off8256 00000040:00080000:1.0:1788201576.484622:0:107455:0:(llog.c:805:llog_process_thread()) index: 19, lh_last_idx: 20 synced_idx: 0 lgh_last_idx: 20 00000040:00080000:1.0:1788201576.484630:0:107455:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x4c:0x0] at index 19 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788201576.484848:0:107455:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 19, last_idx 20 00000040:00080000:1.0:1788201576.484869:0:107455:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x4c:0x0] at index 19 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788201576.485180:0:107455:0:(llog.c:805:llog_process_thread()) index: 20, lh_last_idx: 20 synced_idx: 20 lgh_last_idx: 20 00000040:00080000:1.0:1788201576.485183:0:107455:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x50:0x0] at index 20 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788201576.503174:0:107443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788201576.503193:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788201576.503375:0:107443:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788201576.503401:0:107443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x96d0c9b8c9a1f007 00000100:00080000:3.0:1788201576.503414:0:107443:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201576.503420:0:107443:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8dc11d43c800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201576.503455:0:107443:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004b38e00 x1875060715468160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201576.503539:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715468160:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788201576.503608:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201576.505188:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715468160 00000100:00100000:2.0:1788201576.505201:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715468160 00000100:00100000:2.0:1788201576.505241:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788201576.505251:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3654:x1875060715468160:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1788201576.505279:0:101191:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4427 last 0 00000020:00000080:2.0:1788201576.505309:0:101191:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x96d0c9b8c9a1f00e 00002000:00100000:2.0:1788201576.505325:0:101191:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8dc11d43f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788201576.505329:0:101191:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788201576.505332:0:101191:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788201576.505406:0:101191:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788201576.505430:0:101191:0:(import.c:65:import_set_state_nolock()) ffff8dc11d438000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788201576.505540:0:107443:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788201576.505622:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201576.505627:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201576.505629:0:107443:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788201576.505633:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788201576.505635:0:107443:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1788201576.505637:0:107443:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201576.505638:0:107443:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201576.505640:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788201576.505642:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201576.505644:0:107443:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788201576.505647:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788201576.505651:0:107443:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788201576.505655:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201576.505656:0:107443:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788201576.505659:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788201576.505663:0:107443:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:3.0:1788201576.505685:0:107443:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788201576.505687:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201576.505701:0:107443:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8dc12f0c19b8) 00000020:00000080:3.0:1788201576.505717:0:107443:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1788201576.505722:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788201576.505797:0:107443:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788201576.505809:0:107443:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788201576.505816:0:107443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x96d0c9b8c9a1f01c 00010000:00080000:3.0:1788201576.505842:0:107443:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc110730800@lustre-OST0001-osc-MDT0001: add connection 192.168.201.120@tcp at head 00010000:00010000:3.0:1788201576.506093:0:107443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1788201576.506162:0:107443:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788201576.506177:0:107443:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1788201576.507448:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715468160:12345-0@lo:8:llog_process_th.0 Request processed in 2191us (3832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201576.507460:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1788201576.507492:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201576.507497:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201576.507500:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201576.507503:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788201576.507656:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788201576.507666:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 4 00000100:00080000:1.0:1788201576.507674:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788201576.507679:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788201576.507682:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11d43c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788201576.507698:0:3654:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788201576.507704:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715468160:0@lo:8:llog_process_th.0 00000004:00080000:2.0:1788201576.507860:0:107455:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788201576.507919:0:107455:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 4427979901842ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788201576.508006:0:107455:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788201576.508183:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715468288:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201576.508362:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201576.508479:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715468288 00000100:00100000:2.0:1788201576.508486:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715468288 00000100:00100000:2.0:1788201576.508540:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788201576.508549:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715468288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201576.508567:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201576.508607:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715468288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201576.508615:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788201576.508653:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715468288:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788201576.508805:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1788201576.509870:0:107443:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 18, last_idx 19 00000040:00080000:3.0:1788201576.512536:0:107443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201576.512567:0:107443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].20, 64 off9472 00000040:00080000:3.0:1788201576.512699:0:107443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x52:0x0].1, 64 off8256 00000040:00080000:3.0:1788201576.513514:0:107460:0:(llog.c:805:llog_process_thread()) index: 19, lh_last_idx: 20 synced_idx: 0 lgh_last_idx: 20 00000040:00080000:3.0:1788201576.513520:0:107460:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x4e:0x0] at index 19 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1788201576.513629:0:107460:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 19, last_idx 20 00000040:00080000:3.0:1788201576.513643:0:107460:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x4e:0x0] at index 19 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1788201576.513758:0:107460:0:(llog.c:805:llog_process_thread()) index: 20, lh_last_idx: 20 synced_idx: 20 lgh_last_idx: 20 00000040:00080000:3.0:1788201576.513762:0:107460:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x52:0x0] at index 20 of catalog [0x1:0x5:0x0] 00000004:00080000:3.0:1788201576.515504:0:107392:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000020:00000080:2.0:1788201576.547718:0:107443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788201576.547735:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788201576.547854:0:107443:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788201576.547880:0:107443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x96d0c9b8c9a1f023 00000100:00080000:2.0:1788201576.547892:0:107443:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201576.547904:0:107443:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8dc110730800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201576.557621:0:107443:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12b637100 x1875060715468416/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201576.557696:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715468416:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788201576.558238:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788201576.558360:0:107443:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788201576.558444:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201576.558451:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201576.558454:0:107443:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788201576.558457:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201576.558461:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201576.558463:0:107443:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788201576.558466:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788201576.558468:0:107443:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788201576.558471:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201576.558473:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201576.558475:0:107443:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788201576.558477:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201576.558480:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201576.558481:0:107443:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788201576.558485:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788201576.558490:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201576.558492:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201576.558493:0:107443:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000020:01000000:2.0:1788201576.558496:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788201576.558499:0:107443:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #44 00000020:01000000:2.0:1788201576.558501:0:107443:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201576.558503:0:107443:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201576.558531:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788201576.558533:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201576.558535:0:107443:0:(obd_config.c:1563:class_process_config()) marker 44 (0x6) lustre-MDT0001-m new lustre.pool_134 00000020:01000000:2.0:1788201576.558537:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788201576.558539:0:107443:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #47 00000020:01000000:2.0:1788201576.558541:0:107443:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201576.558543:0:107443:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201576.558556:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788201576.558559:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201576.558560:0:107443:0:(obd_config.c:1563:class_process_config()) marker 47 (0x6) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000020:01000000:2.0:1788201576.558563:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201576.558566:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201576.558567:0:107443:0:(obd_config.c:1563:class_process_config()) marker 48 (0x1) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:2.0:1788201576.558571:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: ce022 00000020:01000000:2.0:1788201576.558583:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201576.558585:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201576.558587:0:107443:0:(obd_config.c:1563:class_process_config()) marker 48 (0x2) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:01000000:2.0:1788201576.558590:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201576.558592:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201576.558594:0:107443:0:(obd_config.c:1563:class_process_config()) marker 51 (0x1) lustre-MDT0001-m del lustre.pool_134 00000020:00000080:2.0:1788201576.558597:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: ce023 00000020:01000000:2.0:1788201576.558607:0:107443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201576.558610:0:107443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201576.558611:0:107443:0:(obd_config.c:1563:class_process_config()) marker 51 (0x2) lustre-MDT0001-m del lustre.pool_134 00000040:00080000:2.0:1788201576.558614:0:107443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x74:0x0] index 59 count 58 00000020:01000000:2.0:1788201576.558676:0:107388:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-58 (rc=0) 10000000:01000000:2.0:1788201576.558707:0:107388:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788201576.558723:0:107388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ef90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ef97 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201576.558820:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715468416 00000100:00100000:0.0:1788201576.558829:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715468416 00000100:00100000:0.0:1788201576.558864:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788201576.558872:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3654:x1875060715468416:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1788201576.558899:0:100688:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4428 last 0 00000020:00000080:0.0:1788201576.558926:0:100688:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x96d0c9b8c9a1f02a 00002000:00100000:0.0:1788201576.558940:0:100688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8dc139bc1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788201576.558945:0:100688:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1788201576.558947:0:100688:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788201576.559041:0:100688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788201576.559067:0:100688:0:(import.c:65:import_set_state_nolock()) ffff8dc139bc4800 : changing import state from RECOVER to FULL 00010000:00010000:2.0:1788201576.559146:0:107388:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ef90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ef97 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201576.559157:0:107388:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc12f00a800 from 1 10000000:01000000:2.0:1788201576.559161:0:107388:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788201576.559191:0:107388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbd600/0x96d0c9b8c9a1f031 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.559199:0:107388:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc006dbd600/0x96d0c9b8c9a1f031 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.559215:0:107388:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc006dbd600/0x96d0c9b8c9a1f031 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201576.559235:0:107388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715468544:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201576.559270:0:107388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201576.559296:0:107388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125952480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201576.559315:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715468544 00000100:00100000:2.0:1788201576.559319:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715468544 00000100:00100000:2.0:1788201576.559346:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788201576.559354:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+12:107388:x1875060715468544:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201576.559362:0:107396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201576.559373:0:107396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006dbde00/0x96d0c9b8c9a1f038 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f031 expref: -99 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.559393:0:107396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006dbde00/0x96d0c9b8c9a1f038 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f031 expref: 13 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.559403:0:107396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006dbde00/0x96d0c9b8c9a1f038 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f031 expref: 13 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.559411:0:107396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbde00, rc 0) 00000100:00100000:2.0:1788201576.559438:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+13:107388:x1875060715468544:12345-0@lo:101:mount.lustre.0 Request processed in 84us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201576.559444:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788201576.559490:0:107388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715468544:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201576.559503:0:107388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc006dbd600/0x96d0c9b8c9a1f031 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f038 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.559517:0:107388:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc006dbd600/0x96d0c9b8c9a1f031 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f038 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201576.564116:0:107388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715468672:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788201576.564196:0:107388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201576.564235:0:107388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125952480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201576.564270:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715468672 00000100:00100000:2.0:1788201576.564277:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715468672 00000100:00100000:2.0:1788201576.564323:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788201576.564333:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+13:107388:x1875060715468672:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788201576.564354:0:107398:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788201576.564373:0:107398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788201576.564377:0:107398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788201576.564380:0:107398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788201576.564382:0:107398:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 139 00000100:00100000:2.0:1788201576.564477:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+13:107388:x1875060715468672:12345-0@lo:256:mount.lustre.0 Request processed in 133us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201576.564485:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788201576.564537:0:107388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715468672:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788201576.565624:0:107388:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788201576.565637:0:107388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbd600/0x96d0c9b8c9a1f031 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f038 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.565649:0:107388:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc006dbd600/0x96d0c9b8c9a1f031 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f038 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201576.565670:0:107388:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc12f00a800 from 1 10000000:01000000:2.0:1788201576.565674:0:107388:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201576.565699:0:107388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbcc00/0x96d0c9b8c9a1f03f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.565706:0:107388:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc006dbcc00/0x96d0c9b8c9a1f03f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.565716:0:107388:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc006dbcc00/0x96d0c9b8c9a1f03f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201576.565732:0:107388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715468800:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201576.566183:0:107388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201576.566206:0:107388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125952480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201576.566235:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715468800 00000100:00100000:2.0:1788201576.566241:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715468800 00000100:00100000:2.0:1788201576.566273:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788201576.566280:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+13:107388:x1875060715468800:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201576.566290:0:107397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201576.566302:0:107397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006dbc400/0x96d0c9b8c9a1f046 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f03f expref: -99 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.566323:0:107397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006dbc400/0x96d0c9b8c9a1f046 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f03f expref: 14 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.566332:0:107397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006dbc400/0x96d0c9b8c9a1f046 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f03f expref: 14 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.566354:0:107397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbc400, rc 0) 00000100:00100000:2.0:1788201576.566388:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+14:107388:x1875060715468800:12345-0@lo:101:mount.lustre.0 Request processed in 107us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201576.566395:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788201576.566434:0:107388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715468800:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201576.566447:0:107388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc006dbcc00/0x96d0c9b8c9a1f03f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f046 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.566457:0:107388:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc006dbcc00/0x96d0c9b8c9a1f03f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f046 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788201576.566643:0:107388:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x70:0x0] index 7 count 7 00000040:00080000:2.0:1788201576.570469:0:107388:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788201576.570680:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x75:0x0].1, 224 off8416 00000040:00080000:2.0:1788201576.570706:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x75:0x0].2, 112 off8528 00000040:00080000:2.0:1788201576.570718:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x75:0x0].3, 224 off8752 00000040:00080000:2.0:1788201576.570731:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x75:0x0].4, 224 off8976 00000040:00080000:2.0:1788201576.570767:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x75:0x0].5, 112 off9088 00000040:00080000:2.0:1788201576.570784:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x75:0x0].6, 224 off9312 00000040:00080000:2.0:1788201576.570790:0:107388:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x70:0x0] index 6 count 7 00000100:00100000:2.0:1788201576.570877:0:107388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715468928:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201576.570951:0:107388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201576.570999:0:107388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140024d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201576.571057:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715468928 00000100:00100000:2.0:1788201576.571064:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715468928 00000100:00100000:2.0:1788201576.571102:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788201576.571111:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+14:107388:x1875060715468928:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201576.571211:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+14:107388:x1875060715468928:12345-0@lo:501:mount.lustre.0 Request processed in 100us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201576.571219:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788201576.571265:0:107388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715468928:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201576.571295:0:107388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715469056:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201576.571332:0:107388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201576.571344:0:107388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140024d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201576.571358:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715469056 00000100:00100000:2.0:1788201576.571361:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715469056 00000100:00100000:2.0:1788201576.571383:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788201576.571389:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+14:107388:x1875060715469056:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201576.571427:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715468416:12345-0@lo:8:llog_process_th.0 Request processed in 12553us (13189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201576.571436:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788201576.571454:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+14:107388:x1875060715469056:12345-0@lo:503:mount.lustre.0 Request processed in 65us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201576.571460:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788201576.571497:0:107388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715469056:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788201576.571785:0:107388:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788201576.571830:0:107388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715469184:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201576.571862:0:107388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201576.571886:0:107388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125952480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201576.571899:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715469184 00000100:00100000:2.0:1788201576.571903:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715469184 00000100:00100000:2.0:1788201576.571923:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788201576.571929:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+14:107388:x1875060715469184:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201576.572007:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+14:107388:x1875060715469184:12345-0@lo:502:mount.lustre.0 Request processed in 76us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201576.572050:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788201576.572089:0:107388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715469184:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788201576.572210:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x76:0x0].1, 224 off8416 00000040:00080000:2.0:1788201576.572233:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x76:0x0].2, 112 off8528 00000040:00080000:2.0:1788201576.572245:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x76:0x0].3, 224 off8752 00000040:00080000:2.0:1788201576.572257:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x76:0x0].4, 224 off8976 00000040:00080000:2.0:1788201576.572270:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x76:0x0].5, 112 off9088 00000100:00100000:2.0:1788201576.572288:0:107388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715469312:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788201576.572320:0:107388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201576.572344:0:107388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125952480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201576.572824:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00100000:0.0:1788201576.572835:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715469312 00000100:00080000:1.0:1788201576.572835:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00100000:0.0:1788201576.572840:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715469312 00000100:00080000:1.0:1788201576.572843:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788201576.572848:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788201576.572852:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc110730800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788201576.572868:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000004:00080000:1.0:1788201576.572874:0:3654:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788201576.572880:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715468416:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788201576.572883:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13c3cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+14:107388:x1875060715469312:12345-0@lo:502:mount.lustre.0 00000100:00080000:1.0:1788201576.572913:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201576.572917:0:41592:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788201576.572967:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13c3cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+14:107388:x1875060715469312:12345-0@lo:502:mount.lustre.0 Request processed in 84us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201576.572974:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1788201576.572983:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201576.572996:0:41592:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201576.573006:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201576.573009:0:41592:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201576.573011:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201576.573043:0:41592:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788201576.573046:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788201576.573048:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788201576.573051:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc005d73000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201576.573056:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 4427 00000100:00080000:1.0:1788201576.573060:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1788201576.573064:0:107388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715469312:0@lo:502:mount.lustre.0 00000100:00080000:1.0:1788201576.573065:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8dc005d73000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201576.573086:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc10604b480 x1875060715469440/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:00080000:0.0:1788201576.573108:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x76:0x0].6, 224 off9312 00000040:00080000:0.0:1788201576.573117:0:107388:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000100:00080000:1.0:1788201576.573126:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788201576.573129:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201576.573130:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc11cdd9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201576.573135:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dc11cdd9800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201576.573145:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc10604b800 x1875060715469824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201576.573152:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788201576.573155:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201576.573156:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201576.573159:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4427 00000100:00080000:1.0:1788201576.573162:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788201576.573171:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc11d439000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201576.573182:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc10604a300 x1875060715469952/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201576.573238:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715469568:0@lo:400:kworker.0 00000100:00100000:1.0:1788201576.573284:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.573307:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201576.573313:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715469696:0@lo:400:kworker.0 00000100:00100000:1.0:1788201576.573335:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.573368:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715470080:0@lo:400:kworker.0 00000100:00100000:1.0:1788201576.573390:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.573418:0:101189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715469568 00000100:00100000:1.0:1788201576.573422:0:101189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715469568 00000100:00100000:1.0:1788201576.573446:0:101189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715469696 00000100:00100000:1.0:1788201576.573449:0:101189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715469696 00000100:00100000:1.0:1788201576.573464:0:101189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715470080 00000100:00100000:1.0:1788201576.573466:0:101189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715470080 00000100:00100000:1.0:1788201576.573482:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788201576.573489:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715469568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201576.573524:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715469568:12345-0@lo:400:kworker.0 Request processed in 35us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.573531:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788201576.573544:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788201576.573550:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715469696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201576.573575:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715469696:12345-0@lo:400:kworker.0 Request processed in 25us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.573581:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788201576.573599:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788201576.573604:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715470080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201576.573633:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715470080:12345-0@lo:400:kworker.0 Request processed in 28us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.573639:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000004:00080000:3.0:1788201576.574440:0:107460:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788201576.574488:0:107460:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 4428046471637ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788201576.574495:0:107460:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788201576.574611:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715470080:0@lo:400:kworker.0 00000100:00100000:1.0:1788201576.574635:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715469696:0@lo:400:kworker.0 00000100:00100000:1.0:1788201576.574643:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715469568:0@lo:400:kworker.0 00000100:00100000:1.0:1788201576.574666:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715469440:0@lo:38:kworker.0 00000100:00100000:1.0:1788201576.574717:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.574737:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715469824:0@lo:38:kworker.0 00000100:00100000:1.0:1788201576.574775:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.574791:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715469952:0@lo:38:kworker.0 00000100:00100000:1.0:1788201576.574810:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.574836:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715469824 00000100:00100000:1.0:1788201576.574840:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715469824 00000100:00100000:1.0:1788201576.574862:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201576.574867:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715469824:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788201576.574887:0:107405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 4428 last 0 00000020:00000080:1.0:1788201576.574916:0:107405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x96d0c9b8c9a1f04d 00000004:00100000:1.0:1788201576.574940:0:107405:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788201576.575081:0:107405:0:(import.c:65:import_set_state_nolock()) ffff8dc11d638800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201576.575119:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875060715469824:12345-0@lo:38:kworker.0 Request processed in 251us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.575134:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201576.575155:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715469440 00000100:00100000:1.0:1788201576.575159:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715469440 00000100:00100000:1.0:1788201576.575167:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715469952 00000100:00100000:1.0:1788201576.575169:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715469952 00000100:00100000:1.0:1788201576.575176:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201576.575181:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715469440:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788201576.575211:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715469440:12345-0@lo:38:kworker.0 Request processed in 29us (494us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788201576.575216:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201576.575225:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201576.575228:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715469952:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788201576.575240:0:99775:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8dc12587c800, cookie 0x96d0c9b8c9a1eec5 00010000:00080000:1.0:1788201576.575244:0:99775:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8dc12587c800 cur 4428 last 1788201576 00000004:00100000:1.0:1788201576.575252:0:99775:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788201576.575264:0:99775:0:(import.c:65:import_set_state_nolock()) ffff8dc11d638000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201576.575294:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715469952:12345-0@lo:38:kworker.0 Request processed in 65us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.575300:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788201576.575314:0:107441:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788201576.575321:0:107441:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00010000:00080000:1.0:1788201576.575323:0:107441:0:(ldlm_lib.c:2589:check_for_recovery_ready()) lustre-MDT0000 update recovery is not ready, extend recovery 71 00000100:00100000:1.0:1788201576.575337:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788201576.575342:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc005d73000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201576.575346:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788201576.575349:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715469440:0@lo:38:kworker.0 00010000:00080000:1.0:1788201576.575365:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8dc10604b800 x1875060715469824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201576.575376:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 31 00000100:00080000:1.0:1788201576.575382:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788201576.575386:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788201576.575388:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11cdd9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788201576.575392:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715469824:0@lo:38:kworker.0 00000100:00100000:1.0:1788201576.575399:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018921 gen 2 00000100:00080000:1.0:1788201576.575401:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 31 00000100:00080000:1.0:1788201576.575405:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788201576.575409:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788201576.575410:0:3654:0:(import.c:1233:ptlrpc_connect_interpret()) connect to lustre-MDT0000_UUID during recovery 00000100:00080000:1.0:1788201576.575412:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY_LOCKS 00000100:00080000:1.0:1788201576.575415:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1788201576.575430:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715469952:0@lo:38:kworker.0 00000100:00100000:1.0:1788201576.575447:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715470208:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:1.0:1788201576.575466:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.575486:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715470208 00000100:00100000:1.0:1788201576.575489:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715470208 00000100:00100000:1.0:1788201576.575506:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201576.575510:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715470208:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:1.0:1788201576.575524:0:99775:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc003a70700 x1875060715470208/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:697/0 lens 224/0 e 0 to 0 dl 1788201587 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201576.575536:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715470208:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 26us (70us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201576.575547:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788201576.575556:0:107441:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788201576.575560:0:107441:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 71 seconds 00010000:00080000:1.0:1788201576.575562:0:107441:0:(ldlm_lib.c:2589:check_for_recovery_ready()) lustre-MDT0000 update recovery is not ready, extend recovery 72 00000100:00100000:1.0:1788201576.575595:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201576.575601:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715470336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201576.575626:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.575647:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715470336 00000100:00100000:1.0:1788201576.575650:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715470336 00000100:00100000:1.0:1788201576.575678:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788201576.575684:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc108cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715470336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201576.575695:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201576.575723:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc108cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715470336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.575729:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1788201576.575982:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201576.576037:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715470336:0@lo:13:osp-pre-1-1.0 00000020:01000000:0.0:1788201576.586849:0:107464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201576.586862:0:107464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201576.586864:0:107464:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788201576.586873:0:107464:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc12f00a800 00000020:00000080:0.0:1788201576.586876:0:107464:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788201576.586885:0:107464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201576.586887:0:107464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201576.586889:0:107464:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788201576.586891:0:107464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201576.586894:0:107464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201576.586895:0:107464:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788201576.586899:0:107464:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc12f00a800 00000020:00000080:0.0:1788201576.586901:0:107464:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788201576.586959:0:107464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201576.586962:0:107464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201576.586964:0:107464:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788201576.586967:0:107464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x76:0x0] index 7 count 7 00000020:01000000:1.0:1788201576.587068:0:107388:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1788201576.587098:0:107388:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201576.587114:0:107388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc006dbcc00/0x96d0c9b8c9a1f03f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f046 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.587126:0:107388:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc006dbcc00/0x96d0c9b8c9a1f03f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f046 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201576.587176:0:107388:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788201576.587180:0:107388:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dc12f00a800 10000000:01000000:1.0:1788201576.587192:0:107388:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dc12f00a800 10000000:01000000:1.0:1788201576.587196:0:107388:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788201576.587479:0:107388:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc12f00a800 from 1 10000000:01000000:1.0:1788201576.587484:0:107388:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788201576.587519:0:107388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1f054 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.587529:0:107388:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1f054 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.587541:0:107388:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1f054 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201576.587565:0:107388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715470464:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201576.587626:0:107388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.587664:0:107388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140a45cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201576.591073:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715470464 00000100:00100000:2.0:1788201576.591086:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715470464 00000100:00100000:2.0:1788201576.591150:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788201576.591160:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13c3cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+14:107388:x1875060715470464:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201576.591178:0:107398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201576.591195:0:107398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc006dbc000/0x96d0c9b8c9a1f05b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f054 expref: -99 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.591625:0:107398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc006dbc000/0x96d0c9b8c9a1f05b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f054 expref: 15 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.591638:0:107398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc006dbc000/0x96d0c9b8c9a1f05b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f054 expref: 15 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201576.591648:0:107398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc006dbc000, rc 0) 00000100:00100000:2.0:1788201576.591769:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13c3cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+15:107388:x1875060715470464:12345-0@lo:101:mount.lustre.0 Request processed in 611us (4143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201576.591789:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:3.0:1788201576.596233:0:107392:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788201576.597887:0:107388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715470464:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201576.597915:0:107388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1f054 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f05b expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.598012:0:107388:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1f054 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f05b expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201576.598286:0:107388:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x72:0x0] index 64 count 63 00000040:00080000:1.0:1788201576.599228:0:107388:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201576.600104:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].1, 224 off8416 00000040:00080000:1.0:1788201576.600136:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].2, 120 off8536 00000040:00080000:1.0:1788201576.600150:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].3, 168 off8704 00000040:00080000:1.0:1788201576.600165:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].4, 224 off8928 00000040:00080000:1.0:1788201576.600180:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].5, 224 off9152 00000040:00080000:1.0:1788201576.600201:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].6, 120 off9272 00000040:00080000:1.0:1788201576.600213:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].7, 168 off9440 00000040:00080000:1.0:1788201576.600225:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].8, 224 off9664 00000040:00080000:1.0:1788201576.600238:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].9, 224 off9888 00000040:00080000:1.0:1788201576.600250:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].10, 120 off10008 00000040:00080000:1.0:1788201576.600261:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].11, 224 off10232 00000040:00080000:1.0:1788201576.600272:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].12, 224 off10456 00000040:00080000:1.0:1788201576.600283:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].13, 88 off10544 00000040:00080000:1.0:1788201576.600833:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].14, 128 off10672 00000040:00080000:1.0:1788201576.600853:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].15, 144 off10816 00000040:00080000:1.0:1788201576.600865:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].16, 160 off10976 00000040:00080000:1.0:1788201576.600879:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].17, 224 off11200 00000040:00080000:1.0:1788201576.600891:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].18, 224 off11424 00000040:00080000:1.0:1788201576.600904:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].19, 80 off11504 00000040:00080000:1.0:1788201576.600915:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].20, 224 off11728 00000040:00080000:1.0:1788201576.601012:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].21, 224 off11952 00000040:00080000:1.0:1788201576.601515:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].22, 88 off12040 00000040:00080000:1.0:1788201576.601531:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].23, 128 off12168 00000040:00080000:1.0:1788201576.601544:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].24, 144 off12312 00000040:00080000:1.0:1788201576.601557:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].25, 160 off12472 00000040:00080000:1.0:1788201576.601569:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].26, 224 off12696 00000040:00080000:1.0:1788201576.601582:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].27, 224 off12920 00000040:00080000:1.0:1788201576.601594:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].28, 80 off13000 00000040:00080000:1.0:1788201576.601607:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].29, 224 off13224 00000040:00080000:1.0:1788201576.601620:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].30, 224 off13448 00000040:00080000:1.0:1788201576.601633:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].31, 88 off13536 00000040:00080000:1.0:1788201576.601645:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].32, 128 off13664 00000040:00080000:1.0:1788201576.601658:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].33, 144 off13808 00000040:00080000:1.0:1788201576.601671:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].34, 128 off13936 00000040:00080000:1.0:1788201576.601681:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].35, 224 off14160 00000040:00080000:1.0:1788201576.601691:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].36, 224 off14384 00000040:00080000:1.0:1788201576.601703:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].37, 80 off14464 00000040:00080000:1.0:1788201576.601717:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].38, 224 off14688 00000040:00080000:1.0:1788201576.601742:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].39, 224 off14912 00000040:00080000:1.0:1788201576.601771:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].40, 88 off15000 00000040:00080000:1.0:1788201576.601785:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].41, 128 off15128 00000040:00080000:1.0:1788201576.601796:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].42, 144 off15272 00000040:00080000:1.0:1788201576.601808:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].43, 128 off15400 00000040:00080000:1.0:1788201576.601821:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].44, 224 off15624 00000040:00080000:1.0:1788201576.601834:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].45, 224 off15848 00000040:00080000:1.0:1788201576.601846:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].46, 80 off15928 00000040:00080000:1.0:1788201576.601859:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].47, 224 off16152 00000040:00080000:1.0:1788201576.601871:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].48, 232 off16384 00000040:00080000:1.0:1788201576.601977:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].49, 224 off16608 00000040:00080000:1.0:1788201576.602007:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].50, 120 off16728 00000040:00080000:1.0:1788201576.602054:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].51, 224 off16952 00000040:00080000:1.0:1788201576.602070:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].52, 224 off17176 00000040:00080000:1.0:1788201576.602082:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].53, 112 off17288 00000040:00080000:1.0:1788201576.602095:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].54, 224 off17512 00000040:00080000:1.0:1788201576.602106:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].55, 224 off17736 00000040:00080000:1.0:1788201576.602118:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].56, 136 off17872 00000040:00080000:1.0:1788201576.602130:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].57, 224 off18096 00000040:00080000:1.0:1788201576.602142:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].58, 224 off18320 00000040:00080000:1.0:1788201576.602154:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].59, 136 off18456 00000040:00080000:1.0:1788201576.602166:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].60, 224 off18680 00000040:00080000:1.0:1788201576.602178:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].61, 224 off18904 00000040:00080000:1.0:1788201576.602190:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].62, 112 off19016 00000040:00080000:1.0:1788201576.602205:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x77:0x0].63, 224 off19240 00000040:00080000:1.0:1788201576.602211:0:107388:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x72:0x0] index 63 count 63 00000100:00100000:1.0:1788201576.602485:0:107388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715470592:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201576.602552:0:107388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.602642:0:107388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140a45240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201576.602794:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715470592 00000100:00100000:2.0:1788201576.602801:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715470592 00000100:00100000:2.0:1788201576.602851:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788201576.602861:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13c3cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+15:107388:x1875060715470592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201576.604468:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13c3cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+15:107388:x1875060715470592:12345-0@lo:501:mount.lustre.0 Request processed in 1602us (1909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201576.604479:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788201576.608035:0:107388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715470592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201576.608097:0:107388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715470720:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201576.608163:0:107388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201576.608207:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715470720 00000100:00100000:0.0:1788201576.608213:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715470720 00000100:00100000:0.0:1788201576.608266:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788201576.608274:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+15:107388:x1875060715470720:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201576.608375:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+15:107388:x1875060715470720:12345-0@lo:503:mount.lustre.0 Request processed in 100us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201576.608383:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788201576.608439:0:107388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201576.608453:0:107388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715470720:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788201576.608876:0:107388:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788201576.608952:0:107388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715470848:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201576.609001:0:107388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201576.609047:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715470848 00000100:00100000:0.0:1788201576.609051:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715470848 00000100:00100000:0.0:1788201576.609075:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788201576.609081:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11073ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+15:107388:x1875060715470848:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201576.609155:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11073ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+15:107388:x1875060715470848:12345-0@lo:502:mount.lustre.0 Request processed in 73us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201576.609162:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788201576.609199:0:107388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201576.609213:0:107388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715470848:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201576.609366:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].1, 224 off8416 00000040:00080000:0.0:1788201576.609389:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].2, 120 off8536 00000040:00080000:0.0:1788201576.609402:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].3, 168 off8704 00000040:00080000:0.0:1788201576.609414:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].4, 224 off8928 00000040:00080000:0.0:1788201576.609426:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].5, 224 off9152 00000040:00080000:0.0:1788201576.609439:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].6, 120 off9272 00000040:00080000:0.0:1788201576.609452:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].7, 168 off9440 00000040:00080000:0.0:1788201576.609464:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].8, 224 off9664 00000040:00080000:0.0:1788201576.609486:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].9, 224 off9888 00000040:00080000:0.0:1788201576.609498:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].10, 120 off10008 00000040:00080000:0.0:1788201576.609510:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].11, 224 off10232 00000040:00080000:0.0:1788201576.609522:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].12, 224 off10456 00000040:00080000:0.0:1788201576.609533:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].13, 88 off10544 00000040:00080000:0.0:1788201576.609545:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].14, 128 off10672 00000040:00080000:0.0:1788201576.609558:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].15, 144 off10816 00000040:00080000:0.0:1788201576.609572:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].16, 160 off10976 00000040:00080000:0.0:1788201576.609585:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].17, 224 off11200 00000040:00080000:0.0:1788201576.609597:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].18, 224 off11424 00000040:00080000:0.0:1788201576.609611:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].19, 80 off11504 00000040:00080000:0.0:1788201576.609627:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].20, 224 off11728 00000040:00080000:0.0:1788201576.609639:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].21, 224 off11952 00000040:00080000:0.0:1788201576.609653:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].22, 88 off12040 00000040:00080000:0.0:1788201576.609666:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].23, 128 off12168 00000040:00080000:0.0:1788201576.609679:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].24, 144 off12312 00000040:00080000:0.0:1788201576.609692:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].25, 160 off12472 00000040:00080000:0.0:1788201576.609704:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].26, 224 off12696 00000040:00080000:0.0:1788201576.609716:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].27, 224 off12920 00000040:00080000:0.0:1788201576.609730:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].28, 80 off13000 00000040:00080000:0.0:1788201576.609742:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].29, 224 off13224 00000040:00080000:0.0:1788201576.609755:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].30, 224 off13448 00000040:00080000:0.0:1788201576.609767:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].31, 88 off13536 00000040:00080000:0.0:1788201576.609779:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].32, 128 off13664 00000040:00080000:0.0:1788201576.609791:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].33, 144 off13808 00000040:00080000:0.0:1788201576.609803:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].34, 128 off13936 00000040:00080000:0.0:1788201576.609817:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].35, 224 off14160 00000040:00080000:0.0:1788201576.609829:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].36, 224 off14384 00000040:00080000:0.0:1788201576.609839:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].37, 80 off14464 00000040:00080000:0.0:1788201576.609849:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].38, 224 off14688 00000040:00080000:0.0:1788201576.609861:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].39, 224 off14912 00000040:00080000:0.0:1788201576.609874:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].40, 88 off15000 00000040:00080000:0.0:1788201576.609888:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].41, 128 off15128 00000040:00080000:0.0:1788201576.609914:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].42, 144 off15272 00000040:00080000:0.0:1788201576.609928:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].43, 128 off15400 00000040:00080000:0.0:1788201576.609940:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].44, 224 off15624 00000040:00080000:0.0:1788201576.609952:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].45, 224 off15848 00000040:00080000:0.0:1788201576.609962:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].46, 80 off15928 00000040:00080000:0.0:1788201576.609974:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].47, 224 off16152 00000040:00080000:0.0:1788201576.610004:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].48, 232 off16384 00000100:00100000:0.0:1788201576.610062:0:107388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715470976:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201576.610105:0:107388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201576.610138:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715470976 00000100:00100000:0.0:1788201576.610143:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715470976 00000100:00100000:0.0:1788201576.610169:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788201576.610176:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110739850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+15:107388:x1875060715470976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201576.610253:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110739850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+15:107388:x1875060715470976:12345-0@lo:502:mount.lustre.0 Request processed in 76us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201576.610260:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788201576.610302:0:107388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201576.610318:0:107388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715470976:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201576.610444:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].49, 224 off16608 00000040:00080000:0.0:1788201576.610465:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].50, 120 off16728 00000040:00080000:0.0:1788201576.610479:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].51, 224 off16952 00000040:00080000:0.0:1788201576.610493:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].52, 224 off17176 00000040:00080000:0.0:1788201576.610507:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].53, 112 off17288 00000040:00080000:0.0:1788201576.610520:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].54, 224 off17512 00000040:00080000:0.0:1788201576.610532:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].55, 224 off17736 00000040:00080000:0.0:1788201576.610545:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].56, 136 off17872 00000040:00080000:0.0:1788201576.610559:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].57, 224 off18096 00000040:00080000:0.0:1788201576.610571:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].58, 224 off18320 00000040:00080000:0.0:1788201576.610584:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].59, 136 off18456 00000040:00080000:0.0:1788201576.610609:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].60, 224 off18680 00000040:00080000:0.0:1788201576.610624:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].61, 224 off18904 00000040:00080000:0.0:1788201576.610637:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].62, 112 off19016 00000100:00100000:0.0:1788201576.610658:0:107388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715471104:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201576.610691:0:107388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201576.610715:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715471104 00000100:00100000:0.0:1788201576.610719:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715471104 00000100:00100000:0.0:1788201576.610741:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788201576.610747:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11073bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+15:107388:x1875060715471104:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201576.610809:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11073bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+15:107388:x1875060715471104:12345-0@lo:502:mount.lustre.0 Request processed in 61us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201576.610816:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788201576.610846:0:107388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201576.610859:0:107388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715471104:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788201576.610893:0:107388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x78:0x0].63, 224 off19240 00000040:00080000:0.0:1788201576.610900:0:107388:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 00000020:01000004:3.0:1788201576.619143:0:107469:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788201576.619160:0:107469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8dc12ef64d28) 00000020:00000080:3.0:1788201576.619187:0:107469:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1788201576.619273:0:107469:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc12f00a800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788201576.619277:0:107469:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc12f00a800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788201576.619280:0:107469:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc12f00a800 3 00010000:00080000:3.0:1788201576.619324:0:107469:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc1401c2000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.120@tcp at head 00010000:00010000:3.0:1788201576.625634:0:107469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-12 is initialized 00000020:00000080:3.0:1788201576.634696:0:107469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788201576.636097:0:107469:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788201576.636118:0:107469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x96d0c9b8c9a1f069 00000100:00080000:3.0:1788201576.636131:0:107469:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201576.636137:0:107469:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc1401c2000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201576.636174:0:107469:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004b39f80 x1875060715471232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201576.636213:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715471232:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201576.636281:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788201576.637451:0:107469:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788201576.637479:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201576.637485:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201576.637488:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201576.637491:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201576.637494:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201576.637497:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201576.637499:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201576.637502:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788201576.638505:0:107469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x78:0x0] index 64 count 63 00000100:00100000:0.0:1788201576.642883:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715471232 00000100:00100000:0.0:1788201576.642899:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715471232 00000100:00100000:0.0:1788201576.642962:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788201576.642971:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715471232:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788201576.643013:0:107403:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 4428 last 0 00000020:00000080:0.0:1788201576.643068:0:107403:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x96d0c9b8c9a1f070 00000004:00100000:0.0:1788201576.643087:0:107403:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788201576.643125:0:107403:0:(import.c:65:import_set_state_nolock()) ffff8dc139bc4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201576.643222:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875060715471232:12345-0@lo:38:llog_process_th.0 Request processed in 251us (6939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201576.643230:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000000:0.0:1788201576.643283:0:107388:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:0.0:1788201576.643323:0:107388:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201576.643340:0:107388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1f054 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f05b expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.643349:0:107388:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1f054 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f05b expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788201576.643395:0:107388:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788201576.643398:0:107388:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788201576.643399:0:107388:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201576.643400:0:107388:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201576.643402:0:107388:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201576.643403:0:107388:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201576.643404:0:107388:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201576.643406:0:107388:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201576.643407:0:107388:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788201576.643411:0:107388:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1788201576.643413:0:107388:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788201576.643414:0:107388:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788201576.643415:0:107388:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201576.643417:0:107388:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201576.643418:0:107388:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201576.643419:0:107388:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201576.643420:0:107388:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201576.643420:0:107388:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201576.643422:0:107388:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788201576.643441:0:107388:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788201576.643458:0:107388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715471360:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788201576.643503:0:107388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201576.643544:0:107388:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73180 going to sleep for 11 seconds 00010000:00080000:2.0:1788201576.643594:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8dc004b39f80 x1875060715471232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201576.643604:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788201576.643612:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 31 00000100:00080000:2.0:1788201576.643620:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788201576.643624:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788201576.643626:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788201576.643632:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715471232:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788201576.643691:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715471360 00000100:00100000:1.0:1788201576.643696:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715471360 00000100:00100000:1.0:1788201576.643738:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788201576.643762:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11073a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+15:107388:x1875060715471360:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788201576.643785:0:107396:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788201576.643798:0:107396:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788201576.649385:0:107396:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788201576.649404:0:107396:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788201576.649707:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11073a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+15:107388:x1875060715471360:12345-0@lo:253:mount.lustre.0 Request processed in 5944us (6198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.649720:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 20000000:01000000:0.0:1788201576.649807:0:107402:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788201576.649813:0:107402:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788201576.649834:0:107402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc0056d7000/0x96d0c9b8c9a1f077 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201576.649834:0:107388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:107388:1875060715471360:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788201576.649847:0:107388:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788201576.649851:0:107388:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788201576.649852:0:107388:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788201576.649854:0:107388:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788201576.649855:0:107388:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788201576.649857:0:107388:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788201576.649858:0:107388:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788201576.649859:0:107388:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788201576.649860:0:107388:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788201576.649862:0:107388:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:0.0:1788201576.649864:0:107402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc006dbde00/0x96d0c9b8c9a1f038 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f031 expref: 14 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.649871:0:107402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dc0056d7000/0x96d0c9b8c9a1f077 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:2.0:1788201576.649880:0:107388:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788201576.649904:0:107402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc006dbde00/0x96d0c9b8c9a1f038 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1f031 expref: 14 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.649919:0:107402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc006dbde00/0x96d0c9b8c9a1f038 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1f031 expref: 14 pid: 107396 timeout: 4528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201576.649932:0:107402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:107402:1875060715471488:0@lo:104: 00000100:00100000:0.0:1788201576.649968:0:107402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201576.650040:0:107402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125952480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201576.650406:0:95383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715471488 00000100:00100000:1.0:1788201576.650413:0:95383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715471488 00000100:00100000:1.0:1788201576.650449:0:95383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1788201576.650458:0:95383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007159180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c9b18af6-fecc-4172-82c2-66531890fe11+3:107402:x1875060715471488:12345-0@lo:104: 00010000:00010000:1.0:1788201576.650470:0:95383:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc006dbd600/0x96d0c9b8c9a1f031 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1f038 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.650528:0:95383:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201576.650534:0:95383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007159180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:c9b18af6-fecc-4172-82c2-66531890fe11+3:107402:x1875060715471488:12345-0@lo:104: Request processed in 78us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.650540:0:95383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00010000:00010000:1.0:1788201576.650562:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201576.650567:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc006dbd600/0x96d0c9b8c9a1f031 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1f038 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.650575:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd600 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201576.650579:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc006dbd600/0x96d0c9b8c9a1f031 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1f038 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.650588:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc006dbd600/0x96d0c9b8c9a1f031 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1f038 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201576.650610:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc006dbd600/0x96d0c9b8c9a1f031 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1f038 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201576.650616:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201576.650641:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc006dbd600/0x96d0c9b8c9a1f031 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1f038 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.650647:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201576.650663:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc006dbd600/0x96d0c9b8c9a1f031 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1f038 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.650669:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc006dbd600/0x96d0c9b8c9a1f031 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1f038 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.650685:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201576.650687:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201576.650689:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201576.650705:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715471616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201576.650732:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.650780:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715471616 00000100:00100000:1.0:1788201576.650784:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715471616 00010000:00010000:1.0:1788201576.650800:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc006dbde00/0x96d0c9b8c9a1f038 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1f031 expref: 15 pid: 107396 timeout: 4528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201576.650822:0:107402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:107402:1875060715471488:0@lo:104: 00000100:00100000:1.0:1788201576.650822:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2637 00000100:00100000:1.0:1788201576.650828:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9b18af6-fecc-4172-82c2-66531890fe11+15:3655:x1875060715471616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201576.650837:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201576.650840:0:107402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dc0056d7000/0x96d0c9b8c9a1f077 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.650841:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc006dbde00/0x96d0c9b8c9a1f038 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1f031 expref: 15 pid: 107396 timeout: 4528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.650857:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc006dbde00/0x96d0c9b8c9a1f038 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1f031 expref: 15 pid: 107396 timeout: 4528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.650869:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006dbde00/0x96d0c9b8c9a1f038 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1f031 expref: 15 pid: 107396 timeout: 4528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.650881:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dc0056d7000/0x96d0c9b8c9a1f077 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.650888:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0056d7000/0x96d0c9b8c9a1f077 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788201576.650901:0:6517:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001957934s 00010000:00010000:1.0:1788201576.650905:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc0056d7000/0x96d0c9b8c9a1f077 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.650911:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc0056d7000/0x96d0c9b8c9a1f077 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.650917:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc0056d7000/0x96d0c9b8c9a1f077 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.650922:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc0056d7000/0x96d0c9b8c9a1f077 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.650926:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201576.650930:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc0056d7000/0x96d0c9b8c9a1f077 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.650936:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc0056d7000/0x96d0c9b8c9a1f077 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.650963:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc0056d7000/0x96d0c9b8c9a1f077 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.650972:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201576.651029:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9b18af6-fecc-4172-82c2-66531890fe11+14:3655:x1875060715471616:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (281us total) trans 0 rc 0/0 00010000:00010000:0.0:1788201576.651033:0:107402:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dc0056d7000/0x96d0c9b8c9a1f077 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201576.651037:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2637 00010000:00010000:0.0:1788201576.651041:0:107402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc0056d7000/0x96d0c9b8c9a1f077 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.651047:0:107402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0056d7000/0x96d0c9b8c9a1f077 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201576.651065:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715471616:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788201576.658794:0:107388:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0001: committed batchid 77309411503 00000040:01000000:2.0:1788201576.659920:0:107388:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1788201576.660205:0:107476:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 77309411503 00000020:00080000:3.0:1788201576.660210:0:107476:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411503 00000040:01000000:3.0:1788201576.660288:0:107477:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788201576.661410:0:107388:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00080000:1.0:1788201576.664745:0:107478:0:(client.c:1430:ptlrpc_import_delay_req()) @@@ allow during recovery req@ffff8dc003a72d80 x1875060715471744/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201576.664767:0:107478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107478:1875060715471744:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788201576.664836:0:107478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.664873:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715471744 00000100:00100000:1.0:1788201576.664878:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715471744 00000100:00100000:1.0:1788201576.664917:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788201576.665000:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107478:x1875060715471744:12345-0@lo:1000:lod0001_rec0000.0 00010000:00080000:1.0:1788201576.665499:0:99775:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8dc003a72a00 x1875060715471744/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:697/0 lens 304/0 e 0 to 0 dl 1788201587 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201576.665568:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107478:x1875060715471744:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 644us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.665576:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:2.0:1788201576.665887:0:107477:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x2400013a0:0x3:0x0] first idx 15, last_idx 16 00000040:00080000:2.0:1788201576.666005:0:107477:0:(llog.c:805:llog_process_thread()) index: 16, lh_last_idx: 16 synced_idx: 16 lgh_last_idx: 16 00000040:00080000:2.0:1788201576.666010:0:107477:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x2400090a0:0x1:0x0] at index 16 of catalog [0x2400013a0:0x3:0x0] 00000040:00080000:2.0:1788201576.666232:0:107477:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x2400090a0:0x1:0x0] at index 16 of catalog [0x2400013a0:0x3:0x0] 00000040:00080000:2.0:1788201576.666248:0:107477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400013a0:0x3:0x0] index 16 count 1 00000004:00080000:2.0:1788201576.666304:0:107477:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:3.0:1788201576.666744:0:107388:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788201576.666794:0:107388:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788201576.668066:0:107388:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788201576.668077:0:107388:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788201576.668138:0:107388:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201576.668902:0:107478:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc00745dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201576.669044:0:107478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107478:1875060715471744:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1788201576.669088:0:107478:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00080000:1.0:1788201576.669133:0:107478:0:(client.c:1430:ptlrpc_import_delay_req()) @@@ allow during recovery req@ffff8dc003a72d80 x1875060715471872/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 336/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201576.669152:0:107478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107478:1875060715471872:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788201576.669218:0:107478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.669254:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715471872 00000100:00100000:1.0:1788201576.669260:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715471872 00000100:00100000:1.0:1788201576.669845:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788201576.669856:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107478:x1875060715471872:12345-0@lo:1000:lod0001_rec0000.0 00010000:00080000:1.0:1788201576.669874:0:99775:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8dc003a71500 x1875060715471872/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:697/0 lens 336/0 e 0 to 0 dl 1788201587 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201576.670168:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107478:x1875060715471872:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 314us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.670175:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788201576.670205:0:107478:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc10647e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201576.670224:0:107478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107478:1875060715471872:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788201576.670288:0:107478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:107478:1875060715472000:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788201576.671428:0:107478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.671460:0:107478:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105d39780 going to sleep for 11 seconds 00000040:00080000:3.0:1788201576.671850:0:107388:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1788201576.672866:0:107415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715472000 00000100:00100000:0.0:1788201576.672884:0:107415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715472000 00000100:00100000:0.0:1788201576.672932:0:107415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201576.672941:0:107415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:107478:x1875060715472000:12345-0@lo:900:lod0001_rec0000.0 00010000:00080000:0.0:1788201576.672956:0:107415:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8dc003a72680 x1875060715472000/t0(0) o900->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:697/0 lens 264/0 e 0 to 0 dl 1788201587 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201576.673048:0:107415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:107478:x1875060715472000:12345-0@lo:900:lod0001_rec0000.0 Request processed in 108us (1622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201576.673055:0:107415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:3.0:1788201576.673059:0:107388:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788201576.673097:0:107388:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788201576.673218:0:107388:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788201576.676528:0:107388:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x41:0x0] (8/32) registered 00010000:00080000:3.0:1788201576.678506:0:107388:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0001, 2 recoverable clients, last_transno 81604378640 00010000:00080000:1.0:1788201576.679304:0:107478:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8dc003a72d80 x1875060715472000/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788201592 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201576.679323:0:107478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:107478:1875060715472000:0@lo:900:lod0001_rec0000.0 00000100:00080000:1.0:1788201576.679400:0:107478:0:(client.c:1430:ptlrpc_import_delay_req()) @@@ allow during recovery req@ffff8dc003a72d80 x1875060715472128/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201576.679412:0:107478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107478:1875060715472128:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788201576.679472:0:107478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.679516:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715472128 00000100:00100000:1.0:1788201576.679523:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715472128 00000100:00100000:1.0:1788201576.679560:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788201576.679570:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107478:x1875060715472128:12345-0@lo:1000:lod0001_rec0000.0 00010000:00080000:1.0:1788201576.679585:0:99775:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8dc003a70380 x1875060715472128/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:697/0 lens 304/0 e 0 to 0 dl 1788201587 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201576.679646:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107478:x1875060715472128:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 77us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.679654:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788201576.679678:0:107478:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004bde540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201576.679692:0:107478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107478:1875060715472128:0@lo:1000:lod0001_rec0000.0 00000100:00080000:1.0:1788201576.679771:0:107478:0:(client.c:1430:ptlrpc_import_delay_req()) @@@ allow during recovery req@ffff8dc003a72d80 x1875060715472256/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 336/33016 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201576.679780:0:107478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107478:1875060715472256:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788201576.679835:0:107478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.679854:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715472256 00000100:00100000:1.0:1788201576.679857:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715472256 00000100:00100000:1.0:1788201576.679877:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788201576.679882:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107478:x1875060715472256:12345-0@lo:1000:lod0001_rec0000.0 00010000:00080000:1.0:1788201576.679891:0:99775:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8dc003a71c00 x1875060715472256/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:697/0 lens 336/0 e 0 to 0 dl 1788201587 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201576.680245:0:107478:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004bde540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201576.681834:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107478:x1875060715472256:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 1946us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.681847:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788201576.681900:0:107478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107478:1875060715472256:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788201576.682091:0:107478:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000bd1:0x3:0x0] first idx 30, last_idx 32 00000100:00080000:1.0:1788201576.682218:0:107478:0:(client.c:1430:ptlrpc_import_delay_req()) @@@ allow during recovery req@ffff8dc003a72d80 x1875060715472384/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 336/33016 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201576.682231:0:107478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107478:1875060715472384:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788201576.682367:0:107478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.682402:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715472384 00000100:00100000:1.0:1788201576.682409:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715472384 00000100:00100000:1.0:1788201576.682440:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788201576.682448:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107478:x1875060715472384:12345-0@lo:1000:lod0001_rec0000.0 00010000:00080000:1.0:1788201576.682464:0:99776:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8dc003a73480 x1875060715472384/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:697/0 lens 336/0 e 0 to 0 dl 1788201587 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201576.682577:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107478:x1875060715472384:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 129us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.682585:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788201576.682605:0:107478:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f730c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201576.682617:0:107478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107478:1875060715472384:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788201576.682657:0:107478:0:(llog.c:805:llog_process_thread()) index: 31, lh_last_idx: 32 synced_idx: 0 lgh_last_idx: 32 00000040:00080000:1.0:1788201576.682661:0:107478:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x20000e691:0x1:0x0] at index 31 of catalog [0x200000bd1:0x3:0x0] 00000100:00080000:1.0:1788201576.682707:0:107478:0:(client.c:1430:ptlrpc_import_delay_req()) @@@ allow during recovery req@ffff8dc003a72d80 x1875060715472512/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201576.682717:0:107478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107478:1875060715472512:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788201576.682742:0:107478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.685174:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715472512 00000100:00100000:1.0:1788201576.685188:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715472512 00000100:00100000:1.0:1788201576.685237:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788201576.685261:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107478:x1875060715472512:12345-0@lo:1000:lod0001_rec0000.0 00010000:00080000:1.0:1788201576.685281:0:99776:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8dc003a72300 x1875060715472512/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:697/0 lens 304/0 e 0 to 0 dl 1788201587 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201576.685946:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107478:x1875060715472512:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 685us (3201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.685955:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788201576.685997:0:107478:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f73180 going to sleep for 11 seconds 00000100:00100000:1.0:1788201576.686034:0:107478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107478:1875060715472512:0@lo:1000:lod0001_rec0000.0 00000100:00080000:1.0:1788201576.686130:0:107478:0:(client.c:1430:ptlrpc_import_delay_req()) @@@ allow during recovery req@ffff8dc003a72d80 x1875060715472640/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 336/33016 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201576.686142:0:107478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107478:1875060715472640:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788201576.686204:0:107478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.686226:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715472640 00000100:00100000:1.0:1788201576.686230:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715472640 00000100:00100000:1.0:1788201576.686253:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201576.686260:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107478:x1875060715472640:12345-0@lo:1000:lod0001_rec0000.0 00010000:00080000:1.0:1788201576.686270:0:99776:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8dc003a71180 x1875060715472640/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:697/0 lens 336/0 e 0 to 0 dl 1788201587 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201576.686448:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107478:x1875060715472640:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 188us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.686456:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788201576.686473:0:107478:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f730c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201576.686486:0:107478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107478:1875060715472640:0@lo:1000:lod0001_rec0000.0 00000100:00080000:1.0:1788201576.686560:0:107478:0:(client.c:1430:ptlrpc_import_delay_req()) @@@ allow during recovery req@ffff8dc003a72d80 x1875060715472768/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201576.686580:0:107478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a72d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107478:1875060715472768:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788201576.686607:0:107478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.686624:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715472768 00000100:00100000:1.0:1788201576.686628:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715472768 00000100:00100000:1.0:1788201576.686646:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201576.686652:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107478:x1875060715472768:12345-0@lo:1000:lod0001_rec0000.0 00010000:00080000:1.0:1788201576.686661:0:99776:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8dc10604bb80 x1875060715472768/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:697/0 lens 304/0 e 0 to 0 dl 1788201587 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201576.686700:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107478:x1875060715472768:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 48us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.686707:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201576.686722:0:107478:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f730c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201576.686733:0:107478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a72d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107478:1875060715472768:0@lo:1000:lod0001_rec0000.0 00000004:00080000:1.0:1788201576.688050:0:107478:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc00745dd80 with version 1 00000040:00080000:1.0:1788201576.688088:0:107478:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000bd1:0x3:0x0] first idx 31, last_idx 32 00000004:00080000:1.0:1788201576.688099:0:107478:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc105d39780 with version 2 00000040:00080000:1.0:1788201576.688103:0:107478:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x20000e691:0x1:0x0] at index 31 of catalog [0x200000bd1:0x3:0x0] 00000004:00080000:1.0:1788201576.690959:0:107452:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc13a875f00 version 1 rpc_version 1 00000020:00100000:1.0:1788201576.691028:0:107452:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788201576.691039:0:107452:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc106048e00 x1875060715473024/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201576.691062:0:107452:0:(client.c:1430:ptlrpc_import_delay_req()) @@@ allow during recovery req@ffff8dc106048e00 x1875060715473024/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201576.691073:0:107452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107452:1875060715473024:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1788201576.691161:0:107452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.691194:0:107452:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f730c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201576.691218:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715473024 00000100:00100000:1.0:1788201576.691225:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715473024 00000100:00100000:1.0:1788201576.691266:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788201576.691273:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107452:x1875060715473024:12345-0@lo:1000:osp_up0-1.0 00010000:00080000:1.0:1788201576.691287:0:99776:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8dc10604a300 x1875060715473024/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:697/0 lens 416/0 e 0 to 0 dl 1788201587 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201576.691672:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:107452:x1875060715473024:12345-0@lo:1000:osp_up0-1.0 Request processed in 397us (509us total) trans 128849018922 rc 0/0 00000100:00100000:1.0:1788201576.691680:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788201576.692706:0:107480:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0001: started recovery thread pid 107480 00010000:02000000:1.0:1788201576.692727:0:107480:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0001: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1788201576.692730:0:107480:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788201576.692734:0:107480:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1788201576.692874:0:107388:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788201576.692907:0:107388:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788201576.693002:0:107388:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000100:00100000:0.0:1788201576.693010:0:107452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107452:1875060715473024:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1788201576.693038:0:107452:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc13a875f00 version 2 rpc_version 2 00000020:00100000:0.0:1788201576.693059:0:107452:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788201576.693065:0:107452:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc00715ad80 x1875060715473280/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000080:00000004:2.0:1788201576.693079:0:107388:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000100:00080000:0.0:1788201576.693081:0:107452:0:(client.c:1430:ptlrpc_import_delay_req()) @@@ allow during recovery req@ffff8dc00715ad80 x1875060715473280/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201576.693090:0:107452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107452:1875060715473280:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788201576.693134:0:107452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201576.693167:0:107452:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125952480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201576.694086:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715473280 00000100:00100000:0.0:1788201576.694092:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715473280 00000100:00100000:0.0:1788201576.694134:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201576.694143:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:107452:x1875060715473280:12345-0@lo:1000:osp_up0-1.0 00010000:00080000:0.0:1788201576.694159:0:99776:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8dc00715a300 x1875060715473280/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:697/0 lens 744/0 e 0 to 0 dl 1788201587 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201576.694328:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:107452:x1875060715473280:12345-0@lo:1000:osp_up0-1.0 Request processed in 185us (1192us total) trans 128849018923 rc 0/0 00000100:00100000:0.0:1788201576.694346:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201576.694399:0:107452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107452:1875060715473280:0@lo:1000:osp_up0-1.0 00000100:00080000:0.0:1788201576.694442:0:107478:0:(client.c:1430:ptlrpc_import_delay_req()) @@@ allow during recovery req@ffff8dc007158000 x1875060715473408/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 336/33016 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201576.694452:0:107478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107478:1875060715473408:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788201576.694511:0:107478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201576.694530:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715473408 00000100:00100000:0.0:1788201576.694534:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715473408 00000100:00100000:0.0:1788201576.694553:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201576.694558:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:107478:x1875060715473408:12345-0@lo:1000:lod0001_rec0000.0 00010000:00080000:0.0:1788201576.694566:0:99776:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8dc007159f80 x1875060715473408/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:697/0 lens 336/0 e 0 to 0 dl 1788201587 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201576.694684:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:107478:x1875060715473408:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 126us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201576.694691:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201576.694710:0:107478:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125952840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201576.694724:0:107478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107478:1875060715473408:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788201576.694912:0:107478:0:(llog.c:805:llog_process_thread()) index: 32, lh_last_idx: 32 synced_idx: 32 lgh_last_idx: 32 00000040:00080000:0.0:1788201576.694918:0:107478:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x20000e691:0x2:0x0] at index 32 of catalog [0x200000bd1:0x3:0x0] 00000100:00080000:0.0:1788201576.694969:0:107478:0:(client.c:1430:ptlrpc_import_delay_req()) @@@ allow during recovery req@ffff8dc007158000 x1875060715473536/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201576.694979:0:107478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107478:1875060715473536:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788201576.695039:0:107478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201576.695065:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715473536 00000100:00100000:0.0:1788201576.695069:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715473536 00000100:00100000:0.0:1788201576.695090:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788201576.695096:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:107478:x1875060715473536:12345-0@lo:1000:lod0001_rec0000.0 00010000:00080000:0.0:1788201576.695104:0:99776:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8dc007159c00 x1875060715473536/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:697/0 lens 304/0 e 0 to 0 dl 1788201587 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201576.695148:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:107478:x1875060715473536:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 52us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201576.695155:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788201576.695170:0:107478:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f730c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201576.695182:0:107478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:107478:1875060715473536:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788201576.695217:0:107478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788201576.695251:0:107478:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc125952480 with version 3 00000004:00080000:0.0:1788201576.695262:0:107452:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc13a875f00 version 3 rpc_version 3 00000020:00100000:0.0:1788201576.695274:0:107452:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788201576.695280:0:107452:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc007158000 x1875060715473792/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201576.695292:0:107452:0:(client.c:1430:ptlrpc_import_delay_req()) @@@ allow during recovery req@ffff8dc007158000 x1875060715473792/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201576.695300:0:107452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107452:1875060715473792:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788201576.695327:0:107452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201576.695340:0:107452:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13aa353c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201576.695351:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715473792 00000100:00100000:0.0:1788201576.695354:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715473792 00000100:00100000:0.0:1788201576.695374:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788201576.695380:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:107452:x1875060715473792:12345-0@lo:1000:osp_up0-1.0 00010000:00080000:0.0:1788201576.695388:0:99776:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8dc00715b100 x1875060715473792/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:697/0 lens 416/0 e 0 to 0 dl 1788201587 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201576.695538:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:107452:x1875060715473792:12345-0@lo:1000:osp_up0-1.0 Request processed in 157us (210us total) trans 128849018924 rc 0/0 00000100:00100000:0.0:1788201576.695545:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788201576.695575:0:107452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107452:1875060715473792:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1788201576.695612:0:107478:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc10647e900 with version 4 00000040:00080000:0.0:1788201576.695619:0:107478:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x20000e691:0x2:0x0] at index 32 of catalog [0x200000bd1:0x3:0x0] 00000040:00080000:0.0:1788201576.695637:0:107478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000bd1:0x3:0x0] index 32 count 1 00000004:00080000:0.0:1788201576.695692:0:107478:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788201576.695695:0:107478:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000004:00080000:0.0:1788201576.695730:0:107452:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc13a875f00 version 4 rpc_version 4 00000020:00100000:0.0:1788201576.696888:0:107452:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788201576.696897:0:107452:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc11cd18700 x1875060715474048/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201576.696913:0:107452:0:(client.c:1430:ptlrpc_import_delay_req()) @@@ allow during recovery req@ffff8dc11cd18700 x1875060715474048/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201576.696923:0:107452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd18700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107452:1875060715474048:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788201576.696969:0:107452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201576.697004:0:107452:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f730c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201576.697039:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715474048 00000100:00100000:0.0:1788201576.697046:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715474048 00000100:00100000:0.0:1788201576.697079:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788201576.697087:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:107452:x1875060715474048:12345-0@lo:1000:osp_up0-1.0 00010000:00080000:0.0:1788201576.697100:0:99776:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8dc11cd1ad80 x1875060715474048/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:697/0 lens 744/0 e 0 to 0 dl 1788201587 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201576.697221:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:107452:x1875060715474048:12345-0@lo:1000:osp_up0-1.0 Request processed in 134us (251us total) trans 128849018925 rc 0/0 00000100:00100000:0.0:1788201576.697235:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788201576.697279:0:107452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd18700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107452:1875060715474048:0@lo:1000:osp_up0-1.0 00000020:00000004:2.0:1788201576.697519:0:107388:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788201576.698851:0:107388:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:0.0:1788201576.701100:0:107480:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:0.0:1788201576.783136:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788201576.969383:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788201576.969390:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc12f00a800 from 140 10000000:01000000:1.0:1788201576.969395:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788201576.969438:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2800/0x96d0c9b8c9a1f07e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.969450:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2800/0x96d0c9b8c9a1f07e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.969462:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2800/0x96d0c9b8c9a1f07e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201576.969488:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715474176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201576.969562:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.969602:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004bde540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201576.969634:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715474176 00000100:00100000:1.0:1788201576.969640:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715474176 00000100:00100000:1.0:1788201576.969687:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788201576.969696:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715474176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201576.969709:0:107397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201576.969721:0:107397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc12e6e3600/0x96d0c9b8c9a1f085 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f07e expref: -99 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.969744:0:107397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc12e6e3600/0x96d0c9b8c9a1f085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f07e expref: 15 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.969754:0:107397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc12e6e3600/0x96d0c9b8c9a1f085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f07e expref: 15 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.969762:0:107397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e3600, rc 0) 00000100:00100000:1.0:1788201576.969796:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715474176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.969803:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788201576.969853:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715474176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201576.969868:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2800/0x96d0c9b8c9a1f07e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f085 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.969877:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2800/0x96d0c9b8c9a1f07e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f085 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201576.969922:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715474304:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788201576.969958:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.969972:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004bde540 going to sleep for 11 seconds 00000100:00100000:1.0:1788201576.970000:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715474304 00000100:00100000:1.0:1788201576.970004:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715474304 00000100:00100000:1.0:1788201576.970042:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788201576.970050:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11073b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715474304:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788201576.970062:0:107396:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788201576.970078:0:107396:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788201576.970082:0:107396:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 140 00000100:00100000:1.0:1788201576.970152:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11073b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715474304:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 102us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.970159:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788201576.970187:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715474304:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788201576.970225:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788201576.970232:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2800/0x96d0c9b8c9a1f07e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f085 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.970241:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2800/0x96d0c9b8c9a1f07e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f085 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201576.970250:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788201576.970252:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc0053a5000 from 139 10000000:01000000:1.0:1788201576.970254:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788201576.970269:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3400/0x96d0c9b8c9a1f08c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.970276:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3400/0x96d0c9b8c9a1f08c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.970293:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3400/0x96d0c9b8c9a1f08c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201576.970306:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715474432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201576.970329:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.970342:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13aa35480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201576.970354:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715474432 00000100:00100000:1.0:1788201576.970357:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715474432 00000100:00100000:1.0:1788201576.970379:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788201576.970385:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11073b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715474432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201576.970392:0:107398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201576.970401:0:107398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc12e6e3200/0x96d0c9b8c9a1f093 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f08c expref: -99 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.970414:0:107398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc12e6e3200/0x96d0c9b8c9a1f093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f08c expref: 16 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.970423:0:107398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc12e6e3200/0x96d0c9b8c9a1f093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f08c expref: 16 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.970430:0:107398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e3200, rc 0) 00000100:00100000:1.0:1788201576.970456:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11073b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715474432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 71us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.970462:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788201576.970489:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715474432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201576.970498:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3400/0x96d0c9b8c9a1f08c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f093 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.970511:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3400/0x96d0c9b8c9a1f08c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f093 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201576.970544:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715474560:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788201576.970569:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.970581:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13aa35480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201576.970591:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715474560 00000100:00100000:1.0:1788201576.970594:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715474560 00000100:00100000:1.0:1788201576.970613:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788201576.970618:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11073b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715474560:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788201576.970627:0:107397:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788201576.970637:0:107397:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788201576.970641:0:107397:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1788201576.970643:0:107397:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 140 00000100:00100000:1.0:1788201576.970696:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11073b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715474560:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 77us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.970703:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788201576.970729:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715474560:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788201576.970763:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788201576.970769:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3400/0x96d0c9b8c9a1f08c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f093 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.970776:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3400/0x96d0c9b8c9a1f08c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f093 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201576.970783:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788201576.970789:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc13aa9f000 from 64 10000000:01000000:1.0:1788201576.970792:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788201576.970805:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1f09a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.970812:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1f09a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.970819:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1f09a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201576.970830:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715474688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201576.970854:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.970866:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13aa35480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201576.970876:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715474688 00000100:00100000:1.0:1788201576.970879:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715474688 00000100:00100000:1.0:1788201576.970898:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788201576.970904:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11073a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715474688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201576.970910:0:107396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201576.970918:0:107396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc12e6e2000/0x96d0c9b8c9a1f0a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f09a expref: -99 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.970931:0:107396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc12e6e2000/0x96d0c9b8c9a1f0a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f09a expref: 17 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.970940:0:107396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc12e6e2000/0x96d0c9b8c9a1f0a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f09a expref: 17 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.970947:0:107396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e2000, rc 0) 00000100:00100000:1.0:1788201576.970972:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11073a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715474688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 68us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201576.974807:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788201576.974893:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715474688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201576.974917:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1f09a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f0a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201576.974929:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1f09a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f0a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201576.975044:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715474816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201576.975096:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.975137:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13aa35480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201576.977222:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715474816 00000100:00100000:0.0:1788201576.977235:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715474816 00000100:00100000:0.0:1788201576.977287:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788201576.977298:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715474816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201576.977466:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715474816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (2368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201576.977474:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788201576.980664:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715474816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201576.980719:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715474944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201576.980790:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201576.980839:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13aa35480 going to sleep for 11 seconds 00000100:00100000:0.0:1788201576.986088:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715474944 00000100:00100000:0.0:1788201576.986104:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715474944 00000100:00100000:0.0:1788201576.986170:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788201576.986181:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715474944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201576.986350:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715474944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (5559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201576.986358:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201576.988054:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715474944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201576.991933:0:107497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:3.0:1788201576.992709:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:3.0:1788201576.992734:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201576.992745:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1f09a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f0a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201576.992757:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1f09a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f0a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201576.992767:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788201576.992770:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1788201576.992773:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788201576.992809:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2600/0x96d0c9b8c9a1f0a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201576.992818:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2600/0x96d0c9b8c9a1f0a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201576.992829:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2600/0x96d0c9b8c9a1f0a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201576.992853:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715475072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201576.992912:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201576.996469:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fb11180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201576.996781:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715475072 00000100:00100000:0.0:1788201576.996791:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715475072 00000100:00100000:0.0:1788201576.996842:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788201576.996852:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715475072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201576.996868:0:107396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201576.996886:0:107396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0056d7600/0x96d0c9b8c9a1f0af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f0a8 expref: -99 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.996921:0:107396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0056d7600/0x96d0c9b8c9a1f0af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f0a8 expref: 18 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.996932:0:107396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0056d7600/0x96d0c9b8c9a1f0af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f0a8 expref: 18 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201576.996942:0:107396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d7600, rc 0) 00000100:00100000:0.0:1788201576.997088:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715475072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 237us (4175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201576.997096:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788201577.001258:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715475072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201577.001289:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2600/0x96d0c9b8c9a1f0a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f0af expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.001302:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2600/0x96d0c9b8c9a1f0a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f0af expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201577.001392:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715475200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201577.001448:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201577.001498:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fb11180 going to sleep for 11 seconds 00000100:00100000:0.0:1788201577.001673:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715475200 00000100:00100000:0.0:1788201577.001680:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715475200 00000100:00100000:0.0:1788201577.001721:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788201577.001730:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715475200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201577.001890:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715475200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201577.001898:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788201577.005219:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715475200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201577.005284:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715475328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201577.005354:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201577.005400:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fb11180 going to sleep for 11 seconds 00000100:00100000:3.0:1788201577.005422:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715475328 00000100:00100000:3.0:1788201577.005427:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715475328 00000100:00100000:3.0:1788201577.005472:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788201577.005480:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715475328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201577.016801:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715475328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 11261us (11386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201577.016815:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788201577.016894:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715475328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788201577.017629:0:107499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1788201577.017686:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1788201577.017709:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788201577.017731:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2600/0x96d0c9b8c9a1f0a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f0af expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.023955:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2600/0x96d0c9b8c9a1f0a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f0af expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201577.023989:0:6529:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788201577.023992:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc13aa9f000 from 7 10000000:01000000:3.0:1788201577.023996:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201577.024048:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1f0b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.024058:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1f0b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.024070:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1f0b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201577.024094:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715475456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201577.024152:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201577.024195:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fb116c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201577.024868:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715475456 00000100:00100000:0.0:1788201577.024877:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715475456 00000100:00100000:0.0:1788201577.025477:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788201577.025489:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715475456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201577.025504:0:107396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201577.025519:0:107396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0056d7000/0x96d0c9b8c9a1f0bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f0b6 expref: -99 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201577.025544:0:107396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0056d7000/0x96d0c9b8c9a1f0bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f0b6 expref: 19 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201577.025565:0:107396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0056d7000/0x96d0c9b8c9a1f0bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f0b6 expref: 19 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201577.025574:0:107396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d7000, rc 0) 00000100:00100000:0.0:1788201577.025638:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715475456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201577.025645:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788201577.025719:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715475456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201577.025737:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1f0b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f0bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201577.025757:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1f0b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f0bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201577.025822:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715475584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201577.025851:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201577.032245:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004e40240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201577.035849:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715475584 00000100:00100000:3.0:1788201577.035863:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715475584 00000100:00100000:3.0:1788201577.036523:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788201577.036534:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715475584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201577.036703:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715475584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (10851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201577.036711:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788201577.037274:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715475584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201577.037326:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715475712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201577.037384:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201577.037429:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004e40240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201577.040998:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715475712 00000100:00100000:3.0:1788201577.041452:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715475712 00000100:00100000:3.0:1788201577.041507:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788201577.041517:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715475712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201577.041683:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715475712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (4298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201577.041690:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788201577.041819:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715475712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788201577.045517:0:107501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788201577.045580:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788201577.045602:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201577.045617:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1f0b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f0bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.045631:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1f0b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f0bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201577.045642:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788201577.045644:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc12b6bc800 from 64 10000000:01000000:3.0:1788201577.045648:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201577.045693:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2800/0x96d0c9b8c9a1f0c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.045702:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2800/0x96d0c9b8c9a1f0c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.045714:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2800/0x96d0c9b8c9a1f0c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201577.046617:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715475840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201577.046693:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201577.049145:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fb11c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201577.051928:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715475840 00000100:00100000:0.0:1788201577.051942:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715475840 00000100:00100000:0.0:1788201577.052638:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788201577.052651:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715475840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201577.052669:0:107397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201577.052687:0:107397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0056d6600/0x96d0c9b8c9a1f0cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f0c4 expref: -99 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201577.052713:0:107397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0056d6600/0x96d0c9b8c9a1f0cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f0c4 expref: 20 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201577.052724:0:107397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0056d6600/0x96d0c9b8c9a1f0cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f0c4 expref: 20 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201577.052733:0:107397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d6600, rc 0) 00000100:00100000:0.0:1788201577.052808:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715475840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (6115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201577.052816:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788201577.052913:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715475840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201577.052932:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2800/0x96d0c9b8c9a1f0c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f0cb expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.052942:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2800/0x96d0c9b8c9a1f0c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f0cb expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201577.053043:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715475968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201577.053073:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201577.053100:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fb11c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201577.053113:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715475968 00000100:00100000:3.0:1788201577.053117:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715475968 00000100:00100000:3.0:1788201577.053138:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788201577.053143:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715475968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201577.053242:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715475968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201577.053248:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788201577.053273:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715475968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201577.053296:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715476096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201577.053339:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201577.053353:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fb11c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201577.053363:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715476096 00000100:00100000:3.0:1788201577.053366:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715476096 00000100:00100000:3.0:1788201577.053387:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788201577.053402:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715476096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201577.053484:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715476096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201577.053491:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788201577.053527:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715476096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788201577.054222:0:107503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:3.0:1788201577.054273:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:3.0:1788201577.054290:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201577.054298:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2800/0x96d0c9b8c9a1f0c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f0cb expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.054307:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2800/0x96d0c9b8c9a1f0c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f0cb expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201577.054314:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788201577.054317:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1788201577.054320:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788201577.054342:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3800/0x96d0c9b8c9a1f0d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.054350:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3800/0x96d0c9b8c9a1f0d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.054359:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3800/0x96d0c9b8c9a1f0d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201577.054373:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715476224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201577.054406:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201577.054432:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fb11cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201577.054448:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715476224 00000100:00100000:3.0:1788201577.054452:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715476224 00000100:00100000:3.0:1788201577.054474:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788201577.054481:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715476224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201577.054490:0:107396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201577.054499:0:107396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc125ae2a00/0x96d0c9b8c9a1f0d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f0d2 expref: -99 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.054516:0:107396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc125ae2a00/0x96d0c9b8c9a1f0d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f0d2 expref: 21 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.054526:0:107396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc125ae2a00/0x96d0c9b8c9a1f0d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f0d2 expref: 21 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.054535:0:107396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2a00, rc 0) 00000100:00100000:3.0:1788201577.054562:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715476224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201577.054568:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788201577.054601:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715476224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201577.054613:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3800/0x96d0c9b8c9a1f0d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f0d9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.054622:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3800/0x96d0c9b8c9a1f0d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f0d9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201577.054659:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715476352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201577.054683:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201577.054701:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fb11cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201577.054712:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715476352 00000100:00100000:3.0:1788201577.054715:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715476352 00000100:00100000:3.0:1788201577.054735:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788201577.054741:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715476352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201577.054834:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715476352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201577.054841:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788201577.054869:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715476352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201577.054892:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715476480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201577.054925:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201577.054937:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fb11cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201577.054948:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715476480 00000100:00100000:3.0:1788201577.054951:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715476480 00000100:00100000:3.0:1788201577.054970:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788201577.054976:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715476480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201577.056617:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715476480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1635us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201577.056629:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788201577.056716:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715476480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788201577.059249:0:107504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1788201577.059346:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1788201577.059369:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788201577.059380:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3800/0x96d0c9b8c9a1f0d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f0d9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.059393:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3800/0x96d0c9b8c9a1f0d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f0d9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201577.059403:0:6529:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788201577.059415:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc12b6bc800 from 7 10000000:01000000:3.0:1788201577.059418:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201577.059518:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2e00/0x96d0c9b8c9a1f0e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.059527:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2e00/0x96d0c9b8c9a1f0e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.059538:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2e00/0x96d0c9b8c9a1f0e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201577.059562:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715476608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201577.059625:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201577.059666:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fb11480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201577.059688:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715476608 00000100:00100000:3.0:1788201577.059695:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715476608 00000100:00100000:3.0:1788201577.059747:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788201577.059756:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715476608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201577.059769:0:107398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201577.059781:0:107398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc125ae2000/0x96d0c9b8c9a1f0e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f0e0 expref: -99 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.059804:0:107398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc125ae2000/0x96d0c9b8c9a1f0e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f0e0 expref: 22 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.059814:0:107398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc125ae2000/0x96d0c9b8c9a1f0e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f0e0 expref: 22 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.059823:0:107398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2000, rc 0) 00000100:00100000:3.0:1788201577.059858:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715476608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201577.059872:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788201577.059916:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715476608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201577.059931:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2e00/0x96d0c9b8c9a1f0e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f0e7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201577.059941:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2e00/0x96d0c9b8c9a1f0e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f0e7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201577.060000:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715476736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201577.060046:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201577.060062:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fb11480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201577.060074:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715476736 00000100:00100000:3.0:1788201577.060077:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715476736 00000100:00100000:3.0:1788201577.060099:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788201577.060105:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715476736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201577.060199:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715476736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201577.060206:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788201577.060233:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715476736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201577.060259:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715476864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201577.060296:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201577.060309:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fb11480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201577.060320:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715476864 00000100:00100000:3.0:1788201577.060323:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715476864 00000100:00100000:3.0:1788201577.060342:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788201577.060355:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715476864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201577.060424:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715476864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201577.060431:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788201577.063255:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715476864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201577.066381:0:107505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788201577.066519:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788201577.066548:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201577.066561:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2e00/0x96d0c9b8c9a1f0e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f0e7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201577.066574:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2e00/0x96d0c9b8c9a1f0e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f0e7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201577.066584:0:6529:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788201577.066598:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8dc12563cd28 from 1 10000000:01000000:1.0:1788201577.066601:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788201577.066639:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1f0ee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201577.066648:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1f0ee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201577.066659:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1f0ee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201577.066684:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715476992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201577.066748:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201577.066789:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13aa35240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201577.066813:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715476992 00000100:00100000:1.0:1788201577.066819:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715476992 00000100:00100000:1.0:1788201577.066861:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788201577.066872:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715476992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201577.066884:0:107397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201577.066897:0:107397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064ed400/0x96d0c9b8c9a1f0f5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f0ee expref: -99 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201577.066919:0:107397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ed400/0x96d0c9b8c9a1f0f5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f0ee expref: 23 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201577.066929:0:107397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064ed400/0x96d0c9b8c9a1f0f5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f0ee expref: 23 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201577.066939:0:107397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ed400, rc 0) 00000100:00100000:1.0:1788201577.066974:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715476992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201577.067000:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788201577.067074:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715476992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201577.067088:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1f0ee lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f0f5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201577.067097:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1f0ee lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f0f5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201577.067114:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788201577.067118:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1f0ee lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f0f5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201577.067126:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1f0ee lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f0f5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201577.067133:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788201577.067134:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dc12563cd28 from 1 10000000:01000000:1.0:1788201577.067137:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788201577.067149:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064edc00/0x96d0c9b8c9a1f0fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201577.067157:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064edc00/0x96d0c9b8c9a1f0fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201577.067164:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064edc00/0x96d0c9b8c9a1f0fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201577.067175:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715477120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201577.067207:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201577.067226:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13aa35240 going to sleep for 11 seconds 00000100:00100000:1.0:1788201577.067239:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715477120 00000100:00100000:1.0:1788201577.067242:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715477120 00000100:00100000:1.0:1788201577.067264:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788201577.067270:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715477120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201577.067277:0:107398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201577.067284:0:107398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064eda00/0x96d0c9b8c9a1f103 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f0fc expref: -99 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201577.067297:0:107398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064eda00/0x96d0c9b8c9a1f103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f0fc expref: 24 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201577.067304:0:107398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064eda00/0x96d0c9b8c9a1f103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f0fc expref: 24 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201577.067310:0:107398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064eda00, rc 0) 00000100:00100000:1.0:1788201577.067336:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715477120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 66us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201577.067342:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788201577.067372:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715477120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201577.067382:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064edc00/0x96d0c9b8c9a1f0fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f103 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201577.067390:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064edc00/0x96d0c9b8c9a1f0fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f103 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201577.067433:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715477248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201577.067921:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201577.067973:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13aa35240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201577.075198:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715477248 00000100:00100000:2.0:1788201577.075215:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715477248 00000100:00100000:2.0:1788201577.078152:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788201577.078166:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715477248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201577.078323:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715477248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (10390us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788201577.078331:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788201577.078634:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715477248:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788201577.078678:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788201577.078688:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064edc00/0x96d0c9b8c9a1f0fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f103 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201577.078700:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064edc00/0x96d0c9b8c9a1f0fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f103 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201577.232350:0:107440:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a49b000 going to sleep for 0 seconds 00010000:00010000:2.0:1788201577.817675:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201577.941555:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201577.946728:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695578112 00000100:00100000:1.0:1788201577.946744:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695578112 00000100:00100000:1.0:1788201577.946824:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 75 00000100:00100000:1.0:1788201577.946836:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+5:71021:x1875060695578112:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201577.946853:0:107397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201577.946871:0:107397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064ede00/0x96d0c9b8c9a1f10a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ff0 expref: -99 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201577.946901:0:107397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ede00/0x96d0c9b8c9a1f10a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ff0 expref: 6 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201577.946912:0:107397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064ede00/0x96d0c9b8c9a1f10a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ff0 expref: 6 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201577.946922:0:107397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ede00, rc 0) 00000100:00100000:1.0:1788201577.946993:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+6:71021:x1875060695578112:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 159us (5447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201577.947043:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 75 00000100:00100000:1.0:1788201577.949409:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201577.956519:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695578240 00000100:00100000:2.0:1788201577.956536:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695578240 00000100:00100000:2.0:1788201577.956597:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 76 00000100:00100000:2.0:1788201577.956609:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+6:71021:x1875060695578240:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788201577.956635:0:107398:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1788201577.956662:0:107398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788201577.956667:0:107398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1788201577.956670:0:107398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1788201577.956673:0:107398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1788201577.956675:0:107398:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 140 00000100:00100000:2.0:1788201577.958569:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+6:71021:x1875060695578240:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 Request processed in 1953us (9161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201577.958583:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 76 00000100:00100000:2.0:1788201577.967886:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201577.967993:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695578368 00000100:00100000:1.0:1788201577.968004:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695578368 00000100:00100000:1.0:1788201577.968081:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 77 00000100:00100000:1.0:1788201577.968093:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+6:71021:x1875060695578368:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201577.968111:0:107396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201577.968130:0:107396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064ec600/0x96d0c9b8c9a1f111 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ff7 expref: -99 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201577.968160:0:107396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ec600/0x96d0c9b8c9a1f111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ff7 expref: 7 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201577.968171:0:107396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064ec600/0x96d0c9b8c9a1f111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ff7 expref: 7 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201577.968180:0:107396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ec600, rc 0) 00000100:00100000:1.0:1788201577.968251:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+7:71021:x1875060695578368:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 161us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201577.968259:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 77 00000100:00100000:0.0:1788201577.992145:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201577.992181:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695578496 00000100:00100000:0.0:1788201577.992199:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695578496 00000100:00100000:0.0:1788201577.992264:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 78 00000100:00100000:0.0:1788201577.992274:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+7:71021:x1875060695578496:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201577.992422:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71021:x1875060695578496:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 149us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201577.992430:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 78 00000100:00100000:0.0:1788201578.000388:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201578.000584:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695578624 00000100:00100000:2.0:1788201578.000595:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695578624 00000100:00100000:2.0:1788201578.000657:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 79 00000100:00100000:2.0:1788201578.000667:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71021:x1875060695578624:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201578.000808:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71021:x1875060695578624:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 143us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201578.000817:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 79 00000100:00100000:0.0:1788201578.034266:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201578.034304:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695578752 00000100:00100000:0.0:1788201578.034314:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695578752 00000100:00100000:0.0:1788201578.034362:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:0.0:1788201578.034371:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71021:x1875060695578752:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201578.034386:0:107396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201578.034403:0:107396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0056d6e00/0x96d0c9b8c9a1f118 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786ffe expref: -99 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201578.034433:0:107396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0056d6e00/0x96d0c9b8c9a1f118 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ffe expref: 9 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201578.034445:0:107396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0056d6e00/0x96d0c9b8c9a1f118 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ffe expref: 9 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201578.034455:0:107396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d6e00, rc 0) 00000100:00100000:0.0:1788201578.034501:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695578752:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 131us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201578.034509:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:2.0:1788201578.044917:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201578.045040:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695578880 00000100:00100000:0.0:1788201578.045058:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695578880 00000100:00100000:0.0:1788201578.045115:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 81 00000100:00100000:0.0:1788201578.045126:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695578880:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201578.045270:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695578880:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 145us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201578.045279:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 81 00000100:00100000:0.0:1788201578.050105:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201578.050212:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695579008 00000100:00100000:3.0:1788201578.050223:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695579008 00000100:00100000:3.0:1788201578.050270:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 82 00000100:00100000:3.0:1788201578.050280:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695579008:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201578.050414:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695579008:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 135us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201578.050422:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 82 00000100:00100000:0.0:1788201578.058512:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201578.061900:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695579136 00000100:00100000:3.0:1788201578.061915:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695579136 00000100:00100000:3.0:1788201578.062062:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 83 00000100:00100000:3.0:1788201578.062073:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695579136:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201578.062091:0:107396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201578.062108:0:107396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc125ae2400/0x96d0c9b8c9a1f11f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f787005 expref: -99 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201578.062137:0:107396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc125ae2400/0x96d0c9b8c9a1f11f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787005 expref: 10 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201578.062147:0:107396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc125ae2400/0x96d0c9b8c9a1f11f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787005 expref: 10 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201578.062173:0:107396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc125ae2400, rc 0) 00000100:00100000:3.0:1788201578.065742:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695579136:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 3649us (7219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201578.065755:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 83 00000100:00100000:2.0:1788201578.077175:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201578.079126:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695579264 00000100:00100000:1.0:1788201578.079140:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695579264 00000100:00100000:1.0:1788201578.079227:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 84 00000100:00100000:1.0:1788201578.079239:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695579264:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201578.079359:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695579264:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 122us (2194us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201578.079380:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 84 00000100:00100000:1.0:1788201578.256089:0:107440:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a49b000 going to sleep for 0 seconds 00010000:00010000:1.0:1788201578.834720:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201579.283806:0:107440:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a49b000 going to sleep for 0 seconds 00010000:00010000:0.0:1788201579.855825:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201580.305208:0:107440:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a49b000 going to sleep for 0 seconds 00000100:00000400:2.0:1788201580.624087:0:3658:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201564/real 1788201564] req@ffff8dc10604aa00 x1875060715461248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201580 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201580.624121:0:3658:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8dc10604aa00 x1875060715461248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201580 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201580.624130:0:3658:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff8dc1401c3800 already not connected (conn 11, was 9): CONNECTING 00000100:00100000:2.0:1788201580.624816:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715461248:0@lo:400:kworker.0 00000100:00000400:0.0:1788201580.687613:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201564/real 1788201564] req@ffff8dc106048000 x1875060715460992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201580 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201580.687644:0:3657:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8dc106048000 x1875060715460992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201580 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201580.687654:0:3657:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff8dc11ccfb000 already not connected (conn 11, was 9): CONNECTING 00000100:00100000:0.0:1788201580.687672:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715460992:0@lo:400:kworker.0 00000100:00080000:3.0:1788201580.692874:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201580.692880:0:41592:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201580.692883:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201580.692886:0:41592:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201580.692889:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201580.692892:0:41592:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201580.692895:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201580.692897:0:41592:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201580.692899:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788201580.692903:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788201580.692906:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc005d73000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201580.692930:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8dc005d73000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201580.692953:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004b3b800 x1875060715477504/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201580.693003:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level REPLAY_WAIT/7 force 0 force_next 1 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201580.693006:0:41592:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:0.0:1788201580.693042:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715477376:0@lo:400:kworker.0 00000100:00100000:3.0:1788201580.693082:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715477888:0@lo:400:kworker.0 00000100:00100000:0.0:1788201580.693115:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201580.693522:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715477760:0@lo:400:kworker.0 00000100:00100000:3.0:1788201580.693574:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201580.693619:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715477504:0@lo:38:kworker.0 00000100:00100000:3.0:1788201580.693645:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201580.693676:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715477376 00000100:00100000:3.0:1788201580.693684:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715477376 00000100:00100000:3.0:1788201580.693727:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788201580.693737:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715477376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201580.693793:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715477376:12345-0@lo:400:kworker.0 Request processed in 58us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201580.693801:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788201580.693810:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715477376:0@lo:400:kworker.0 00000100:00100000:0.0:1788201580.693817:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715478016:0@lo:400:kworker.0 00000100:00100000:3.0:1788201580.693833:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715477888 00000100:00100000:3.0:1788201580.693837:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715477888 00000100:00100000:0.0:1788201580.693844:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201580.693860:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201580.693866:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715477888:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788201580.693878:0:107404:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8dc004b39f80 x1875060715477888/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:701/0 lens 224/0 e 0 to 0 dl 1788201591 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201580.693882:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715477632:0@lo:400:kworker.0 00000100:00100000:3.0:1788201580.693914:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715477888:12345-0@lo:400:kworker.0 Request processed in 47us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201580.693928:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201580.693929:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788201580.693946:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715478144:0@lo:400:kworker.0 00000100:00100000:3.0:1788201580.693951:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715477504 00000100:00100000:3.0:1788201580.693954:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715477504 00000100:00100000:3.0:1788201580.693971:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788201580.693975:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715477504:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788201580.693980:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788201580.693997:0:99776:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff8dc0059d7800, cookie 0x96d0c9b8c9a1efd6 00010000:00080000:3.0:1788201580.694003:0:99776:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t0 exp ffff8dc0059d7800 cur 4432 last 1788201576 00000100:00100000:0.0:1788201580.694008:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715478016 00010000:02000400:3.0:1788201580.694009:0:99776:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0001: Will be in recovery for at least 1:00, or until 2 clients reconnect 00000100:00100000:0.0:1788201580.694011:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715478016 00010000:00080000:3.0:1788201580.694037:0:99776:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 70 seconds 00000004:00100000:3.0:1788201580.694054:0:99776:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1788201580.694062:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715477632 00000100:00100000:0.0:1788201580.694065:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715477632 00000100:00100000:0.0:1788201580.694081:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715478144 00000100:00100000:0.0:1788201580.694084:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715478144 00000100:00100000:0.0:1788201580.694101:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788201580.694107:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715478016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201580.694312:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201580.694331:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715478272:0@lo:400:kworker.0 00000100:00100000:2.0:1788201580.694349:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201580.694374:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715477760 00000100:00100000:2.0:1788201580.694377:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715477760 00000100:00100000:2.0:1788201580.694400:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788201580.694406:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715477632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201580.694436:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715477632:12345-0@lo:400:kworker.0 Request processed in 29us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201580.694814:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788201580.694831:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788201580.694838:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715478144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201580.694871:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715478144:12345-0@lo:400:kworker.0 Request processed in 33us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201580.694877:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788201580.694888:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788201580.694894:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715477760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201580.694938:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715477760:12345-0@lo:400:kworker.0 Request processed in 44us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201580.694943:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788201580.694975:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715477760:0@lo:400:kworker.0 00000100:00080000:3.0:1788201580.695310:0:99776:0:(import.c:65:import_set_state_nolock()) ffff8dc110732000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201580.695354:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715477504:12345-0@lo:38:kworker.0 Request processed in 1377us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201580.695361:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788201580.695458:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715478272 00000100:00100000:3.0:1788201580.695462:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715478272 00000100:00100000:3.0:1788201580.695489:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788201580.695495:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715478272:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788201580.695506:0:107405:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8dc12b634700 x1875060715478272/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:701/0 lens 224/0 e 0 to 0 dl 1788201591 ref 1 fl Interpret:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201580.695550:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715478272:12345-0@lo:400:kworker.0 Request processed in 54us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201580.695556:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788201580.695582:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc004b3a300 x1875060715478272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201580.695592:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715478016:12345-0@lo:400:kworker.0 Request processed in 34us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201580.695593:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715478272:0@lo:400:kworker.0 00000100:00100000:0.0:1788201580.695600:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1788201580.695620:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 20 00000100:00080000:0.0:1788201580.695628:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201580.695628:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788201580.695633:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201580.695633:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788201580.695635:0:3654:0:(import.c:1233:ptlrpc_connect_interpret()) connect to lustre-MDT0001_UUID during recovery 00000100:00080000:3.0:1788201580.695637:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc005d73000 lustre-MDT0001_UUID: changing import state from CONNECTING to REPLAY_LOCKS 00000100:00080000:3.0:1788201580.695641:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc005d73000 lustre-MDT0001_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1788201580.695658:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715477504:0@lo:38:kworker.0 00000100:00100000:0.0:1788201580.695666:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715477632:0@lo:400:kworker.0 00000100:00100000:3.0:1788201580.695682:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715478400:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:0.0:1788201580.695688:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715478144:0@lo:400:kworker.0 00000100:00100000:3.0:1788201580.695709:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788201580.695746:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc004b3ad80 x1875060715477888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788201596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201580.695756:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715477888:0@lo:400:kworker.0 00000100:00100000:3.0:1788201580.695776:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715478400 00000100:00100000:3.0:1788201580.695779:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715478400 00000100:00100000:3.0:1788201580.695800:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201580.695806:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715478400:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1788201580.695815:0:99776:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc004b3b800 x1875060715478400/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:701/0 lens 224/0 e 0 to 0 dl 1788201591 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201580.695828:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715478400:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 23us (119us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201580.695833:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788201580.696290:0:107480:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:0.0:1788201580.696315:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715478016:0@lo:400:kworker.0 00010000:00010000:1.0:1788201580.881455:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201581.330608:0:107440:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a49b000 going to sleep for 0 seconds 00000100:00080000:0.0:1788201581.330628:0:107440:0:(client.c:1430:ptlrpc_import_delay_req()) @@@ allow during recovery req@ffff8dc106048700 x1875060715466496/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201581.330744:0:107440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201581.330780:0:107440:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a49b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201581.330805:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715466496 00000100:00100000:0.0:1788201581.330812:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715466496 00000100:00100000:0.0:1788201581.330997:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788201581.331006:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:107440:x1875060715466496:12345-0@lo:1000:lod0000_rec0001.0 00010000:00080000:0.0:1788201581.331051:0:99776:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8dc11cd1b480 x1875060715466496/t0(0) o1000->lustre-MDT0000-mdtlov_UUID@0@lo:702/0 lens 304/0 e 0 to 0 dl 1788201592 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201581.331133:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:107440:x1875060715466496:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 128us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201581.331141:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788201581.331184:0:107440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:107440:1875060715466496:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788201581.331224:0:107440:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00080000:0.0:1788201581.331264:0:107440:0:(client.c:1430:ptlrpc_import_delay_req()) @@@ allow during recovery req@ffff8dc11cd1b100 x1875060715478528/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 336/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201581.331274:0:107440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd1b100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:107440:1875060715478528:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788201581.331303:0:107440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201581.331318:0:107440:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0058463c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201581.331328:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715478528 00000100:00100000:0.0:1788201581.331331:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715478528 00000100:00100000:0.0:1788201581.331349:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788201581.331355:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:107440:x1875060715478528:12345-0@lo:1000:lod0000_rec0001.0 00010000:00080000:0.0:1788201581.331362:0:99776:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8dc11cd1aa00 x1875060715478528/t0(0) o1000->lustre-MDT0000-mdtlov_UUID@0@lo:702/0 lens 336/0 e 0 to 0 dl 1788201592 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201581.331450:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:107440:x1875060715478528:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 94us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201581.331456:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788201581.331793:0:107440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd1b100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:107440:1875060715478528:0@lo:1000:lod0000_rec0001.0 00000100:00080000:0.0:1788201581.331933:0:107440:0:(client.c:1430:ptlrpc_import_delay_req()) @@@ allow during recovery req@ffff8dc11cd1b100 x1875060715478656/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201581.331954:0:107440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd1b100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:107440:1875060715478656:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788201581.331982:0:107440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201581.331997:0:107440:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201581.332009:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715478656 00000100:00100000:0.0:1788201581.332012:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715478656 00000100:00100000:0.0:1788201581.332053:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788201581.332060:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:107440:x1875060715478656:12345-0@lo:1000:lod0000_rec0001.0 00010000:00080000:0.0:1788201581.332067:0:99776:0:(ldlm_lib.c:3239:target_queue_recovery_request()) @@@ not queueing req@ffff8dc11cd19880 x1875060715478656/t0(0) o1000->lustre-MDT0000-mdtlov_UUID@0@lo:702/0 lens 304/0 e 0 to 0 dl 1788201592 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201581.332131:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:107440:x1875060715478656:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 70us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201581.332137:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788201581.332165:0:107440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd1b100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:107440:1875060715478656:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788201581.332202:0:107440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201581.338996:0:107440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788201581.339545:0:107440:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 5, retries 0 00000004:00080000:0.0:1788201581.339551:0:107440:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:0.0:1788201581.339687:0:107441:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1788201581.339693:0:107441:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 128849018922 00000020:00080000:0.0:1788201581.339777:0:107441:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201581.339781:0:107441:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 128849018922, next_transno: 128849018922 00010000:00080000:0.0:1788201581.339785:0:107441:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (128849018922) 00000020:00080000:0.0:1788201581.339788:0:107441:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201581.339802:0:107441:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695569792 t128849018922 from 192.168.201.20@tcp req@ffff8dc106049c00 x1875060695569792/t0(128849018922) o36->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:697/0 lens 528/0 e 0 to 0 dl 1788201587 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788201581.343050:0:107441:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1963us 00010000:00010000:3.0:1788201581.364464:0:107441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1f126 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.364488:0:107441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1f126 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.364502:0:107441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1f126 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.364519:0:107441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1f12d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.364526:0:107441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1f12d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.364545:0:107441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1f12d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.364926:0:107441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1f126 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.364934:0:107441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1f126 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.364941:0:107441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1f126 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.364946:0:107441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201581.364950:0:107441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1f126 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.364957:0:107441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1f126 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.364970:0:107441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc004b23b00) 00010000:00010000:3.0:1788201581.364974:0:107441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201581.364977:0:107441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1f126 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.364983:0:107441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae2200/0x96d0c9b8c9a1f126 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788201581.365004:0:107441:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd8a9278 reply state 0000000064686949 transno 128849018922 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1f12d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.365036:0:107441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1f12d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.365052:0:107441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc004b23800) 00010000:00010000:3.0:1788201581.365055:0:107441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788201581.365058:0:107441:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788201581.365174:0:107441:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:3.0:1788201581.365196:0:107441:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201581.365199:0:107441:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 128849018923 00000020:00080000:3.0:1788201581.365204:0:107441:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788201581.365206:0:107441:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 128849018923 00000001:00100000:2.0:1788201581.399063:0:100576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788201581.399076:0:100576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788201581.399307:0:99761:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788201581.399316:0:99761:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788201581.405491:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201581.405534:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695570304 00000100:00100000:0.0:1788201581.405544:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695570304 00000100:00100000:0.0:1788201581.405836:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:0.0:1788201581.405849:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2399:x1875060695570304:12345-192.168.201.20@tcp:36:rm.0 00010000:00080000:0.0:1788201581.405870:0:107405:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 128849018923, current: 128849018923, replaying 00000100:00100000:0.0:1788201581.405887:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2399:x1875060695570304:12345-192.168.201.20@tcp:36:rm.0 Request processed in 42us (404us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201581.405895:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5 00000020:00080000:0.0:1788201581.405933:0:107441:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201581.405937:0:107441:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 128849018923, next_transno: 128849018923 00010000:00080000:0.0:1788201581.405942:0:107441:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (128849018923) 00000020:00080000:0.0:1788201581.405946:0:107441:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201581.405955:0:107441:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695570304 t128849018923 from 192.168.201.20@tcp req@ffff8dc11cd1b100 x1875060695570304/t0(128849018923) o36->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:702/0 lens 512/0 e 0 to 0 dl 1788201592 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201581.406064:0:107441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f134 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.406079:0:107441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f134 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.406092:0:107441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f134 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.406104:0:107441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1f13b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.406119:0:107441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1f13b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.406125:0:107441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1f13b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.406220:0:107441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f142 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.406229:0:107441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f142 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.406236:0:107441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f142 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.406446:0:107441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f142 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.406455:0:107441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f142 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.406475:0:107441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f142 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.406483:0:107441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201581.406488:0:107441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f142 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.406496:0:107441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f142 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.406509:0:107441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x35:0x0].0x0 (ffff8dc005ab2400) 00010000:00010000:0.0:1788201581.406519:0:107441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201581.406524:0:107441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f142 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.406531:0:107441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f142 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.407659:0:107441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f134 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.407672:0:107441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f134 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.407679:0:107441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f134 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.407684:0:107441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201581.407687:0:107441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f134 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.407693:0:107441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f134 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.407705:0:107441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc005ab2000) 00010000:00010000:0.0:1788201581.407708:0:107441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201581.407712:0:107441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f134 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.407718:0:107441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f134 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201581.407734:0:107441:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000878292a5 reply state 00000000f7a1fc49 transno 128849018923 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1f13b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.407757:0:107441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1f13b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.407763:0:107441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc004b23800) 00010000:00010000:0.0:1788201581.407766:0:107441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201581.407768:0:107441:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788201581.407860:0:107441:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788201581.407880:0:107441:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201581.407883:0:107441:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 128849018924 00000020:00080000:0.0:1788201581.407887:0:107441:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201581.407888:0:107441:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 128849018924 00000100:00100000:1.0:1788201581.412976:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201581.414575:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695571840 00000100:00100000:3.0:1788201581.414589:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695571840 00000100:00100000:3.0:1788201581.414663:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:3.0:1788201581.414750:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2399:x1875060695571840:12345-192.168.201.20@tcp:36:mcreate.0 00010000:00080000:3.0:1788201581.414772:0:107404:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 128849018924, current: 128849018924, replaying 00000100:00100000:3.0:1788201581.414788:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2399:x1875060695571840:12345-192.168.201.20@tcp:36:mcreate.0 Request processed in 44us (1822us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201581.414794:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6 00000020:00080000:0.0:1788201581.414945:0:107441:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201581.414950:0:107441:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 128849018924, next_transno: 128849018924 00010000:00080000:0.0:1788201581.414955:0:107441:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (128849018924) 00000020:00080000:0.0:1788201581.414959:0:107441:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201581.414969:0:107441:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695571840 t128849018924 from 192.168.201.20@tcp req@ffff8dc10604b800 x1875060695571840/t0(128849018924) o36->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:702/0 lens 528/0 e 0 to 0 dl 1788201592 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201581.415127:0:107441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f149 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.415144:0:107441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f149 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.415156:0:107441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f149 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.415168:0:107441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1f150 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.415185:0:107441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1f150 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.415191:0:107441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1f150 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.415551:0:107441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f149 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.415561:0:107441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f149 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.415567:0:107441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f149 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.415573:0:107441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201581.415578:0:107441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f149 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.415585:0:107441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f149 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.415597:0:107441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc005ab2d00) 00010000:00010000:0.0:1788201581.415600:0:107441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201581.415604:0:107441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f149 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.415610:0:107441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f149 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201581.415630:0:107441:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b62a968b reply state 00000000f44dac14 transno 128849018924 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1f150 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.415650:0:107441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1f150 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.415656:0:107441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc004b23800) 00010000:00010000:0.0:1788201581.415659:0:107441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201581.415662:0:107441:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788201581.415760:0:107441:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788201581.415780:0:107441:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201581.415783:0:107441:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 128849018925 00000020:00080000:0.0:1788201581.415786:0:107441:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201581.415788:0:107441:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 128849018925 00000100:00100000:0.0:1788201581.434737:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201581.434818:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695572352 00000100:00100000:1.0:1788201581.434829:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695572352 00000100:00100000:1.0:1788201581.435079:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:1.0:1788201581.435091:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695572352:12345-192.168.201.20@tcp:36:rm.0 00010000:00080000:1.0:1788201581.435116:0:107403:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 128849018925, current: 128849018925, replaying 00000100:00100000:1.0:1788201581.435128:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2399:x1875060695572352:12345-192.168.201.20@tcp:36:rm.0 Request processed in 41us (399us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201581.435135:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 7 00000020:00080000:0.0:1788201581.435209:0:107441:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201581.435213:0:107441:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 128849018925, next_transno: 128849018925 00010000:00080000:0.0:1788201581.435218:0:107441:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (128849018925) 00000020:00080000:0.0:1788201581.435221:0:107441:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201581.435230:0:107441:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695572352 t128849018925 from 192.168.201.20@tcp req@ffff8dc11cd18000 x1875060695572352/t0(128849018925) o36->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:702/0 lens 512/0 e 0 to 0 dl 1788201592 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788201581.435313:0:107441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f157 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.435328:0:107441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f157 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.435339:0:107441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f157 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.435351:0:107441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f15e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.435366:0:107441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f15e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.435373:0:107441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f15e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.435463:0:107441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f165 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.435472:0:107441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f165 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.435480:0:107441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f165 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.435679:0:107441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f165 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.435687:0:107441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f165 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.435694:0:107441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f165 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.435701:0:107441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201581.435705:0:107441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f165 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.435713:0:107441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f165 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.435726:0:107441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x36:0x0].0x0 (ffff8dc005ab2000) 00010000:00010000:0.0:1788201581.435735:0:107441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788201581.435741:0:107441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f165 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.435748:0:107441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f165 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.435772:0:107441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f157 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.435779:0:107441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f157 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.435785:0:107441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f157 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.435791:0:107441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201581.435795:0:107441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f157 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.435801:0:107441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f157 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.435809:0:107441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc005ab2d00) 00010000:00010000:0.0:1788201581.435812:0:107441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201581.435815:0:107441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f157 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.435820:0:107441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f157 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201581.435831:0:107441:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000303477f7 reply state 00000000c1c02886 transno 128849018925 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f15e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.435995:0:107441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f15e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.436002:0:107441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc004b23800) 00010000:00010000:0.0:1788201581.436005:0:107441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201581.436008:0:107441:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788201581.440091:0:107441:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788201581.440127:0:107441:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201581.440131:0:107441:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 128849018926 00000020:00080000:0.0:1788201581.440137:0:107441:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201581.440139:0:107441:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 128849018926 00000100:00100000:1.0:1788201581.445874:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201581.455068:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695574656 00000100:00100000:0.0:1788201581.455083:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695574656 00000100:00100000:0.0:1788201581.455147:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:0.0:1788201581.455159:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2399:x1875060695574656:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00080000:0.0:1788201581.455178:0:107405:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 128849018926, current: 128849018926, replaying 00000100:00100000:0.0:1788201581.455193:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:2399:x1875060695574656:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 38us (9331us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201581.455200:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 8 00000020:00080000:0.0:1788201581.455218:0:107441:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201581.455222:0:107441:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 128849018926, next_transno: 128849018926 00010000:00080000:0.0:1788201581.455226:0:107441:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (128849018926) 00000020:00080000:0.0:1788201581.455229:0:107441:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201581.455238:0:107441:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695574656 t128849018926 from 192.168.201.20@tcp req@ffff8dc10604b480 x1875060695574656/t0(128849018926) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:702/0 lens 520/0 e 0 to 0 dl 1788201592 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'mkdir.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1788201581.455260:0:107441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201581.455287:0:107441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f16c lrc: 2/0,0 mode: --/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786fe2 expref: -99 pid: 107441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.455492:0:107441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f173 lrc: 3/0,1 mode: --/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.455506:0:107441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f173 lrc: 3/0,1 mode: CW/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.455517:0:107441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f173 lrc: 3/0,1 mode: CW/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.455530:0:107441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1f17a lrc: 3/0,1 mode: --/PW res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.455538:0:107441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1f17a lrc: 3/0,1 mode: PW/PW res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.455545:0:107441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1f17a lrc: 3/0,1 mode: PW/PW res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201581.456003:0:107441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x37:0x0]: returning size 4096 00010000:00010000:0.0:1788201581.456052:0:107441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1f181 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.456061:0:107441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1f181 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.456068:0:107441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1f181 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.456081:0:107441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f173 lrc: 3/0,1 mode: CW/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.456097:0:107441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f173 lrc: 2/0,0 mode: CW/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.456104:0:107441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f173 lrc: 3/0,0 mode: CW/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.456110:0:107441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201581.456115:0:107441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f173 lrc: 3/0,0 mode: CW/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.456122:0:107441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f173 lrc: 4/0,0 mode: CW/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.456134:0:107441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000e691:0x3:0x0].0x0 (ffff8dc005ab2d00) 00010000:00010000:0.0:1788201581.456137:0:107441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201581.456142:0:107441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f173 lrc: 2/0,0 mode: --/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.456147:0:107441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f173 lrc: 0/0,0 mode: --/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788201581.456158:0:107441:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000184a493a reply state 00000000ca53e682 transno 128849018926 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1f17a lrc: 3/0,1 mode: PW/PW res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.456169:0:107441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1f17a lrc: 3/0,1 mode: TXN/TXN res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.456175:0:107441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000e691:0x3:0x0].0xcd52553e (ffff8dc005ab2000) 00010000:00010000:0.0:1788201581.456177:0:107441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788201581.456179:0:107441:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788201581.456236:0:107441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f16c lrc: 0/0,0 mode: --/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fe2 expref: 17 pid: 107441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.456255:0:107441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1f181 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fe2 expref: 16 pid: 107441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.456263:0:107441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x37:0x0].0x0 (ffff8dc005ab2400) 00010000:00010000:0.0:1788201581.456265:0:107441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201581.456268:0:107441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d7400, rc 0) 00010000:00080000:0.0:1788201581.456331:0:107441:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788201581.456347:0:107441:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201581.456350:0:107441:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 128849018927 00000020:00080000:0.0:1788201581.456353:0:107441:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201581.456355:0:107441:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 128849018927 00000100:00100000:3.0:1788201581.459775:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201581.459814:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695579392 00000100:00100000:3.0:1788201581.459824:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695579392 00000100:00100000:3.0:1788201581.460055:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:3.0:1788201581.460067:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+17:2399:x1875060695579392:12345-192.168.201.20@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1788201581.460091:0:107404:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc004b3ad80 x1875060695579392/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:702/0 lens 224/0 e 0 to 0 dl 1788201592 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201581.460111:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+17:2399:x1875060695579392:12345-192.168.201.20@tcp:400:ldlm_lock_repla.0 Request processed in 48us (345us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201581.461002:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2 00000020:00080000:2.0:1788201581.462631:0:107441:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788201581.462639:0:107441:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 128849018927 00010000:00080000:2.0:1788201581.462643:0:107441:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1788201581.462646:0:107441:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788201581.462653:0:107441:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1788201581.462656:0:107441:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:2.0:1788201581.462765:0:107441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 31, last_transno is 133143986176 00000001:00100000:2.0:1788201581.468317:0:107389:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000001:00100000:2.0:1788201581.468330:0:107389:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1788201581.468369:0:107389:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018926 is committed 00000001:00080000:2.0:1788201581.468383:0:107389:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 128849018925 is committed 00010000:00010000:2.0:1788201581.468427:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1f12d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.468440:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1f12d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.468448:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1f12d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.468455:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201581.468459:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1f12d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.468467:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1f12d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.468487:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1f12d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.468493:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc125ae3c00/0x96d0c9b8c9a1f12d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.468512:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1f13b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.468518:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1f13b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.468523:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1f13b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.468537:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201581.468540:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1f13b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.468546:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1f13b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.468556:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1f13b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.468562:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1f13b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.468574:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1f150 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.468580:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1f150 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.468585:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1f150 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.468590:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201581.468592:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1f150 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.468598:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1f150 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.468604:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1f150 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.468630:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7800/0x96d0c9b8c9a1f150 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.468641:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f15e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.468647:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f15e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.468652:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f15e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.468657:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201581.468660:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f15e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.470002:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f15e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.470033:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f15e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.470041:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f15e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.470069:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1f17a lrc: 3/0,1 mode: TXN/TXN res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.470076:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1f17a lrc: 2/0,0 mode: TXN/TXN res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.470095:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1f17a lrc: 3/0,0 mode: TXN/TXN res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.470101:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201581.470105:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1f17a lrc: 3/0,0 mode: TXN/TXN res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.470112:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1f17a lrc: 4/0,0 mode: TXN/TXN res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.470121:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1f17a lrc: 2/0,0 mode: --/TXN res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.470736:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1f17a lrc: 0/0,0 mode: --/TXN res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107441 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788201581.470798:0:107441:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:2.0:1788201581.470846:0:107441:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:2.0:1788201581.470861:0:107441:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8dc003a70700 x1875060715470208/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:697/0 lens 224/0 e 0 to 0 dl 1788201587 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788201581.471872:0:107441:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.201.20@tcp: req@ffff8dc004b3ad80 x1875060695579392/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:702/0 lens 224/0 e 0 to 0 dl 1788201592 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788201581.471960:0:107441:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00100000:3.0:1788201581.481972:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 128849018925 gen 2 00000004:00080000:3.0:1788201581.481985:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018922 committed transno 128849018925 00000004:00080000:3.0:1788201581.482005:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018923 committed transno 128849018925 00000004:00080000:3.0:1788201581.482053:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018924 committed transno 128849018925 00000004:00080000:3.0:1788201581.482066:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 128849018925 committed transno 128849018925 00000100:00080000:3.0:1788201581.482083:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788201581.482095:0:3654:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8dc003a73100 x1875060715470208/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201592 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201581.482106:0:3654:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8dc003a73100 x1875060715470208/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201592 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201581.482114:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788201581.482145:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788201581.482150:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715470208:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:0.0:1788201581.483683:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201581.483701:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715478784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201581.483763:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201581.483811:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715478784 00000100:00100000:0.0:1788201581.483818:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715478784 00000100:00100000:0.0:1788201581.484098:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788201581.484109:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715478784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201581.484149:0:99776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444966400 avail 1298726912 00000100:00100000:0.0:1788201581.484195:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715478784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201581.484202:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788201581.484248:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715478784:0@lo:41:osp-pre-0-1.0 00000004:00000080:3.0:1788201581.521940:0:107441:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa0dd45813e10 00100000:10000000:3.0:1788201581.521954:0:107441:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1788201581.523051:0:107427:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x396:0x0] 00000100:00100000:3.0:1788201581.523100:0:107427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:107427:1875060715478912:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788201581.523436:0:107427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201581.523470:0:107427:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038e0180 going to sleep for 11 seconds 00000004:00080000:3.0:1788201581.523486:0:107429:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x323:0x0] 00000100:00100000:3.0:1788201581.523505:0:107429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:107429:1875060715479040:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788201581.523536:0:107429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201581.523552:0:107429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0038e0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201581.523602:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201581.523639:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715478912 00000100:00100000:3.0:1788201581.523647:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715478912 00000100:00100000:3.0:1788201581.523688:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715479040 00000100:00100000:3.0:1788201581.523691:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715479040 00000100:00100000:3.0:1788201581.523713:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788201581.523723:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:107427:x1875060715478912:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788201581.523751:0:101191:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 993 -> diff = -75 00002000:02000040:3.0:1788201581.523757:0:101191:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:919 to 0x280000401:993) 00000100:00100000:2.0:1788201581.525101:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695579520 00000100:00100000:2.0:1788201581.525112:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695579520 00000100:00100000:2.0:1788201581.525334:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00100000:2.0:1788201581.525345:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695579520:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201581.525422:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005871450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695579520:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 79us (1821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201581.525430:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00100000:2.0:1788201581.525472:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788201581.525482:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:107429:x1875060715479040:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788201581.525503:0:100688:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 961 -> diff = -158 00002000:02000040:2.0:1788201581.525508:0:100688:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:804 to 0x2c0000401:961) 00002000:00010000:3.0:1788201581.532467:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.532490:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000583840ff/0x96d0c9b8c9a1f188 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.532514:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e1:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.532520:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.532530:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000583840ff/0x96d0c9b8c9a1f188 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.532551:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000583840ff/0x96d0c9b8c9a1f188 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.532564:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000583840ff/0x96d0c9b8c9a1f188 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.532573:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000583840ff/0x96d0c9b8c9a1f188 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.532612:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201581.532875:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.532881:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e9efc76/0x96d0c9b8c9a1f18f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.532890:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e0:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.532893:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.532898:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e9efc76/0x96d0c9b8c9a1f18f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.532920:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e9efc76/0x96d0c9b8c9a1f18f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.532929:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e9efc76/0x96d0c9b8c9a1f18f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.532935:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e9efc76/0x96d0c9b8c9a1f18f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.532961:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788201581.533007:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.533013:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab39a76d/0x96d0c9b8c9a1f196 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.533061:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3df:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.533065:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.533069:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab39a76d/0x96d0c9b8c9a1f196 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.533093:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab39a76d/0x96d0c9b8c9a1f196 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.533102:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab39a76d/0x96d0c9b8c9a1f196 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.533109:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab39a76d/0x96d0c9b8c9a1f196 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.533127:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788201581.533171:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.533176:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e7699c6/0x96d0c9b8c9a1f19d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.533184:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3de:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.533187:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.533191:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e7699c6/0x96d0c9b8c9a1f19d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.533198:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e7699c6/0x96d0c9b8c9a1f19d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.533206:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e7699c6/0x96d0c9b8c9a1f19d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.533224:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e7699c6/0x96d0c9b8c9a1f19d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.533243:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788201581.533262:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788201581.533288:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000583840ff/0x96d0c9b8c9a1f188 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201581.533293:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.533311:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ccd9d4f/0x96d0c9b8c9a1f1a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.533314:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201581.533324:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000583840ff/0x96d0c9b8c9a1f188 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.533328:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3dd:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.533341:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.533352:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ccd9d4f/0x96d0c9b8c9a1f1a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.533353:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000583840ff/0x96d0c9b8c9a1f188 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.533407:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ccd9d4f/0x96d0c9b8c9a1f1a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.533418:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000583840ff/0x96d0c9b8c9a1f188 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.533422:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ccd9d4f/0x96d0c9b8c9a1f1a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.533446:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000583840ff/0x96d0c9b8c9a1f188 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.533450:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ccd9d4f/0x96d0c9b8c9a1f1a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.533478:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788201581.533490:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788201581.533496:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e9efc76/0x96d0c9b8c9a1f18f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.533505:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201581.533510:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e9efc76/0x96d0c9b8c9a1f18f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.533518:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e9efc76/0x96d0c9b8c9a1f18f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.533544:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e9efc76/0x96d0c9b8c9a1f18f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.533551:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e9efc76/0x96d0c9b8c9a1f18f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.533567:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788201581.533571:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab39a76d/0x96d0c9b8c9a1f196 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.533578:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae2c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201581.533581:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab39a76d/0x96d0c9b8c9a1f196 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.533589:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab39a76d/0x96d0c9b8c9a1f196 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.533599:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab39a76d/0x96d0c9b8c9a1f196 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.533606:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab39a76d/0x96d0c9b8c9a1f196 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.533625:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201581.533629:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e7699c6/0x96d0c9b8c9a1f19d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.533646:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3200 already unused, calling callback (ffffffffc0c83230) 00002000:00010000:3.0:1788201581.533646:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201581.533655:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e7699c6/0x96d0c9b8c9a1f19d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.533659:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1f1ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.533673:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e7699c6/0x96d0c9b8c9a1f19d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.533679:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3dc:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.533692:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.533698:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1f1ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.533699:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e7699c6/0x96d0c9b8c9a1f19d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.533737:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e7699c6/0x96d0c9b8c9a1f19d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.533740:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1f1ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.533766:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1f1ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.533770:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201581.533789:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ccd9d4f/0x96d0c9b8c9a1f1a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.533789:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1f1ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.533843:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201581.533912:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201581.533915:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.533920:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1f1b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.533923:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ccd9d4f/0x96d0c9b8c9a1f1a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.533940:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ccd9d4f/0x96d0c9b8c9a1f1a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.533958:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3db:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:0.0:1788201581.533967:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ccd9d4f/0x96d0c9b8c9a1f1a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.533970:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.533976:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1f1b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.534004:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ccd9d4f/0x96d0c9b8c9a1f1a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.534012:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1f1b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.534055:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201581.534059:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1f1ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.534072:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201581.534079:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1f1ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.534094:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1f1ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.534098:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1f1b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.534110:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1f1b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.535264:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1f1ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.535279:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bac309ca/0x96d0c9b8c9a1f1ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.535302:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201581.535304:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201581.535306:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.536247:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.536545:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.536555:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.536607:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201581.536763:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.536776:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1f1b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.536803:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3da:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.536809:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.536817:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1f1b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.536841:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1f1b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.536859:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1f1b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.536868:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1f1b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.536914:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201581.536924:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201581.536931:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1f1b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.536939:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100031200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.536945:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1f1b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.536962:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1f1b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.536991:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1f1b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537001:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000aebd397/0x96d0c9b8c9a1f1b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537376:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201581.537381:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1f1b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537389:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.537392:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1f1b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537412:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1f1b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537425:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1f1b9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537433:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000182d31c8/0x96d0c9b8c9a1f1b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537461:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.537465:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.537467:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.537478:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201581.537556:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.537563:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1f1c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537572:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d9:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.537576:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.537581:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1f1c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537592:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1f1c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537600:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1f1c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537614:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1f1c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537634:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201581.537642:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201581.537649:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1f1c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537656:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100031e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.537660:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1f1c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537667:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1f1c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537680:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1f1c0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537688:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8153134/0x96d0c9b8c9a1f1c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537703:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.537705:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.537707:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201581.537755:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.537768:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1f1c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537778:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d8:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.537782:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.537786:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1f1c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537805:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1f1c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537815:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1f1c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537824:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1f1c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537845:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201581.537860:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201581.537865:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1f1c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537873:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.537877:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1f1c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537891:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1f1c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537926:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1f1c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537934:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f3442d8/0x96d0c9b8c9a1f1c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.537955:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.537957:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.537959:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201581.538050:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.538057:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1f1ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538066:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d7:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.538077:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.538082:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1f1ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538092:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1f1ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538106:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1f1ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538115:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1f1ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538144:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201581.538153:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201581.538157:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1f1ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538170:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.538174:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1f1ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538183:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1f1ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538200:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1f1ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538208:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077b8db84/0x96d0c9b8c9a1f1ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538227:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.538229:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.538231:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201581.538282:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.538288:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1f1d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538296:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d6:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.538308:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.538313:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1f1d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538323:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1f1d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538331:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1f1d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538338:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1f1d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538353:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201581.538363:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201581.538368:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1f1d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538375:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100031400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.538380:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1f1d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538388:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1f1d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538401:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1f1d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538421:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7c4d0fb/0x96d0c9b8c9a1f1d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538438:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.538440:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.538442:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201581.538496:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.538503:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1f1dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538511:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d5:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.538515:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.538520:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1f1dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538530:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1f1dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538538:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1f1dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538546:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1f1dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538560:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201581.538576:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201581.538581:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1f1dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538588:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.538592:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1f1dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538601:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1f1dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538614:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1f1dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538622:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000553df25f/0x96d0c9b8c9a1f1dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538638:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.538642:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.538644:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201581.538691:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.538696:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1f1e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538704:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d4:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.538707:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.538712:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1f1e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538734:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1f1e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538742:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1f1e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538750:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1f1e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538764:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201581.538774:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201581.538779:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1f1e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538787:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.538790:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1f1e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538799:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1f1e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538812:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1f1e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538820:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000201a2490/0x96d0c9b8c9a1f1e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538843:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.538845:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.538847:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201581.538892:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.538897:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1f1ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538918:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d3:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.538922:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.538926:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1f1ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538935:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1f1ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538943:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1f1ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538951:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1f1ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538963:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201581.538969:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201581.538973:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1f1ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.538993:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc100030600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.538996:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1f1ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539004:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1f1ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539043:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1f1ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539051:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2526df2/0x96d0c9b8c9a1f1ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539066:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.539068:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.539070:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201581.539115:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.539120:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076abd4f8/0x96d0c9b8c9a1f1f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539127:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d2:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.539130:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.539134:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076abd4f8/0x96d0c9b8c9a1f1f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539142:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076abd4f8/0x96d0c9b8c9a1f1f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539156:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076abd4f8/0x96d0c9b8c9a1f1f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539163:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076abd4f8/0x96d0c9b8c9a1f1f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539176:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201581.539183:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201581.539187:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076abd4f8/0x96d0c9b8c9a1f1f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539194:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101672600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.539197:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076abd4f8/0x96d0c9b8c9a1f1f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539206:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076abd4f8/0x96d0c9b8c9a1f1f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539217:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076abd4f8/0x96d0c9b8c9a1f1f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539224:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076abd4f8/0x96d0c9b8c9a1f1f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539238:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.539245:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.539247:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201581.539291:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.539297:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042646aec/0x96d0c9b8c9a1f1f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539306:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d1:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.539310:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.539314:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042646aec/0x96d0c9b8c9a1f1f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539325:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042646aec/0x96d0c9b8c9a1f1f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539334:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042646aec/0x96d0c9b8c9a1f1f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539342:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042646aec/0x96d0c9b8c9a1f1f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539367:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201581.539381:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201581.539387:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042646aec/0x96d0c9b8c9a1f1f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539395:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101672000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.539399:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042646aec/0x96d0c9b8c9a1f1f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539425:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042646aec/0x96d0c9b8c9a1f1f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539443:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042646aec/0x96d0c9b8c9a1f1f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539451:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042646aec/0x96d0c9b8c9a1f1f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539473:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.539477:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.539480:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201581.539539:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.539544:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000263f6817/0x96d0c9b8c9a1f1ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539560:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d0:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.539563:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.539567:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000263f6817/0x96d0c9b8c9a1f1ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539576:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000263f6817/0x96d0c9b8c9a1f1ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539591:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000263f6817/0x96d0c9b8c9a1f1ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539604:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000263f6817/0x96d0c9b8c9a1f1ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539641:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201581.539693:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.539698:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff29e9a9/0x96d0c9b8c9a1f206 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539705:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3cf:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.539709:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.539713:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff29e9a9/0x96d0c9b8c9a1f206 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539722:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff29e9a9/0x96d0c9b8c9a1f206 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539730:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff29e9a9/0x96d0c9b8c9a1f206 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539738:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff29e9a9/0x96d0c9b8c9a1f206 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539752:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201581.539759:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201581.539763:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000263f6817/0x96d0c9b8c9a1f1ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539784:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101673600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.539788:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000263f6817/0x96d0c9b8c9a1f1ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539796:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000263f6817/0x96d0c9b8c9a1f1ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539808:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000263f6817/0x96d0c9b8c9a1f1ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539815:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000263f6817/0x96d0c9b8c9a1f1ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539831:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201581.539834:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff29e9a9/0x96d0c9b8c9a1f206 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539841:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101673800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.539845:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff29e9a9/0x96d0c9b8c9a1f206 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539860:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff29e9a9/0x96d0c9b8c9a1f206 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539870:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff29e9a9/0x96d0c9b8c9a1f206 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539891:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff29e9a9/0x96d0c9b8c9a1f206 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.539918:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.539920:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.539922:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201581.540352:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.540359:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097e718a9/0x96d0c9b8c9a1f20d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.540368:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ce:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.540372:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.540377:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097e718a9/0x96d0c9b8c9a1f20d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.540385:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097e718a9/0x96d0c9b8c9a1f20d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.540392:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097e718a9/0x96d0c9b8c9a1f20d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.540399:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097e718a9/0x96d0c9b8c9a1f20d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.540413:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201581.540428:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201581.540433:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097e718a9/0x96d0c9b8c9a1f20d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.540440:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101672c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.540443:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097e718a9/0x96d0c9b8c9a1f20d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.540451:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097e718a9/0x96d0c9b8c9a1f20d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.540462:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097e718a9/0x96d0c9b8c9a1f20d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.540469:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097e718a9/0x96d0c9b8c9a1f20d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.540492:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.540494:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.540498:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201581.540523:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201581.540567:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.540573:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d2f6c7b/0x96d0c9b8c9a1f214 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.540581:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3cd:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.540584:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.540588:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d2f6c7b/0x96d0c9b8c9a1f214 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.540609:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d2f6c7b/0x96d0c9b8c9a1f214 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.540617:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d2f6c7b/0x96d0c9b8c9a1f214 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.540624:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d2f6c7b/0x96d0c9b8c9a1f214 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.540645:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201581.540677:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1788201581.540696:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201581.540701:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d2f6c7b/0x96d0c9b8c9a1f214 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.540705:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f37d517a/0x96d0c9b8c9a1f21b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.540747:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3cc:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:0.0:1788201581.540749:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101673e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.540755:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201581.540759:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d2f6c7b/0x96d0c9b8c9a1f214 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.540763:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f37d517a/0x96d0c9b8c9a1f21b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.540798:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d2f6c7b/0x96d0c9b8c9a1f214 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.540800:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f37d517a/0x96d0c9b8c9a1f21b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.540846:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f37d517a/0x96d0c9b8c9a1f21b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.540864:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d2f6c7b/0x96d0c9b8c9a1f214 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.540873:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f37d517a/0x96d0c9b8c9a1f21b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.540879:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d2f6c7b/0x96d0c9b8c9a1f214 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.540898:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201581.540924:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201581.540926:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.540930:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f37d517a/0x96d0c9b8c9a1f21b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.540931:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201581.540936:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.540948:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101673c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.540953:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f37d517a/0x96d0c9b8c9a1f21b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.540961:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f37d517a/0x96d0c9b8c9a1f21b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.540973:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f37d517a/0x96d0c9b8c9a1f21b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.540980:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f37d517a/0x96d0c9b8c9a1f21b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.540997:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.540999:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.541001:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201581.541066:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.541077:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae2bee79/0x96d0c9b8c9a1f222 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541084:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3cb:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.541087:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.541091:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae2bee79/0x96d0c9b8c9a1f222 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541099:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae2bee79/0x96d0c9b8c9a1f222 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541106:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae2bee79/0x96d0c9b8c9a1f222 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541112:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae2bee79/0x96d0c9b8c9a1f222 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541129:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201581.541164:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.541169:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000017a6f37/0x96d0c9b8c9a1f229 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541177:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ca:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.541179:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.541183:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000017a6f37/0x96d0c9b8c9a1f229 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541201:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000017a6f37/0x96d0c9b8c9a1f229 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541209:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000017a6f37/0x96d0c9b8c9a1f229 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541217:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000017a6f37/0x96d0c9b8c9a1f229 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541230:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788201581.541273:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.541279:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ae48645/0x96d0c9b8c9a1f230 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541287:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c9:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.541290:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.541295:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ae48645/0x96d0c9b8c9a1f230 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541305:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ae48645/0x96d0c9b8c9a1f230 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541314:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ae48645/0x96d0c9b8c9a1f230 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541345:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ae48645/0x96d0c9b8c9a1f230 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541360:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788201581.541422:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.541434:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1c8c558/0x96d0c9b8c9a1f237 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541444:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c8:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.541447:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.541451:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1c8c558/0x96d0c9b8c9a1f237 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541468:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1c8c558/0x96d0c9b8c9a1f237 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541477:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1c8c558/0x96d0c9b8c9a1f237 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541491:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1c8c558/0x96d0c9b8c9a1f237 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541509:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788201581.541524:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788201581.541529:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae2bee79/0x96d0c9b8c9a1f222 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541543:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101673200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.541552:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae2bee79/0x96d0c9b8c9a1f222 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541562:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae2bee79/0x96d0c9b8c9a1f222 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541582:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae2bee79/0x96d0c9b8c9a1f222 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541591:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae2bee79/0x96d0c9b8c9a1f222 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541617:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788201581.541620:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000017a6f37/0x96d0c9b8c9a1f229 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541634:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc101673a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.541638:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000017a6f37/0x96d0c9b8c9a1f229 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541646:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000017a6f37/0x96d0c9b8c9a1f229 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541662:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000017a6f37/0x96d0c9b8c9a1f229 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541677:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000017a6f37/0x96d0c9b8c9a1f229 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541692:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201581.541696:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ae48645/0x96d0c9b8c9a1f230 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541702:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda9800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.541705:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ae48645/0x96d0c9b8c9a1f230 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541713:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ae48645/0x96d0c9b8c9a1f230 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541725:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ae48645/0x96d0c9b8c9a1f230 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541732:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ae48645/0x96d0c9b8c9a1f230 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541747:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201581.541751:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1c8c558/0x96d0c9b8c9a1f237 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541757:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda9400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.541767:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1c8c558/0x96d0c9b8c9a1f237 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541777:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1c8c558/0x96d0c9b8c9a1f237 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541788:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1c8c558/0x96d0c9b8c9a1f237 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541795:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1c8c558/0x96d0c9b8c9a1f237 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541810:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.541812:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.541815:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201581.541870:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.541876:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab0084d6/0x96d0c9b8c9a1f23e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541885:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c7:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.541888:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.541910:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab0084d6/0x96d0c9b8c9a1f23e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541922:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab0084d6/0x96d0c9b8c9a1f23e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541952:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab0084d6/0x96d0c9b8c9a1f23e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541960:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab0084d6/0x96d0c9b8c9a1f23e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.541981:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201581.541991:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201581.541995:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab0084d6/0x96d0c9b8c9a1f23e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542002:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda9600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.542012:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab0084d6/0x96d0c9b8c9a1f23e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542055:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab0084d6/0x96d0c9b8c9a1f23e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542068:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab0084d6/0x96d0c9b8c9a1f23e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542082:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab0084d6/0x96d0c9b8c9a1f23e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542098:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.542111:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.542114:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201581.542171:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.542177:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040b0256d/0x96d0c9b8c9a1f245 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542185:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c6:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.542188:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.542193:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040b0256d/0x96d0c9b8c9a1f245 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542208:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040b0256d/0x96d0c9b8c9a1f245 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542217:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040b0256d/0x96d0c9b8c9a1f245 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542224:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040b0256d/0x96d0c9b8c9a1f245 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542243:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201581.542249:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201581.542253:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040b0256d/0x96d0c9b8c9a1f245 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542260:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda9000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.542263:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040b0256d/0x96d0c9b8c9a1f245 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542288:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040b0256d/0x96d0c9b8c9a1f245 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542305:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040b0256d/0x96d0c9b8c9a1f245 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542313:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040b0256d/0x96d0c9b8c9a1f245 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542333:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.542334:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.542336:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201581.542384:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.542396:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3a5c061/0x96d0c9b8c9a1f24c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542405:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c5:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.542408:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.542412:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3a5c061/0x96d0c9b8c9a1f24c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542427:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3a5c061/0x96d0c9b8c9a1f24c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542435:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3a5c061/0x96d0c9b8c9a1f24c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542456:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3a5c061/0x96d0c9b8c9a1f24c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542469:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201581.542482:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201581.542486:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3a5c061/0x96d0c9b8c9a1f24c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542493:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda8e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.542496:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3a5c061/0x96d0c9b8c9a1f24c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542505:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3a5c061/0x96d0c9b8c9a1f24c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542522:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3a5c061/0x96d0c9b8c9a1f24c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542530:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3a5c061/0x96d0c9b8c9a1f24c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542543:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.542545:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.542546:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201581.542590:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.542600:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf834a51/0x96d0c9b8c9a1f253 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201581.542606:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.542608:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c4:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:3.0:1788201581.542611:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.542612:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1f25a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542615:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf834a51/0x96d0c9b8c9a1f253 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.542622:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c1:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.542625:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.542625:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf834a51/0x96d0c9b8c9a1f253 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.542630:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1f25a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542633:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf834a51/0x96d0c9b8c9a1f253 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542641:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf834a51/0x96d0c9b8c9a1f253 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.542647:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1f25a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542655:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201581.542656:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1f25a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542662:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201581.542663:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1f25a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542667:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf834a51/0x96d0c9b8c9a1f253 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.542669:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.542678:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda9200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201581.542680:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.542683:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf834a51/0x96d0c9b8c9a1f253 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.542688:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.542695:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf834a51/0x96d0c9b8c9a1f253 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542714:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf834a51/0x96d0c9b8c9a1f253 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542721:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf834a51/0x96d0c9b8c9a1f253 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542735:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.542737:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.542740:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201581.542752:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201581.542754:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1f25a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542761:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbda00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.542765:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1f25a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542772:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1f25a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542783:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1f25a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542789:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1f25a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542814:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.542815:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.542817:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201581.542826:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.542831:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1f261 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.542839:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c0:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.542842:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.542846:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1f261 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.542855:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1f261 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201581.542857:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.542862:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008489a425/0x96d0c9b8c9a1f268 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.542863:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1f261 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542870:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c3:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.542872:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1f261 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542873:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.542877:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008489a425/0x96d0c9b8c9a1f268 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.542884:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201581.542885:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008489a425/0x96d0c9b8c9a1f268 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542892:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008489a425/0x96d0c9b8c9a1f268 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542914:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008489a425/0x96d0c9b8c9a1f268 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542932:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788201581.542937:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.542941:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b840617e/0x96d0c9b8c9a1f26f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.542948:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3bf:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.542951:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.542955:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b840617e/0x96d0c9b8c9a1f26f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201581.542967:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201581.542972:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002190e16a/0x96d0c9b8c9a1f276 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.542974:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b840617e/0x96d0c9b8c9a1f26f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.542984:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b840617e/0x96d0c9b8c9a1f26f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542989:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c2:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.542992:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b840617e/0x96d0c9b8c9a1f26f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.542992:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201581.542997:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002190e16a/0x96d0c9b8c9a1f276 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.543005:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002190e16a/0x96d0c9b8c9a1f276 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.543012:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002190e16a/0x96d0c9b8c9a1f276 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.543047:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002190e16a/0x96d0c9b8c9a1f276 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.547386:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788201581.547416:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788201581.547425:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1f261 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.547440:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbde00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.547445:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1f261 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.547455:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1f261 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.547492:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1f261 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.547499:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1f261 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.547527:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788201581.547532:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008489a425/0x96d0c9b8c9a1f268 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.547537:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda8400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.547540:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008489a425/0x96d0c9b8c9a1f268 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.547547:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008489a425/0x96d0c9b8c9a1f268 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.547557:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008489a425/0x96d0c9b8c9a1f268 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.547563:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008489a425/0x96d0c9b8c9a1f268 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.547578:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201581.547581:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b840617e/0x96d0c9b8c9a1f26f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.547593:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.547597:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b840617e/0x96d0c9b8c9a1f26f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.547604:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b840617e/0x96d0c9b8c9a1f26f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.547613:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b840617e/0x96d0c9b8c9a1f26f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.547621:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201581.547625:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002190e16a/0x96d0c9b8c9a1f276 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.547631:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda8600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.547634:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002190e16a/0x96d0c9b8c9a1f276 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.547641:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002190e16a/0x96d0c9b8c9a1f276 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.547650:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002190e16a/0x96d0c9b8c9a1f276 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.547656:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002190e16a/0x96d0c9b8c9a1f276 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.547678:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.547680:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.547682:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788201581.548147:0:101191:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:918 00000100:00100000:3.0:1788201581.548251:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:107427:x1875060715478912:12345-0@lo:5:osp-pre-0-0.0 Request processed in 24525us (24812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201581.548261:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788201581.548314:0:107427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:107427:1875060715478912:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788201581.548331:0:107427:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x3e1:0x0] from OST, last_created [0x280000401:0x3e1:0x0]last_used is [0x280000401:0x396:0x0] 00000100:00100000:3.0:1788201581.548400:0:107427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:107427:1875060715479296:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788201581.548432:0:107427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201581.548454:0:107427:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13aa353c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201581.548466:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201581.548478:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715479168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201581.548504:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201581.548537:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715479168 00000100:00100000:3.0:1788201581.548543:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715479168 00000100:00100000:3.0:1788201581.548583:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788201581.548592:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715479168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201581.548616:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201581.548650:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715479168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201581.548656:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788201581.548684:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715479168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201581.548710:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715479296 00000100:00100000:3.0:1788201581.548713:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715479296 00000100:00100000:3.0:1788201581.548734:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788201581.548741:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:107427:x1875060715479296:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788201581.548764:0:101191:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 994 00000100:00100000:3.0:1788201581.550288:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:107427:x1875060715479296:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1543us (1850us total) trans 12884901912 rc 0/0 00000100:00100000:3.0:1788201581.550297:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788201581.550343:0:107427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:107427:1875060715479296:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788201581.550355:0:107427:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x3e1:0x0]-[0x280000401:0x401:0x0] 00010000:00010000:0.0:1788201581.557282:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201581.557481:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201581.557487:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201581.557491:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201581.558225:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201581.558238:0:100688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b840617e/0x96d0c9b8c9a1f26f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201581.558378:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.558385:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1f27d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558398:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3be:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.558403:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.558409:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1f27d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558423:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1f27d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558444:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1f27d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558452:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1f27d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558467:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201581.558510:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.558516:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1f284 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558524:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3bd:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.558527:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.558531:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1f284 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558540:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1f284 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558548:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1f284 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558556:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1f284 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558587:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788201581.558629:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.558635:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1f28b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558644:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3bc:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.558646:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.558650:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1f28b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558659:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1f28b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558666:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1f28b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558672:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1f28b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558685:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788201581.558719:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.558724:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1f292 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558732:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3bb:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.558740:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.558744:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1f292 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558753:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1f292 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558760:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1f292 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558766:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1f292 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558778:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788201581.558818:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.558824:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1f299 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558832:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3ba:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.558835:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.558839:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1f299 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558847:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1f299 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558854:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1f299 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558868:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1f299 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558875:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788201581.558925:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.558930:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1f2a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558937:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b9:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.558939:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.558944:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1f2a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558952:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1f2a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558958:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1f2a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558965:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1f2a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.558972:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788201581.559003:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.559008:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1f2a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559041:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b8:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.559044:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.559049:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1f2a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559058:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1f2a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559065:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1f2a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559072:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1f2a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559081:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1788201581.559130:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.559135:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000944e21c3/0x96d0c9b8c9a1f2ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559144:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b7:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.559146:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.559150:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000944e21c3/0x96d0c9b8c9a1f2ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559159:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000944e21c3/0x96d0c9b8c9a1f2ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559174:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000944e21c3/0x96d0c9b8c9a1f2ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559180:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000944e21c3/0x96d0c9b8c9a1f2ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559187:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1788201581.559226:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.559232:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1f2b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559240:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b6:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.559243:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.559247:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1f2b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559256:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1f2b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559263:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1f2b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559270:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1f2b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559289:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:2.0:1788201581.559326:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.559331:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1f2bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559338:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b5:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.559341:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.559345:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1f2bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559354:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1f2bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559361:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1f2bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559369:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1f2bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559377:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:2.0:1788201581.559406:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.559411:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dca8821c/0x96d0c9b8c9a1f2c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559418:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b4:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.559427:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.559431:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dca8821c/0x96d0c9b8c9a1f2c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559440:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dca8821c/0x96d0c9b8c9a1f2c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559448:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dca8821c/0x96d0c9b8c9a1f2c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559455:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dca8821c/0x96d0c9b8c9a1f2c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559475:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:2.0:1788201581.559510:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.559515:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afd47170/0x96d0c9b8c9a1f2ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559522:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b3:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.559525:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.559529:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afd47170/0x96d0c9b8c9a1f2ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559538:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afd47170/0x96d0c9b8c9a1f2ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559546:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afd47170/0x96d0c9b8c9a1f2ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559558:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afd47170/0x96d0c9b8c9a1f2ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559567:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:2.0:1788201581.559610:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.559615:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001345303e/0x96d0c9b8c9a1f2d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559623:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b2:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.559626:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.559629:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001345303e/0x96d0c9b8c9a1f2d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559637:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001345303e/0x96d0c9b8c9a1f2d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559645:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001345303e/0x96d0c9b8c9a1f2d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559652:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001345303e/0x96d0c9b8c9a1f2d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559660:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:2.0:1788201581.559691:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.559696:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2e436a5/0x96d0c9b8c9a1f2d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559708:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b1:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.559711:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.559715:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2e436a5/0x96d0c9b8c9a1f2d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559725:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2e436a5/0x96d0c9b8c9a1f2d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559732:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2e436a5/0x96d0c9b8c9a1f2d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559739:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2e436a5/0x96d0c9b8c9a1f2d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559748:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:2.0:1788201581.559784:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.559789:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040ddaf75/0x96d0c9b8c9a1f2df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559796:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b0:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.559799:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.559802:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040ddaf75/0x96d0c9b8c9a1f2df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559810:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040ddaf75/0x96d0c9b8c9a1f2df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559823:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040ddaf75/0x96d0c9b8c9a1f2df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559831:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040ddaf75/0x96d0c9b8c9a1f2df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559840:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:2.0:1788201581.559879:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.559884:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093d699d/0x96d0c9b8c9a1f2e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559892:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3af:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.559895:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.559899:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093d699d/0x96d0c9b8c9a1f2e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559919:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000093d699d/0x96d0c9b8c9a1f2e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559927:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093d699d/0x96d0c9b8c9a1f2e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559934:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000093d699d/0x96d0c9b8c9a1f2e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.559954:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:2.0:1788201581.559990:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.559995:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000886792bf/0x96d0c9b8c9a1f2ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560002:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3ae:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.560005:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.560009:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000886792bf/0x96d0c9b8c9a1f2ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560042:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000886792bf/0x96d0c9b8c9a1f2ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560049:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000886792bf/0x96d0c9b8c9a1f2ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560056:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000886792bf/0x96d0c9b8c9a1f2ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560070:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:2.0:1788201581.560102:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.560107:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cf45d4a/0x96d0c9b8c9a1f2f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560115:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3ad:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.560123:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.560127:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cf45d4a/0x96d0c9b8c9a1f2f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560136:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cf45d4a/0x96d0c9b8c9a1f2f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560143:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cf45d4a/0x96d0c9b8c9a1f2f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560149:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cf45d4a/0x96d0c9b8c9a1f2f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560158:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:2.0:1788201581.560195:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.560200:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f86745e6/0x96d0c9b8c9a1f2fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560208:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3ac:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.560211:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.560215:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f86745e6/0x96d0c9b8c9a1f2fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560224:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f86745e6/0x96d0c9b8c9a1f2fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560232:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f86745e6/0x96d0c9b8c9a1f2fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560245:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f86745e6/0x96d0c9b8c9a1f2fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560254:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00002000:00010000:2.0:1788201581.560292:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.560297:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040edfed0/0x96d0c9b8c9a1f302 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560305:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3ab:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.560308:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.560312:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040edfed0/0x96d0c9b8c9a1f302 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560321:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040edfed0/0x96d0c9b8c9a1f302 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560328:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040edfed0/0x96d0c9b8c9a1f302 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560336:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040edfed0/0x96d0c9b8c9a1f302 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560345:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/20 locks to regular blp list, 20 blwis in pool 00002000:00010000:2.0:1788201581.560383:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.560388:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1f309 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560402:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3aa:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.560405:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.560410:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1f309 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560419:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1f309 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560427:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1f309 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560435:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1f309 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560443:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/21 locks to regular blp list, 21 blwis in pool 00002000:00010000:2.0:1788201581.560479:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.560484:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1f310 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560492:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a9:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.560494:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.560498:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1f310 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560507:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1f310 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560522:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1f310 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560529:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1f310 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560537:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/22 locks to regular blp list, 22 blwis in pool 00002000:00010000:2.0:1788201581.560577:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.560582:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566fdddc/0x96d0c9b8c9a1f317 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560590:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a8:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.560593:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.560597:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566fdddc/0x96d0c9b8c9a1f317 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560607:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000566fdddc/0x96d0c9b8c9a1f317 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560615:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566fdddc/0x96d0c9b8c9a1f317 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560622:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000566fdddc/0x96d0c9b8c9a1f317 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560640:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/23 locks to regular blp list, 23 blwis in pool 00002000:00010000:2.0:1788201581.560673:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.560678:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002723d596/0x96d0c9b8c9a1f31e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560685:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a7:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.560688:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.560691:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002723d596/0x96d0c9b8c9a1f31e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560700:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002723d596/0x96d0c9b8c9a1f31e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560707:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002723d596/0x96d0c9b8c9a1f31e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560714:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002723d596/0x96d0c9b8c9a1f31e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560722:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/24 locks to regular blp list, 24 blwis in pool 00002000:00010000:2.0:1788201581.560753:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.560758:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1f325 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560766:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a6:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.560775:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.560780:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1f325 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560789:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1f325 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560796:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1f325 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560803:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1f325 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560810:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/25 locks to regular blp list, 25 blwis in pool 00002000:00010000:2.0:1788201581.560846:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.560851:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1f32c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560858:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a5:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.560861:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.560864:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1f32c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560872:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1f32c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560879:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1f32c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560891:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1f32c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560915:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/26 locks to regular blp list, 26 blwis in pool 00002000:00010000:2.0:1788201581.560957:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.560962:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1f333 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560969:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a4:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.560972:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.560976:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1f333 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560984:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1f333 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.560993:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1f333 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.561000:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1f333 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.561009:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/27 locks to regular blp list, 27 blwis in pool 00002000:00010000:2.0:1788201581.561373:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.561379:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6188192/0x96d0c9b8c9a1f33a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.561392:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a3:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.561395:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.561399:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6188192/0x96d0c9b8c9a1f33a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.561409:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6188192/0x96d0c9b8c9a1f33a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.561417:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6188192/0x96d0c9b8c9a1f33a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.561424:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6188192/0x96d0c9b8c9a1f33a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.561433:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/28 locks to regular blp list, 28 blwis in pool 00002000:00010000:2.0:1788201581.561468:0:100688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201581.561473:0:100688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016617895/0x96d0c9b8c9a1f341 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.561480:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a2:0x0].0x0 since=4433s v=(0 0) 00010000:00010000:2.0:1788201581.561483:0:100688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201581.561487:0:100688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016617895/0x96d0c9b8c9a1f341 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.561494:0:100688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016617895/0x96d0c9b8c9a1f341 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.561509:0:100688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016617895/0x96d0c9b8c9a1f341 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.561516:0:100688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016617895/0x96d0c9b8c9a1f341 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201581.561523:0:100688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/29 locks to regular blp list, 29 blwis in pool 00010000:00010000:0.0:1788201581.563389:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 28 total in blp. (28 blwis in pool) 00010000:00010000:0.0:1788201581.563401:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1f27d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563424:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201581.563430:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1f27d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563440:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1f27d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563461:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1f27d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563469:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1f27d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563493:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 27 total in blp. (27 blwis in pool) 00010000:00010000:0.0:1788201581.563497:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1f284 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563504:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201581.563507:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1f284 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563513:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1f284 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563522:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1f284 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563536:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1f284 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563550:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 26 total in blp. (26 blwis in pool) 00010000:00010000:0.0:1788201581.563554:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1f28b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563560:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201581.563563:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1f28b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563571:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1f28b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563580:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1f28b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563588:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1f28b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563599:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 25 total in blp. (25 blwis in pool) 00010000:00010000:0.0:1788201581.563602:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1f292 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563608:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201581.563617:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1f292 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563624:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1f292 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563633:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1f292 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563640:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1f292 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563652:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 24 total in blp. (24 blwis in pool) 00010000:00010000:0.0:1788201581.563656:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1f299 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563662:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201581.563665:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1f299 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563672:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1f299 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563680:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1f299 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563686:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1f299 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563704:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 23 total in blp. (23 blwis in pool) 00010000:00010000:0.0:1788201581.563707:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1f2a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563713:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201581.563717:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1f2a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563725:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1f2a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563735:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1f2a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563742:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1f2a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563753:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 22 total in blp. (22 blwis in pool) 00010000:00010000:0.0:1788201581.563756:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1f2a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563761:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbca00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201581.563763:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1f2a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563783:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1f2a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563793:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1f2a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563800:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1f2a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563818:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 21 total in blp. (21 blwis in pool) 00010000:00010000:0.0:1788201581.563822:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000944e21c3/0x96d0c9b8c9a1f2ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563828:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc125ae3c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201581.563831:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000944e21c3/0x96d0c9b8c9a1f2ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563837:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000944e21c3/0x96d0c9b8c9a1f2ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563845:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000944e21c3/0x96d0c9b8c9a1f2ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563851:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000944e21c3/0x96d0c9b8c9a1f2ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563875:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 20 total in blp. (20 blwis in pool) 00010000:00010000:0.0:1788201581.563879:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1f2b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563886:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201581.563889:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1f2b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563896:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1f2b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563916:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1f2b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563923:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1f2b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563936:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 19 total in blp. (19 blwis in pool) 00010000:00010000:0.0:1788201581.563939:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1f2bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563946:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201581.563949:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1f2bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563968:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1f2bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563979:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1f2bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563985:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1f2bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.563998:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:0.0:1788201581.564002:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dca8821c/0x96d0c9b8c9a1f2c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564012:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201581.564040:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dca8821c/0x96d0c9b8c9a1f2c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564048:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dca8821c/0x96d0c9b8c9a1f2c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564058:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dca8821c/0x96d0c9b8c9a1f2c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564064:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dca8821c/0x96d0c9b8c9a1f2c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564088:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:0.0:1788201581.564092:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afd47170/0x96d0c9b8c9a1f2ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564098:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201581.564101:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afd47170/0x96d0c9b8c9a1f2ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564631:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afd47170/0x96d0c9b8c9a1f2ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564645:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afd47170/0x96d0c9b8c9a1f2ca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564653:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afd47170/0x96d0c9b8c9a1f2ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564671:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:0.0:1788201581.564675:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001345303e/0x96d0c9b8c9a1f2d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564680:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201581.564683:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001345303e/0x96d0c9b8c9a1f2d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564704:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001345303e/0x96d0c9b8c9a1f2d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564714:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001345303e/0x96d0c9b8c9a1f2d1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564720:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001345303e/0x96d0c9b8c9a1f2d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564733:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:0.0:1788201581.564737:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2e436a5/0x96d0c9b8c9a1f2d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564742:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201581.564745:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2e436a5/0x96d0c9b8c9a1f2d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564752:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2e436a5/0x96d0c9b8c9a1f2d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564760:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2e436a5/0x96d0c9b8c9a1f2d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564767:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2e436a5/0x96d0c9b8c9a1f2d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564794:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:0.0:1788201581.564797:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040ddaf75/0x96d0c9b8c9a1f2df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564803:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201581.564806:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040ddaf75/0x96d0c9b8c9a1f2df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564813:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040ddaf75/0x96d0c9b8c9a1f2df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564824:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040ddaf75/0x96d0c9b8c9a1f2df lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564832:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040ddaf75/0x96d0c9b8c9a1f2df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564857:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:0.0:1788201581.564861:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000093d699d/0x96d0c9b8c9a1f2e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564867:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201581.564870:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000093d699d/0x96d0c9b8c9a1f2e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564887:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000093d699d/0x96d0c9b8c9a1f2e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564898:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000093d699d/0x96d0c9b8c9a1f2e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564914:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000093d699d/0x96d0c9b8c9a1f2e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564927:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:0.0:1788201581.564931:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000886792bf/0x96d0c9b8c9a1f2ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564937:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201581.564940:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000886792bf/0x96d0c9b8c9a1f2ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564948:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000886792bf/0x96d0c9b8c9a1f2ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564957:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000886792bf/0x96d0c9b8c9a1f2ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564963:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000886792bf/0x96d0c9b8c9a1f2ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564986:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:0.0:1788201581.564990:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cf45d4a/0x96d0c9b8c9a1f2f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.564997:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201581.565001:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cf45d4a/0x96d0c9b8c9a1f2f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.565008:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cf45d4a/0x96d0c9b8c9a1f2f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.565042:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cf45d4a/0x96d0c9b8c9a1f2f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.565050:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cf45d4a/0x96d0c9b8c9a1f2f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.565064:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1788201581.565068:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f86745e6/0x96d0c9b8c9a1f2fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.565074:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201581.565077:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f86745e6/0x96d0c9b8c9a1f2fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.565096:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f86745e6/0x96d0c9b8c9a1f2fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.565107:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f86745e6/0x96d0c9b8c9a1f2fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565568:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1788201581.565576:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040edfed0/0x96d0c9b8c9a1f302 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565584:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.565587:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040edfed0/0x96d0c9b8c9a1f302 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565594:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040edfed0/0x96d0c9b8c9a1f302 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565606:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040edfed0/0x96d0c9b8c9a1f302 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565613:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040edfed0/0x96d0c9b8c9a1f302 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565641:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1788201581.565645:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1f309 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565652:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.565655:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1f309 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565663:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1f309 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565674:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1f309 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565680:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1f309 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565693:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788201581.565697:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1f310 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565703:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.565706:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1f310 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565724:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1f310 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565741:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1f310 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565748:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1f310 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565761:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788201581.565765:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000566fdddc/0x96d0c9b8c9a1f317 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565771:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.565774:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000566fdddc/0x96d0c9b8c9a1f317 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565782:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000566fdddc/0x96d0c9b8c9a1f317 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565792:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000566fdddc/0x96d0c9b8c9a1f317 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565799:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000566fdddc/0x96d0c9b8c9a1f317 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565822:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788201581.565826:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002723d596/0x96d0c9b8c9a1f31e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565832:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.565835:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002723d596/0x96d0c9b8c9a1f31e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565843:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002723d596/0x96d0c9b8c9a1f31e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565853:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002723d596/0x96d0c9b8c9a1f31e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565860:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002723d596/0x96d0c9b8c9a1f31e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565872:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788201581.565876:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1f325 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565882:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.565885:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1f325 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565914:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1f325 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565926:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1f325 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565933:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1f325 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565947:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788201581.565950:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1f32c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565956:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.565959:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1f32c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565967:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1f32c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565975:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1f32c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.565982:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1f32c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.566006:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788201581.566010:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1f333 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.566102:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.566105:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1f333 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.566125:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1f333 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.566135:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1f333 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.566141:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1f333 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.566154:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201581.566158:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6188192/0x96d0c9b8c9a1f33a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.566164:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.566167:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6188192/0x96d0c9b8c9a1f33a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.566491:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6188192/0x96d0c9b8c9a1f33a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.566502:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6188192/0x96d0c9b8c9a1f33a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.566508:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6188192/0x96d0c9b8c9a1f33a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.566522:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201581.566526:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016617895/0x96d0c9b8c9a1f341 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.566532:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfe00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201581.566535:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016617895/0x96d0c9b8c9a1f341 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.566542:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016617895/0x96d0c9b8c9a1f341 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.566550:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016617895/0x96d0c9b8c9a1f341 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.566557:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016617895/0x96d0c9b8c9a1f341 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201581.566581:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.566583:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201581.566585:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201581.567809:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f86745e6/0x96d0c9b8c9a1f2fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 100688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201581.567830:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201581.567832:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201581.567834:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201581.567859:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788201581.572422:0:100688:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:803 00000100:00100000:2.0:1788201581.572531:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:107429:x1875060715479040:12345-0@lo:5:osp-pre-1-0.0 Request processed in 47046us (48990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201581.572542:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788201581.572602:0:107429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:107429:1875060715479040:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788201581.572619:0:107429:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x3c1:0x0] from OST, last_created [0x2c0000401:0x3c1:0x0]last_used is [0x2c0000401:0x323:0x0] 00000100:00100000:2.0:1788201581.572685:0:107429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:107429:1875060715479552:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788201581.572719:0:107429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201581.572741:0:107429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc109832cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201581.572756:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201581.572765:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715479424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201581.572787:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201581.572812:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715479424 00000100:00100000:2.0:1788201581.572819:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715479424 00000100:00100000:2.0:1788201581.574316:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788201581.574330:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715479424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201581.574359:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201581.574417:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715479424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201581.574424:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788201581.574970:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715479552 00000100:00100000:0.0:1788201581.574980:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715479552 00000100:00100000:2.0:1788201581.588049:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715479424:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788201581.589228:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201581.592002:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788201581.592036:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:107429:x1875060715479552:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788201581.592081:0:99767:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 962 00000100:00100000:0.0:1788201581.598378:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:107429:x1875060715479552:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6354us (25647us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788201581.598393:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788201581.604460:0:107429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:107429:1875060715479552:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788201581.604484:0:107429:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x3c1:0x0]-[0x2c0000401:0x3e1:0x0] 00000100:00080000:3.0:1788201581.713425:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201581.713432:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201581.713435:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201581.713438:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201581.713441:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201581.713444:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201581.713447:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201581.713449:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201581.713452:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201581.713464:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:3.0:1788201581.713572:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715480064:0@lo:400:kworker.0 00000100:00100000:3.0:1788201581.713644:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201581.713694:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788201581.713701:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715479680:0@lo:400:kworker.0 00000100:00100000:3.0:1788201581.713731:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201581.713759:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715480192:0@lo:400:kworker.0 00000100:00100000:3.0:1788201581.713784:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201581.713810:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715479808:0@lo:400:kworker.0 00000100:00100000:3.0:1788201581.713845:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201581.713863:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715480320:0@lo:400:kworker.0 00000100:00100000:3.0:1788201581.713882:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201581.713915:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201581.713921:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715479936:0@lo:400:kworker.0 00000100:00100000:3.0:1788201581.713947:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201581.713986:0:101189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715480064 00000100:00100000:3.0:1788201581.713993:0:101189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715480064 00000100:00100000:3.0:1788201581.714059:0:101189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715480192 00000100:00100000:3.0:1788201581.714062:0:101189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715480192 00000100:00100000:3.0:1788201581.714085:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788201581.714094:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715480064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201581.715095:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715480064:12345-0@lo:400:kworker.0 Request processed in 1000us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201581.715280:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788201581.715304:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788201581.715312:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715480192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201581.715342:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715480192:12345-0@lo:400:kworker.0 Request processed in 32us (1557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201581.715347:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788201581.715365:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715479680 00000100:00100000:3.0:1788201581.715369:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715479680 00000100:00100000:3.0:1788201581.715395:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788201581.715401:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005871850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715479680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201581.715425:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005871850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715479680:12345-0@lo:400:kworker.0 Request processed in 24us (1693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201581.715439:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788201581.715532:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715479936 00000100:00100000:3.0:1788201581.715536:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715479936 00000100:00100000:3.0:1788201581.715559:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788201581.715565:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715479936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201581.715600:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715479936:12345-0@lo:400:kworker.0 Request processed in 36us (1653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201581.715606:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788201581.715646:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715479936:0@lo:400:kworker.0 00000100:00100000:1.0:1788201581.715778:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715479808 00000100:00100000:1.0:1788201581.715783:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715479808 00000100:00100000:1.0:1788201581.715811:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715480320 00000100:00100000:1.0:1788201581.715814:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715480320 00000100:00100000:1.0:1788201581.715826:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201581.715832:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715479808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201581.715867:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715479808:12345-0@lo:400:kworker.0 Request processed in 35us (2021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201581.715873:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788201581.715888:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788201581.715893:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715480320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201581.715931:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715480320:12345-0@lo:400:kworker.0 Request processed in 38us (2047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201581.715945:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788201581.716398:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715479680:0@lo:400:kworker.0 00000100:00100000:0.0:1788201581.716420:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715480192:0@lo:400:kworker.0 00000100:00100000:0.0:1788201581.716429:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715480064:0@lo:400:kworker.0 00000100:00100000:3.0:1788201581.717430:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715480320:0@lo:400:kworker.0 00000100:00100000:3.0:1788201581.717451:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715479808:0@lo:400:kworker.0 00000001:02000400:2.0:1788201581.831619:0:107941:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788201581.919767:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788201581.936685:0:107952:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00000400:0.0:1788201582.550401:0:3656:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201565/real 1788201565] req@ffff8dc007159880 x1875060715461760/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201581 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201582.550437:0:3656:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8dc007159880 x1875060715461760/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788201581 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201582.550445:0:3656:0:(import.c:214:ptlrpc_set_import_discon()) lwp: import ffff8dc1401c3800 already not connected (conn 11, was 9): CONNECTING 00000100:00100000:0.0:1788201582.550463:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715461760:0@lo:400:kworker.0 00010000:00010000:0.0:1788201582.929141:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788201583.231207:0:108040:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788201583.233350:0:108040:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1788201583.424345:0:108066:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788201583.424705:0:108066:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788201583.951085:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788201584.343524:0:108149:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788201584.343758:0:108149:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1788201584.406791:0:108157:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788201584.407134:0:108157:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788201584.783404:0:3654:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201564/real 1788201564] req@ffff8dc10604b100 x1875060715461120/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201584 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201584.783440:0:3654:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dc10604b100 x1875060715461120/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201584 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201584.783450:0:3654:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201564/real 1788201564] req@ffff8dc106049180 x1875060715461376/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201584 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201584.783461:0:3654:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dc106049180 x1875060715461376/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201584 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201584.783480:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201584.783509:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788201584.783514:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715461120:0@lo:38:kworker.0 00000100:00080000:3.0:1788201584.783519:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201584.783528:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788201584.783531:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715461376:0@lo:38:kworker.0 00000100:00080000:2.0:1788201584.783698:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201584.783702:0:41592:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201584.783705:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201584.783707:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788201584.783710:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201584.783715:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 4415 00000100:00080000:2.0:1788201584.783719:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788201584.783725:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8dc13f86f000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201584.783744:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12b635500 x1875060715480576/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201584.783760:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201584.783763:0:41592:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201584.783765:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201584.783768:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788201584.783769:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201584.783782:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 4415 00000100:00080000:2.0:1788201584.783784:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788201584.783788:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8dc1401c2800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201584.783802:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12b636a00 x1875060715480704/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201584.783810:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201584.783813:0:41592:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:2.0:1788201584.783882:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715480576:0@lo:38:kworker.0 00000100:00100000:2.0:1788201584.783939:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201584.783971:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715480704:0@lo:38:kworker.0 00000100:00100000:2.0:1788201584.783994:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201584.784069:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715480576 00000100:00100000:2.0:1788201584.784077:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715480576 00000100:00100000:2.0:1788201584.784109:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715480704 00000100:00100000:2.0:1788201584.784113:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715480704 00000100:00100000:2.0:1788201584.784125:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788201584.784132:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715480576:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788201584.784159:0:107403:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 4436 last 0 00000020:00000080:2.0:1788201584.784207:0:107403:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x96d0c9b8c9a1f348 00000004:00100000:2.0:1788201584.784221:0:107403:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201584.784250:0:107403:0:(import.c:65:import_set_state_nolock()) ffff8dc13f83c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201584.784296:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875060715480576:12345-0@lo:38:kworker.0 Request processed in 163us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201584.784302:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788201584.784319:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788201584.784345:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715480704:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788201584.784359:0:107403:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 4436 last 0 00000020:00000080:2.0:1788201584.784381:0:107403:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x96d0c9b8c9a1f34f 00000004:00100000:2.0:1788201584.784387:0:107403:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201584.784401:0:107403:0:(import.c:65:import_set_state_nolock()) ffff8dc13f83b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201584.784427:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875060715480704:12345-0@lo:38:kworker.0 Request processed in 81us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201584.784434:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788201584.784471:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc12b635500 x1875060715480576/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201584.784484:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 20 00000100:00100000:3.0:1788201584.784785:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715481088:0@lo:400:kworker.0 00000100:00100000:3.0:1788201584.784815:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201584.784835:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715481600:0@lo:400:kworker.0 00000100:00100000:3.0:1788201584.784865:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201584.784882:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788201584.784887:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715480448:0@lo:400:kworker.0 00000100:00100000:3.0:1788201584.784911:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201584.784934:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715481216:0@lo:400:kworker.0 00000100:00100000:3.0:1788201584.784954:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201584.784977:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715480448 00000100:00100000:3.0:1788201584.784981:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715480448 00000100:00100000:3.0:1788201584.785009:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788201584.785240:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005872450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715480448:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788201584.785246:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-lwp-OST0000: lwp recover req@ffff8dc12b635500 x1875060715480576/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201609 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201584.785254:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788201584.785258:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788201584.785261:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788201584.785266:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715480576:0@lo:38:kworker.0 00000100:00100000:3.0:1788201584.785280:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005872450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715480448:12345-0@lo:400:kworker.0 Request processed in 265us (368us total) trans 0 rc 0/0 00010000:00080000:2.0:1788201584.785281:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc12b636a00 x1875060715480704/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201584.785287:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1788201584.785291:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 20 00000100:00100000:3.0:1788201584.785314:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715481216 00000100:00100000:3.0:1788201584.785317:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715481216 00000100:00100000:3.0:1788201584.785339:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788201584.785345:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715481216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201584.785386:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715481216:12345-0@lo:400:kworker.0 Request processed in 41us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201584.785392:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788201584.785420:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715480448:0@lo:400:kworker.0 00000100:00100000:3.0:1788201584.785428:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715481216:0@lo:400:kworker.0 00000100:00080000:2.0:1788201584.786012:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0001-lwp-OST0001: lwp recover req@ffff8dc12b636a00 x1875060715480704/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201609 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201584.786041:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788201584.786044:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788201584.786057:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788201584.786061:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715480704:0@lo:38:kworker.0 00000100:00100000:2.0:1788201584.786089:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715481088 00000100:00100000:2.0:1788201584.786092:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715481088 00000100:00100000:2.0:1788201584.786129:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715481600 00000100:00100000:2.0:1788201584.786133:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715481600 00000100:00100000:2.0:1788201584.786146:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201584.786152:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715481088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201584.786199:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715481088:12345-0@lo:400:kworker.0 Request processed in 46us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201584.786205:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201584.786217:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201584.786223:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715481600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201584.786247:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715481600:12345-0@lo:400:kworker.0 Request processed in 24us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201584.786252:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201584.786283:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715481088:0@lo:400:kworker.0 00000100:00100000:2.0:1788201584.786295:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715481600:0@lo:400:kworker.0 00000100:00100000:0.0:1788201584.787470:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715480832:0@lo:400:kworker.0 00000100:00100000:0.0:1788201584.787527:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201584.787575:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715481344:0@lo:400:kworker.0 00000100:00100000:0.0:1788201584.787597:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201584.787636:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788201584.787643:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715480960:0@lo:400:kworker.0 00000100:00100000:0.0:1788201584.787666:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201584.787686:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715481472:0@lo:400:kworker.0 00000100:00100000:0.0:1788201584.787706:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201584.787741:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715480832 00000100:00100000:0.0:1788201584.787747:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715480832 00000100:00100000:0.0:1788201584.787790:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715481344 00000100:00100000:0.0:1788201584.787793:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715481344 00000100:00100000:0.0:1788201584.787813:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715480960 00000100:00100000:0.0:1788201584.787829:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715480960 00000100:00100000:0.0:1788201584.787862:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715481472 00000100:00100000:0.0:1788201584.787865:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715481472 00000100:00100000:0.0:1788201584.787886:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788201584.787894:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715480832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201584.787896:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788201584.787904:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715481344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201584.788100:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715480832:12345-0@lo:400:kworker.0 Request processed in 207us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201584.788108:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788201584.788126:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788201584.788133:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715480960:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788201584.789973:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201584.789983:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201584.790007:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788201584.790044:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715481472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201584.796350:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715481344:12345-0@lo:400:kworker.0 Request processed in 8436us (8740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201584.796366:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788201584.814964:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715480960:12345-0@lo:400:kworker.0 Request processed in 26819us (27285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201584.814981:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788201584.815096:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715480960:0@lo:400:kworker.0 00000100:00100000:1.0:1788201584.821589:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715481472:12345-0@lo:400:kworker.0 Request processed in 31565us (33873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201584.821606:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788201584.828583:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715481472:0@lo:400:kworker.0 00000100:00100000:1.0:1788201584.829372:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715480832:0@lo:400:kworker.0 00000100:00100000:1.0:1788201584.829389:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715481344:0@lo:400:kworker.0 00010000:00010000:2.0:1788201584.976336:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201585.562718:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201585.562773:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201585.563722:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695579648 00000100:00100000:2.0:1788201585.563732:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695579648 00000100:00100000:2.0:1788201585.563814:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 89 00000100:00100000:2.0:1788201585.563825:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005870450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695579648:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201585.563915:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005870450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695579648:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 91us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201585.563942:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 89 00000100:00100000:3.0:1788201585.572515:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695579776 00000100:00100000:3.0:1788201585.572530:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695579776 00000100:00100000:3.0:1788201585.572613:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:3.0:1788201585.572625:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695579776:12345-192.168.201.20@tcp:400:kworker.0 00000100:00080000:1.0:1788201585.572746:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201585.592734:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695579776:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 20099us (29948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201585.592752:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:0.0:1788201585.593126:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201585.594271:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695579904 00000100:00100000:3.0:1788201585.594282:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695579904 00000100:00100000:3.0:1788201585.594438:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:3.0:1788201585.594446:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875060695579904:12345-192.168.201.20@tcp:38:kworker.0 00010000:00080000:3.0:1788201585.594478:0:107405:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '6e293f14-c501-4bc5-9dd4-a18ef02756b4' at ffff8dc1341df000, cookie 0x96d0c9b8c9a1efdd 00010000:00080000:3.0:1788201585.594485:0:107405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp recovering/t81604378641 exp ffff8dc1341df000 cur 4437 last 1788201576 00000004:00100000:3.0:1788201585.594515:0:107405:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788201585.594685:0:107405:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201585.594777:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695579904:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 330us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201585.594785:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 11 00010000:00080000:0.0:1788201585.600613:0:107480:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1788201585.600625:0:107480:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 81604378641 00000020:00080000:0.0:1788201585.600633:0:107480:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:0.0:1788201585.600636:0:107480:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 81604378641 00000020:00080000:0.0:1788201585.600640:0:107480:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:0.0:1788201585.600642:0:107480:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 81604378641 00000100:00100000:1.0:1788201585.606966:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201585.607038:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695574912 00000100:00100000:3.0:1788201585.607048:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695574912 00000100:00100000:3.0:1788201585.607230:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:3.0:1788201585.607240:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695574912:12345-192.168.201.20@tcp:101:mkdir.0 00010000:00080000:3.0:1788201585.607260:0:107404:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 81604378641, current: 81604378641, replaying 00000100:00100000:3.0:1788201585.607427:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695574912:12345-192.168.201.20@tcp:101:mkdir.0 Request processed in 188us (470us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201585.607435:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 12 00000020:00080000:0.0:1788201585.610712:0:107480:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:0.0:1788201585.610721:0:107480:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 81604378641, next_transno: 81604378641 00010000:00080000:0.0:1788201585.610728:0:107480:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (81604378641) 00000020:00080000:0.0:1788201585.610731:0:107480:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:0.0:1788201585.610896:0:107480:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695574912 t81604378641 from 192.168.201.20@tcp req@ffff8dc106049500 x1875060695574912/t0(81604378641) o101->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:706/0 lens 520/0 e 0 to 0 dl 1788201596 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'mkdir.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1788201585.619727:0:107480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201585.619884:0:107480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1f356 lrc: 2/0,0 mode: --/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f786fe9 expref: -99 pid: 107480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788201585.638427:0:107480:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 18478us 00010000:00010000:2.0:1788201585.707686:0:107480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1f35d lrc: 3/0,1 mode: --/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.707709:0:107480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1f35d lrc: 3/0,1 mode: CW/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.707724:0:107480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1f35d lrc: 3/0,1 mode: CW/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.707740:0:107480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf800/0x96d0c9b8c9a1f364 lrc: 3/0,1 mode: --/PW res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.707747:0:107480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf800/0x96d0c9b8c9a1f364 lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.707754:0:107480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf800/0x96d0c9b8c9a1f364 lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107480 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201585.708272:0:107480:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xd:0x0]: returning size 4096 00010000:00010000:2.0:1788201585.708288:0:107480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1f36b lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.708297:0:107480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1f36b lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.708306:0:107480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1f36b lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.708330:0:107480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1f35d lrc: 3/0,1 mode: CW/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.708345:0:107480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1f35d lrc: 2/0,0 mode: CW/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 107480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.708352:0:107480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1f35d lrc: 3/0,0 mode: CW/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 107480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.708359:0:107480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201585.708363:0:107480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1f35d lrc: 3/0,0 mode: CW/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 107480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.708371:0:107480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1f35d lrc: 4/0,0 mode: CW/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 107480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.708384:0:107480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x3:0x0].0x0 (ffff8dc10bed3a00) 00010000:00010000:2.0:1788201585.708387:0:107480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201585.708391:0:107480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1f35d lrc: 2/0,0 mode: --/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 107480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.708398:0:107480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007ade000/0x96d0c9b8c9a1f35d lrc: 0/0,0 mode: --/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 107480 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201585.708412:0:107480:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e55efb63 reply state 000000003d501514 transno 81604378641 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf800/0x96d0c9b8c9a1f364 lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.708422:0:107480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf800/0x96d0c9b8c9a1f364 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.708429:0:107480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x3:0x0].0xf0209d98 (ffff8dc1421c6b00) 00010000:00010000:2.0:1788201585.708431:0:107480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201585.708434:0:107480:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788201585.708495:0:107480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1f356 lrc: 0/0,0 mode: --/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fe9 expref: 9 pid: 107480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.708517:0:107480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1f36b lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fe9 expref: 8 pid: 107480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.708525:0:107480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xd:0x0].0x0 (ffff8dc1421c6d00) 00010000:00010000:2.0:1788201585.708527:0:107480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201585.708530:0:107480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc007adfa00, rc 0) 00010000:00080000:2.0:1788201585.708610:0:107480:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0001: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788201585.716475:0:107480:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:2.0:1788201585.716484:0:107480:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 81604378642 00000020:00080000:2.0:1788201585.716490:0:107480:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:2.0:1788201585.716492:0:107480:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 81604378642 00000100:00100000:1.0:1788201585.720341:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201585.720909:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695580032 00000100:00100000:3.0:1788201585.720920:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695580032 00000100:00100000:3.0:1788201585.720975:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:3.0:1788201585.720985:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2399:x1875060695580032:12345-192.168.201.20@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1788201585.721009:0:107405:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc106049180 x1875060695580032/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:706/0 lens 224/0 e 0 to 0 dl 1788201596 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201585.722917:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:2399:x1875060695580032:12345-192.168.201.20@tcp:400:ldlm_lock_repla.0 Request processed in 1925us (2577us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201585.722931:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 8 00000020:00080000:1.0:1788201585.729918:0:107480:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:1.0:1788201585.729928:0:107480:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 81604378642 00010000:00080000:1.0:1788201585.729933:0:107480:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1788201585.729936:0:107480:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0001: Next update transno 0 00010000:00080000:1.0:1788201585.729964:0:107480:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1788201585.729968:0:107480:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1788201585.730500:0:107480:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 20, last_transno is 85899345920 00000001:00100000:3.0:1788201585.742676:0:107392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000001:00100000:3.0:1788201585.742694:0:107392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788201585.742724:0:107392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378641 is committed 00010000:00010000:2.0:1788201585.742934:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf800/0x96d0c9b8c9a1f364 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.742952:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf800/0x96d0c9b8c9a1f364 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.742960:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf800/0x96d0c9b8c9a1f364 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.742965:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201585.742970:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf800/0x96d0c9b8c9a1f364 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.742978:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf800/0x96d0c9b8c9a1f364 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.743073:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf800/0x96d0c9b8c9a1f364 lrc: 2/0,0 mode: --/TXN res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.743080:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adf800/0x96d0c9b8c9a1f364 lrc: 0/0,0 mode: --/TXN res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107480 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788201585.748382:0:107480:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1788201585.748434:0:107480:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0001: cancel recovery timer 00010000:00080000:1.0:1788201585.748450:0:107480:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8dc004b3b800 x1875060715478400/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:701/0 lens 224/0 e 0 to 0 dl 1788201591 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788201585.748580:0:107480:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.201.20@tcp: req@ffff8dc106049180 x1875060695580032/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:706/0 lens 224/0 e 0 to 0 dl 1788201596 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1788201585.748650:0:107480:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0001: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:3.0:1788201585.748708:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc005d73000 lustre-MDT0001_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788201585.748746:0:3654:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8dc004b3a300 x1875060715478400/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201596 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201585.748758:0:3654:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8dc004b3a300 x1875060715478400/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201596 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201585.748764:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc005d73000 lustre-MDT0001_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788201585.748781:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0001-osp-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788201585.748786:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715478400:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:0.0:1788201585.752236:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715481728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201585.752314:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201585.752371:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715481728 00000100:00100000:0.0:1788201585.752378:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715481728 00000100:00100000:0.0:1788201585.752428:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788201585.752437:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715481728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201585.752469:0:99775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445408768 avail 1299169280 00000100:00100000:0.0:1788201585.752520:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715481728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201585.752527:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788201585.752595:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715481728:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788201585.807232:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201585.807238:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788201585.807250:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201585.807253:0:76267:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788201585.807371:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715481984:0@lo:400:kworker.0 00000100:00100000:2.0:1788201585.807445:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201585.807486:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715482112:0@lo:400:kworker.0 00000100:00100000:2.0:1788201585.807491:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715482496:0@lo:400:kworker.0 00000100:00100000:2.0:1788201585.807542:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201585.807569:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715483008:0@lo:400:kworker.0 00000100:00100000:3.0:1788201585.807582:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201585.807689:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715481856:0@lo:400:kworker.0 00000100:00100000:1.0:1788201585.807724:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201585.807755:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715482368:0@lo:400:kworker.0 00000100:00100000:1.0:1788201585.807778:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201585.807794:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715482880:0@lo:400:kworker.0 00000100:00100000:1.0:1788201585.807837:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201585.807885:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715481856 00000100:00100000:1.0:1788201585.807892:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715481856 00000100:00100000:1.0:1788201585.807940:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788201585.807949:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005873050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715481856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201585.807994:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005873050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715481856:12345-0@lo:400:kworker.0 Request processed in 47us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201585.808001:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788201585.808061:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715481856:0@lo:400:kworker.0 00000100:00100000:3.0:1788201585.808349:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715482624:0@lo:400:kworker.0 00000100:00100000:3.0:1788201585.808393:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201585.808425:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788201585.808432:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715482240:0@lo:400:kworker.0 00000100:00100000:3.0:1788201585.808460:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201585.808480:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715482752:0@lo:400:kworker.0 00000100:00100000:3.0:1788201585.808501:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201585.808537:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715482368 00000100:00100000:3.0:1788201585.808543:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715482368 00000100:00100000:3.0:1788201585.809251:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715482880 00000100:00100000:3.0:1788201585.809259:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715482880 00000100:00100000:3.0:1788201585.809294:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715482240 00000100:00100000:3.0:1788201585.809298:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715482240 00000100:00100000:3.0:1788201585.809322:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715482752 00000100:00100000:3.0:1788201585.809326:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715482752 00000100:00100000:3.0:1788201585.809352:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788201585.809361:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715482368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201585.809432:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715482368:12345-0@lo:400:kworker.0 Request processed in 72us (1652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201585.809457:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788201585.809480:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788201585.809486:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715482880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201585.809519:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715482880:12345-0@lo:400:kworker.0 Request processed in 33us (1691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201585.809524:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788201585.809535:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788201585.809541:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715482240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201585.809575:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715482240:12345-0@lo:400:kworker.0 Request processed in 34us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201585.809581:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788201585.810311:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788201585.810324:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715482752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201585.810371:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715482752:12345-0@lo:400:kworker.0 Request processed in 51us (1868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201585.810378:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788201585.810421:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715482624 00000100:00100000:3.0:1788201585.810427:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715482624 00000100:00100000:2.0:1788201585.810453:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715481984 00000100:00100000:2.0:1788201585.810468:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715481984 00000100:00100000:3.0:1788201585.810476:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788201585.810485:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715482624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201585.810532:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715482624:12345-0@lo:400:kworker.0 Request processed in 48us (2139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201585.810538:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715482496 00000100:00100000:3.0:1788201585.810546:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788201585.810547:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715482496 00000100:00100000:2.0:1788201585.810576:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715482112 00000100:00100000:2.0:1788201585.810580:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715482112 00000100:00100000:2.0:1788201585.810607:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788201585.810617:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715481984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201585.810698:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715481984:12345-0@lo:400:kworker.0 Request processed in 83us (3256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201585.810722:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788201585.810738:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788201585.810744:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715482496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201585.810775:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715482496:12345-0@lo:400:kworker.0 Request processed in 31us (3234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201585.810781:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788201585.810793:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788201585.810992:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201585.811060:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715482368:0@lo:400:kworker.0 00000100:00100000:1.0:1788201585.811073:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715482880:0@lo:400:kworker.0 00000100:00100000:3.0:1788201585.811289:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715482240:0@lo:400:kworker.0 00000100:00100000:3.0:1788201585.811311:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715482752:0@lo:400:kworker.0 00000100:00100000:3.0:1788201585.811341:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715482624:0@lo:400:kworker.0 00000100:00100000:2.0:1788201585.811680:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715482112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201585.811735:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715482112:12345-0@lo:400:kworker.0 Request processed in 937us (4156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201585.811742:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788201585.811794:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715482112:0@lo:400:kworker.0 00000100:00100000:2.0:1788201585.812551:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201585.812611:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715481984:0@lo:400:kworker.0 00000100:00100000:1.0:1788201585.812934:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715483008 00000100:00100000:1.0:1788201585.812941:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715483008 00000100:00100000:1.0:1788201585.812991:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788201585.812999:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715483008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201585.813065:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715483008:12345-0@lo:400:kworker.0 Request processed in 67us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201585.813071:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788201585.813388:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715482496:0@lo:400:kworker.0 00000100:00100000:2.0:1788201585.813400:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715483008:0@lo:400:kworker.0 00000004:00000080:0.0:1788201585.821112:0:107480:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa0dd40dd3e10 00100000:10000000:0.0:1788201585.821131:0:107480:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000004:00080000:3.0:1788201585.838106:0:107457:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x602:0x0] 00000100:00100000:3.0:1788201585.838189:0:107457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:107457:1875060715483136:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788201585.838283:0:107457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201585.838340:0:107457:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005846c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201585.838404:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715483136 00000100:00100000:2.0:1788201585.838417:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715483136 00000100:00100000:2.0:1788201585.838485:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788201585.838496:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:107457:x1875060715483136:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788201585.838527:0:101191:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1601 -> diff = -63 00002000:02000040:2.0:1788201585.838532:0:101191:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:1539 to 0x280000400:1601) 00000004:00080000:0.0:1788201585.838714:0:107461:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x603:0x0] 00000100:00100000:0.0:1788201585.838743:0:107461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd1bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:107461:1875060715483264:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788201585.838781:0:107461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201585.838811:0:107461:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005c6c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201585.838876:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715483264 00000100:00100000:3.0:1788201585.838883:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715483264 00000100:00100000:3.0:1788201585.838949:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788201585.838958:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:107461:x1875060715483264:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788201585.838987:0:99767:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1601 -> diff = -62 00002000:02000040:3.0:1788201585.838992:0:99767:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:1540 to 0x2c0000400:1601) 00002000:00010000:2.0:1788201585.864083:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x641:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.864103:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1f372 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x641:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864144:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x641:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.864151:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x641:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.864160:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1f372 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864184:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1f372 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864195:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1f372 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864204:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1f372 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864234:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201585.864275:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201585.864291:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1f372 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.864306:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.864312:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1f372 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.864326:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1f372 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.864350:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1f372 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.864359:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1f372 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201585.864383:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x640:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.864398:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1f379 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864409:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x640:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.864413:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x640:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.864417:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1f379 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.864425:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201585.864427:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1f379 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.864430:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201585.864433:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201585.864445:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1f379 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864452:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1f379 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864473:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201585.864519:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x63f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.864524:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1f380 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864531:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63f:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.864535:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.864538:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1f380 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864548:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1f380 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864556:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1f380 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864563:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1f380 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864587:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788201585.864629:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x63e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.864635:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1f387 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x63e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864642:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63e:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.864645:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.864649:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1f387 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864657:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1f387 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864665:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1f387 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864672:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1f387 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864687:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788201585.864725:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x63d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.864730:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1f38e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x63d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864737:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63d:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.864746:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.864750:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1f38e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864759:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1f38e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864767:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1f38e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864775:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1f38e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864787:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788201585.864842:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x63c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.864848:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1f395 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x63c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864855:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63c:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.864858:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.864862:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1f395 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864871:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1f395 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864880:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1f395 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864893:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1f395 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864903:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788201585.864942:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x63b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.864947:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1f39c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x63b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864956:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63b:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.864959:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.864964:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1f39c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864973:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1f39c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864981:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1f39c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864988:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1f39c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.864997:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788201585.865068:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x63a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.865077:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1f3a3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.865078:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788201585.865095:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63a:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:1.0:1788201585.865096:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1f379 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.865100:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.865114:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1f3a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.865125:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.865135:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1f379 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.865136:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1f3a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.865180:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1f3a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.865181:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1f379 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.865238:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1f3a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.865246:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1f379 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.865264:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1788201585.865265:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1f379 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201585.865319:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x639:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201585.865326:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788201585.865326:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1f3aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.865338:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1f380 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.865343:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x639:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.865356:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x639:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201585.865360:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfe00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201585.865363:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1f3aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.865377:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1f380 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.865382:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1f3aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.865390:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1f380 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.865427:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1f3aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.865435:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1f380 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.865438:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1f3aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.865465:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1f380 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.865470:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1788201585.865492:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788201585.865497:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1f387 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.865507:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.865512:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1f387 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.865520:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1f387 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x63e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201585.865528:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x638:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201585.865532:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1f387 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x63e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.865537:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1f3b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x638:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.865553:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1f387 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x63e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.865558:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x638:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.865563:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x638:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.865574:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1f3b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.865599:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1f3b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.865605:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788201585.865620:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1f3b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.865629:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1f3b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.865652:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788201585.865693:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x637:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.865697:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1f3b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x637:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.865705:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x637:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.865707:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x637:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.865711:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1f3b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.865720:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1f3b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.865729:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1f3b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.865736:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1f3b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.865744:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788201585.865777:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x636:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.865783:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1f3bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x636:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.865790:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x636:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.865798:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x636:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.865802:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1f3bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.865811:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1f3bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.865820:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1f3bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.865890:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1f38e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.865904:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.865909:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1f38e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.865919:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1f38e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x63d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.865932:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1f38e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x63d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.865940:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1f38e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x63d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.865956:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788201585.865960:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1f395 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.865965:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.865969:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1f395 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.865989:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1f395 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x63c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.865998:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1f395 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x63c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.866008:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1f395 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x63c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.866051:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788201585.866056:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1f39c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.866062:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.866065:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1f39c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.866073:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1f39c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x63b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.866081:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1f39c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x63b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.866150:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1f39c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x63b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.866177:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788201585.866181:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1f3a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.866188:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.866191:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1f3a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.866198:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1f3a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.866209:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1f3a3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.866216:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1f3a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.866229:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201585.866233:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1f3aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.866239:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adee00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.866244:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1f3aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.866259:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201585.866265:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1f3aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.866270:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1f3b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.866294:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1f3aa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.866296:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adea00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201585.866306:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1f3b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.866310:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1f3aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.866338:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201585.866343:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1f3b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.866345:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1f3b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.866388:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.866392:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1f3b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.866397:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1f3b1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.866401:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1f3b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.866430:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1f3b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.866441:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1f3b8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.866451:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1f3b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.866461:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201585.866465:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201585.866470:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201585.866501:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201585.866505:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201585.866508:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201585.866522:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201585.866543:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201585.868124:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1f3bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.868198:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201585.868348:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x635:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.868356:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1f3c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x635:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.868370:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x635:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.868377:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x635:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.868385:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1f3c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.868402:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1f3c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.868413:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1f3c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.868446:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1f3c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.868480:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201585.868489:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1f3bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.868499:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201585.868505:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1f3bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.868515:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1f3bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.868536:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1f3bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.868552:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1f3bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.868581:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201585.868584:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1f3c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.868592:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201585.868596:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1f3c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.868604:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1f3c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.868616:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1f3c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.868625:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201585.868627:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201585.868629:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201585.868729:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788201585.868735:0:101191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1f3c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788201585.868799:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x634:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.868804:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1f3cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x634:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.868813:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x634:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.868816:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x634:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.868821:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1f3cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.868844:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1f3cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.868851:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1f3cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.868858:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1f3cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.868896:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201585.868938:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x633:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.868943:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1f3d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.868951:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x633:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.868955:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x633:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.868959:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1f3d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.868968:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1f3d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.868976:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1f3d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.868985:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1f3d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.868998:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788201585.869070:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x632:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.869075:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1f3db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869084:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x632:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.869092:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x632:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.869097:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1f3db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869107:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1f3db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869116:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1f3db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869124:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1f3db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869136:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788201585.869177:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x631:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.869183:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d38d639/0x96d0c9b8c9a1f3e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x631:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869191:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x631:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.869194:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x631:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.869198:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d38d639/0x96d0c9b8c9a1f3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869207:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d38d639/0x96d0c9b8c9a1f3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869216:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d38d639/0x96d0c9b8c9a1f3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869229:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d38d639/0x96d0c9b8c9a1f3e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869239:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788201585.869285:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x630:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.869290:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1f3e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x630:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869299:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x630:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.869302:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x630:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.869306:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1f3e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869316:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1f3e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869324:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1f3e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869333:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1f3e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869343:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788201585.869379:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x62f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.869384:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1f3f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x62f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869398:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62f:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.869401:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.869406:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1f3f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869415:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1f3f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869424:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1f3f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869446:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1f3f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869456:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788201585.869498:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x62e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.869503:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1f3f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x62e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869511:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62e:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.869514:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.869518:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1f3f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869527:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1f3f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869545:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1f3f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869553:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1f3f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869562:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1788201585.869601:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x62d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.869606:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1f3fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x62d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869614:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62d:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.869617:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.869621:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1f3fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869630:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1f3fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869638:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1f3fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869645:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1f3fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869666:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1788201585.869710:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x62c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.869715:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1f405 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x62c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869724:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62c:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.869726:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.869731:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1f405 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869740:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1f405 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869748:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1f405 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869756:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1f405 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869765:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:2.0:1788201585.869799:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x62b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.869805:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1f40c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869813:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62b:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.869821:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.869836:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1f40c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869846:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1f40c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869855:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1f40c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869863:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1f40c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869872:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:2.0:1788201585.869914:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x62a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.869919:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6099134/0x96d0c9b8c9a1f413 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x62a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869927:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62a:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.869930:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.869934:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6099134/0x96d0c9b8c9a1f413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869943:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6099134/0x96d0c9b8c9a1f413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869953:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6099134/0x96d0c9b8c9a1f413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869966:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6099134/0x96d0c9b8c9a1f413 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.869976:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:2.0:1788201585.870039:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x629:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.870045:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b840617e/0x96d0c9b8c9a1f41a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870054:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x629:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.870057:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x629:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.870061:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b840617e/0x96d0c9b8c9a1f41a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870071:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b840617e/0x96d0c9b8c9a1f41a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870079:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b840617e/0x96d0c9b8c9a1f41a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870087:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b840617e/0x96d0c9b8c9a1f41a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870096:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:2.0:1788201585.870132:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x628:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.870137:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc1702f9/0x96d0c9b8c9a1f421 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x628:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870150:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x628:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.870153:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x628:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.870158:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc1702f9/0x96d0c9b8c9a1f421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870167:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc1702f9/0x96d0c9b8c9a1f421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870176:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc1702f9/0x96d0c9b8c9a1f421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870184:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc1702f9/0x96d0c9b8c9a1f421 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870194:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:2.0:1788201585.870232:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x627:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.870237:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b005909c/0x96d0c9b8c9a1f428 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x627:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870246:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x627:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.870249:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x627:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.870253:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b005909c/0x96d0c9b8c9a1f428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870262:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b005909c/0x96d0c9b8c9a1f428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870277:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b005909c/0x96d0c9b8c9a1f428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870284:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b005909c/0x96d0c9b8c9a1f428 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870293:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:2.0:1788201585.870333:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x626:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.870338:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1f42f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x626:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870347:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x626:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.870350:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x626:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.870354:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1f42f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870364:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1f42f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870372:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1f42f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870380:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1f42f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870401:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:2.0:1788201585.870438:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x625:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.870443:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008eb566b/0x96d0c9b8c9a1f436 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x625:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870452:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x625:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.870455:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x625:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.870459:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008eb566b/0x96d0c9b8c9a1f436 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870468:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008eb566b/0x96d0c9b8c9a1f436 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870477:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008eb566b/0x96d0c9b8c9a1f436 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870485:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008eb566b/0x96d0c9b8c9a1f436 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870494:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:2.0:1788201585.870529:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x624:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.870534:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e365e6f9/0x96d0c9b8c9a1f43d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x624:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870542:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x624:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.870552:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x624:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.870557:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e365e6f9/0x96d0c9b8c9a1f43d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870567:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e365e6f9/0x96d0c9b8c9a1f43d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870576:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e365e6f9/0x96d0c9b8c9a1f43d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870583:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e365e6f9/0x96d0c9b8c9a1f43d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870593:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:2.0:1788201585.870631:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x623:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.870636:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eb5cf67/0x96d0c9b8c9a1f444 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870644:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x623:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.870647:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x623:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.870650:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eb5cf67/0x96d0c9b8c9a1f444 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870658:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eb5cf67/0x96d0c9b8c9a1f444 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870665:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001eb5cf67/0x96d0c9b8c9a1f444 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870678:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001eb5cf67/0x96d0c9b8c9a1f444 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870686:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:2.0:1788201585.870724:0:101191:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x622:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201585.870729:0:101191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edd72e98/0x96d0c9b8c9a1f44b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870737:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x622:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:2.0:1788201585.870740:0:101191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x622:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201585.870743:0:101191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edd72e98/0x96d0c9b8c9a1f44b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870753:0:101191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edd72e98/0x96d0c9b8c9a1f44b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870761:0:101191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edd72e98/0x96d0c9b8c9a1f44b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870768:0:101191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edd72e98/0x96d0c9b8c9a1f44b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.870778:0:101191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00010000:00010000:1.0:1788201585.871280:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:1.0:1788201585.871295:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1f3cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871308:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.871314:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1f3cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871325:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1f3cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871346:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1f3cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871354:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1f3cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871389:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:1.0:1788201585.871392:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1f3d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871398:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adec00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.871419:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1f3d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871426:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1f3d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871435:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1f3d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871442:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1f3d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871455:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:1.0:1788201585.871459:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1f3db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871465:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbca00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.871468:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1f3db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871474:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1f3db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871482:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1f3db lrc: 1/0,0 mode: --/PW res: [0x280000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871489:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1f3db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871507:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:1.0:1788201585.871511:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d38d639/0x96d0c9b8c9a1f3e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871519:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.871522:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d38d639/0x96d0c9b8c9a1f3e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871529:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d38d639/0x96d0c9b8c9a1f3e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871539:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d38d639/0x96d0c9b8c9a1f3e2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871546:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d38d639/0x96d0c9b8c9a1f3e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871560:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:1.0:1788201585.871563:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1f3e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871569:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.871572:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1f3e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871590:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1f3e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871600:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1f3e9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871606:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1f3e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871619:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:1.0:1788201585.871623:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1f3f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871629:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.871632:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1f3f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871638:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1f3f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x62f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871647:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1f3f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x62f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871654:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1f3f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x62f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871678:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:1.0:1788201585.871681:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1f3f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871689:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.871691:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1f3f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871698:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1f3f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x62e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871707:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1f3f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x62e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871713:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1f3f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x62e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871725:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:1.0:1788201585.871729:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1f3fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871734:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.871737:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1f3fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871754:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1f3fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x62d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871762:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1f3fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x62d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871768:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1f3fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x62d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871777:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:1.0:1788201585.871781:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1f405 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871787:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.871790:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1f405 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871797:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1f405 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x62c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871806:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1f405 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x62c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871813:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1f405 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x62c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871851:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:1.0:1788201585.871855:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1f40c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871862:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbde00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.871865:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1f40c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871873:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1f40c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871882:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1f40c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871889:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1f40c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871900:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1788201585.871904:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6099134/0x96d0c9b8c9a1f413 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871911:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbda00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.871914:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6099134/0x96d0c9b8c9a1f413 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871931:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6099134/0x96d0c9b8c9a1f413 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x62a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871941:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6099134/0x96d0c9b8c9a1f413 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x62a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871948:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6099134/0x96d0c9b8c9a1f413 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x62a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871960:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788201585.871964:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b840617e/0x96d0c9b8c9a1f41a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871970:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.871973:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b840617e/0x96d0c9b8c9a1f41a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871980:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b840617e/0x96d0c9b8c9a1f41a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871989:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b840617e/0x96d0c9b8c9a1f41a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.871995:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b840617e/0x96d0c9b8c9a1f41a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872036:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788201585.872041:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc1702f9/0x96d0c9b8c9a1f421 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872047:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.872050:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc1702f9/0x96d0c9b8c9a1f421 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872058:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc1702f9/0x96d0c9b8c9a1f421 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872068:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc1702f9/0x96d0c9b8c9a1f421 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872075:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc1702f9/0x96d0c9b8c9a1f421 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872088:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788201585.872091:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b005909c/0x96d0c9b8c9a1f428 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872098:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.872101:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b005909c/0x96d0c9b8c9a1f428 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872117:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b005909c/0x96d0c9b8c9a1f428 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872127:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b005909c/0x96d0c9b8c9a1f428 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872134:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b005909c/0x96d0c9b8c9a1f428 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872145:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788201585.872148:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1f42f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872153:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.872156:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1f42f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872162:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1f42f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872170:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1f42f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872177:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3afcc62/0x96d0c9b8c9a1f42f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872199:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788201585.872203:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008eb566b/0x96d0c9b8c9a1f436 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872209:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.872212:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008eb566b/0x96d0c9b8c9a1f436 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872219:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008eb566b/0x96d0c9b8c9a1f436 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872229:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008eb566b/0x96d0c9b8c9a1f436 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872236:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008eb566b/0x96d0c9b8c9a1f436 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872245:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201585.872249:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e365e6f9/0x96d0c9b8c9a1f43d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872254:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.872257:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e365e6f9/0x96d0c9b8c9a1f43d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872274:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e365e6f9/0x96d0c9b8c9a1f43d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872283:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e365e6f9/0x96d0c9b8c9a1f43d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872290:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e365e6f9/0x96d0c9b8c9a1f43d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872303:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201585.872307:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001eb5cf67/0x96d0c9b8c9a1f444 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872313:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.872316:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001eb5cf67/0x96d0c9b8c9a1f444 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872323:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001eb5cf67/0x96d0c9b8c9a1f444 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872332:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001eb5cf67/0x96d0c9b8c9a1f444 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872338:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eb5cf67/0x96d0c9b8c9a1f444 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872360:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201585.872363:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edd72e98/0x96d0c9b8c9a1f44b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872370:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.872373:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edd72e98/0x96d0c9b8c9a1f44b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872380:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edd72e98/0x96d0c9b8c9a1f44b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872390:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edd72e98/0x96d0c9b8c9a1f44b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872397:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edd72e98/0x96d0c9b8c9a1f44b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.872409:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201585.872411:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201585.872413:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201585.873443:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201585.873461:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201585.873468:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788201585.874386:0:101191:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000400:1538 00000100:00100000:2.0:1788201585.874657:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:107457:x1875060715483136:12345-0@lo:5:osp-pre-0-1.0 Request processed in 36156us (36367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201585.874678:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788201585.874923:0:107457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:107457:1875060715483136:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788201585.874944:0:107457:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x641:0x0] from OST, last_created [0x280000400:0x641:0x0]last_used is [0x280000400:0x602:0x0] 00000100:00100000:2.0:1788201585.875078:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715483392:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201585.875130:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201585.875266:0:107457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:107457:1875060715483520:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788201585.875299:0:107457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201585.875321:0:107457:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005c6c840 going to sleep for 11 seconds 00000100:00100000:0.0:1788201585.875345:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715483520 00000100:00100000:0.0:1788201585.875353:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715483520 00000100:00100000:0.0:1788201585.875401:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788201585.875412:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:107457:x1875060715483520:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788201585.875473:0:101192:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 1602 00002000:00010000:3.0:1788201585.875885:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x641:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.875896:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008489a425/0x96d0c9b8c9a1f452 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x641:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.875916:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x641:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.875921:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x641:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.875928:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008489a425/0x96d0c9b8c9a1f452 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.875946:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008489a425/0x96d0c9b8c9a1f452 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.875958:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008489a425/0x96d0c9b8c9a1f452 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.875972:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008489a425/0x96d0c9b8c9a1f452 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.875993:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201585.876114:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x640:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.876120:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002190e16a/0x96d0c9b8c9a1f459 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876129:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x640:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.876132:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x640:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.876136:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002190e16a/0x96d0c9b8c9a1f459 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876145:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002190e16a/0x96d0c9b8c9a1f459 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876154:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002190e16a/0x96d0c9b8c9a1f459 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876163:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002190e16a/0x96d0c9b8c9a1f459 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876178:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201585.876188:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201585.876195:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008489a425/0x96d0c9b8c9a1f452 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876210:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda8400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201585.876215:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008489a425/0x96d0c9b8c9a1f452 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876226:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008489a425/0x96d0c9b8c9a1f452 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876247:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008489a425/0x96d0c9b8c9a1f452 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876254:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008489a425/0x96d0c9b8c9a1f452 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x641:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876277:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201585.876281:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002190e16a/0x96d0c9b8c9a1f459 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876288:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda8600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201585.876292:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002190e16a/0x96d0c9b8c9a1f459 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876300:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002190e16a/0x96d0c9b8c9a1f459 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876310:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002190e16a/0x96d0c9b8c9a1f459 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876324:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002190e16a/0x96d0c9b8c9a1f459 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x640:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201585.876336:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715483392 00010000:00010000:3.0:1788201585.876340:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.876346:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.876348:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201585.876352:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715483392 00002000:00010000:3.0:1788201585.876398:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x63f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.876406:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf834a51/0x96d0c9b8c9a1f460 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876415:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x63f:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.876419:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x63f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.876424:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf834a51/0x96d0c9b8c9a1f460 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201585.876435:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00010000:00010000:3.0:1788201585.876441:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf834a51/0x96d0c9b8c9a1f460 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201585.876452:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715483392:12345-0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788201585.876469:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf834a51/0x96d0c9b8c9a1f460 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876481:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf834a51/0x96d0c9b8c9a1f460 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000024:1.0:1788201585.876490:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 896 free 3922464768 avail 3690942464 00010000:00010000:3.0:1788201585.876501:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201585.876555:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x63e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.876561:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3a5c061/0x96d0c9b8c9a1f467 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x63e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876570:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x63e:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.876573:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x63e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.876577:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3a5c061/0x96d0c9b8c9a1f467 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x63e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876586:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3a5c061/0x96d0c9b8c9a1f467 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x63e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876665:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3a5c061/0x96d0c9b8c9a1f467 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x63e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876674:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3a5c061/0x96d0c9b8c9a1f467 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x63e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876690:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201585.876698:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201585.876703:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf834a51/0x96d0c9b8c9a1f460 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876711:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda9200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201585.876715:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf834a51/0x96d0c9b8c9a1f460 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876735:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf834a51/0x96d0c9b8c9a1f460 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876746:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf834a51/0x96d0c9b8c9a1f460 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876754:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf834a51/0x96d0c9b8c9a1f460 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x63f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876769:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201585.876772:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3a5c061/0x96d0c9b8c9a1f467 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x63e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876780:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda8e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201585.876783:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3a5c061/0x96d0c9b8c9a1f467 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x63e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876792:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3a5c061/0x96d0c9b8c9a1f467 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x63e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876802:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3a5c061/0x96d0c9b8c9a1f467 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x63e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876810:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3a5c061/0x96d0c9b8c9a1f467 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x63e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876848:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.876850:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.876852:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201585.876895:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x63d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.876900:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040b0256d/0x96d0c9b8c9a1f46e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x63d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876909:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x63d:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.876913:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x63d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.876918:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b0256d/0x96d0c9b8c9a1f46e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x63d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876926:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040b0256d/0x96d0c9b8c9a1f46e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x63d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876935:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040b0256d/0x96d0c9b8c9a1f46e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x63d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876943:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040b0256d/0x96d0c9b8c9a1f46e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x63d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876956:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201585.876963:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201585.876967:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040b0256d/0x96d0c9b8c9a1f46e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x63d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876984:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda9000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201585.876988:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040b0256d/0x96d0c9b8c9a1f46e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x63d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.876997:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040b0256d/0x96d0c9b8c9a1f46e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x63d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.877008:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040b0256d/0x96d0c9b8c9a1f46e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x63d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.877045:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040b0256d/0x96d0c9b8c9a1f46e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x63d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.877059:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.877061:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.877063:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201585.877101:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x63c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.877107:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab0084d6/0x96d0c9b8c9a1f475 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x63c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.877115:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x63c:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.877118:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x63c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.877122:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab0084d6/0x96d0c9b8c9a1f475 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x63c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.877132:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab0084d6/0x96d0c9b8c9a1f475 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x63c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.877145:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab0084d6/0x96d0c9b8c9a1f475 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x63c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.877153:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab0084d6/0x96d0c9b8c9a1f475 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x63c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.877166:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201585.877173:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201585.877176:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab0084d6/0x96d0c9b8c9a1f475 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x63c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.877183:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda9600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201585.877188:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab0084d6/0x96d0c9b8c9a1f475 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x63c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.877195:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab0084d6/0x96d0c9b8c9a1f475 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x63c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.877206:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab0084d6/0x96d0c9b8c9a1f475 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x63c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.877213:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab0084d6/0x96d0c9b8c9a1f475 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x63c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.877225:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.877232:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.877234:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201585.877275:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x63b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.877280:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1c8c558/0x96d0c9b8c9a1f47c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x63b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.877287:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x63b:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.877290:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x63b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.877294:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1c8c558/0x96d0c9b8c9a1f47c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x63b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.877303:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1c8c558/0x96d0c9b8c9a1f47c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x63b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.877311:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1c8c558/0x96d0c9b8c9a1f47c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x63b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.877318:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1c8c558/0x96d0c9b8c9a1f47c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x63b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.877330:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201585.877337:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201585.877340:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1c8c558/0x96d0c9b8c9a1f47c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x63b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.877347:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda9400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201585.877350:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1c8c558/0x96d0c9b8c9a1f47c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x63b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.877367:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1c8c558/0x96d0c9b8c9a1f47c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x63b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.877377:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1c8c558/0x96d0c9b8c9a1f47c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x63b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.877384:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1c8c558/0x96d0c9b8c9a1f47c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x63b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.877395:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.877396:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.877398:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201585.877488:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+7:107457:x1875060715483520:12345-0@lo:5:osp-pre-0-1.0 Request processed in 2074us (2184us total) trans 12884901913 rc 0/0 00000100:00100000:0.0:1788201585.877499:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00010000:0.0:1788201585.877542:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201585.877584:0:107457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:107457:1875060715483520:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788201585.877600:0:107457:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x641:0x0]-[0x280000400:0x661:0x0] 00000100:00100000:0.0:1788201585.877647:0:107457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:107457:1875060715483648:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788201585.877692:0:107457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201585.877719:0:107457:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005c6c840 going to sleep for 11 seconds 00002000:00010000:3.0:1788201585.878718:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x63a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.878731:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ae48645/0x96d0c9b8c9a1f483 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.878748:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x63a:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.878752:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x63a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.878759:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ae48645/0x96d0c9b8c9a1f483 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.878771:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ae48645/0x96d0c9b8c9a1f483 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.878781:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ae48645/0x96d0c9b8c9a1f483 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.878800:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ae48645/0x96d0c9b8c9a1f483 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.878837:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201585.878920:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x639:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.878925:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042eddd92/0x96d0c9b8c9a1f48a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.878935:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x639:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.878938:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x639:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.878943:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042eddd92/0x96d0c9b8c9a1f48a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.878952:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042eddd92/0x96d0c9b8c9a1f48a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.878961:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042eddd92/0x96d0c9b8c9a1f48a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.878970:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042eddd92/0x96d0c9b8c9a1f48a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.878986:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201585.878997:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201585.879003:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ae48645/0x96d0c9b8c9a1f483 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879033:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda9800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201585.879039:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ae48645/0x96d0c9b8c9a1f483 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879048:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ae48645/0x96d0c9b8c9a1f483 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879064:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ae48645/0x96d0c9b8c9a1f483 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879072:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ae48645/0x96d0c9b8c9a1f483 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x63a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879095:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201585.879099:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042eddd92/0x96d0c9b8c9a1f48a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879106:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda8a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201585.879109:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042eddd92/0x96d0c9b8c9a1f48a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879117:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042eddd92/0x96d0c9b8c9a1f48a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879127:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042eddd92/0x96d0c9b8c9a1f48a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879140:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042eddd92/0x96d0c9b8c9a1f48a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x639:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879154:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.879155:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.879158:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201585.879202:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x638:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.879208:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a917869/0x96d0c9b8c9a1f491 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x638:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879216:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x638:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.879220:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x638:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.879224:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a917869/0x96d0c9b8c9a1f491 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879233:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a917869/0x96d0c9b8c9a1f491 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879242:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a917869/0x96d0c9b8c9a1f491 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879248:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a917869/0x96d0c9b8c9a1f491 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879263:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201585.879276:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201585.879281:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a917869/0x96d0c9b8c9a1f491 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879288:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda9c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201585.879292:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a917869/0x96d0c9b8c9a1f491 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879299:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a917869/0x96d0c9b8c9a1f491 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879310:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a917869/0x96d0c9b8c9a1f491 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879318:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a917869/0x96d0c9b8c9a1f491 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x638:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879330:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.879332:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.879334:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201585.879376:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x637:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.879381:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000855b4fd0/0x96d0c9b8c9a1f498 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x637:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879390:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x637:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.879393:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x637:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.879398:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000855b4fd0/0x96d0c9b8c9a1f498 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879418:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000855b4fd0/0x96d0c9b8c9a1f498 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879427:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000855b4fd0/0x96d0c9b8c9a1f498 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879435:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000855b4fd0/0x96d0c9b8c9a1f498 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879448:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201585.879455:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201585.879458:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000855b4fd0/0x96d0c9b8c9a1f498 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879466:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda9e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201585.879469:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000855b4fd0/0x96d0c9b8c9a1f498 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879477:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000855b4fd0/0x96d0c9b8c9a1f498 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879486:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000855b4fd0/0x96d0c9b8c9a1f498 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879494:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000855b4fd0/0x96d0c9b8c9a1f498 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x637:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879513:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.879514:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.879516:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201585.879557:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x636:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.879562:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000495f61/0x96d0c9b8c9a1f49f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x636:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879570:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x636:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.879573:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x636:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.879577:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000495f61/0x96d0c9b8c9a1f49f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879657:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000495f61/0x96d0c9b8c9a1f49f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879667:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000495f61/0x96d0c9b8c9a1f49f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879675:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000495f61/0x96d0c9b8c9a1f49f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879689:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201585.879696:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201585.879700:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000495f61/0x96d0c9b8c9a1f49f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879718:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda8800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201585.879721:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000495f61/0x96d0c9b8c9a1f49f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879730:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000495f61/0x96d0c9b8c9a1f49f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879741:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000495f61/0x96d0c9b8c9a1f49f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879750:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000495f61/0x96d0c9b8c9a1f49f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x636:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879763:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.879765:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.879767:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201585.879811:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x635:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.879817:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7b31281/0x96d0c9b8c9a1f4a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x635:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879840:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x635:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.879844:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x635:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.879848:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7b31281/0x96d0c9b8c9a1f4a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879858:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7b31281/0x96d0c9b8c9a1f4a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879871:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7b31281/0x96d0c9b8c9a1f4a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879879:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7b31281/0x96d0c9b8c9a1f4a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879892:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201585.879898:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201585.879902:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7b31281/0x96d0c9b8c9a1f4a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879908:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda9a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201585.879912:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7b31281/0x96d0c9b8c9a1f4a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879921:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7b31281/0x96d0c9b8c9a1f4a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879932:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7b31281/0x96d0c9b8c9a1f4a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879939:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7b31281/0x96d0c9b8c9a1f4a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x635:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.879951:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.879960:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.879962:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201585.880001:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x634:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.880006:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d413e82d/0x96d0c9b8c9a1f4ad lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x634:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880037:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x634:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.880041:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x634:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.880046:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d413e82d/0x96d0c9b8c9a1f4ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880055:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d413e82d/0x96d0c9b8c9a1f4ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880063:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d413e82d/0x96d0c9b8c9a1f4ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880071:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d413e82d/0x96d0c9b8c9a1f4ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880083:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201585.880089:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201585.880093:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d413e82d/0x96d0c9b8c9a1f4ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880100:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda8200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201585.880104:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d413e82d/0x96d0c9b8c9a1f4ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880124:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d413e82d/0x96d0c9b8c9a1f4ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880135:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d413e82d/0x96d0c9b8c9a1f4ad lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880144:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d413e82d/0x96d0c9b8c9a1f4ad lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x634:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880158:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.880160:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.880162:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201585.880202:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x633:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.880208:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ce118bf/0x96d0c9b8c9a1f4b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880216:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x633:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.880220:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x633:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.880224:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ce118bf/0x96d0c9b8c9a1f4b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880233:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ce118bf/0x96d0c9b8c9a1f4b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880242:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ce118bf/0x96d0c9b8c9a1f4b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880255:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ce118bf/0x96d0c9b8c9a1f4b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880267:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201585.880274:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201585.880277:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ce118bf/0x96d0c9b8c9a1f4b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880284:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda8000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201585.880287:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ce118bf/0x96d0c9b8c9a1f4b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880296:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ce118bf/0x96d0c9b8c9a1f4b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880307:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ce118bf/0x96d0c9b8c9a1f4b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880315:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ce118bf/0x96d0c9b8c9a1f4b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x633:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880328:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.880329:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.880331:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201585.880371:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x632:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.880381:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040f4b600/0x96d0c9b8c9a1f4bb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880390:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x632:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.880394:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x632:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.880398:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040f4b600/0x96d0c9b8c9a1f4bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880408:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040f4b600/0x96d0c9b8c9a1f4bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880416:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040f4b600/0x96d0c9b8c9a1f4bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880424:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040f4b600/0x96d0c9b8c9a1f4bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880436:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201585.880443:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201585.880446:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040f4b600/0x96d0c9b8c9a1f4bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880453:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc11cda8c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201585.880456:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040f4b600/0x96d0c9b8c9a1f4bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880463:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040f4b600/0x96d0c9b8c9a1f4bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880478:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040f4b600/0x96d0c9b8c9a1f4bb lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880486:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040f4b600/0x96d0c9b8c9a1f4bb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x632:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880498:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.880500:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.880502:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788201585.880540:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x631:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.880546:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f86745e6/0x96d0c9b8c9a1f4c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x631:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880554:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x631:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.880557:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x631:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.880561:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f86745e6/0x96d0c9b8c9a1f4c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880568:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f86745e6/0x96d0c9b8c9a1f4c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880576:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f86745e6/0x96d0c9b8c9a1f4c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.880584:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f86745e6/0x96d0c9b8c9a1f4c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.880885:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201585.880957:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715483392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4502us (5817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201585.880970:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788201585.881057:0:107416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715483648 00000100:00100000:1.0:1788201585.881066:0:107416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715483648 00000100:00100000:1.0:1788201585.881114:0:107416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201585.881122:0:107416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:107457:x1875060715483648:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788201585.881199:0:107416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:107457:x1875060715483648:12345-0@lo:900:osp-pre-0-1.0 Request processed in 78us (3508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201585.881206:0:107416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788201585.881246:0:107457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:107457:1875060715483648:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1788201585.881281:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.882976:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201585.883135:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x630:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.883145:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cf45d4a/0x96d0c9b8c9a1f4c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x630:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.883160:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x630:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.883165:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x630:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.883172:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cf45d4a/0x96d0c9b8c9a1f4c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.883187:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cf45d4a/0x96d0c9b8c9a1f4c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.883198:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cf45d4a/0x96d0c9b8c9a1f4c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.883206:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cf45d4a/0x96d0c9b8c9a1f4c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201585.884562:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715483392:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788201585.885064:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788201585.885076:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f86745e6/0x96d0c9b8c9a1f4c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.885089:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201585.885095:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f86745e6/0x96d0c9b8c9a1f4c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.885132:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f86745e6/0x96d0c9b8c9a1f4c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.885156:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f86745e6/0x96d0c9b8c9a1f4c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.885177:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f86745e6/0x96d0c9b8c9a1f4c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x631:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.885206:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201585.885210:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cf45d4a/0x96d0c9b8c9a1f4c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.885216:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74c00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201585.885219:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cf45d4a/0x96d0c9b8c9a1f4c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.885227:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cf45d4a/0x96d0c9b8c9a1f4c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.885237:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cf45d4a/0x96d0c9b8c9a1f4c9 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.885246:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201585.885248:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201585.885256:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.886741:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201585.886756:0:99767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cf45d4a/0x96d0c9b8c9a1f4c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x630:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201585.886937:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x62f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.886944:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000886792bf/0x96d0c9b8c9a1f4d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x62f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.886969:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x62f:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.886974:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x62f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.886982:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000886792bf/0x96d0c9b8c9a1f4d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x62f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.886998:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000886792bf/0x96d0c9b8c9a1f4d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x62f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.887009:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000886792bf/0x96d0c9b8c9a1f4d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x62f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.887031:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000886792bf/0x96d0c9b8c9a1f4d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x62f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.888036:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201585.888048:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000886792bf/0x96d0c9b8c9a1f4d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x62f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.888061:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201585.888066:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000886792bf/0x96d0c9b8c9a1f4d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x62f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.888078:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000886792bf/0x96d0c9b8c9a1f4d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x62f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.888100:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000886792bf/0x96d0c9b8c9a1f4d0 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x62f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.888111:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201585.888113:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201585.888115:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.888484:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201585.888492:0:99767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000886792bf/0x96d0c9b8c9a1f4d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x62f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201585.888614:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x62e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.888621:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093d699d/0x96d0c9b8c9a1f4d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x62e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.888632:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x62e:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.888637:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x62e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.888644:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093d699d/0x96d0c9b8c9a1f4d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x62e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.888674:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000093d699d/0x96d0c9b8c9a1f4d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x62e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.888684:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093d699d/0x96d0c9b8c9a1f4d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x62e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.888692:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000093d699d/0x96d0c9b8c9a1f4d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x62e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.888949:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201585.888956:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000093d699d/0x96d0c9b8c9a1f4d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x62e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.888964:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201585.888968:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000093d699d/0x96d0c9b8c9a1f4d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x62e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.888978:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000093d699d/0x96d0c9b8c9a1f4d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x62e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.889004:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000093d699d/0x96d0c9b8c9a1f4d7 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x62e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.889013:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201585.889117:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201585.889120:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.889197:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201585.889202:0:99767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000093d699d/0x96d0c9b8c9a1f4d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x62e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201585.889269:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x62d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.889274:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040ddaf75/0x96d0c9b8c9a1f4de lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x62d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.889282:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x62d:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.889287:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x62d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.889291:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040ddaf75/0x96d0c9b8c9a1f4de lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x62d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.889300:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040ddaf75/0x96d0c9b8c9a1f4de lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x62d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.889319:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040ddaf75/0x96d0c9b8c9a1f4de lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x62d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.889327:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040ddaf75/0x96d0c9b8c9a1f4de lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x62d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.889520:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201585.889528:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040ddaf75/0x96d0c9b8c9a1f4de lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x62d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.889537:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.889540:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040ddaf75/0x96d0c9b8c9a1f4de lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x62d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.889549:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040ddaf75/0x96d0c9b8c9a1f4de lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x62d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.889563:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040ddaf75/0x96d0c9b8c9a1f4de lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x62d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.889573:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201585.889581:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201585.889583:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.889644:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201585.889649:0:99767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040ddaf75/0x96d0c9b8c9a1f4de lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x62d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201585.889719:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x62c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.889725:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2e436a5/0x96d0c9b8c9a1f4e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x62c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.889734:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x62c:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.889738:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x62c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.889742:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2e436a5/0x96d0c9b8c9a1f4e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x62c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.889752:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2e436a5/0x96d0c9b8c9a1f4e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x62c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.889761:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2e436a5/0x96d0c9b8c9a1f4e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x62c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.889780:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2e436a5/0x96d0c9b8c9a1f4e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x62c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.889996:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201585.890002:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2e436a5/0x96d0c9b8c9a1f4e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x62c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.890010:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201585.890113:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2e436a5/0x96d0c9b8c9a1f4e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x62c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.890123:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2e436a5/0x96d0c9b8c9a1f4e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x62c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.890136:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2e436a5/0x96d0c9b8c9a1f4e5 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x62c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201585.890145:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201585.890146:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201585.890149:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.890197:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201585.890203:0:99767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2e436a5/0x96d0c9b8c9a1f4e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x62c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201585.890266:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x62b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.890272:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001345303e/0x96d0c9b8c9a1f4ec lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.890281:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x62b:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.890284:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x62b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.890289:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001345303e/0x96d0c9b8c9a1f4ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.890297:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001345303e/0x96d0c9b8c9a1f4ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.890305:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001345303e/0x96d0c9b8c9a1f4ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.890313:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001345303e/0x96d0c9b8c9a1f4ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.890381:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201585.890425:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x62a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.890441:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afd47170/0x96d0c9b8c9a1f4f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x62a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.890448:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x62a:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.890451:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x62a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.890455:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afd47170/0x96d0c9b8c9a1f4f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x62a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.890464:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afd47170/0x96d0c9b8c9a1f4f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x62a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.890472:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afd47170/0x96d0c9b8c9a1f4f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x62a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.890478:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afd47170/0x96d0c9b8c9a1f4f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x62a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.890564:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201585.890570:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001345303e/0x96d0c9b8c9a1f4ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.890579:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.890582:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001345303e/0x96d0c9b8c9a1f4ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.890590:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001345303e/0x96d0c9b8c9a1f4ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.890603:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001345303e/0x96d0c9b8c9a1f4ec lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.890610:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001345303e/0x96d0c9b8c9a1f4ec lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x62b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.890628:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201585.890632:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afd47170/0x96d0c9b8c9a1f4f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x62a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.890638:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201585.890642:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afd47170/0x96d0c9b8c9a1f4f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x62a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.890663:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afd47170/0x96d0c9b8c9a1f4f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x62a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.890674:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afd47170/0x96d0c9b8c9a1f4f3 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x62a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201585.890682:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201585.890684:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201585.890685:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201585.890798:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788201585.890803:0:99767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afd47170/0x96d0c9b8c9a1f4f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x62a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788201585.890907:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x629:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.890912:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dca8821c/0x96d0c9b8c9a1f4fa lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.890926:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x629:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.890929:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x629:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.890933:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dca8821c/0x96d0c9b8c9a1f4fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.890942:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dca8821c/0x96d0c9b8c9a1f4fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.890949:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dca8821c/0x96d0c9b8c9a1f4fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.890957:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dca8821c/0x96d0c9b8c9a1f4fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.890980:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788201585.891049:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x628:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.891055:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1f501 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x628:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891062:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x628:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.891065:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x628:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.891069:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1f501 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891079:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1f501 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891098:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1f501 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891106:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1f501 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891117:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788201585.891154:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x627:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.891158:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1f508 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x627:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891166:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x627:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.891169:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x627:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.891173:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1f508 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891182:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1f508 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891190:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1f508 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891198:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1f508 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891217:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788201585.891255:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x626:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.891259:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002723d596/0x96d0c9b8c9a1f50f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x626:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891267:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x626:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.891270:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x626:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.891274:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002723d596/0x96d0c9b8c9a1f50f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891283:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002723d596/0x96d0c9b8c9a1f50f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891291:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002723d596/0x96d0c9b8c9a1f50f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891299:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002723d596/0x96d0c9b8c9a1f50f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891306:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788201585.891342:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x625:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.891347:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566fdddc/0x96d0c9b8c9a1f516 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x625:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891353:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x625:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.891365:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x625:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.891369:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566fdddc/0x96d0c9b8c9a1f516 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891380:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000566fdddc/0x96d0c9b8c9a1f516 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891389:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566fdddc/0x96d0c9b8c9a1f516 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891398:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000566fdddc/0x96d0c9b8c9a1f516 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891407:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788201585.891728:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x624:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.891734:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1f51d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x624:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891743:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x624:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.891747:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x624:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.891751:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1f51d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891761:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1f51d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891770:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1f51d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891784:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1f51d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891792:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788201585.891854:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x623:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.891950:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1f524 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891960:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x623:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.891963:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x623:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.891967:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1f524 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891976:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1f524 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891984:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1f524 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.891992:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1f524 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.892002:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1788201585.892068:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x622:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201585.892073:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040edfed0/0x96d0c9b8c9a1f52b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.892086:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x622:0x0].0x0 since=4437s v=(0 0) 00010000:00010000:3.0:1788201585.892089:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x622:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201585.892093:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040edfed0/0x96d0c9b8c9a1f52b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.892102:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040edfed0/0x96d0c9b8c9a1f52b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.892110:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040edfed0/0x96d0c9b8c9a1f52b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.892117:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040edfed0/0x96d0c9b8c9a1f52b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201585.892127:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00080000:3.0:1788201585.892398:0:99767:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000400:1539 00010000:00010000:2.0:1788201585.892549:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1788201585.892558:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dca8821c/0x96d0c9b8c9a1f4fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892567:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201585.892572:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dca8821c/0x96d0c9b8c9a1f4fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892582:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dca8821c/0x96d0c9b8c9a1f4fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892601:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dca8821c/0x96d0c9b8c9a1f4fa lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892608:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dca8821c/0x96d0c9b8c9a1f4fa lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x629:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892633:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788201585.892637:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1f501 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892657:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201585.892661:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1f501 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892669:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1f501 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892680:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1f501 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892688:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfc3bf80/0x96d0c9b8c9a1f501 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x628:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892703:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788201585.892708:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1f508 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892714:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201585.892717:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1f508 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892724:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1f508 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892733:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1f508 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892746:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062d445f0/0x96d0c9b8c9a1f508 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x627:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892760:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788201585.892763:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002723d596/0x96d0c9b8c9a1f50f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892769:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201585.892772:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002723d596/0x96d0c9b8c9a1f50f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892781:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002723d596/0x96d0c9b8c9a1f50f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892792:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002723d596/0x96d0c9b8c9a1f50f lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892800:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002723d596/0x96d0c9b8c9a1f50f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x626:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892812:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788201585.892816:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000566fdddc/0x96d0c9b8c9a1f516 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892822:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201585.892850:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000566fdddc/0x96d0c9b8c9a1f516 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892859:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000566fdddc/0x96d0c9b8c9a1f516 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892875:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000566fdddc/0x96d0c9b8c9a1f516 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892884:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000566fdddc/0x96d0c9b8c9a1f516 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x625:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892896:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788201585.892899:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1f51d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892906:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201585.892909:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1f51d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892917:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1f51d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892925:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1f51d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892932:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ad58e75/0x96d0c9b8c9a1f51d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x624:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892948:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201585.892952:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1f524 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892959:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201585.892962:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1f524 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892969:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1f524 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892978:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1f524 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892985:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab41fff6/0x96d0c9b8c9a1f524 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.892994:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201585.892997:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040edfed0/0x96d0c9b8c9a1f52b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.893003:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c75000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201585.893006:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040edfed0/0x96d0c9b8c9a1f52b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.893044:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040edfed0/0x96d0c9b8c9a1f52b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.893054:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040edfed0/0x96d0c9b8c9a1f52b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.893063:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040edfed0/0x96d0c9b8c9a1f52b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201585.893076:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201585.893077:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201585.893079:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201585.893343:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:107461:x1875060715483264:12345-0@lo:5:osp-pre-1-1.0 Request processed in 54379us (54555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201585.893356:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00010000:1.0:1788201585.893586:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201585.893594:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201585.893675:0:107461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd1bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:107461:1875060715483264:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788201585.893704:0:107461:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x641:0x0] from OST, last_created [0x2c0000400:0x641:0x0]last_used is [0x2c0000400:0x603:0x0] 00000100:00100000:2.0:1788201585.893793:0:107461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:107461:1875060715483904:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788201585.893964:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715483776:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201585.894002:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201585.894084:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715483776 00000100:00100000:1.0:1788201585.894092:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715483776 00000100:00100000:1.0:1788201585.894141:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788201585.894151:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715483776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201585.894183:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 277312 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201585.894222:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715483776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201585.894229:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788201585.894262:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715483776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201585.894334:0:107461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201585.894365:0:107461:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f17b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201585.894535:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715483904 00000100:00100000:1.0:1788201585.894540:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715483904 00000100:00100000:1.0:1788201585.894573:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788201585.894595:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:107461:x1875060715483904:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788201585.894628:0:99764:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 1602 00010000:00010000:0.0:1788201585.896957:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201585.897974:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:107461:x1875060715483904:12345-0@lo:5:osp-pre-1-1.0 Request processed in 3371us (3632us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788201585.897993:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788201585.901216:0:107461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:107461:1875060715483904:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788201585.901246:0:107461:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x641:0x0]-[0x2c0000400:0x661:0x0] 00000100:00100000:2.0:1788201585.901321:0:107461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:107461:1875060715484032:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788201585.901406:0:107461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201585.901453:0:107461:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f17b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788201585.901713:0:107416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715484032 00000100:00100000:1.0:1788201585.901723:0:107416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715484032 00000100:00100000:1.0:1788201585.901799:0:107416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201585.901811:0:107416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:107461:x1875060715484032:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788201585.902040:0:107416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:107461:x1875060715484032:12345-0@lo:900:osp-pre-1-1.0 Request processed in 208us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201585.902048:0:107416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788201585.902093:0:107461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:107461:1875060715484032:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1788201585.999396:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201586.423462:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201586.423671:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695580160 00000100:00100000:1.0:1788201586.423702:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695580160 00000100:00100000:1.0:1788201586.423788:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:1.0:1788201586.423802:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:80087:x1875060695580160:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1788201586.423840:0:107405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201586.423874:0:107405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1f532 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78700c expref: -99 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201586.423959:0:107405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec400/0x96d0c9b8c9a1f539 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201586.423976:0:107405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec400/0x96d0c9b8c9a1f539 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201586.424013:0:107405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec400/0x96d0c9b8c9a1f539 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201586.424130:0:107405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788201586.424135:0:107405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201586.424197:0:107405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec400/0x96d0c9b8c9a1f539 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201586.424228:0:107405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1f532 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78700c expref: 9 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201586.424251:0:107405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec400/0x96d0c9b8c9a1f539 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78700c expref: 8 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201586.424260:0:107405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc10bed3e00) 00010000:00010000:1.0:1788201586.424263:0:107405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201586.424267:0:107405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ec400, rc 0) 00000100:00100000:1.0:1788201586.424350:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:80087:x1875060695580160:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 552us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201586.424358:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:0.0:1788201586.437607:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201586.437962:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695580288 00000100:00100000:3.0:1788201586.437975:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695580288 00000100:00100000:3.0:1788201586.438082:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:3.0:1788201586.438095:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:80087:x1875060695580288:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:3.0:1788201586.438145:0:107404:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444966400 avail 1298726912 00000100:00100000:3.0:1788201586.438244:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:80087:x1875060695580288:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 152us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201586.438260:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:0.0:1788201586.443266:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201586.443636:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695580416 00000100:00100000:2.0:1788201586.443649:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695580416 00000100:00100000:2.0:1788201586.446136:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:2.0:1788201586.446179:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:80087:x1875060695580416:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:2.0:1788201586.446230:0:107403:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445408768 avail 1299169280 00000100:00100000:2.0:1788201586.446374:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:80087:x1875060695580416:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 222us (3122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201586.446383:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:0.0:1788201586.453836:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201586.453965:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695580544 00000100:00100000:3.0:1788201586.453980:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695580544 00000100:00100000:3.0:1788201586.454091:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:3.0:1788201586.454102:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2399:x1875060695580544:12345-192.168.201.20@tcp:8:lfs.0 00010000:00080000:3.0:1788201586.454147:0:101188:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp t8589934594 exp 0000000000000000 cur 4437 last 0 00000020:00000080:3.0:1788201586.454202:0:101188:0:(genops.c:1385:class_connect()) connect: client 6e293f14-c501-4bc5-9dd4-a18ef02756b4, cookie 0x96d0c9b8c9a1f540 00002000:00100000:3.0:1788201586.454218:0:101188:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6e293f14-c501-4bc5-9dd4-a18ef02756b4/ffff8dc006d87800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8359936 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788201586.454232:0:101188:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788201586.454321:0:101188:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788201586.454361:0:101188:0:(import.c:65:import_set_state_nolock()) ffff8dc006d86000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201586.454931:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695580544:12345-192.168.201.20@tcp:8:lfs.0 Request processed in 826us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201586.454941:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:0.0:1788201586.475344:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201586.480424:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695580672 00000100:00100000:1.0:1788201586.480459:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695580672 00000100:00080000:2.0:1788201586.480661:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201586.481287:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 142 00000100:00100000:1.0:1788201586.481305:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:80087:x1875060695580672:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:1.0:1788201586.481342:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1788201586.481448:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:80087:x1875060695580672:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 148us (6118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201586.481478:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 142 00000100:00100000:0.0:1788201586.490090:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201586.490196:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695580800 00000100:00100000:2.0:1788201586.490211:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695580800 00000100:00100000:2.0:1788201586.490272:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 81 00000100:00100000:2.0:1788201586.490282:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2399:x1875060695580800:12345-192.168.201.20@tcp:8:lfs.0 00010000:00080000:2.0:1788201586.490330:0:101191:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp t0 exp 0000000000000000 cur 4437 last 0 00000020:00000080:2.0:1788201586.490369:0:101191:0:(genops.c:1385:class_connect()) connect: client 6e293f14-c501-4bc5-9dd4-a18ef02756b4, cookie 0x96d0c9b8c9a1f547 00002000:00100000:2.0:1788201586.490385:0:101191:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6e293f14-c501-4bc5-9dd4-a18ef02756b4/ffff8dc005fae800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788201586.490401:0:101191:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788201586.490487:0:101191:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788201586.490524:0:101191:0:(import.c:65:import_set_state_nolock()) ffff8dc13f83f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201586.490625:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695580800:12345-192.168.201.20@tcp:8:lfs.0 Request processed in 342us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201586.490634:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 81 00000100:00100000:0.0:1788201586.493145:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201586.493298:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695580928 00000100:00100000:1.0:1788201586.493310:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695580928 00000100:00100000:1.0:1788201586.493393:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 143 00000100:00100000:1.0:1788201586.493405:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:80087:x1875060695580928:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:1.0:1788201586.493441:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201586.493524:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:80087:x1875060695580928:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 121us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201586.493532:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 143 00000100:00080000:2.0:1788201586.493925:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201586.511622:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201586.511659:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715484160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201586.511776:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201586.512203:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715484160 00000100:00100000:0.0:1788201586.512216:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715484160 00000100:00100000:0.0:1788201586.512292:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788201586.512305:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715484160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201586.512360:0:99775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444966400 avail 1298726912 00000100:00100000:0.0:1788201586.512428:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715484160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201586.512436:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788201586.512493:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715484160:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1788201586.585527:0:100576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000001:00080000:0.0:1788201586.585551:0:100576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:0.0:1788201586.585632:0:100576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00100000:2.0:1788201586.593495:0:99761:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000001:00080000:2.0:1788201586.593520:0:99761:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901913 is committed 00000001:00080000:2.0:1788201586.593665:0:99761:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901912 is committed 00000100:00100000:2.0:1788201587.023547:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201587.023596:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715484288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201587.023728:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201587.023955:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715484288 00000100:00100000:3.0:1788201587.023967:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715484288 00000100:00100000:3.0:1788201587.024087:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788201587.024101:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715484288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201587.024138:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201587.024230:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715484288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201587.024238:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:2.0:1788201587.024800:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201587.024854:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901912 gen 2 00000100:00100000:2.0:1788201587.024882:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715484288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201587.026960:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715484416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201587.027082:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201587.027515:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715484416 00000100:00100000:0.0:1788201587.027531:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715484416 00000100:00100000:0.0:1788201587.027631:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788201587.027647:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715484416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201587.027938:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788201587.028077:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715484416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 435us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201587.028085:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788201587.028178:0:3655:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934595 gen 2 00000100:00100000:1.0:1788201587.028208:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715484416:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788201587.028831:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201587.030133:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788201588.049715:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201589.074578:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201590.095428:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201590.739463:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201590.739529:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201590.739579:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201590.739600:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201590.739622:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201590.739653:0:101189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695581440 00000100:00100000:0.0:1788201590.739665:0:101189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695581440 00000100:00100000:0.0:1788201590.739732:0:101189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695581568 00000100:00100000:0.0:1788201590.739736:0:101189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695581568 00000100:00100000:0.0:1788201590.739782:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 168 00000100:00100000:0.0:1788201590.739796:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695581440:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201590.739887:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695581440:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 94us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201590.739894:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 168 00000100:00100000:0.0:1788201590.739913:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 169 00000100:00100000:0.0:1788201590.739920:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695581568:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201590.739945:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695581568:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201590.739952:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 169 00000100:00100000:0.0:1788201590.739971:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695581056 00000100:00100000:0.0:1788201590.739974:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695581056 00000100:00100000:0.0:1788201590.740011:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 91 00000100:00100000:0.0:1788201590.740043:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695581056:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201590.740068:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695581056:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201590.740074:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 91 00000100:00080000:0.0:1788201590.740102:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201590.740114:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201590.740450:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695581184 00000100:00100000:3.0:1788201590.740456:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695581184 00000100:00100000:3.0:1788201590.740503:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695581312 00000100:00100000:3.0:1788201590.740507:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695581312 00000100:00100000:3.0:1788201590.740524:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:3.0:1788201590.740532:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2400:x1875060695581184:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201590.740580:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2400:x1875060695581184:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 49us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201590.740588:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:3.0:1788201590.740602:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:3.0:1788201590.740608:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2400:x1875060695581312:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201590.740631:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2400:x1875060695581312:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201590.740637:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00080000:0.0:1788201590.744713:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201590.744736:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201590.927221:0:3654:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201575/real 1788201575] req@ffff8dc12b634380 x1875060715462272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201590 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201590.927266:0:3654:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dc12b634380 x1875060715462272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201590 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201590.927279:0:3654:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201575/real 1788201575] req@ffff8dc12b636d80 x1875060715462144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201590 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201590.927305:0:3654:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dc12b636d80 x1875060715462144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788201590 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201590.927328:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201590.927359:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788201590.927364:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715462272:0@lo:38:kworker.0 00000100:00080000:0.0:1788201590.927371:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201590.927376:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788201590.927379:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715462144:0@lo:38:kworker.0 00000100:00080000:3.0:1788201590.927568:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201590.927573:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201590.927576:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201590.927582:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4427 00000100:00080000:3.0:1788201590.927588:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788201590.927596:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc11ccfb000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201590.927620:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efc9880 x1875060715484672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201590.927663:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201590.927667:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201590.927687:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201590.927691:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4427 00000100:00080000:3.0:1788201590.927694:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788201590.927698:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc1401c3800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201590.927713:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc12efc9500 x1875060715484928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201590.927879:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715484544:0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.927971:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201590.928060:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715485312:0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.928092:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201590.928113:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715485824:0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.928137:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201590.928163:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788201590.928168:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715485184:0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.928198:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201590.928216:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715485696:0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.928239:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201590.928279:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715485056:0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.928313:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201590.928333:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715485568:0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.928354:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201590.928371:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715486080:0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.928392:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201590.928410:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788201590.928415:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715484800:0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.928436:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201590.928446:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715485440:0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.928465:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201590.928480:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715485952:0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.928500:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201590.928531:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715485312 00000100:00100000:1.0:1788201590.928541:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715485312 00000100:00100000:1.0:1788201590.928601:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715485824 00000100:00100000:1.0:1788201590.928603:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715485824 00000100:00100000:1.0:1788201590.928620:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715485440 00000100:00100000:1.0:1788201590.928623:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715485440 00000100:00100000:1.0:1788201590.928638:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715485952 00000100:00100000:1.0:1788201590.928640:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715485952 00000100:00100000:1.0:1788201590.928659:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788201590.928668:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715485312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.928725:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715485312:12345-0@lo:400:kworker.0 Request processed in 57us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201590.928732:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788201590.928763:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788201590.928776:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715485824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.928806:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715485824:12345-0@lo:400:kworker.0 Request processed in 31us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201590.928812:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788201590.928825:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788201590.928831:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715485440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.928862:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715485440:12345-0@lo:400:kworker.0 Request processed in 30us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201590.928868:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788201590.928879:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788201590.928886:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715485952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.928916:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715485952:12345-0@lo:400:kworker.0 Request processed in 31us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201590.928922:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788201590.928944:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715485184 00000100:00100000:1.0:1788201590.928948:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715485184 00000100:00100000:1.0:1788201590.928969:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715485696 00000100:00100000:1.0:1788201590.928971:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715485696 00000100:00100000:1.0:1788201590.928983:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788201590.928988:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715485184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.929045:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715485184:12345-0@lo:400:kworker.0 Request processed in 56us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201590.929051:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788201590.929063:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788201590.929069:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715485696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.929097:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715485696:12345-0@lo:400:kworker.0 Request processed in 29us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201590.929109:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788201590.929130:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715485056 00000100:00100000:1.0:1788201590.929134:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715485056 00000100:00100000:1.0:1788201590.929155:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715485568 00000100:00100000:1.0:1788201590.929158:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715485568 00000100:00100000:1.0:1788201590.929168:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715486080 00000100:00100000:1.0:1788201590.929170:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715486080 00000100:00100000:1.0:1788201590.929179:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715484800 00000100:00100000:1.0:1788201590.929182:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715484800 00000100:00100000:1.0:1788201590.929194:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201590.929201:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715485056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.929232:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715485056:12345-0@lo:400:kworker.0 Request processed in 32us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201590.929238:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788201590.929251:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201590.929256:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715485568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.929283:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715485568:12345-0@lo:400:kworker.0 Request processed in 27us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201590.929289:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788201590.929300:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788201590.929305:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715486080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.929328:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715486080:12345-0@lo:400:kworker.0 Request processed in 23us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201590.929333:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788201590.929344:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788201590.929349:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715484800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.929387:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715484800:12345-0@lo:400:kworker.0 Request processed in 38us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201590.929393:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788201590.929439:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715484800:0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.929452:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715485440:0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.929460:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934596 gen 2 00000100:00100000:1.0:1788201590.929477:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715485952:0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.929489:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715485056:0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.929497:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715485568:0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.929506:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715486080:0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.929540:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715485184:0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.929549:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715485696:0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.929559:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715485312:0@lo:400:kworker.0 00000100:00100000:1.0:1788201590.929567:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901913 gen 2 00000100:00100000:1.0:1788201590.929576:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715485824:0@lo:400:kworker.0 00000100:00080000:0.0:1788201590.929791:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201590.929797:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201590.929800:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201590.929816:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715484672:0@lo:38:kworker.0 00000100:00100000:0.0:1788201590.929861:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201590.929893:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715484928:0@lo:38:kworker.0 00000100:00100000:0.0:1788201590.929916:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201590.929946:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715484672 00000100:00100000:0.0:1788201590.929958:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715484672 00000100:00100000:0.0:1788201590.929978:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715484928 00000100:00100000:0.0:1788201590.929980:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715484928 00000100:00100000:0.0:1788201590.930004:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788201590.930010:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715484672:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788201590.930063:0:107405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 4442 last 0 00000020:00000080:0.0:1788201590.930111:0:107405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x96d0c9b8c9a1f54e 00000004:00100000:0.0:1788201590.930132:0:107405:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788201590.930173:0:107405:0:(import.c:65:import_set_state_nolock()) ffff8dc137d30800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201590.930220:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875060715484672:12345-0@lo:38:kworker.0 Request processed in 209us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201590.930227:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788201590.930244:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788201590.930248:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715484928:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788201590.930260:0:107405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 4442 last 0 00000020:00000080:0.0:1788201590.930283:0:107405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x96d0c9b8c9a1f555 00000004:00100000:0.0:1788201590.930290:0:107405:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788201590.930306:0:107405:0:(import.c:65:import_set_state_nolock()) ffff8dc137d37800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201590.930338:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875060715484928:12345-0@lo:38:kworker.0 Request processed in 88us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201590.930345:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788201590.930388:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 31 00000100:00080000:0.0:1788201590.931284:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8dc12efc9880 x1875060715484672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201610 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201590.931296:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1788201590.931301:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788201590.931319:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1788201590.931326:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715484672:0@lo:38:kworker.0 00000100:00080000:0.0:1788201590.931355:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 31 00000100:00080000:0.0:1788201590.932254:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8dc12efc9500 x1875060715484928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201610 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201590.932264:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1788201590.932268:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788201590.932272:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1788201590.932277:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715484928:0@lo:38:kworker.0 00000100:00100000:3.0:1788201590.933098:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715484544 00000100:00100000:3.0:1788201590.933108:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715484544 00000100:00100000:3.0:1788201590.933183:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788201590.933195:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715484544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201590.933576:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715484544:12345-0@lo:400:kworker.0 Request processed in 381us (5603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201590.933585:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788201590.933665:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715484544:0@lo:400:kworker.0 00000100:00100000:3.0:1788201591.121277:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715486208:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788201591.121312:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201591.121386:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201591.121426:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715486208 00000100:00100000:1.0:1788201591.121436:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715486208 00000100:00100000:3.0:1788201591.121438:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201591.121445:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715486336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201591.121473:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201591.121497:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788201591.121510:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715486336 00000100:00100000:3.0:1788201591.121514:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715486336 00000100:00100000:1.0:1788201591.121520:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715486208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201591.121556:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1788201591.121613:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715486208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201591.121636:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788201591.121699:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715486208:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201591.121717:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788201591.121728:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715486336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788201591.121768:0:99776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445408768 avail 1299169280 00000100:00100000:3.0:1788201591.121824:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715486336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201591.121838:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788201591.121880:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715486464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201591.121911:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201591.122005:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715486336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201591.129121:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715486464 00000100:00100000:2.0:1788201591.129143:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715486464 00000100:00100000:2.0:1788201591.129245:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788201591.129259:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715486464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201591.129306:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201591.129430:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715486464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 172us (7517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201591.129438:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788201591.129907:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715486464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201591.631402:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715486592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201591.631513:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201591.631642:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715486592 00000100:00100000:0.0:1788201591.631653:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715486592 00000100:00100000:0.0:1788201591.631724:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788201591.631744:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715486592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788201591.631792:0:99776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444966400 avail 1298726912 00000100:00100000:0.0:1788201591.631865:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715486592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201591.631874:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788201591.632944:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715486592:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201592.147424:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201592.147459:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715486720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201592.147554:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201592.148377:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201592.148559:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715486720 00000100:00100000:3.0:1788201592.148569:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715486720 00000100:00100000:3.0:1788201592.148637:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788201592.148648:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715486720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201592.148670:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201592.148759:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715486720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201592.148765:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788201592.148815:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715486720:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788201592.148880:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201592.152292:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201592.152327:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715486848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201592.152430:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201592.152520:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715486848 00000100:00100000:2.0:1788201592.152529:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715486848 00000100:00100000:2.0:1788201592.152628:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788201592.152641:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715486848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201592.152671:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201592.152750:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715486848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201592.152778:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788201592.152851:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715486848:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788201592.152998:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:1.0:1788201592.955949:0:108362:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid,mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 00010000:00010000:3.0:1788201593.174219:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201594.191361:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788201595.153920:0:108410:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:3.0:1788201595.217650:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201595.863468:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201595.863510:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201595.863546:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201595.863573:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201595.863602:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201595.863640:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695581952 00000100:00100000:2.0:1788201595.863648:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695581952 00000100:00100000:2.0:1788201595.863711:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695581824 00000100:00100000:2.0:1788201595.863714:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695581824 00000100:00100000:2.0:1788201595.863735:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:2.0:1788201595.863745:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2402:x1875060695581952:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201595.863813:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2402:x1875060695581952:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 69us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201595.863821:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:2.0:1788201595.863838:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:2.0:1788201595.863845:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2402:x1875060695581824:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201595.863868:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2402:x1875060695581824:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 24us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201595.863874:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:0.0:1788201595.864122:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695581696 00000100:00100000:0.0:1788201595.864126:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695581696 00000100:00100000:0.0:1788201595.864172:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 93 00000100:00100000:0.0:1788201595.864196:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695581696:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201595.864222:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695581696:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 29us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201595.864228:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 93 00000100:00100000:0.0:1788201595.864257:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695582208 00000100:00100000:0.0:1788201595.864261:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695582208 00000100:00100000:0.0:1788201595.864286:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695582080 00000100:00100000:0.0:1788201595.864288:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695582080 00000100:00100000:0.0:1788201595.864305:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 174 00000100:00100000:0.0:1788201595.864311:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695582208:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201595.864333:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695582208:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201595.864338:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 174 00000100:00100000:0.0:1788201595.864349:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 175 00000100:00100000:0.0:1788201595.864355:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695582080:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201595.864375:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695582080:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 20us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201595.864380:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 175 00000100:00080000:0.0:1788201595.864394:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201595.864397:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201595.864399:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201595.864401:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788201596.239209:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201596.240328:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715486976:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201596.240401:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201596.240458:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715486976 00000100:00100000:2.0:1788201596.240465:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715486976 00000100:00100000:2.0:1788201596.240524:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788201596.240532:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715486976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201596.240565:0:99776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445408768 avail 1299169280 00000100:00100000:2.0:1788201596.240606:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715486976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201596.240627:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788201596.240685:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715486976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201596.242413:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715487360:0@lo:400:kworker.0 00000100:00100000:3.0:1788201596.242463:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201596.242489:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715487872:0@lo:400:kworker.0 00000100:00100000:3.0:1788201596.242509:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201596.242524:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715488384:0@lo:400:kworker.0 00000100:00100000:3.0:1788201596.242541:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201596.242558:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788201596.242563:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715487232:0@lo:400:kworker.0 00000100:00100000:3.0:1788201596.242587:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201596.242633:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715487744:0@lo:400:kworker.0 00000100:00100000:3.0:1788201596.242669:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201596.242687:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715488256:0@lo:400:kworker.0 00000100:00100000:3.0:1788201596.242710:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201596.245801:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715487872 00000100:00100000:0.0:1788201596.245810:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715487872 00000100:00100000:0.0:1788201596.245858:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715488384 00000100:00100000:0.0:1788201596.245861:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715488384 00000100:00100000:0.0:1788201596.245893:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788201596.245910:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715487872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201596.245989:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715487872:12345-0@lo:400:kworker.0 Request processed in 82us (3478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201596.245997:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788201596.246031:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788201596.246039:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715488384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201596.246067:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715488384:12345-0@lo:400:kworker.0 Request processed in 29us (3525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201596.246073:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788201596.246113:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715487872:0@lo:400:kworker.0 00000100:00100000:0.0:1788201596.246125:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715488384:0@lo:400:kworker.0 00000100:00100000:0.0:1788201596.246141:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201596.246152:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715488768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201596.246184:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788201596.246210:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201596.246394:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715487360 00000100:00100000:2.0:1788201596.246399:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715487360 00000100:00100000:2.0:1788201596.246440:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715487744 00000100:00100000:2.0:1788201596.246443:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715487744 00000100:00100000:2.0:1788201596.246457:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788201596.246464:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715487360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201596.246504:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715487360:12345-0@lo:400:kworker.0 Request processed in 41us (4040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201596.246511:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788201596.246522:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788201596.246527:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715487744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201596.246552:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715487744:12345-0@lo:400:kworker.0 Request processed in 25us (3883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201596.246558:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788201596.246574:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715487232 00000100:00100000:2.0:1788201596.246577:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715487232 00000100:00100000:2.0:1788201596.246599:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788201596.246616:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715487232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201596.246655:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715487232:12345-0@lo:400:kworker.0 Request processed in 40us (4058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201596.246670:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788201596.246703:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715488768 00000100:00100000:2.0:1788201596.246707:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715488768 00000100:00100000:2.0:1788201596.246733:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788201596.246739:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715488768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201596.246760:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201596.246789:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715488768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201596.246796:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788201596.246834:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715488768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201596.246844:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715487232:0@lo:400:kworker.0 00000100:00100000:2.0:1788201596.246854:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715487744:0@lo:400:kworker.0 00000100:00100000:2.0:1788201596.246864:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715487360:0@lo:400:kworker.0 00000100:00100000:2.0:1788201596.246891:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715487488:0@lo:400:kworker.0 00000100:00100000:2.0:1788201596.246917:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201596.246935:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715488000:0@lo:400:kworker.0 00000100:00100000:2.0:1788201596.246955:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201596.246971:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715488512:0@lo:400:kworker.0 00000100:00100000:2.0:1788201596.246987:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201596.247004:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788201596.247010:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715487104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201596.247054:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201596.247071:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715487616:0@lo:400:kworker.0 00000100:00100000:2.0:1788201596.247098:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201596.247113:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715488128:0@lo:400:kworker.0 00000100:00100000:2.0:1788201596.247133:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201596.247143:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715488640:0@lo:400:kworker.0 00000100:00100000:2.0:1788201596.247160:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201596.247178:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715488000 00000100:00100000:2.0:1788201596.247181:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715488000 00000100:00100000:2.0:1788201596.247203:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715488512 00000100:00100000:2.0:1788201596.247206:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715488512 00000100:00100000:2.0:1788201596.247221:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788201596.247227:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715488000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201596.247257:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715488000:12345-0@lo:400:kworker.0 Request processed in 30us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201596.247263:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788201596.247274:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788201596.247280:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715488512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201596.247302:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715488512:12345-0@lo:400:kworker.0 Request processed in 22us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201596.247309:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788201596.247325:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715487104 00000100:00100000:2.0:1788201596.247329:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715487104 00000100:00100000:2.0:1788201596.247346:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788201596.247352:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715487104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201596.247366:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201596.247392:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715487104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201596.247409:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788201596.247430:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715487488 00000100:00100000:2.0:1788201596.247433:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715487488 00000100:00100000:2.0:1788201596.247447:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715487616 00000100:00100000:2.0:1788201596.247450:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715487616 00000100:00100000:2.0:1788201596.247460:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715488128 00000100:00100000:2.0:1788201596.247462:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715488128 00000100:00100000:2.0:1788201596.247470:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715488640 00000100:00100000:2.0:1788201596.247472:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715488640 00000100:00100000:2.0:1788201596.247483:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788201596.247489:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715487488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201596.247516:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715487488:12345-0@lo:400:kworker.0 Request processed in 27us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201596.247523:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788201596.247532:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788201596.247538:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715487616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201596.247558:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715487616:12345-0@lo:400:kworker.0 Request processed in 21us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201596.247564:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788201596.247574:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788201596.247579:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715488128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201596.247601:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715488128:12345-0@lo:400:kworker.0 Request processed in 22us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201596.247606:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788201596.247615:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788201596.247621:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715488640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201596.247668:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715488640:12345-0@lo:400:kworker.0 Request processed in 48us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201596.247675:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788201596.247699:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715488256 00000100:00100000:2.0:1788201596.247703:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715488256 00000100:00100000:2.0:1788201596.247725:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788201596.247732:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715488256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201596.247765:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715488256:12345-0@lo:400:kworker.0 Request processed in 34us (5055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201596.247772:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788201596.247803:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715488256:0@lo:400:kworker.0 00000100:00100000:2.0:1788201596.247831:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715487104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201596.247842:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715487616:0@lo:400:kworker.0 00000100:00100000:2.0:1788201596.247851:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715488128:0@lo:400:kworker.0 00000100:00100000:2.0:1788201596.247860:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715488640:0@lo:400:kworker.0 00000100:00100000:2.0:1788201596.247868:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715487488:0@lo:400:kworker.0 00000100:00100000:2.0:1788201596.247877:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715488000:0@lo:400:kworker.0 00000100:00100000:2.0:1788201596.247885:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715488512:0@lo:400:kworker.0 00000100:00080000:0.0:1788201596.250351:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201596.250361:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201596.250364:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1788201596.691381:0:108459:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:0.0:1788201596.761869:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201596.761893:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715488896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201596.761964:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201596.762066:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715488896 00000100:00100000:2.0:1788201596.762076:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715488896 00000100:00100000:2.0:1788201596.762133:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788201596.762142:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715488896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201596.762191:0:99776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444966400 avail 1298726912 00000100:00100000:2.0:1788201596.762261:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715488896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201596.762268:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788201596.762364:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715488896:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788201597.263331:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201597.263381:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715489024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201597.263460:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201597.263511:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201597.263516:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715489152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201597.263539:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201597.263643:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715489024 00000100:00100000:3.0:1788201597.263651:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715489024 00000100:00100000:3.0:1788201597.263701:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715489152 00000100:00100000:3.0:1788201597.263704:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715489152 00000100:00100000:3.0:1788201597.263721:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788201597.263729:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715489024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201597.263751:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201597.263798:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715489024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201597.263805:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788201597.263822:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788201597.263828:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715489152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201597.263838:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788201597.263863:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715489152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201597.263868:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788201597.263909:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715489152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201597.263924:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715489024:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788201598.299765:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201598.864365:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201598.864446:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695582336 00000100:00100000:2.0:1788201598.864457:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695582336 00000100:00100000:2.0:1788201598.864525:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00100000:2.0:1788201598.864535:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:80711:x1875060695582336:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:2.0:1788201598.864572:0:107404:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444966400 avail 1298726912 00000100:00100000:2.0:1788201598.864652:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:80711:x1875060695582336:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 118us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201598.864659:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 18 00000100:00080000:1.0:1788201598.865047:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201598.867129:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201598.867301:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695582464 00000100:00100000:1.0:1788201598.867313:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695582464 00000100:00100000:1.0:1788201598.867407:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00100000:1.0:1788201598.867419:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:80711:x1875060695582464:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:1.0:1788201598.867463:0:107405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445408768 avail 1299169280 00000100:00100000:1.0:1788201598.867543:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:80711:x1875060695582464:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 126us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201598.867551:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 19 00000100:00080000:0.0:1788201598.867770:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201598.882778:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201598.882981:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695582592 00000100:00100000:3.0:1788201598.883042:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695582592 00000100:00100000:3.0:1788201598.883135:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 154 00000100:00100000:3.0:1788201598.883150:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:80711:x1875060695582592:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:3.0:1788201598.883210:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201598.883310:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:80711:x1875060695582592:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 164us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201598.883318:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 154 00000100:00100000:3.0:1788201598.885857:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00080000:0.0:1788201598.886047:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201598.887552:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695582720 00000100:00100000:2.0:1788201598.887571:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695582720 00000100:00100000:2.0:1788201598.887745:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 155 00000100:00100000:2.0:1788201598.887758:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:80711:x1875060695582720:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:2.0:1788201598.887801:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201598.887912:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:80711:x1875060695582720:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 156us (2068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201598.887940:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 155 00000100:00080000:0.0:1788201598.888787:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201598.965782:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201598.965920:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695582848 00000100:00100000:3.0:1788201598.965934:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695582848 00000100:00100000:3.0:1788201598.966041:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 780 00000100:00100000:3.0:1788201598.966057:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:71017:x1875060695582848:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788201598.966077:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201598.966113:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec400/0x96d0c9b8c9a1f539 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78700c expref: 8 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201598.966138:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc10bed3e00) 00010000:00010000:3.0:1788201598.966154:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201598.966250:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:71017:x1875060695582848:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 196us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201598.966259:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 780 00000100:00100000:1.0:1788201598.988009:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201598.988144:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695582976 00000100:00100000:2.0:1788201598.988157:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695582976 00000100:00100000:2.0:1788201598.988250:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:2.0:1788201598.988263:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:80736:x1875060695582976:12345-192.168.201.20@tcp:101:checkstat.0 00010000:00010000:2.0:1788201598.988304:0:107403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201598.988335:0:107403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f55c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f787013 expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.988443:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58400/0x96d0c9b8c9a1f563 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.988463:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58400/0x96d0c9b8c9a1f563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.988500:0:107403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58400/0x96d0c9b8c9a1f563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201598.988560:0:107403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788201598.988564:0:107403:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201598.988624:0:107403:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58400/0x96d0c9b8c9a1f563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.988651:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f55c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787013 expref: 9 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.988671:0:107403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58400/0x96d0c9b8c9a1f563 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787013 expref: 8 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.988709:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc107816400) 00010000:00010000:2.0:1788201598.988719:0:107403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201598.988723:0:107403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58400, rc 0) 00000100:00100000:2.0:1788201598.989263:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:80736:x1875060695582976:12345-192.168.201.20@tcp:101:checkstat.0 Request processed in 1001us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201598.989273:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 20 00000100:00100000:1.0:1788201598.992262:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201598.992424:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695583104 00000100:00100000:2.0:1788201598.992439:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695583104 00000100:00100000:2.0:1788201598.992514:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00100000:2.0:1788201598.992526:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:80736:x1875060695583104:12345-192.168.201.20@tcp:101:checkstat.0 00010000:00010000:2.0:1788201598.992554:0:107404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201598.992581:0:107404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f56a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78701a expref: -99 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.992679:0:107404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f571 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.992696:0:107404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f571 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.992710:0:107404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f571 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.992728:0:107404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1f578 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.992736:0:107404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1f578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.992760:0:107404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1f578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.993107:0:107404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58e00/0x96d0c9b8c9a1f57f lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.993118:0:107404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58e00/0x96d0c9b8c9a1f57f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.993126:0:107404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58e00/0x96d0c9b8c9a1f57f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201598.993164:0:107404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x34:0x0]: returning size 4096 00000004:00200000:2.0:1788201598.993168:0:107404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201598.993195:0:107404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58e00/0x96d0c9b8c9a1f57f lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.993346:0:107404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f571 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.993354:0:107404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f571 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.993423:0:107404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f571 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.993430:0:107404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201598.993435:0:107404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f571 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.993443:0:107404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f571 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.993466:0:107404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc107816400) 00010000:00010000:2.0:1788201598.993469:0:107404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201598.993474:0:107404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f571 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.993480:0:107404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f571 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.993492:0:107404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1f578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.993499:0:107404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1f578 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.993505:0:107404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1f578 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.993510:0:107404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201598.993513:0:107404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1f578 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.993518:0:107404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1f578 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.993526:0:107404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe888c80e (ffff8dc107816700) 00010000:00010000:2.0:1788201598.993529:0:107404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201598.993661:0:107404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1f578 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.993669:0:107404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1f578 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.993723:0:107404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f56a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78701a expref: 10 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.993739:0:107404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58e00/0x96d0c9b8c9a1f57f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78701a expref: 9 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.993747:0:107404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0x0 (ffff8dc107816800) 00010000:00010000:2.0:1788201598.993749:0:107404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201598.993752:0:107404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58e00, rc 0) 00000100:00100000:2.0:1788201598.993894:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:80736:x1875060695583104:12345-192.168.201.20@tcp:101:checkstat.0 Request processed in 1368us (1706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201598.993903:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 21 00000100:00100000:0.0:1788201598.997341:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201598.997483:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695583232 00000100:00100000:2.0:1788201598.997495:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695583232 00000100:00100000:2.0:1788201598.997625:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:2.0:1788201598.997636:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:80736:x1875060695583232:12345-192.168.201.20@tcp:101:checkstat.0 00010000:00010000:2.0:1788201598.997660:0:107403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201598.997683:0:107403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f586 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f787021 expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.997762:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1f58d lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.997778:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1f58d lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.997791:0:107403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1f58d lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.997820:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1f594 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.997827:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1f594 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.997834:0:107403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1f594 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201598.998009:0:107403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:107403:1875060715489280:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788201598.998387:0:107403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201598.998425:0:107403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f17b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201598.998480:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715489280 00000100:00100000:3.0:1788201598.998486:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715489280 00000100:00100000:3.0:1788201598.998525:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788201598.998533:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:107403:x1875060715489280:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788201598.998723:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:107403:x1875060715489280:12345-0@lo:1000:mdt00_000.0 Request processed in 190us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201598.998740:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788201598.998885:0:107403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:107403:1875060715489280:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788201598.998943:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1f59b lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.998957:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1f59b lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.998966:0:107403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1f59b lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201598.998993:0:107403:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1f59b lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.999008:0:107403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1f58d lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.999036:0:107403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1f58d lrc: 2/0,0 mode: CR/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.999055:0:107403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1f58d lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.999062:0:107403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201598.999067:0:107403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1f58d lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.999075:0:107403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1f58d lrc: 4/0,0 mode: CR/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.999089:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0x0 (ffff8dc107816800) 00010000:00010000:2.0:1788201598.999093:0:107403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201598.999097:0:107403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1f58d lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.999104:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1f58d lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.999118:0:107403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1f594 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.999123:0:107403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1f594 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.999128:0:107403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1f594 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.999134:0:107403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201598.999137:0:107403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1f594 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.999151:0:107403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1f594 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.999160:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0xd1d4b922 (ffff8dc107816d00) 00010000:00010000:2.0:1788201598.999163:0:107403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201598.999166:0:107403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1f594 lrc: 2/0,0 mode: --/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.999172:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1f594 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.999227:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f586 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787021 expref: 11 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.999244:0:107403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1f59b lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787021 expref: 10 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201598.999257:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xc:0x0].0x0 (ffff8dc107816f00) 00010000:00010000:2.0:1788201598.999260:0:107403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201598.999262:0:107403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58c00, rc 0) 00000100:00100000:2.0:1788201598.999330:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:80736:x1875060695583232:12345-192.168.201.20@tcp:101:checkstat.0 Request processed in 1696us (1999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201598.999337:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 22 00000100:00100000:1.0:1788201599.003387:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201599.003543:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695583360 00000100:00100000:2.0:1788201599.003558:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695583360 00000100:00100000:2.0:1788201599.003644:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00100000:2.0:1788201599.003657:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:80736:x1875060695583360:12345-192.168.201.20@tcp:101:checkstat.0 00010000:00010000:2.0:1788201599.003703:0:107404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201599.003735:0:107404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f5a2 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f787028 expref: -99 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.003823:0:107404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1f5a9 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.003843:0:107404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1f5a9 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.003861:0:107404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1f5a9 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201599.004037:0:107404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xc:0x0]: returning size 4096 00000004:00200000:2.0:1788201599.004044:0:107404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1788201599.004123:0:107404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f5a2 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787028 expref: 9 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.004146:0:107404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1f5a9 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787028 expref: 8 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.004156:0:107404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xc:0x0].0x0 (ffff8dc107816700) 00010000:00010000:2.0:1788201599.004159:0:107404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1788201599.004163:0:107404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59c00, rc 0) 00000100:00100000:2.0:1788201599.004304:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:80736:x1875060695583360:12345-192.168.201.20@tcp:101:checkstat.0 Request processed in 649us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201599.004312:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 23 00000100:00100000:1.0:1788201599.011415:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201599.011496:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695583488 00000100:00100000:2.0:1788201599.011509:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695583488 00000100:00100000:2.0:1788201599.011608:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 24 00000100:00100000:2.0:1788201599.011621:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:80736:x1875060695583488:12345-192.168.201.20@tcp:101:checkstat.0 00010000:00010000:2.0:1788201599.011646:0:107403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201599.011676:0:107403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f5b0 lrc: 2/0,0 mode: --/CR res: [0x20000e691:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78702f expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.011762:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1f5b7 lrc: 3/1,0 mode: --/CR res: [0x20000e691:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.011780:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1f5b7 lrc: 3/1,0 mode: CR/CR res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.011795:0:107403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1f5b7 lrc: 3/1,0 mode: CR/CR res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.011809:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f5be lrc: 3/1,0 mode: --/PR res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.011816:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f5be lrc: 3/1,0 mode: PR/PR res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.011823:0:107403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f5be lrc: 3/1,0 mode: PR/PR res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.011935:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1f5c5 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.011945:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1f5c5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.011953:0:107403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1f5c5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201599.012062:0:107403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x37:0x0]: returning size 4096 00000004:00200000:2.0:1788201599.012068:0:107403:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201599.012093:0:107403:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1f5c5 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.012110:0:107403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1f5b7 lrc: 3/1,0 mode: CR/CR res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.012118:0:107403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1f5b7 lrc: 2/0,0 mode: CR/CR res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.012126:0:107403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1f5b7 lrc: 3/0,0 mode: CR/CR res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.012133:0:107403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201599.012138:0:107403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1f5b7 lrc: 3/0,0 mode: CR/CR res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.012147:0:107403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1f5b7 lrc: 4/0,0 mode: CR/CR res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.012161:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000e691:0x3:0x0].0x0 (ffff8dc107816100) 00010000:00010000:2.0:1788201599.012165:0:107403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201599.012170:0:107403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1f5b7 lrc: 2/0,0 mode: --/CR res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.012177:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1f5b7 lrc: 0/0,0 mode: --/CR res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.012194:0:107403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f5be lrc: 3/1,0 mode: PR/PR res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.012211:0:107403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f5be lrc: 2/0,0 mode: PR/PR res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.012217:0:107403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f5be lrc: 3/0,0 mode: PR/PR res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.012222:0:107403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201599.012226:0:107403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f5be lrc: 3/0,0 mode: PR/PR res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.012232:0:107403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f5be lrc: 4/0,0 mode: PR/PR res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.012241:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000e691:0x3:0x0].0xcd52553e (ffff8dc107816a00) 00010000:00010000:2.0:1788201599.012244:0:107403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201599.012247:0:107403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f5be lrc: 2/0,0 mode: --/PR res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.012253:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f5be lrc: 0/0,0 mode: --/PR res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.012295:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f5b0 lrc: 0/0,0 mode: --/CR res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78702f expref: 12 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.012312:0:107403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1f5c5 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78702f expref: 11 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.012319:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x37:0x0].0x0 (ffff8dc005ab2400) 00010000:00010000:2.0:1788201599.012322:0:107403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201599.012332:0:107403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59000, rc 0) 00000100:00100000:2.0:1788201599.012401:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:80736:x1875060695583488:12345-192.168.201.20@tcp:101:checkstat.0 Request processed in 782us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201599.012410:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 24 00000100:00100000:0.0:1788201599.033051:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201599.033551:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695583744 00000100:00100000:1.0:1788201599.033565:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695583744 00000100:00100000:1.0:1788201599.033654:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 25 00000100:00100000:1.0:1788201599.033668:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:80741:x1875060695583744:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1788201599.033695:0:107405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201599.033721:0:107405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1f5cc lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f787036 expref: -99 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201599.033879:0:107405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x37:0x0]: returning size 4096 00010000:00010000:1.0:1788201599.034950:0:107405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1f5cc lrc: 1/0,0 mode: --/CR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787036 expref: 13 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.034972:0:107405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x37:0x0].0x0 (ffff8dc005ab2400) 00010000:00010000:1.0:1788201599.035100:0:107405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201599.035109:0:107405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1f5cc lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787036 expref: 13 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.035129:0:107405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ec000, rc 0) 00000100:00100000:1.0:1788201599.035888:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:80741:x1875060695583744:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 2220us (2886us total) trans 133143986177 rc 301/301 00000100:00100000:1.0:1788201599.035901:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 25 00000100:00100000:1.0:1788201599.039697:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201599.039828:0:107406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695583872 00000100:00100000:2.0:1788201599.039845:0:107406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695583872 00000100:00100000:2.0:1788201599.039963:0:107406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:2.0:1788201599.039985:0:107406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:80741:x1875060695583872:12345-192.168.201.20@tcp:33:lfs.0 00000004:00200000:2.0:1788201599.040148:0:107406:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x37:0x0]: returning size 4096 00000004:00200000:2.0:1788201599.040154:0:107406:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1788201599.040490:0:107406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:80741:x1875060695583872:12345-192.168.201.20@tcp:33:lfs.0 Request processed in 514us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201599.040499:0:107406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:3.0:1788201599.043845:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201599.044147:0:107408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695584128 00000100:00100000:1.0:1788201599.044173:0:107408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695584128 00000100:00100000:1.0:1788201599.044549:0:107408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 1 00000100:00100000:1.0:1788201599.044563:0:107408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:80741:x1875060695584128:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:1.0:1788201599.044862:0:107408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:80741:x1875060695584128:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 301us (1029us total) trans 133143986178 rc 0/0 00000100:00100000:1.0:1788201599.044871:0:107408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 1 00000100:00100000:3.0:1788201599.073963:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201599.074216:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695584384 00000100:00100000:2.0:1788201599.074230:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695584384 00000100:00100000:2.0:1788201599.074310:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:2.0:1788201599.074322:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:80743:x1875060695584384:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1788201599.074357:0:107404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201599.074393:0:107404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f5da lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78703d expref: -99 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.074530:0:107404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f5e1 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.074547:0:107404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f5e1 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.074562:0:107404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f5e1 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201599.074590:0:107404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x37:0x0]: returning size 4096 00010000:00010000:2.0:1788201599.074735:0:107404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f5da lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78703d expref: 16 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.074755:0:107404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f5e1 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78703d expref: 15 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.074765:0:107404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x37:0x0].0x0 (ffff8dc005ab2400) 00010000:00010000:2.0:1788201599.074768:0:107404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788201599.074772:0:107404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59200, rc 0) 00000100:00100000:2.0:1788201599.074850:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:80743:x1875060695584384:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 529us (903us total) trans 133143986179 rc 0/0 00000100:00100000:2.0:1788201599.074857:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 26 00000100:00100000:3.0:1788201599.079956:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201599.080077:0:107406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695584512 00000100:00100000:2.0:1788201599.080092:0:107406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695584512 00000100:00100000:2.0:1788201599.080164:0:107406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:2.0:1788201599.080177:0:107406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:80743:x1875060695584512:12345-192.168.201.20@tcp:33:lfs.0 00000004:00200000:2.0:1788201599.080300:0:107406:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x37:0x0]: returning size 4096 00000004:00200000:2.0:1788201599.080304:0:107406:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1788201599.080405:0:107406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:80743:x1875060695584512:12345-192.168.201.20@tcp:33:lfs.0 Request processed in 230us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201599.080414:0:107406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2 00000100:00100000:3.0:1788201599.091940:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201599.092070:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695584640 00000100:00100000:2.0:1788201599.092083:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695584640 00000100:00100000:2.0:1788201599.092158:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:2.0:1788201599.092171:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:80745:x1875060695584640:12345-192.168.201.20@tcp:101:checkstat.0 00010000:00010000:2.0:1788201599.092224:0:107403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201599.092255:0:107403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f5ef lrc: 2/0,0 mode: --/CR res: [0x2400090a0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f787044 expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.092356:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1f5f6 lrc: 3/1,0 mode: --/CR res: [0x2400090a0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.092382:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1f5f6 lrc: 3/1,0 mode: CR/CR res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.092396:0:107403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1f5f6 lrc: 3/1,0 mode: CR/CR res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.092411:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f5fd lrc: 3/1,0 mode: --/PR res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.092418:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f5fd lrc: 3/1,0 mode: PR/PR res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.092425:0:107403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f5fd lrc: 3/1,0 mode: PR/PR res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.092526:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f604 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.092535:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f604 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.092542:0:107403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f604 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201599.092606:0:107403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xd:0x0]: returning size 4096 00000004:00200000:2.0:1788201599.092617:0:107403:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201599.092645:0:107403:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f604 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.092660:0:107403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1f5f6 lrc: 3/1,0 mode: CR/CR res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.092668:0:107403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1f5f6 lrc: 2/0,0 mode: CR/CR res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.092675:0:107403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1f5f6 lrc: 3/0,0 mode: CR/CR res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.092682:0:107403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201599.092687:0:107403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1f5f6 lrc: 3/0,0 mode: CR/CR res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.092695:0:107403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1f5f6 lrc: 4/0,0 mode: CR/CR res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.092709:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x3:0x0].0x0 (ffff8dc107816100) 00010000:00010000:2.0:1788201599.092712:0:107403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201599.092716:0:107403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1f5f6 lrc: 2/0,0 mode: --/CR res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.092722:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1f5f6 lrc: 0/0,0 mode: --/CR res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.092737:0:107403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f5fd lrc: 3/1,0 mode: PR/PR res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.092743:0:107403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f5fd lrc: 2/0,0 mode: PR/PR res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.092760:0:107403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f5fd lrc: 3/0,0 mode: PR/PR res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.092765:0:107403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201599.092768:0:107403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f5fd lrc: 3/0,0 mode: PR/PR res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.092775:0:107403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f5fd lrc: 4/0,0 mode: PR/PR res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.092782:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x3:0x0].0xf0209d98 (ffff8dc107816a00) 00010000:00010000:2.0:1788201599.092784:0:107403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201599.092787:0:107403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f5fd lrc: 2/0,0 mode: --/PR res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.092793:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f5fd lrc: 0/0,0 mode: --/PR res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.092826:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f5ef lrc: 0/0,0 mode: --/CR res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787044 expref: 10 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.092841:0:107403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f604 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787044 expref: 9 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.092849:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xd:0x0].0x0 (ffff8dc1421c6d00) 00010000:00010000:2.0:1788201599.092851:0:107403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201599.092853:0:107403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59800, rc 0) 00000100:00100000:2.0:1788201599.092938:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:80745:x1875060695584640:12345-192.168.201.20@tcp:101:checkstat.0 Request processed in 770us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201599.092954:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:3.0:1788201599.107873:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201599.109885:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695584896 00000100:00100000:1.0:1788201599.109904:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695584896 00000100:00100000:1.0:1788201599.110083:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:1.0:1788201599.110097:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:80746:x1875060695584896:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1788201599.110121:0:107405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201599.110146:0:107405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1f60b lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78704b expref: -99 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201599.110301:0:107405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xd:0x0]: returning size 4096 00010000:00010000:1.0:1788201599.110472:0:107405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1f60b lrc: 1/0,0 mode: --/CR res: [0x2400088d5:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78704b expref: 11 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.110491:0:107405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xd:0x0].0x0 (ffff8dc1421c6d00) 00010000:00010000:1.0:1788201599.110495:0:107405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201599.110501:0:107405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1f60b lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78704b expref: 11 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.110517:0:107405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ed200, rc 0) 00000100:00100000:1.0:1788201599.110608:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:80746:x1875060695584896:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 514us (2750us total) trans 85899345921 rc 301/301 00000100:00100000:1.0:1788201599.110617:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:1.0:1788201599.112936:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201599.113200:0:107406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695585024 00000100:00100000:2.0:1788201599.113213:0:107406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695585024 00000100:00100000:2.0:1788201599.113304:0:107406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:2.0:1788201599.113315:0:107406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:80746:x1875060695585024:12345-192.168.201.20@tcp:33:lfs.0 00000004:00200000:2.0:1788201599.113439:0:107406:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xd:0x0]: returning size 4096 00000004:00200000:2.0:1788201599.113444:0:107406:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1788201599.113530:0:107406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:80746:x1875060695585024:12345-192.168.201.20@tcp:33:lfs.0 Request processed in 215us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201599.113539:0:107406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 3 00000100:00100000:3.0:1788201599.116309:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201599.116467:0:107408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695585280 00000100:00100000:1.0:1788201599.116480:0:107408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695585280 00000100:00100000:1.0:1788201599.116551:0:107408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:1.0:1788201599.116563:0:107408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12e5c3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:80746:x1875060695585280:12345-192.168.201.20@tcp:35:lfs.0 00000100:00100000:1.0:1788201599.116893:0:107408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12e5c3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:80746:x1875060695585280:12345-192.168.201.20@tcp:35:lfs.0 Request processed in 332us (597us total) trans 85899345922 rc 0/0 00000100:00100000:1.0:1788201599.116900:0:107408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 4 00000100:00100000:3.0:1788201599.145915:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201599.146315:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695585536 00000100:00100000:2.0:1788201599.146420:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695585536 00000100:00100000:2.0:1788201599.146538:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:2.0:1788201599.146551:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:80747:x1875060695585536:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1788201599.146583:0:107404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201599.146622:0:107404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f619 lrc: 2/0,0 mode: --/CR res: [0x2400088d5:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f787052 expref: -99 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.146760:0:107404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f620 lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.146778:0:107404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f620 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0xd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.146792:0:107404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f620 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0xd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201599.146805:0:107404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xd:0x0]: returning size 4096 00010000:00010000:2.0:1788201599.147323:0:107404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f619 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0xd:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787052 expref: 14 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.147366:0:107404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f620 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0xd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787052 expref: 13 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.147376:0:107404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xd:0x0].0x0 (ffff8dc1421c6d00) 00010000:00010000:2.0:1788201599.147379:0:107404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788201599.147383:0:107404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59400, rc 0) 00000100:00100000:2.0:1788201599.147467:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:80747:x1875060695585536:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 919us (1569us total) trans 85899345923 rc 0/0 00000100:00100000:2.0:1788201599.147477:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:3.0:1788201599.149952:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201599.150523:0:107408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695585664 00000100:00100000:1.0:1788201599.150538:0:107408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695585664 00000100:00100000:1.0:1788201599.150650:0:107408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:1.0:1788201599.150662:0:107408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:80747:x1875060695585664:12345-192.168.201.20@tcp:33:lfs.0 00000004:00200000:1.0:1788201599.150779:0:107408:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xd:0x0]: returning size 4096 00000004:00200000:1.0:1788201599.150785:0:107408:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1788201599.150877:0:107408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:80747:x1875060695585664:12345-192.168.201.20@tcp:33:lfs.0 Request processed in 216us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201599.150886:0:107408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 5 00000100:00100000:3.0:1788201599.168192:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201599.168419:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695585920 00000100:00100000:1.0:1788201599.168434:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695585920 00000100:00100000:1.0:1788201599.168506:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:1.0:1788201599.168518:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:80748:x1875060695585920:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:1.0:1788201599.168544:0:107405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201599.168570:0:107405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1f62e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f787059 expref: -99 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201599.168724:0:107405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x34:0x0]: returning size 4096 00010000:00010000:1.0:1788201599.168858:0:107405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1f62e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787059 expref: 17 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.168894:0:107405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc107816400) 00010000:00010000:1.0:1788201599.168897:0:107405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788201599.168905:0:107405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1f62e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787059 expref: 17 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.169270:0:107405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ed200, rc 0) 00000100:00100000:1.0:1788201599.169352:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:80748:x1875060695585920:12345-192.168.201.20@tcp:101:rm.0 Request processed in 835us (1174us total) trans 133143986180 rc 301/301 00000100:00100000:1.0:1788201599.169369:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:3.0:1788201599.178989:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201599.179288:0:107406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695586048 00000100:00100000:2.0:1788201599.179302:0:107406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695586048 00000100:00100000:2.0:1788201599.179480:0:107406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:2.0:1788201599.179494:0:107406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:80748:x1875060695586048:12345-192.168.201.20@tcp:37:rm.0 00000100:00100000:2.0:1788201599.191759:0:107406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:80748:x1875060695586048:12345-192.168.201.20@tcp:37:rm.0 Request processed in 12251us (12778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201599.191777:0:107406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 6 00000100:00100000:3.0:1788201599.198906:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201599.199199:0:107408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695586304 00000100:00100000:1.0:1788201599.199213:0:107408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695586304 00000100:00100000:1.0:1788201599.199540:0:107408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:1.0:1788201599.199553:0:107408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:80748:x1875060695586304:12345-192.168.201.20@tcp:35:rm.0 00000100:00100000:1.0:1788201599.201137:0:107408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+17:80748:x1875060695586304:12345-192.168.201.20@tcp:35:rm.0 Request processed in 371us (1031us total) trans 133143986181 rc 0/0 00000100:00100000:1.0:1788201599.201153:0:107408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 7 00000100:00100000:3.0:1788201599.204077:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201599.204366:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695586560 00000100:00100000:2.0:1788201599.204379:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695586560 00000100:00100000:2.0:1788201599.204451:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:2.0:1788201599.204462:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+17:80748:x1875060695586560:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:2.0:1788201599.204492:0:107404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201599.204517:0:107404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f63c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f787060 expref: -99 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.204683:0:107404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1f643 lrc: 3/1,0 mode: --/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.204699:0:107404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1f643 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.204712:0:107404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1f643 lrc: 3/1,0 mode: CR/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201599.204724:0:107404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x34:0x0]: returning size 4096 00010000:00010000:2.0:1788201599.204854:0:107404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f63c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787060 expref: 20 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.204875:0:107404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1f643 lrc: 3/0,0 mode: CR/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787060 expref: 19 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.204884:0:107404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0x0 (ffff8dc107816800) 00010000:00010000:2.0:1788201599.204887:0:107404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788201599.204891:0:107404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58600, rc 0) 00000100:00100000:2.0:1788201599.204969:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+19:80748:x1875060695586560:12345-192.168.201.20@tcp:101:rm.0 Request processed in 508us (904us total) trans 133143986182 rc 0/0 00000100:00100000:2.0:1788201599.207546:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:3.0:1788201599.219207:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201599.219455:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695586688 00000100:00100000:1.0:1788201599.219469:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695586688 00000100:00100000:1.0:1788201599.219811:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:1.0:1788201599.219825:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:80748:x1875060695586688:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:1.0:1788201599.219853:0:107405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201599.219884:0:107405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1f651 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f787067 expref: -99 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201599.220084:0:107405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:107405:1875060715489408:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788201599.220182:0:107405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201599.220226:0:107405:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc120888780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201599.221413:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715489408 00000100:00100000:3.0:1788201599.221427:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715489408 00000100:00100000:3.0:1788201599.221496:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788201599.221507:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107405:x1875060715489408:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788201599.221653:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107405:x1875060715489408:12345-0@lo:1000:mdt00_002.0 Request processed in 147us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201599.221661:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788201599.221946:0:107405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:107405:1875060715489408:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788201599.222108:0:107405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1f658 lrc: 3/1,0 mode: --/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.222128:0:107405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1f658 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.222145:0:107405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1f658 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107405 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201599.222272:0:107405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xc:0x0]: returning size 4096 00000004:00200000:1.0:1788201599.222279:0:107405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1788201599.222325:0:107405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1f658 lrc: 3/1,0 mode: PR/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.222791:0:107405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1f651 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787067 expref: 15 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.222824:0:107405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1f658 lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787067 expref: 14 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.222836:0:107405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xc:0x0].0x0 (ffff8dc107816700) 00010000:00010000:1.0:1788201599.222839:0:107405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788201599.222843:0:107405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ece00, rc 0) 00000100:00100000:1.0:1788201599.223064:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:80748:x1875060695586688:12345-192.168.201.20@tcp:101:rm.0 Request processed in 3241us (3871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201599.223073:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:3.0:1788201599.227391:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201599.227500:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695586816 00000100:00100000:2.0:1788201599.227515:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695586816 00000100:00100000:2.0:1788201599.227608:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:2.0:1788201599.227622:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:80748:x1875060695586816:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:2.0:1788201599.227648:0:107404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201599.227698:0:107404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f65f lrc: 2/0,0 mode: --/CR res: [0x2400090a0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78706e expref: -99 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.227781:0:107404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1f666 lrc: 3/1,0 mode: --/PR res: [0x2400090a0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.227798:0:107404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1f666 lrc: 3/1,0 mode: PR/PR res: [0x2400090a0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.227812:0:107404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1f666 lrc: 3/1,0 mode: PR/PR res: [0x2400090a0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201599.227870:0:107404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a0:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788201599.227876:0:107404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1788201599.227937:0:107404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f65f lrc: 0/0,0 mode: --/CR res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78706e expref: 16 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.227958:0:107404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1f666 lrc: 3/0,0 mode: PR/PR res: [0x2400090a0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78706e expref: 15 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.227968:0:107404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x3:0x0].0x0 (ffff8dc107816100) 00010000:00010000:2.0:1788201599.227971:0:107404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788201599.227975:0:107404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58000, rc 0) 00000100:00100000:2.0:1788201599.228086:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:80748:x1875060695586816:12345-192.168.201.20@tcp:101:rm.0 Request processed in 467us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201599.228094:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:3.0:1788201599.231818:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201599.231987:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695586944 00000100:00100000:1.0:1788201599.232000:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695586944 00000100:00100000:1.0:1788201599.232104:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00100000:1.0:1788201599.232116:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+19:80748:x1875060695586944:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:1.0:1788201599.232149:0:107405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201599.232178:0:107405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1f66d lrc: 2/0,0 mode: --/CR res: [0x20000e691:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f787075 expref: -99 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.232257:0:107405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f674 lrc: 3/1,0 mode: --/PR res: [0x20000e691:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.232273:0:107405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f674 lrc: 3/1,0 mode: PR/PR res: [0x20000e691:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.232288:0:107405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f674 lrc: 3/1,0 mode: PR/PR res: [0x20000e691:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201599.232352:0:107405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000e691:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788201599.232368:0:107405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1788201599.232419:0:107405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1f66d lrc: 0/0,0 mode: --/CR res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787075 expref: 21 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.232442:0:107405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f674 lrc: 3/0,0 mode: PR/PR res: [0x20000e691:0x3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787075 expref: 20 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.232452:0:107405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000e691:0x3:0x0].0x0 (ffff8dc103a3ab00) 00010000:00010000:1.0:1788201599.232456:0:107405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788201599.232460:0:107405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ed800, rc 0) 00000100:00100000:1.0:1788201599.232537:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:80748:x1875060695586944:12345-192.168.201.20@tcp:101:rm.0 Request processed in 422us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201599.232565:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00100000:3.0:1788201599.236461:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201599.236624:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695587200 00000100:00100000:0.0:1788201599.236637:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695587200 00000100:00100000:0.0:1788201599.236712:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00100000:0.0:1788201599.236724:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:80748:x1875060695587200:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1788201599.236752:0:107403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201599.236786:0:107403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f67b lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78707c expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201599.237319:0:107403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xc:0x0]: returning size 4096 00010000:00010000:0.0:1788201599.237471:0:107403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f67b lrc: 1/0,0 mode: --/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78707c expref: 17 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.237488:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0x0 (ffff8dc103a1ef00) 00010000:00010000:0.0:1788201599.237491:0:107403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788201599.237497:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f67b lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78707c expref: 17 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.237520:0:107403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d6a00, rc 0) 00000100:00100000:0.0:1788201599.237715:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:80748:x1875060695587200:12345-192.168.201.20@tcp:101:rm.0 Request processed in 991us (1268us total) trans 85899345924 rc 301/301 00000100:00100000:0.0:1788201599.237724:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00100000:3.0:1788201599.242639:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201599.242839:0:107408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695587328 00000100:00100000:1.0:1788201599.242853:0:107408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695587328 00000100:00100000:1.0:1788201599.242925:0:107408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:1.0:1788201599.242938:0:107408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:80748:x1875060695587328:12345-192.168.201.20@tcp:37:rm.0 00000100:00100000:1.0:1788201599.248696:0:107408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:80748:x1875060695587328:12345-192.168.201.20@tcp:37:rm.0 Request processed in 5744us (6056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201599.248715:0:107408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 8 00000100:00100000:3.0:1788201599.252958:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201599.253074:0:107406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695587456 00000100:00100000:2.0:1788201599.253087:0:107406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695587456 00000100:00100000:2.0:1788201599.253163:0:107406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:2.0:1788201599.253176:0:107406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12e5c2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:80748:x1875060695587456:12345-192.168.201.20@tcp:37:rm.0 00000100:00100000:2.0:1788201599.258369:0:107406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12e5c2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:80748:x1875060695587456:12345-192.168.201.20@tcp:37:rm.0 Request processed in 5168us (5399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201599.258387:0:107406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 9 00000100:00100000:3.0:1788201599.261761:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201599.262170:0:107408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695587712 00000100:00100000:1.0:1788201599.262185:0:107408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695587712 00000100:00100000:1.0:1788201599.262312:0:107408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:1.0:1788201599.262326:0:107408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+16:80748:x1875060695587712:12345-192.168.201.20@tcp:35:rm.0 00000100:00100000:1.0:1788201599.262665:0:107408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:107408:1875060715489536:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788201599.262732:0:107408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201599.262774:0:107408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc120888780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201599.262904:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715489536 00000100:00100000:3.0:1788201599.262918:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715489536 00000100:00100000:3.0:1788201599.262963:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201599.262972:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107408:x1875060715489536:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788201599.263094:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107408:x1875060715489536:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 123us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201599.263104:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788201599.263256:0:107408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:107408:1875060715489536:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788201599.263369:0:107408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:107408:1875060715489664:0@lo:700:mdt_rdpg00_001.0 00000100:00100000:1.0:1788201599.263401:0:107408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201599.263431:0:107408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121870780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201599.263551:0:107413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715489664 00000100:00100000:3.0:1788201599.263556:0:107413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715489664 00000100:00100000:3.0:1788201599.263590:0:107413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788201599.263607:0:107413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+6:107408:x1875060715489664:12345-0@lo:700:mdt_rdpg00_001.0 00000100:00100000:3.0:1788201599.263653:0:107413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+6:107408:x1875060715489664:12345-0@lo:700:mdt_rdpg00_001.0 Request processed in 47us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201599.263659:0:107413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788201599.263820:0:107408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0001-mdtlov_UUID:107408:1875060715489664:0@lo:700:mdt_rdpg00_001.0 00000040:00080000:1.0:1788201599.263952:0:107408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201599.263975:0:107408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd1:0x3:0x0].33, 64 off34880 00000004:00080000:1.0:1788201599.263984:0:107408:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc121870780 with version 5 00000040:00080000:1.0:1788201599.264292:0:107408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201599.264308:0:107408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd1:0x3:0x0].34, 64 off34944 00000004:00080000:1.0:1788201599.264313:0:107408:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc103892000 with version 6 00000004:00080000:0.0:1788201599.264442:0:107452:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc13a875f00 version 5 rpc_version 5 00000020:00100000:0.0:1788201599.264472:0:107452:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788201599.264481:0:107452:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc12b637480 x1875060715489920/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201599.264501:0:107452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107452:1875060715489920:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788201599.264555:0:107452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201599.264765:0:107452:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105d39f00 going to sleep for 11 seconds 00000040:00080000:1.0:1788201599.265838:0:107408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201599.265879:0:107408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400013a0:0x3:0x0].17, 64 off33856 00000040:00080000:1.0:1788201599.266760:0:107408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240009870:0x1:0x0].1, 344 off33112 00000040:00080000:1.0:1788201599.266891:0:107408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000ee61:0x1:0x0].1, 424 off33192 00000004:00080000:1.0:1788201599.267143:0:107408:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc1208880c0 with version 7 00000100:00100000:3.0:1788201599.267225:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715489920 00000100:00100000:3.0:1788201599.267237:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715489920 00000100:00100000:3.0:1788201599.267342:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788201599.267364:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107452:x1875060715489920:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:0.0:1788201599.269807:0:107389:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 133143986183 is committed 00000001:00080000:0.0:1788201599.269829:0:107389:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 133143986182 is committed 00000100:00100000:3.0:1788201599.270811:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107452:x1875060715489920:12345-0@lo:1000:osp_up0-1.0 Request processed in 3451us (6247us total) trans 133143986183 rc 0/0 00000100:00100000:3.0:1788201599.270828:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:0.0:1788201599.270990:0:107452:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 133143986183 committed transno 133143986183 00000100:00100000:0.0:1788201599.271066:0:107452:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 133143986183 gen 2 00000100:00100000:0.0:1788201599.271091:0:107452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107452:1875060715489920:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1788201599.271126:0:107452:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc13a875f00 version 6 rpc_version 6 00000020:00100000:0.0:1788201599.271158:0:107452:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788201599.271168:0:107452:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc12b637480 x1875060715490176/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201599.271195:0:107452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107452:1875060715490176:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788201599.271239:0:107452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201599.271328:0:107452:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105d39f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201599.271426:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715490176 00000100:00100000:2.0:1788201599.271435:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715490176 00000100:00100000:2.0:1788201599.271493:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788201599.271504:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107452:x1875060715490176:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:1.0:1788201599.277521:0:107389:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 133143986184 is committed 00000100:00100000:2.0:1788201599.278062:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107452:x1875060715490176:12345-0@lo:1000:osp_up0-1.0 Request processed in 6552us (6815us total) trans 133143986184 rc 0/0 00000100:00100000:2.0:1788201599.278079:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:0.0:1788201599.278233:0:107452:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 133143986184 committed transno 133143986184 00000100:00100000:0.0:1788201599.278241:0:107452:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 133143986184 gen 2 00000100:00100000:0.0:1788201599.278270:0:107452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107452:1875060715490176:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1788201599.278310:0:107452:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc13a875f00 version 7 rpc_version 7 00000020:00100000:0.0:1788201599.278538:0:107452:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788201599.278550:0:107452:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc12b637480 x1875060715490432/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201599.278585:0:107452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107452:1875060715490432:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1788201599.278763:0:107452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201599.278859:0:107452:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105d39480 going to sleep for 11 seconds 00000100:00100000:3.0:1788201599.278975:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715490432 00000100:00100000:3.0:1788201599.278985:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715490432 00000100:00100000:2.0:1788201599.279256:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788201599.279269:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107452:x1875060715490432:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788201599.280913:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107452:x1875060715490432:12345-0@lo:1000:osp_up0-1.0 Request processed in 1627us (2131us total) trans 133143986185 rc 0/0 00000100:00100000:2.0:1788201599.280928:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788201599.281138:0:107452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107452:1875060715490432:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788201599.281449:0:107408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+17:80748:x1875060695587712:12345-192.168.201.20@tcp:35:rm.0 Request processed in 19124us (19699us total) trans 85899345925 rc 0/0 00000100:00100000:2.0:1788201599.281459:0:107408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 10 00000100:00100000:3.0:1788201599.284609:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201599.284818:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695587968 00000100:00100000:2.0:1788201599.284831:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695587968 00000100:00100000:2.0:1788201599.284921:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 36 00000100:00100000:2.0:1788201599.284934:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+17:80748:x1875060695587968:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:2.0:1788201599.284965:0:107404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201599.284997:0:107404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f689 lrc: 2/0,0 mode: --/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f787083 expref: -99 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.285280:0:107404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1f690 lrc: 3/1,0 mode: --/CR res: [0x2400088d5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.285297:0:107404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1f690 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.285314:0:107404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1f690 lrc: 3/1,0 mode: CR/CR res: [0x2400088d5:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201599.285329:0:107404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xc:0x0]: returning size 4096 00010000:00010000:2.0:1788201599.285480:0:107404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f689 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787083 expref: 20 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.285512:0:107404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1f690 lrc: 3/0,0 mode: CR/CR res: [0x2400088d5:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787083 expref: 19 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.285524:0:107404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xc:0x0].0x0 (ffff8dc107816700) 00010000:00010000:2.0:1788201599.285528:0:107404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788201599.285534:0:107404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58800, rc 0) 00000100:00100000:2.0:1788201599.285908:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+19:80748:x1875060695587968:12345-192.168.201.20@tcp:101:rm.0 Request processed in 972us (1323us total) trans 85899345926 rc 0/0 00000100:00100000:2.0:1788201599.285916:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 36 00000100:00100000:3.0:1788201599.297876:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201599.298097:0:107406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695588096 00000100:00100000:2.0:1788201599.298113:0:107406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695588096 00000100:00100000:2.0:1788201599.298192:0:107406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 11 00000100:00100000:2.0:1788201599.298216:0:107406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:80748:x1875060695588096:12345-192.168.201.20@tcp:37:rm.0 00000100:00100000:2.0:1788201599.306008:0:107406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:80748:x1875060695588096:12345-192.168.201.20@tcp:37:rm.0 Request processed in 7789us (8133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201599.306078:0:107406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 11 00010000:00010000:1.0:1788201599.311372:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201599.315931:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201599.316055:0:107408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695588352 00000100:00100000:1.0:1788201599.316069:0:107408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695588352 00000100:00100000:1.0:1788201599.316151:0:107408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:1.0:1788201599.316165:0:107408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+14:80748:x1875060695588352:12345-192.168.201.20@tcp:35:rm.0 00000100:00100000:1.0:1788201599.316733:0:107408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:80748:x1875060695588352:12345-192.168.201.20@tcp:35:rm.0 Request processed in 568us (814us total) trans 133143986186 rc 0/0 00000100:00100000:1.0:1788201599.316744:0:107408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 12 00000100:00100000:2.0:1788201599.324333:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201599.324578:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695588608 00000100:00100000:0.0:1788201599.324666:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695588608 00000100:00100000:0.0:1788201599.324804:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 37 00000100:00100000:0.0:1788201599.324818:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+15:80748:x1875060695588608:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:0.0:1788201599.324931:0:107403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788201599.324968:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f5e1 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78703d expref: 15 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.324997:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1f5c5 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78702f expref: 14 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.325012:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x37:0x0].0x0 (ffff8dc005ab2400) 00010000:00010000:0.0:1788201599.325079:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f674 lrc: 0/0,0 mode: --/PR res: [0x20000e691:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787075 expref: 13 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.325092:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000e691:0x3:0x0].0x0 (ffff8dc103a3ab00) 00010000:00010000:0.0:1788201599.325104:0:107403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201599.325138:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f69e lrc: 3/0,1 mode: --/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.325153:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f69e lrc: 3/0,1 mode: CW/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.325165:0:107403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f69e lrc: 3/0,1 mode: CW/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.325180:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1f6a5 lrc: 3/0,1 mode: --/PW res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.325188:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1f6a5 lrc: 3/0,1 mode: PW/PW res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.325196:0:107403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1f6a5 lrc: 3/0,1 mode: PW/PW res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.325338:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f6ac lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.325350:0:107403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1f181 lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fe2 expref: 12 pid: 107441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.325370:0:107403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f6ac lrc: 4/0,1 mode: --/EX res: [0x20000d6f1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.325412:0:107403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1f181 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fe2 expref: 12 pid: 107441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.325438:0:107403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1f181 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fe2 expref: 12 pid: 107441 timeout: 4550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201599.325455:0:107403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:107403:1875060715490560:192.168.201.20@tcp:104: 00000100:00100000:0.0:1788201599.325659:0:107403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105d39780 going to sleep for 11 seconds 00010000:00010000:2.0:1788201599.328775:0:107403:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.20@tcp) returned -22 from blocking AST (req@00000000e3aa0020 x1875060715490560) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1f181 lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fe2 expref: 12 pid: 107441 timeout: 4550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.328802:0:107403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1f181 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fe2 expref: 12 pid: 107441 timeout: 4550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.328842:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1f181 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fe2 expref: 12 pid: 107441 timeout: 4550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201599.328862:0:107403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:107403:1875060715490560:192.168.201.20@tcp:104: 00010000:00010000:2.0:1788201599.328885:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x37:0x0].0x0 (ffff8dc005ab2400) 00010000:00010000:2.0:1788201599.328891:0:107403:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f6ac lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.328901:0:107403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f6ac lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.328908:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f6ac lrc: 4/0,1 mode: EX/EX res: [0x20000d6f1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.328933:0:107403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f6ac lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.328942:0:107403:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f6ac lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.328968:0:107403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f6ac lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201599.329297:0:107403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x37:0x0]: returning size 4096 00010000:00010000:2.0:1788201599.329326:0:107403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f6ac lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.329333:0:107403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f6ac lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.329339:0:107403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f6ac lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.329345:0:107403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201599.329349:0:107403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f6ac lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.329356:0:107403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f6ac lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.329366:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x37:0x0].0x0 (ffff8dc005ab2400) 00010000:00010000:2.0:1788201599.329369:0:107403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201599.329372:0:107403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f6ac lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.329734:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f6ac lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.329764:0:107403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f69e lrc: 3/0,1 mode: CW/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.329785:0:107403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f69e lrc: 2/0,0 mode: CW/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.329791:0:107403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f69e lrc: 3/0,0 mode: CW/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.329797:0:107403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201599.329800:0:107403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f69e lrc: 3/0,0 mode: CW/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.329807:0:107403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f69e lrc: 4/0,0 mode: CW/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.329880:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000e691:0x3:0x0].0x0 (ffff8dc11248cd00) 00010000:00010000:2.0:1788201599.329883:0:107403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201599.329887:0:107403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f69e lrc: 2/0,0 mode: --/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.329894:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f69e lrc: 0/0,0 mode: --/CW res: [0x20000e691:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201599.329908:0:107403:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b82ca3b reply state 000000003dca8f18 transno 133143986187 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1f6a5 lrc: 3/0,1 mode: PW/PW res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.329919:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1f6a5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.329926:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000e691:0x3:0x0].0xcd52553e (ffff8dc11248c700) 00010000:00010000:2.0:1788201599.329929:0:107403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201599.329932:0:107403:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201599.330059:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:80748:x1875060695588608:12345-192.168.201.20@tcp:36:rm.0 Request processed in 5241us (5747us total) trans 133143986187 rc 0/0 00000100:00100000:2.0:1788201599.330068:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 37 00000100:00100000:2.0:1788201599.337508:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201599.337863:0:107406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695588736 00000100:00100000:0.0:1788201599.337884:0:107406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695588736 00000100:00100000:0.0:1788201599.337966:0:107406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:0.0:1788201599.337979:0:107406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+19:80748:x1875060695588736:12345-192.168.201.20@tcp:37:rm.0 00000100:00100000:2.0:1788201599.343641:0:107406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+19:80748:x1875060695588736:12345-192.168.201.20@tcp:37:rm.0 Request processed in 5643us (6122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201599.343663:0:107406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 13 00000100:00100000:2.0:1788201599.347781:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201599.347856:0:107408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695588992 00000100:00100000:1.0:1788201599.347876:0:107408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695588992 00000100:00100000:1.0:1788201599.347981:0:107408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:1.0:1788201599.347994:0:107408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10981c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+19:80748:x1875060695588992:12345-192.168.201.20@tcp:35:rm.0 00000100:00100000:1.0:1788201599.348399:0:107408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10981c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:80748:x1875060695588992:12345-192.168.201.20@tcp:35:rm.0 Request processed in 407us (628us total) trans 85899345927 rc 0/0 00000100:00100000:1.0:1788201599.348409:0:107408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 14 00000100:00100000:3.0:1788201599.352293:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201599.352447:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695589248 00000100:00100000:2.0:1788201599.352457:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695589248 00000100:00100000:2.0:1788201599.352530:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 38 00000100:00100000:2.0:1788201599.352542:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+20:80748:x1875060695589248:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:2.0:1788201599.352621:0:107404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788201599.352648:0:107404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f620 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0xd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787052 expref: 20 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.352672:0:107404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f604 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787044 expref: 19 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.352683:0:107404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xd:0x0].0x0 (ffff8dc1421c6d00) 00010000:00010000:2.0:1788201599.352693:0:107404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1f666 lrc: 0/0,0 mode: --/PR res: [0x2400090a0:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78706e expref: 18 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.352702:0:107404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x3:0x0].0x0 (ffff8dc107816100) 00010000:00010000:2.0:1788201599.352713:0:107404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201599.352742:0:107404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6b3 lrc: 3/0,1 mode: --/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.352768:0:107404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6b3 lrc: 3/0,1 mode: CW/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.352778:0:107404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6b3 lrc: 3/0,1 mode: CW/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.352792:0:107404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59e00/0x96d0c9b8c9a1f6ba lrc: 3/0,1 mode: --/PW res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.352800:0:107404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59e00/0x96d0c9b8c9a1f6ba lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.352807:0:107404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59e00/0x96d0c9b8c9a1f6ba lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.352909:0:107404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1f6c1 lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.352921:0:107404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1f36b lrc: 2/0,0 mode: PR/PR res: [0x2400088d5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fe9 expref: 17 pid: 107480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.352929:0:107404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1f6c1 lrc: 4/0,1 mode: --/EX res: [0x2400088d5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.352961:0:107404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1f36b lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fe9 expref: 17 pid: 107480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.352976:0:107404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1f36b lrc: 4/0,0 mode: PR/PR res: [0x2400088d5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fe9 expref: 17 pid: 107480 timeout: 4550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201599.353002:0:107404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:107404:1875060715490688:192.168.201.20@tcp:104: 00000100:00100000:2.0:1788201599.353145:0:107404:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f17b3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788201599.364110:0:107404:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.20@tcp) returned -22 from blocking AST (req@000000004aaaf2cf x1875060715490688) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1f36b lrc: 4/0,0 mode: PR/PR res: [0x2400088d5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fe9 expref: 17 pid: 107480 timeout: 4550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.364137:0:107404:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1f36b lrc: 3/0,0 mode: PR/PR res: [0x2400088d5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fe9 expref: 17 pid: 107480 timeout: 4550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.364163:0:107404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc007adfa00/0x96d0c9b8c9a1f36b lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0xd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786fe9 expref: 17 pid: 107480 timeout: 4550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201599.364180:0:107404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:107404:1875060715490688:192.168.201.20@tcp:104: 00010000:00010000:2.0:1788201599.364203:0:107404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xd:0x0].0x0 (ffff8dc1421c6d00) 00010000:00010000:2.0:1788201599.364209:0:107404:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1f6c1 lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.364219:0:107404:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1f6c1 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.364227:0:107404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1f6c1 lrc: 4/0,1 mode: EX/EX res: [0x2400088d5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.364249:0:107404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1f6c1 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.364258:0:107404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1f6c1 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.364280:0:107404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1f6c1 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201599.365313:0:107404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xd:0x0]: returning size 4096 00010000:00010000:2.0:1788201599.365334:0:107404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1f6c1 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.365343:0:107404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1f6c1 lrc: 2/0,0 mode: EX/EX res: [0x2400088d5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.365351:0:107404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1f6c1 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.365379:0:107404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201599.365384:0:107404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1f6c1 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.365392:0:107404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1f6c1 lrc: 4/0,0 mode: EX/EX res: [0x2400088d5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.365406:0:107404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xd:0x0].0x0 (ffff8dc1421c6d00) 00010000:00010000:2.0:1788201599.365408:0:107404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201599.365413:0:107404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1f6c1 lrc: 2/0,0 mode: --/EX res: [0x2400088d5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.365419:0:107404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1f6c1 lrc: 0/0,0 mode: --/EX res: [0x2400088d5:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.365444:0:107404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6b3 lrc: 3/0,1 mode: CW/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.365466:0:107404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6b3 lrc: 2/0,0 mode: CW/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.365472:0:107404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6b3 lrc: 3/0,0 mode: CW/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.365478:0:107404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201599.365481:0:107404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6b3 lrc: 3/0,0 mode: CW/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.365488:0:107404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6b3 lrc: 4/0,0 mode: CW/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.365497:0:107404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x3:0x0].0x0 (ffff8dc005cc6800) 00010000:00010000:2.0:1788201599.365500:0:107404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201599.365503:0:107404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6b3 lrc: 2/0,0 mode: --/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.365509:0:107404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6b3 lrc: 0/0,0 mode: --/CW res: [0x2400090a0:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201599.365523:0:107404:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b263a9d8 reply state 0000000041bd5c16 transno 85899345928 ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59e00/0x96d0c9b8c9a1f6ba lrc: 3/0,1 mode: PW/PW res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.365533:0:107404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59e00/0x96d0c9b8c9a1f6ba lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.365539:0:107404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x3:0x0].0xf0209d98 (ffff8dc005cc6300) 00010000:00010000:2.0:1788201599.365541:0:107404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201599.365544:0:107404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201599.365641:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+18:80748:x1875060695589248:12345-192.168.201.20@tcp:36:rm.0 Request processed in 13099us (13355us total) trans 85899345928 rc 0/0 00000100:00100000:2.0:1788201599.365650:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 38 00000100:00100000:0.0:1788201599.374085:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201599.374122:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201599.374409:0:107406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695589632 00000100:00100000:2.0:1788201599.374419:0:107406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695589632 00000100:00100000:2.0:1788201599.374481:0:107406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:2.0:1788201599.374491:0:107406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+18:80748:x1875060695589632:12345-192.168.201.20@tcp:35:rm.0 00000100:00100000:2.0:1788201599.374719:0:107406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+19:80748:x1875060695589632:12345-192.168.201.20@tcp:35:rm.0 Request processed in 228us (595us total) trans 85899345929 rc 0/0 00000100:00100000:2.0:1788201599.374727:0:107406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 15 00000100:00100000:1.0:1788201599.374819:0:26207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695589376 00000100:00100000:1.0:1788201599.374823:0:26207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695589376 00000100:00100000:1.0:1788201599.374871:0:26207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 781 00000100:00100000:1.0:1788201599.374912:0:26207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:2400:x1875060695589376:12345-192.168.201.20@tcp:103:rm.0 00010000:00010000:1.0:1788201599.374925:0:26207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201599.374948:0:26207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58c00/0x96d0c9b8c9a1f59b lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787021 expref: 13 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.374967:0:26207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xc:0x0].0x0 (ffff8dc107816f00) 00010000:00010000:1.0:1788201599.374978:0:26207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201599.374998:0:26207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2400:x1875060695589376:12345-192.168.201.20@tcp:103:rm.0 Request processed in 102us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201599.375006:0:26207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 781 00000100:00100000:0.0:1788201599.382485:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201599.382567:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695589888 00000100:00100000:2.0:1788201599.382578:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695589888 00000100:00100000:2.0:1788201599.382677:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 39 00000100:00100000:2.0:1788201599.382688:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+19:80748:x1875060695589888:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:2.0:1788201599.382747:0:107403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788201599.382775:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1f690 lrc: 0/0,0 mode: --/CR res: [0x2400088d5:0xc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787083 expref: 19 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.382812:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1f658 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787067 expref: 18 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.382827:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59c00/0x96d0c9b8c9a1f5a9 lrc: 0/0,0 mode: --/PR res: [0x2400088d5:0xc:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787028 expref: 17 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.382838:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xc:0x0].0x0 (ffff8dc107816700) 00010000:00010000:2.0:1788201599.382848:0:107403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201599.382899:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6c8 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.382924:0:107403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6c8 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.382935:0:107403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6c8 lrc: 3/0,1 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201599.382959:0:107403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:107403:1875060715490816:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1788201599.383010:0:107403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201599.383093:0:107403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f17b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201599.383170:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715490816 00000100:00100000:0.0:1788201599.383175:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715490816 00000100:00100000:0.0:1788201599.383216:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788201599.383234:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107403:x1875060715490816:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1788201599.383248:0:99775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201599.383263:0:99775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f6cf lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f6c8 expref: -99 pid: 99775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.383284:0:99775:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58e00/0x96d0c9b8c9a1f57f lrc: 2/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78701a expref: 11 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.383293:0:99775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f6cf lrc: 4/0,0 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f6c8 expref: 8 pid: 99775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.383314:0:99775:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58e00/0x96d0c9b8c9a1f57f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78701a expref: 11 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.383327:0:99775:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58e00/0x96d0c9b8c9a1f57f lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78701a expref: 11 pid: 107404 timeout: 4550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201599.383339:0:99775:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91f480 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:99775:1875060715490944:192.168.201.20@tcp:104: 00000100:00100000:0.0:1788201599.383414:0:99775:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105d39e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201599.386552:0:99775:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91f480 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:99775:1875060715490944:192.168.201.20@tcp:104: 00010000:00010000:2.0:1788201599.386588:0:99775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f6cf lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f6c8 expref: 8 pid: 99775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.386611:0:99775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0x0 (ffff8dc107816800) 00010000:00010000:2.0:1788201599.386614:0:99775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201599.386618:0:99775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f6cf lrc: 3/0,0 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f6c8 expref: 8 pid: 99775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.386627:0:99775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d7200, rc 0) 00000100:00100000:2.0:1788201599.386692:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:107403:x1875060715490816:12345-0@lo:101:mdt00_000.0 Request processed in 3459us (3681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201599.386701:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788201599.386789:0:107403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:107403:1875060715490816:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1788201599.386808:0:107403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6c8 lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f6cf expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.386819:0:107403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6c8 lrc: 4/0,1 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f6cf expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201599.389775:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201599.389982:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695590016 00000100:00100000:1.0:1788201599.389993:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695590016 00010000:00010000:1.0:1788201599.390064:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58e00/0x96d0c9b8c9a1f57f lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78701a expref: 12 pid: 107404 timeout: 4550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201599.390109:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2638 00000100:00100000:1.0:1788201599.390120:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2401:x1875060695590016:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788201599.390135:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201599.390143:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58e00/0x96d0c9b8c9a1f57f lrc: 4/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78701a expref: 12 pid: 107404 timeout: 4550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.390156:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58e00/0x96d0c9b8c9a1f57f lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78701a expref: 12 pid: 107404 timeout: 4550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.390178:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58e00/0x96d0c9b8c9a1f57f lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78701a expref: 12 pid: 107404 timeout: 4550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.390206:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0x0 (ffff8dc107816800) 00010000:00010000:1.0:1788201599.390213:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f6cf lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f6c8 expref: 7 pid: 99775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.390225:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f6cf lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f6c8 expref: 7 pid: 99775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.390234:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f6cf lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f6c8 expref: 7 pid: 99775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.390267:0:6517:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f6cf lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f6c8 expref: 7 pid: 99775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201599.390281:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6517:1875060715491072:0@lo:105: 00000100:00100000:1.0:1788201599.390333:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201599.390379:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103892c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201599.390436:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715491072 00000100:00100000:2.0:1788201599.390441:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715491072 00000100:00100000:2.0:1788201599.390480:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1788201599.390487:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6517:x1875060715491072:12345-0@lo:105: 00010000:00010000:2.0:1788201599.390498:0:6515:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6c8 lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f6cf expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.390514:0:6515:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6c8 lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f6cf expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.390522:0:6515:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6c8 lrc: 5/0,1 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f6cf expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.390530:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6c8 lrc: 5/0,1 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x96d0c9b8c9a1f6cf expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.390537:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6c8 lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x96d0c9b8c9a1f6cf expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.390547:0:6515:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6c8 lrc: 6/0,1 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x96d0c9b8c9a1f6cf expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.390564:0:6515:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8dc140d59a00) 00000100:00100000:2.0:1788201599.390622:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6517:x1875060715491072:12345-0@lo:105: Request processed in 135us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201599.390628:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1788201599.390669:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6517:1875060715491072:0@lo:105: 00010000:00010000:3.0:1788201599.390686:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788201599.390700:0:107403:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6c8 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f6cf expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.390710:0:107403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6c8 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f6cf expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201599.390732:0:107403:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x34:0x0] 00000100:00100000:3.0:1788201599.390736:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:2401:x1875060695590016:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 619us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201599.390743:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2638 00010000:00010000:0.0:1788201599.390767:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6200/0x96d0c9b8c9a1f6d6 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.390774:0:107403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6200/0x96d0c9b8c9a1f6d6 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.390789:0:107403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6200/0x96d0c9b8c9a1f6d6 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201599.390805:0:107403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:107403:1875060715491200:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1788201599.390834:0:107403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201599.390862:0:107403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105d39e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788201599.390930:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715491200 00000100:00100000:3.0:1788201599.390935:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715491200 00000100:00100000:3.0:1788201599.390970:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788201599.390977:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:107403:x1875060715491200:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1788201599.390992:0:99776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201599.391006:0:99776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74000/0x96d0c9b8c9a1f6dd lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f6d6 expref: -99 pid: 99776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201599.391042:0:99776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74000/0x96d0c9b8c9a1f6dd lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f6d6 expref: 9 pid: 99776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201599.391055:0:99776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74000/0x96d0c9b8c9a1f6dd lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f6d6 expref: 9 pid: 99776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201599.391063:0:99776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0xd1d4b922 (ffff8dc002663700) 00010000:00010000:3.0:1788201599.391066:0:99776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201599.391069:0:99776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c74000, rc 0) 00000100:00100000:3.0:1788201599.391383:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:107403:x1875060715491200:12345-0@lo:101:mdt00_000.0 Request processed in 405us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201599.391390:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788201599.391696:0:107403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:107403:1875060715491200:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1788201599.391711:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6200/0x96d0c9b8c9a1f6d6 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f6dd expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.391723:0:107403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6200/0x96d0c9b8c9a1f6d6 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f6dd expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788201599.391739:0:107403:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x34:0x0] 00000100:00100000:0.0:1788201599.391771:0:107403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:107403:1875060715491328:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788201599.391817:0:107403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201599.391847:0:107403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105d39780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201599.393199:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715491328 00000100:00100000:2.0:1788201599.393210:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715491328 00000100:00100000:2.0:1788201599.393268:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788201599.393277:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:107403:x1875060715491328:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788201599.393372:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:107403:x1875060715491328:12345-0@lo:1000:mdt00_000.0 Request processed in 97us (1556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201599.393380:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788201599.393496:0:107403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:107403:1875060715491328:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788201599.393561:0:107403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:107403:1875060715491456:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788201599.393607:0:107403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201599.393637:0:107403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105d39780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201599.393697:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715491456 00000100:00100000:2.0:1788201599.393702:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715491456 00000100:00100000:2.0:1788201599.393720:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788201599.393726:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:107403:x1875060715491456:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788201599.393792:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:107403:x1875060715491456:12345-0@lo:1000:mdt00_000.0 Request processed in 65us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201599.393799:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788201599.393863:0:107403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:107403:1875060715491456:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788201599.393897:0:107403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:107403:1875060715491584:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788201599.393919:0:107403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201599.393942:0:107403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105d39780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201599.393992:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715491584 00000100:00100000:2.0:1788201599.393996:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715491584 00000100:00100000:2.0:1788201599.394054:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788201599.394062:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:107403:x1875060715491584:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788201599.394132:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:107403:x1875060715491584:12345-0@lo:1000:mdt00_000.0 Request processed in 70us (211us total) trans 0 rc 1/1 00000100:00100000:2.0:1788201599.394138:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788201599.394479:0:107403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:107403:1875060715491584:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788201599.394538:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f6e4 lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.394547:0:107403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f6e4 lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.394556:0:107403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f6e4 lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201599.394568:0:107403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:107403:1875060715491712:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1788201599.394604:0:107403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201599.394626:0:107403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105d39e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201599.394676:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715491712 00000100:00100000:2.0:1788201599.394681:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715491712 00000100:00100000:2.0:1788201599.394714:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788201599.394720:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:107403:x1875060715491712:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1788201599.394730:0:99775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201599.394747:0:99775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1f6eb lrc: 2/0,0 mode: --/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f6e4 expref: -99 pid: 99775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.394769:0:99775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1f6eb lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f6e4 expref: 10 pid: 99775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.394783:0:99775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1f6eb lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f6e4 expref: 10 pid: 99775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.394810:0:99775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xc:0x0].0x0 (ffff8dc005cc6500) 00010000:00010000:2.0:1788201599.394814:0:99775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788201599.394818:0:99775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58800, rc 0) 00000100:00100000:2.0:1788201599.394857:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:107403:x1875060715491712:12345-0@lo:101:mdt00_000.0 Request processed in 136us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201599.394863:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788201599.394917:0:107403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:107403:1875060715491712:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1788201599.394928:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f6e4 lrc: 4/0,1 mode: EX/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f6eb expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.394938:0:107403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f6e4 lrc: 4/0,1 mode: EX/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f6eb expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.394967:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f6f2 lrc: 3/0,1 mode: --/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.394976:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f6f2 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.394984:0:107403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f6f2 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.395001:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1f6f9 lrc: 3/0,1 mode: --/EX res: [0x2400090a0:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.395008:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1f6f9 lrc: 3/0,1 mode: EX/EX res: [0x2400090a0:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.399960:0:107403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1f6f9 lrc: 3/0,1 mode: EX/EX res: [0x2400090a0:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.400082:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7800/0x96d0c9b8c9a1f700 lrc: 3/0,1 mode: --/EX res: [0x20000e691:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.400091:0:107403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7800/0x96d0c9b8c9a1f700 lrc: 3/0,1 mode: --/EX res: [0x20000e691:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.400106:0:107403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7800/0x96d0c9b8c9a1f700 lrc: 3/0,1 mode: --/EX res: [0x20000e691:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201599.400132:0:107403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:107403:1875060715491840:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1788201599.400199:0:107403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201599.400236:0:107403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105d39e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788201599.400627:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715491840 00000100:00100000:2.0:1788201599.400634:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715491840 00000100:00100000:2.0:1788201599.400689:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788201599.400699:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:107403:x1875060715491840:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1788201599.400718:0:99775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201599.400736:0:99775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1f707 lrc: 2/0,0 mode: --/EX res: [0x20000e691:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f700 expref: -99 pid: 99775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.400762:0:99775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1f707 lrc: 3/0,0 mode: EX/EX res: [0x20000e691:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f700 expref: 11 pid: 99775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.400777:0:99775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1f707 lrc: 3/0,0 mode: EX/EX res: [0x20000e691:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f700 expref: 11 pid: 99775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.400786:0:99775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000e691:0x3:0x0].0x0 (ffff8dc005cc6f00) 00010000:00010000:2.0:1788201599.400789:0:99775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201599.400793:0:99775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58200, rc 0) 00000100:00100000:2.0:1788201599.400848:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:107403:x1875060715491840:12345-0@lo:101:mdt00_000.0 Request processed in 149us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201599.400855:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788201599.400949:0:107403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:107403:1875060715491840:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1788201599.400969:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7800/0x96d0c9b8c9a1f700 lrc: 4/0,1 mode: EX/EX res: [0x20000e691:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f707 expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.400981:0:107403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7800/0x96d0c9b8c9a1f700 lrc: 4/0,1 mode: EX/EX res: [0x20000e691:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f707 expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201599.401718:0:107403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:107403:1875060715491968:0@lo:403:mdt00_000.0 00000100:00100000:1.0:1788201599.401767:0:107403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201599.401797:0:107403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103892600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201599.403565:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715491968 00000100:00100000:2.0:1788201599.403578:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715491968 00000100:00100000:2.0:1788201599.403635:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788201599.403645:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:107403:x1875060715491968:12345-0@lo:403:mdt00_000.0 00000100:00100000:2.0:1788201599.407113:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:107403:x1875060715491968:12345-0@lo:403:mdt00_000.0 Request processed in 3460us (5335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201599.407129:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788201599.407281:0:107403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:107403:1875060715491968:0@lo:403:mdt00_000.0 00000040:00080000:1.0:1788201599.410537:0:107403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240009870:0x1:0x0].2, 936 off34048 00000100:00100000:1.0:1788201599.410768:0:107403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:107403:1875060715492096:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788201599.410830:0:107403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201599.410908:0:107403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc103892d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201599.414300:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715492096 00000100:00100000:0.0:1788201599.414333:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715492096 00000100:00100000:0.0:1788201599.414485:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788201599.414496:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:107403:x1875060715492096:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788201599.414628:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:107403:x1875060715492096:12345-0@lo:1000:mdt00_000.0 Request processed in 134us (3797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201599.414636:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788201599.414711:0:107403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:107403:1875060715492096:0@lo:1000:mdt00_000.0 00000040:00080000:1.0:1788201599.414758:0:107403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000ee61:0x1:0x0].2, 1016 off34208 00000004:00080000:1.0:1788201599.414769:0:107403:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc103892600 with version 8 00000004:00080000:3.0:1788201599.414835:0:107452:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc13a875f00 version 8 rpc_version 8 00000020:00100000:3.0:1788201599.414862:0:107452:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788201599.414870:0:107452:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc120090000 x1875060715492352/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2336/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201599.414900:0:107452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107452:1875060715492352:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201599.414939:0:107452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201599.419182:0:107452:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005fd3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201599.420476:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715492352 00000100:00100000:2.0:1788201599.420488:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715492352 00000100:00100000:2.0:1788201599.420549:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788201599.420558:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:107452:x1875060715492352:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788201599.422602:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:107452:x1875060715492352:12345-0@lo:1000:osp_up0-1.0 Request processed in 2027us (7644us total) trans 133143986188 rc 0/0 00000100:00100000:2.0:1788201599.422617:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788201599.424795:0:107452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107452:1875060715492352:0@lo:1000:osp_up0-1.0 00000004:00200000:1.0:1788201599.426180:0:107403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400088d5:0xc:0x0]: returning size 4096 00010000:00010000:1.0:1788201599.426209:0:107403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1f6f9 lrc: 3/0,1 mode: EX/EX res: [0x2400090a0:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.426220:0:107403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1f6f9 lrc: 2/0,0 mode: EX/EX res: [0x2400090a0:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.426229:0:107403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1f6f9 lrc: 3/0,0 mode: EX/EX res: [0x2400090a0:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.426235:0:107403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201599.426240:0:107403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1f6f9 lrc: 3/0,0 mode: EX/EX res: [0x2400090a0:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.426249:0:107403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1f6f9 lrc: 4/0,0 mode: EX/EX res: [0x2400090a0:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.426264:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x3:0x0].0x0 (ffff8dc11248c300) 00010000:00010000:1.0:1788201599.426267:0:107403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201599.426272:0:107403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1f6f9 lrc: 2/0,0 mode: --/EX res: [0x2400090a0:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.426302:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1f6f9 lrc: 0/0,0 mode: --/EX res: [0x2400090a0:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.426329:0:107403:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7800/0x96d0c9b8c9a1f700 lrc: 4/0,1 mode: EX/EX res: [0x20000e691:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f707 expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.426338:0:107403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7800/0x96d0c9b8c9a1f700 lrc: 4/0,1 mode: EX/EX res: [0x20000e691:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1f707 expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.426346:0:107403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7800/0x96d0c9b8c9a1f700 lrc: 3/0,0 mode: EX/EX res: [0x20000e691:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1f707 expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.426471:0:107403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788201599.426483:0:107403:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000e691:0x3:0x0] 00010000:00010000:1.0:1788201599.426493:0:107403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f6f2 lrc: 3/0,1 mode: EX/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.426500:0:107403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f6f2 lrc: 2/0,0 mode: EX/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.426507:0:107403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f6f2 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.426513:0:107403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6c00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201599.426516:0:107403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f6f2 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.426522:0:107403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f6f2 lrc: 4/0,0 mode: EX/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.426541:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xc:0x0].0x0 (ffff8dc11248c000) 00010000:00010000:1.0:1788201599.426543:0:107403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201599.426546:0:107403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f6f2 lrc: 2/0,0 mode: --/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.426551:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f6f2 lrc: 0/0,0 mode: --/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.426564:0:107403:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f6e4 lrc: 4/0,1 mode: EX/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f6eb expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.426571:0:107403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f6e4 lrc: 4/0,1 mode: EX/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1f6eb expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.426578:0:107403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f6e4 lrc: 3/0,0 mode: EX/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1f6eb expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.429047:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201599.429061:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7800/0x96d0c9b8c9a1f700 lrc: 2/0,0 mode: EX/EX res: [0x20000e691:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1f707 expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.429073:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7800 already unused, calling callback (ffffffffc189cee0) 00010000:00010000:2.0:1788201599.429079:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7800/0x96d0c9b8c9a1f700 lrc: 3/0,0 mode: EX/EX res: [0x20000e691:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1f707 expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201599.429089:0:24979:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7800/0x96d0c9b8c9a1f700 lrc: 3/0,0 mode: EX/EX res: [0x20000e691:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1f707 expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.429135:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7800/0x96d0c9b8c9a1f700 lrc: 2/0,0 mode: --/EX res: [0x20000e691:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f707 expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.429162:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788201599.429239:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715492480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201599.429313:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201599.429410:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715492480 00000100:00100000:0.0:1788201599.429418:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715492480 00000100:00100000:0.0:1788201599.429475:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00000100:00100000:0.0:1788201599.429486:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1059ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+12:3655:x1875060715492480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201599.429499:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201599.429519:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58200/0x96d0c9b8c9a1f707 lrc: 0/0,0 mode: --/EX res: [0x20000e691:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f700 expref: 12 pid: 99775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201599.429538:0:26215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000e691:0x3:0x0].0x0 (ffff8dc005cc6f00) 00010000:00010000:0.0:1788201599.429549:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201599.429610:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7800/0x96d0c9b8c9a1f700 lrc: 1/0,0 mode: --/EX res: [0x20000e691:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f707 expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.429620:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d7800/0x96d0c9b8c9a1f700 lrc: 0/0,0 mode: --/EX res: [0x20000e691:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f707 expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.429637:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201599.429642:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f6e4 lrc: 4/0,0 mode: EX/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1f6eb expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.429649:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6a00 already unused, calling callback (ffffffffc189cee0) 00010000:00010000:2.0:1788201599.429653:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f6e4 lrc: 5/0,0 mode: EX/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1f6eb expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201599.429661:0:24979:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f6e4 lrc: 5/0,0 mode: EX/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1f6eb expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.429680:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f6e4 lrc: 4/0,0 mode: --/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f6eb expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.429687:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201599.429750:0:107403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000004:00080000:1.0:1788201599.429770:0:107403:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x34:0x0] 00010000:00010000:1.0:1788201599.429781:0:107403:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6c8 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f6cf expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.429790:0:107403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6c8 lrc: 4/0,1 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1f6cf expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.429799:0:107403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6c8 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1f6cf expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.429814:0:107403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788201599.429827:0:107403:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000d6f1:0x34:0x0] 00010000:00010000:1.0:1788201599.429835:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201599.429840:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6c8 lrc: 2/0,0 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1f6cf expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.429847:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59a00 already unused, calling callback (ffffffffc189cee0) 00010000:00010000:1.0:1788201599.429850:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6c8 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1f6cf expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201599.429857:0:6520:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6c8 lrc: 3/0,0 mode: CW/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1f6cf expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.429876:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6c8 lrc: 2/0,0 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f6cf expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.429883:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201599.429898:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6c8 lrc: 1/0,0 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f6cf expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.429906:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc140d59a00/0x96d0c9b8c9a1f6c8 lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f6cf expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.429921:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201599.429923:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201599.429926:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201599.429936:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201599.429948:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715492736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201599.429979:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201599.430054:0:107403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6200/0x96d0c9b8c9a1f6d6 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f6dd expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.430075:0:107403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6200/0x96d0c9b8c9a1f6d6 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f6dd expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201599.430143:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+17:80748:x1875060695589888:12345-192.168.201.20@tcp:36:rm.0 Request processed in 47455us (47667us total) trans 85899345930 rc 0/0 00000100:00100000:1.0:1788201599.430152:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 39 00000100:00100000:1.0:1788201599.433851:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715492736 00000100:00100000:1.0:1788201599.433866:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715492736 00000100:00100000:1.0:1788201599.433942:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 783 00000100:00100000:1.0:1788201599.433953:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+12:3658:x1875060715492736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201599.433968:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788201599.433994:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7200/0x96d0c9b8c9a1f6cf lrc: 0/0,0 mode: --/CW res: [0x20000d6f1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f6c8 expref: 12 pid: 99775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.434042:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0x0 (ffff8dc107816800) 00010000:00010000:1.0:1788201599.434048:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788201599.434116:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3658:x1875060715492736:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (4136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201599.434124:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 783 00000100:00100000:1.0:1788201599.434177:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715492736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201599.438167:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1059ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+10:3655:x1875060715492480:12345-0@lo:103:ldlm_bl.0 Request processed in 8673us (8843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201599.438181:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00000100:00100000:3.0:1788201599.438896:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715492480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201599.438921:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201599.438932:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715492608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201599.438981:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201599.439057:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715492608 00000100:00100000:3.0:1788201599.439064:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715492608 00000100:00100000:3.0:1788201599.439117:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:3.0:1788201599.439126:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+10:3655:x1875060715492608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201599.439139:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201599.439161:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58800/0x96d0c9b8c9a1f6eb lrc: 0/0,0 mode: --/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f6e4 expref: 10 pid: 99775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201599.439180:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400088d5:0xc:0x0].0x0 (ffff8dc005cc6500) 00010000:00010000:3.0:1788201599.439190:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201599.439232:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3655:x1875060715492608:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201599.439239:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00010000:00010000:3.0:1788201599.439262:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201599.439283:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715492608:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201599.439558:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f6e4 lrc: 1/0,0 mode: --/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f6eb expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.439569:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6a00/0x96d0c9b8c9a1f6e4 lrc: 0/0,0 mode: --/EX res: [0x2400088d5:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f6eb expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.439608:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201599.439610:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201599.439612:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201599.443895:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201599.443975:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695590144 00000100:00100000:2.0:1788201599.443985:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695590144 00000100:00100000:2.0:1788201599.444075:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 40 00000100:00100000:2.0:1788201599.444086:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+11:80748:x1875060695590144:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:2.0:1788201599.444109:0:107404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201599.444129:0:107404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1f70e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78708a expref: -99 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.444189:0:107404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f715 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.444202:0:107404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f715 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.444213:0:107404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f715 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.444228:0:107404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f71c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.444235:0:107404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f71c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.444242:0:107404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f71c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.444338:0:107404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1f723 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.444348:0:107404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1f723 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.444356:0:107404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1f723 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201599.444470:0:107404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x34:0x0]: returning size 4096 00000004:00200000:2.0:1788201599.444474:0:107404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201599.444494:0:107404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1f723 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.444506:0:107404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f715 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.444513:0:107404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f715 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.444520:0:107404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f715 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.444527:0:107404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201599.444531:0:107404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f715 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.444538:0:107404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f715 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.444549:0:107404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc107816400) 00010000:00010000:2.0:1788201599.444559:0:107404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201599.444564:0:107404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f715 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.444571:0:107404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f715 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.444585:0:107404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f71c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.444603:0:107404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f71c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.444609:0:107404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f71c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.444614:0:107404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201599.444618:0:107404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f71c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.444625:0:107404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f71c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.444633:0:107404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe888c80e (ffff8dc005cc6c00) 00010000:00010000:2.0:1788201599.444636:0:107404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201599.444639:0:107404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f71c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.444645:0:107404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f71c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.444676:0:107404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58000/0x96d0c9b8c9a1f70e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78708a expref: 13 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.444705:0:107404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1f723 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78708a expref: 12 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201599.444714:0:107404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0x0 (ffff8dc107816800) 00010000:00010000:2.0:1788201599.444716:0:107404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201599.444719:0:107404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59a00, rc 0) 00000100:00100000:2.0:1788201599.444786:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:80748:x1875060695590144:12345-192.168.201.20@tcp:101:rm.0 Request processed in 702us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201599.444795:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 40 00000100:00100000:1.0:1788201599.447760:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201599.447835:0:107406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695590400 00000100:00100000:2.0:1788201599.447844:0:107406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695590400 00000100:00100000:2.0:1788201599.447904:0:107406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:2.0:1788201599.447914:0:107406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:80748:x1875060695590400:12345-192.168.201.20@tcp:35:rm.0 00000100:00100000:3.0:1788201599.453283:0:107406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:80748:x1875060695590400:12345-192.168.201.20@tcp:35:rm.0 Request processed in 5362us (5526us total) trans 133143986189 rc 0/0 00000100:00100000:3.0:1788201599.453298:0:107406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 16 00000100:00100000:0.0:1788201599.456277:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201599.456371:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695590656 00000100:00100000:1.0:1788201599.456451:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695590656 00000100:00100000:1.0:1788201599.456519:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 41 00000100:00100000:1.0:1788201599.456531:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+13:80748:x1875060695590656:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:1.0:1788201599.456618:0:107403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788201599.456647:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59a00/0x96d0c9b8c9a1f723 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78708a expref: 13 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.456670:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58600/0x96d0c9b8c9a1f643 lrc: 0/0,0 mode: --/CR res: [0x20000d6f1:0x34:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787060 expref: 12 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.456684:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0x0 (ffff8dc107816800) 00010000:00010000:1.0:1788201599.456701:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58400/0x96d0c9b8c9a1f563 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787013 expref: 11 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.456710:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc107816400) 00010000:00010000:1.0:1788201599.456716:0:107403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201599.456742:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f72a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.456756:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f72a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.456765:0:107403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f72a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.456778:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1f731 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe888c80e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.456786:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1f731 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.456794:0:107403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1f731 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.456887:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1f738 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.456895:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1f738 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.456901:0:107403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1f738 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201599.457187:0:107403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x34:0x0]: returning size 4096 00010000:00010000:1.0:1788201599.457202:0:107403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1f738 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.457209:0:107403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1f738 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.457216:0:107403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1f738 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.457221:0:107403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201599.457225:0:107403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1f738 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.457232:0:107403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1f738 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.457240:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0x0 (ffff8dc103a3a200) 00010000:00010000:1.0:1788201599.457243:0:107403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201599.457246:0:107403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1f738 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.457261:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1f738 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.457282:0:107403:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f72a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.457288:0:107403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f72a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.457292:0:107403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f72a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.457297:0:107403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f72a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.457302:0:107403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201599.457305:0:107403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f72a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.457310:0:107403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f72a lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.457318:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a3a500) 00010000:00010000:1.0:1788201599.457320:0:107403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201599.457322:0:107403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f72a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.457328:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f72a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201599.457341:0:107403:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1755bc0 reply state 000000004380aa67 transno 133143986190 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1f731 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.457360:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1f731 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201599.457366:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe888c80e (ffff8dc103a3aa00) 00010000:00010000:1.0:1788201599.457368:0:107403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201599.457371:0:107403:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201599.458638:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:80748:x1875060695590656:12345-192.168.201.20@tcp:36:rm.0 Request processed in 2106us (2366us total) trans 133143986190 rc 0/0 00000100:00100000:1.0:1788201599.458649:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 41 00010000:00010000:1.0:1788201600.335300:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201600.984166:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201600.984213:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201600.984240:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201600.984260:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201600.984284:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201600.984312:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695591040 00000100:00100000:0.0:1788201600.984321:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695591040 00000100:00100000:0.0:1788201600.984383:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695590912 00000100:00100000:0.0:1788201600.984386:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695590912 00000100:00100000:0.0:1788201600.984406:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:0.0:1788201600.984416:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+17:2403:x1875060695591040:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201600.984508:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+17:2403:x1875060695591040:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 93us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201600.984515:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:0.0:1788201600.984533:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:0.0:1788201600.984540:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2403:x1875060695590912:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201600.984579:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+12:2403:x1875060695590912:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 39us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201600.984585:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:0.0:1788201600.984604:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695591296 00000100:00100000:0.0:1788201600.984607:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695591296 00000100:00100000:0.0:1788201600.984631:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695591168 00000100:00100000:0.0:1788201600.984634:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695591168 00000100:00100000:0.0:1788201600.984655:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 180 00000100:00100000:0.0:1788201600.984662:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695591296:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201600.984688:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695591296:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201600.984694:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 180 00000100:00100000:0.0:1788201600.984705:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 181 00000100:00100000:0.0:1788201600.984711:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695591168:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201600.984731:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695591168:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 19us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201600.984746:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 181 00000100:00080000:0.0:1788201600.984769:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201600.984773:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201600.984775:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201600.984777:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201600.985050:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695590784 00000100:00100000:1.0:1788201600.985056:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695590784 00000100:00100000:1.0:1788201600.985093:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 95 00000100:00100000:1.0:1788201600.985101:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695590784:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201600.985133:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695590784:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 33us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201600.985140:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 95 00000100:00100000:3.0:1788201601.359243:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715492992:0@lo:400:kworker.0 00000100:00100000:3.0:1788201601.359312:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201601.359417:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715493504:0@lo:400:kworker.0 00000100:00100000:3.0:1788201601.359445:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201601.359470:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715494016:0@lo:400:kworker.0 00000100:00100000:3.0:1788201601.359491:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201601.359515:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788201601.359521:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715493120:0@lo:400:kworker.0 00000100:00100000:3.0:1788201601.359542:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201601.359569:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715493632:0@lo:400:kworker.0 00000100:00100000:3.0:1788201601.359594:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201601.359610:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715494144:0@lo:400:kworker.0 00000100:00100000:3.0:1788201601.359630:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201601.359738:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715493248:0@lo:400:kworker.0 00000100:00100000:0.0:1788201601.359768:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201601.359975:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715493760:0@lo:400:kworker.0 00000100:00100000:0.0:1788201601.360006:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201601.360056:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715494272:0@lo:400:kworker.0 00000100:00100000:0.0:1788201601.360078:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201601.360099:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788201601.360105:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715492864:0@lo:400:kworker.0 00000100:00100000:0.0:1788201601.360133:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201601.360160:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715493376:0@lo:400:kworker.0 00000100:00100000:0.0:1788201601.360182:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201601.360193:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715493888:0@lo:400:kworker.0 00000100:00100000:0.0:1788201601.360214:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201601.360225:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715494400:0@lo:400:kworker.0 00000100:00100000:0.0:1788201601.360244:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201601.360269:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715492992 00000100:00100000:0.0:1788201601.360275:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715492992 00000100:00100000:0.0:1788201601.360387:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715493120 00000100:00100000:0.0:1788201601.360391:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715493120 00000100:00100000:0.0:1788201601.360409:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715493248 00000100:00100000:0.0:1788201601.360411:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715493248 00000100:00100000:0.0:1788201601.360438:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715493376 00000100:00100000:0.0:1788201601.360441:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715493376 00000100:00100000:0.0:1788201601.360453:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715493888 00000100:00100000:0.0:1788201601.360455:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715493888 00000100:00100000:0.0:1788201601.360465:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715494400 00000100:00100000:0.0:1788201601.360467:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715494400 00000100:00100000:0.0:1788201601.360480:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788201601.360488:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715492992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201601.360541:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715492992:12345-0@lo:400:kworker.0 Request processed in 53us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201601.360549:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788201601.360578:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788201601.360584:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715493120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201601.360612:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715493120:12345-0@lo:400:kworker.0 Request processed in 28us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201601.360617:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788201601.360628:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788201601.360633:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715493248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201601.360661:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715493248:12345-0@lo:400:kworker.0 Request processed in 28us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201601.360667:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788201601.360677:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788201601.360683:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715493376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201601.360706:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715493376:12345-0@lo:400:kworker.0 Request processed in 24us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201601.360711:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788201601.360720:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788201601.360732:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715493888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201601.360758:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715493888:12345-0@lo:400:kworker.0 Request processed in 27us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201601.360763:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788201601.360773:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788201601.360778:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715494400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201601.360991:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715493632 00000100:00100000:3.0:1788201601.360996:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715493632 00000100:00100000:3.0:1788201601.361041:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715494144 00000100:00100000:3.0:1788201601.361044:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715494144 00000100:00100000:3.0:1788201601.361065:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715493760 00000100:00100000:3.0:1788201601.361067:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715493760 00000100:00100000:3.0:1788201601.361082:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715494272 00000100:00100000:3.0:1788201601.361085:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715494272 00000100:00100000:3.0:1788201601.361102:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788201601.361108:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715493632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201601.361153:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715493632:12345-0@lo:400:kworker.0 Request processed in 45us (1558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201601.361160:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788201601.361173:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788201601.361179:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715494144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201601.361204:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715494144:12345-0@lo:400:kworker.0 Request processed in 25us (1572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201601.361211:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788201601.361222:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788201601.361228:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12bfd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715493760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201601.361255:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12bfd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715493760:12345-0@lo:400:kworker.0 Request processed in 27us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201601.361260:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788201601.361436:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715494400:12345-0@lo:400:kworker.0 Request processed in 657us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201601.361442:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788201601.361465:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715493504 00000100:00100000:0.0:1788201601.361469:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715493504 00000100:00100000:0.0:1788201601.361486:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715494016 00000100:00100000:0.0:1788201601.361489:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715494016 00000100:00100000:0.0:1788201601.361500:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788201601.361506:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715493504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201601.361537:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715493504:12345-0@lo:400:kworker.0 Request processed in 31us (2092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201601.361542:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788201601.361553:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788201601.361569:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3655:x1875060715494016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201601.361599:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3655:x1875060715494016:12345-0@lo:400:kworker.0 Request processed in 41us (2108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201601.361605:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788201601.361678:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715492864 00000100:00100000:0.0:1788201601.361682:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715492864 00000100:00100000:0.0:1788201601.361704:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788201601.361710:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715492864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201601.361753:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715492864:12345-0@lo:400:kworker.0 Request processed in 42us (1618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201601.361759:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788201601.362070:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788201601.362078:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715494272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201601.362109:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715494272:12345-0@lo:400:kworker.0 Request processed in 33us (2030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201601.362115:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00010000:00010000:1.0:1788201601.362223:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201601.362589:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715492864:0@lo:400:kworker.0 00000100:00100000:1.0:1788201601.362602:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715493376:0@lo:400:kworker.0 00000100:00100000:1.0:1788201601.362613:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715493888:0@lo:400:kworker.0 00000100:00100000:1.0:1788201601.362622:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715494400:0@lo:400:kworker.0 00000100:00100000:1.0:1788201601.362631:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715493248:0@lo:400:kworker.0 00000100:00100000:1.0:1788201601.362640:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715493760:0@lo:400:kworker.0 00000100:00100000:1.0:1788201601.362663:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715494272:0@lo:400:kworker.0 00000100:00100000:1.0:1788201601.362701:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715494528:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201601.362735:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201601.362766:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715493120:0@lo:400:kworker.0 00000100:00100000:1.0:1788201601.362776:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715493632:0@lo:400:kworker.0 00000100:00100000:1.0:1788201601.362992:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715494144:0@lo:400:kworker.0 00000100:00100000:1.0:1788201601.363006:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715492992:0@lo:400:kworker.0 00000100:00100000:1.0:1788201601.363040:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715493504:0@lo:400:kworker.0 00000100:00100000:1.0:1788201601.363053:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715494016:0@lo:400:kworker.0 00000100:00100000:1.0:1788201601.363084:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715494528 00000100:00100000:1.0:1788201601.363088:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715494528 00000100:00100000:1.0:1788201601.363123:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788201601.363130:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715494528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201601.363152:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1788201601.363192:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715494528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201601.363198:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788201601.363230:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715494528:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788201601.363423:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201601.363428:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201601.363432:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201601.363434:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201601.365052:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201601.365072:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715494656:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201601.365129:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201601.365174:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715494656 00000100:00100000:0.0:1788201601.365180:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715494656 00000100:00100000:0.0:1788201601.365222:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788201601.365230:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715494656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201601.365254:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788201601.365296:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715494656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201601.365303:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788201601.365356:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715494656:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201601.367522:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715494784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201601.367593:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201601.367921:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715494784 00000100:00100000:0.0:1788201601.367929:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715494784 00000100:00100000:0.0:1788201601.367975:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788201601.367985:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715494784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201601.368047:0:99776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445376000 avail 1299136512 00000100:00100000:0.0:1788201601.377715:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715494784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9720us (10110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201601.377731:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788201601.378571:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715494784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201601.872076:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201601.872098:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715494912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201601.872164:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201601.872301:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715494912 00000100:00100000:2.0:1788201601.872316:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715494912 00000100:00100000:2.0:1788201601.872358:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788201601.872365:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3657:x1875060715494912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201601.872392:0:99775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444945920 avail 1298706432 00000100:00100000:2.0:1788201601.872434:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3657:x1875060715494912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201601.872438:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201601.872507:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715494912:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788201602.385935:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201602.386235:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201602.386256:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715495040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201602.386313:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201602.386429:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715495040 00000100:00100000:2.0:1788201602.386436:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715495040 00000100:00100000:2.0:1788201602.386493:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788201602.386502:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715495040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201602.386548:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201602.386640:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715495040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201602.386646:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788201602.387683:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201602.387699:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715495168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201602.387740:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201602.388042:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715495168 00000100:00100000:0.0:1788201602.388049:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715495168 00000100:00100000:0.0:1788201602.388096:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788201602.388118:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715495168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201602.388136:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201602.388192:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715495168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201602.388199:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788201602.388297:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715495168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201602.389384:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715495040:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788201603.414063:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201604.433259:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201604.441315:0:107392:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6200/0x96d0c9b8c9a1f6d6 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1f6dd expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201604.441340:0:107392:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6200/0x96d0c9b8c9a1f6d6 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1f6dd expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201604.441387:0:107392:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6200/0x96d0c9b8c9a1f6d6 lrc: 2/0,0 mode: --/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f6dd expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201604.441394:0:107392:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201604.441430:0:107392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8dc0056d6200/0x96d0c9b8c9a1f6d6 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f6dd expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788201604.441454:0:107392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 85899345930 is committed 00000100:00100000:1.0:1788201604.441553:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715495296:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1788201604.441660:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201604.441735:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715495296 00000100:00100000:3.0:1788201604.441745:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715495296 00000100:00100000:3.0:1788201604.441835:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:3.0:1788201604.441845:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3657:x1875060715495296:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1788201604.441860:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201604.441879:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74000/0x96d0c9b8c9a1f6dd lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x34:0x0].0xd1d4b922 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f6d6 expref: 9 pid: 99776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201604.441894:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x34:0x0].0xd1d4b922 (ffff8dc002663700) 00010000:00010000:3.0:1788201604.441903:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201604.441989:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3657:x1875060715495296:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 135us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201604.441998:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00010000:00010000:0.0:1788201604.442218:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59e00/0x96d0c9b8c9a1f6ba lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201604.442228:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59e00/0x96d0c9b8c9a1f6ba lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201604.442235:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59e00/0x96d0c9b8c9a1f6ba lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201604.442242:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59e00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201604.442247:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59e00/0x96d0c9b8c9a1f6ba lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201604.442254:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59e00/0x96d0c9b8c9a1f6ba lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201604.442277:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a0:0x3:0x0].0xf0209d98 (ffff8dc005cc6300) 00010000:00010000:0.0:1788201604.442281:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201604.442286:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59e00/0x96d0c9b8c9a1f6ba lrc: 2/0,0 mode: --/TXN res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201604.442300:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8dc140d59e00/0x96d0c9b8c9a1f6ba lrc: 0/0,0 mode: --/TXN res: [0x2400090a0:0x3:0x0].0xf0209d98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107404 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201604.442343:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715495296:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1788201605.459680:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788201605.469413:0:107389:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 133143986190 is committed 00000001:00080000:2.0:1788201605.469438:0:107389:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 133143986188 is committed 00010000:00010000:3.0:1788201605.472655:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1f6a5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201605.472675:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1f6a5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201605.472685:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1f6a5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201605.472692:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201605.472698:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1f6a5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201605.472708:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1f6a5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201605.472731:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000e691:0x3:0x0].0xcd52553e (ffff8dc11248c700) 00010000:00010000:3.0:1788201605.472734:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201605.472767:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1f6a5 lrc: 2/0,0 mode: --/TXN res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201605.472909:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6800/0x96d0c9b8c9a1f6a5 lrc: 0/0,0 mode: --/TXN res: [0x20000e691:0x3:0x0].0xcd52553e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201605.472944:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1f731 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201605.472951:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1f731 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201605.472957:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1f731 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201605.472962:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ece00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201605.472965:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1f731 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201605.472971:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1f731 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201605.472979:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe888c80e (ffff8dc103a3aa00) 00010000:00010000:3.0:1788201605.472991:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201605.472995:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1f731 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201605.473001:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1f731 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe888c80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201606.100852:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201606.100881:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201606.100924:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201606.100942:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201606.100961:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201606.100986:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695591424 00000100:00100000:3.0:1788201606.100994:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695591424 00000100:00100000:3.0:1788201606.101052:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 97 00000100:00100000:3.0:1788201606.101062:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695591424:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201606.101120:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695591424:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 59us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201606.101128:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 97 00000100:00100000:3.0:1788201606.101156:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695591936 00000100:00100000:3.0:1788201606.101159:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695591936 00000100:00100000:3.0:1788201606.101188:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695591808 00000100:00100000:3.0:1788201606.101191:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695591808 00000100:00100000:3.0:1788201606.101207:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 186 00000100:00100000:3.0:1788201606.101213:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695591936:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201606.101236:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695591936:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201606.101242:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 186 00000100:00100000:3.0:1788201606.101252:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 187 00000100:00100000:3.0:1788201606.101258:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695591808:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201606.101275:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695591808:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 18us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201606.101281:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 187 00000100:00080000:3.0:1788201606.101383:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201606.101387:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201606.105105:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695591680 00000100:00100000:0.0:1788201606.105118:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695591680 00000100:00100000:0.0:1788201606.106438:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695591552 00000100:00100000:0.0:1788201606.106445:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695591552 00000100:00100000:1.0:1788201606.106500:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00100000:1.0:1788201606.106512:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695591680:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201606.106586:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695591680:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 77us (5704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201606.106594:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00080000:3.0:1788201606.107615:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201606.107622:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201606.107877:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 36 00000100:00100000:0.0:1788201606.107889:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695591552:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201606.107947:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695591552:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 61us (7003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201606.107954:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 36 00000100:00100000:2.0:1788201606.479653:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201606.479676:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715495424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201606.479739:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201606.479958:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715495424 00000100:00100000:1.0:1788201606.479966:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715495424 00000100:00100000:3.0:1788201606.480252:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715495552:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201606.480326:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788201606.480381:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788201606.485671:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201606.485693:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201606.485718:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715495680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201606.485990:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201606.490162:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715495680 00000100:00100000:0.0:1788201606.490184:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715495680 00000100:00080000:3.0:1788201606.497147:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201606.497774:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715495552 00000100:00100000:1.0:1788201606.497941:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788201606.498782:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715495552 00000100:00100000:0.0:1788201606.498865:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788201606.498895:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715495680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201606.498948:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788201606.499088:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715495680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 209us (13097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201606.499098:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788201606.499191:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715495680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201606.499880:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201606.499900:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715495808:0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.499957:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201606.500048:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715495936:0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.500092:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201606.500135:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201606.500143:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715496064:0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.500167:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201606.500197:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715495936 00000100:00100000:0.0:1788201606.500307:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715495936 00000100:00100000:0.0:1788201606.500367:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715496064 00000100:00100000:0.0:1788201606.500370:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715496064 00000100:00100000:0.0:1788201606.500567:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788201606.500577:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715495936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201606.500586:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715495424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201606.500631:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201606.500638:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715495936:12345-0@lo:400:kworker.0 Request processed in 62us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201606.500647:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788201606.500666:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788201606.500674:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715496064:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788201606.500955:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201606.500960:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201606.501012:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715495424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1782us (20974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201606.501036:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715496064:12345-0@lo:400:kworker.0 Request processed in 339us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201606.501055:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788201606.501057:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788201606.501105:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715495808 00000100:00100000:0.0:1788201606.501112:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715496064:0@lo:400:kworker.0 00000100:00100000:1.0:1788201606.501113:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715495808 00000100:00100000:0.0:1788201606.501156:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715495936:0@lo:400:kworker.0 00000100:00100000:1.0:1788201606.501158:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788201606.501179:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715495808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201606.501244:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715495808:12345-0@lo:400:kworker.0 Request processed in 71us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201606.501490:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715496192:0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.501526:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201606.501554:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715496192 00000100:00100000:0.0:1788201606.501558:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715496192 00000100:00100000:0.0:1788201606.501591:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788201606.501598:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715496192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.501643:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715496192:12345-0@lo:400:kworker.0 Request processed in 45us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201606.501650:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788201606.501677:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715496192:0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.501739:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201606.501746:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715496576:0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.501874:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201606.501907:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715496576 00000100:00100000:0.0:1788201606.501911:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715496576 00000100:00100000:1.0:1788201606.502214:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788201606.502282:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715496448:0@lo:400:kworker.0 00000100:00100000:1.0:1788201606.502321:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201606.502544:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715496320:0@lo:400:kworker.0 00000100:00100000:3.0:1788201606.502586:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201606.502631:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715495424:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788201606.502657:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201606.502661:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201606.502690:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788201606.502701:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715495552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788201606.502892:0:99776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445376000 avail 1299136512 00000100:00100000:3.0:1788201606.502940:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715495552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 242us (22614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201606.502948:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788201606.516769:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715495808:0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.517946:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715496448 00000100:00100000:0.0:1788201606.517966:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715496448 00000100:00100000:0.0:1788201606.518084:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788201606.518098:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715496576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.518371:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715496576:12345-0@lo:400:kworker.0 Request processed in 276us (16594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201606.518393:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788201606.518414:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788201606.518422:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715496448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.518456:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715496448:12345-0@lo:400:kworker.0 Request processed in 36us (16134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201606.518461:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788201606.518531:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715496576:0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.518571:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715496320 00000100:00100000:0.0:1788201606.518575:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715496320 00000100:00100000:0.0:1788201606.518611:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788201606.518619:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715496320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.518681:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715496320:12345-0@lo:400:kworker.0 Request processed in 63us (16095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201606.518689:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788201606.518746:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715495552:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201606.518983:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715496704:0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.519043:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201606.519136:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715496704 00000100:00100000:0.0:1788201606.519140:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715496704 00000100:00100000:0.0:1788201606.519167:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788201606.519174:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715496704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.519355:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715496704:12345-0@lo:400:kworker.0 Request processed in 181us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201606.519363:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788201606.519463:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715496704:0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.519518:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715496832:0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.519553:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201606.519585:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715496320:0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.519600:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201606.519605:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715496960:0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.519629:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201606.519652:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715496960 00000100:00100000:0.0:1788201606.519656:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715496960 00000100:00100000:0.0:1788201606.519679:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788201606.519686:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715496960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.519734:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1875060715496960:12345-0@lo:400:kworker.0 Request processed in 49us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201606.519742:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1788201606.519760:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201606.519765:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201606.519903:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3657:1875060715496960:0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.519958:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715496832 00000100:00100000:0.0:1788201606.519962:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715496832 00000100:00100000:0.0:1788201606.519985:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788201606.519993:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715496832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.520064:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715496832:12345-0@lo:400:kworker.0 Request processed in 72us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201606.520071:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788201606.520094:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 133143986188 gen 2 00000004:00080000:0.0:1788201606.520100:0:3657:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 133143986185 committed transno 133143986188 00000020:00080000:0.0:1788201606.520107:0:3657:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8dc120888780 refcount 2 committed 0 result 0 batchid 81604378641 00000020:00080000:0.0:1788201606.520112:0:3657:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc12f3fa600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8dc1208880c0 00000020:00080000:0.0:1788201606.520115:0:3657:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x20000ee61:0x1:0x0].1 00000020:00080000:0.0:1788201606.520118:0:3657:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc12f3fa400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dc108c72a00 00000020:00080000:0.0:1788201606.520121:0:3657:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240009870:0x1:0x0].1 00000004:00080000:0.0:1788201606.520173:0:3657:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 133143986188 committed transno 133143986188 00000020:00080000:0.0:1788201606.520178:0:3657:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8dc103892780 refcount 2 committed 0 result 0 batchid 81604378642 00000020:00080000:0.0:1788201606.520181:0:3657:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc12f3faf00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8dc103892600 00000020:00080000:0.0:1788201606.520184:0:3657:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x20000ee61:0x1:0x0].2 00000020:00080000:0.0:1788201606.520186:0:3657:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dc12f3fa200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dc1330e0200 00000020:00080000:0.0:1788201606.520195:0:3657:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240009870:0x1:0x0].2 00000100:00100000:0.0:1788201606.520526:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715496832:0@lo:400:kworker.0 00000020:00080000:0.0:1788201606.520556:0:107476:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 81604378642 committed batchid 77309411503 00000020:00080000:0.0:1788201606.520650:0:107476:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411503 00000100:00100000:1.0:1788201606.523387:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715496448:0@lo:400:kworker.0 00000100:00100000:0.0:1788201606.991358:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715497088:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201606.991982:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201606.992620:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715497088 00000100:00100000:3.0:1788201606.992632:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715497088 00000100:00100000:3.0:1788201606.992789:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788201606.992802:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715497088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201606.992866:0:99776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444945920 avail 1298706432 00000100:00100000:3.0:1788201606.992942:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715497088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201606.992951:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788201606.993086:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715497088:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788201607.504155:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201607.504232:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201607.504262:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715497216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201607.504358:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201607.504529:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715497216 00000100:00100000:0.0:1788201607.504539:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715497216 00000100:00100000:0.0:1788201607.504606:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788201607.504617:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715497216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201607.504646:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201607.504708:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715497216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201607.504716:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788201607.504775:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715497216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201607.507002:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715497344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201607.507109:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201607.507254:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715497344 00000100:00100000:3.0:1788201607.507263:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715497344 00000100:00100000:3.0:1788201607.507321:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788201607.507332:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715497344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201607.507372:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788201607.507431:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715497344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201607.507439:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788201607.508003:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715497344:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788201608.218130:0:108654:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 160: mdt.recovery_reconnect_histogram testing ========================================================== 14:40:06 (1788201606) 00000100:00100000:1.0:1788201608.359932:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201608.360083:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695592064 00000100:00100000:3.0:1788201608.360099:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695592064 00000100:00100000:3.0:1788201608.360198:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 42 00000100:00100000:3.0:1788201608.360220:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:81349:x1875060695592064:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:3.0:1788201608.360245:0:107404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201608.360275:0:107404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74600/0x96d0c9b8c9a1f73f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f787091 expref: -99 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201608.360377:0:107404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74000/0x96d0c9b8c9a1f746 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201608.360408:0:107404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74000/0x96d0c9b8c9a1f746 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201608.360423:0:107404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74000/0x96d0c9b8c9a1f746 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788201608.360495:0:107404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788201608.360499:0:107404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788201608.360524:0:107404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74000/0x96d0c9b8c9a1f746 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201608.360554:0:107404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74600/0x96d0c9b8c9a1f73f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787091 expref: 8 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201608.360574:0:107404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74000/0x96d0c9b8c9a1f746 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787091 expref: 7 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201608.360583:0:107404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12066fd00) 00010000:00010000:3.0:1788201608.360587:0:107404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788201608.360591:0:107404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c74000, rc 0) 00000100:00100000:3.0:1788201608.360658:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:81349:x1875060695592064:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 442us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201608.360665:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 42 00000100:00080000:1.0:1788201608.361072:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201608.365256:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201608.367238:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695592192 00000100:00100000:1.0:1788201608.367259:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695592192 00000100:00100000:1.0:1788201608.367358:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 43 00000100:00100000:1.0:1788201608.367373:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:81349:x1875060695592192:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1788201608.367399:0:107405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201608.367427:0:107405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1f74d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f787098 expref: -99 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201608.367522:0:107405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f754 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201608.367539:0:107405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f754 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201608.367552:0:107405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f754 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201608.367581:0:107405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f75b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc1561962 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201608.367589:0:107405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f75b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1561962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201608.367595:0:107405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f75b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1561962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201608.367650:0:107405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f754 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201608.367657:0:107405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f754 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201608.367664:0:107405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f754 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201608.367670:0:107405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201608.367675:0:107405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f754 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201608.367684:0:107405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f754 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201608.367712:0:107405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12066fd00) 00010000:00010000:1.0:1788201608.367716:0:107405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201608.367721:0:107405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f754 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201608.367728:0:107405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f754 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201608.367750:0:107405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f75b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1561962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201608.367757:0:107405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f75b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1561962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201608.367763:0:107405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f75b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1561962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201608.367769:0:107405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201608.367772:0:107405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f75b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1561962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201608.367778:0:107405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f75b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1561962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201608.367788:0:107405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc1561962 (ffff8dc103a3a200) 00010000:00010000:1.0:1788201608.367790:0:107405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201608.367794:0:107405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f75b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc1561962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201608.367800:0:107405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f75b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc1561962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201608.367837:0:107405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1f74d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787098 expref: 8 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201608.368163:0:107405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12066fd00) 00010000:00010000:1.0:1788201608.368166:0:107405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201608.368179:0:107405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed200/0x96d0c9b8c9a1f74d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787098 expref: 8 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201608.368192:0:107405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ed200, rc 0) 00000100:00100000:1.0:1788201608.368273:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:81349:x1875060695592192:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 903us (3030us total) trans 0 rc 301/301 00000100:00100000:1.0:1788201608.368281:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 43 00000100:00100000:0.0:1788201608.375678:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201608.379951:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695592448 00000100:00100000:2.0:1788201608.379975:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695592448 00000100:00100000:2.0:1788201608.380209:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 44 00000100:00100000:2.0:1788201608.380222:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:81349:x1875060695592448:12345-192.168.201.20@tcp:36:lfs.0 00010000:00010000:2.0:1788201608.380293:0:107403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201608.380328:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc108c74000/0x96d0c9b8c9a1f746 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787091 expref: 7 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201608.380368:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc12066fd00) 00010000:00010000:2.0:1788201608.380382:0:107403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201608.380469:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f762 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201608.380485:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f762 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201608.380497:0:107403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f762 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201608.380510:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f769 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc1561962 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201608.380516:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f769 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc1561962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201608.380522:0:107403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f769 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc1561962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201608.381218:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1f770 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201608.381241:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1f770 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201608.381249:0:107403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1f770 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201608.381266:0:107403:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055e6d11a reply state 000000003fbaf32d transno 133143986191 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1f770 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201608.381278:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1f770 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201608.381285:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x38:0x0].0x0 (ffff8dc008611e00) 00010000:00010000:2.0:1788201608.381287:0:107403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201608.381291:0:107403:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788201608.381297:0:107403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x38:0x0]: returning size 4096 00010000:00010000:2.0:1788201608.381306:0:107403:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f762 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201608.381313:0:107403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f762 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201608.381319:0:107403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f762 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201608.381326:0:107403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f762 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201608.381332:0:107403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58a00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201608.381337:0:107403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f762 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201608.381355:0:107403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f762 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201608.381365:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008611800) 00010000:00010000:2.0:1788201608.381368:0:107403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201608.381371:0:107403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f762 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201608.381378:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d58a00/0x96d0c9b8c9a1f762 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201608.381392:0:107403:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055e6d11a reply state 000000003fbaf32d transno 133143986191 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f769 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc1561962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201608.381401:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f769 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc1561962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201608.381407:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc1561962 (ffff8dc008611d00) 00010000:00010000:2.0:1788201608.381409:0:107403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201608.381412:0:107403:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788201608.381528:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:81349:x1875060695592448:12345-192.168.201.20@tcp:36:lfs.0 Request processed in 1307us (5865us total) trans 133143986191 rc 0/0 00000100:00100000:2.0:1788201608.381536:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 44 00010000:00010000:1.0:1788201608.527510:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788201609.209132:0:107392:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 81604378642 batchid updated 00000020:00080000:0.0:1788201609.209244:0:107476:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 81604378642 00000004:00080000:0.0:1788201609.209305:0:107476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc125ae4840 with version 9 00000020:00080000:0.0:1788201609.209322:0:107476:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 81604378641 cancel update log [0x20000ee61:0x1:0x0].1: rc = 0 00000004:00080000:3.0:1788201609.209475:0:107452:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc13a875f00 version 9 rpc_version 9 00000020:00100000:3.0:1788201609.209512:0:107452:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788201609.209523:0:107452:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc007c34000 x1875060715497600/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201609.209564:0:107452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c34000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107452:1875060715497600:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201609.209643:0:107452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201609.209678:0:107452:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f60600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201609.209699:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715497600 00000100:00100000:3.0:1788201609.209707:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715497600 00000100:00100000:3.0:1788201609.209755:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788201609.209764:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107452:x1875060715497600:12345-0@lo:1000:osp_up0-1.0 00000020:00080000:0.0:1788201609.209845:0:107476:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 81604378641 cancel update log [0x240009870:0x1:0x0].1: rc = 0 00000004:00080000:0.0:1788201609.209870:0:107476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc125ae4a80 with version 10 00000020:00080000:0.0:1788201609.209874:0:107476:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 81604378642 cancel update log [0x20000ee61:0x1:0x0].2: rc = 0 00000020:00080000:0.0:1788201609.209906:0:107476:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 81604378642 cancel update log [0x240009870:0x1:0x0].2: rc = 0 00000020:00080000:0.0:1788201609.209913:0:107476:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 81604378642 00000001:00080000:1.0:1788201609.211223:0:107389:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 133143986191 is committed 00010000:00010000:0.0:1788201609.211333:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f769 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc1561962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201609.211346:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f769 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc1561962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201609.211355:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f769 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc1561962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201609.211361:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59200 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201609.211367:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f769 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc1561962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201609.211375:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f769 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc1561962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201609.211404:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc1561962 (ffff8dc008611d00) 00010000:00010000:0.0:1788201609.211408:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201609.211414:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f769 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc1561962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201609.211430:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59200/0x96d0c9b8c9a1f769 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc1561962 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201609.211451:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1f770 lrc: 3/0,1 mode: TXN/TXN res: [0x20000d6f1:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201609.211458:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1f770 lrc: 2/0,0 mode: TXN/TXN res: [0x20000d6f1:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201609.211480:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1f770 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201609.211485:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:0.0:1788201609.211489:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1f770 lrc: 3/0,0 mode: TXN/TXN res: [0x20000d6f1:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201609.211496:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1f770 lrc: 4/0,0 mode: TXN/TXN res: [0x20000d6f1:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201609.211505:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x38:0x0].0x0 (ffff8dc008611e00) 00010000:00010000:0.0:1788201609.211508:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788201609.211511:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1f770 lrc: 2/0,0 mode: --/TXN res: [0x20000d6f1:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201609.211517:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59000/0x96d0c9b8c9a1f770 lrc: 0/0,0 mode: --/TXN res: [0x20000d6f1:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201609.213916:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107452:x1875060715497600:12345-0@lo:1000:osp_up0-1.0 Request processed in 4143us (4263us total) trans 133143986192 rc 0/0 00000100:00100000:3.0:1788201609.213932:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788201609.214088:0:107452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c34000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107452:1875060715497600:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1788201609.214105:0:107452:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc13a875f00 version 10 rpc_version 10 00000020:00100000:2.0:1788201609.214133:0:107452:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788201609.214140:0:107452:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc005254000 x1875060715497856/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201609.214163:0:107452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107452:1875060715497856:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788201609.214231:0:107452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201609.214303:0:107452:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12f17b3c0 going to sleep for 11 seconds 00000001:00080000:1.0:1788201609.220612:0:107389:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 133143986192 is committed 00000100:00100000:3.0:1788201609.224044:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715497856 00000100:00100000:3.0:1788201609.224060:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715497856 00000100:00100000:3.0:1788201609.224128:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788201609.224138:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11802f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:107452:x1875060715497856:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201609.224439:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11802f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:107452:x1875060715497856:12345-0@lo:1000:osp_up0-1.0 Request processed in 302us (10206us total) trans 133143986193 rc 0/0 00000100:00100000:3.0:1788201609.224448:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788201609.224801:0:107452:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 133143986192 gen 2 00000004:00080000:1.0:1788201609.224808:0:107452:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 133143986192 committed transno 133143986192 00000100:00100000:1.0:1788201609.224829:0:107452:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8dc005254000 x1875060715497856/t133143986193(133143986193) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1788201625 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201609.224848:0:107452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:107452:1875060715497856:0@lo:1000:osp_up0-1.0 00000001:00080000:1.0:1788201609.229247:0:107389:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 133143986193 is committed 00000100:00100000:1.0:1788201609.299640:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201609.299686:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695592576 00000100:00100000:1.0:1788201609.299696:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695592576 00000100:00100000:1.0:1788201609.299755:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 45 00000100:00100000:1.0:1788201609.299766:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:81358:x1875060695592576:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:1.0:1788201609.299790:0:107405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201609.299812:0:107405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f777 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f78709f expref: -99 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.299879:0:107405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f77e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.299914:0:107405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f77e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.299925:0:107405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f77e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201609.299972:0:107405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788201609.299976:0:107405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201609.299996:0:107405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f77e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.300036:0:107405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f777 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78709f expref: 8 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.300054:0:107405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f77e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78709f expref: 7 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.300062:0:107405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a3ad00) 00010000:00010000:1.0:1788201609.300066:0:107405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788201609.300069:0:107405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ec800, rc 0) 00000100:00100000:1.0:1788201609.300127:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:81358:x1875060695592576:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 362us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201609.300134:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 45 00000100:00100000:0.0:1788201609.307180:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201609.314309:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695592704 00000100:00100000:2.0:1788201609.314327:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695592704 00000100:00100000:2.0:1788201609.314539:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 46 00000100:00100000:2.0:1788201609.314553:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:81358:x1875060695592704:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:2.0:1788201609.314592:0:107403:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444941824 avail 1298702336 00000100:00100000:2.0:1788201609.315876:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:81358:x1875060695592704:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 1057us (8435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201609.315890:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 46 00000100:00100000:1.0:1788201609.328096:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201609.328180:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695592832 00000100:00100000:0.0:1788201609.328190:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695592832 00000100:00100000:0.0:1788201609.328263:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 47 00000100:00100000:0.0:1788201609.328274:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:81358:x1875060695592832:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:0.0:1788201609.328310:0:107404:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445376000 avail 1299136512 00000100:00100000:0.0:1788201609.328374:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:81358:x1875060695592832:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 101us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201609.328391:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 47 00000100:00080000:1.0:1788201609.329187:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201609.340152:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201609.340227:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695592960 00000100:00100000:3.0:1788201609.340236:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695592960 00000100:00100000:3.0:1788201609.340307:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 164 00000100:00100000:3.0:1788201609.340317:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:81358:x1875060695592960:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:3.0:1788201609.340347:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201609.340507:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:81358:x1875060695592960:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 191us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201609.340515:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 164 00000100:00080000:0.0:1788201609.341524:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201609.342635:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201609.342751:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695593088 00000100:00100000:1.0:1788201609.342761:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695593088 00000100:00100000:1.0:1788201609.342822:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 165 00000100:00100000:1.0:1788201609.342834:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:81358:x1875060695593088:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:1.0:1788201609.342879:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201609.342940:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:81358:x1875060695593088:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 110us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201609.342948:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 165 00000100:00080000:0.0:1788201609.343393:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201609.456653:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201609.456796:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695593344 00000100:00100000:2.0:1788201609.456808:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695593344 00000100:00100000:2.0:1788201609.456865:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 48 00000100:00100000:2.0:1788201609.456876:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:81365:x1875060695593344:12345-192.168.201.20@tcp:36:mcreate.0 00010000:00010000:2.0:1788201609.456930:0:107403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201609.456958:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f77e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f78709f expref: 7 pid: 107405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201609.456975:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a3ad00) 00010000:00010000:2.0:1788201609.456987:0:107403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201609.457126:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f785 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201609.457140:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f785 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201609.457150:0:107403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f785 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201609.457183:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f78c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201609.457191:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f78c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201609.457198:0:107403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f78c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201609.457581:0:107403:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f785 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201609.457589:0:107403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f785 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201609.457596:0:107403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f785 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201609.457602:0:107403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f785 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201609.457608:0:107403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201609.457789:0:107403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f785 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201609.457799:0:107403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f785 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201609.457809:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc008611000) 00010000:00010000:2.0:1788201609.457812:0:107403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201609.457816:0:107403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f785 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201609.457830:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59800/0x96d0c9b8c9a1f785 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201609.457846:0:107403:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc8a69cc reply state 000000006ed3d56d transno 133143986194 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f78c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201609.457859:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f78c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201609.457865:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc008611900) 00010000:00010000:2.0:1788201609.457867:0:107403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201609.457870:0:107403:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788201609.457950:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:81365:x1875060695593344:12345-192.168.201.20@tcp:36:mcreate.0 Request processed in 1075us (1305us total) trans 133143986194 rc 0/0 00000100:00100000:2.0:1788201609.457958:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 48 00000100:00100000:3.0:1788201609.484193:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201609.484314:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695593472 00000100:00100000:1.0:1788201609.484323:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695593472 00000100:00100000:0.0:1788201609.484745:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 49 00000100:00100000:0.0:1788201609.484771:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:81368:x1875060695593472:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:0.0:1788201609.484794:0:107403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201609.484819:0:107403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1f793 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7870a6 expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201609.484889:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1f79a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201609.484902:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1f79a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201609.484913:0:107403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1f79a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788201609.484960:0:107403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788201609.484964:0:107403:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788201609.484983:0:107403:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1f79a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201609.485006:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d7400/0x96d0c9b8c9a1f793 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7870a6 expref: 10 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201609.485044:0:107403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1f79a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7870a6 expref: 9 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201609.485064:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a1ea00) 00010000:00010000:0.0:1788201609.485083:0:107403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788201609.485087:0:107403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d6200, rc 0) 00000100:00100000:0.0:1788201609.485142:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:81368:x1875060695593472:12345-192.168.201.20@tcp:101:rm.0 Request processed in 377us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201609.485149:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 49 00000100:00100000:0.0:1788201609.488529:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201609.488607:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695593600 00000100:00100000:1.0:1788201609.488684:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695593600 00000100:00100000:1.0:1788201609.488741:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 50 00000100:00100000:1.0:1788201609.488751:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+9:81368:x1875060695593600:12345-192.168.201.20@tcp:101:rm.0 00010000:00010000:1.0:1788201609.488771:0:107404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201609.488790:0:107404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1f7a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7870ad expref: -99 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.488849:0:107404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1f7a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.488863:0:107404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1f7a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.488874:0:107404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1f7a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.488885:0:107404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec400/0x96d0c9b8c9a1f7af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.488892:0:107404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec400/0x96d0c9b8c9a1f7af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.488899:0:107404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec400/0x96d0c9b8c9a1f7af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.488985:0:107404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1f7b6 lrc: 3/1,0 mode: --/PR res: [0x20000d6f1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.488994:0:107404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1f7b6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x39:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.489000:0:107404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1f7b6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x39:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788201609.489084:0:107404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000d6f1:0x39:0x0]: returning size 0 00000004:00200000:1.0:1788201609.489088:0:107404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788201609.489106:0:107404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1f7b6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x39:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.489117:0:107404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1f7b6 lrc: 3/1,0 mode: PR/PR res: [0x20000d6f1:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.489126:0:107404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1f7a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.489132:0:107404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1f7a8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.489139:0:107404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1f7a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.489145:0:107404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201609.489149:0:107404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1f7a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.489156:0:107404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1f7a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.489174:0:107404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a1ea00) 00010000:00010000:1.0:1788201609.489177:0:107404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201609.489182:0:107404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1f7a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.489189:0:107404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed000/0x96d0c9b8c9a1f7a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.489202:0:107404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec400/0x96d0c9b8c9a1f7af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.489208:0:107404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec400/0x96d0c9b8c9a1f7af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.489214:0:107404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec400/0x96d0c9b8c9a1f7af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.489219:0:107404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201609.489222:0:107404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec400/0x96d0c9b8c9a1f7af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.489227:0:107404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec400/0x96d0c9b8c9a1f7af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.489234:0:107404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc008611900) 00010000:00010000:1.0:1788201609.489237:0:107404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201609.489239:0:107404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec400/0x96d0c9b8c9a1f7af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.489245:0:107404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec400/0x96d0c9b8c9a1f7af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 107404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.489280:0:107404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1f7a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7870ad expref: 11 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.489293:0:107404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1f7b6 lrc: 3/0,0 mode: PR/PR res: [0x20000d6f1:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7870ad expref: 10 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.489300:0:107404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x39:0x0].0x0 (ffff8dc103a3ab00) 00010000:00010000:1.0:1788201609.489302:0:107404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788201609.489304:0:107404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ece00, rc 0) 00000100:00100000:1.0:1788201609.489360:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:81368:x1875060695593600:12345-192.168.201.20@tcp:101:rm.0 Request processed in 611us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201609.489367:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 50 00000100:00100000:3.0:1788201609.493141:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201609.493376:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695593856 00000100:00100000:1.0:1788201609.493400:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695593856 00000100:00100000:1.0:1788201609.493482:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 51 00000100:00100000:1.0:1788201609.493493:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:81368:x1875060695593856:12345-192.168.201.20@tcp:36:rm.0 00010000:00010000:1.0:1788201609.493556:0:107405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788201609.493584:0:107405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1f7b6 lrc: 0/0,0 mode: --/PR res: [0x20000d6f1:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7870ad expref: 10 pid: 107404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.493603:0:107405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x39:0x0].0x0 (ffff8dc103a3ab00) 00010000:00010000:1.0:1788201609.493784:0:107405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc0056d6200/0x96d0c9b8c9a1f79a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7870a6 expref: 9 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.493795:0:107405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a1ea00) 00010000:00010000:1.0:1788201609.493821:0:107405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788201609.493843:0:107405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f7bd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.493856:0:107405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f7bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.493865:0:107405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f7bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.493876:0:107405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f7c4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.493884:0:107405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f7c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.493891:0:107405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f7c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.493961:0:107405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f7cb lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.493969:0:107405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f7cb lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.493976:0:107405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f7cb lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.494320:0:107405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1f7d2 lrc: 3/0,1 mode: --/PW res: [0x20000d6f1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.494330:0:107405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1f7d2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.494347:0:107405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1f7d2 lrc: 3/0,1 mode: PW/PW res: [0x20000d6f1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.494355:0:107405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1f7d2 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.494361:0:107405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1f7d2 lrc: 4/0,1 mode: PW/PW res: [0x20000d6f1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.494368:0:107405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1f7d2 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.494833:0:107405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201609.494855:0:107405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f7cb lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.494862:0:107405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f7cb lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.494869:0:107405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f7cb lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.494874:0:107405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201609.494879:0:107405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f7cb lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.494885:0:107405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f7cb lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.494894:0:107405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x39:0x0].0x0 (ffff8dc103a3aa00) 00010000:00010000:1.0:1788201609.494897:0:107405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788201609.494907:0:107405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f7cb lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.494914:0:107405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed800/0x96d0c9b8c9a1f7cb lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.494932:0:107405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f7bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.494937:0:107405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f7bd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.494943:0:107405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f7bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.494949:0:107405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ecc00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201609.494952:0:107405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f7bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.494958:0:107405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f7bd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.494965:0:107405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc103a3a500) 00010000:00010000:1.0:1788201609.494967:0:107405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201609.494970:0:107405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f7bd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.494976:0:107405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f7bd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201609.494989:0:107405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dbfe4270 reply state 00000000c5e0cdc4 transno 133143986195 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f7c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.495010:0:107405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f7c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201609.495066:0:107405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc008611900) 00010000:00010000:1.0:1788201609.495068:0:107405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201609.495071:0:107405:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788201609.495152:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:81368:x1875060695593856:12345-192.168.201.20@tcp:36:rm.0 Request processed in 1659us (2025us total) trans 133143986195 rc 0/0 00000100:00100000:1.0:1788201609.495160:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 51 00010000:00010000:2.0:1788201609.500225:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201609.500241:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1f7d2 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201609.500252:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201609.500257:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1f7d2 lrc: 2/0,0 mode: PW/PW res: [0x20000d6f1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201609.500266:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1f7d2 lrc: 3/0,0 mode: PW/PW res: [0x20000d6f1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201609.500287:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x39:0x0].0x0 (ffff8dc103a3aa00) 00010000:00010000:2.0:1788201609.500291:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788201609.500295:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1f7d2 lrc: 1/0,0 mode: --/PW res: [0x20000d6f1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201609.500321:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1f7d2 lrc: 0/0,0 mode: --/PW res: [0x20000d6f1:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201609.500431:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201609.500435:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201609.500437:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201609.551359:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201610.587311:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201611.225870:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201611.225920:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201611.225960:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201611.225977:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201611.226002:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201611.226049:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695594112 00000100:00100000:3.0:1788201611.226059:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695594112 00000100:00100000:3.0:1788201611.226117:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695594240 00000100:00100000:3.0:1788201611.226121:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695594240 00000100:00100000:3.0:1788201611.226141:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 43 00000100:00100000:3.0:1788201611.227689:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2401:x1875060695594112:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000080:3.0:1788201611.227749:0:107403:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc007c36680 x1875060695594112/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:732/0 lens 224/224 e 0 to 0 dl 1788201622 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201611.227820:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2401:x1875060695594112:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 1670us (1960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201611.227830:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 43 00000100:00100000:3.0:1788201611.227858:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 44 00000100:00100000:3.0:1788201611.227868:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695594240:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201611.227893:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695594240:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 28us (1914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201611.227898:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 44 00000100:00100000:3.0:1788201611.227922:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695594368 00000100:00100000:3.0:1788201611.227941:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695594368 00000100:00100000:3.0:1788201611.227972:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695594496 00000100:00100000:3.0:1788201611.227975:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695594496 00000100:00100000:3.0:1788201611.227993:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 190 00000100:00100000:3.0:1788201611.228000:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695594368:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201611.228040:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695594368:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 41us (2120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201611.228046:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 190 00000100:00100000:3.0:1788201611.228058:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 191 00000100:00100000:3.0:1788201611.228063:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695594496:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201611.228086:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695594496:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (2084us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201611.228091:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 191 00000100:00080000:3.0:1788201611.228105:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201611.228108:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201611.228111:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201611.228114:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201611.229508:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695593984 00000100:00100000:2.0:1788201611.229519:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695593984 00000100:00100000:2.0:1788201611.229564:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 99 00000100:00100000:2.0:1788201611.229573:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695593984:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201611.229620:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695593984:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 49us (3660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201611.229626:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 99 00000100:00100000:0.0:1788201611.611479:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201611.611504:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715497984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201611.611602:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201611.611646:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715498112:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788201611.611907:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201611.612004:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715498368:0@lo:400:kworker.0 00000100:00100000:1.0:1788201611.612058:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201611.612087:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715498880:0@lo:400:kworker.0 00000100:00100000:1.0:1788201611.612111:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201611.612130:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715499392:0@lo:400:kworker.0 00000100:00100000:1.0:1788201611.612165:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201611.612185:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788201611.612190:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715498496:0@lo:400:kworker.0 00000100:00100000:1.0:1788201611.612212:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201611.612228:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715499008:0@lo:400:kworker.0 00000100:00100000:1.0:1788201611.612245:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201611.612259:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715499520:0@lo:400:kworker.0 00000100:00100000:1.0:1788201611.612275:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201611.612299:0:107396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715498368 00000100:00100000:1.0:1788201611.612317:0:107396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715498368 00000100:00100000:1.0:1788201611.612358:0:107396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788201611.612366:0:107396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715498368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201611.612425:0:107396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715498368:12345-0@lo:400:kworker.0 Request processed in 60us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201611.612433:0:107396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788201611.612463:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715498880 00000100:00100000:1.0:1788201611.612467:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715498880 00000100:00100000:1.0:1788201611.612495:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715499392 00000100:00100000:1.0:1788201611.612498:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715499392 00000100:00100000:1.0:1788201611.612508:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715498496 00000100:00100000:1.0:1788201611.612510:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715498496 00000100:00100000:1.0:1788201611.612522:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788201611.612528:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715498880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201611.612555:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715498880:12345-0@lo:400:kworker.0 Request processed in 28us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201611.612561:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788201611.612584:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788201611.612590:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715499392:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788201611.612602:0:107403:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc120090380 x1875060715499392/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:732/0 lens 224/224 e 0 to 0 dl 1788201622 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201611.612627:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1875060715499392:12345-0@lo:400:kworker.0 Request processed in 37us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201611.612633:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788201611.612645:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788201611.612650:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715498496:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788201611.612660:0:107403:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc120092300 x1875060715498496/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:732/0 lens 224/224 e 0 to 0 dl 1788201622 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201611.612930:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715498496:12345-0@lo:400:kworker.0 Request processed in 278us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201611.612937:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788201611.612966:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715499008 00000100:00100000:1.0:1788201611.612970:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715499008 00000100:00100000:1.0:1788201611.612987:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715499520 00000100:00100000:1.0:1788201611.612990:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715499520 00000100:00100000:1.0:1788201611.613002:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788201611.613008:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715499008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201611.613061:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715499008:12345-0@lo:400:kworker.0 Request processed in 52us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201611.613067:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788201611.613079:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788201611.613085:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715499520:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788201611.613101:0:99775:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc137cec700 x1875060715499520/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:732/0 lens 224/224 e 0 to 0 dl 1788201622 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201611.613125:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715499520:12345-0@lo:400:kworker.0 Request processed in 41us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201611.613131:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1788201611.613215:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788201611.613220:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201611.613252:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715498496:0@lo:400:kworker.0 00000100:00100000:1.0:1788201611.613264:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715499008:0@lo:400:kworker.0 00000100:00100000:1.0:1788201611.613273:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715499520:0@lo:400:kworker.0 00000100:00100000:1.0:1788201611.613281:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715498368:0@lo:400:kworker.0 00000100:00100000:1.0:1788201611.613301:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715498880:0@lo:400:kworker.0 00000100:00100000:1.0:1788201611.613310:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3657:1875060715499392:0@lo:400:kworker.0 00000100:00100000:0.0:1788201611.613427:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201611.613459:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715498624:0@lo:400:kworker.0 00000100:00100000:0.0:1788201611.613490:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201611.613509:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715499136:0@lo:400:kworker.0 00000100:00100000:0.0:1788201611.613534:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201611.613552:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715499648:0@lo:400:kworker.0 00000100:00100000:0.0:1788201611.613583:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201611.613599:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788201611.613605:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715498240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201611.613627:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201611.613644:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715498752:0@lo:400:kworker.0 00000100:00100000:0.0:1788201611.613666:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201611.613681:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715499264:0@lo:400:kworker.0 00000100:00100000:0.0:1788201611.613887:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201611.613907:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc120090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715499776:0@lo:400:kworker.0 00000100:00100000:0.0:1788201611.613927:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201611.613960:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715497984 00000100:00100000:0.0:1788201611.613965:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715497984 00000100:00100000:0.0:1788201611.614002:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715498240 00000100:00100000:0.0:1788201611.614005:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715498240 00000100:00100000:0.0:1788201611.614044:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788201611.614052:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715497984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201611.614074:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201611.614110:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715497984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (2508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201611.614116:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788201611.614129:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788201611.614135:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715498240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788201611.617910:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788201611.618045:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715498240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3905us (4411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201611.618058:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788201611.618120:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715499136 00000100:00100000:0.0:1788201611.618129:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715499136 00000100:00100000:0.0:1788201611.618249:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715499648 00000100:00100000:0.0:1788201611.618253:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715499648 00000100:00100000:0.0:1788201611.618272:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715499264 00000100:00100000:0.0:1788201611.618275:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715499264 00000100:00100000:0.0:1788201611.618297:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788201611.618306:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715499136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201611.618363:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715499136:12345-0@lo:400:kworker.0 Request processed in 58us (4827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201611.618370:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788201611.618397:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788201611.618404:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715499648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201611.618438:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715499648:12345-0@lo:400:kworker.0 Request processed in 35us (4865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201611.618445:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788201611.618456:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788201611.618461:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715499264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201611.618486:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715499264:12345-0@lo:400:kworker.0 Request processed in 25us (4598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201611.618492:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788201611.618553:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715498240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201611.618566:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715499264:0@lo:400:kworker.0 00000100:00100000:0.0:1788201611.622892:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715499136:0@lo:400:kworker.0 00000100:00100000:0.0:1788201611.622916:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715499648:0@lo:400:kworker.0 00000100:00100000:0.0:1788201611.622996:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715498624 00000100:00100000:0.0:1788201611.623003:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715498624 00000100:00100000:0.0:1788201611.623063:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715498752 00000100:00100000:0.0:1788201611.623066:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715498752 00000100:00100000:0.0:1788201611.623081:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715499776 00000100:00100000:0.0:1788201611.623084:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715499776 00000100:00100000:0.0:1788201611.623098:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788201611.623106:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715498624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201611.623279:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715498624:12345-0@lo:400:kworker.0 Request processed in 172us (9786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201611.623287:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788201611.623306:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788201611.623312:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715498752:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788201611.623327:0:107404:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc005abd500 x1875060715498752/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:732/0 lens 224/224 e 0 to 0 dl 1788201622 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201611.623356:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715498752:12345-0@lo:400:kworker.0 Request processed in 45us (9689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201611.623362:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788201611.623373:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201611.623392:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715499776:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788201611.623404:0:107404:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc005abd880 x1875060715499776/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:732/0 lens 224/224 e 0 to 0 dl 1788201622 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201611.623431:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715499776:12345-0@lo:400:kworker.0 Request processed in 53us (9503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201611.623437:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201611.623464:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715498752:0@lo:400:kworker.0 00000100:00100000:0.0:1788201611.623476:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc120090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715499776:0@lo:400:kworker.0 00000100:00100000:0.0:1788201611.623486:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715498624:0@lo:400:kworker.0 00000100:00080000:0.0:1788201611.623512:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201611.623516:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201611.623519:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201611.623522:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201611.623543:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715498112 00000100:00100000:0.0:1788201611.623547:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715498112 00000100:00100000:0.0:1788201611.627902:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788201611.627929:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715498112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788201611.627970:0:99775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445376000 avail 1299136512 00000100:00100000:0.0:1788201611.628089:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715498112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 173us (14662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201611.628097:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788201611.628313:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715497984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201611.628862:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715498112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201612.116118:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715499904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201612.116193:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201612.116360:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715499904 00000100:00100000:2.0:1788201612.116380:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715499904 00000100:00100000:2.0:1788201612.116438:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788201612.116448:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715499904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201612.116482:0:99775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444941824 avail 1298702336 00010000:00000080:2.0:1788201612.116498:0:99775:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc137ceea00 x1875060715499904/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:733/0 lens 224/368 e 0 to 0 dl 1788201623 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201612.116541:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715499904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201612.116548:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788201612.118199:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715499904:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788201612.623494:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201612.623817:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715500032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201612.623886:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201612.624045:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201612.624054:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715500160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201612.624080:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201612.624111:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715500032 00000100:00100000:3.0:1788201612.624118:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715500032 00000100:00100000:3.0:1788201612.624301:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715500160 00000100:00100000:3.0:1788201612.624305:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715500160 00000100:00100000:3.0:1788201612.624323:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788201612.624333:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715500032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788201612.624354:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201612.624421:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715500032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201612.624429:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788201612.624446:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788201612.625826:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715500032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201612.625952:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715500160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201612.625973:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788201612.626059:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715500160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1607us (1977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201612.626066:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788201612.630884:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715500160:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788201613.656744:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201614.674483:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201615.712403:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201616.342543:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201616.342597:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201616.342627:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201616.342653:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201616.342677:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201616.342703:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695595136 00000100:00100000:3.0:1788201616.342712:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695595136 00000100:00100000:3.0:1788201616.342765:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695595008 00000100:00100000:3.0:1788201616.342768:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695595008 00000100:00100000:3.0:1788201616.342792:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 195 00000100:00100000:3.0:1788201616.342803:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695595136:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201616.342871:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695595136:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 71us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201616.342879:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 195 00000100:00100000:3.0:1788201616.342895:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 196 00000100:00100000:3.0:1788201616.342901:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695595008:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201616.342935:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695595008:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 34us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201616.342941:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 196 00000100:00100000:3.0:1788201616.342959:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695594880 00000100:00100000:3.0:1788201616.342962:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695594880 00000100:00100000:3.0:1788201616.342985:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695594752 00000100:00100000:3.0:1788201616.342988:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695594752 00000100:00100000:3.0:1788201616.343002:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 51 00000100:00100000:3.0:1788201616.343007:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695594880:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201616.343052:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695594880:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 45us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201616.343071:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 51 00000100:00100000:3.0:1788201616.343083:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 52 00000100:00100000:3.0:1788201616.343090:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2401:x1875060695594752:12345-192.168.201.20@tcp:400:kworker.0 00010000:00000080:3.0:1788201616.343103:0:107405:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12b637b80 x1875060695594752/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:737/0 lens 224/224 e 0 to 0 dl 1788201627 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201616.343124:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+10:2401:x1875060695594752:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 36us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201616.343130:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 52 00000100:00080000:3.0:1788201616.343144:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201616.343148:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201616.343150:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201616.343152:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201616.343615:0:107398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695594624 00000100:00100000:1.0:1788201616.343621:0:107398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695594624 00000100:00100000:1.0:1788201616.343661:0:107398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 101 00000100:00100000:1.0:1788201616.343670:0:107398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695594624:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201616.343708:0:107398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695594624:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 40us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201616.343715:0:107398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 101 00000100:00100000:1.0:1788201616.723040:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715500672:0@lo:400:kworker.0 00000100:00100000:1.0:1788201616.723122:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201616.723165:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715501184:0@lo:400:kworker.0 00000100:00100000:1.0:1788201616.723191:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201616.723235:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715501696:0@lo:400:kworker.0 00000100:00100000:1.0:1788201616.723274:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201616.723313:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788201616.723319:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715500288:0@lo:400:kworker.0 00000100:00100000:1.0:1788201616.723350:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201616.723376:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715500800:0@lo:400:kworker.0 00000100:00100000:1.0:1788201616.723397:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201616.723413:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715501312:0@lo:400:kworker.0 00000100:00100000:1.0:1788201616.723431:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201616.723444:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715501824:0@lo:400:kworker.0 00000100:00100000:1.0:1788201616.723460:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201616.723479:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715500416:0@lo:400:kworker.0 00000100:00100000:1.0:1788201616.723498:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201616.723509:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715500928:0@lo:400:kworker.0 00000100:00100000:1.0:1788201616.723527:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201616.723541:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715501440:0@lo:400:kworker.0 00000100:00100000:1.0:1788201616.723557:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201616.723573:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788201616.723578:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715500544:0@lo:400:kworker.0 00000100:00100000:1.0:1788201616.723598:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201616.723608:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715501056:0@lo:400:kworker.0 00000100:00100000:1.0:1788201616.723627:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201616.723641:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715501568:0@lo:400:kworker.0 00000100:00100000:1.0:1788201616.723658:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201616.723698:0:107397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715500288 00000100:00100000:1.0:1788201616.723706:0:107397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715500288 00000100:00100000:1.0:1788201616.723751:0:107397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788201616.723760:0:107397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1331e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715500288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201616.723806:0:107397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1331e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715500288:12345-0@lo:400:kworker.0 Request processed in 46us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201616.723814:0:107397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788201616.723844:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715500928 00000100:00100000:1.0:1788201616.723848:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715500928 00000100:00100000:1.0:1788201616.723864:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715501440 00000100:00100000:1.0:1788201616.723866:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715501440 00000100:00100000:1.0:1788201616.723878:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788201616.723885:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11fc17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715500928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201616.723922:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11fc17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715500928:12345-0@lo:400:kworker.0 Request processed in 38us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201616.723929:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788201616.723942:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788201616.723948:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11fc14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715501440:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788201616.723960:0:99776:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11fc14e00 x1875060715501440/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:737/0 lens 224/224 e 0 to 0 dl 1788201627 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201616.723986:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11fc14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715501440:12345-0@lo:400:kworker.0 Request processed in 38us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201616.723992:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788201616.724050:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715500928:0@lo:400:kworker.0 00000100:00100000:1.0:1788201616.724063:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715501440:0@lo:400:kworker.0 00000100:00100000:1.0:1788201616.724090:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715500288:0@lo:400:kworker.0 00000100:00100000:2.0:1788201616.724393:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201616.724403:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715501952:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201616.724432:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201616.724462:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715501952 00000100:00100000:2.0:1788201616.724471:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715501952 00000100:00100000:2.0:1788201616.724511:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788201616.724517:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715501952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201616.724541:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201616.724577:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715501952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201616.724582:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:2.0:1788201616.724597:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201616.724622:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715501952:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201616.726093:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715500672 00000100:00100000:2.0:1788201616.726104:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715500672 00000100:00100000:2.0:1788201616.726159:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715500800 00000100:00100000:2.0:1788201616.726162:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715500800 00000100:00100000:2.0:1788201616.726177:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715501312 00000100:00100000:2.0:1788201616.726180:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715501312 00000100:00100000:2.0:1788201616.726189:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715501824 00000100:00100000:2.0:1788201616.726191:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715501824 00000100:00100000:2.0:1788201616.726200:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715500416 00000100:00100000:2.0:1788201616.726203:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715500416 00000100:00100000:2.0:1788201616.726214:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715500544 00000100:00100000:2.0:1788201616.726217:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715500544 00000100:00100000:2.0:1788201616.726232:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788201616.726240:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715500672:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788201616.726261:0:107403:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc12efc9c00 x1875060715500672/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:737/0 lens 224/224 e 0 to 0 dl 1788201627 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201616.726337:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715500672:12345-0@lo:400:kworker.0 Request processed in 96us (3214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201616.726344:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788201616.726358:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788201616.726379:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11fc15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715500800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201616.726412:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11fc15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715500800:12345-0@lo:400:kworker.0 Request processed in 35us (3014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201616.726418:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788201616.726430:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788201616.726436:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11fc16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715501312:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788201616.726447:0:107403:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11fc16300 x1875060715501312/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:737/0 lens 224/224 e 0 to 0 dl 1788201627 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201616.726472:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11fc16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715501312:12345-0@lo:400:kworker.0 Request processed in 37us (3040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201616.726478:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788201616.726488:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788201616.726494:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11fc17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715501824:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788201616.726504:0:107403:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11fc17480 x1875060715501824/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:737/0 lens 224/224 e 0 to 0 dl 1788201627 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201616.726529:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11fc17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715501824:12345-0@lo:400:kworker.0 Request processed in 35us (3067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201616.726534:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788201616.726545:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788201616.726550:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11fc15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715500416:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788201616.726562:0:107403:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc11fc15500 x1875060715500416/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:737/0 lens 224/224 e 0 to 0 dl 1788201627 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201616.726587:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11fc15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715500416:12345-0@lo:400:kworker.0 Request processed in 37us (3088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201616.726602:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788201616.726614:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788201616.726620:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11fc15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715500544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201616.726648:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11fc15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715500544:12345-0@lo:400:kworker.0 Request processed in 28us (3049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201616.726653:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1788201616.726678:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201616.726682:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201616.726712:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715500800:0@lo:400:kworker.0 00000100:00100000:2.0:1788201616.726723:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715501312:0@lo:400:kworker.0 00000100:00100000:2.0:1788201616.726734:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715501824:0@lo:400:kworker.0 00000100:00100000:2.0:1788201616.726743:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715500672:0@lo:400:kworker.0 00000100:00100000:1.0:1788201616.727390:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715500544:0@lo:400:kworker.0 00000100:00100000:1.0:1788201616.727403:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137cedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715500416:0@lo:400:kworker.0 00000100:00100000:2.0:1788201616.731535:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715501184 00000100:00100000:2.0:1788201616.731551:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715501184 00000100:00100000:2.0:1788201616.731637:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715501696 00000100:00100000:2.0:1788201616.731641:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715501696 00000100:00100000:2.0:1788201616.731661:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715501056 00000100:00100000:2.0:1788201616.731664:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715501056 00000100:00100000:2.0:1788201616.731681:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715501568 00000100:00100000:2.0:1788201616.731684:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715501568 00000100:00100000:2.0:1788201616.731707:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788201616.731717:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715501184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201616.731809:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715501184:12345-0@lo:400:kworker.0 Request processed in 93us (8615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201616.731816:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788201616.731847:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788201616.731853:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11fc16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715501696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201616.731886:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11fc16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715501696:12345-0@lo:400:kworker.0 Request processed in 34us (8612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201616.731893:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788201616.731903:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788201616.731909:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11fc15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715501056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201616.731946:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11fc15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715501056:12345-0@lo:400:kworker.0 Request processed in 37us (8318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201616.731951:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788201616.731961:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788201616.731967:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11fc17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715501568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201616.731993:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11fc17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715501568:12345-0@lo:400:kworker.0 Request processed in 26us (8334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201616.731999:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788201616.732090:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715501056:0@lo:400:kworker.0 00000100:00100000:2.0:1788201616.732103:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715501568:0@lo:400:kworker.0 00000100:00100000:2.0:1788201616.732141:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715501184:0@lo:400:kworker.0 00000100:00100000:2.0:1788201616.732151:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715501696:0@lo:400:kworker.0 00000100:00080000:1.0:1788201616.734329:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201616.734338:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788201616.736767:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201616.741351:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201616.741372:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715502208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201616.741437:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201616.741487:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715502208 00000100:00100000:2.0:1788201616.741494:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715502208 00000100:00100000:2.0:1788201616.741552:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788201616.741561:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715502208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201616.741587:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201616.741629:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715502208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201616.741636:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788201616.741658:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11fc15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715502080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201616.741684:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201616.741737:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715502208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201616.741779:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715502080 00000100:00100000:2.0:1788201616.741783:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715502080 00000100:00100000:2.0:1788201616.741808:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788201616.741815:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715502080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201616.741836:0:99776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445376000 avail 1299136512 00000100:00100000:2.0:1788201616.741868:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715502080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201616.741874:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788201616.741898:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11fc15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715502080:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1788201616.754091:0:107389:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 133143986195 is committed 00010000:00010000:3.0:1788201616.754222:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f78c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201616.754245:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f78c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201616.754252:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f78c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201616.754258:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59400 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201616.754263:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f78c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201616.754270:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f78c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201616.754286:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc008611900) 00010000:00010000:3.0:1788201616.754300:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201616.754304:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f78c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201616.754310:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc140d59400/0x96d0c9b8c9a1f78c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201616.754327:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f7c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201616.754333:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f7c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201616.754338:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f7c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201616.754343:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec800 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201616.754351:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f7c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201616.754357:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f7c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201616.754365:0:3641:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc008611900) 00010000:00010000:3.0:1788201616.754368:0:3641:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788201616.754370:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f7c4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201616.754376:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec800/0x96d0c9b8c9a1f7c4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 107405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201617.257846:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715502336:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788201617.257915:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201617.258137:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715502336 00000100:00100000:3.0:1788201617.258145:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715502336 00000100:00100000:3.0:1788201617.258193:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788201617.258203:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715502336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201617.258240:0:99776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444941824 avail 1298702336 00010000:00000080:3.0:1788201617.258260:0:99776:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc005abdc00 x1875060715502336/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:738/0 lens 224/368 e 0 to 0 dl 1788201628 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201617.258320:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715502336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201617.258327:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788201617.258378:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715502336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201617.743285:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715502464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201617.743354:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201617.743427:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715502464 00000100:00100000:2.0:1788201617.743434:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715502464 00000100:00100000:2.0:1788201617.743481:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788201617.743490:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715502464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201617.743524:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201617.743569:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715502464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201617.743575:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788201617.743640:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715502464:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788201617.747156:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201617.757227:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201617.757250:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715502592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201617.757328:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201617.757670:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715502592 00000100:00100000:0.0:1788201617.757679:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715502592 00000100:00100000:0.0:1788201617.757737:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788201617.759010:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715502592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201617.759119:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201617.759194:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715502592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1448us (1865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201617.759202:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788201617.759982:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715502592:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788201618.117180:0:109050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00010000:00010000:2.0:1788201618.767289:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201619.797328:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201620.816299:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788201620.921188:0:109148:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788201620.921255:0:109148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3800/0x96d0c9b8c9a1ef51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ef58 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.921270:0:109148:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3800/0x96d0c9b8c9a1ef51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ef58 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.921277:0:109148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3800/0x96d0c9b8c9a1ef51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ef58 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.921283:0:109148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3800/0x96d0c9b8c9a1ef51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ef58 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.921309:0:109148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788201620.921315:0:109148:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788201620.921342:0:109148:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201620.921348:0:109148:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788201620.921354:0:109148:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788201620.921379:0:109148:0:(import.c:65:import_set_state_nolock()) ffff8dc11cdd9800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788201620.921417:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715502720:0@lo:39:umount.0 00000100:00100000:2.0:1788201620.921497:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201620.921569:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715502720 00000100:00100000:2.0:1788201620.921576:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715502720 00000100:00100000:2.0:1788201620.921623:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788201620.921633:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875060715502720:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788201620.921658:0:107403:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1f04d 00000100:00080000:2.0:1788201620.921673:0:107403:0:(import.c:65:import_set_state_nolock()) ffff8dc11d638800 : changing import state from FULL to CLOSED 00010000:00000080:2.0:1788201620.921698:0:107403:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8dc005256d80 x1875060715502720/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:741/0 lens 224/224 e 0 to 0 dl 1788201631 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201620.921739:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3654:x1875060715502720:12345-0@lo:39:umount.0 Request processed in 107us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201620.921747:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000020:00000080:2.0:1788201620.921756:0:107403:0:(genops.c:885:class_export_put()) final put ffff8dc11d63b800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1788201620.921804:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201620.921810:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3800/0x96d0c9b8c9a1ef51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1ef58 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.921818:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3800 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788201620.921822:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3800/0x96d0c9b8c9a1ef51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1ef58 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.921831:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3800/0x96d0c9b8c9a1ef51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1ef58 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201620.921840:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3800/0x96d0c9b8c9a1ef51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1ef58 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201620.921846:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788201620.921849:0:24979:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788201620.921852:0:24979:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788201620.921882:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3800/0x96d0c9b8c9a1ef51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ef58 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.921889:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201620.921906:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3800/0x96d0c9b8c9a1ef51 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ef58 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.921914:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3800/0x96d0c9b8c9a1ef51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ef58 expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.921925:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201620.921927:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201620.921929:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788201620.921937:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d63b800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788201620.921972:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc11d638800 for lustre-MDT0000 00000100:00080000:2.0:1788201620.921999:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11cdd9800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788201620.922005:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715502720:0@lo:39:umount.0 00000100:00080000:2.0:1788201620.922045:0:109148:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788201620.922047:0:109148:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788201620.922051:0:109148:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788201620.922920:0:109148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ee8d expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.922933:0:109148:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ee8d expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.922940:0:109148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ee8d expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.922948:0:109148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ee8d expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.922986:0:109148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201620.923004:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201620.923010:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1ee8d expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923044:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2a00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788201620.923048:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1ee8d expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923056:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1ee8d expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201620.923064:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1ee8d expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201620.923069:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788201620.923072:0:6521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788201620.923093:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ee8d expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923099:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201620.923110:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee86 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ee8d expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923116:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2a00/0x96d0c9b8c9a1ee86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ee8d expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923129:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201620.923130:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201620.923138:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201620.923150:0:109148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3400/0x96d0c9b8c9a1f08c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f093 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923158:0:109148:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3400/0x96d0c9b8c9a1f08c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f093 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923164:0:109148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3400/0x96d0c9b8c9a1f08c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1f093 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923171:0:109148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3400/0x96d0c9b8c9a1f08c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1f093 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923184:0:109148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788201620.923190:0:109148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ef43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ef4a expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923196:0:109148:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ef43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ef4a expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923202:0:109148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ef43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ef4a expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923207:0:109148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ef43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ef4a expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923230:0:109148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788201620.923238:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201620.923242:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3400/0x96d0c9b8c9a1f08c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1f093 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923259:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e3400 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788201620.923262:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3400/0x96d0c9b8c9a1f08c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1f093 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923269:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3400/0x96d0c9b8c9a1f08c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1f093 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201620.923274:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3400/0x96d0c9b8c9a1f08c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1f093 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201620.923279:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788201620.923281:0:24979:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788201620.923283:0:24979:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788201620.923299:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3400/0x96d0c9b8c9a1f08c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f093 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923305:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201620.923319:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3400/0x96d0c9b8c9a1f08c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f093 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923326:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3400/0x96d0c9b8c9a1f08c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f093 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923336:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201620.923340:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ef43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1ef4a expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923345:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7a00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788201620.923348:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ef43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1ef4a expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923361:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ef43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1ef4a expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201620.923367:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ef43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1ef4a expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201620.923373:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788201620.923376:0:24979:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788201620.923378:0:24979:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788201620.923392:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ef43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ef4a expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923398:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201620.923404:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ef43 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ef4a expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923410:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7a00/0x96d0c9b8c9a1ef43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ef4a expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923419:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201620.923420:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201620.923422:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201620.923435:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715503232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201620.923487:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201620.923532:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201620.923538:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715503104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201620.923558:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201620.923586:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715503232 00000100:00100000:2.0:1788201620.923592:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715503232 00000100:00100000:2.0:1788201620.923636:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715503104 00000100:00100000:2.0:1788201620.923640:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715503104 00000100:00100000:2.0:1788201620.923661:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00100000:2.0:1788201620.923669:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+25:3658:x1875060715503232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201620.923681:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201620.923695:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0056d7c00/0x96d0c9b8c9a1ef4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ef43 expref: 25 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923706:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201620.923737:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715503232:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201620.923744:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00000100:00100000:2.0:1788201620.923760:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:2.0:1788201620.923766:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+23:3658:x1875060715503104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201620.923774:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201620.923782:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc12e6e3200/0x96d0c9b8c9a1f093 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f08c expref: 23 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923791:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201620.923810:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+22:3658:x1875060715503104:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201620.923816:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00100000:2.0:1788201620.923849:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715503104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201620.923858:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715503232:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201620.923880:0:109148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ee78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1ee7f expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923898:0:109148:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ee78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1ee7f expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923904:0:109148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ee78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ee7f expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923910:0:109148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ee78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1ee7f expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923922:0:109148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788201620.923925:0:109148:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788201620.923929:0:109148:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1788201620.923956:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201620.923960:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ee78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1ee7f expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923966:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2400 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:2.0:1788201620.923969:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ee78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1ee7f expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.923977:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ee78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1ee7f expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201620.923983:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ee78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1ee7f expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201620.923989:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788201620.923991:0:6521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788201620.923992:0:6521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788201620.924011:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ee78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ee7f expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.924041:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788201620.924047:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ee78 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ee7f expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.924054:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2400/0x96d0c9b8c9a1ee78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1ee7f expref: -99 pid: 107383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201620.924063:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201620.924064:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201620.924066:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788201620.924079:0:109148:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788201620.924083:0:109148:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1788201620.924087:0:109148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1788201620.924092:0:109148:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:3.0:1788201620.926949:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715502976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201620.927050:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201620.927101:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788201620.927107:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715502848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201620.927133:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201620.927153:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715503360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201620.927173:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201620.927235:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715502976 00000100:00100000:3.0:1788201620.927243:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715502976 00000100:00100000:3.0:1788201620.927294:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715502848 00000100:00100000:3.0:1788201620.927298:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715502848 00000100:00100000:3.0:1788201620.927318:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715503360 00000100:00100000:3.0:1788201620.927320:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715503360 00000100:00100000:3.0:1788201620.927336:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:3.0:1788201620.927344:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715502976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201620.927356:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201620.927377:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006dbce00/0x96d0c9b8c9a1ee8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ee86 expref: 24 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201620.927394:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201620.927429:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+23:3656:x1875060715502976:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201620.927436:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00000100:00100000:3.0:1788201620.927453:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 789 00000100:00100000:3.0:1788201620.927459:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1059bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+22:3656:x1875060715502848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201620.927479:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201620.927506:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006dbd800/0x96d0c9b8c9a1ef58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ef51 expref: 22 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201620.927515:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201620.927538:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1059bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+21:3656:x1875060715502848:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201620.927544:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 789 00000100:00100000:3.0:1788201620.927579:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:3.0:1788201620.927585:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+20:3656:x1875060715503360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201620.927592:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201620.927600:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006dbdc00/0x96d0c9b8c9a1ee7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ee78 expref: 20 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201620.927609:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201620.927629:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+19:3656:x1875060715503360:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201620.927635:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00100000:3.0:1788201620.927683:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715502848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201620.927692:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715503360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201620.927698:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715502976:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201620.928317:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201620.928345:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:2.0:1788201620.938668:0:109148:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:1.0:1788201620.940236:0:109148:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:1.0:1788201620.940248:0:109148:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc137d31000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201620.940255:0:109148:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc137d32800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201620.940260:0:109148:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc139bc6000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201620.940266:0:109148:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc12587a800 6e293f14-c501-4bc5-9dd4-a18ef02756b4 192.168.201.20@tcp 5 (0 0 0) 0 0 0 0: 0000000000000000 133143986195 stale:0 00000020:00080000:1.0:1788201620.940270:0:109148:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dc12587c800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 133143986193 stale:0 00000020:00080000:1.0:1788201620.940274:0:109148:0:(genops.c:1553:class_disconnect_exports()) OBD device 6 (ffff8dc1060e3370) has exports, disconnecting them 00000020:00080000:1.0:1788201620.940279:0:109148:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc137d31000), last request at 1788201616 00000020:00000080:1.0:1788201620.940287:0:109148:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1f555 00000100:00080000:1.0:1788201620.940297:0:109148:0:(import.c:65:import_set_state_nolock()) ffff8dc137d37800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201620.940325:0:109148:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc137d31000): rc 0 00000020:00000080:1.0:1788201620.940328:0:109148:0:(genops.c:885:class_export_put()) final put ffff8dc137d31000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:2.0:1788201620.940339:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788201620.940344:0:109148:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc137d32800), last request at 1788201616 00000020:00000080:1.0:1788201620.940347:0:109148:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1f54e 00000100:00080000:1.0:1788201620.940351:0:109148:0:(import.c:65:import_set_state_nolock()) ffff8dc137d30800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201620.940364:0:109148:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc137d32800): rc 0 00000020:00000080:1.0:1788201620.940366:0:109148:0:(genops.c:885:class_export_put()) final put ffff8dc137d32800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788201620.940369:0:109148:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc139bc6000), last request at 1788201576 00000020:00000080:1.0:1788201620.940372:0:109148:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1f070 00000100:00080000:1.0:1788201620.940395:0:109148:0:(import.c:65:import_set_state_nolock()) ffff8dc139bc4000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788201620.940395:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788201620.940413:0:109148:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc139bc6000): rc 0 00000020:00000080:1.0:1788201620.940415:0:109148:0:(genops.c:885:class_export_put()) final put ffff8dc139bc6000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788201620.940420:0:109148:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.201.20@tcp (ffff8dc12587a800), last request at 1788201616 00000020:00000080:1.0:1788201620.940430:0:109148:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1eecc 00000100:00080000:1.0:1788201620.940441:0:109148:0:(import.c:65:import_set_state_nolock()) ffff8dc12b6ba800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201620.940491:0:109148:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.201.20@tcp (ffff8dc12587a800): rc 0 00000020:00000080:1.0:1788201620.940494:0:109148:0:(genops.c:885:class_export_put()) final put ffff8dc12587a800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00080000:1.0:1788201620.940498:0:109148:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dc12587c800), last request at 1788201576 00000020:00000080:1.0:1788201620.940501:0:109148:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1eec5 00000100:00080000:1.0:1788201620.940507:0:109148:0:(import.c:65:import_set_state_nolock()) ffff8dc11d638000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201620.940514:0:109148:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc12587c800): rc 0 00000020:00000080:1.0:1788201620.940516:0:109148:0:(genops.c:885:class_export_put()) final put ffff8dc12587c800/lustre-MDT0001-mdtlov_UUID 00000004:00000080:1.0:1788201620.940522:0:109148:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa0dd41d43ae0 00000100:00080000:1.0:1788201620.940542:0:109148:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788201620.940545:0:109148:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1788201620.940688:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201620.940693:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201620.941345:0:109148:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788201620.941371:0:109148:0:(import.c:65:import_set_state_nolock()) ffff8dc005d73000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788201620.941416:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11fc14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715503488:0@lo:39:umount.0 00000020:00000080:3.0:1788201620.941455:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d31000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:2.0:1788201620.941488:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788201620.941515:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc137d32800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788201620.941533:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc139bc6000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788201620.941556:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12587a800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 for lustre-MDT0000 00000020:00000080:3.0:1788201620.941580:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12587c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788201620.941599:0:41592:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc137d37800 for lustre-MDT0000 00000020:00000080:3.0:1788201620.941614:0:41592:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc137d30800 for lustre-MDT0000 00000020:00000080:3.0:1788201620.941617:0:41592:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc139bc4000 for lustre-MDT0000 00000020:00000080:3.0:1788201620.941621:0:41592:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc12b6ba800 for lustre-MDT0000 00000020:00000080:3.0:1788201620.941624:0:41592:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc11d638000 for lustre-MDT0000 00000100:00100000:2.0:1788201620.941632:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715503488 00000100:00100000:2.0:1788201620.941640:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715503488 00010000:00010000:0.0:1788201620.941690:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201620.941691:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788201620.941700:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715503488:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788201620.941725:0:99776:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1efd6 00000100:00080000:2.0:1788201620.941739:0:99776:0:(import.c:65:import_set_state_nolock()) ffff8dc110732000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788201620.941757:0:99776:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 20, last_transno is 85899345930 00010000:00010000:3.0:1788201620.941758:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201620.941848:0:109148:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788201620.941851:0:109148:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901912 gen 3 00000004:00080000:1.0:1788201620.941867:0:109148:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788201620.941922:0:109148:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788201620.941933:0:109148:0:(import.c:65:import_set_state_nolock()) ffff8dc1259e7000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788201620.941933:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3654:x1875060715503488:12345-0@lo:39:umount.0 Request processed in 234us (444us total) trans 85899345931 rc 0/0 00000100:00080000:1.0:1788201620.941939:0:109148:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788201620.941940:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788201620.941941:0:109148:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934595 gen 3 00000004:00080000:1.0:1788201620.941950:0:109148:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788201620.942004:0:109148:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788201620.942012:0:109148:0:(import.c:65:import_set_state_nolock()) ffff8dc004011000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788201620.942053:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11fc16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715503616:0@lo:9:umount.0 00000100:00100000:3.0:1788201620.942082:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788201620.942125:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc005d73000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788201620.942131:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11fc14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715503488:0@lo:39:umount.0 00000100:00100000:3.0:1788201620.942262:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11fc14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715503744:0@lo:9:umount.0 00000100:00100000:3.0:1788201620.942288:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788201620.942353:0:109148:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8dc1060e3370) has no exports 00000100:00100000:2.0:1788201620.942355:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715503616 00000100:00100000:2.0:1788201620.942359:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715503616 00000100:00100000:2.0:1788201620.942392:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715503744 00000100:00100000:2.0:1788201620.942395:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715503744 00000100:00100000:2.0:1788201620.942415:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788201620.942422:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715503616:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788201620.942436:0:99764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1ef20 00000100:00080000:2.0:1788201620.942442:0:99764:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccff000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788201620.942498:0:99764:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901913 00010000:00010000:0.0:1788201620.942855:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201620.943086:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788201620.943097:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1875060715503744:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788201620.943112:0:100688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1ef2e 00000100:00080000:0.0:1788201620.943118:0:100688:0:(import.c:65:import_set_state_nolock()) ffff8dc004012800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788201620.943155:0:100688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934596 00010000:00010000:1.0:1788201620.943284:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201620.944241:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201620.944248:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201620.947082:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3654:x1875060715503616:12345-0@lo:9:umount.0 Request processed in 4651us (4989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201620.947098:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788201620.948752:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3654:x1875060715503744:12345-0@lo:9:umount.0 Request processed in 5650us (6454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201620.948764:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1788201620.952008:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc004011000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788201620.952091:0:3654:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788201620.952093:0:3654:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201620.952100:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11fc14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715503744:0@lo:9:umount.0 00000100:00080000:3.0:1788201620.952120:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1259e7000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788201620.952136:0:3654:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788201620.952137:0:3654:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201620.952140:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11fc16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715503616:0@lo:9:umount.0 00000020:00080000:1.0:1788201620.956152:0:109148:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8dc1060e3370) has no exports 00000020:00000080:1.0:1788201621.013558:0:109148:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1eee1 00000020:00000080:1.0:1788201621.013575:0:109148:0:(genops.c:885:class_export_put()) final put ffff8dc10bd90800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788201621.013598:0:109148:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788201621.013630:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc10bd90800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788201621.013658:0:109148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201621.013670:0:109148:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788201621.013675:0:109148:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8dc12f0c0000) has no exports 00000020:00000080:2.0:1788201621.014128:0:109148:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1eeda 00000020:00000080:2.0:1788201621.014134:0:109148:0:(genops.c:885:class_export_put()) final put ffff8dc1257f7000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788201621.014192:0:109148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201621.014199:0:109148:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788201621.014201:0:109148:0:(genops.c:885:class_export_put()) final put ffff8dc119917000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788201621.014204:0:109148:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc119917000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788201621.014208:0:109148:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788201621.014252:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1257f7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788201621.014362:0:109148:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc007fd0a20 - data ffff8dc133904288/ffff8dc125dc7400 00000020:01000000:2.0:1788201621.014525:0:109148:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc007fd0cc0 - data ffff8dc1339e1438/ffff8dc003929800 00000100:00080000:2.0:1788201621.064984:0:109148:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788201621.065012:0:109148:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788201621.065060:0:109148:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8dc11fc14a80 x1875060715503488/t85899345931(85899345931) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201630 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201621.065087:0:109148:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788201621.066670:0:109148:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788201621.066677:0:109148:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901912 gen 4 00000004:00080000:0.0:1788201621.066697:0:109148:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201621.066700:0:109148:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788201621.067490:0:107426:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788201621.067496:0:107426:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x7c:0x0] index 1 count 1 00000040:00080000:1.0:1788201621.067505:0:107426:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 31 count 2 00000100:00080000:0.0:1788201621.068122:0:109148:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788201621.068127:0:109148:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934595 gen 4 00000004:00080000:0.0:1788201621.068142:0:109148:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201621.068144:0:109148:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788201621.068287:0:107428:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788201621.068290:0:107428:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x7e:0x0] index 1 count 1 00000040:00080000:0.0:1788201621.068300:0:107428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 31 count 2 00000020:00000080:0.0:1788201621.069865:0:109148:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1ee9b 00000020:00000080:0.0:1788201621.069875:0:109148:0:(genops.c:885:class_export_put()) final put ffff8dc006e31800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788201621.070124:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc006e31800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788201621.071726:0:109148:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1eeb0 00000020:00000080:0.0:1788201621.071738:0:109148:0:(genops.c:885:class_export_put()) final put ffff8dc006e35800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788201621.071914:0:109148:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788201621.071922:0:109148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201621.071931:0:109148:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788201621.071935:0:109148:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8dc1060e19b8) has no exports 00000004:01000000:0.0:1788201621.072138:0:109148:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788201621.072148:0:109148:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1ef27 00000020:00000080:0.0:1788201621.072153:0:109148:0:(genops.c:885:class_export_put()) final put ffff8dc119913800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788201621.072972:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc006e35800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788201621.073175:0:109148:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788201621.073193:0:109148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201621.073200:0:109148:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788201621.073204:0:109148:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8dc12f30cd28) has no exports 00000020:00000080:0.0:1788201621.073212:0:109148:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1ef19 00000020:00000080:0.0:1788201621.073226:0:109148:0:(genops.c:885:class_export_put()) final put ffff8dc004015800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788201621.073609:0:109148:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788201621.073614:0:109148:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788201621.073617:0:109148:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934595 gen 5 00000004:00080000:0.0:1788201621.073623:0:109148:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201621.073625:0:109148:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788201621.073658:0:109148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201621.073664:0:109148:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201621.073671:0:109148:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1ef0b 00000020:00000080:0.0:1788201621.073677:0:109148:0:(genops.c:885:class_export_put()) final put ffff8dc004013800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788201621.073680:0:109148:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788201621.073684:0:109148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201621.073687:0:109148:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788201621.073689:0:109148:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8dc139bbcd28) has no exports 00000020:00000080:0.0:1788201621.073693:0:109148:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1ef04 00000020:00000080:0.0:1788201621.073696:0:109148:0:(genops.c:885:class_export_put()) final put ffff8dc006e30800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788201621.074191:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc119913800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788201621.074203:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc004015800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788201621.074208:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc004011000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788201621.074223:0:76267:0:(genops.c:885:class_export_put()) final put ffff8dc004016000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788201621.074225:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc004016000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788201621.074229:0:76267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201621.074307:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc004013800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788201621.074312:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc006e30800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788201621.074345:0:109148:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788201621.074348:0:109148:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788201621.074350:0:109148:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901912 gen 5 00000004:00080000:0.0:1788201621.074354:0:109148:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788201621.074355:0:109148:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788201621.074393:0:109148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201621.074398:0:109148:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1788201621.074408:0:109148:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788201621.074413:0:109148:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1eef6 00000020:00000080:0.0:1788201621.074418:0:109148:0:(genops.c:885:class_export_put()) final put ffff8dc005d70800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788201621.074422:0:109148:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1788201621.074425:0:109148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788201621.074437:0:109148:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788201621.074440:0:109148:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8dc12f3099b8) has no exports 00000020:00000080:0.0:1788201621.074444:0:109148:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1eeef 00000020:00000080:0.0:1788201621.074447:0:109148:0:(genops.c:885:class_export_put()) final put ffff8dc005d75000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788201621.075140:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1259e7000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788201621.075148:0:76267:0:(genops.c:885:class_export_put()) final put ffff8dc005d74800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788201621.075151:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005d74800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788201621.075155:0:76267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201621.075196:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005d70800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788201621.075201:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005d75000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788201621.076151:0:109148:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788201621.076165:0:109148:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788201621.076168:0:109148:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788201621.076175:0:109148:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201621.076230:0:109148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201621.076239:0:109148:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201621.076264:0:109148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201621.076267:0:109148:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201621.076272:0:109148:0:(genops.c:885:class_export_put()) final put ffff8dc006e30000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788201621.076275:0:109148:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc006e30000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788201621.076281:0:109148:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788201621.076352:0:109148:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1eeb7 00000020:00000080:1.0:1788201621.076359:0:109148:0:(genops.c:885:class_export_put()) final put ffff8dc006e37000/lustre-MDD0000_UUID 00000020:01000000:1.0:1788201621.076363:0:109148:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788201621.076367:0:109148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201621.076371:0:109148:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788201621.076375:0:109148:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8dc1060e0000) has no exports 00000020:00000080:1.0:1788201621.076394:0:109148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201621.076397:0:109148:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788201621.076400:0:109148:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1eebe 00000020:00000080:1.0:1788201621.076404:0:109148:0:(genops.c:885:class_export_put()) final put ffff8dc006e32800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788201621.076411:0:109148:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc0053a5000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788201621.076414:0:109148:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc0053a5000 3 00000020:01000004:1.0:1788201621.076418:0:109148:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dc0053a5000 from lustre-MDT0000 00000020:00000080:1.0:1788201621.076434:0:109148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201621.076437:0:109148:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788201621.076440:0:109148:0:(genops.c:885:class_export_put()) final put ffff8dc006e36800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788201621.076442:0:109148:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc006e36800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788201621.076449:0:109148:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788201621.076478:0:109148:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788201621.076482:0:109148:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788201621.076485:0:109148:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788201621.076487:0:109148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201621.076496:0:109148:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788201621.076508:0:109148:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8dc11d43f000 93ba7067-43b5-4e46-8db7-27c040fa03d9 192.168.201.20@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201621.076515:0:109148:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8dc005a4a000 c9b18af6-fecc-4172-82c2-66531890fe11 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788201621.076519:0:109148:0:(genops.c:1553:class_disconnect_exports()) OBD device 3 (ffff8dc0027d19b8) has exports, disconnecting them 00000020:00080000:1.0:1788201621.076524:0:109148:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.201.20@tcp (ffff8dc11d43f000), last request at 1788201576 00000020:00000080:1.0:1788201621.076547:0:109148:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1efcf 00000020:00010000:1.0:1788201621.076553:0:109148:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc11d43f000: total 2 00000100:00080000:1.0:1788201621.076556:0:109148:0:(import.c:65:import_set_state_nolock()) ffff8dc11d438800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201621.076569:0:109148:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.201.20@tcp (ffff8dc11d43f000): rc 0 00000020:00080000:1.0:1788201621.076572:0:109148:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8dc005a4a000), last request at 1788201575 00000020:00000080:1.0:1788201621.076616:0:109148:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1ee5c 00000020:00010000:1.0:1788201621.076619:0:109148:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dc005a4a000: total 2 00000100:00080000:1.0:1788201621.076622:0:109148:0:(import.c:65:import_set_state_nolock()) ffff8dc005a48800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788201621.076632:0:109148:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc005a4a000): rc 0 00000020:00080000:1.0:1788201621.076636:0:109148:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8dc0027d19b8) has no exports 00000100:00100000:1.0:1788201621.076688:0:107397:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8dc10729ee00:107397] 1 exiting: rc = 0 00000100:00100000:1.0:1788201621.076800:0:107398:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8dc125a2b000:107398] 2 exiting: rc = 0 00000020:00000080:2.0:1788201621.076879:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc005d73000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788201621.076886:0:76267:0:(genops.c:885:class_export_put()) final put ffff8dc005d72000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788201621.076889:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005d72000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1788201621.076893:0:76267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201621.076945:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc006e37000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788201621.076949:0:76267:0:(genops.c:885:class_export_put()) final put ffff8dc006e34800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788201621.076951:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc006e34800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788201621.076955:0:76267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788201621.076982:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc006e32800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1788201621.077392:0:13349:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc11d43f000: total 0 00010000:00010000:1.0:1788201621.077419:0:13349:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc11d43f000, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1788201621.077449:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ec600/0x96d0c9b8c9a1f111 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ff7 expref: 5 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.077466:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae2400/0x96d0c9b8c9a1f11f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f787005 expref: 4 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.077478:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0056d6e00/0x96d0c9b8c9a1f118 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ffe expref: 3 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.077489:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ede00/0x96d0c9b8c9a1f10a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f786ff0 expref: 2 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.077508:0:13349:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc11d43f000, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1788201621.077527:0:13349:0:(genops.c:885:class_export_put()) final put ffff8dc11d43f000/93ba7067-43b5-4e46-8db7-27c040fa03d9 00000020:00010000:1.0:1788201621.077542:0:13349:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dc005a4a000: total 1 00010000:00010000:1.0:1788201621.077559:0:13349:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dc005a4a000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788201621.077576:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0056d6600/0x96d0c9b8c9a1f0cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f0c4 expref: 14 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.077587:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006dbc000/0x96d0c9b8c9a1f05b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f054 expref: 13 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.077597:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae2a00/0x96d0c9b8c9a1f0d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f0d2 expref: 12 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.077608:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc125ae2000/0x96d0c9b8c9a1f0e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f0e0 expref: 11 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.077618:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc12e6e3000/0x96d0c9b8c9a1ef89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ef82 expref: 10 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.077631:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ed400/0x96d0c9b8c9a1f0f5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f0ee expref: 9 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.077643:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc006dbc400/0x96d0c9b8c9a1f046 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f03f expref: 8 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.077653:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc12e6e3600/0x96d0c9b8c9a1f085 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f07e expref: 7 pid: 107397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.077665:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc12e6e3a00/0x96d0c9b8c9a1ef97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1ef90 expref: 6 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.077686:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc12e6e2000/0x96d0c9b8c9a1f0a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f09a expref: 5 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.077697:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064eda00/0x96d0c9b8c9a1f103 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f0fc expref: 4 pid: 107398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.077709:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0056d7000/0x96d0c9b8c9a1f0bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f0b6 expref: 3 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.077720:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0056d7600/0x96d0c9b8c9a1f0af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f0a8 expref: 2 pid: 107396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201621.077729:0:13349:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dc005a4a000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1788201621.077742:0:13349:0:(genops.c:885:class_export_put()) final put ffff8dc005a4a000/c9b18af6-fecc-4172-82c2-66531890fe11 00010000:00010000:1.0:1788201621.077748:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201621.077750:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201621.077752:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788201621.077793:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d43f000/93ba7067-43b5-4e46-8db7-27c040fa03d9 for MGS 00000020:00000080:2.0:1788201621.077827:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005a4a000/c9b18af6-fecc-4172-82c2-66531890fe11 for MGS 00000020:00000080:2.0:1788201621.077847:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc11d438800 for MGS 00000020:00000080:2.0:1788201621.077852:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc005a48800 for MGS 00000100:00100000:1.0:1788201621.080239:0:107396:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8dc005de0400:107396] 0 exiting: rc = 1 00000100:00100000:2.0:1788201621.080432:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080440:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080446:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080453:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080473:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080482:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080489:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080494:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080501:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080506:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080511:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080516:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080522:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080542:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080548:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080554:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080560:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080565:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080573:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080579:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080584:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080589:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080594:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080602:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080606:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080611:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080615:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080620:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080625:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080633:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080639:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080644:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080651:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080657:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080662:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080667:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080672:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080677:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080682:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080687:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080692:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080698:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080704:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080709:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080714:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080720:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080726:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080731:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080744:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080749:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080755:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080760:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080765:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080770:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080775:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080780:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080786:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080792:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080799:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080805:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080811:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080816:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080821:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788201621.080826:0:109148:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1788201621.082005:0:109148:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc12f2f3480 - data ffff8dc1338fd0d8/ffff8dc0037a9000 00000020:01000000:2.0:1788201621.082170:0:109148:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc003bd7ae0 - data ffff8dc11da730d8/ffff8dc1060e9400 00000020:00000080:2.0:1788201621.082601:0:109148:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1ee4e 00000020:00000080:2.0:1788201621.082609:0:109148:0:(genops.c:885:class_export_put()) final put ffff8dc0053a7000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788201621.082624:0:109148:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc0053a5000 from MGS, refs=2 00000020:01000004:2.0:1788201621.082627:0:109148:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc0053a5000 2 00000020:01000004:2.0:1788201621.082630:0:109148:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dc0053a5000 from MGS 00000020:00000080:2.0:1788201621.082654:0:109148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788201621.082660:0:109148:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788201621.082663:0:109148:0:(genops.c:885:class_export_put()) final put ffff8dc10603c000/MGS 00000020:00000080:2.0:1788201621.082666:0:109148:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc10603c000/MGS for MGS 00000020:01000000:2.0:1788201621.082671:0:109148:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788201621.082733:0:109148:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788201621.082737:0:109148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788201621.082742:0:109148:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788201621.082750:0:109148:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8dc11cdde800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788201621.082755:0:109148:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8dc139bb8000) has exports, disconnecting them 00000020:00080000:2.0:1788201621.082770:0:109148:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8dc11cdde800), last request at 1788201576 00000020:00000080:2.0:1788201621.082774:0:109148:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1ef66 00000020:00080000:2.0:1788201621.082783:0:109148:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc11cdde800): rc 0 00000020:00000080:2.0:1788201621.082787:0:109148:0:(genops.c:885:class_export_put()) final put ffff8dc11cdde800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788201621.083448:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0053a7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788201621.083458:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11cdde800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788201621.095127:0:109148:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788201621.095136:0:109148:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788201621.095141:0:109148:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788201621.095150:0:109148:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201621.095202:0:41592:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc11cdd9800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788201621.095420:0:109148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201621.095430:0:109148:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788201621.095436:0:109148:0:(genops.c:885:class_export_put()) final put ffff8dc12e646000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788201621.095451:0:109148:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12e646000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788201621.095461:0:109148:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788201621.095537:0:109148:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc0053a5000 1 00000020:00000080:1.0:1788201621.095544:0:109148:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1ee40 00000020:00000080:1.0:1788201621.095552:0:109148:0:(genops.c:885:class_export_put()) final put ffff8dc106039000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788201621.095561:0:109148:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788201621.095569:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc106039000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788201621.095578:0:109148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201621.095582:0:109148:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788201621.095585:0:109148:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8dc1060e4d28) has no exports 00010000:00010000:3.0:1788201621.118133:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788201621.139238:0:109148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201621.139253:0:109148:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788201621.139259:0:109148:0:(genops.c:885:class_export_put()) final put ffff8dc0053a4800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788201621.139264:0:109148:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0053a4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788201621.139274:0:109148:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788201621.139398:0:109148:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dc0053a2000 00000020:02000400:1.0:1788201621.139458:0:109148:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1788201621.470851:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201621.471126:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000400:00000100:0.0:1788201621.471153:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695595264 offset 0 length 224: 4 00000100:00100000:0.0:1788201621.471171:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201621.471228:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695595648 00000100:00100000:1.0:1788201621.471239:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695595648 00000100:00100000:1.0:1788201621.471305:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 201 00000100:00100000:1.0:1788201621.471316:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695595648:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201621.471399:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695595648:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 86us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201621.471407:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 201 00000100:00080000:1.0:1788201621.471431:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201621.485676:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201621.485710:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695595776 00000100:00100000:0.0:1788201621.485719:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695595776 00000100:00100000:0.0:1788201621.485780:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 202 00000100:00100000:0.0:1788201621.485791:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695595776:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201621.485869:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695595776:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 80us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201621.485877:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 202 00000100:00080000:0.0:1788201621.485903:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201621.489313:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695595392 00000100:00100000:2.0:1788201621.489329:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695595392 00000100:00100000:2.0:1788201621.489383:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695595520 00000100:00100000:2.0:1788201621.489386:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695595520 00000100:00100000:2.0:1788201621.489427:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 59 00000100:00100000:2.0:1788201621.489439:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695595520:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201621.489531:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695595520:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 96us (18358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201621.489539:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 59 00000100:00100000:2.0:1788201621.489558:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 53 00000100:00100000:2.0:1788201621.489562:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1875060695595392:12345-192.168.201.20@tcp:400:kworker.0 00000020:00080000:2.0:1788201621.489568:0:107404:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.20@tcp 00000100:00100000:2.0:1788201621.489592:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1875060695595392:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 29us (18754us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788201621.489598:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 53 00000100:00080000:2.0:1788201621.489626:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201621.503799:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201621.503897:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695595904 00000100:00100000:2.0:1788201621.503907:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695595904 00000100:00100000:2.0:1788201621.503962:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 54 00000100:00100000:2.0:1788201621.503980:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695595904:12345-192.168.201.20@tcp:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1788201621.504004:0:107404:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788201621.504086:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695595904:12345-192.168.201.20@tcp:38:ptlrpcd_00_01.0 Request processed in 115us (298us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201621.504103:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 54 00010000:00010000:0.0:1788201621.839366:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201621.839615:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201621.839634:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715503872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201621.839696:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201621.839800:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715504000:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201621.839822:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201621.839858:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715503872 00000100:00100000:2.0:1788201621.839865:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715503872 00000100:00100000:2.0:1788201621.839916:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715504000 00000100:00100000:2.0:1788201621.839918:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715504000 00000100:00100000:2.0:1788201621.839929:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788201621.839934:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715503872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201621.839959:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201621.839991:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715503872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201621.839998:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788201621.840013:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788201621.840043:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715504000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201621.840058:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201621.840088:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715504000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201621.840093:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788201621.840133:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715504000:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201621.840163:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715503872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201621.840491:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11fc16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715504512:0@lo:400:kworker.0 00000100:00100000:1.0:1788201621.840523:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201621.840545:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788201621.840550:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11fc17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715504128:0@lo:400:kworker.0 00000400:00000100:1.0:1788201621.840586:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715504128 offset 0 length 224: 4 00000100:00100000:1.0:1788201621.840608:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11fc14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715504640:0@lo:400:kworker.0 00000100:00100000:1.0:1788201621.840628:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201621.840652:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715504512 00000100:00100000:1.0:1788201621.840656:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715504512 00000100:00100000:1.0:1788201621.840681:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715504640 00000100:00100000:1.0:1788201621.840683:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715504640 00000100:00100000:1.0:1788201621.840701:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788201621.840707:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715504640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201621.840743:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715504640:12345-0@lo:400:kworker.0 Request processed in 36us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201621.840748:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788201621.840759:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788201621.840761:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11fc15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1875060715504512:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788201621.840765:0:107403:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788201621.840783:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11fc15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1875060715504512:12345-0@lo:400:kworker.0 Request processed in 20us (260us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788201621.840786:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788201621.840798:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11fc14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715504256:0@lo:400:kworker.0 00000100:00100000:1.0:1788201621.840811:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201621.840820:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11fc16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715504768:0@lo:400:kworker.0 00000100:00100000:1.0:1788201621.840833:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201621.840843:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201621.840846:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11fc14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715504384:0@lo:400:kworker.0 00000100:00100000:1.0:1788201621.840857:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201621.840864:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11fc14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715504896:0@lo:400:kworker.0 00000100:00100000:1.0:1788201621.840883:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201621.840897:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715504768 00000100:00100000:1.0:1788201621.840899:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715504768 00000100:00100000:1.0:1788201621.840916:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788201621.840919:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3655:x1875060715504768:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788201621.840922:0:99775:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788201621.840937:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3655:x1875060715504768:12345-0@lo:400:kworker.0 Request processed in 18us (104us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788201621.840941:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788201621.840952:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715504256 00000100:00100000:1.0:1788201621.840954:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715504256 00000100:00100000:1.0:1788201621.840961:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715504384 00000100:00100000:1.0:1788201621.840962:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715504384 00000100:00100000:1.0:1788201621.840970:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715504896 00000100:00100000:1.0:1788201621.840971:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715504896 00000100:00100000:1.0:1788201621.840977:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788201621.840980:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715504384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201621.841006:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715504384:12345-0@lo:400:kworker.0 Request processed in 25us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201621.841012:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788201621.841047:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201621.841050:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3655:x1875060715504256:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788201621.841053:0:107405:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788201621.841068:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3655:x1875060715504256:12345-0@lo:400:kworker.0 Request processed in 18us (257us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788201621.841072:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788201621.841078:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788201621.841080:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3655:x1875060715504896:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788201621.841088:0:107405:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788201621.841101:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3655:x1875060715504896:12345-0@lo:400:kworker.0 Request processed in 20us (217us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788201621.841104:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788201621.841136:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11fc14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715504384:0@lo:400:kworker.0 00000100:00080000:1.0:1788201621.841146:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788201621.841150:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788201621.841154:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788201621.841159:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201621.841163:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4428 00000100:00080000:1.0:1788201621.841168:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc1401c2000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201621.841189:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc106048a80 x1875060715505024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201621.841221:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11fc14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715504896:0@lo:400:kworker.0 00000100:00080000:1.0:1788201621.841233:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788201621.841237:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788201621.841240:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788201621.841242:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201621.841245:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4442 00000100:00080000:1.0:1788201621.841249:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc11ccfb000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201621.841261:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc10604b100 x1875060715505152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201621.841271:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11fc14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715504256:0@lo:400:kworker.0 00000100:00080000:1.0:1788201621.841288:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788201621.841291:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788201621.841294:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788201621.841298:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201621.841301:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4428 00000100:00080000:1.0:1788201621.841305:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc11d439000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201621.841317:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc106048380 x1875060715505280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201621.841326:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11fc16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715504768:0@lo:400:kworker.0 00000100:00100000:1.0:1788201621.841348:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715505024:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788201621.841372:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201621.841388:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10604b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715505152:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788201621.841406:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201621.841420:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715505280:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788201621.841437:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201621.841460:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715505280 00000100:00100000:1.0:1788201621.841464:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715505280 00000100:00100000:1.0:1788201621.841480:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788201621.841485:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11fc16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715505280:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1788201621.841502:0:99775:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201621.841530:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11fc16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715505280:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 44us (91us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201621.841536:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1788201621.841569:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201621.841573:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201621.841574:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715505280:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788201621.841586:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715505024 00000100:00100000:1.0:1788201621.841588:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715505024 00000100:00100000:1.0:1788201621.841595:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715505152 00000100:00100000:1.0:1788201621.841596:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715505152 00000100:00100000:1.0:1788201621.841601:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788201621.841603:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715505024:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1788201621.841610:0:107405:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201621.841629:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715505024:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 25us (258us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201621.841632:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788201621.841639:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788201621.841641:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715505152:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1788201621.841646:0:107405:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201621.841657:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715505152:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 15us (251us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201621.841660:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1788201621.841672:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201621.841674:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201621.841675:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715505024:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1788201621.841680:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201621.841682:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201621.841684:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10604b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715505152:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788201621.841711:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11fc14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715504640:0@lo:400:kworker.0 00000100:00080000:1.0:1788201621.841717:0:3657:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788201621.841719:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788201621.841721:0:3657:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788201621.841723:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201621.841725:0:3657:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4442 00000100:00080000:1.0:1788201621.841728:0:3657:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc1401c3800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201621.841736:0:3657:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11fc14000 x1875060715505408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201621.841745:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11fc16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715504512:0@lo:400:kworker.0 00000100:00100000:1.0:1788201621.841757:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11fc14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715505408:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788201621.841771:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201621.841784:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715505408 00000100:00100000:1.0:1788201621.841786:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715505408 00000100:00100000:1.0:1788201621.841795:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788201621.841798:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715505408:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1788201621.841804:0:107405:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201621.841819:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11fc16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715505408:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 20us (48us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201621.841822:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1788201621.841835:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201621.841837:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201621.841838:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11fc14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715505408:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1788201621.841956:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201621.841959:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201621.841961:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788201622.863121:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201623.889038:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201624.912353:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201625.935266:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788201626.449399:0:107392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788201626.449413:0:107392:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 85899345931 is committed 00000020:00000080:3.0:1788201626.449418:0:107392:0:(genops.c:885:class_export_put()) final put ffff8dc0059d7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788201626.449589:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0059d7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788201626.449659:0:41592:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc110732000 for lustre-MDT0001 00000001:00100000:1.0:1788201626.450055:0:100576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788201626.450059:0:100576:0:(genops.c:885:class_export_put()) final put ffff8dc004017800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201626.450175:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc004017800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788201626.450217:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc004012800 for lustre-OST0001 00000001:00100000:3.0:1788201626.457230:0:99761:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788201626.457241:0:99761:0:(genops.c:885:class_export_put()) final put ffff8dc11ccfb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788201626.457352:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11ccfb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788201626.457420:0:41592:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc11ccff000 for lustre-OST0000 00000100:00100000:1.0:1788201626.580989:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000400:00000100:1.0:1788201626.581066:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695596032 offset 0 length 224: 4 00000100:00100000:1.0:1788201626.581088:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201626.581139:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201626.581198:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201626.581234:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695596416 00000100:00100000:1.0:1788201626.581244:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695596416 00000100:00100000:1.0:1788201626.581310:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695596544 00000100:00100000:1.0:1788201626.581314:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695596544 00000100:00100000:1.0:1788201626.581335:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 203 00000100:00100000:1.0:1788201626.581344:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695596416:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201626.581412:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11fc14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695596416:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 69us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201626.581420:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 203 00000100:00100000:1.0:1788201626.581437:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 204 00000100:00100000:1.0:1788201626.581442:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11fc14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695596544:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201626.581465:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11fc14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695596544:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201626.581486:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 204 00000100:00100000:3.0:1788201626.581718:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695596160 00000100:00100000:3.0:1788201626.581723:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695596160 00000100:00100000:3.0:1788201626.581752:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695596288 00000100:00100000:3.0:1788201626.581755:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695596288 00000100:00100000:3.0:1788201626.581774:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 62 00000100:00100000:3.0:1788201626.581782:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11fc14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2403:x1875060695596288:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201626.581817:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11fc14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2403:x1875060695596288:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 36us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201626.581824:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 62 00000100:00100000:3.0:1788201626.581836:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 61 00000100:00100000:3.0:1788201626.581840:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11fc14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695596160:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:3.0:1788201626.581860:0:107403:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201626.581883:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11fc14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695596160:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 41us (917us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201626.581888:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 61 00000100:00080000:0.0:1788201626.582568:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201626.582574:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201626.582577:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201626.959351:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201626.959360:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201626.959363:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201626.959372:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4473 00000100:00080000:3.0:1788201626.959377:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201626.959384:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc11ccfb000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201626.959409:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11cd18e00 x1875060715505664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201626.959440:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201626.959443:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201626.959460:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201626.959464:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4473 00000100:00080000:3.0:1788201626.959467:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201626.959471:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc1401c3800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201626.959482:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11cd19c00 x1875060715505920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201626.959643:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715505536:0@lo:400:kworker.0 00000400:00000100:1.0:1788201626.959702:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715505536 offset 0 length 224: 4 00000100:00100000:1.0:1788201626.959747:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201626.959753:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715505792:0@lo:400:kworker.0 00000100:00100000:1.0:1788201626.959782:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201626.959833:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715505792 00000100:00100000:1.0:1788201626.959840:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715505792 00000100:00100000:1.0:1788201626.959903:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788201626.959912:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715505792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201626.959962:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715505792:12345-0@lo:400:kworker.0 Request processed in 51us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201626.959969:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1788201626.959989:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201626.960038:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715505792:0@lo:400:kworker.0 00000100:00080000:3.0:1788201626.960145:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201626.960155:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201626.960157:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201626.960161:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4473 00000100:00080000:3.0:1788201626.960163:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201626.960168:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc11d439000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201626.960181:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11cd18380 x1875060715506176/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201626.960204:0:76267:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201626.960207:0:76267:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201626.960208:0:76267:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201626.960212:0:76267:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4473 00000100:00080000:3.0:1788201626.960214:0:76267:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201626.960217:0:76267:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc1401c2000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201626.960227:0:76267:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11cd19f80 x1875060715506560/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201626.960248:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715506304:0@lo:400:kworker.0 00000100:00100000:3.0:1788201626.960280:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201626.960310:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201626.960316:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715506048:0@lo:400:kworker.0 00000100:00100000:3.0:1788201626.960338:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201626.960635:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201626.960645:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715506432:0@lo:400:kworker.0 00000100:00100000:2.0:1788201626.960673:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201626.960697:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715506048 00000100:00100000:2.0:1788201626.960706:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715506048 00000100:00100000:2.0:1788201626.960734:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788201626.960739:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715506048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201626.960773:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715506048:12345-0@lo:400:kworker.0 Request processed in 34us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201626.960779:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788201626.960830:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715506048:0@lo:400:kworker.0 00000100:00100000:2.0:1788201626.960845:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715506688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201626.960866:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201626.960887:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715506688 00000100:00100000:2.0:1788201626.960890:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715506688 00000100:00100000:2.0:1788201626.960912:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788201626.960918:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715506688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201626.960937:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636352 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201626.960965:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715506688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201626.960971:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788201626.961001:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12efcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715506688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201626.961267:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715506304 00000100:00100000:1.0:1788201626.961271:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715506304 00000100:00100000:1.0:1788201626.961302:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715506432 00000100:00100000:1.0:1788201626.961305:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715506432 00000100:00100000:1.0:1788201626.961326:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788201626.961332:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715506304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201626.961375:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715506304:12345-0@lo:400:kworker.0 Request processed in 43us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201626.961381:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788201626.961393:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788201626.961405:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715506432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201626.961430:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715506432:12345-0@lo:400:kworker.0 Request processed in 26us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201626.961435:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:1.0:1788201626.961450:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201626.961453:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201626.961455:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201626.961898:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715506304:0@lo:400:kworker.0 00000100:00100000:2.0:1788201626.961911:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201626.961916:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715506816:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201626.961954:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201626.961995:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715506432:0@lo:400:kworker.0 00000100:00100000:3.0:1788201626.962239:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715506816 00000100:00100000:3.0:1788201626.962244:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715506816 00000100:00100000:3.0:1788201626.962277:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788201626.962286:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715506816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201626.962305:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8665024 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788201626.962356:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715506816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201626.962362:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788201626.962529:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715505664:0@lo:38:kworker.0 00000100:00100000:0.0:1788201626.962563:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201626.962582:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715505920:0@lo:38:kworker.0 00000100:00100000:0.0:1788201626.962602:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201626.962619:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715506176:0@lo:38:kworker.0 00000100:00100000:0.0:1788201626.962644:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201626.962662:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715506560:0@lo:38:kworker.0 00000100:00100000:0.0:1788201626.962697:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201626.962751:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715506176 00000100:00100000:0.0:1788201626.962756:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715506176 00000100:00100000:0.0:1788201626.962777:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788201626.962783:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715506176:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201626.962800:0:99775:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201626.962833:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715506176:12345-0@lo:38:kworker.0 Request processed in 49us (188us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201626.962839:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788201626.962857:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715505664 00000100:00100000:0.0:1788201626.962860:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715505664 00000100:00100000:0.0:1788201626.962871:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715505920 00000100:00100000:0.0:1788201626.962885:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715505920 00000100:00100000:0.0:1788201626.962893:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715506560 00000100:00100000:0.0:1788201626.962895:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715506560 00000100:00100000:0.0:1788201626.962904:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788201626.962908:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715505664:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201626.962917:0:107405:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201626.962952:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715505664:12345-0@lo:38:kworker.0 Request processed in 43us (389us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201626.962969:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788201626.962981:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788201626.962985:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715505920:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201626.962994:0:107405:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201626.963041:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715505920:12345-0@lo:38:kworker.0 Request processed in 54us (438us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201626.963047:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788201626.963058:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788201626.963063:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715506560:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788201626.963072:0:107405:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201626.963095:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715506560:12345-0@lo:38:kworker.0 Request processed in 31us (398us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201626.963101:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1788201626.963140:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201626.963145:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201626.963157:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715505664:0@lo:38:kworker.0 00000100:00080000:0.0:1788201626.963166:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201626.963170:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201626.963172:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715505920:0@lo:38:kworker.0 00000100:00080000:0.0:1788201626.963179:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201626.963182:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201626.963184:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715506176:0@lo:38:kworker.0 00000100:00080000:0.0:1788201626.963190:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201626.963199:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201626.963201:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715506560:0@lo:38:kworker.0 00010000:00010000:1.0:1788201626.963988:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201626.964070:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715506816:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788201627.983361:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201629.007317:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201630.031243:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201631.059411:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201631.700130:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000400:00000100:1.0:1788201631.700170:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695596672 offset 0 length 224: 4 00000100:00100000:0.0:1788201631.700361:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695596928 00000100:00100000:0.0:1788201631.700371:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695596928 00000100:00100000:0.0:1788201631.700460:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 65 00000100:00100000:0.0:1788201631.700471:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695596928:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201631.700563:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695596928:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 94us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201631.700570:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 65 00000100:00080000:1.0:1788201631.700813:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201631.702428:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201631.702465:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201631.702604:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695597056 00000100:00100000:1.0:1788201631.702612:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695597056 00000100:00100000:1.0:1788201631.702675:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 84 00000100:00100000:1.0:1788201631.702685:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2399:x1875060695597056:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:1.0:1788201631.702712:0:101192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1f540 00000100:00080000:1.0:1788201631.702721:0:101192:0:(import.c:65:import_set_state_nolock()) ffff8dc006d86000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788201631.702766:0:101192:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901913 00000100:00100000:1.0:1788201631.702914:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+2:2399:x1875060695597056:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 230us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201631.702922:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 84 00010000:00010000:1.0:1788201631.702961:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201631.703187:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201631.703400:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201631.703471:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695596800 00000100:00100000:3.0:1788201631.703476:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695596800 00000100:00100000:3.0:1788201631.703517:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 65 00000100:00100000:3.0:1788201631.703523:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695596800:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:3.0:1788201631.703543:0:107404:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201631.703571:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695596800:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 48us (1149us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201631.703578:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 65 00000100:00100000:2.0:1788201631.708333:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695597184 00000100:00100000:2.0:1788201631.708372:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695597184 00000100:00100000:2.0:1788201631.708460:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00100000:2.0:1788201631.708473:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2399:x1875060695597184:12345-192.168.201.20@tcp:9:kworker.0 00000020:00000080:2.0:1788201631.708515:0:99764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1f547 00000100:00080000:2.0:1788201631.708525:0:99764:0:(import.c:65:import_set_state_nolock()) ffff8dc13f83f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788201631.708574:0:99764:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934596 00000100:00100000:2.0:1788201631.708746:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+2:2399:x1875060695597184:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 275us (5408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201631.708754:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 85 00010000:00010000:3.0:1788201631.709650:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201631.711460:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201632.079293:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201632.079300:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201632.079304:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201632.079311:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4478 00000100:00080000:1.0:1788201632.079317:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201632.079323:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc11ccfb000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201632.079367:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc1259b3b80 x1875060715507200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201632.079393:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201632.079396:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201632.079398:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201632.079402:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4478 00000100:00080000:1.0:1788201632.079404:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201632.079407:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc1401c3800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201632.079416:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc1259b0380 x1875060715507456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201632.079428:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201632.079432:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201632.079433:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201632.079436:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4478 00000100:00080000:1.0:1788201632.079439:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201632.079441:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc11d439000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201632.079449:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc1259b2680 x1875060715507712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201632.079463:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201632.079472:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788201632.079474:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201632.079477:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4478 00000100:00080000:1.0:1788201632.079480:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201632.079483:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc1401c2000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201632.079493:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc1259b3480 x1875060715508096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201632.079522:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1259b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715507200:0@lo:38:kworker.0 00000100:00100000:1.0:1788201632.079583:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201632.079610:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1259b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715507456:0@lo:38:kworker.0 00000100:00100000:1.0:1788201632.079626:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201632.079640:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1259b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715507712:0@lo:38:kworker.0 00000100:00100000:1.0:1788201632.079671:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201632.079685:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1259b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715508096:0@lo:38:kworker.0 00000100:00100000:1.0:1788201632.079699:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201632.079729:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715507200 00000100:00100000:1.0:1788201632.079736:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715507200 00000100:00100000:1.0:1788201632.079761:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715507456 00000100:00100000:1.0:1788201632.079763:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715507456 00000100:00100000:1.0:1788201632.079769:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715508096 00000100:00100000:1.0:1788201632.079771:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715508096 00000100:00100000:1.0:1788201632.079782:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788201632.079790:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715507200:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201632.079809:0:107404:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201632.079844:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715507200:12345-0@lo:38:kworker.0 Request processed in 54us (260us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201632.079855:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788201632.079870:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788201632.079874:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715507456:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201632.079882:0:107404:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201632.079902:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715507456:12345-0@lo:38:kworker.0 Request processed in 27us (275us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201632.079908:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788201632.079916:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788201632.079920:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715508096:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201632.079990:0:107404:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201632.080013:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715508096:12345-0@lo:38:kworker.0 Request processed in 91us (312us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201632.080050:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788201632.080066:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715507712 00000100:00100000:1.0:1788201632.080069:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715507712 00000100:00100000:1.0:1788201632.080084:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788201632.080088:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715507712:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201632.080098:0:99776:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201632.080119:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715507712:12345-0@lo:38:kworker.0 Request processed in 30us (448us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201632.080125:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788201632.080152:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201632.080155:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201632.080159:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1259b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715507200:0@lo:38:kworker.0 00000100:00080000:1.0:1788201632.080175:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201632.080178:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201632.080180:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1259b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715507456:0@lo:38:kworker.0 00000100:00080000:1.0:1788201632.080186:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201632.080189:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201632.080192:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1259b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715507712:0@lo:38:kworker.0 00000100:00080000:1.0:1788201632.080198:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201632.080200:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201632.080202:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1259b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715508096:0@lo:38:kworker.0 00000100:00100000:0.0:1788201632.080310:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1259b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715507584:0@lo:400:kworker.0 00000100:00100000:0.0:1788201632.080336:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201632.080359:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788201632.080364:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715506944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201632.080383:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201632.080396:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1259b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715507840:0@lo:400:kworker.0 00000100:00100000:0.0:1788201632.080412:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201632.080458:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715507840 00000100:00100000:0.0:1788201632.080461:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715507840 00000100:00100000:0.0:1788201632.080497:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788201632.080504:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715507840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201632.080539:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715507840:12345-0@lo:400:kworker.0 Request processed in 36us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201632.080553:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00010000:00010000:0.0:1788201632.080571:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201632.080580:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201632.080598:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1259b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715507840:0@lo:400:kworker.0 00000100:00100000:1.0:1788201632.080651:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715507584 00000100:00100000:1.0:1788201632.080655:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715507584 00000100:00100000:1.0:1788201632.080682:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788201632.080688:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715507584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201632.080716:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715507584:12345-0@lo:400:kworker.0 Request processed in 29us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201632.080721:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788201632.080844:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715507072:0@lo:400:kworker.0 00000400:00000100:3.0:1788201632.080866:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715507072 offset 0 length 224: 4 00000100:00100000:3.0:1788201632.080885:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1259b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715507968:0@lo:400:kworker.0 00000100:00100000:3.0:1788201632.080912:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201632.081038:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201632.081046:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1259b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715507328:0@lo:400:kworker.0 00000100:00100000:3.0:1788201632.081072:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201632.081095:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715507328 00000100:00100000:3.0:1788201632.081098:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715507328 00000100:00100000:3.0:1788201632.081118:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788201632.081123:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715507328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201632.081151:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715507328:12345-0@lo:400:kworker.0 Request processed in 28us (78us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201632.081157:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788201632.081177:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1259b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715507328:0@lo:400:kworker.0 00000100:00100000:1.0:1788201632.081233:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715507968 00000100:00100000:1.0:1788201632.081237:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715507968 00000100:00100000:1.0:1788201632.081267:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788201632.081273:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715507968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201632.081301:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715507968:12345-0@lo:400:kworker.0 Request processed in 29us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201632.081306:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:0.0:1788201632.082129:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201632.082134:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201632.082162:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1259b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715507584:0@lo:400:kworker.0 00000100:00100000:3.0:1788201632.082244:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1259b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715507968:0@lo:400:kworker.0 00000100:00100000:2.0:1788201632.082362:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715506944 00000100:00100000:2.0:1788201632.082368:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715506944 00000100:00100000:2.0:1788201632.082410:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788201632.082418:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715506944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201632.082444:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201632.082501:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715506944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (2115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201632.082507:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788201632.082785:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715506944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201632.082887:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc003a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715508224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201632.082938:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201632.082971:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715508224 00000100:00100000:0.0:1788201632.082974:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715508224 00000100:00100000:0.0:1788201632.082998:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788201632.083004:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715508224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201632.083068:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201632.083101:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715508224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201632.083107:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788201632.083136:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc003a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715508224:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788201633.103794:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201634.131861:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201635.155746:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201636.177151:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201636.819615:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201636.819665:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000400:00000100:0.0:1788201636.819693:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695597312 offset 0 length 224: 4 00000100:00100000:3.0:1788201636.819707:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695597440 00000100:00100000:3.0:1788201636.819718:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695597440 00000100:00100000:3.0:1788201636.819766:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695597568 00000100:00100000:3.0:1788201636.819770:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695597568 00000100:00100000:3.0:1788201636.819817:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 68 00000100:00100000:3.0:1788201636.819828:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695597568:12345-192.168.201.20@tcp:400:kworker.0 00000100:00080000:0.0:1788201636.819846:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201636.819901:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695597568:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 75us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201636.819908:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 68 00000100:00100000:3.0:1788201636.819927:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 69 00000100:00100000:3.0:1788201636.819931:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875060695597440:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:3.0:1788201636.819959:0:107405:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201636.819983:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875060695597440:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 50us (381us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201636.820007:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 69 00000100:00100000:1.0:1788201637.199339:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1259b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715508352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201637.199395:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201637.199443:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715508352 00000100:00100000:1.0:1788201637.199449:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715508352 00000100:00100000:1.0:1788201637.199499:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788201637.199505:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715508352:12345-0@lo:13:osp-pre-1-1.0 00000100:00000400:0.0:1788201637.199518:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201621/real 1788201621] req@ffff8dc11fc17b80 x1875060715504128/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788201637 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:1.0:1788201637.199530:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788201637.199555:0:3657:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8dc11fc17b80 x1875060715504128/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788201637 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788201637.199565:0:3657:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from FULL to DISCONN 00000100:00100000:1.0:1788201637.199566:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715508352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (170us total) trans 0 rc 0/0 00000100:02020000:0.0:1788201637.199573:0:3657:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:1.0:1788201637.199576:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:0.0:1788201637.199580:0:3657:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.120@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788201637.199583:0:3657:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788201637.199588:0:3657:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc11fc17b80 x1875060715504128/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788201637 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788201637.199593:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201637.199602:0:3657:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc11cd19880 x1875060715505536/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201642 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788201637.199617:0:3657:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dc106048380 x1875060715507072/t0(0) o400->MGC192.168.201.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788201648 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788201637.199626:0:3657:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788201637.199630:0:3657:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 00000100:00100000:1.0:1788201637.199630:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1259b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715508352:0@lo:13:osp-pre-1-1.0 10000000:01000000:0.0:1788201637.199633:0:3657:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788201637.199696:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201637.199701:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788201637.199704:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201637.199708:0:41592:0:(import.c:510:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 4427 00000100:00080000:2.0:1788201637.199714:0:41592:0:(import.c:624:import_select_connection()) MGC192.168.201.120@tcp: import ffff8dc104280800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201637.199734:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005254e00 x1875060715508480/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201637.199753:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201637.199757:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201637.199765:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201637.199768:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4483 00000100:00080000:2.0:1788201637.199772:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788201637.199776:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc11ccfb000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201637.199792:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005257b80 x1875060715508608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201637.199811:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201637.199814:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201637.199816:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201637.199819:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4483 00000100:00080000:2.0:1788201637.199821:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788201637.199824:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc1401c3800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201637.199835:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005257480 x1875060715508864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201637.199842:0:3657:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:CONNECTING 00000100:00100000:0.0:1788201637.199862:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715507072:0@lo:400:kworker.0 00000100:00080000:2.0:1788201637.199864:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201637.199870:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201637.199872:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788201637.199875:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715505536:0@lo:400:kworker.0 00000100:00080000:2.0:1788201637.199879:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4483 00000100:00080000:2.0:1788201637.199883:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00100000:0.0:1788201637.199886:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11fc17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715504128:0@lo:400:kworker.0 00000100:00080000:2.0:1788201637.199889:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc11d439000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201637.199905:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc00715a300 x1875060715509120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201637.199921:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715508992:0@lo:400:kworker.0 00000100:00080000:2.0:1788201637.199924:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201637.199930:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201637.199949:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201637.199954:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4483 00000100:00080000:2.0:1788201637.199957:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788201637.199961:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc1401c2000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201637.199977:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc007159c00 x1875060715509376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201637.199979:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201637.200006:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715509248:0@lo:400:kworker.0 00000100:00100000:2.0:1788201637.200067:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201637.200088:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715508992 00000100:00100000:0.0:1788201637.200094:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715508992 00000100:00100000:0.0:1788201637.200142:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788201637.200151:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11fc17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715508992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201637.200197:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11fc17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715508992:12345-0@lo:400:kworker.0 Request processed in 47us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201637.200204:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788201637.200209:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715508480:0@lo:250:kworker.0 00000100:00100000:0.0:1788201637.200233:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715508992:0@lo:400:kworker.0 00000400:00000100:1.0:1788201637.200238:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060715508480 offset 0 length 520: 4 00000100:00100000:1.0:1788201637.200264:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715508608:0@lo:38:kworker.0 00000100:00100000:1.0:1788201637.200286:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201637.200311:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715508864:0@lo:38:kworker.0 00000100:00100000:1.0:1788201637.200327:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201637.200339:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715509120:0@lo:38:kworker.0 00000100:00100000:1.0:1788201637.200355:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201637.200366:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715509376:0@lo:38:kworker.0 00000100:00100000:1.0:1788201637.200379:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201637.200397:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715509248 00000100:00100000:1.0:1788201637.200400:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715509248 00000100:00100000:1.0:1788201637.200423:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788201637.200433:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715509248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201637.200461:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715509248:12345-0@lo:400:kworker.0 Request processed in 29us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201637.200466:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00010000:00010000:1.0:1788201637.200480:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201637.200487:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715508608 00000100:00100000:1.0:1788201637.200489:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715508608 00000100:00100000:1.0:1788201637.200498:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715508864 00000100:00100000:1.0:1788201637.200500:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715508864 00000100:00100000:1.0:1788201637.200505:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715509376 00000100:00100000:1.0:1788201637.200507:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715509376 00000100:00100000:1.0:1788201637.200513:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788201637.200517:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715508608:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201637.200530:0:107404:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201637.200556:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715508608:12345-0@lo:38:kworker.0 Request processed in 37us (269us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201637.200561:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788201637.200569:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788201637.200572:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715508864:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201637.200580:0:107404:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201637.200597:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715508864:12345-0@lo:38:kworker.0 Request processed in 24us (269us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201637.200603:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788201637.200612:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788201637.200616:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715509376:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201637.200624:0:107404:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201637.200654:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715509376:12345-0@lo:38:kworker.0 Request processed in 35us (272us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201637.200660:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788201637.200677:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715509120 00000100:00100000:1.0:1788201637.200680:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715509120 00000100:00100000:1.0:1788201637.200698:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788201637.200703:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715509120:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201637.200712:0:99776:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201637.200735:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715509120:12345-0@lo:38:kworker.0 Request processed in 31us (379us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201637.200741:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788201637.200763:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715508736:0@lo:400:kworker.0 00000100:00100000:1.0:1788201637.200784:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201637.200799:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201637.200803:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715509504:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201637.200820:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201637.200840:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715509504 00000100:00100000:1.0:1788201637.200844:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715509504 00000100:00100000:1.0:1788201637.200862:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788201637.200868:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715509504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201637.200883:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1788201637.200912:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715509504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201637.200919:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788201637.200956:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715509248:0@lo:400:kworker.0 00000100:00100000:1.0:1788201637.200988:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715509504:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788201637.200990:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201637.200995:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201637.201038:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715508736 00000100:00100000:1.0:1788201637.201042:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715508736 00000100:00100000:1.0:1788201637.201070:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788201637.201080:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715508736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201637.201113:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715508736:12345-0@lo:400:kworker.0 Request processed in 38us (328us total) trans 0 rc 0/0 00000100:00080000:2.0:1788201637.201166:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201637.201244:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788201637.201273:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715508736:0@lo:400:kworker.0 00000100:00080000:1.0:1788201637.201308:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201637.201313:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201637.201316:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715508608:0@lo:38:kworker.0 00000100:00080000:1.0:1788201637.201325:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201637.201328:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201637.201331:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715508864:0@lo:38:kworker.0 00000100:00080000:1.0:1788201637.201340:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201637.201344:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201637.201348:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715509120:0@lo:38:kworker.0 00000100:00080000:1.0:1788201637.201359:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788201637.201363:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788201637.201366:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715509376:0@lo:38:kworker.0 00000001:00100000:1.0:1788201637.718785:0:100576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:1.0:1788201637.718796:0:100576:0:(genops.c:885:class_export_put()) final put ffff8dc005fae800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:0.0:1788201637.718870:0:76267:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005fae800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 for lustre-OST0001 00000020:00000080:0.0:1788201637.718933:0:76267:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc13f83f800 for lustre-OST0001 00000001:00100000:1.0:1788201637.719054:0:99761:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:1.0:1788201637.719059:0:99761:0:(genops.c:885:class_export_put()) final put ffff8dc006d87800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:0.0:1788201637.719120:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc006d87800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 for lustre-OST0000 00000020:00000080:0.0:1788201637.719152:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc006d86000 for lustre-OST0000 00000400:00000100:3.0:1788201637.855509:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.20@tcp portal 26 match 1875060695597696 offset 0 length 520: 4 00000100:00100000:3.0:1788201637.855538:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201637.855638:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201637.856044:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695597824 00000100:00100000:0.0:1788201637.856054:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695597824 00000100:00100000:0.0:1788201637.856090:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695597952 00000100:00100000:0.0:1788201637.856093:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695597952 00000100:00100000:0.0:1788201637.856117:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 71 00000100:00100000:0.0:1788201637.856126:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695597952:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201637.856197:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695597952:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 72us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201637.856204:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 71 00000100:00100000:0.0:1788201637.856220:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 73 00000100:00100000:0.0:1788201637.856224:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695597824:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:0.0:1788201637.856243:0:107403:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201637.856267:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695597824:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 41us (728us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201637.856273:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 73 00010000:00010000:0.0:1788201638.223122:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201639.254795:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201640.276902:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201641.296877:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201642.320231:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1259b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715509632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201642.320247:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1259b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715509760:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788201642.320427:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201642.320529:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201642.320534:0:93109:0:(pinger.c:247:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788201642.320537:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201642.320540:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201642.320544:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201642.320549:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4488 00000100:00080000:0.0:1788201642.320553:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201642.320559:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc11ccfb000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201642.320582:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc106048380 x1875060715509888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201642.320679:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201642.320683:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201642.320685:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201642.320690:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4488 00000100:00080000:0.0:1788201642.320692:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201642.320696:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc1401c3800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201642.320709:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d54380 x1875060715510144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201642.320728:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201642.320732:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201642.320733:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201642.320737:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4488 00000100:00080000:0.0:1788201642.320739:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201642.320743:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc11d439000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201642.320763:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d57480 x1875060715510400/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201642.320782:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788201642.320786:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788201642.320787:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788201642.320790:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4488 00000100:00080000:0.0:1788201642.320793:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788201642.320796:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc1401c2000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201642.320805:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d55500 x1875060715510784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201642.320983:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201642.321039:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715510528:0@lo:400:kworker.0 00000100:00100000:3.0:1788201642.321066:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201642.321086:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201642.321092:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715510272:0@lo:400:kworker.0 00000100:00100000:3.0:1788201642.321118:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201642.321147:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715509632 00000100:00100000:3.0:1788201642.321167:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715509632 00000100:00100000:3.0:1788201642.321221:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788201642.321230:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715509632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201642.321257:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201642.321296:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715509632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201642.321303:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788201642.321324:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715510528 00000100:00100000:3.0:1788201642.321328:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715510528 00000100:00100000:3.0:1788201642.321350:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788201642.321356:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715510528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201642.321392:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715510528:12345-0@lo:400:kworker.0 Request processed in 36us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201642.321399:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788201642.321415:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715510272 00000100:00100000:3.0:1788201642.321418:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715510272 00000100:00100000:3.0:1788201642.321443:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788201642.321449:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715510272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201642.321478:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715510272:12345-0@lo:400:kworker.0 Request processed in 29us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201642.321484:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1788201642.321499:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201642.321504:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201642.321524:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715509888:0@lo:38:kworker.0 00000100:00100000:3.0:1788201642.321551:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201642.321569:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715510144:0@lo:38:kworker.0 00000100:00100000:3.0:1788201642.321589:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201642.321604:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715510400:0@lo:38:kworker.0 00000100:00100000:3.0:1788201642.321759:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201642.321778:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715510784:0@lo:38:kworker.0 00000100:00100000:3.0:1788201642.321801:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201642.321898:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715509888 00000100:00100000:3.0:1788201642.321904:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715509888 00000100:00100000:3.0:1788201642.321919:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715510144 00000100:00100000:3.0:1788201642.321921:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715510144 00000100:00100000:3.0:1788201642.321928:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715510784 00000100:00100000:3.0:1788201642.321930:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715510784 00000100:00100000:3.0:1788201642.321940:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788201642.321951:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715509888:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788201642.321969:0:107404:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201642.322006:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715509888:12345-0@lo:38:kworker.0 Request processed in 54us (454us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201642.322012:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788201642.322045:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788201642.322049:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715510144:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788201642.322059:0:107404:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201642.322061:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201642.322083:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715510144:12345-0@lo:38:kworker.0 Request processed in 32us (494us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201642.322086:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715510656:0@lo:400:kworker.0 00000100:00100000:3.0:1788201642.322089:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788201642.322100:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788201642.322104:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715510784:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788201642.322109:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:3.0:1788201642.322113:0:107404:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201642.322126:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201642.322132:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715510016:0@lo:400:kworker.0 00000100:00100000:3.0:1788201642.322134:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715510784:12345-0@lo:38:kworker.0 Request processed in 29us (333us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201642.322139:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788201642.322151:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201642.322220:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715510400 00000100:00100000:3.0:1788201642.322224:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715510400 00000100:00100000:3.0:1788201642.325596:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788201642.325675:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715510400:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788201642.325699:0:99776:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201642.325771:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715510400:12345-0@lo:38:kworker.0 Request processed in 163us (4011us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201642.325778:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788201642.328764:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715510016 00000100:00100000:3.0:1788201642.328781:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715510016 00000100:00100000:3.0:1788201642.329046:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788201642.329059:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715510016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201642.329142:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715510016:12345-0@lo:400:kworker.0 Request processed in 87us (6990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201642.329149:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1788201642.329195:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201642.329277:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201642.329282:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201642.329286:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715509888:0@lo:38:kworker.0 00000100:00080000:3.0:1788201642.329297:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1788201642.329298:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715510016:0@lo:400:kworker.0 00000100:00080000:3.0:1788201642.329300:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201642.329304:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715510144:0@lo:38:kworker.0 00000100:00080000:3.0:1788201642.329312:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201642.329315:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201642.329318:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715510400:0@lo:38:kworker.0 00000100:00080000:3.0:1788201642.329328:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201642.329331:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201642.329334:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715510784:0@lo:38:kworker.0 00000100:00100000:1.0:1788201642.329336:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715509760 00000100:00100000:1.0:1788201642.329340:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715509760 00000100:00100000:3.0:1788201642.329376:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715510272:0@lo:400:kworker.0 00000100:00100000:3.0:1788201642.329389:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715510528:0@lo:400:kworker.0 00000100:00100000:3.0:1788201642.329408:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1259b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715509632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201642.329417:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788201642.329424:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715509760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201642.329448:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201642.329488:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715509760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (7427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201642.329494:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788201642.329514:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715510656 00000100:00100000:1.0:1788201642.329518:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715510656 00000100:00100000:1.0:1788201642.329542:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788201642.329548:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715510656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201642.329577:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715510656:12345-0@lo:400:kworker.0 Request processed in 30us (7467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201642.329582:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788201642.329636:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715510656:0@lo:400:kworker.0 00000100:00100000:1.0:1788201642.329648:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1259b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715509760:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788201642.331138:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201642.969309:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201642.969379:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201642.969429:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695598208 00000100:00100000:3.0:1788201642.969438:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695598208 00000100:00100000:0.0:1788201642.969475:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695598080 00000100:00100000:0.0:1788201642.969479:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695598080 00000100:00080000:2.0:1788201642.969530:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201642.978133:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 74 00000100:00100000:3.0:1788201642.978182:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695598208:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201642.978288:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695598208:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 129us (8989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201642.978358:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 77 00000100:00100000:0.0:1788201642.978366:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695598080:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:0.0:1788201642.978389:0:107403:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788201642.978420:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695598080:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 53us (9040us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201642.978427:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 77 00000100:00100000:3.0:1788201642.990830:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 74 00010000:00010000:3.0:1788201643.344218:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788201644.328992:0:109766:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788201644.328998:0:109766:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788201644.328999:0:109766:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788201644.329216:0:109766:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dc12b6ba000 00000020:01000004:3.0:1788201644.329232:0:109766:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788201644.329245:0:109766:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788201644.329260:0:109766:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8dc12ef63370) 00000020:00000080:3.0:1788201644.329275:0:109766:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1788201644.369132:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788201644.398242:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788201644.402655:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788201644.404717:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788201644.405203:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788201644.405391:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788201644.405583:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788201644.405888:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788201644.406202:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788201644.406414:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788201644.406600:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788201644.406883:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788201644.407112:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788201644.407301:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788201644.407473:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788201644.410562:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788201644.411522:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788201644.411865:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788201644.412165:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788201644.412389:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788201644.412630:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788201644.412873:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788201644.413126:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788201644.413340:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788201644.413556:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788201644.413928:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788201644.414222:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788201644.414458:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788201644.414690:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788201644.415007:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788201644.415216:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788201644.415441:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788201644.415682:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788201644.415952:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788201644.416218:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788201644.416450:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788201644.416680:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788201644.416930:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788201644.417202:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788201644.417389:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788201644.417623:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788201644.417866:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788201644.418144:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788201644.418384:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788201644.418619:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788201644.418865:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788201644.419064:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788201644.419280:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788201644.420283:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788201644.420597:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788201644.420886:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788201644.421310:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788201644.421507:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788201644.421743:0:109766:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1788201644.422485:0:109766:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788201644.422710:0:109766:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788201644.422719:0:109766:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788201644.422730:0:109766:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1f7e0 00000020:01000004:3.0:1788201644.422737:0:109766:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788201644.422749:0:109766:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788201644.422755:0:109766:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dc12b6ba000 from MGS 00000020:01000004:3.0:1788201644.422758:0:109766:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788201644.422769:0:109766:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8dc1256399b8) 00000020:00000080:3.0:1788201644.422782:0:109766:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:3.0:1788201644.422860:0:109766:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc12b6ba000 from MGS, refs=2 00080000:01000000:3.0:1788201644.422864:0:109766:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788201644.422880:0:109766:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1f7ee 00010000:00010000:3.0:1788201644.423005:0:109766:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1788201644.427539:0:109766:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788201644.431121:0:109770:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788201644.431213:0:109766:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788201644.431275:0:109766:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788201644.432296:0:109766:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788201644.432543:0:109766:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788201644.432723:0:109766:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788201644.432729:0:109766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788201644.433432:0:109766:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788201644.433441:0:109766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788201644.442928:0:109766:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788201644.442941:0:109766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788201644.450612:0:109766:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788201644.450643:0:109766:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1788201644.450645:0:109766:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.120@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1788201644.450649:0:109766:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.120@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:2.0:1788201644.450654:0:109766:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8dc104280800 already not connected (conn 83, was 0): CONNECTING 00000100:00100000:2.0:1788201644.450661:0:109766:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00010000:00010000:3.0:1788201645.391450:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201646.415220:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201647.069754:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201647.069820:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201647.069859:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201647.069979:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695598592 00000100:00100000:3.0:1788201647.069989:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695598592 00000100:00100000:1.0:1788201647.070072:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695598464 00000100:00100000:1.0:1788201647.070077:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695598464 00000100:00100000:3.0:1788201647.070093:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 75 00000100:00100000:3.0:1788201647.070109:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2400:x1875060695598592:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201647.070183:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2400:x1875060695598592:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 77us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201647.070307:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695598336 00000100:00100000:2.0:1788201647.070312:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695598336 00000100:00100000:2.0:1788201647.070336:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:2.0:1788201647.070342:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2399:x1875060695598336:12345-192.168.201.20@tcp:250:kworker.0 00010000:00080000:2.0:1788201647.070367:0:109772:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 93ba7067-43b5-4e46-8db7-27c040fa03d9@192.168.201.20@tcp t0 exp 0000000000000000 cur 4498 last 0 00000020:00000080:2.0:1788201647.070410:0:109772:0:(genops.c:1385:class_connect()) connect: client 93ba7067-43b5-4e46-8db7-27c040fa03d9, cookie 0x96d0c9b8c9a1f7f5 00000100:00080000:0.0:1788201647.070915:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788201647.070970:0:107405:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788201647.070980:0:107405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:2.0:1788201647.071189:0:109772:0:(import.c:65:import_set_state_nolock()) ffff8dc106038000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201647.071239:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+5:2399:x1875060695598336:12345-192.168.201.20@tcp:250:kworker.0 Request processed in 894us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201647.071247:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 0 00000100:00100000:1.0:1788201647.071296:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 78 00000100:00100000:1.0:1788201647.071303:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695598464:12345-192.168.201.20@tcp:38:kworker.0 00010000:00020000:1.0:1788201647.071329:0:107404:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.201.20@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788201647.071354:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875060695598464:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 52us (1495us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201647.071361:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 78 00000100:00100000:3.0:1788201647.072807:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 75 00000100:00080000:3.0:1788201647.439238:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201647.439248:0:41592:0:(pinger.c:247:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788201647.439251:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201647.439255:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1788201647.439256:0:3654:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788201637/real 1788201637] req@ffff8dc005254e00 x1875060715508480/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788201647 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201647.439259:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201647.439266:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4493 00000100:00080000:3.0:1788201647.439270:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201647.439278:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc11ccfb000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201647.439310:0:3654:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dc005254e00 x1875060715508480/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788201647 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201647.439319:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004b3a680 x1875060715510912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201647.439333:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201647.439346:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788201647.439356:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715508480:0@lo:250:kworker.0 00000100:00080000:3.0:1788201647.439365:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201647.439370:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201647.439372:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201647.439377:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4493 00000100:00080000:3.0:1788201647.439380:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1788201647.439385:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715510912:0@lo:38:kworker.0 00000100:00080000:3.0:1788201647.439385:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc1401c3800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201647.439405:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004b38000 x1875060715511168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201647.439433:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201647.439436:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201647.439438:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201647.439441:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4493 00000100:00080000:3.0:1788201647.439443:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201647.439447:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc11d439000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201647.439455:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201647.439462:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004b39180 x1875060715511424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201647.439483:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201647.439486:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201647.439488:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788201647.439492:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715511168:0@lo:38:kworker.0 00000100:00080000:3.0:1788201647.439493:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4493 00000100:00080000:3.0:1788201647.439499:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201647.439504:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc1401c2000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201647.439521:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004b39c00 x1875060715511808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201647.439525:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201647.439545:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715511424:0@lo:38:kworker.0 00000100:00080000:3.0:1788201647.439545:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201647.439552:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788201647.439553:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201647.439558:0:41592:0:(import.c:510:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 4488 00000100:00080000:3.0:1788201647.439561:0:41592:0:(import.c:589:import_select_connection()) MGC192.168.201.120@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788201647.439565:0:41592:0:(import.c:624:import_select_connection()) MGC192.168.201.120@tcp: import ffff8dc104280800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201647.439575:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201647.439583:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc106048380 x1875060715512064/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201647.439599:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715511808:0@lo:38:kworker.0 00000100:00100000:1.0:1788201647.439600:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715511040:0@lo:400:kworker.0 00000100:00100000:0.0:1788201647.439623:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201647.439633:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715511680:0@lo:400:kworker.0 00000100:00020000:0.0:1788201647.439642:0:3654:0:(client.c:1404:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff8dc106048380 x1875060715512064/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201647.439655:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201647.439718:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715511680 00000100:00100000:1.0:1788201647.439725:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715511680 00000100:00100000:1.0:1788201647.439788:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788201647.439797:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715511680:12345-0@lo:400:kworker.0 10000000:01000000:2.0:1788201647.439837:0:109766:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00100000:1.0:1788201647.439851:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715511680:12345-0@lo:400:kworker.0 Request processed in 55us (194us total) trans 0 rc 0/0 00010000:00010000:2.0:1788201647.439853:0:109766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1f0ee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1f0f5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201647.439858:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 10000000:00010000:2.0:1788201647.439863:0:109766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1f0ee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1f0f5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201647.439869:0:109766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00080000:1.0:1788201647.439876:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788201647.439879:0:109766:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00100000:1.0:1788201647.439887:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715510912 00010000:00010000:2.0:1788201647.439888:0:109766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064eca00/0x96d0c9b8c9a1f0ee lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1f0f5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201647.439890:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715510912 00000100:00100000:1.0:1788201647.439907:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715511168 00000100:00100000:1.0:1788201647.439909:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715511168 00000100:00100000:1.0:1788201647.439917:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715511808 00010000:00010000:2.0:1788201647.439918:0:109766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ef90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1ef97 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201647.439919:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715511808 10000000:00010000:2.0:1788201647.439925:0:109766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ef90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1ef97 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201647.439928:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 10000000:01000000:2.0:1788201647.439930:0:109766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201647.439937:0:109766:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201647.439941:0:109766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2c00/0x96d0c9b8c9a1ef90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1ef97 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201647.439949:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715510912:12345-0@lo:38:kworker.0 00010000:00010000:2.0:1788201647.439950:0:109766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1f054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1f05b expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201647.439964:0:109766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1f054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1f05b expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201647.439969:0:109766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00020000:1.0:1788201647.439973:0:107404:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:2.0:1788201647.439983:0:109766:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201647.439987:0:109766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2200/0x96d0c9b8c9a1f054 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1f05b expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.439997:0:109766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1f09a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1f0a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201647.440000:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715510912:12345-0@lo:38:kworker.0 Request processed in 50us (547us total) trans 0 rc -19/-19 10000000:00010000:2.0:1788201647.440003:0:109766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1f09a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1f0a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201647.440006:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 10000000:01000000:2.0:1788201647.440008:0:109766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788201647.440038:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788201647.440042:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715511168:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201647.440052:0:107404:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:2.0:1788201647.440060:0:109766:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201647.440064:0:109766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e3e00/0x96d0c9b8c9a1f09a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1f0a1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.440075:0:109766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2600/0x96d0c9b8c9a1f0a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1f0af expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201647.440076:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715511168:12345-0@lo:38:kworker.0 Request processed in 32us (552us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201647.440082:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 10000000:00010000:2.0:1788201647.440082:0:109766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2600/0x96d0c9b8c9a1f0a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1f0af expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201647.440087:0:109766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788201647.440092:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788201647.440096:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715511808:12345-0@lo:38:kworker.0 00010000:00010000:2.0:1788201647.440099:0:109766:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201647.440102:0:109766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2600/0x96d0c9b8c9a1f0a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1f0af expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00020000:1.0:1788201647.440105:0:107404:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:2.0:1788201647.440121:0:109766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2800/0x96d0c9b8c9a1f0c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1f0cb expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201647.440126:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715511808:12345-0@lo:38:kworker.0 Request processed in 28us (502us total) trans 0 rc -19/-19 10000000:00010000:2.0:1788201647.440129:0:109766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2800/0x96d0c9b8c9a1f0c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1f0cb expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201647.440131:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 10000000:01000000:2.0:1788201647.440134:0:109766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201647.440148:0:109766:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201647.440152:0:109766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2800/0x96d0c9b8c9a1f0c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1f0cb expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.440161:0:109766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3800/0x96d0c9b8c9a1f0d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1f0d9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201647.440167:0:109766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3800/0x96d0c9b8c9a1f0d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1f0d9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201647.440172:0:109766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201647.440184:0:109766:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201647.440188:0:109766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3800/0x96d0c9b8c9a1f0d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1f0d9 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.440196:0:109766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc1064edc00/0x96d0c9b8c9a1f0fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1f103 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201647.440202:0:109766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc1064edc00/0x96d0c9b8c9a1f0fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1f103 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201647.440207:0:109766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201647.440226:0:109766:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201647.440232:0:109766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc1064edc00/0x96d0c9b8c9a1f0fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1f103 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.440249:0:109766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2800/0x96d0c9b8c9a1f07e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1f085 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201647.440255:0:109766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2800/0x96d0c9b8c9a1f07e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1f085 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201647.440260:0:109766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201647.440266:0:109766:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201647.440269:0:109766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2800/0x96d0c9b8c9a1f07e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1f085 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.440287:0:109766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2600/0x96d0c9b8c9a1ef82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1ef89 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201647.440294:0:109766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2600/0x96d0c9b8c9a1ef82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1ef89 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201647.440298:0:109766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1788201647.440304:0:109766:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201647.440307:0:109766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc12e6e2600/0x96d0c9b8c9a1ef82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1ef89 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.440324:0:109766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc006dbcc00/0x96d0c9b8c9a1f03f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1f046 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201647.440331:0:109766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc006dbcc00/0x96d0c9b8c9a1f03f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1f046 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201647.440347:0:109766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788201647.440355:0:109766:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201647.440360:0:109766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc006dbcc00/0x96d0c9b8c9a1f03f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1f046 expref: -99 pid: 107388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.440369:0:109766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1f0b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1f0bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201647.440375:0:109766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1f0b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1f0bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201647.440379:0:109766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788201647.440392:0:109766:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201647.440396:0:109766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc125ae3a00/0x96d0c9b8c9a1f0b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1f0bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.440404:0:109766:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2e00/0x96d0c9b8c9a1f0e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x96d0c9b8c9a1f0e7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788201647.440410:0:109766:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2e00/0x96d0c9b8c9a1f0e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x96d0c9b8c9a1f0e7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201647.440414:0:109766:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788201647.440426:0:109766:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788201647.440429:0:109766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc125ae2e00/0x96d0c9b8c9a1f0e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x96d0c9b8c9a1f0e7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201647.440473:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201647.440497:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1259b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715511936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201647.440523:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201647.440568:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715511680:0@lo:400:kworker.0 00000100:00100000:1.0:1788201647.440585:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715511040 00000100:00100000:1.0:1788201647.440588:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715511040 00000100:00100000:1.0:1788201647.440615:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788201647.440621:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715511040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201647.440654:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715511040:12345-0@lo:400:kworker.0 Request processed in 34us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201647.440666:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788201647.440681:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201647.440698:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715511040:0@lo:400:kworker.0 00000100:00100000:3.0:1788201647.440724:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715511296:0@lo:400:kworker.0 00000100:00100000:3.0:1788201647.440767:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201647.440769:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715511424 00000100:00100000:1.0:1788201647.440774:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715511424 00000100:00100000:3.0:1788201647.440797:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1259b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715512192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201647.440800:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788201647.440809:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715511424:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788201647.440821:0:99776:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788201647.440827:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201647.440857:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201647.440863:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715511424:12345-0@lo:38:kworker.0 Request processed in 52us (1287us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201647.440868:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715511552:0@lo:400:kworker.0 00000100:00100000:1.0:1788201647.440874:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788201647.440899:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715511296 00000100:00100000:1.0:1788201647.440903:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715511296 00000100:00100000:3.0:1788201647.440910:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201647.440954:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715511552 00000100:00100000:3.0:1788201647.440958:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715511552 00000100:00100000:3.0:1788201647.440986:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788201647.440992:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715511552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201647.441042:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715511552:12345-0@lo:400:kworker.0 Request processed in 50us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201647.441050:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788201647.441075:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715511936 00000100:00100000:3.0:1788201647.441079:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715511936 00000100:00100000:3.0:1788201647.441103:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715512192 00000100:00100000:3.0:1788201647.441115:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715512192 00000100:00100000:3.0:1788201647.441132:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788201647.441137:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715511936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201647.441156:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201647.441191:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715511936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201647.441197:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788201647.441209:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788201647.441216:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715512192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788201647.441231:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788201647.441256:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715512192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201647.441261:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788201647.441405:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1259b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715511936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201647.441411:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788201647.441422:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715511296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201647.441435:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715511552:0@lo:400:kworker.0 00000100:00100000:3.0:1788201647.441452:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1259b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715512192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201647.441464:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715511296:12345-0@lo:400:kworker.0 Request processed in 43us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201647.441468:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715511296:0@lo:400:kworker.0 00000100:00100000:1.0:1788201647.441477:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1788201647.441500:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201647.441504:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201647.504842:0:109766:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8dc104280800 already not connected (conn 84, was 0): CONNECTING 00000100:00080000:2.0:1788201647.504854:0:109766:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:0.0:1788201647.505487:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201647.505527:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:0.0:1788201647.505553:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:0:1875060715512064:0@lo:250:kworker.0 00000100:00080000:0.0:1788201647.505659:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201647.505664:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201647.505668:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715511168:0@lo:38:kworker.0 00000100:00080000:0.0:1788201647.505681:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201647.505684:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201647.505697:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715511424:0@lo:38:kworker.0 00000100:00080000:0.0:1788201647.505712:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201647.505716:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201647.505719:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715510912:0@lo:38:kworker.0 00000100:00080000:0.0:1788201647.505773:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201647.505777:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201647.505780:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715511808:0@lo:38:kworker.0 00010000:00010000:3.0:1788201647.506084:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201647.507445:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) c9b18af6-fecc-4172-82c2-66531890fe11->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201647.507454:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788201647.507458:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201647.507464:0:93109:0:(import.c:510:import_select_connection()) MGC192.168.201.120@tcp: connect to NID 0@lo last attempt 4498 00000100:00080000:2.0:1788201647.507469:0:93109:0:(import.c:589:import_select_connection()) MGC192.168.201.120@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788201647.507476:0:93109:0:(import.c:624:import_select_connection()) MGC192.168.201.120@tcp: import ffff8dc104280800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201647.507512:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc007159500 x1875060715512320/t0(0) o250->MGC192.168.201.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201647.508376:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715512320:0@lo:250:kworker.0 00000100:00100000:0.0:1788201647.508449:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201647.508592:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715512320 00000100:00100000:2.0:1788201647.508600:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715512320 00000100:00100000:2.0:1788201647.508649:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788201647.508656:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3654:x1875060715512320:12345-0@lo:250:kworker.0 00010000:00080000:2.0:1788201647.508681:0:109774:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c9b18af6-fecc-4172-82c2-66531890fe11@0@lo t0 exp 0000000000000000 cur 4498 last 0 00000020:00000080:2.0:1788201647.508708:0:109774:0:(genops.c:1385:class_connect()) connect: client c9b18af6-fecc-4172-82c2-66531890fe11, cookie 0x96d0c9b8c9a1f7fc 00000100:00080000:2.0:1788201647.508851:0:109774:0:(import.c:65:import_set_state_nolock()) ffff8dc10603a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201647.508919:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+5:3654:x1875060715512320:12345-0@lo:250:kworker.0 Request processed in 261us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201647.508926:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788201647.509186:0:3654:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.120@tcp: committing for last_committed 0 gen 32 00000100:00080000:0.0:1788201647.509196:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.120@tcp: connect to target with instance 0 00000100:00080000:0.0:1788201647.509203:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788201647.509208:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788201647.509210:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc104280800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788201647.509213:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788201647.509234:0:3654:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788201647.509242:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c9b18af6-fecc-4172-82c2-66531890fe11:3654:1875060715512320:0@lo:250:kworker.0 00000020:01000000:3.0:1788201647.509334:0:93109:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.201.120@tcp 10000000:01000000:3.0:1788201647.509353:0:93109:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1788201647.509356:0:93109:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788201647.509358:0:93109:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201647.509360:0:93109:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201647.509361:0:93109:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201647.509362:0:93109:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201647.509363:0:93109:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201647.509365:0:93109:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201647.509372:0:93109:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201647.509374:0:93109:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788201647.509418:0:93109:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1788201647.509426:0:93109:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1788201647.509427:0:93109:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788201647.509429:0:93109:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788201647.509430:0:93109:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201647.509431:0:93109:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201647.509432:0:93109:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201647.509433:0:93109:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201647.509434:0:93109:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201647.509435:0:93109:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201647.509436:0:93109:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788201647.509456:0:93109:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1788201647.509460:0:93109:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1788201647.509462:0:93109:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788201647.509463:0:93109:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788201647.509464:0:93109:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201647.509465:0:93109:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201647.509466:0:93109:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201647.509468:0:93109:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201647.509469:0:93109:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201647.509470:0:93109:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201647.509470:0:93109:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788201647.509479:0:93109:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1788201647.509512:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715512576:0@lo:253:kworker.0 00000100:00100000:3.0:1788201647.509563:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201647.509591:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201647.509596:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715512704:0@lo:253:kworker.0 00000100:00100000:3.0:1788201647.509623:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201647.509645:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201647.509652:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715512448:0@lo:253:kworker.0 00000100:00100000:3.0:1788201647.509678:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201647.509709:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715512576 00000100:00100000:3.0:1788201647.509714:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715512576 00000100:00100000:3.0:1788201647.509748:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715512704 00000100:00100000:3.0:1788201647.509751:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715512704 00000100:00100000:3.0:1788201647.509776:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715512448 00000100:00100000:3.0:1788201647.509779:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715512448 00000100:00100000:3.0:1788201647.509790:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788201647.509796:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+7:3657:x1875060715512576:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1788201647.509818:0:109773:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00080000:3.0:1788201647.510008:0:109766:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:3.0:1788201647.510188:0:109766:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788201647.510222:0:109766:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788201647.510226:0:109766:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788201647.510327:0:109766:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788201647.510354:0:109766:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.120@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788201647.510357:0:109766:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788201647.510359:0:109766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201647.510360:0:109766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201647.510361:0:109766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201647.510362:0:109766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201647.510363:0:109766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201647.510364:0:109766:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201647.510365:0:109766:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201647.510367:0:109766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201647.510368:0:109766:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788201647.510370:0:109766:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788201647.510371:0:109766:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788201647.510372:0:109766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201647.510373:0:109766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201647.510374:0:109766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201647.510375:0:109766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201647.510376:0:109766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201647.510377:0:109766:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201647.510377:0:109766:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201647.510378:0:109766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201647.510379:0:109766:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788201647.510394:0:109766:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788201647.510405:0:109766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1259b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715512832:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788201647.510444:0:109766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201647.510454:0:109766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f4e300 going to sleep for 11 seconds 10000000:01000000:3.0:1788201647.510496:0:109777:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:2.0:1788201647.511257:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715512832 00000100:00100000:2.0:1788201647.511264:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715512832 00000100:00100000:2.0:1788201647.511298:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201647.511306:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+8:3657:x1875060715512704:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788201647.511329:0:109772:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788201647.511473:0:109773:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 140 20000000:01000000:3.0:1788201647.522859:0:109778:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788201647.522868:0:109778:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788201647.522871:0:109778:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788201647.522874:0:109778:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788201647.523488:0:109778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 20000000:01000000:0.0:1788201647.523828:0:109773:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788201647.523860:0:109773:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788201647.540232:0:109773:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788201647.540251:0:109773:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788201647.540472:0:109772:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788201647.540957:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+8:3657:x1875060715512576:12345-0@lo:253:kworker.0 Request processed in 31155us (31388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201647.540969:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788201647.541128:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788201647.541141:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+7:3655:x1875060715512448:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788201647.541169:0:109773:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788201647.541247:0:109777:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788201647.541253:0:109777:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788201647.541277:0:109777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc0056d7800/0x96d0c9b8c9a1f803 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.541292:0:109777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0056d7800/0x96d0c9b8c9a1f803 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788201647.541301:0:109777:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000049035s 00010000:00010000:0.0:1788201647.541312:0:109777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc0056d7800/0x96d0c9b8c9a1f803 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.541319:0:109777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc0056d7800/0x96d0c9b8c9a1f803 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.541326:0:109777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc0056d7800/0x96d0c9b8c9a1f803 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.541334:0:109777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc0056d7800/0x96d0c9b8c9a1f803 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.541339:0:109777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201647.541344:0:109777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc0056d7800/0x96d0c9b8c9a1f803 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.541353:0:109777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc0056d7800/0x96d0c9b8c9a1f803 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.541368:0:109777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc0056d7800/0x96d0c9b8c9a1f803 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.541376:0:109777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc0056d7800/0x96d0c9b8c9a1f803 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.541383:0:109777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0056d7800/0x96d0c9b8c9a1f803 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788201647.541504:0:3657:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788201647.541507:0:3657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788201647.541509:0:3657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201647.541510:0:3657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201647.541512:0:3657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201647.541513:0:3657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201647.541582:0:3657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201647.541586:0:3657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201647.541587:0:3657:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788201647.541592:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715512576:0@lo:253:kworker.0 20000000:01000000:2.0:1788201647.564187:0:109772:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788201647.564202:0:109772:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788201647.564404:0:109773:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788201647.564920:0:109777:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788201647.564925:0:109777:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788201647.564949:0:109777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f80a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.564965:0:109777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f80a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788201647.564995:0:109777:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000070820s 00010000:00010000:1.0:1788201647.565000:0:109777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f80a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.565007:0:109777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f80a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201647.565645:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+7:3657:x1875060715512704:12345-0@lo:253:kworker.0 Request processed in 54333us (56015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201647.565655:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201647.565706:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788201647.565717:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+6:109766:x1875060715512832:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788201647.565768:0:109772:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788201647.565771:0:109772:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788201647.565774:0:109772:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1788201647.565779:0:109772:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00010000:00010000:1.0:1788201647.567218:0:109777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f80a lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.567239:0:109777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f80a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.567245:0:109777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ecc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201647.567250:0:109777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f80a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.567260:0:109777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f80a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.567277:0:109777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f80a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.567286:0:109777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f80a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.567292:0:109777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f80a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788201647.573174:0:3657:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788201647.573181:0:3657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788201647.573183:0:3657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201647.573184:0:3657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201647.573206:0:3657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201647.573209:0:3657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201647.573210:0:3657:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201647.573212:0:3657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201647.573214:0:3657:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788201647.573220:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715512704:0@lo:253:kworker.0 20000000:01000000:2.0:1788201647.596523:0:109773:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788201647.596546:0:109773:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788201647.596693:0:109777:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788201647.596715:0:109777:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788201647.596738:0:109777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f811 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.596764:0:109777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f811 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788201647.596775:0:109777:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000070820s 00010000:00010000:1.0:1788201647.596780:0:109777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f811 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.596786:0:109777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f811 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.596793:0:109777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f811 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.596799:0:109777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f811 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.596806:0:109777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ecc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201647.596811:0:109777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f811 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.596820:0:109777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f811 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.596833:0:109777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f811 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.596841:0:109777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f811 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.596860:0:109777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f811 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201647.597499:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+6:109766:x1875060715512832:12345-0@lo:253:mount.lustre.0 Request processed in 31779us (87048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201647.597530:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788201647.597683:0:109766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1259b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715512832:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788201647.597698:0:109766:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788201647.597702:0:109766:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788201647.597704:0:109766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201647.597705:0:109766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201647.597707:0:109766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201647.597708:0:109766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201647.597709:0:109766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201647.597711:0:109766:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201647.597712:0:109766:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201647.597714:0:109766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201647.597716:0:109766:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788201647.597739:0:109766:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dc12b6ba000 from lustre-MDT0000 10000000:01000000:3.0:1788201647.597780:0:109766:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788201647.597791:0:109766:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788201647.597800:0:109766:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dc12b6ba000 10000000:01000000:3.0:1788201647.597804:0:109766:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788201647.597809:0:109766:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8dc12b6ba000 10000000:01000000:3.0:1788201647.597812:0:109766:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788201647.597815:0:109766:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dc12b6ba000 from 1 10000000:01000000:3.0:1788201647.597818:0:109766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788201647.597850:0:109766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c75e00/0x96d0c9b8c9a1f818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201647.597859:0:109766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc108c75e00/0x96d0c9b8c9a1f818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201647.597868:0:109766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc108c75e00/0x96d0c9b8c9a1f818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201647.597902:0:109766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1259b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715512960:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201647.597942:0:109766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201647.597977:0:109766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005f4e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788201647.598220:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715512960 00000100:00100000:2.0:1788201647.598227:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715512960 00000100:00100000:2.0:1788201647.598271:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788201647.598281:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+6:109766:x1875060715512960:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201647.598293:0:109774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201647.598309:0:109774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140d58400/0x96d0c9b8c9a1f81f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f818 expref: -99 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.598331:0:109774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140d58400/0x96d0c9b8c9a1f81f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f818 expref: 7 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.598340:0:109774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140d58400/0x96d0c9b8c9a1f81f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f818 expref: 7 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.598361:0:109774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58400, rc 0) 00000100:00100000:2.0:1788201647.598408:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+7:109766:x1875060715512960:12345-0@lo:101:mount.lustre.0 Request processed in 128us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201647.598414:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788201647.598490:0:109766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1259b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715512960:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201647.598505:0:109766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc108c75e00/0x96d0c9b8c9a1f818 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f81f expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.598513:0:109766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc108c75e00/0x96d0c9b8c9a1f818 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f81f expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201647.598540:0:109766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788201647.598554:0:109766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c75e00/0x96d0c9b8c9a1f818 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f81f expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.598561:0:109766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc108c75e00/0x96d0c9b8c9a1f818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f81f expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201647.598568:0:109766:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788201647.598573:0:109766:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788201647.598577:0:109766:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8dc12b6ba000 10000000:01000000:1.0:1788201647.598580:0:109766:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788201647.598583:0:109766:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788201647.598585:0:109766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788201647.598600:0:109766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed800/0x96d0c9b8c9a1f826 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.598608:0:109766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed800/0x96d0c9b8c9a1f826 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.598626:0:109766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed800/0x96d0c9b8c9a1f826 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201647.598640:0:109766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715513088:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201647.598668:0:109766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201647.598688:0:109766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005c6c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201647.598802:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715513088 00000100:00100000:2.0:1788201647.598807:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715513088 00000100:00100000:2.0:1788201647.598827:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788201647.598833:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+7:109766:x1875060715513088:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201647.598840:0:109774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201647.598850:0:109774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140d58000/0x96d0c9b8c9a1f82d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f826 expref: -99 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.598863:0:109774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140d58000/0x96d0c9b8c9a1f82d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f826 expref: 8 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.598871:0:109774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140d58000/0x96d0c9b8c9a1f82d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f826 expref: 8 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.598878:0:109774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58000, rc 0) 00000100:00100000:2.0:1788201647.598926:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:109766:x1875060715513088:12345-0@lo:101:mount.lustre.0 Request processed in 93us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201647.598933:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788201647.599009:0:109766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715513088:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201647.599066:0:109766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed800/0x96d0c9b8c9a1f826 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f82d expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.599074:0:109766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed800/0x96d0c9b8c9a1f826 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f82d expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201647.599124:0:109766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715513216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201647.599151:0:109766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201647.599166:0:109766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005c6c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201647.599354:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715513216 00000100:00100000:2.0:1788201647.599358:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715513216 00000100:00100000:2.0:1788201647.599379:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788201647.599386:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:109766:x1875060715513216:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201647.599598:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+9:109766:x1875060715513216:12345-0@lo:501:mount.lustre.0 Request processed in 212us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201647.599614:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788201647.599775:0:109766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715513216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201647.599806:0:109766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715513344:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201647.599848:0:109766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201647.599872:0:109766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005c6c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201647.601116:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715513344 00000100:00100000:3.0:1788201647.601126:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715513344 00000100:00100000:3.0:1788201647.601168:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788201647.601177:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+9:109766:x1875060715513344:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201647.601895:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+9:3655:x1875060715512448:12345-0@lo:253:kworker.0 Request processed in 60747us (92203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201647.601904:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:3.0:1788201647.602765:0:3655:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788201647.602769:0:3655:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788201647.602771:0:3655:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201647.602772:0:3655:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201647.602774:0:3655:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201647.602775:0:3655:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201647.602777:0:3655:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788201647.602778:0:3655:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201647.602780:0:3655:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788201647.602796:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715512448:0@lo:253:kworker.0 00000100:00100000:2.0:1788201647.604075:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:109766:x1875060715513344:12345-0@lo:503:mount.lustre.0 Request processed in 2894us (4222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201647.604087:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788201647.609822:0:109766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715513344:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201647.617946:0:109779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:109779:1875060715513472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201647.621471:0:109779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201647.621546:0:109779:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc108cfccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201647.621696:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715513472 00000100:00100000:3.0:1788201647.621706:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715513472 00000100:00100000:3.0:1788201647.621774:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788201647.621784:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+8:109779:x1875060715513472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201647.622812:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+8:109779:x1875060715513472:12345-0@lo:502:llog_process_th.0 Request processed in 1026us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201647.622822:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788201647.622976:0:109779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:109779:1875060715513472:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201647.623039:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201647.623052:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201647.623055:0:109779:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788201647.623060:0:109779:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788201647.623063:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201647.623077:0:109779:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8dc004044d28) 00000020:00000080:0.0:1788201647.623099:0:109779:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:0.0:1788201647.623104:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788201647.623185:0:109779:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788201647.623192:0:109779:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1f83b 00000020:00000080:0.0:1788201647.623408:0:109779:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788201647.623412:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201647.623417:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201647.623418:0:109779:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788201647.623421:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201647.623425:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201647.623432:0:109779:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788201647.623436:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201647.623445:0:109779:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8dc1401b3370) 00000020:00000080:0.0:1788201647.623458:0:109779:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:0.0:1788201647.623462:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788201647.623464:0:109779:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788201647.623467:0:109779:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788201647.623473:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788201647.623516:0:109779:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc12b6ba000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788201647.623543:0:109779:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8dc1401b4d28) 00000020:00000080:0.0:1788201647.623554:0:109779:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:0.0:1788201647.623606:0:109779:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788201647.623610:0:109779:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1f850 00000020:00000080:0.0:1788201647.623709:0:109779:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788201647.623715:0:109779:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788201647.623720:0:109779:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x96d0c9b8c9a1f857 00080000:01000000:0.0:1788201647.623724:0:109779:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788201647.623728:0:109779:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1f85e 00010000:00010000:0.0:1788201647.764355:0:109779:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:0.0:1788201647.764506:0:109779:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 128849018925 srv lr: 133143986176 lx: 0 gen 25 00000001:00080000:0.0:1788201647.764555:0:109779:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 6e293f14-c501-4bc5-9dd4-a18ef02756b4 idx: 2 lr: 128849018926 srv lr: 133143986176 lx: 0 gen 24 00000001:00000004:0.0:1788201647.764579:0:109779:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 32, last_transno is 133143986176 00000001:00080000:0.0:1788201647.766211:0:109779:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:0.0:1788201647.766279:0:109779:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc125ae4d80: xid 1875060695590656, transno 133143986190, client gen 24, slot idx 0 00000001:00080000:0.0:1788201647.766289:0:109779:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc125ae4180: xid 1875060695592448, transno 133143986191, client gen 24, slot idx 1 00000001:00080000:0.0:1788201647.766294:0:109779:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc125ae4780: xid 1875060715497856, transno 133143986193, client gen 25, slot idx 2 00000001:00080000:0.0:1788201647.766298:0:109779:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc125ae4b40: xid 1875060715497600, transno 133143986192, client gen 25, slot idx 3 00000001:00080000:0.0:1788201647.766303:0:109779:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc10647eb40: xid 1875060695484032, transno 124554051729, client gen 24, slot idx 4 00000001:00080000:0.0:1788201647.766307:0:109779:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc10647ef00: xid 1875060695483008, transno 124554051723, client gen 24, slot idx 5 00000001:00080000:0.0:1788201647.766320:0:109779:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8dc10647ecc0: xid 1875060695483008, transno 124554051724, client gen 24, slot idx 6 00000020:00000080:0.0:1788201647.768292:0:109779:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8dc1401b19b8) 00000020:00000080:0.0:1788201647.768322:0:109779:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type qmt with refcount 2 00080000:01000000:0.0:1788201647.768413:0:109779:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788201647.768420:0:109779:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1f87a 00000020:00000080:2.0:1788201647.776311:0:109779:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788201647.798501:0:109779:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x96d0c9b8c9a1f881 00000020:00000080:2.0:1788201647.798941:0:109779:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788201647.798951:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201647.798959:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201647.798960:0:109779:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788201647.798963:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788201647.798967:0:109779:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1788201647.798968:0:109779:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201647.798969:0:109779:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201647.798971:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788201647.798974:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201647.798975:0:109779:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788201647.798978:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201647.798983:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201647.798984:0:109779:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788201647.798989:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788201647.799059:0:109779:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788201647.799077:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201647.799080:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201647.799082:0:109779:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788201647.799084:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788201647.799096:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201647.799098:0:109779:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788201647.799101:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788201647.799107:0:109779:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:00000080:2.0:1788201647.799130:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201647.799145:0:109779:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8dc0027d19b8) 00000020:00000080:2.0:1788201647.799163:0:109779:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788201647.799168:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788201647.799224:0:109779:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788201647.799229:0:109779:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788201647.799236:0:109779:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1f88f 00010000:00080000:2.0:1788201647.799267:0:109779:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc10603c000@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:2.0:1788201647.800964:0:109779:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1788201647.801507:0:109779:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788201647.801518:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788201647.801548:0:109779:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788201647.801568:0:109779:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1f896 00000100:00080000:2.0:1788201647.801578:0:109779:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788201647.801583:0:109779:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8dc10603c000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201647.801617:0:109779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc007158700 x1875060715513600/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201647.801637:0:109779:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788201647.801684:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788201647.801688:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201647.801690:0:109779:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788201647.801692:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788201647.801695:0:109779:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1788201647.801697:0:109779:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201647.801699:0:109779:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788201647.801700:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788201647.801702:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201647.801709:0:109779:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788201647.801713:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788201647.801716:0:109779:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788201647.801720:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788201647.801721:0:109779:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788201647.801724:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788201647.801728:0:109779:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000100:00100000:0.0:1788201647.801986:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715513600:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788201647.802074:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201647.802524:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715513600 00000100:00100000:1.0:1788201647.802532:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715513600 00000100:00100000:1.0:1788201647.802577:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788201647.802584:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715513600:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788201647.802619:0:99776:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4499 last 0 00000020:00000080:1.0:1788201647.802665:0:99776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1f89d 00000004:00100000:1.0:1788201647.802680:0:99776:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788201647.802780:0:99776:0:(import.c:65:import_set_state_nolock()) ffff8dc0053a5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201647.802839:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715513600:12345-0@lo:38:llog_process_th.0 Request processed in 254us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201647.802848:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788201647.802924:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788201647.802932:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 20 00000100:00080000:1.0:1788201647.802939:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788201647.802943:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788201647.802946:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc10603c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788201647.802952:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715513600:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788201647.804176:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201647.804183:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201647.804186:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201647.804191:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4498 00000100:00080000:3.0:1788201647.804195:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201647.804201:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc11ccfb000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201647.804230:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc1259b2a00 x1875060715513728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201647.804272:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201647.804275:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201647.804277:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201647.804281:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4498 00000100:00080000:3.0:1788201647.804283:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201647.804286:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc1401c3800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201647.804300:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc14014ca80 x1875060715513984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201647.804317:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201647.804320:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201647.804321:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201647.804325:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4498 00000100:00080000:3.0:1788201647.804334:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201647.804338:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc11d439000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201647.804352:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc14014d180 x1875060715514240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201647.804385:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788201647.804389:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788201647.804391:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788201647.804394:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4498 00000100:00080000:3.0:1788201647.804396:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788201647.804400:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc1401c2000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201647.804411:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13a91ed80 x1875060715514624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201647.804445:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1259b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715513856:0@lo:400:kworker.0 00000100:00100000:3.0:1788201647.804496:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201647.804543:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201647.804549:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715514112:0@lo:400:kworker.0 00000100:00100000:3.0:1788201647.804570:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201647.804604:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715514368:0@lo:400:kworker.0 00000100:00100000:3.0:1788201647.804631:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201647.804650:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201647.804656:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715514496:0@lo:400:kworker.0 00000100:00100000:3.0:1788201647.804693:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201647.804729:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715513856 00000100:00100000:3.0:1788201647.804735:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715513856 00000100:00100000:3.0:1788201647.804782:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715514112 00000100:00100000:3.0:1788201647.804792:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715514112 00000100:00100000:3.0:1788201647.804820:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788201647.804828:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715513856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201647.804875:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715513856:12345-0@lo:400:kworker.0 Request processed in 47us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201647.804881:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788201647.804895:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788201647.804901:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715514112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201647.804927:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715514112:12345-0@lo:400:kworker.0 Request processed in 26us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201647.804932:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788201647.804955:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715514368 00000100:00100000:3.0:1788201647.804959:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715514368 00000100:00100000:3.0:1788201647.804980:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715514496 00000100:00100000:3.0:1788201647.804982:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715514496 00000100:00100000:3.0:1788201647.805000:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788201647.805006:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715514368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201647.805629:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715514368:12345-0@lo:400:kworker.0 Request processed in 621us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201647.805637:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788201647.805652:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788201647.805726:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715514496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201647.805767:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715514496:12345-0@lo:400:kworker.0 Request processed in 45us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201647.805774:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788201647.805826:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715514112:0@lo:400:kworker.0 00000100:00100000:3.0:1788201647.805849:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1259b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715513856:0@lo:400:kworker.0 00000100:00100000:3.0:1788201647.805883:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715514496:0@lo:400:kworker.0 00000100:00100000:3.0:1788201647.805892:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715514368:0@lo:400:kworker.0 00000100:00100000:3.0:1788201647.805908:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1259b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715513728:0@lo:38:kworker.0 00000100:00100000:3.0:1788201647.805933:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201647.805952:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715513984:0@lo:38:kworker.0 00000100:00100000:3.0:1788201647.805970:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201647.805983:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715514240:0@lo:38:kworker.0 00000100:00100000:3.0:1788201647.805998:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201647.806134:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715514240 00000100:00100000:0.0:1788201647.806139:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715514240 00000100:00100000:0.0:1788201647.806155:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788201647.806160:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715514240:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788201647.806759:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715514624:0@lo:38:kworker.0 00000100:00100000:3.0:1788201647.806791:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788201647.814653:0:109779:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788201647.814680:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788201647.814700:0:109779:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8dc0027d4d28) 00000020:00000080:2.0:1788201647.814730:0:109779:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788201647.814745:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788201647.814854:0:109779:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788201647.814861:0:109779:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788201647.814868:0:109779:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1f8ab 00010000:00080000:2.0:1788201647.814903:0:109779:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc12b7a5800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:2.0:1788201647.815151:0:109779:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:2.0:1788201647.815476:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715513728 00000100:00100000:2.0:1788201647.815483:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715513728 00000100:00100000:2.0:1788201647.815518:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715513984 00000100:00100000:2.0:1788201647.815523:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715513984 00000100:00100000:2.0:1788201647.815533:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715514624 00000100:00100000:2.0:1788201647.815535:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715514624 00000100:00100000:2.0:1788201647.815551:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788201647.815559:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715513728:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788201647.815646:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715513728:12345-0@lo:38:kworker.0 Request processed in 86us (9711us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788201647.815654:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788201647.815672:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788201647.815676:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715513984:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788201647.815706:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715513984:12345-0@lo:38:kworker.0 Request processed in 29us (9734us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788201647.815720:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788201647.815733:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788201647.815738:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715514624:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788201647.815779:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715514624:12345-0@lo:38:kworker.0 Request processed in 40us (8988us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788201647.815785:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788201647.815815:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201647.815829:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715514752:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201647.815871:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201647.816418:0:99776:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 2 min 2 max 16 00000100:00100000:1.0:1788201647.816428:0:99776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_002' 00000100:00100000:1.0:1788201647.816550:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715514752 00000100:00100000:1.0:1788201647.816556:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715514752 00000100:00100000:1.0:1788201647.816680:0:109785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788201647.816688:0:109785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715514752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201647.816720:0:109785:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445376000 avail 1299136512 00000100:00100000:1.0:1788201647.816782:0:109785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715514752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201647.816788:0:109785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788201647.816832:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715514752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201647.819245:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715514240:12345-0@lo:38:kworker.0 Request processed in 13075us (13236us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788201647.819259:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000040:01000000:1.0:1788201647.819457:0:109779:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788201647.819499:0:109779:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788201647.819917:0:109779:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 30, last_idx 31 00000040:00080000:1.0:1788201647.821722:0:109779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201647.821785:0:109779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].32, 64 off10240 00000100:00080000:3.0:1788201647.828853:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201647.828866:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788201647.828870:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715514240:0@lo:38:kworker.0 00000100:00080000:3.0:1788201647.828885:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201647.828888:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788201647.828891:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715514624:0@lo:38:kworker.0 00000100:00080000:3.0:1788201647.828922:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201647.828926:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788201647.828929:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1259b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715513728:0@lo:38:kworker.0 00000100:00080000:3.0:1788201647.828940:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201647.828943:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788201647.828959:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715513984:0@lo:38:kworker.0 00000040:00080000:2.0:1788201647.831794:0:109779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x80:0x0].1, 64 off8256 00000040:00080000:1.0:1788201647.837867:0:109786:0:(llog.c:805:llog_process_thread()) index: 31, lh_last_idx: 32 synced_idx: 0 lgh_last_idx: 32 00000040:00080000:1.0:1788201647.837875:0:109786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x7c:0x0] at index 31 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788201647.838124:0:109786:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 31, last_idx 32 00000040:00080000:1.0:1788201647.838145:0:109786:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x7c:0x0] at index 31 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788201647.838280:0:109786:0:(llog.c:805:llog_process_thread()) index: 32, lh_last_idx: 32 synced_idx: 32 lgh_last_idx: 32 00000040:00080000:1.0:1788201647.838284:0:109786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x80:0x0] at index 32 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788201647.840257:0:109779:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788201647.840273:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788201647.840318:0:109779:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788201647.840340:0:109779:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1f8b2 00000100:00080000:3.0:1788201647.840351:0:109779:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201647.840357:0:109779:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dc12b7a5800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201647.840391:0:109779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc1259b2a00 x1875060715514880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788201647.840452:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1259b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715514880:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788201647.840535:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201647.840631:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715514880 00000100:00100000:2.0:1788201647.840638:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715514880 00000100:00100000:2.0:1788201647.840686:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788201647.840694:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3654:x1875060715514880:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1788201647.840719:0:101191:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4499 last 0 00000020:00000080:2.0:1788201647.840745:0:101191:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1f8b9 00002000:00100000:2.0:1788201647.840769:0:101191:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8dc12b7a7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788201647.840773:0:101191:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788201647.840775:0:101191:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788201647.840848:0:101191:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788201647.840871:0:101191:0:(import.c:65:import_set_state_nolock()) ffff8dc12b7a6000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788201647.841033:0:109779:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788201647.841117:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201647.841122:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201647.841124:0:109779:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788201647.841128:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788201647.841130:0:109779:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1788201647.841132:0:109779:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201647.841133:0:109779:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201647.841134:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788201647.841137:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201647.841139:0:109779:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788201647.841141:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788201647.841145:0:109779:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788201647.841148:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201647.841150:0:109779:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788201647.841152:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788201647.841155:0:109779:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:3.0:1788201647.841181:0:109779:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788201647.841186:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201647.841198:0:109779:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8dc12563b370) 00000020:00000080:3.0:1788201647.841214:0:109779:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:3.0:1788201647.841233:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788201647.841296:0:109779:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788201647.841302:0:109779:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788201647.841311:0:109779:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96d0c9b8c9a1f8c7 00010000:00080000:3.0:1788201647.841337:0:109779:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc001e2e800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:3.0:1788201647.841550:0:109779:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:3.0:1788201647.841622:0:109779:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788201647.841637:0:109779:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788201647.843254:0:109779:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 30, last_idx 31 00000040:00080000:3.0:1788201647.844764:0:109779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201647.844803:0:109779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].32, 64 off10240 00000040:00080000:0.0:1788201647.846612:0:109779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x82:0x0].1, 64 off8256 00000100:00100000:2.0:1788201647.849056:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715514880:12345-0@lo:8:llog_process_th.0 Request processed in 8351us (8511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201647.849071:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000040:00080000:3.0:1788201647.850365:0:109788:0:(llog.c:805:llog_process_thread()) index: 31, lh_last_idx: 32 synced_idx: 0 lgh_last_idx: 32 00000040:00080000:3.0:1788201647.850372:0:109788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x7e:0x0] at index 31 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1788201647.850585:0:109788:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 31, last_idx 32 00000040:00080000:3.0:1788201647.850607:0:109788:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x7e:0x0] at index 31 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1788201647.850765:0:109788:0:(llog.c:805:llog_process_thread()) index: 32, lh_last_idx: 32 synced_idx: 32 lgh_last_idx: 32 00000040:00080000:3.0:1788201647.850769:0:109788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x82:0x0] at index 32 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788201647.852208:0:109779:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788201647.852223:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788201647.852264:0:109779:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788201647.852288:0:109779:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1f8ce 00000100:00080000:0.0:1788201647.852301:0:109779:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788201647.852308:0:109779:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dc001e2e800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201647.852347:0:109779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005d56a00 x1875060715515008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201647.852365:0:109779:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788201647.852429:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201647.852433:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201647.852435:0:109779:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788201647.852446:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201647.852451:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201647.852452:0:109779:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788201647.852456:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788201647.852458:0:109779:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788201647.852460:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201647.852463:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201647.852464:0:109779:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788201647.852467:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201647.852469:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201647.852471:0:109779:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788201647.852475:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788201647.852482:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201647.852485:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201647.852486:0:109779:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000020:01000000:0.0:1788201647.852489:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788201647.852492:0:109779:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #43 00000020:01000000:0.0:1788201647.852493:0:109779:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788201647.852494:0:109779:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000100:00100000:0.0:1788201647.852535:0:109779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d57b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:109779:1875060715515136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201647.852612:0:109779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201647.852647:0:109779:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007566240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201647.853291:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715515136 00000100:00100000:2.0:1788201647.853300:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715515136 00000100:00100000:2.0:1788201647.853364:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788201647.853373:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:109779:x1875060715515136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201647.854041:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:109779:x1875060715515136:12345-0@lo:502:llog_process_th.0 Request processed in 644us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201647.854050:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788201647.854202:0:109779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d57b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:109779:1875060715515136:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788201647.854235:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788201647.854242:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201647.854244:0:109779:0:(obd_config.c:1563:class_process_config()) marker 43 (0x6) lustre-MDT0000-m new lustre.pool_134 00000020:01000000:0.0:1788201647.854248:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788201647.854251:0:109779:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #46 00000020:01000000:0.0:1788201647.854253:0:109779:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788201647.854254:0:109779:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788201647.854256:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788201647.854258:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201647.854260:0:109779:0:(obd_config.c:1563:class_process_config()) marker 46 (0x6) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:01000000:0.0:1788201647.854269:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201647.854272:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201647.854273:0:109779:0:(obd_config.c:1563:class_process_config()) marker 47 (0x1) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:0.0:1788201647.854276:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: ce022 00000020:01000000:0.0:1788201647.854286:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788201647.854288:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201647.854289:0:109779:0:(obd_config.c:1563:class_process_config()) marker 47 (0x2) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:01000000:0.0:1788201647.854291:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788201647.854294:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201647.854295:0:109779:0:(obd_config.c:1563:class_process_config()) marker 50 (0x1) lustre-MDT0000-m del lustre.pool_134 00000020:00000080:0.0:1788201647.854298:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: ce023 00000100:00100000:0.0:1788201647.854327:0:109779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d57b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:109779:1875060715515264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201647.854369:0:109779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201647.854412:0:109779:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc007566240 going to sleep for 11 seconds 00000100:00100000:2.0:1788201647.854435:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715515264 00000100:00100000:2.0:1788201647.854440:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715515264 00000100:00100000:2.0:1788201647.854477:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788201647.854485:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+8:109779:x1875060715515264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201647.854701:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+8:109779:x1875060715515264:12345-0@lo:502:llog_process_th.0 Request processed in 216us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201647.854709:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788201647.854767:0:109779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d57b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:109779:1875060715515264:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201647.854787:0:109779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201647.854792:0:109779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201647.854794:0:109779:0:(obd_config.c:1563:class_process_config()) marker 50 (0x2) lustre-MDT0000-m del lustre.pool_134 00000040:00080000:3.0:1788201647.854798:0:109779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000020:01000000:2.0:1788201647.854935:0:109766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-58 (rc=0) 10000000:01000000:2.0:1788201647.854961:0:109766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788201647.854981:0:109766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed800/0x96d0c9b8c9a1f826 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f82d expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.854992:0:109766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed800/0x96d0c9b8c9a1f826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f82d expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201647.855001:0:109766:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc12b6ba000 from 1 10000000:01000000:2.0:1788201647.855003:0:109766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788201647.855052:0:109766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59c00/0x96d0c9b8c9a1f8d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.855060:0:109766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc140d59c00/0x96d0c9b8c9a1f8d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.855079:0:109766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc140d59c00/0x96d0c9b8c9a1f8d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201647.855094:0:109766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715515392:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201647.855123:0:109766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201647.855140:0:109766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005dfdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788201647.855294:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715515392 00000100:00100000:2.0:1788201647.855307:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715515392 00000100:00100000:2.0:1788201647.855470:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788201647.855479:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+8:109766:x1875060715515392:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201647.855489:0:109774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201647.855503:0:109774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1f8dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f8d5 expref: -99 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.855650:0:109774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1f8dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f8d5 expref: 9 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.855663:0:109774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1f8dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f8d5 expref: 9 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.855672:0:109774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59000, rc 0) 00000100:00100000:2.0:1788201647.855711:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+9:109766:x1875060715515392:12345-0@lo:101:mount.lustre.0 Request processed in 233us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201647.855717:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788201647.855816:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788201647.855825:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 4 00000100:00080000:1.0:1788201647.855832:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788201647.855837:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788201647.855841:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc12b7a5800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788201647.855854:0:3654:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788201647.855861:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1259b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715514880:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788201647.855947:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201647.855955:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715515520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201647.855984:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201647.856787:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715515008:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788201647.856834:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788201647.856883:0:109786:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788201647.856958:0:109786:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 4499328941566ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788201647.856965:0:109786:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788201647.857447:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715515520 00000100:00100000:1.0:1788201647.857454:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715515520 00000100:00100000:1.0:1788201647.857507:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788201647.857515:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715515520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201647.857535:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1788201647.857585:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715515520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (1599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201647.857607:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:1.0:1788201647.857630:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201647.857820:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715515520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201647.861200:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715515008 00000100:00100000:3.0:1788201647.861215:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715515008 00000004:00080000:0.0:1788201647.861325:0:109767:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788201647.862363:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788201647.862375:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3654:x1875060715515008:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1788201647.862414:0:101192:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4499 last 0 00000020:00000080:3.0:1788201647.862460:0:101192:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96d0c9b8c9a1f8e3 00002000:00100000:3.0:1788201647.862479:0:101192:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8dc001e29800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788201647.862500:0:101192:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788201647.862503:0:101192:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788201647.862584:0:101192:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788201647.862610:0:101192:0:(import.c:65:import_set_state_nolock()) ffff8dc001e28800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201647.862961:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3654:x1875060715515008:12345-0@lo:8:llog_process_th.0 Request processed in 586us (6124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201647.862969:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788201647.863100:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788201647.863110:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788201647.863118:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788201647.863124:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788201647.863126:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc001e2e800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788201647.863143:0:3654:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788201647.863149:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715515008:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1788201647.864701:0:109788:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788201647.864812:0:109788:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 4499336794665ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788201647.864819:0:109788:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788201647.864916:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1259b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715515648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201647.864984:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201647.865516:0:109766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715515392:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201647.865540:0:109766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc140d59c00/0x96d0c9b8c9a1f8d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f8dc expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.865570:0:109766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc140d59c00/0x96d0c9b8c9a1f8d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f8dc expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201647.865812:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715515648 00000100:00100000:3.0:1788201647.865819:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715515648 00000100:00100000:3.0:1788201647.865869:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788201647.865878:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715515648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201647.865910:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788201647.865962:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715515648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201647.865969:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788201647.866138:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1259b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715515648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201647.866217:0:109766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715515776:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788201647.866259:0:109766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201647.866287:0:109766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005dfdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201647.866355:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715515776 00000100:00100000:0.0:1788201647.866360:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715515776 00000100:00100000:0.0:1788201647.866401:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788201647.866407:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+9:109766:x1875060715515776:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788201647.866421:0:109773:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788201647.866435:0:109773:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788201647.866439:0:109773:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788201647.866442:0:109773:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788201647.866444:0:109773:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 143 00000100:00100000:0.0:1788201647.866531:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+9:109766:x1875060715515776:12345-0@lo:256:mount.lustre.0 Request processed in 123us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201647.866538:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788201647.866783:0:109766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715515776:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788201647.867445:0:109766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788201647.868087:0:109766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59c00/0x96d0c9b8c9a1f8d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f8dc expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.868100:0:109766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc140d59c00/0x96d0c9b8c9a1f8d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f8dc expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201647.870318:0:109766:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc12b6ba000 from 1 10000000:01000000:2.0:1788201647.870327:0:109766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788201647.870381:0:109766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59200/0x96d0c9b8c9a1f8ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.870393:0:109766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc140d59200/0x96d0c9b8c9a1f8ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.870404:0:109766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc140d59200/0x96d0c9b8c9a1f8ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201647.870429:0:109766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715515904:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201647.870502:0:109766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201647.870564:0:109766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005dfdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201647.870619:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715515904 00000100:00100000:0.0:1788201647.870628:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715515904 00000100:00100000:0.0:1788201647.870689:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788201647.870698:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+9:109766:x1875060715515904:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201647.870710:0:109774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201647.870724:0:109774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0056d7800/0x96d0c9b8c9a1f8f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f8ea expref: -99 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.870745:0:109774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0056d7800/0x96d0c9b8c9a1f8f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f8ea expref: 10 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.870766:0:109774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0056d7800/0x96d0c9b8c9a1f8f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f8ea expref: 10 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.870774:0:109774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d7800, rc 0) 00000100:00100000:0.0:1788201647.870849:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:109766:x1875060715515904:12345-0@lo:101:mount.lustre.0 Request processed in 148us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201647.870858:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1788201647.870945:0:109767:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788201647.871013:0:109766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715515904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201647.871052:0:109766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc140d59200/0x96d0c9b8c9a1f8ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f8f1 expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.871062:0:109766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc140d59200/0x96d0c9b8c9a1f8ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f8f1 expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201647.871271:0:109766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715516032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201647.871301:0:109766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201647.871323:0:109766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005dfdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201647.871627:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715516032 00000100:00100000:0.0:1788201647.871633:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715516032 00000100:00100000:0.0:1788201647.871732:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788201647.871741:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+10:109766:x1875060715516032:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201647.871952:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+10:109766:x1875060715516032:12345-0@lo:501:mount.lustre.0 Request processed in 212us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201647.871960:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788201647.872743:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201647.874952:0:109766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715516032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788201647.875050:0:109766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715516160:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788201647.875260:0:109766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201647.875628:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715516160 00000100:00100000:0.0:1788201647.875635:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715516160 00000100:00100000:0.0:1788201647.875740:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788201647.875761:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:109766:x1875060715516160:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201647.875881:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:109766:x1875060715516160:12345-0@lo:503:mount.lustre.0 Request processed in 132us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201647.875902:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788201647.877847:0:109766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005dfdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201647.877893:0:109766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715516160:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201647.891868:0:109790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1259b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:109790:1875060715516288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201647.891975:0:109790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201647.892064:0:109790:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125a960c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201647.892229:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715516288 00000100:00100000:0.0:1788201647.892238:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715516288 00000100:00100000:0.0:1788201647.892297:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788201647.892307:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:109790:x1875060715516288:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201647.893004:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:109790:x1875060715516288:12345-0@lo:502:llog_process_th.0 Request processed in 696us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201647.893200:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788201647.893368:0:109790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1259b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:109790:1875060715516288:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788201647.893406:0:109790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201647.893417:0:109790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201647.893420:0:109790:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788201647.893428:0:109790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc12b6ba000 00000020:00000080:3.0:1788201647.893431:0:109790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788201647.893438:0:109790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201647.893440:0:109790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201647.893442:0:109790:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788201647.893444:0:109790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201647.893446:0:109790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201647.893448:0:109790:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788201647.893451:0:109790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc12b6ba000 00000020:00000080:3.0:1788201647.893453:0:109790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788201647.893541:0:109790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1259b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:109790:1875060715516416:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201647.893591:0:109790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201647.893630:0:109790:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125a960c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201647.895810:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715516416 00000100:00100000:0.0:1788201647.895826:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715516416 00000100:00100000:0.0:1788201647.895907:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788201647.895922:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:109790:x1875060715516416:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201647.896299:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+10:109790:x1875060715516416:12345-0@lo:502:llog_process_th.0 Request processed in 381us (2707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201647.896316:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788201647.896426:0:109790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1259b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:109790:1875060715516416:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788201647.896465:0:109790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201647.896474:0:109790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201647.896477:0:109790:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788201647.896481:0:109790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788201647.900951:0:109766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1788201647.901004:0:109766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201647.901161:0:109766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59200/0x96d0c9b8c9a1f8ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f8f1 expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.901175:0:109766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc140d59200/0x96d0c9b8c9a1f8ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f8f1 expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201647.901235:0:109766:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788201647.901238:0:109766:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dc12b6ba000 10000000:01000000:0.0:1788201647.901241:0:109766:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dc12b6ba000 10000000:01000000:0.0:1788201647.901244:0:109766:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788201647.901250:0:109766:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc12b6ba000 from 1 10000000:01000000:0.0:1788201647.901253:0:109766:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201647.901291:0:109766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7200/0x96d0c9b8c9a1f8f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.901300:0:109766:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7200/0x96d0c9b8c9a1f8f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.901312:0:109766:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7200/0x96d0c9b8c9a1f8f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201647.901336:0:109766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715516544:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788201647.901406:0:109766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201647.901506:0:109766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105d390c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201647.907174:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715516544 00000100:00100000:1.0:1788201647.907189:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715516544 00000100:00100000:1.0:1788201647.907258:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788201647.907268:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:109766:x1875060715516544:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201647.907286:0:109774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201647.907304:0:109774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f8ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f8f8 expref: -99 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.907332:0:109774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f8ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f8f8 expref: 11 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.907343:0:109774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc1064ecc00/0x96d0c9b8c9a1f8ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f8f8 expref: 11 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.907352:0:109774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc1064ecc00, rc 0) 00000100:00100000:1.0:1788201647.907432:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:109766:x1875060715516544:12345-0@lo:101:mount.lustre.0 Request processed in 166us (6025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201647.907440:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788201647.908123:0:109766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715516544:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201647.908145:0:109766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7200/0x96d0c9b8c9a1f8f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f8ff expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201647.908156:0:109766:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7200/0x96d0c9b8c9a1f8f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f8ff expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201647.909283:0:109766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715516672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201647.909347:0:109766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201647.909452:0:109766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f600c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201647.917810:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715516672 00000100:00100000:2.0:1788201647.917825:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715516672 00000100:00100000:3.0:1788201647.917939:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788201647.917951:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:109766:x1875060715516672:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201647.918177:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:109766:x1875060715516672:12345-0@lo:501:mount.lustre.0 Request processed in 226us (8828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201647.918203:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788201647.918489:0:109766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715516672:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201647.918546:0:109766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1259b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715516800:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201647.918597:0:109766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201647.918646:0:109766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f63000 going to sleep for 11 seconds 00000100:00100000:3.0:1788201647.918670:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715516800 00000100:00100000:3.0:1788201647.918675:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715516800 00000100:00100000:3.0:1788201647.918705:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201647.918713:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:109766:x1875060715516800:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201647.918820:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:109766:x1875060715516800:12345-0@lo:503:mount.lustre.0 Request processed in 108us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201647.918828:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788201647.918870:0:109766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1259b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715516800:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201647.922000:0:109793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:109793:1875060715516928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788201647.922095:0:109793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201647.922148:0:109793:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125a96780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201647.922217:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715516928 00000100:00100000:3.0:1788201647.922224:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715516928 00000100:00100000:3.0:1788201647.922269:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788201647.922279:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:109793:x1875060715516928:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201647.922396:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:109793:x1875060715516928:12345-0@lo:502:llog_process_th.0 Request processed in 118us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201647.922405:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788201647.923741:0:109793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:109793:1875060715516928:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788201647.923845:0:109793:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788201647.923861:0:109793:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8dc1401b0000) 00000020:00000080:0.0:1788201647.924631:0:109793:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1788201647.924742:0:109793:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc12b6ba000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788201647.924757:0:109793:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc12b6ba000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788201647.924760:0:109793:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc12b6ba000 4 00010000:00080000:0.0:1788201647.924795:0:109793:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc106038800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.120@tcp at head 00010000:00010000:1.0:1788201647.929586:0:109793:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1788201647.930187:0:109793:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788201647.930234:0:109793:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788201647.930248:0:109793:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x96d0c9b8c9a1f90d 00000100:00080000:1.0:1788201647.930258:0:109793:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201647.930264:0:109793:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dc106038800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201647.930301:0:109793:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc005257b80 x1875060715517056/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201647.930562:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715517056:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788201647.930637:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201647.931706:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715517056 00000100:00100000:2.0:1788201647.931717:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715517056 00000100:00100000:2.0:1788201647.931782:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788201647.931793:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715517056:12345-0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788201647.931995:0:109793:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788201647.934989:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715517056:12345-0@lo:38:llog_process_th.0 Request processed in 3188us (4342us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788201647.935030:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788201647.939174:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788201647.939189:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc106038800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201647.939197:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788201647.939201:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715517056:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201647.940061:0:109793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1259b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:109793:1875060715517184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201647.940159:0:109793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201647.940203:0:109793:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1065c7780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201647.940274:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715517184 00000100:00100000:2.0:1788201647.940282:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715517184 00000100:00100000:2.0:1788201647.940338:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788201647.940350:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:109793:x1875060715517184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788201647.940495:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:109793:x1875060715517184:12345-0@lo:502:llog_process_th.0 Request processed in 145us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201647.940503:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788201647.940773:0:109793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1259b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:109793:1875060715517184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201647.940820:0:109793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:109793:1875060715517312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788201647.940859:0:109793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201647.941171:0:109793:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105d39900 going to sleep for 11 seconds 00000100:00100000:3.0:1788201647.941246:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715517312 00000100:00100000:3.0:1788201647.941258:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715517312 00000100:00100000:3.0:1788201647.941301:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788201647.941309:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:109793:x1875060715517312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788201647.941398:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:109793:x1875060715517312:12345-0@lo:502:llog_process_th.0 Request processed in 89us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201647.941405:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788201647.941782:0:109793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c9b18af6-fecc-4172-82c2-66531890fe11:109793:1875060715517312:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788201647.941808:0:109793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:3.0:1788201647.942181:0:109766:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:3.0:1788201647.942205:0:109766:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201647.942231:0:109766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7200/0x96d0c9b8c9a1f8f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f8ff expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201647.942243:0:109766:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7200/0x96d0c9b8c9a1f8f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f8ff expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788201647.942296:0:109766:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788201647.942298:0:109766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201647.942299:0:109766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201647.942300:0:109766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201647.942301:0:109766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201647.942303:0:109766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201647.942304:0:109766:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201647.942306:0:109766:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201647.942308:0:109766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201647.942309:0:109766:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788201647.942312:0:109766:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788201647.942315:0:109766:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788201647.942316:0:109766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788201647.942317:0:109766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201647.942318:0:109766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201647.942319:0:109766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201647.942321:0:109766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201647.942322:0:109766:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201647.942323:0:109766:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788201647.942324:0:109766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201647.942330:0:109766:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788201647.942346:0:109766:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788201647.942359:0:109766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1259b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715517440:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788201647.942401:0:109766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201647.942437:0:109766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1065c7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201647.942527:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715517440 00000100:00100000:0.0:1788201647.942607:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715517440 00000100:00100000:0.0:1788201647.942651:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788201647.942768:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:109766:x1875060715517440:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788201647.942792:0:109773:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788201647.942806:0:109773:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788201647.949835:0:109773:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788201647.949854:0:109773:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788201647.950271:0:109777:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788201647.950278:0:109777:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788201647.950300:0:109777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc0056d7e00/0x96d0c9b8c9a1f914 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.950317:0:109777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1f8dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f8d5 expref: 11 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.950326:0:109777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dc0056d7e00/0x96d0c9b8c9a1f914 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.950367:0:109777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1f8dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1f8d5 expref: 11 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.950381:0:109777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1f8dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1f8d5 expref: 11 pid: 109774 timeout: 4599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201647.950396:0:109777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:109777:1875060715517568:0@lo:104: 00000100:00100000:0.0:1788201647.950464:0:109777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201647.950522:0:109777:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc105d39900 going to sleep for 11 seconds 00000100:00100000:1.0:1788201647.950852:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715517568 00000100:00100000:1.0:1788201647.950861:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715517568 00000100:00100000:1.0:1788201647.950923:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1788201647.950934:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+3:109777:x1875060715517568:12345-0@lo:104: 00010000:00010000:1.0:1788201647.950946:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc140d59c00/0x96d0c9b8c9a1f8d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1f8dc expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.951006:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201647.951219:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c9b18af6-fecc-4172-82c2-66531890fe11+3:109777:x1875060715517568:12345-0@lo:104: Request processed in 286us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201647.951228:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00010000:00010000:1.0:1788201647.951272:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201647.951278:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc140d59c00/0x96d0c9b8c9a1f8d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1f8dc expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.951286:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59c00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201647.951290:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d59c00/0x96d0c9b8c9a1f8d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1f8dc expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.951299:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc140d59c00/0x96d0c9b8c9a1f8d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1f8dc expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201647.951305:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d59c00/0x96d0c9b8c9a1f8d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1f8dc expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201647.951311:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201647.951347:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc140d59c00/0x96d0c9b8c9a1f8d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1f8dc expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.951354:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201647.951389:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc140d59c00/0x96d0c9b8c9a1f8d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1f8dc expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.951396:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc140d59c00/0x96d0c9b8c9a1f8d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1f8dc expref: -99 pid: 109766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201647.951416:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201647.951419:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201647.951419:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715517696:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201647.951423:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201647.951508:0:109777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:109777:1875060715517568:0@lo:104: 00010000:00010000:1.0:1788201647.951617:0:109777:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dc0056d7e00/0x96d0c9b8c9a1f914 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201647.956729:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201647.966197:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+11:109766:x1875060715517440:12345-0@lo:253:mount.lustre.0 Request processed in 23420us (23782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201647.966216:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788201647.968138:0:109766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc1259b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:109766:1875060715517440:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788201647.968157:0:109766:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788201647.968161:0:109766:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788201647.968163:0:109766:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788201647.968164:0:109766:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788201647.968165:0:109766:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788201647.968166:0:109766:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788201647.968167:0:109766:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788201647.968169:0:109766:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788201647.968189:0:109766:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788201647.968191:0:109766:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788201647.968193:0:109766:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788201647.968209:0:109766:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788201647.976125:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715517696 00000100:00100000:0.0:1788201647.976144:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715517696 00010000:00010000:0.0:1788201647.976187:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1f8dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1f8d5 expref: 11 pid: 109774 timeout: 4599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201647.976236:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2639 00000100:00100000:0.0:1788201647.976247:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9b18af6-fecc-4172-82c2-66531890fe11+11:3658:x1875060715517696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201647.976264:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201647.976270:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1f8dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1f8d5 expref: 11 pid: 109774 timeout: 4599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.976283:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1f8dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1f8d5 expref: 11 pid: 109774 timeout: 4599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.976302:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1f8dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1f8d5 expref: 11 pid: 109774 timeout: 4599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.976323:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dc0056d7e00/0x96d0c9b8c9a1f914 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.976331:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0056d7e00/0x96d0c9b8c9a1f914 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788201647.976349:0:6517:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.026071986s 00010000:00010000:0.0:1788201647.976353:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc0056d7e00/0x96d0c9b8c9a1f914 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.976361:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc0056d7e00/0x96d0c9b8c9a1f914 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.976381:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc0056d7e00/0x96d0c9b8c9a1f914 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.976389:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc0056d7e00/0x96d0c9b8c9a1f914 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.976395:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d7e00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201647.976399:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc0056d7e00/0x96d0c9b8c9a1f914 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.976407:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc0056d7e00/0x96d0c9b8c9a1f914 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.976433:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc0056d7e00/0x96d0c9b8c9a1f914 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201647.976443:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788201647.976470:0:109777:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dc0056d7e00/0x96d0c9b8c9a1f914 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.976482:0:109777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc0056d7e00/0x96d0c9b8c9a1f914 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201647.976490:0:109777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0056d7e00/0x96d0c9b8c9a1f914 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201647.976531:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c9b18af6-fecc-4172-82c2-66531890fe11+10:3658:x1875060715517696:12345-0@lo:103:ldlm_bl.0 Request processed in 285us (20206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201647.976561:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715517696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201647.976755:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2639 00000020:00080000:0.0:1788201647.993971:0:109766:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 77309411350 00000040:01000000:0.0:1788201647.996095:0:109766:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788201647.996356:0:109798:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 77309411350 00000020:00080000:2.0:1788201647.996360:0:109798:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 77309411350 00000040:01000000:0.0:1788201647.996574:0:109799:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788201647.996615:0:109766:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1788201647.997205:0:109800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:109800:1875060715517824:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788201647.997621:0:109766:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788201647.997674:0:109766:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788201647.998150:0:109766:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788201647.998158:0:109766:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788201647.998193:0:109766:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788201647.999295:0:109766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788201647.999897:0:109766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788201647.999947:0:109766:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788201648.000072:0:109766:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788201648.000584:0:109766:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x57:0x0] (8/32) registered 00000100:00100000:3.0:1788201648.006207:0:109800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201648.006250:0:109800:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc0074866c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201648.006401:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715517824 00000100:00100000:1.0:1788201648.006411:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715517824 00000100:00100000:1.0:1788201648.006474:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788201648.006483:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:109800:x1875060715517824:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788201648.006567:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:109800:x1875060715517824:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 85us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201648.006574:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788201648.006674:0:109800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:109800:1875060715517824:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788201648.006723:0:109800:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788201648.006775:0:109800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc14014c000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:109800:1875060715517952:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788201648.006837:0:109800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201648.006864:0:109800:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1065c7cc0 going to sleep for 11 seconds 00000040:00080000:0.0:1788201648.007114:0:109799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201648.008128:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715517952 00000100:00100000:1.0:1788201648.008138:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715517952 00000100:00100000:1.0:1788201648.008184:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788201648.008194:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0071f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:109800:x1875060715517952:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788201648.008766:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0071f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:109800:x1875060715517952:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 572us (1927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201648.008774:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788201648.008857:0:109800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc14014c000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:109800:1875060715517952:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788201648.008941:0:109800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0071f0a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:109800:1875060715518080:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788201648.008972:0:109800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201648.009004:0:109800:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1065c7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201648.009072:0:109785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715518080 00000100:00100000:1.0:1788201648.009077:0:109785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715518080 00000100:00100000:1.0:1788201648.009100:0:109785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788201648.009106:0:109785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0071f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:109800:x1875060715518080:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788201648.009163:0:109785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0071f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:109800:x1875060715518080:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 57us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201648.009169:0:109785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788201648.009235:0:109800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0071f0a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:109800:1875060715518080:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788201648.009281:0:109800:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201648.012940:0:109800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400088d4:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788201648.013057:0:109800:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 1, retries 0 00000040:00080000:0.0:1788201648.013979:0:109799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000afe0:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788201648.014073:0:109799:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:0.0:1788201648.014077:0:109799:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:2.0:1788201648.021292:0:109766:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 133143986193 00010000:00080000:2.0:1788201648.025593:0:109801:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 109801 00010000:02000000:2.0:1788201648.026427:0:109801:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:2.0:1788201648.026434:0:109801:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1788201648.026439:0:109801:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:1.0:1788201648.028210:0:109766:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788201648.028235:0:109766:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788201648.028258:0:109766:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788201648.028290:0:109766:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788201648.029245:0:109766:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788201648.029494:0:109766:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788201648.529611:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201648.724849:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201648.727873:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695598720 00000100:00100000:0.0:1788201648.727890:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695598720 00000100:00100000:0.0:1788201648.727969:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:0.0:1788201648.727980:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+5:71021:x1875060695598720:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201648.728000:0:109774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201648.728043:0:109774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0056d6600/0x96d0c9b8c9a1f91b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7870b4 expref: -99 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201648.728070:0:109774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0056d6600/0x96d0c9b8c9a1f91b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7870b4 expref: 6 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201648.728080:0:109774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0056d6600/0x96d0c9b8c9a1f91b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7870b4 expref: 6 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201648.728089:0:109774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d6600, rc 0) 00000100:00100000:0.0:1788201648.728156:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+6:71021:x1875060695598720:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 176us (3318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201648.728163:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 27 00000100:00100000:2.0:1788201648.732664:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201648.733416:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695598848 00000100:00100000:1.0:1788201648.733428:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695598848 00000100:00100000:1.0:1788201648.733502:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:1.0:1788201648.733513:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+6:71021:x1875060695598848:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788201648.733539:0:109773:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1788201648.733554:0:109773:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788201648.733558:0:109773:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1788201648.733561:0:109773:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1788201648.733564:0:109773:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1788201648.733566:0:109773:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 144 00000100:00100000:1.0:1788201648.745559:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+6:71021:x1875060695598848:12345-192.168.201.20@tcp:256:ll_cfg_requeue.0 Request processed in 12037us (12894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201648.745574:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 28 00000100:00100000:3.0:1788201648.755661:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201648.755787:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695599104 00000100:00100000:0.0:1788201648.755798:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695599104 00000100:00100000:0.0:1788201648.755855:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:0.0:1788201648.755866:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+6:71021:x1875060695599104:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201648.755889:0:109772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201648.755904:0:109772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f922 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7870bb expref: -99 pid: 109772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201648.755933:0:109772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7870bb expref: 7 pid: 109772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201648.755944:0:109772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0056d6c00/0x96d0c9b8c9a1f922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7870bb expref: 7 pid: 109772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201648.755954:0:109772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d6c00, rc 0) 00000100:00100000:0.0:1788201648.756004:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+7:71021:x1875060695599104:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 139us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201648.756011:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 29 00000100:00100000:3.0:1788201648.757484:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201648.757787:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695598976 00000100:00100000:0.0:1788201648.757797:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695598976 00000100:00100000:0.0:1788201648.757842:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00100000:0.0:1788201648.757852:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0071f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875060695598976:12345-192.168.201.20@tcp:38:ll_cfg_requeue.0 00010000:00080000:0.0:1788201648.757879:0:107405:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '6e293f14-c501-4bc5-9dd4-a18ef02756b4' at ffff8dc006e37000, cookie 0x96d0c9b8c9a1f86c 00010000:00080000:0.0:1788201648.757884:0:107405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp recovering/t133143986194 exp ffff8dc006e37000 cur 4500 last 1788201647 00010000:02000400:0.0:1788201648.757893:0:107405:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1788201648.757899:0:107405:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1788201648.757919:0:107405:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788201648.758088:0:107405:0:(import.c:65:import_set_state_nolock()) ffff8dc1031fa800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201648.758147:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0071f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695598976:12345-192.168.201.20@tcp:38:ll_cfg_requeue.0 Request processed in 296us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201648.758162:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00100000:0.0:1788201648.764488:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201648.764584:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201648.764617:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695593344 00000100:00100000:0.0:1788201648.764627:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695593344 00000100:00100000:0.0:1788201648.764684:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 87 00000100:00100000:0.0:1788201648.764693:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695593344:12345-192.168.201.20@tcp:36:mcreate.0 00010000:00080000:0.0:1788201648.764714:0:107403:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 133143986194, current: 133143986194, replaying 00000100:00100000:0.0:1788201648.764743:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695593344:12345-192.168.201.20@tcp:36:mcreate.0 Request processed in 43us (151us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788201648.764750:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 87 00000100:00100000:3.0:1788201648.765062:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695599232 00000100:00100000:3.0:1788201648.765066:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695599232 00000100:00100000:3.0:1788201648.765097:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 30 00000100:00100000:3.0:1788201648.765104:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+7:71021:x1875060695599232:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201648.765245:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71021:x1875060695599232:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 140us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201648.765252:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 30 00010000:00080000:2.0:1788201648.766716:0:109801:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1788201648.769354:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201648.769434:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695599360 00000100:00100000:0.0:1788201648.769444:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695599360 00000100:00100000:0.0:1788201648.769508:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:0.0:1788201648.769519:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71021:x1875060695599360:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201648.769654:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71021:x1875060695599360:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 136us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201648.769662:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 31 00000100:00100000:3.0:1788201648.786579:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201648.786663:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695599488 00000100:00100000:0.0:1788201648.786674:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695599488 00000100:00100000:0.0:1788201648.786741:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:0.0:1788201648.786752:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+8:71021:x1875060695599488:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201648.786769:0:109772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201648.786785:0:109772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0056d7400/0x96d0c9b8c9a1f929 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7870c2 expref: -99 pid: 109772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201648.786829:0:109772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0056d7400/0x96d0c9b8c9a1f929 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7870c2 expref: 9 pid: 109772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201648.786841:0:109772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0056d7400/0x96d0c9b8c9a1f929 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7870c2 expref: 9 pid: 109772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201648.786851:0:109772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d7400, rc 0) 00000100:00100000:0.0:1788201648.786913:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695599488:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 163us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201648.786921:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 32 00000100:00100000:0.0:1788201648.797250:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201648.797340:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695599616 00000100:00100000:3.0:1788201648.797351:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695599616 00000100:00100000:3.0:1788201648.797408:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:3.0:1788201648.797419:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695599616:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201648.797588:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695599616:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 170us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201648.797596:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 33 00000100:00100000:3.0:1788201648.801664:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201648.801782:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695599744 00000100:00100000:0.0:1788201648.801792:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695599744 00000100:00100000:0.0:1788201648.801845:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00100000:0.0:1788201648.801854:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695599744:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201648.801982:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695599744:12345-192.168.201.20@tcp:503:ll_cfg_requeue.0 Request processed in 128us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201648.801990:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 34 00000100:00100000:1.0:1788201648.806775:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201648.806879:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695599872 00000100:00100000:0.0:1788201648.806891:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695599872 00000100:00100000:0.0:1788201648.806958:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00100000:0.0:1788201648.806970:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11073a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+9:71021:x1875060695599872:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201648.806986:0:109772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201648.807007:0:109772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0056d6800/0x96d0c9b8c9a1f930 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7870c9 expref: -99 pid: 109772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201648.807111:0:109772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0056d6800/0x96d0c9b8c9a1f930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7870c9 expref: 10 pid: 109772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201648.807122:0:109772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0056d6800/0x96d0c9b8c9a1f930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7870c9 expref: 10 pid: 109772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201648.807131:0:109772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d6800, rc 0) 00000100:00100000:0.0:1788201648.807184:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11073a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695599872:12345-192.168.201.20@tcp:101:ll_cfg_requeue.0 Request processed in 216us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201648.807191:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 35 00000100:00100000:1.0:1788201648.810226:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201648.811923:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695600000 00000100:00100000:3.0:1788201648.811937:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695600000 00000100:00100000:3.0:1788201648.812010:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 36 00000100:00100000:3.0:1788201648.812046:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11073b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695600000:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201648.812162:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11073b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:71021:x1875060695600000:12345-192.168.201.20@tcp:501:ll_cfg_requeue.0 Request processed in 128us (1956us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788201648.812171:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 36 10000000:01000000:2.0:1788201649.167169:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788201649.167177:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc12b6ba000 from 144 10000000:01000000:2.0:1788201649.167183:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788201649.167243:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1f937 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201649.167276:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1f937 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201649.167289:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1f937 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201649.167318:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715518208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201649.167412:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201649.167465:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125952c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201649.168669:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715518208 00000100:00100000:3.0:1788201649.168692:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715518208 00000100:00100000:3.0:1788201649.168764:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788201649.168775:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11073b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+10:6529:x1875060715518208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201649.168789:0:109774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201649.168804:0:109774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1f93e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f937 expref: -99 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.168825:0:109774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1f93e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f937 expref: 11 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.168831:0:109774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1f93e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f937 expref: 11 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.168838:0:109774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c75800, rc 0) 00000100:00100000:3.0:1788201649.168902:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11073b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715518208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (1489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201649.168908:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788201649.169005:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715518208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201649.169040:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1f937 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f93e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201649.169049:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1f937 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f93e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201649.169106:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715518336:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788201649.169133:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201649.169257:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125952c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201649.171628:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715518336 00000100:00100000:0.0:1788201649.171640:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715518336 00000100:00100000:0.0:1788201649.171711:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788201649.171722:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11073b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715518336:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788201649.171758:0:109772:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788201649.171784:0:109772:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788201649.171787:0:109772:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 144 00000100:00100000:0.0:1788201649.171893:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11073b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715518336:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 172us (2758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201649.171901:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788201649.172047:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715518336:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788201649.172116:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788201649.172124:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1f937 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f93e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201649.172132:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1f937 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f93e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201649.172148:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788201649.172150:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc12f00a800 from 64 10000000:01000000:2.0:1788201649.172152:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788201649.172179:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1f945 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201649.172187:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1f945 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201649.172196:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1f945 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201649.172214:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715518464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201649.172249:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201649.172291:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125952c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201649.172363:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715518464 00000100:00100000:3.0:1788201649.172368:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715518464 00000100:00100000:3.0:1788201649.172401:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788201649.172410:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+11:6529:x1875060715518464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201649.172419:0:109774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201649.172430:0:109774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc108c74600/0x96d0c9b8c9a1f94c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f945 expref: -99 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.172451:0:109774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc108c74600/0x96d0c9b8c9a1f94c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f945 expref: 12 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.172460:0:109774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc108c74600/0x96d0c9b8c9a1f94c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f945 expref: 12 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.172476:0:109774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c74600, rc 0) 00000100:00100000:3.0:1788201649.172516:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715518464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201649.172523:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788201649.172595:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715518464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201649.172607:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1f945 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f94c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201649.172616:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1f945 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f94c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201649.172672:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715518592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201649.172698:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201649.172718:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125952c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201649.172778:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715518592 00000100:00100000:3.0:1788201649.172782:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715518592 00000100:00100000:3.0:1788201649.172800:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788201649.172806:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11073a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715518592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201649.172920:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11073a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715518592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201649.172928:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788201649.172994:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715518592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201649.173047:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715518720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201649.173090:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201649.173117:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125952c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201649.173357:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715518720 00000100:00100000:3.0:1788201649.173361:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715518720 00000100:00100000:3.0:1788201649.173381:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788201649.173387:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11073bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715518720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201649.173473:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11073bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715518720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201649.173480:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788201649.173558:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715518720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201649.174552:0:109861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:3.0:1788201649.174713:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:3.0:1788201649.174742:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201649.174753:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1f945 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f94c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.174764:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1f945 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f94c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201649.174786:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788201649.174789:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc12f00a800 from 141 10000000:01000000:3.0:1788201649.174792:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788201649.174823:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1f953 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.174831:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1f953 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.174840:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1f953 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201649.174859:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0071f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715518848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201649.175197:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201649.175229:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004a956c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201649.175304:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715518848 00000100:00100000:0.0:1788201649.175311:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715518848 00000100:00100000:0.0:1788201649.175350:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788201649.175357:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110739850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+12:6529:x1875060715518848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201649.175368:0:109774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201649.175379:0:109774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0056d6200/0x96d0c9b8c9a1f95a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f953 expref: -99 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201649.175405:0:109774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0056d6200/0x96d0c9b8c9a1f95a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f953 expref: 13 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201649.175415:0:109774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0056d6200/0x96d0c9b8c9a1f95a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f953 expref: 13 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201649.175423:0:109774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d6200, rc 0) 00000100:00100000:0.0:1788201649.175621:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110739850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715518848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 262us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201649.175627:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788201649.183176:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0071f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715518848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201649.183262:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1f953 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f95a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.183277:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1f953 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f95a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201649.183551:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715518976:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788201649.183620:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201649.183717:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125952cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201649.183771:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715518976 00000100:00100000:0.0:1788201649.183780:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715518976 00000100:00100000:0.0:1788201649.183876:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788201649.183887:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11073ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715518976:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788201649.183911:0:109772:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788201649.183929:0:109772:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788201649.183935:0:109772:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1788201649.183938:0:109772:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1788201649.183941:0:109772:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1788201649.183944:0:109772:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 144 00000100:00100000:0.0:1788201649.184083:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11073ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715518976:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 197us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201649.184091:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788201649.184168:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715518976:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788201649.184273:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788201649.184281:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1f953 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f95a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201649.184289:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1f953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f95a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788201649.184298:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788201649.184300:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 59 10000000:01000000:2.0:1788201649.184302:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788201649.184325:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59e00/0x96d0c9b8c9a1f961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201649.184331:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc140d59e00/0x96d0c9b8c9a1f961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201649.184340:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc140d59e00/0x96d0c9b8c9a1f961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201649.184354:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715519104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788201649.184384:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201649.184653:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125952cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201649.184678:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715519104 00000100:00100000:3.0:1788201649.184683:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715519104 00000100:00100000:3.0:1788201649.184706:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788201649.184713:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+13:6529:x1875060715519104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201649.184724:0:109774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201649.184751:0:109774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc108c74c00/0x96d0c9b8c9a1f968 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f961 expref: -99 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.184771:0:109774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc108c74c00/0x96d0c9b8c9a1f968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f961 expref: 14 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.184781:0:109774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc108c74c00/0x96d0c9b8c9a1f968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f961 expref: 14 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.184790:0:109774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c74c00, rc 0) 00000100:00100000:3.0:1788201649.184828:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715519104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201649.184834:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788201649.184941:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715519104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201649.184953:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc140d59e00/0x96d0c9b8c9a1f961 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f968 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201649.184961:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc140d59e00/0x96d0c9b8c9a1f961 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f968 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201649.185091:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715519232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201649.185511:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201649.185575:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125952cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201649.185607:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715519232 00000100:00100000:3.0:1788201649.185611:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715519232 00000100:00100000:3.0:1788201649.185688:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788201649.185696:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0034cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715519232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201649.185837:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0034cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715519232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201649.185844:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788201649.185906:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715519232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201649.185934:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715519360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201649.185972:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201649.189092:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125952cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201649.189402:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715519360 00000100:00100000:1.0:1788201649.189414:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715519360 00000100:00100000:1.0:1788201649.189484:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788201649.189494:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118102450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715519360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201649.190402:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118102450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715519360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 905us (4425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201649.190412:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788201649.190694:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715519360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201649.193396:0:109862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 58 00000020:01000000:1.0:1788201649.195181:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 59-58 (rc=0) 10000000:01000000:1.0:1788201649.195330:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788201649.195345:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59e00/0x96d0c9b8c9a1f961 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f968 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201649.195385:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc140d59e00/0x96d0c9b8c9a1f961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f968 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201649.196868:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1788201649.196877:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dc12f00a800 from 1 10000000:01000000:0.0:1788201649.196883:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788201649.196931:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6000/0x96d0c9b8c9a1f96f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201649.196958:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6000/0x96d0c9b8c9a1f96f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201649.196969:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6000/0x96d0c9b8c9a1f96f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201649.196997:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715519488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201649.197100:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201649.197163:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a875780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201649.197416:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715519488 00000100:00100000:3.0:1788201649.197425:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715519488 00000100:00100000:3.0:1788201649.197502:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788201649.197512:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+14:6529:x1875060715519488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201649.197526:0:109773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201649.197539:0:109773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc108c74000/0x96d0c9b8c9a1f976 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f96f expref: -99 pid: 109773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.197563:0:109773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc108c74000/0x96d0c9b8c9a1f976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f96f expref: 15 pid: 109773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.197583:0:109773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc108c74000/0x96d0c9b8c9a1f976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f96f expref: 15 pid: 109773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.197593:0:109773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c74000, rc 0) 00000100:00100000:3.0:1788201649.197642:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715519488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201649.197649:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788201649.197907:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715519488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201649.197922:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6000/0x96d0c9b8c9a1f96f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f976 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201649.197930:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6000/0x96d0c9b8c9a1f96f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f976 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201649.197946:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788201649.197952:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6000/0x96d0c9b8c9a1f96f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f976 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201649.197959:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6000/0x96d0c9b8c9a1f96f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f976 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201649.197966:0:6529:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201649.197968:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc12f00a800 from 7 10000000:01000000:0.0:1788201649.197970:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201649.197986:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6e00/0x96d0c9b8c9a1f97d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201649.198003:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6e00/0x96d0c9b8c9a1f97d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201649.198012:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6e00/0x96d0c9b8c9a1f97d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201649.198066:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715519616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201649.198095:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201649.198123:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a875780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201649.198194:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715519616 00000100:00100000:2.0:1788201649.198214:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715519616 00000100:00100000:2.0:1788201649.198241:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788201649.198248:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118101050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+15:6529:x1875060715519616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201649.198256:0:109772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201649.198264:0:109772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140d59400/0x96d0c9b8c9a1f984 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f97d expref: -99 pid: 109772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201649.198289:0:109772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140d59400/0x96d0c9b8c9a1f984 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f97d expref: 16 pid: 109772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201649.198296:0:109772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140d59400/0x96d0c9b8c9a1f984 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f97d expref: 16 pid: 109772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201649.198302:0:109772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59400, rc 0) 00000100:00100000:2.0:1788201649.198333:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118101050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715519616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201649.198339:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788201649.198584:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715519616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201649.198594:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6e00/0x96d0c9b8c9a1f97d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f984 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201649.198602:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6e00/0x96d0c9b8c9a1f97d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f984 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201649.198655:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715519744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201649.198681:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201649.198709:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a875780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201649.198846:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715519744 00000100:00100000:3.0:1788201649.198850:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715519744 00000100:00100000:3.0:1788201649.198881:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788201649.198888:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12bfd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715519744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201649.198988:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12bfd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715519744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201649.198996:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788201649.199154:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715519744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201649.199182:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715519872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201649.199366:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201649.199394:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a875780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201649.199445:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715519872 00000100:00100000:3.0:1788201649.199450:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715519872 00000100:00100000:3.0:1788201649.199479:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788201649.199485:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12bfd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715519872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201649.199584:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12bfd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715519872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201649.199590:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788201649.199734:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715519872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201649.202081:0:109863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788201649.203600:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788201649.203645:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788201649.203656:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6e00/0x96d0c9b8c9a1f97d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f984 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201649.203667:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6e00/0x96d0c9b8c9a1f97d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f984 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201649.203678:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788201649.203681:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc13aa9f000 from 64 10000000:01000000:0.0:1788201649.203683:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788201649.203719:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7a00/0x96d0c9b8c9a1f98b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201649.203754:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7a00/0x96d0c9b8c9a1f98b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201649.203765:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7a00/0x96d0c9b8c9a1f98b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201649.203791:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715520000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201649.203855:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201649.203906:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004b1c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201649.204339:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715520000 00000100:00100000:2.0:1788201649.204348:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715520000 00000100:00100000:2.0:1788201649.204404:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788201649.204415:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12bfd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+16:6529:x1875060715520000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201649.204428:0:109772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201649.204441:0:109772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140d58e00/0x96d0c9b8c9a1f992 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f98b expref: -99 pid: 109772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201649.204463:0:109772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140d58e00/0x96d0c9b8c9a1f992 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f98b expref: 17 pid: 109772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201649.204472:0:109772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140d58e00/0x96d0c9b8c9a1f992 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f98b expref: 17 pid: 109772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201649.204480:0:109772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58e00, rc 0) 00000100:00100000:2.0:1788201649.204535:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12bfd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715520000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201649.204553:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788201649.204701:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715520000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201649.204720:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7a00/0x96d0c9b8c9a1f98b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f992 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201649.204740:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7a00/0x96d0c9b8c9a1f98b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f992 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201649.204794:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715520128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201649.204834:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201649.204865:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004b1c780 going to sleep for 11 seconds 00000100:00100000:3.0:1788201649.205391:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715520128 00000100:00100000:3.0:1788201649.205397:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715520128 00000100:00100000:3.0:1788201649.205436:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788201649.205443:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12bfd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715520128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201649.205634:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12bfd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715520128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 191us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201649.205649:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788201649.205750:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715520128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201649.205784:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715520256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201649.205824:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201649.205855:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004b1c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201649.205936:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715520256 00000100:00100000:2.0:1788201649.205941:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715520256 00000100:00100000:2.0:1788201649.205963:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788201649.205970:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12bfd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715520256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201649.206065:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12bfd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715520256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201649.206072:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788201649.206359:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715520256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788201649.209054:0:109864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:0.0:1788201649.210108:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:0.0:1788201649.210134:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788201649.210145:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7a00/0x96d0c9b8c9a1f98b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f992 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201649.210157:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7a00/0x96d0c9b8c9a1f98b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f992 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201649.210168:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788201649.210171:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1788201649.210174:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788201649.210282:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7c00/0x96d0c9b8c9a1f999 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201649.210291:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7c00/0x96d0c9b8c9a1f999 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201649.210300:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7c00/0x96d0c9b8c9a1f999 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201649.210323:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715520384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201649.210408:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201649.210452:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc13a875780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201649.211779:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715520384 00000100:00100000:2.0:1788201649.211789:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715520384 00000100:00100000:2.0:1788201649.211841:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788201649.211852:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0055dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+17:6529:x1875060715520384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201649.211866:0:109774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201649.211881:0:109774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1f9a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f999 expref: -99 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201649.211907:0:109774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1f9a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f999 expref: 18 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201649.211917:0:109774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140d59000/0x96d0c9b8c9a1f9a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f999 expref: 18 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201649.211927:0:109774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59000, rc 0) 00000100:00100000:2.0:1788201649.211998:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0055dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715520384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (1590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201649.212006:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788201649.212164:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715520384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201649.212181:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7c00/0x96d0c9b8c9a1f999 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f9a0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201649.212190:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7c00/0x96d0c9b8c9a1f999 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f9a0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201649.212378:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715520512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201649.212410:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201649.212437:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f60780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201649.212602:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715520512 00000100:00100000:0.0:1788201649.212607:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715520512 00000100:00100000:0.0:1788201649.212640:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788201649.212648:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0055d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715520512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201649.212800:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0055d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715520512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201649.212809:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788201649.212963:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715520512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201649.212995:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715520640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201649.213249:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201649.213268:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f60780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201649.213803:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715520640 00000100:00100000:0.0:1788201649.213808:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715520640 00000100:00100000:0.0:1788201649.213835:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788201649.213842:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0055d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715520640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201649.215128:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0055d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715520640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1279us (1871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201649.215139:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788201649.215437:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715520640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201649.219176:0:109865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1788201649.224170:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1788201649.224287:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788201649.224301:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7c00/0x96d0c9b8c9a1f999 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f9a0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.224314:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7c00/0x96d0c9b8c9a1f999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f9a0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201649.224325:0:6529:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788201649.224328:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc13aa9f000 from 7 10000000:01000000:3.0:1788201649.224330:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201649.224375:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c75c00/0x96d0c9b8c9a1f9a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.224385:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc108c75c00/0x96d0c9b8c9a1f9a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.224558:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc108c75c00/0x96d0c9b8c9a1f9a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201649.224590:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0071f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715520768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201649.224666:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201649.224757:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004a95a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788201649.226450:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715520768 00000100:00100000:2.0:1788201649.226476:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715520768 00000100:00100000:3.0:1788201649.226607:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788201649.226616:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0055db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+18:6529:x1875060715520768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201649.226635:0:109774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201649.226651:0:109774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc108c74200/0x96d0c9b8c9a1f9ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f9a7 expref: -99 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.226675:0:109774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc108c74200/0x96d0c9b8c9a1f9ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f9a7 expref: 19 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.226686:0:109774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc108c74200/0x96d0c9b8c9a1f9ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f9a7 expref: 19 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.226695:0:109774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c74200, rc 0) 00000100:00100000:3.0:1788201649.226760:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0055db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715520768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (2093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201649.226767:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788201649.226947:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0071f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715520768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201649.226965:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc108c75c00/0x96d0c9b8c9a1f9a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f9ae expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201649.226974:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc108c75c00/0x96d0c9b8c9a1f9a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f9ae expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201649.227071:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715520896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201649.227105:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201649.227138:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1257069c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201649.227404:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715520896 00000100:00100000:2.0:1788201649.227408:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715520896 00000100:00100000:2.0:1788201649.227439:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788201649.227447:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0055db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715520896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201649.227568:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0055db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715520896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201649.227575:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788201649.227761:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715520896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201649.227790:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715521024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201649.227832:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201649.227863:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1257069c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201649.227916:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715521024 00000100:00100000:1.0:1788201649.227921:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715521024 00000100:00100000:1.0:1788201649.227957:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788201649.227966:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0055d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715521024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201649.228092:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0055d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715521024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201649.228099:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788201649.228237:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715521024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201649.229360:0:109866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788201649.234592:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788201649.234631:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788201649.234644:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c75c00/0x96d0c9b8c9a1f9a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f9ae expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.234657:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc108c75c00/0x96d0c9b8c9a1f9a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f9ae expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201649.235447:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788201649.235453:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc12b6bc800 from 64 10000000:01000000:3.0:1788201649.235457:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788201649.235508:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c75000/0x96d0c9b8c9a1f9b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.235517:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc108c75000/0x96d0c9b8c9a1f9b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.235549:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc108c75000/0x96d0c9b8c9a1f9b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201649.235574:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0071f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715521152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788201649.235646:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201649.235687:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc00747c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201649.235938:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715521152 00000100:00100000:2.0:1788201649.235946:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715521152 00000100:00100000:2.0:1788201649.235999:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788201649.236009:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0055da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:6529:x1875060715521152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201649.236043:0:109774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201649.236056:0:109774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140d59c00/0x96d0c9b8c9a1f9bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f9b5 expref: -99 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201649.236079:0:109774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140d59c00/0x96d0c9b8c9a1f9bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f9b5 expref: 20 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201649.236090:0:109774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140d59c00/0x96d0c9b8c9a1f9bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f9b5 expref: 20 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201649.236099:0:109774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d59c00, rc 0) 00000100:00100000:2.0:1788201649.236136:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0055da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715521152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201649.236143:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788201649.241892:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0071f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715521152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201649.241921:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc108c75000/0x96d0c9b8c9a1f9b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f9bc expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.241934:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc108c75000/0x96d0c9b8c9a1f9b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f9bc expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201649.242054:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0071f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715521280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788201649.242110:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201649.242149:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc00747c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788201649.243112:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715521280 00000100:00100000:2.0:1788201649.243122:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715521280 00000100:00100000:2.0:1788201649.243182:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788201649.243221:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0055db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715521280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788201649.243383:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0055db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715521280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201649.243392:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788201649.243594:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0071f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715521280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201649.243645:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715521408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201649.243689:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201649.243720:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125706240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201649.243800:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715521408 00000100:00100000:3.0:1788201649.243805:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715521408 00000100:00100000:3.0:1788201649.243841:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788201649.243848:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc006dd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715521408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788201649.243924:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc006dd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715521408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201649.243931:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788201649.244008:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715521408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788201649.245828:0:109867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:3.0:1788201649.250975:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:3.0:1788201649.251175:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788201649.251189:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c75000/0x96d0c9b8c9a1f9b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f9bc expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.251278:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc108c75000/0x96d0c9b8c9a1f9b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f9bc expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201649.251367:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788201649.251371:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1788201649.251374:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788201649.251560:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7000/0x96d0c9b8c9a1f9c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201649.251569:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7000/0x96d0c9b8c9a1f9c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201649.251580:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7000/0x96d0c9b8c9a1f9c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201649.251604:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715521536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201649.251671:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201649.251770:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc1257069c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788201649.251810:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715521536 00000100:00100000:3.0:1788201649.251818:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715521536 00000100:00100000:3.0:1788201649.251899:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788201649.251909:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc006dd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+20:6529:x1875060715521536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201649.251922:0:109774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201649.251934:0:109774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc108c74800/0x96d0c9b8c9a1f9ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f9c3 expref: -99 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.251956:0:109774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc108c74800/0x96d0c9b8c9a1f9ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f9c3 expref: 21 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.251965:0:109774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc108c74800/0x96d0c9b8c9a1f9ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f9c3 expref: 21 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.251972:0:109774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c74800, rc 0) 00000100:00100000:3.0:1788201649.252061:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc006dd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715521536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201649.252068:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788201649.252150:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715521536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201649.252164:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7000/0x96d0c9b8c9a1f9c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f9ca expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201649.252173:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7000/0x96d0c9b8c9a1f9c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f9ca expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201649.252243:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715521664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201649.252270:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201649.252700:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f60000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201649.252749:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715521664 00000100:00100000:0.0:1788201649.252753:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715521664 00000100:00100000:0.0:1788201649.252777:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788201649.252784:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715521664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201649.252923:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715521664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201649.252930:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788201649.252995:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715521664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201649.253056:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715521792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788201649.253106:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201649.253127:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f60000 going to sleep for 11 seconds 00000100:00100000:0.0:1788201649.253180:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715521792 00000100:00100000:0.0:1788201649.253185:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715521792 00000100:00100000:0.0:1788201649.253213:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788201649.253221:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715521792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201649.254231:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715521792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1007us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201649.254240:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788201649.254325:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715521792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788201649.255442:0:109868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1788201649.255806:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1788201649.255831:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788201649.255844:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7000/0x96d0c9b8c9a1f9c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f9ca expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201649.255854:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7000/0x96d0c9b8c9a1f9c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f9ca expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201649.255863:0:6529:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788201649.255865:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc12b6bc800 from 7 10000000:01000000:0.0:1788201649.255868:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788201649.255902:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7600/0x96d0c9b8c9a1f9d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201649.255926:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7600/0x96d0c9b8c9a1f9d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201649.255937:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7600/0x96d0c9b8c9a1f9d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201649.255959:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715521920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788201649.256012:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201649.256077:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005c6c180 going to sleep for 11 seconds 00000100:00100000:3.0:1788201649.256698:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715521920 00000100:00100000:3.0:1788201649.256706:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715521920 00000100:00100000:3.0:1788201649.256761:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788201649.256770:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:6529:x1875060715521920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201649.256783:0:109774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201649.256795:0:109774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc108c75a00/0x96d0c9b8c9a1f9d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f9d1 expref: -99 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.256827:0:109774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc108c75a00/0x96d0c9b8c9a1f9d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f9d1 expref: 22 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.256837:0:109774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc108c75a00/0x96d0c9b8c9a1f9d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f9d1 expref: 22 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.256846:0:109774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c75a00, rc 0) 00000100:00100000:3.0:1788201649.256903:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715521920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201649.256910:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788201649.257056:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715521920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788201649.257071:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7600/0x96d0c9b8c9a1f9d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f9d8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201649.257081:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7600/0x96d0c9b8c9a1f9d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f9d8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201649.257140:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715522048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201649.257170:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201649.257185:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005c6c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788201649.257308:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715522048 00000100:00100000:1.0:1788201649.257312:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715522048 00000100:00100000:1.0:1788201649.257333:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788201649.257339:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715522048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201649.257712:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715522048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 372us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201649.257720:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788201649.257967:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715522048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788201649.257991:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715522176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788201649.258041:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201649.258064:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc005c6c180 going to sleep for 11 seconds 00000100:00100000:2.0:1788201649.260703:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715522176 00000100:00100000:2.0:1788201649.260716:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715522176 00000100:00100000:2.0:1788201649.264337:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788201649.264354:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715522176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788201649.264543:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715522176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (6500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201649.264551:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788201649.265626:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715522176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788201649.266364:0:109870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788201649.266507:0:6529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788201649.266537:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201649.266548:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7600/0x96d0c9b8c9a1f9d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f9d8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201649.266558:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0056d7600/0x96d0c9b8c9a1f9d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f9d8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201649.266567:0:6529:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788201649.266569:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8dc12563cd28 from 1 10000000:01000000:1.0:1788201649.266572:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788201649.266606:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed200/0x96d0c9b8c9a1f9df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201649.266615:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed200/0x96d0c9b8c9a1f9df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201649.266624:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed200/0x96d0c9b8c9a1f9df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201649.266644:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715522304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201649.266696:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201649.266745:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f60780 going to sleep for 11 seconds 00000100:00100000:2.0:1788201649.267185:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715522304 00000100:00100000:2.0:1788201649.267192:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715522304 00000100:00100000:2.0:1788201649.268801:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788201649.268816:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:6529:x1875060715522304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788201649.268833:0:109772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201649.268851:0:109772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc140d58600/0x96d0c9b8c9a1f9e6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f9df expref: -99 pid: 109772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201649.268876:0:109772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc140d58600/0x96d0c9b8c9a1f9e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f9df expref: 23 pid: 109772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201649.268886:0:109772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc140d58600/0x96d0c9b8c9a1f9e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f9df expref: 23 pid: 109772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201649.268894:0:109772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc140d58600, rc 0) 00000100:00100000:2.0:1788201649.268964:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715522304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (2267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201649.268977:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788201649.269216:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715522304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201649.269238:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed200/0x96d0c9b8c9a1f9df lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f9e6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201649.269248:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed200/0x96d0c9b8c9a1f9df lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f9e6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201649.269269:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788201649.269281:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed200/0x96d0c9b8c9a1f9df lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f9e6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201649.269289:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ed200/0x96d0c9b8c9a1f9df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f9e6 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201649.269298:0:6529:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788201649.269301:0:6529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dc12563cd28 from 1 10000000:01000000:1.0:1788201649.269304:0:6529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788201649.269329:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec800/0x96d0c9b8c9a1f9ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201649.269337:0:6529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec800/0x96d0c9b8c9a1f9ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201649.269344:0:6529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec800/0x96d0c9b8c9a1f9ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201649.269363:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715522432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788201649.269408:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201649.275138:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715522432 00000100:00100000:3.0:1788201649.275157:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715522432 00000100:00100000:3.0:1788201649.275253:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788201649.275264:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+23:6529:x1875060715522432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788201649.275280:0:109773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788201649.275296:0:109773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc108c75200/0x96d0c9b8c9a1f9f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1f9ed expref: -99 pid: 109773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.275321:0:109773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc108c75200/0x96d0c9b8c9a1f9f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f9ed expref: 24 pid: 109773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.275329:0:109773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc108c75200/0x96d0c9b8c9a1f9f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f9ed expref: 24 pid: 109773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201649.275336:0:109773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc108c75200, rc 0) 00000100:00100000:3.0:1788201649.275391:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715522432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (5983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201649.275405:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788201649.278467:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f60780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201649.278514:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715522432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788201649.278543:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec800/0x96d0c9b8c9a1f9ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f9f4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201649.278556:0:6529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec800/0x96d0c9b8c9a1f9ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f9f4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201649.278643:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715522560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201649.278711:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201649.278752:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f60780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201649.278784:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715522560 00000100:00100000:1.0:1788201649.278790:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715522560 00000100:00100000:1.0:1788201649.278823:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788201649.278830:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715522560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788201649.278898:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:6529:x1875060715522560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 69us (187us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788201649.278904:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788201649.278943:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c9b18af6-fecc-4172-82c2-66531890fe11:6529:1875060715522560:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788201649.278965:0:6529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788201649.278970:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec800/0x96d0c9b8c9a1f9ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f9f4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201649.278976:0:6529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec800/0x96d0c9b8c9a1f9ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f9f4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201649.551253:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201650.579483:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201651.599235:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201652.179902:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201652.179940:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201652.179974:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695600256 00000100:00100000:3.0:1788201652.179995:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695600256 00000100:00100000:3.0:1788201652.180065:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:3.0:1788201652.180076:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0071f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2400:x1875060695600256:12345-192.168.201.20@tcp:400:kworker.0 00000100:00080000:2.0:1788201652.180699:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201652.180817:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695600128 00000100:00100000:1.0:1788201652.180823:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695600128 00000100:00100000:1.0:1788201652.180907:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 72 00000100:00100000:1.0:1788201652.180916:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007d51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695600128:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201652.180989:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0071f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2400:x1875060695600256:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 914us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201652.180998:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:1.0:1788201652.185119:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007d51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695600128:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 4192us (5164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201652.185146:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 72 00000001:02000400:1.0:1788201652.541921:0:110051:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788201652.560066:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0071f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715522688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201652.560147:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201652.560192:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201652.560199:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715522816:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201652.560223:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201652.560263:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715522688 00000100:00100000:1.0:1788201652.560270:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715522688 00000100:00100000:1.0:1788201652.560320:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715522816 00000100:00100000:1.0:1788201652.560324:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715522816 00000100:00100000:1.0:1788201652.560340:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788201652.560349:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715522688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788201652.560377:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1788201652.560419:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715522688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201652.560426:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788201652.560454:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788201652.560461:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715522816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201652.560477:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201652.560505:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715522816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201652.560510:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:1.0:1788201652.560525:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788201652.560529:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201652.560564:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715522816:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201652.560577:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0071f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715522688:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788201652.625134:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788201653.071256:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201653.071263:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201653.071266:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201653.071278:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dc11ccfb000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201653.071299:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc007159880 x1875060715523072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201653.071326:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201653.071329:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201653.071331:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201653.071335:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dc1401c3800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201653.071348:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc00715b480 x1875060715523328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201653.071372:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 1 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201653.071376:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201653.071378:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201653.071383:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc11d439000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201653.071393:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc007158380 x1875060715523584/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201653.071403:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788201653.071406:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201653.071408:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201653.071412:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc1401c2000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201653.071449:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc007158700 x1875060715523712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788201653.071475:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788201653.071479:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788201653.071480:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc106038800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201653.071486:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dc106038800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201653.071495:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc007159f80 x1875060715524224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201653.071607:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715523200:0@lo:400:kworker.0 00000100:00100000:3.0:1788201653.071698:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201653.071749:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715524096:0@lo:400:kworker.0 00000100:00100000:3.0:1788201653.071776:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201653.071802:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788201653.071808:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715522944:0@lo:400:kworker.0 00000100:00100000:3.0:1788201653.071835:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201653.071859:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715523968:0@lo:400:kworker.0 00000100:00100000:3.0:1788201653.071885:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201653.071916:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715524096 00000100:00100000:3.0:1788201653.071924:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715524096 00000100:00100000:3.0:1788201653.071991:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715523968 00000100:00100000:3.0:1788201653.071994:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715523968 00000100:00100000:3.0:1788201653.072045:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788201653.072064:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0071f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715524096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201653.072193:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0071f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715524096:12345-0@lo:400:kworker.0 Request processed in 131us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201653.072201:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788201653.072218:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788201653.072225:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0071f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715523968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201653.072250:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0071f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715523968:12345-0@lo:400:kworker.0 Request processed in 25us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201653.072256:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788201653.072300:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715523968:0@lo:400:kworker.0 00000100:00100000:3.0:1788201653.072311:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715524096:0@lo:400:kworker.0 00000100:00100000:0.0:1788201653.072395:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715523072:0@lo:38:kworker.0 00000100:00100000:0.0:1788201653.072437:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201653.072466:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715523328:0@lo:38:kworker.0 00000100:00100000:0.0:1788201653.072487:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201653.072504:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715523584:0@lo:38:kworker.0 00000100:00100000:0.0:1788201653.072526:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201653.072540:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715523712:0@lo:38:kworker.0 00000100:00100000:0.0:1788201653.072559:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201653.072573:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715524224:0@lo:38:kworker.0 00000100:00100000:0.0:1788201653.072592:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201653.072614:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715523200 00000100:00100000:0.0:1788201653.072618:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715523200 00000100:00100000:0.0:1788201653.072638:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715523072 00000100:00100000:0.0:1788201653.072641:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715523072 00000100:00100000:0.0:1788201653.072649:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715523328 00000100:00100000:0.0:1788201653.072652:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715523328 00000100:00100000:0.0:1788201653.072668:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715523712 00000100:00100000:0.0:1788201653.072671:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715523712 00000100:00100000:0.0:1788201653.072678:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715524224 00000100:00100000:0.0:1788201653.072680:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715524224 00000100:00100000:0.0:1788201653.072690:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788201653.072696:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0071f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715523200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201653.072734:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0071f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715523200:12345-0@lo:400:kworker.0 Request processed in 38us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201653.072741:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788201653.072756:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788201653.072760:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715523072:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788201653.072792:0:107405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 4504 last 0 00000020:00000080:0.0:1788201653.072825:0:107405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x96d0c9b8c9a1f9fb 00000004:00100000:0.0:1788201653.072839:0:107405:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788201653.072967:0:107405:0:(import.c:65:import_set_state_nolock()) ffff8dc11387a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201653.073007:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875060715523072:12345-0@lo:38:kworker.0 Request processed in 244us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201653.073035:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788201653.073051:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788201653.073055:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715523328:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788201653.073067:0:107405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 4504 last 0 00000100:00100000:1.0:1788201653.073252:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715523456:0@lo:400:kworker.0 00000100:00100000:1.0:1788201653.073284:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201653.073308:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201653.073315:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715523840:0@lo:400:kworker.0 00000100:00100000:1.0:1788201653.073339:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201653.073364:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201653.073369:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201653.073371:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201653.073382:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715523584 00000100:00100000:1.0:1788201653.073385:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715523584 00000100:00100000:1.0:1788201653.073404:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715523840 00000100:00100000:1.0:1788201653.073407:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715523840 00000100:00100000:1.0:1788201653.073437:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788201653.073442:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715523584:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788201653.073455:0:99776:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8dc006e34800, cookie 0x96d0c9b8c9a1f865 00010000:00080000:1.0:1788201653.073459:0:99776:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t133143986193 exp ffff8dc006e34800 cur 4504 last 1788201647 00000004:00100000:1.0:1788201653.073469:0:99776:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788201653.073485:0:99776:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201653.073520:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715523584:12345-0@lo:38:kworker.0 Request processed in 77us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201653.073526:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788201653.073541:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788201653.073547:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715523840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201653.073577:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715523840:12345-0@lo:400:kworker.0 Request processed in 30us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201653.073583:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:1.0:1788201653.073607:0:109801:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788201653.073612:0:109801:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 133143986194 00000020:00080000:1.0:1788201653.073616:0:109801:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788201653.073625:0:109801:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 133143986194, next_transno: 133143986194 00010000:00080000:1.0:1788201653.073630:0:109801:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (133143986194) 00000020:00080000:1.0:1788201653.073633:0:109801:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788201653.073642:0:109801:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695593344 t133143986194 from 192.168.201.20@tcp req@ffff8dc005d54000 x1875060695593344/t0(133143986194) o36->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:14/0 lens 528/0 e 0 to 0 dl 1788201659 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788201653.073724:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715523840:0@lo:400:kworker.0 00000100:00100000:3.0:1788201653.074231:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715523456 00000100:00100000:3.0:1788201653.074235:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715523456 00000100:00100000:3.0:1788201653.074265:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788201653.074271:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715523456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201653.074311:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715523456:12345-0@lo:400:kworker.0 Request processed in 40us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201653.074317:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788201653.074330:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788201653.074334:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715523712:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788201653.074347:0:107404:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 4504 last 0 00000100:00100000:2.0:1788201653.074438:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715522944 00000100:00100000:2.0:1788201653.074443:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715522944 00000100:00100000:2.0:1788201653.074471:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788201653.074477:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715522944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201653.074510:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715522944:12345-0@lo:400:kworker.0 Request processed in 33us (2674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201653.074517:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788201653.074571:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201653.074580:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715524352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201653.074605:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788201653.077503:0:107404:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x96d0c9b8c9a1fa02 00000004:00100000:3.0:1788201653.077523:0:107404:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201653.077559:0:107404:0:(import.c:65:import_set_state_nolock()) ffff8dc001e2d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201653.077644:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875060715523712:12345-0@lo:38:kworker.0 Request processed in 3306us (5082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201653.077654:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788201653.077698:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788201653.077705:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715524224:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788201653.077726:0:107404:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 4504 last 0 00000020:00000080:3.0:1788201653.077750:0:107404:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x96d0c9b8c9a1fa10 00000004:00100000:3.0:1788201653.077756:0:107404:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788201653.077770:0:107404:0:(import.c:65:import_set_state_nolock()) ffff8dc001e2c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201653.077798:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875060715524224:12345-0@lo:38:kworker.0 Request processed in 93us (5205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201653.077804:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1788201653.077830:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201653.077866:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715523456:0@lo:400:kworker.0 00000100:00100000:2.0:1788201653.078051:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715524352 00000100:00100000:2.0:1788201653.078058:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715524352 00000100:00100000:2.0:1788201653.078112:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788201653.078119:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715524352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201653.078144:0:99776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445376000 avail 1299136512 00000100:00100000:2.0:1788201653.078183:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715524352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (3577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201653.078190:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788201653.078228:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715524352:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1788201653.081216:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc007159880 x1875060715523072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201653.081238:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 32 00000100:00080000:2.0:1788201653.082283:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8dc007159880 x1875060715523072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201678 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201653.082294:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788201653.082299:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfb000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788201653.082303:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788201653.082308:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3654:1875060715523072:0@lo:38:kworker.0 00000100:00100000:2.0:1788201653.082331:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 133143986193 gen 2 00000004:00080000:2.0:1788201653.082336:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 133143986193 committed transno 133143986193 00000100:00080000:2.0:1788201653.082362:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 32 00000100:00080000:2.0:1788201653.082371:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1788201653.082375:0:3654:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1788201653.082377:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 133143986193 gen 2 00000100:00080000:2.0:1788201653.082380:0:3654:0:(recover.c:53:ptlrpc_replay_next()) import ffff8dc11d439000 from lustre-MDT0000_UUID committed 133143986193 last 0 00000100:00080000:2.0:1788201653.082383:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1788201653.082600:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715522944:0@lo:400:kworker.0 00000100:00100000:2.0:1788201653.082617:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715523200:0@lo:400:kworker.0 00000100:00100000:2.0:1788201653.082691:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715523584:0@lo:38:kworker.0 00010000:00080000:2.0:1788201653.082707:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc007158700 x1875060715523712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201653.082732:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 32 00010000:00080000:3.0:1788201653.084109:0:110085:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1788201653.084114:0:110085:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1788201653.084119:0:110085:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:3.0:1788201653.085179:0:110085:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:2.0:1788201653.086334:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8dc007158700 x1875060715523712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201678 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201653.086346:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788201653.086352:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788201653.086357:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788201653.086362:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715523712:0@lo:38:kworker.0 00010000:00080000:2.0:1788201653.086403:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc007159f80 x1875060715524224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201653.086418:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 32 00000100:00080000:2.0:1788201653.086489:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788201653.086494:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788201653.086497:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc106038800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788201653.086502:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875060715524224:0@lo:38:kworker.0 00000100:00100000:2.0:1788201653.086544:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0071f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715524480:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788201653.086607:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788201653.088542:0:109801:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 14845us 00000100:00100000:3.0:1788201653.091155:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715524480 00000100:00100000:3.0:1788201653.091167:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715524480 00000100:00100000:3.0:1788201653.091234:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788201653.091243:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715524480:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1788201653.091267:0:99775:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc007159f80 x1875060715524480/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:19/0 lens 224/0 e 0 to 0 dl 1788201664 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201653.091278:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715524480:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 38us (4672us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788201653.091292:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000020:00000080:0.0:1788201653.095557:0:107405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x96d0c9b8c9a1fa09 00000004:00100000:0.0:1788201653.095583:0:107405:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788201653.095626:0:107405:0:(import.c:65:import_set_state_nolock()) ffff8dc13a87e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201653.095782:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875060715523328:12345-0@lo:38:kworker.0 Request processed in 22723us (23292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201653.095793:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:3.0:1788201653.104994:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8dc00715b480 x1875060715523328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201653.105057:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 32 00000100:00080000:3.0:1788201653.111649:0:3654:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8dc00715b480 x1875060715523328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788201678 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788201653.111673:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788201653.111679:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c3800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788201653.111683:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788201653.111689:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3654:1875060715523328:0@lo:38:kworker.0 00010000:00010000:1.0:1788201653.128199:0:109801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1fa17 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.128230:0:109801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1fa17 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.128252:0:109801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1fa17 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.128275:0:109801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1fa1e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.128283:0:109801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1fa1e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.128290:0:109801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1fa1e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.131740:0:109801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1fa17 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.131758:0:109801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1fa17 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.131779:0:109801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1fa17 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.131785:0:109801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed600 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:1.0:1788201653.131790:0:109801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1fa17 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.131798:0:109801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1fa17 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.131814:0:109801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc1115df700) 00010000:00010000:1.0:1788201653.131817:0:109801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788201653.131822:0:109801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1fa17 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.131829:0:109801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ed600/0x96d0c9b8c9a1fa17 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788201653.131855:0:109801:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001728c306 reply state 00000000155ec14b transno 133143986194 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1fa1e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.131866:0:109801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1fa1e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.131873:0:109801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc1115df400) 00010000:00010000:1.0:1788201653.131876:0:109801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788201653.131878:0:109801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788201653.132000:0:109801:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:1.0:1788201653.132632:0:109801:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788201653.132636:0:109801:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 133143986195 00000020:00080000:1.0:1788201653.132646:0:109801:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788201653.132649:0:109801:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 133143986195 00000100:00100000:1.0:1788201653.143233:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201653.143275:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695593856 00000100:00100000:1.0:1788201653.143286:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695593856 00000100:00100000:1.0:1788201653.143355:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 92 00000100:00100000:1.0:1788201653.143366:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2399:x1875060695593856:12345-192.168.201.20@tcp:36:rm.0 00010000:00080000:1.0:1788201653.143386:0:107403:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 133143986195, current: 133143986195, replaying 00000100:00100000:1.0:1788201653.143401:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2399:x1875060695593856:12345-192.168.201.20@tcp:36:rm.0 Request processed in 38us (179us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788201653.143407:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 92 00000020:00080000:1.0:1788201653.143423:0:109801:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788201653.143427:0:109801:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 133143986195, next_transno: 133143986195 00010000:00080000:1.0:1788201653.143437:0:109801:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (133143986195) 00000020:00080000:1.0:1788201653.143440:0:109801:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788201653.143449:0:109801:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875060695593856 t133143986195 from 192.168.201.20@tcp req@ffff8dc004b38e00 x1875060695593856/t0(133143986195) o36->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:19/0 lens 512/0 e 0 to 0 dl 1788201664 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788201653.143526:0:109801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1fa25 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.143542:0:109801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1fa25 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.143554:0:109801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1fa25 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.143566:0:109801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1fa2c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.143591:0:109801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1fa2c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.143599:0:109801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1fa2c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.143691:0:109801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1fa33 lrc: 3/0,1 mode: --/EX res: [0x20000d6f1:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.143699:0:109801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1fa33 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.143706:0:109801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1fa33 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.148561:0:109801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1fa33 lrc: 3/0,1 mode: EX/EX res: [0x20000d6f1:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.148578:0:109801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1fa33 lrc: 2/0,0 mode: EX/EX res: [0x20000d6f1:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.148586:0:109801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1fa33 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.148604:0:109801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064eda00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201653.148609:0:109801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1fa33 lrc: 3/0,0 mode: EX/EX res: [0x20000d6f1:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.148618:0:109801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1fa33 lrc: 4/0,0 mode: EX/EX res: [0x20000d6f1:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.148635:0:109801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000d6f1:0x39:0x0].0x0 (ffff8dc1115dfc00) 00010000:00010000:2.0:1788201653.148638:0:109801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788201653.148643:0:109801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1fa33 lrc: 2/0,0 mode: --/EX res: [0x20000d6f1:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.148649:0:109801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eda00/0x96d0c9b8c9a1fa33 lrc: 0/0,0 mode: --/EX res: [0x20000d6f1:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.148687:0:109801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1fa25 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.148694:0:109801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1fa25 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.148700:0:109801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1fa25 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.148705:0:109801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064eca00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201653.148708:0:109801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1fa25 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.148715:0:109801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1fa25 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.148733:0:109801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc1115dfb00) 00010000:00010000:2.0:1788201653.148735:0:109801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201653.148739:0:109801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1fa25 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.148744:0:109801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064eca00/0x96d0c9b8c9a1fa25 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788201653.148759:0:109801:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000941e79d3 reply state 00000000528f7320 transno 133143986195 ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1fa2c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.148771:0:109801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1fa2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.148778:0:109801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc1115df400) 00010000:00010000:2.0:1788201653.148781:0:109801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788201653.148784:0:109801:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788201653.148872:0:109801:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788201653.148893:0:109801:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788201653.148897:0:109801:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 133143986196 00000020:00080000:2.0:1788201653.148901:0:109801:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788201653.148903:0:109801:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 133143986196 00000001:00080000:3.0:1788201653.151727:0:109767:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 133143986194 is committed 00010000:00010000:2.0:1788201653.152847:0:3642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1fa1e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.152862:0:3642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1fa1e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.152871:0:3642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1fa1e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.152892:0:3642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ece00 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:2.0:1788201653.152897:0:3642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1fa1e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.152905:0:3642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1fa1e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.152923:0:3642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd74ce62b (ffff8dc1115df400) 00010000:00010000:2.0:1788201653.152926:0:3642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788201653.152931:0:3642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1fa1e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.152937:0:3642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ece00/0x96d0c9b8c9a1fa1e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201653.162778:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201653.163010:0:109776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695600384 00000100:00100000:2.0:1788201653.163916:0:109776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695600384 00000100:00100000:2.0:1788201653.163983:0:109776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 83 00000100:00100000:2.0:1788201653.163995:0:109776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2399:x1875060695600384:12345-192.168.201.20@tcp:400:ldlm_lock_repla.0 00010000:00080000:2.0:1788201653.164039:0:109776:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8dc005d56d80 x1875060695600384/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:19/0 lens 224/0 e 0 to 0 dl 1788201664 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788201653.164058:0:109776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+8:2399:x1875060695600384:12345-192.168.201.20@tcp:400:ldlm_lock_repla.0 Request processed in 67us (1292us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788201653.164066:0:109776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 83 00000020:00080000:0.0:1788201653.164181:0:109801:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201653.164186:0:109801:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 133143986196 00010000:00080000:0.0:1788201653.164190:0:109801:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1788201653.164193:0:109801:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788201653.164200:0:109801:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788201653.164203:0:109801:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1788201653.164306:0:109801:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 32, last_transno is 137438953472 00000001:00100000:3.0:1788201653.168299:0:109767:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000001:00100000:3.0:1788201653.168361:0:109767:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1788201653.168380:0:109767:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 133143986195 is committed 00010000:00010000:3.0:1788201653.168414:0:3641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1fa2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.168442:0:3641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1fa2c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.168449:0:3641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1fa2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.168456:0:3641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec000 already unused, calling callback (ffffffffc18904f0) 00010000:00010000:3.0:1788201653.168461:0:3641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1fa2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.168480:0:3641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1fa2c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.168506:0:3641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1fa2c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.168512:0:3641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc1064ec000/0x96d0c9b8c9a1fa2c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd74ce62b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 109801 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788201653.168694:0:109801:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1788201653.168737:0:109801:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1788201653.168755:0:109801:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8dc007159f80 x1875060715524480/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:19/0 lens 224/0 e 0 to 0 dl 1788201664 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788201653.168867:0:109801:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.201.20@tcp: req@ffff8dc005d56d80 x1875060695600384/t0(0) o400->6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp:19/0 lens 224/0 e 0 to 0 dl 1788201664 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1788201653.168925:0:109801:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:2.0:1788201653.170212:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1788201653.170224:0:3654:0:(client.c:3247:ptlrpc_resend_req()) @@@ going to resend req@ffff8dc0071f2300 x1875060715524480/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201669 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201653.170250:0:3654:0:(client.c:3256:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8dc0071f2300 x1875060715524480/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788201669 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788201653.170258:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788201653.170272:0:3654:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788201653.170277:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0071f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715524480:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788201653.170349:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715524608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201653.170400:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201653.170450:0:109785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715524608 00000100:00100000:2.0:1788201653.170456:0:109785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715524608 00000100:00100000:2.0:1788201653.170497:0:109785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788201653.170505:0:109785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715524608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201653.170531:0:109785:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444941824 avail 1298702336 00000100:00100000:2.0:1788201653.170582:0:109785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715524608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201653.170590:0:109785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788201653.170630:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715524608:0@lo:41:osp-pre-0-1.0 00000004:00000080:1.0:1788201653.197651:0:109801:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa0dd457dfe10 00100000:10000000:1.0:1788201653.197676:0:109801:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1788201653.199798:0:109789:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x323:0x0] 00000100:00100000:1.0:1788201653.199843:0:109789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:109789:1875060715524736:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788201653.199912:0:109789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201653.199943:0:109789:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc003a3ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788201653.199968:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715524736 00000100:00100000:1.0:1788201653.199985:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715524736 00000100:00100000:1.0:1788201653.200044:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788201653.200054:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:109789:x1875060715524736:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788201653.200081:0:99767:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 993 -> diff = -190 00002000:02000040:1.0:1788201653.200085:0:99767:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:804 to 0x2c0000401:993) 00000004:00080000:0.0:1788201653.200730:0:109787:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x396:0x0] 00000100:00100000:0.0:1788201653.200758:0:109787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:109787:1875060715524864:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788201653.200802:0:109787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201653.200836:0:109787:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc125706240 going to sleep for 11 seconds 00000100:00100000:3.0:1788201653.201089:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715524864 00000100:00100000:3.0:1788201653.201096:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715524864 00000100:00100000:3.0:1788201653.201128:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788201653.201136:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:109787:x1875060715524864:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788201653.201154:0:101188:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1025 -> diff = -107 00002000:02000040:3.0:1788201653.201157:0:101188:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:919 to 0x280000401:1025) 00002000:00010000:1.0:1788201653.213283:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.213303:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1fa3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.213323:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e1:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.213328:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.213334:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1fa3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.213350:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1fa3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.213361:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1fa3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.213370:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1fa3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.213406:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201653.213797:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.213803:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1fa41 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.213812:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e0:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.213815:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.213820:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1fa41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.213829:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1fa41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.214088:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1fa41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.214096:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1fa41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.214219:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201653.214227:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1fa3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.214236:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201653.214241:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1fa3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.214263:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1fa3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.214282:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1fa3a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.214288:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004015a639/0x96d0c9b8c9a1fa3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.214308:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201653.214310:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201653.214312:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.215550:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201653.215565:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201653.215572:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1fa41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.215581:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ede00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.215585:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1fa41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.215594:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1fa41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.215610:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1fa41 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.215618:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3450d83/0x96d0c9b8c9a1fa41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.215635:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.215645:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.215647:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.215760:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.215767:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1fa48 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.215779:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3df:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.215783:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.215790:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1fa48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.215802:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1fa48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.215809:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1fa48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.215816:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1fa48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.215831:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201653.215838:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201653.215842:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1fa48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.215849:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.215853:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1fa48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.215871:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1fa48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.215882:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1fa48 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.215890:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009044bfe0/0x96d0c9b8c9a1fa48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.215903:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.215905:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.215907:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.215952:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.215957:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1fa4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.215965:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3de:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.215969:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.215973:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1fa4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.215981:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1fa4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.215989:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1fa4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.216001:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1fa4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.216332:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201653.216342:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201653.216347:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1fa4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.216355:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ece00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.216358:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1fa4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.216366:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1fa4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.216376:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1fa4f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.216382:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c16a5800/0x96d0c9b8c9a1fa4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.216395:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.216397:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.216399:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.216444:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.216454:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1fa56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.216462:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3dd:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.216466:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.216470:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1fa56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.216478:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1fa56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.216485:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1fa56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.216493:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1fa56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.216511:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201653.216554:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.216559:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1fa5d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.216567:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3dc:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.216570:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.216574:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1fa5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.216582:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1fa5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.216596:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1fa5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.216603:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1fa5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.216616:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788201653.216623:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201653.216627:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1fa56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.216630:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201653.216634:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064eca00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201653.216636:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1fa5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.216638:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1fa56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.216644:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064eda00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.216646:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1fa56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.216647:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1fa5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.216665:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1fa5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.216676:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1fa5d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.216682:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000382a5e1c/0x96d0c9b8c9a1fa5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.216711:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201653.216713:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201653.216715:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.221317:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1fa56 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.221335:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d59ebb0e/0x96d0c9b8c9a1fa56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.221363:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.221373:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.221376:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.222050:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.222057:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000847d8716/0x96d0c9b8c9a1fa64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.222071:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3db:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.222076:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.222082:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000847d8716/0x96d0c9b8c9a1fa64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.222095:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000847d8716/0x96d0c9b8c9a1fa64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.222104:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000847d8716/0x96d0c9b8c9a1fa64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.222112:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000847d8716/0x96d0c9b8c9a1fa64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.222145:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201653.222192:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.222197:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1fa6b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.222204:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3da:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.222207:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.222211:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1fa6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.222228:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1fa6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.222236:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1fa6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.222243:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1fa6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.222246:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201653.222252:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000847d8716/0x96d0c9b8c9a1fa64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.222257:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201653.222261:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.222265:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201653.222266:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000847d8716/0x96d0c9b8c9a1fa64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.222269:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1fa6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.222275:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064edc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201653.222277:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000847d8716/0x96d0c9b8c9a1fa64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.222279:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1fa6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.222286:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1fa6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.222291:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000847d8716/0x96d0c9b8c9a1fa64 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.222295:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1fa6b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.222298:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000847d8716/0x96d0c9b8c9a1fa64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.222302:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfd9117e/0x96d0c9b8c9a1fa6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.222315:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201653.222317:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201653.222319:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.222320:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.222321:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.222323:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.222360:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.222364:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3011c0a/0x96d0c9b8c9a1fa72 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.222370:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d9:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.222372:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.222374:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3011c0a/0x96d0c9b8c9a1fa72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.222380:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3011c0a/0x96d0c9b8c9a1fa72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.222384:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3011c0a/0x96d0c9b8c9a1fa72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.222389:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3011c0a/0x96d0c9b8c9a1fa72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.222405:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201653.222548:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201653.222553:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3011c0a/0x96d0c9b8c9a1fa72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.222570:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ec400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201653.222573:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3011c0a/0x96d0c9b8c9a1fa72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.222579:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3011c0a/0x96d0c9b8c9a1fa72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.222589:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3011c0a/0x96d0c9b8c9a1fa72 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.222594:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3011c0a/0x96d0c9b8c9a1fa72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.222609:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201653.222610:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201653.222612:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.223525:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.223535:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1fa79 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.223556:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d8:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.223560:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.223564:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1fa79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.223574:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1fa79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.223582:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1fa79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.223590:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1fa79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.223613:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201653.223635:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201653.223640:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1fa79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.223648:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc1064ed000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201653.223651:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1fa79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.223671:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1fa79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201653.223686:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201653.223689:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1fa79 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.223690:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e6e921c/0x96d0c9b8c9a1fa80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.223696:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000507ef2f/0x96d0c9b8c9a1fa79 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.223698:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d7:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.223702:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.223706:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e6e921c/0x96d0c9b8c9a1fa80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.223711:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201653.223712:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201653.223714:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.223714:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e6e921c/0x96d0c9b8c9a1fa80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.223732:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e6e921c/0x96d0c9b8c9a1fa80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.223740:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e6e921c/0x96d0c9b8c9a1fa80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.223753:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201653.223771:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201653.223775:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e6e921c/0x96d0c9b8c9a1fa80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.223782:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbcc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201653.223785:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e6e921c/0x96d0c9b8c9a1fa80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.223792:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e6e921c/0x96d0c9b8c9a1fa80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201653.223792:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.223797:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b1b722d/0x96d0c9b8c9a1fa87 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.223802:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e6e921c/0x96d0c9b8c9a1fa80 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.223804:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d6:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.223807:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788201653.223810:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e6e921c/0x96d0c9b8c9a1fa80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.223812:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b1b722d/0x96d0c9b8c9a1fa87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.223821:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b1b722d/0x96d0c9b8c9a1fa87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.223829:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b1b722d/0x96d0c9b8c9a1fa87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.223837:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201653.223838:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201653.223840:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.224283:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b1b722d/0x96d0c9b8c9a1fa87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.224304:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201653.224325:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201653.224330:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b1b722d/0x96d0c9b8c9a1fa87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.224337:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201653.224341:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b1b722d/0x96d0c9b8c9a1fa87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201653.224345:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201653.224348:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b1b722d/0x96d0c9b8c9a1fa87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.224349:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1fa8e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.224358:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d5:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:0.0:1788201653.224360:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b1b722d/0x96d0c9b8c9a1fa87 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.224361:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.224365:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1fa8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.224367:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b1b722d/0x96d0c9b8c9a1fa87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.224375:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1fa8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.224379:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201653.224381:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.224382:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1fa8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.224383:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.224389:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1fa8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.224404:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201653.224676:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201653.224681:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1fa8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.224699:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201653.224702:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1fa8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.224710:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1fa8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.224721:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1fa8e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.224728:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a103ff4f/0x96d0c9b8c9a1fa8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.224742:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201653.224743:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201653.224745:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.224775:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.224781:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000279447c9/0x96d0c9b8c9a1fa95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.224789:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d4:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.224796:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.224801:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000279447c9/0x96d0c9b8c9a1fa95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.224811:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000279447c9/0x96d0c9b8c9a1fa95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.224819:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000279447c9/0x96d0c9b8c9a1fa95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.224826:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000279447c9/0x96d0c9b8c9a1fa95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225419:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201653.225429:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201653.225434:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000279447c9/0x96d0c9b8c9a1fa95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225451:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbdc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.225455:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000279447c9/0x96d0c9b8c9a1fa95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225463:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000279447c9/0x96d0c9b8c9a1fa95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225474:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000279447c9/0x96d0c9b8c9a1fa95 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225492:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000279447c9/0x96d0c9b8c9a1fa95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225507:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.225509:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.225511:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.225570:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.225575:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1fa9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225583:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d3:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.225587:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.225591:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1fa9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225599:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1fa9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225606:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1fa9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225614:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1fa9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225632:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201653.225685:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.225691:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1faa3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225699:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d2:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.225702:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.225706:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1faa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225715:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1faa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225722:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1faa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225729:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1faa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225743:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788201653.225750:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201653.225753:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1fa9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225760:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.225763:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1fa9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225782:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1fa9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225791:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1fa9c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225797:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4ea62da/0x96d0c9b8c9a1fa9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225809:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201653.225812:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1faa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225818:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbce00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.225821:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1faa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225827:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1faa3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225850:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1faa3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225858:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001000d9a0/0x96d0c9b8c9a1faa3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.225880:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.225882:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.225884:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.225885:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.225925:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.225930:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b840617e/0x96d0c9b8c9a1faaa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225938:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d1:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.225941:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.225946:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b840617e/0x96d0c9b8c9a1faaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225955:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b840617e/0x96d0c9b8c9a1faaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225962:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b840617e/0x96d0c9b8c9a1faaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225969:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b840617e/0x96d0c9b8c9a1faaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.225982:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201653.225989:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201653.225992:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b840617e/0x96d0c9b8c9a1faaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226009:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.226012:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b840617e/0x96d0c9b8c9a1faaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226037:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b840617e/0x96d0c9b8c9a1faaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226049:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b840617e/0x96d0c9b8c9a1faaa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226056:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b840617e/0x96d0c9b8c9a1faaa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226070:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.226071:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.226073:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.226112:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.226125:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1fab1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226133:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d0:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.226136:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.226140:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1fab1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226149:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1fab1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226163:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1fab1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226169:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1fab1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226181:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201653.226188:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201653.226191:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1fab1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226197:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbda00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.226200:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1fab1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226208:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1fab1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226218:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1fab1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226225:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6099134/0x96d0c9b8c9a1fab1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226238:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.226243:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.226245:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.226289:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.226293:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1fab8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226301:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3cf:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.226304:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.226308:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1fab8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226316:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1fab8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226323:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1fab8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226329:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1fab8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226347:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201653.226352:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201653.226357:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1fab8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.226364:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbde00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201653.226368:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1fab8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201653.226381:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788201653.226385:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1fab8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226386:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1fabf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226394:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3ce:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.226397:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.226401:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1fabf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226415:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1fabf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226423:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1fabf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226431:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1fabf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226443:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201653.226450:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201653.226453:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1fabf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226460:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.226463:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1fabf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226472:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1fabf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226482:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1fabf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226489:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ef171b0/0x96d0c9b8c9a1fabf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226508:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.226510:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.226512:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.226552:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.226558:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1fac6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226566:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3cd:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.226568:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.226573:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1fac6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226581:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1fac6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.226582:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1fab8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226590:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1fac6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.226591:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec83ad0b/0x96d0c9b8c9a1fab8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226598:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1fac6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.226605:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201653.226607:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201653.226610:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1fac6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.226616:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201653.226619:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1fac6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.226626:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1fac6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.226635:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1fac6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.226642:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201653.226648:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.226970:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788201653.226971:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.226976:0:99767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7cc1da9/0x96d0c9b8c9a1fac6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.226995:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.227075:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.227081:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1facd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.227088:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3cc:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.227092:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.227095:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1facd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.227104:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1facd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.227112:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1facd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.227118:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1facd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.227137:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201653.227174:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.227180:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1fad4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.227187:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3cb:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.227190:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.227194:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1fad4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.227215:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1fad4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.227223:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1fad4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.227230:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1fad4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.227242:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788201653.227249:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201653.227253:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1facd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.227259:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.227262:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1facd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.227269:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1facd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.227280:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1facd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.227286:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df255c7d/0x96d0c9b8c9a1facd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.227305:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201653.227308:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1fad4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.227315:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbc600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.227318:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1fad4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.227325:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1fad4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.227334:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1fad4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.227341:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066d996a5/0x96d0c9b8c9a1fad4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.227353:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.227355:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.227356:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.227395:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.227400:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1fadb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.227408:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3ca:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.227416:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.227421:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1fadb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.227431:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1fadb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.227814:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.227909:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1fadb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.227920:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1fadb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.227941:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201653.227988:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.227994:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1fae2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.228002:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c9:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.228005:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.228009:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1fae2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.228040:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1fae2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.228048:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1fae2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.228061:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1fae2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.228075:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788201653.228082:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201653.228086:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1fadb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.228092:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.228095:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1fadb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.228102:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1fadb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.228221:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201653.228226:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1fae2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.228234:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbd400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201653.228237:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1fae2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.228246:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1fae2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.228258:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1fae2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.228270:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d38d639/0x96d0c9b8c9a1fae2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.228286:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201653.228287:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201653.228289:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.228311:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1fadb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.228321:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000568a02ca/0x96d0c9b8c9a1fadb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.228334:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.228336:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.228338:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.228380:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.228390:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1fae9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.228398:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c8:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.228401:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.228405:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1fae9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.228414:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1fae9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.228422:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1fae9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.228429:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1fae9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.228545:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201653.228591:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.228596:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1faf0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.228604:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c7:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.228607:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.228611:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1faf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.228620:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1faf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.228634:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1faf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.228641:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1faf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.230669:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201653.230683:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1fae9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.230694:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc006dbca00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201653.230699:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1fae9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.230709:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1fae9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.230728:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1fae9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.230735:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d69819e9/0x96d0c9b8c9a1fae9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.230761:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201653.230765:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1faf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.230777:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfa00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201653.230780:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1faf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.230788:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1faf0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.230799:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1faf0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.230807:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201653.230808:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201653.230810:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788201653.231549:0:100576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788201653.231617:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788201653.231625:0:99767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1faf0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201653.231745:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.231752:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020cae025/0x96d0c9b8c9a1faf7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.231765:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c6:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.231769:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.231775:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020cae025/0x96d0c9b8c9a1faf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.231788:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020cae025/0x96d0c9b8c9a1faf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.231797:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020cae025/0x96d0c9b8c9a1faf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.231817:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020cae025/0x96d0c9b8c9a1faf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.231947:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201653.231989:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.231994:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089583674/0x96d0c9b8c9a1fafe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232002:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c5:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.232005:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.232009:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089583674/0x96d0c9b8c9a1fafe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232035:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089583674/0x96d0c9b8c9a1fafe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232044:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089583674/0x96d0c9b8c9a1fafe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232051:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089583674/0x96d0c9b8c9a1fafe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.232098:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201653.232105:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020cae025/0x96d0c9b8c9a1faf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.232172:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201653.232177:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020cae025/0x96d0c9b8c9a1faf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.232186:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020cae025/0x96d0c9b8c9a1faf7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.232211:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020cae025/0x96d0c9b8c9a1faf7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.232218:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020cae025/0x96d0c9b8c9a1faf7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.232231:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201653.232234:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089583674/0x96d0c9b8c9a1fafe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.232241:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adea00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201653.232245:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089583674/0x96d0c9b8c9a1fafe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.232253:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089583674/0x96d0c9b8c9a1fafe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.232261:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089583674/0x96d0c9b8c9a1fafe lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.232269:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201653.232270:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201653.232272:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.232333:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788201653.232338:0:99767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089583674/0x96d0c9b8c9a1fafe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201653.232403:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.232408:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1fb05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232416:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c4:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.232419:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.232423:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1fb05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232432:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1fb05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232449:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1fb05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232456:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1fb05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232473:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201653.232480:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201653.232484:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1fb05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232491:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.232495:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1fb05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.232498:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.232509:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1fb05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232520:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1fb05 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232527:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1fb05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232540:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.232541:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.232543:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.232586:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.232591:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1fb0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232599:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c3:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.232602:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.232607:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1fb0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232615:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1fb0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232623:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1fb0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232635:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1fb0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232648:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201653.232665:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201653.232669:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1fb0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232675:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adec00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.232678:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1fb0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232685:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1fb0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232696:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1fb0c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232703:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1fb0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232715:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.232717:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.232718:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.232759:0:99767:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.232770:0:99767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000564054f8/0x96d0c9b8c9a1fb13 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232778:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c2:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.232781:0:99767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.232785:0:99767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000564054f8/0x96d0c9b8c9a1fb13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232794:0:99767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000564054f8/0x96d0c9b8c9a1fb13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232801:0:99767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000564054f8/0x96d0c9b8c9a1fb13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232808:0:99767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000564054f8/0x96d0c9b8c9a1fb13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.232828:0:99767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788201653.232958:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201653.232964:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000564054f8/0x96d0c9b8c9a1fb13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.232972:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201653.232987:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000564054f8/0x96d0c9b8c9a1fb13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.232996:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000564054f8/0x96d0c9b8c9a1fb13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.233008:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000564054f8/0x96d0c9b8c9a1fb13 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.233033:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000564054f8/0x96d0c9b8c9a1fb13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 99767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.233048:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201653.233050:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201653.233051:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788201653.234193:0:99767:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:803 00000100:00100000:1.0:1788201653.234301:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:109789:x1875060715524736:12345-0@lo:5:osp-pre-1-0.0 Request processed in 34244us (34384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201653.234312:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788201653.234473:0:109789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:109789:1875060715524736:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788201653.234488:0:109789:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x3e1:0x0] from OST, last_created [0x2c0000401:0x3e1:0x0]last_used is [0x2c0000401:0x323:0x0] 00000100:00100000:0.0:1788201653.234561:0:109789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc45180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:109789:1875060715525120:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788201653.234608:0:109789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201653.234635:0:109789:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc003a3ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788201653.234652:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715524992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201653.234688:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201653.234725:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715524992 00000100:00100000:0.0:1788201653.234732:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715524992 00000100:00100000:0.0:1788201653.234777:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788201653.234786:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715524992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201653.234805:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788201653.234839:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715524992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201653.234845:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788201653.234878:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715524992:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788201653.235949:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201653.236086:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715525120 00000100:00100000:2.0:1788201653.236100:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715525120 00000100:00100000:2.0:1788201653.236601:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788201653.236612:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:109789:x1875060715525120:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788201653.236654:0:99764:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 994 00000100:00100000:2.0:1788201653.240647:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:109789:x1875060715525120:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4031us (6032us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788201653.240670:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788201653.240783:0:109789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc45180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:109789:1875060715525120:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788201653.240799:0:109789:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x3e1:0x0]-[0x2c0000401:0x401:0x0] 00000100:00100000:1.0:1788201653.243125:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201653.243156:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201653.243176:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201653.243212:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695600512 00000100:00100000:1.0:1788201653.243220:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695600512 00000100:00100000:1.0:1788201653.243271:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 74 00000100:00100000:1.0:1788201653.243280:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695600512:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201653.243348:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695600512:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 69us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201653.243357:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 74 00000100:00100000:1.0:1788201653.243387:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695600768 00000100:00100000:1.0:1788201653.243391:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695600768 00000100:00100000:1.0:1788201653.243418:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695600640 00000100:00100000:1.0:1788201653.243421:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695600640 00000100:00100000:1.0:1788201653.243454:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 84 00000100:00100000:1.0:1788201653.243461:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695600768:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201653.243493:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695600768:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 33us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201653.243500:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 84 00000100:00100000:1.0:1788201653.243512:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 85 00000100:00100000:1.0:1788201653.243519:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695600640:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201653.243541:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695600640:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201653.243547:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 85 00002000:00010000:2.0:1788201653.243751:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x401:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201653.243760:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008eb566b/0x96d0c9b8c9a1fb1a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x401:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.243775:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x401:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:2.0:1788201653.243779:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x401:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201653.243786:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008eb566b/0x96d0c9b8c9a1fb1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.243802:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008eb566b/0x96d0c9b8c9a1fb1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.243812:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008eb566b/0x96d0c9b8c9a1fb1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.243820:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008eb566b/0x96d0c9b8c9a1fb1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.243848:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201653.243958:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x400:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201653.243969:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bec305bd/0x96d0c9b8c9a1fb21 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x400:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.243977:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x400:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:2.0:1788201653.243980:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x400:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201653.243984:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bec305bd/0x96d0c9b8c9a1fb21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.243993:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bec305bd/0x96d0c9b8c9a1fb21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.244001:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bec305bd/0x96d0c9b8c9a1fb21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.244007:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bec305bd/0x96d0c9b8c9a1fb21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.244347:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201653.244561:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201653.244569:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008eb566b/0x96d0c9b8c9a1fb1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.244578:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201653.244582:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008eb566b/0x96d0c9b8c9a1fb1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.244590:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008eb566b/0x96d0c9b8c9a1fb1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.244607:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008eb566b/0x96d0c9b8c9a1fb1a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.244619:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008eb566b/0x96d0c9b8c9a1fb1a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x401:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.244634:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201653.244637:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bec305bd/0x96d0c9b8c9a1fb21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.244643:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59a00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201653.244646:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bec305bd/0x96d0c9b8c9a1fb21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.244653:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bec305bd/0x96d0c9b8c9a1fb21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.244674:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bec305bd/0x96d0c9b8c9a1fb21 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.244682:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bec305bd/0x96d0c9b8c9a1fb21 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x400:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.244693:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201653.244694:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201653.244696:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.244746:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201653.245069:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201653.245076:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edd72e98/0x96d0c9b8c9a1fb28 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.245086:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ff:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:2.0:1788201653.245090:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201653.245096:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edd72e98/0x96d0c9b8c9a1fb28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.245177:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edd72e98/0x96d0c9b8c9a1fb28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.245187:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edd72e98/0x96d0c9b8c9a1fb28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.245195:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edd72e98/0x96d0c9b8c9a1fb28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.245214:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788201653.245260:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201653.245266:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd596986/0x96d0c9b8c9a1fb2f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.245274:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3fe:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:2.0:1788201653.245277:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201653.245281:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd596986/0x96d0c9b8c9a1fb2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.245290:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd596986/0x96d0c9b8c9a1fb2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.245298:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd596986/0x96d0c9b8c9a1fb2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.245317:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd596986/0x96d0c9b8c9a1fb2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.245331:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788201653.245339:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201653.245343:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edd72e98/0x96d0c9b8c9a1fb28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1788201653.245349:0:99761:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788201653.245350:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201653.245352:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edd72e98/0x96d0c9b8c9a1fb28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.245360:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edd72e98/0x96d0c9b8c9a1fb28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.245372:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edd72e98/0x96d0c9b8c9a1fb28 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.245379:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edd72e98/0x96d0c9b8c9a1fb28 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.245391:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788201653.245394:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd596986/0x96d0c9b8c9a1fb2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.245414:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201653.245417:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd596986/0x96d0c9b8c9a1fb2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.245425:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd596986/0x96d0c9b8c9a1fb2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.245435:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd596986/0x96d0c9b8c9a1fb2f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.245536:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201653.245901:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd596986/0x96d0c9b8c9a1fb2f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.245915:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201653.245916:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201653.245918:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788201653.245961:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788201653.245966:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065642781/0x96d0c9b8c9a1fb36 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.245974:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3fd:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:2.0:1788201653.245977:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788201653.245982:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065642781/0x96d0c9b8c9a1fb36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.245991:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065642781/0x96d0c9b8c9a1fb36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.246004:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065642781/0x96d0c9b8c9a1fb36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.246011:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065642781/0x96d0c9b8c9a1fb36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.251986:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201653.252092:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201653.252106:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065642781/0x96d0c9b8c9a1fb36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.252118:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc12e6e2800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201653.252131:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065642781/0x96d0c9b8c9a1fb36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.252142:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065642781/0x96d0c9b8c9a1fb36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.252162:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065642781/0x96d0c9b8c9a1fb36 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.252169:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065642781/0x96d0c9b8c9a1fb36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.252187:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201653.252188:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201653.252190:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.252191:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.252198:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1fb3d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.252216:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3fc:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.252220:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.252226:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1fb3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.252237:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1fb3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.252246:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1fb3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.252254:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1fb3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.252279:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201653.252322:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.252328:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1fb44 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.252338:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3fb:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.252341:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.252345:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1fb44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.252354:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1fb44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.252367:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1fb44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.252375:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1fb44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.252390:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788201653.252429:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.252435:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1fb4b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.252676:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788201653.252682:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1fb3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.252690:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201653.252693:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1fb3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.252712:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1fb3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.252715:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201653.252721:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1fb44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.252723:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1fb3d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.252729:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adee00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201653.252731:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000514b297a/0x96d0c9b8c9a1fb3d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.252733:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1fb44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.252740:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1fb44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.252746:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201653.252748:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201653.252749:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201653.252751:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1fb44 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.252768:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052a4837a/0x96d0c9b8c9a1fb44 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.252782:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201653.252784:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201653.252786:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.253110:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3fa:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.253263:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.253270:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1fb4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.253281:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1fb4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.253290:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1fb4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.253298:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1fb4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.254316:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201653.254338:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201653.254345:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1fb4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.254355:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201653.254358:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1fb4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.254366:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1fb4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.254382:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1fb4b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201653.254400:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.254407:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1fb52 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.254411:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b61951f/0x96d0c9b8c9a1fb4b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.254415:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f9:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.254419:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.254424:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1fb52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.254433:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1fb52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.254433:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201653.254435:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201653.254437:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.254916:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1fb52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.254925:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1fb52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.254946:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201653.254998:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.255004:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1fb59 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.255012:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f8:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.255044:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.255049:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1fb59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.255059:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1fb59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.255067:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1fb59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.255074:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1fb59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.255074:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201653.255080:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1fb52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.255087:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.255090:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201653.255090:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1fb52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.255097:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201653.255098:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1fb52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.255100:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1fb59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.255107:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.255111:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1fb59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.255111:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1fb52 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.255119:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1fb59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.255128:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1fb59 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.255145:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030b35a90/0x96d0c9b8c9a1fb59 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.255161:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.255163:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.255165:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201653.255189:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f47e07a0/0x96d0c9b8c9a1fb52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.255206:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.255207:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201653.255208:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.255212:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1fb60 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.255215:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.255220:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f7:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.255223:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.255226:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1fb60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.255235:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1fb60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.255243:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1fb60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.255250:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1fb60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.255271:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201653.255315:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.255320:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1fb67 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.255328:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f6:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.255331:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.255335:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1fb67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.255344:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1fb67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.255351:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1fb67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.255358:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1fb67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.255372:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788201653.255373:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201653.255378:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201653.255378:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1fb60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.255381:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1fb67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.255386:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.255387:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201653.255389:0:24979:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1fb60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.255391:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1fb67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.255408:0:24979:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1fb60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.255409:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1fb67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.255420:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1fb67 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.255428:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6188192/0x96d0c9b8c9a1fb67 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.255536:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1fb60 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.255545:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000154bee4c/0x96d0c9b8c9a1fb60 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.256340:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.256343:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.256346:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.256418:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.256425:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1fb6e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.256436:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f5:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.256916:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.256923:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1fb6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.256935:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1fb6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.256945:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1fb6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.256960:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1fb6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.257042:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201653.257093:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.257098:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1fb75 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.257107:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f4:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.257109:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.257113:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1fb75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.257123:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1fb75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.257130:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1fb75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.257137:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1fb75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.258781:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788201653.258792:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1fb6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.258804:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adec00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:2.0:1788201653.258809:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1fb6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.258819:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1fb6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.258848:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1fb6e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201653.258856:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f92b280a/0x96d0c9b8c9a1fb6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.258962:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201653.258976:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201653.258981:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1fb75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.258996:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.258999:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1fb75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259006:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1fb75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259032:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1fb75 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259040:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000049ad00b/0x96d0c9b8c9a1fb75 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259055:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.259057:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.259059:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.259140:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.259146:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1fb7c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259156:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f3:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.259160:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.259166:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1fb7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259177:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1fb7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259192:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1fb7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259200:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1fb7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259217:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201653.259232:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201653.259237:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1fb7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.259245:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adea00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201653.259248:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1fb7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788201653.259255:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788201653.259255:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1fb7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259259:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1fb83 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259268:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f2:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.259270:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788201653.259273:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1fb7c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259274:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1fb83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.259281:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089583674/0x96d0c9b8c9a1fb7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259284:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1fb83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259291:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1fb83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.259296:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201653.259297:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.259299:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1fb83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.259299:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.259321:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201653.259328:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201653.259332:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1fb83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259338:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfa00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.259341:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1fb83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259348:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1fb83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259359:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1fb83 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259366:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3fc5498/0x96d0c9b8c9a1fb83 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259379:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.259380:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.259382:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.259420:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.259426:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1fb8a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259433:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f1:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.259453:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.259458:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1fb8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259468:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1fb8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259476:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1fb8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259483:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1fb8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259496:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201653.259503:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201653.259506:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1fb8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259513:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adfe00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.259516:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1fb8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259524:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1fb8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259534:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1fb8a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259552:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016617895/0x96d0c9b8c9a1fb8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259565:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.259567:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.259569:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.259610:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.259616:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1fb91 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259624:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f0:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.259627:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.259631:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1fb91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259640:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1fb91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259648:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1fb91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259667:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1fb91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259681:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201653.259693:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201653.259696:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1fb91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259703:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007ade000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.259706:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1fb91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259713:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1fb91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259724:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1fb91 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259731:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000907cfc31/0x96d0c9b8c9a1fb91 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259744:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.259746:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.259747:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.259786:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.259791:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1fb98 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259799:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ef:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.259802:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.259806:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1fb98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259826:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1fb98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259956:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1fb98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259965:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1fb98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259978:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201653.259985:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201653.259988:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1fb98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.259995:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.259998:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1fb98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260005:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1fb98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260035:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1fb98 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260044:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013706e08/0x96d0c9b8c9a1fb98 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260064:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.260066:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.260067:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.260110:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.260116:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1fb9f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260123:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ee:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.260127:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.260130:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1fb9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260139:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1fb9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260146:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1fb9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260152:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1fb9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260164:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201653.260170:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201653.260173:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1fb9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260190:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.260193:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1fb9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260201:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1fb9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260211:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1fb9f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260218:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000564054f8/0x96d0c9b8c9a1fb9f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260230:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.260232:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.260234:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.260274:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.260279:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1fba6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260286:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ed:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.260289:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.260293:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1fba6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260302:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1fba6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260314:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1fba6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260321:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1fba6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260333:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201653.260339:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201653.260343:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1fba6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260349:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc007adf400 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.260353:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1fba6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260360:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1fba6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260370:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1fba6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260377:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020cae025/0x96d0c9b8c9a1fba6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260390:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.260396:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.260397:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.260500:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.260506:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e751138/0x96d0c9b8c9a1fbad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260514:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ec:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.260517:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.260521:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e751138/0x96d0c9b8c9a1fbad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260530:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e751138/0x96d0c9b8c9a1fbad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260537:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e751138/0x96d0c9b8c9a1fbad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260545:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e751138/0x96d0c9b8c9a1fbad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260558:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201653.260565:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201653.260569:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e751138/0x96d0c9b8c9a1fbad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260575:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075ef200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.260579:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e751138/0x96d0c9b8c9a1fbad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260596:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e751138/0x96d0c9b8c9a1fbad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260607:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e751138/0x96d0c9b8c9a1fbad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260614:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e751138/0x96d0c9b8c9a1fbad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260627:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.260629:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.260630:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.260684:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.260689:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1fbb4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260698:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3eb:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.260701:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.260705:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1fbb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260713:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1fbb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260720:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1fbb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260730:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1fbb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260742:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201653.260748:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201653.260752:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1fbb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260759:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075eea00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.260762:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1fbb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260769:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1fbb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260779:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1fbb4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260786:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ef58d5a/0x96d0c9b8c9a1fbb4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.260800:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.260801:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.260803:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201653.260946:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201653.260949:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201653.260955:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201653.260981:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201653.260983:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788201653.260985:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.261356:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.261369:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1fbbb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261377:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ea:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.261380:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.261384:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1fbbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261393:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1fbbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261402:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1fbbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261409:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1fbbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261422:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201653.261429:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201653.261432:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1fbbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261450:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075ee800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.261454:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1fbbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261461:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1fbbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261479:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1fbbb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261486:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cdcdad5/0x96d0c9b8c9a1fbbb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261500:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.261502:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.261504:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.261551:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.261557:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1fbc2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261564:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e9:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.261567:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.261571:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1fbc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261580:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1fbc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261588:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1fbc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261594:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1fbc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261611:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201653.261618:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201653.261622:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1fbc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261628:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075eee00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.261631:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1fbc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261639:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1fbc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261650:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1fbc2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261670:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e6b68d5/0x96d0c9b8c9a1fbc2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261683:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.261685:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.261686:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.261727:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.261732:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a1fbc9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261740:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e8:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.261747:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.261752:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a1fbc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261762:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a1fbc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261770:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a1fbc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261778:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a1fbc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261791:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201653.261829:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.261911:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d770280/0x96d0c9b8c9a1fbd0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261920:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e7:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.261922:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.261926:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d770280/0x96d0c9b8c9a1fbd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261935:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d770280/0x96d0c9b8c9a1fbd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261942:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d770280/0x96d0c9b8c9a1fbd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261955:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d770280/0x96d0c9b8c9a1fbd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.261968:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788201653.262007:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.262011:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a2b4130/0x96d0c9b8c9a1fbd7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262040:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e6:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.262044:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.262048:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a2b4130/0x96d0c9b8c9a1fbd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262056:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a2b4130/0x96d0c9b8c9a1fbd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262063:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a2b4130/0x96d0c9b8c9a1fbd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262071:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a2b4130/0x96d0c9b8c9a1fbd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262082:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788201653.262088:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201653.262092:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a1fbc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262103:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075ef600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.262106:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a1fbc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262112:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a1fbc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262123:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a1fbc9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262130:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f0f7d75/0x96d0c9b8c9a1fbc9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262143:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201653.262146:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d770280/0x96d0c9b8c9a1fbd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262151:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075ee000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.262154:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d770280/0x96d0c9b8c9a1fbd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262161:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d770280/0x96d0c9b8c9a1fbd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262170:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d770280/0x96d0c9b8c9a1fbd0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262182:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d770280/0x96d0c9b8c9a1fbd0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262194:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201653.262197:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a2b4130/0x96d0c9b8c9a1fbd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262203:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075ee600 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.262206:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a2b4130/0x96d0c9b8c9a1fbd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262213:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a2b4130/0x96d0c9b8c9a1fbd7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262223:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a2b4130/0x96d0c9b8c9a1fbd7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262229:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a2b4130/0x96d0c9b8c9a1fbd7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262238:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.262240:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.262242:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.262279:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.262284:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9f8f773/0x96d0c9b8c9a1fbde lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262296:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e5:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.262299:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.262303:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9f8f773/0x96d0c9b8c9a1fbde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262312:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9f8f773/0x96d0c9b8c9a1fbde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262319:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9f8f773/0x96d0c9b8c9a1fbde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262326:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9f8f773/0x96d0c9b8c9a1fbde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262350:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201653.262387:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.262391:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068ebde1a/0x96d0c9b8c9a1fbe5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262399:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e4:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.262401:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.262405:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068ebde1a/0x96d0c9b8c9a1fbe5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262413:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068ebde1a/0x96d0c9b8c9a1fbe5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262427:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068ebde1a/0x96d0c9b8c9a1fbe5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262433:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068ebde1a/0x96d0c9b8c9a1fbe5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262446:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788201653.262453:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201653.262456:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9f8f773/0x96d0c9b8c9a1fbde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262463:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075ef000 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.262467:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9f8f773/0x96d0c9b8c9a1fbde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262474:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9f8f773/0x96d0c9b8c9a1fbde lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262484:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9f8f773/0x96d0c9b8c9a1fbde lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262492:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9f8f773/0x96d0c9b8c9a1fbde lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262504:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201653.262512:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068ebde1a/0x96d0c9b8c9a1fbe5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262518:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075ee200 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:1.0:1788201653.262521:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068ebde1a/0x96d0c9b8c9a1fbe5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.262527:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.262529:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068ebde1a/0x96d0c9b8c9a1fbe5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262540:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068ebde1a/0x96d0c9b8c9a1fbe5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262547:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068ebde1a/0x96d0c9b8c9a1fbe5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262558:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.262559:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201653.262561:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788201653.262599:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.262605:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e91f28e3/0x96d0c9b8c9a1fbec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262612:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e3:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.262615:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.262619:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e91f28e3/0x96d0c9b8c9a1fbec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262638:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e91f28e3/0x96d0c9b8c9a1fbec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262646:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e91f28e3/0x96d0c9b8c9a1fbec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262652:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e91f28e3/0x96d0c9b8c9a1fbec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262912:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788201653.262952:0:101188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788201653.262958:0:101188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3b8d3e/0x96d0c9b8c9a1fbf3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262966:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e2:0x0].0x0 since=4504s v=(0 0) 00010000:00010000:1.0:1788201653.262969:0:101188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788201653.262973:0:101188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b3b8d3e/0x96d0c9b8c9a1fbf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262982:0:101188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b3b8d3e/0x96d0c9b8c9a1fbf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.262989:0:101188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3b8d3e/0x96d0c9b8c9a1fbf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.263006:0:101188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b3b8d3e/0x96d0c9b8c9a1fbf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.263065:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201653.263070:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e91f28e3/0x96d0c9b8c9a1fbec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.263077:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075ef800 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201653.263081:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201653.263081:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e91f28e3/0x96d0c9b8c9a1fbec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201653.263086:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201653.263089:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e91f28e3/0x96d0c9b8c9a1fbec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.263101:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e91f28e3/0x96d0c9b8c9a1fbec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.263108:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e91f28e3/0x96d0c9b8c9a1fbec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201653.263170:0:101188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788201653.263203:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788201653.263206:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b3b8d3e/0x96d0c9b8c9a1fbf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.263213:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075efc00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:3.0:1788201653.263216:0:13349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3b8d3e/0x96d0c9b8c9a1fbf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.263224:0:13349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3b8d3e/0x96d0c9b8c9a1fbf3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.263234:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b3b8d3e/0x96d0c9b8c9a1fbf3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.263241:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b3b8d3e/0x96d0c9b8c9a1fbf3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 101188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201653.263252:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201653.263254:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788201653.267068:0:101188:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:918 00000100:00100000:1.0:1788201653.267179:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:109787:x1875060715524864:12345-0@lo:5:osp-pre-0-0.0 Request processed in 66039us (66372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201653.267191:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788201653.268110:0:109787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:109787:1875060715524864:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788201653.268126:0:109787:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x401:0x0] from OST, last_created [0x280000401:0x401:0x0]last_used is [0x280000401:0x396:0x0] 00000100:00100000:1.0:1788201653.268189:0:109787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:109787:1875060715525376:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788201653.268228:0:109787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201653.268260:0:109787:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc139bf70c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788201653.268379:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201653.268393:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715525248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201653.268423:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201653.269062:0:99766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715525376 00000100:00100000:0.0:1788201653.269070:0:99766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715525376 00000100:00100000:0.0:1788201653.269112:0:99766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788201653.269121:0:99766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:109787:x1875060715525376:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788201653.269163:0:99766:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1026 00000100:00100000:1.0:1788201653.269558:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715525248 00000100:00100000:1.0:1788201653.269563:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715525248 00000100:00100000:1.0:1788201653.269594:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788201653.269601:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715525248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201653.269614:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 896 free 3922464768 avail 3690942464 00000100:00100000:1.0:1788201653.269679:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715525248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201653.269686:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788201653.271553:0:99766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:109787:x1875060715525376:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2428us (3320us total) trans 12884901914 rc 0/0 00000100:00100000:0.0:1788201653.271564:0:99766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788201653.271635:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715525248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201653.271769:0:109787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005254000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:109787:1875060715525376:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788201653.271782:0:109787:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x401:0x0]-[0x280000401:0x421:0x0] 00010000:00010000:3.0:1788201653.272252:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788201653.304760:0:110106:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788201653.305181:0:110106:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000001:00100000:3.0:1788201653.590946:0:107392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788201653.647399:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788201654.067636:0:110157:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788201654.067892:0:110157:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788201654.671245:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201655.695229:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201655.933413:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201655.933935:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695600896 00000100:00100000:2.0:1788201655.933947:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695600896 00000100:00100000:2.0:1788201655.934079:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 93 00000100:00100000:2.0:1788201655.934091:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:81760:x1875060695600896:12345-192.168.201.20@tcp:101:lfs.0 00010000:00010000:2.0:1788201655.934111:0:107403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201655.934135:0:107403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1fbfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64c4f98b7f7870d0 expref: -99 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201655.934211:0:107403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1fc01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201655.934225:0:107403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1fc01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201655.934238:0:107403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1fc01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788201655.934291:0:107403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788201655.934295:0:107403:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788201655.934348:0:107403:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1fc01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 107403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201655.934383:0:107403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e2400/0x96d0c9b8c9a1fbfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7870d0 expref: 8 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201655.934414:0:107403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dc12e6e3200/0x96d0c9b8c9a1fc01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7870d0 expref: 7 pid: 107403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201655.934423:0:107403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dc107816300) 00010000:00010000:2.0:1788201655.934426:0:107403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788201655.934430:0:107403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e3200, rc 0) 00000100:00100000:2.0:1788201655.934488:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:81760:x1875060695600896:12345-192.168.201.20@tcp:101:lfs.0 Request processed in 399us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201655.934495:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 93 00000100:00080000:3.0:1788201655.935213:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201655.940925:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201655.941063:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695601024 00000100:00100000:1.0:1788201655.941072:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695601024 00000100:00100000:1.0:1788201655.941152:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 94 00000100:00100000:1.0:1788201655.941161:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0071f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:81760:x1875060695601024:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:1.0:1788201655.941198:0:107405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444941824 avail 1298702336 00000100:00100000:1.0:1788201655.941325:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0071f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:81760:x1875060695601024:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 164us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201655.941332:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 94 00000100:00100000:0.0:1788201655.943999:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201655.944160:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695601152 00000100:00100000:2.0:1788201655.944171:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695601152 00000100:00100000:2.0:1788201655.944255:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 95 00000100:00100000:2.0:1788201655.944265:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:81760:x1875060695601152:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:2.0:1788201655.944307:0:107403:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445376000 avail 1299136512 00000100:00100000:2.0:1788201655.944383:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:81760:x1875060695601152:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 111us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201655.944391:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 95 00000100:00080000:3.0:1788201655.945095:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201655.949099:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201655.949421:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695601280 00000100:00100000:0.0:1788201655.949432:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695601280 00000100:00100000:0.0:1788201655.949488:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 92 00000100:00100000:0.0:1788201655.949497:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0071f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2399:x1875060695601280:12345-192.168.201.20@tcp:8:lfs.0 00010000:00080000:0.0:1788201655.949533:0:101192:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp t8589934594 exp 0000000000000000 cur 4507 last 0 00000020:00000080:0.0:1788201655.949563:0:101192:0:(genops.c:1385:class_connect()) connect: client 6e293f14-c501-4bc5-9dd4-a18ef02756b4, cookie 0x96d0c9b8c9a1fc08 00002000:00100000:0.0:1788201655.949576:0:101192:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6e293f14-c501-4bc5-9dd4-a18ef02756b4/ffff8dc10603f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8359936 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788201655.949594:0:101192:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788201655.949662:0:101192:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788201655.949692:0:101192:0:(import.c:65:import_set_state_nolock()) ffff8dc10603a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788201655.949767:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0071f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695601280:12345-192.168.201.20@tcp:8:lfs.0 Request processed in 270us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201655.949775:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 92 00000100:00100000:0.0:1788201655.952715:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201655.952827:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695601408 00000100:00100000:1.0:1788201655.952838:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695601408 00000100:00080000:3.0:1788201655.953083:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201655.953172:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 192 00000100:00100000:1.0:1788201655.953187:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:81760:x1875060695601408:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:1.0:1788201655.953222:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635456 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1788201655.953292:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:81760:x1875060695601408:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 109us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201655.956221:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201655.956302:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695601536 00000100:00100000:3.0:1788201655.956312:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695601536 00000100:00100000:3.0:1788201655.956359:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 93 00000100:00100000:3.0:1788201655.956368:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1875060695601536:12345-192.168.201.20@tcp:8:lfs.0 00010000:00080000:3.0:1788201655.956411:0:99767:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6e293f14-c501-4bc5-9dd4-a18ef02756b4@192.168.201.20@tcp t0 exp 0000000000000000 cur 4507 last 0 00000020:00000080:3.0:1788201655.956443:0:99767:0:(genops.c:1385:class_connect()) connect: client 6e293f14-c501-4bc5-9dd4-a18ef02756b4, cookie 0x96d0c9b8c9a1fc0f 00002000:00100000:3.0:1788201655.956454:0:99767:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6e293f14-c501-4bc5-9dd4-a18ef02756b4/ffff8dc001e2f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788201655.956471:0:99767:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788201655.956535:0:99767:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788201655.956565:0:99767:0:(import.c:65:import_set_state_nolock()) ffff8dc0053a2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201655.956637:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2399:x1875060695601536:12345-192.168.201.20@tcp:8:lfs.0 Request processed in 268us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201655.956645:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 93 00000100:00100000:3.0:1788201655.962784:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201655.962885:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695601664 00000100:00100000:0.0:1788201655.962895:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695601664 00000100:00100000:0.0:1788201655.962968:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 193 00000100:00100000:0.0:1788201655.962978:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0071f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:81760:x1875060695601664:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:0.0:1788201655.963001:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8664128 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788201655.963083:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0071f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:81760:x1875060695601664:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 107us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201655.963090:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 193 00000100:00080000:3.0:1788201655.963833:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788201655.965500:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 192 00010000:00010000:3.0:1788201656.719347:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201657.679819:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f456d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715525504:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201657.679917:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201657.679979:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201657.679985:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715525632:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201657.680012:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201657.680075:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715525504 00000100:00100000:2.0:1788201657.680086:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715525504 00000100:00100000:2.0:1788201657.680156:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715525632 00000100:00100000:2.0:1788201657.680169:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715525632 00000100:00100000:2.0:1788201657.680195:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788201657.680205:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007159880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715525504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201657.680241:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8664128 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201657.680292:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007159880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715525504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201657.680301:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788201657.680320:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788201657.680326:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715525632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201657.680343:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635456 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201657.680369:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715525632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201657.680375:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:3.0:1788201657.682914:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201657.682925:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201657.683501:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715525632:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201657.683525:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f456d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715525504:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788201657.743169:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201658.191227:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715525760:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201658.191347:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201658.191429:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715525760 00000100:00100000:2.0:1788201658.191439:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715525760 00000100:00100000:2.0:1788201658.191498:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788201658.191508:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715525760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201658.191621:0:99776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444941824 avail 1298702336 00000100:00100000:2.0:1788201658.191743:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715525760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 235us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201658.191751:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788201658.191837:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715525760:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201658.192006:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0071f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715525888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788201658.192067:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201658.192222:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715525888 00000100:00100000:2.0:1788201658.192227:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715525888 00000100:00100000:2.0:1788201658.192298:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788201658.192307:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0071f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715525888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201658.192329:0:99775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445376000 avail 1299136512 00000100:00100000:2.0:1788201658.192368:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0071f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715525888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201658.192375:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788201658.199217:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715526016:0@lo:400:kworker.0 00000100:00100000:1.0:1788201658.199350:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201658.199414:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f455500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715526528:0@lo:400:kworker.0 00000100:00100000:1.0:1788201658.199447:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201658.199472:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715527040:0@lo:400:kworker.0 00000100:00100000:1.0:1788201658.199499:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201658.199529:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788201658.199537:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715526144:0@lo:400:kworker.0 00000100:00100000:1.0:1788201658.199848:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201658.199871:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715526656:0@lo:400:kworker.0 00000100:00100000:1.0:1788201658.200049:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201658.200110:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715526528 00000100:00100000:1.0:1788201658.200121:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715526528 00000100:00100000:1.0:1788201658.200190:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715527040 00000100:00100000:1.0:1788201658.200194:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715527040 00000100:00100000:1.0:1788201658.200392:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715526144 00000100:00100000:1.0:1788201658.200397:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715526144 00000100:00100000:1.0:1788201658.200416:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715526656 00000100:00100000:1.0:1788201658.200419:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715526656 00000100:00100000:1.0:1788201658.200438:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788201658.200447:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715526528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201658.200515:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1875060715526528:12345-0@lo:400:kworker.0 Request processed in 67us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201658.200523:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788201658.200546:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788201658.200552:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715527040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201658.202265:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715527040:12345-0@lo:400:kworker.0 Request processed in 1708us (2759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201658.202275:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788201658.202303:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788201658.202313:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715526144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201658.202337:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715526144:12345-0@lo:400:kworker.0 Request processed in 27us (2490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201658.202342:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788201658.202351:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788201658.202357:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715526656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201658.202378:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715526656:12345-0@lo:400:kworker.0 Request processed in 22us (2330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201658.202395:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788201658.202431:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715526400:0@lo:400:kworker.0 00000100:00100000:1.0:1788201658.202469:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201658.202493:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715526912:0@lo:400:kworker.0 00000100:00100000:1.0:1788201658.202516:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201658.202581:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0071f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715525888:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201658.202609:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788201658.202615:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715526272:0@lo:400:kworker.0 00000100:00100000:1.0:1788201658.202638:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201658.202665:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715526784:0@lo:400:kworker.0 00000100:00100000:1.0:1788201658.202685:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201658.202712:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715526912 00000100:00100000:1.0:1788201658.202717:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715526912 00000100:00100000:1.0:1788201658.202761:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715526784 00000100:00100000:1.0:1788201658.202764:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715526784 00000100:00100000:1.0:1788201658.202788:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788201658.202796:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f457b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715526912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201658.202831:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f457b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715526912:12345-0@lo:400:kworker.0 Request processed in 36us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201658.202837:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788201658.202851:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788201658.202857:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f456d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715526784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201658.202896:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f456d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715526784:12345-0@lo:400:kworker.0 Request processed in 39us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201658.202902:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788201658.202931:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715526400 00000100:00100000:1.0:1788201658.202935:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715526400 00000100:00100000:1.0:1788201658.202954:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715526272 00000100:00100000:1.0:1788201658.202957:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715526272 00000100:00100000:1.0:1788201658.202972:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788201658.202978:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715526400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201658.203006:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875060715526400:12345-0@lo:400:kworker.0 Request processed in 29us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201658.203013:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788201658.203046:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788201658.203052:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715526272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201658.203079:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875060715526272:12345-0@lo:400:kworker.0 Request processed in 27us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201658.203084:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788201658.203109:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715526272:0@lo:400:kworker.0 00000100:00100000:1.0:1788201658.203121:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715526784:0@lo:400:kworker.0 00000100:00100000:1.0:1788201658.203130:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3658:1875060715526400:0@lo:400:kworker.0 00000100:00100000:1.0:1788201658.203139:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715526912:0@lo:400:kworker.0 00000100:00100000:1.0:1788201658.203175:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715526144:0@lo:400:kworker.0 00000100:00100000:1.0:1788201658.203187:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715526656:0@lo:400:kworker.0 00000100:00100000:1.0:1788201658.203200:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f455500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3655:1875060715526528:0@lo:400:kworker.0 00000100:00100000:1.0:1788201658.203213:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715527040:0@lo:400:kworker.0 00000100:00080000:3.0:1788201658.206846:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201658.206862:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201658.206868:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201658.206872:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201658.213291:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715526016 00000100:00100000:1.0:1788201658.213389:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715526016 00000100:00100000:1.0:1788201658.213519:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788201658.213533:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715526016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201658.213682:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715526016:12345-0@lo:400:kworker.0 Request processed in 152us (14331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201658.213690:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788201658.239225:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715526016:0@lo:400:kworker.0 00000100:00100000:0.0:1788201658.327904:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201658.328257:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201658.328321:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201658.328373:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201658.328413:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201658.328455:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695602048 00000100:00100000:0.0:1788201658.328469:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695602048 00000100:00100000:0.0:1788201658.328550:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695601920 00000100:00100000:0.0:1788201658.328554:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695601920 00000100:00100000:0.0:1788201658.328597:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 92 00000100:00100000:0.0:1788201658.328611:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2403:x1875060695602048:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201658.328789:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2403:x1875060695602048:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 180us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201658.328798:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 92 00000100:00100000:0.0:1788201658.328820:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 93 00000100:00100000:0.0:1788201658.328828:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695601920:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201658.328854:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695601920:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 28us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201658.328861:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 93 00000100:00100000:0.0:1788201658.329075:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695602304 00000100:00100000:0.0:1788201658.329080:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695602304 00000100:00100000:0.0:1788201658.329115:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695602176 00000100:00100000:0.0:1788201658.329118:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695602176 00000100:00100000:0.0:1788201658.329142:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 220 00000100:00100000:0.0:1788201658.329148:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2403:x1875060695602304:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201658.329178:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2403:x1875060695602304:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 30us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201658.329184:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 220 00000100:00100000:0.0:1788201658.329206:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 221 00000100:00100000:0.0:1788201658.329212:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2403:x1875060695602176:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201658.329238:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2403:x1875060695602176:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 26us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201658.329244:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 221 00000100:00080000:0.0:1788201658.329268:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788201658.329273:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201658.329277:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201658.329279:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201658.334529:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695601792 00000100:00100000:1.0:1788201658.334550:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695601792 00000100:00100000:1.0:1788201658.334676:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 76 00000100:00100000:1.0:1788201658.334692:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695601792:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201658.334794:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695601792:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 106us (6903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201658.334803:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 76 00000100:00100000:0.0:1788201658.704854:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715527168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201658.704927:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201658.704985:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715527168 00000100:00100000:0.0:1788201658.704993:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715527168 00000100:00100000:0.0:1788201658.705070:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788201658.705080:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715527168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201658.705103:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635456 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201658.705148:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1875060715527168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201658.705155:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788201658.705202:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715527168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201658.710598:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788201658.710620:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715527296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201658.710688:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201658.710731:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715527296 00000100:00100000:1.0:1788201658.710749:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715527296 00000100:00100000:1.0:1788201658.710797:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788201658.710805:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f455180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715527296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201658.710825:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8664128 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201658.710865:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f455180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1875060715527296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201658.710872:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788201658.710917:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715527296:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1788201658.718269:0:100576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000001:00080000:0.0:1788201658.718286:0:100576:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00010000:00010000:0.0:1788201658.767180:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788201659.730271:0:99761:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000001:00080000:2.0:1788201659.730289:0:99761:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901914 is committed 00010000:00010000:0.0:1788201659.791215:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201660.818576:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788201661.741821:0:110351:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg120-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:0.0:1788201661.839315:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201662.800142:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715527424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201662.800214:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201662.800251:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0071f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715527552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201662.800268:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715527424 00000100:00100000:2.0:1788201662.800275:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715527424 00000100:00100000:3.0:1788201662.800301:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201662.800332:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715527552 00000100:00100000:3.0:1788201662.800336:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715527552 00000100:00100000:2.0:1788201662.800339:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788201662.800347:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00715aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715527424:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201662.800356:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788201662.800362:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0071f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715527552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201662.800374:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8664128 pending 0 free 3923513344 avail 3691991040 00002000:00000024:3.0:1788201662.800375:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635456 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201662.800412:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00715aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715527424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201662.800418:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788201662.800423:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0071f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715527552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201662.800427:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:2.0:1788201662.800438:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201662.800441:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201662.800462:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715527424:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201662.800462:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0071f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715527552:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788201662.864294:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201663.312577:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715527936:0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.312662:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201663.312705:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715528448:0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.312732:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201663.312749:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715528960:0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.312775:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201663.312800:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788201663.312804:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715527808:0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.312829:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201663.312855:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715528320:0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.312876:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201663.312892:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715528832:0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.312910:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201663.312942:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715527936 00000100:00100000:2.0:1788201663.312949:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715527936 00000100:00100000:2.0:1788201663.312998:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715528320 00000100:00100000:2.0:1788201663.313001:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715528320 00000100:00100000:2.0:1788201663.313047:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788201663.313057:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a7dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715527936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.313182:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a7dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715527936:12345-0@lo:400:kworker.0 Request processed in 127us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201663.313191:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788201663.313208:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788201663.313215:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a7dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715528320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.313242:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a7dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715528320:12345-0@lo:400:kworker.0 Request processed in 28us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201663.313248:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788201663.313333:0:109785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715528448 00000100:00100000:2.0:1788201663.313343:0:109785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715528448 00000100:00100000:2.0:1788201663.313371:0:109785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788201663.313377:0:109785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a7df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715528448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.313409:0:109785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a7df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715528448:12345-0@lo:400:kworker.0 Request processed in 32us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201663.313415:0:109785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788201663.313432:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715528960 00000100:00100000:2.0:1788201663.313435:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715528960 00000100:00100000:2.0:1788201663.313459:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715528832 00000100:00100000:2.0:1788201663.313462:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715528832 00000100:00100000:2.0:1788201663.313490:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788201663.313496:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a7dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715528960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.313527:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a7dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715528960:12345-0@lo:400:kworker.0 Request processed in 31us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201663.313532:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788201663.313543:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788201663.313549:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a7dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715528832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.313575:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a7dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715528832:12345-0@lo:400:kworker.0 Request processed in 27us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201663.313580:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788201663.313597:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715527808 00000100:00100000:2.0:1788201663.313601:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715527808 00000100:00100000:2.0:1788201663.313626:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788201663.313632:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715527808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.313658:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715527808:12345-0@lo:400:kworker.0 Request processed in 27us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201663.313663:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788201663.313699:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201663.313703:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201663.313706:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201663.313708:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201663.313745:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715527808:0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.313757:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715528320:0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.313764:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901914 gen 2 00000100:00100000:2.0:1788201663.313777:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715528832:0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.313786:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715527936:0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.313794:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715528448:0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.313801:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000100:00100000:2.0:1788201663.313808:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715528960:0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.314212:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715528064:0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.315394:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201663.315432:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715528576:0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.315466:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201663.315494:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715529088:0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.315518:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201663.315540:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788201663.315546:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715527680:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201663.315569:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201663.315585:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00715b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715528192:0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.315604:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201663.315628:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715528704:0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.315646:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201663.315660:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f455500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715529216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201663.315680:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201663.315717:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715527680 00000100:00100000:2.0:1788201663.315722:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715527680 00000100:00100000:2.0:1788201663.315752:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715528704 00000100:00100000:2.0:1788201663.315754:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715528704 00000100:00100000:2.0:1788201663.315763:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715529216 00000100:00100000:2.0:1788201663.315765:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715529216 00000100:00100000:2.0:1788201663.315779:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788201663.315787:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a7dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715527680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201663.315816:0:99775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445376000 avail 1299136512 00000100:00100000:2.0:1788201663.315854:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a7dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3655:x1875060715527680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201663.315860:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788201663.315875:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788201663.315880:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a7dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715528704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.315906:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a7dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715528704:12345-0@lo:400:kworker.0 Request processed in 26us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201663.315911:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788201663.315921:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788201663.315927:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a7dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715529216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788201663.315942:0:99775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444941824 avail 1298702336 00000100:00100000:2.0:1788201663.315967:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a7dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715529216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 40us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201663.315973:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788201663.315999:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715528064 00000100:00100000:2.0:1788201663.316003:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715528064 00000100:00100000:2.0:1788201663.316044:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715528576 00000100:00100000:2.0:1788201663.316048:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715528576 00000100:00100000:2.0:1788201663.316057:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715529088 00000100:00100000:2.0:1788201663.316059:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715529088 00000100:00100000:2.0:1788201663.316067:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715528192 00000100:00100000:2.0:1788201663.316069:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715528192 00000100:00100000:2.0:1788201663.316083:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788201663.316089:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a7df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715528064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.318728:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a7df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715528064:12345-0@lo:400:kworker.0 Request processed in 2632us (3329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201663.318740:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788201663.318779:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788201663.318789:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a7ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715528576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.318827:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a7ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715528576:12345-0@lo:400:kworker.0 Request processed in 42us (3361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201663.318833:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788201663.318844:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788201663.318850:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a7dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715529088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.318875:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a7dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715529088:12345-0@lo:400:kworker.0 Request processed in 26us (3357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201663.318880:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788201663.318891:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788201663.318898:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a7dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715528192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.318943:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a7dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715528192:12345-0@lo:400:kworker.0 Request processed in 47us (3338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201663.318958:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:2.0:1788201663.318983:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201663.318990:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201663.319054:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715527680:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201663.319068:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00715b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715528192:0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.319077:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715528704:0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.319089:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f455500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715529216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201663.321078:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715528064:0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.321412:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715528576:0@lo:400:kworker.0 00000100:00100000:2.0:1788201663.321428:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715529088:0@lo:400:kworker.0 00000001:02000400:0.0:1788201663.322898:0:110399:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:0.0:1788201663.445552:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201663.445626:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201663.445659:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201663.445686:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201663.445729:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695602432 00000100:00100000:3.0:1788201663.445739:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695602432 00000100:00100000:3.0:1788201663.445785:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 78 00000100:00100000:3.0:1788201663.445794:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695602432:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201663.445854:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695602432:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 61us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201663.445861:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 78 00000100:00100000:1.0:1788201663.446101:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695602816 00000100:00100000:1.0:1788201663.446105:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695602816 00000100:00100000:1.0:1788201663.446154:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 224 00000100:00100000:1.0:1788201663.446161:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695602816:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201663.446188:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695602816:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 28us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201663.446194:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 224 00000100:00080000:3.0:1788201663.446791:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201663.447104:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201663.447157:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695602944 00000100:00100000:0.0:1788201663.447161:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695602944 00000100:00100000:0.0:1788201663.447194:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 225 00000100:00100000:0.0:1788201663.447201:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695602944:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201663.447235:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695602944:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 35us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201663.447242:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 225 00000100:00080000:0.0:1788201663.447506:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201663.447686:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695602560 00000100:00100000:2.0:1788201663.447691:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695602560 00000100:00100000:2.0:1788201663.447763:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695602688 00000100:00100000:2.0:1788201663.447767:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695602688 00000100:00100000:3.0:1788201663.447791:0:109776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 100 00000100:00100000:3.0:1788201663.447798:0:109776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2400:x1875060695602560:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201663.447870:0:109776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2400:x1875060695602560:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 73us (2327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201663.447876:0:109776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 100 00000100:00080000:0.0:1788201663.448195:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201663.448199:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201663.448301:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 101 00000100:00100000:2.0:1788201663.448307:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2400:x1875060695602688:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201663.448367:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2400:x1875060695602688:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 60us (2680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201663.448374:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 101 00000100:00100000:2.0:1788201663.823347:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201663.823375:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715529344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201663.823459:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201663.823780:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715529344 00000100:00100000:0.0:1788201663.823789:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715529344 00000100:00100000:2.0:1788201663.824409:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a7ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715529472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201663.824463:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201663.838953:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715529472 00000100:00100000:0.0:1788201663.838968:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715529472 00000100:00100000:0.0:1788201663.839040:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788201663.839051:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a7dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715529344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201663.839078:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8664128 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788201663.839146:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a7dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715529344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (15687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201663.839154:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788201663.839171:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788201663.839178:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a7de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715529472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788201663.839208:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635456 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201663.839238:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a7de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715529472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (14773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201663.839246:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788201663.839340:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a7ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715529472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201663.839358:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715529344:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788201663.887215:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201664.911346:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201665.289135:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201665.289200:0:109776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695603072 00000100:00100000:3.0:1788201665.289237:0:109776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695603072 00000100:00100000:3.0:1788201665.289355:0:109776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 96 00000100:00100000:3.0:1788201665.289368:0:109776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:82227:x1875060695603072:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:3.0:1788201665.289406:0:109776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444941824 avail 1298702336 00000100:00100000:3.0:1788201665.289502:0:109776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:82227:x1875060695603072:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 137us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201665.289511:0:109776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 96 00000100:00080000:0.0:1788201665.289863:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201665.300009:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201665.300121:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695603200 00000100:00100000:2.0:1788201665.300133:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695603200 00000100:00080000:0.0:1788201665.300198:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788201665.300217:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 97 00000100:00100000:2.0:1788201665.300231:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0071f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:82227:x1875060695603200:12345-192.168.201.20@tcp:41:lfs.0 00000004:00000024:2.0:1788201665.300269:0:107403:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445376000 avail 1299136512 00000100:00100000:2.0:1788201665.300345:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0071f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:82227:x1875060695603200:12345-192.168.201.20@tcp:41:lfs.0 Request processed in 117us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201665.300353:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 97 00000100:00100000:2.0:1788201665.306141:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201665.306869:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695603328 00000100:00100000:0.0:1788201665.306880:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695603328 00000100:00100000:0.0:1788201665.306971:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 202 00000100:00100000:0.0:1788201665.306983:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a7ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:82227:x1875060695603328:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:0.0:1788201665.307048:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635456 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201665.307126:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a7ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:82227:x1875060695603328:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 145us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201665.307134:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 202 00000100:00080000:3.0:1788201665.307796:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201665.318153:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201665.318560:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695603456 00000100:00100000:1.0:1788201665.318571:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695603456 00000100:00100000:1.0:1788201665.318693:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 203 00000100:00100000:1.0:1788201665.318706:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:82227:x1875060695603456:12345-192.168.201.20@tcp:13:lfs.0 00002000:00000024:1.0:1788201665.318740:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8664128 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201665.318831:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:82227:x1875060695603456:12345-192.168.201.20@tcp:13:lfs.0 Request processed in 128us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201665.318839:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 203 00000100:00080000:3.0:1788201665.320560:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788201665.935369:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201666.962607:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201667.923937:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a7ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715529600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201667.924051:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201667.924953:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715529600 00000100:00100000:2.0:1788201667.924962:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715529600 00000100:00100000:2.0:1788201667.925045:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788201667.925056:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0071f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715529600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201667.925091:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635456 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201667.925155:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0071f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715529600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201667.926361:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:2.0:1788201667.926460:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201667.926599:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a7ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715529600:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201667.931294:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715529728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201667.931366:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201667.931511:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715529728 00000100:00100000:1.0:1788201667.931520:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715529728 00000100:00100000:1.0:1788201667.931592:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788201667.931604:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715529728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201667.931631:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8664128 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201667.931677:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715529728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201667.931684:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788201667.931727:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715529728:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788201667.931809:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788201667.983649:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201668.431340:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788201668.431364:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a7de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715529856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201668.431450:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201668.431507:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715529856 00000100:00100000:2.0:1788201668.431514:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715529856 00000100:00100000:2.0:1788201668.431577:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788201668.431585:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a7df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715529856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201668.431616:0:99775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445376000 avail 1299136512 00000100:00100000:2.0:1788201668.431670:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a7df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715529856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201668.431677:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788201668.431722:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a7de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715529856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201668.431993:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715530112:0@lo:400:kworker.0 00000100:00100000:0.0:1788201668.432052:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201668.432074:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10785b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715530624:0@lo:400:kworker.0 00000100:00100000:0.0:1788201668.432097:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201668.432122:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc107859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715531136:0@lo:400:kworker.0 00000100:00100000:0.0:1788201668.432144:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201668.432165:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788201668.432170:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10785ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715530240:0@lo:400:kworker.0 00000100:00100000:0.0:1788201668.432205:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201668.432223:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc107858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715530752:0@lo:400:kworker.0 00000100:00100000:0.0:1788201668.432243:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201668.432268:0:109776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715530112 00000100:00100000:0.0:1788201668.432271:0:109776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715530112 00000100:00100000:0.0:1788201668.432302:0:109776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715531136 00000100:00100000:0.0:1788201668.432305:0:109776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715531136 00000100:00100000:0.0:1788201668.432317:0:109776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715530240 00000100:00100000:0.0:1788201668.432318:0:109776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715530240 00000100:00100000:0.0:1788201668.432328:0:109776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715530752 00000100:00100000:0.0:1788201668.432329:0:109776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715530752 00000100:00100000:0.0:1788201668.432340:0:109776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788201668.432346:0:109776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715530112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201668.432385:0:109776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715530112:12345-0@lo:400:kworker.0 Request processed in 39us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201668.432400:0:109776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788201668.432415:0:109776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788201668.432421:0:109776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715531136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201668.432448:0:109776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715531136:12345-0@lo:400:kworker.0 Request processed in 28us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201668.432453:0:109776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788201668.432465:0:109776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788201668.432471:0:109776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715530240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201668.432508:0:109776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715530240:12345-0@lo:400:kworker.0 Request processed in 37us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201668.432513:0:109776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788201668.432525:0:109776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788201668.432530:0:109776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10785a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715530752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201668.432554:0:109776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10785a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1875060715530752:12345-0@lo:400:kworker.0 Request processed in 23us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201668.432559:0:109776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1788201668.432577:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201668.432581:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201668.432600:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10785ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715530240:0@lo:400:kworker.0 00000100:00100000:0.0:1788201668.432610:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc107858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3655:1875060715530752:0@lo:400:kworker.0 00000100:00100000:0.0:1788201668.432618:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715530112:0@lo:400:kworker.0 00000100:00100000:0.0:1788201668.432626:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc107859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715531136:0@lo:400:kworker.0 00000100:00100000:3.0:1788201668.432895:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc107858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715530368:0@lo:400:kworker.0 00000100:00100000:3.0:1788201668.432926:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201668.432952:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10785b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715530880:0@lo:400:kworker.0 00000100:00100000:3.0:1788201668.432973:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201668.432991:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788201668.432996:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715529984:0@lo:400:kworker.0 00000100:00100000:3.0:1788201668.433044:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201668.433068:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc107859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715530496:0@lo:400:kworker.0 00000100:00100000:3.0:1788201668.433088:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201668.433103:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10785a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715531008:0@lo:400:kworker.0 00000100:00100000:3.0:1788201668.433120:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201668.433167:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715530368 00000100:00100000:3.0:1788201668.433171:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715530368 00000100:00100000:3.0:1788201668.433302:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715530496 00000100:00100000:3.0:1788201668.433306:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715530496 00000100:00100000:3.0:1788201668.433321:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788201668.433327:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0071f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715530368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201668.433363:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0071f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715530368:12345-0@lo:400:kworker.0 Request processed in 36us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201668.433369:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788201668.433399:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788201668.433406:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0071f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715530496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201668.433434:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0071f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715530496:12345-0@lo:400:kworker.0 Request processed in 29us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201668.433440:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1788201668.433453:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201668.433456:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201668.433473:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc107859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715530496:0@lo:400:kworker.0 00000100:00100000:3.0:1788201668.433483:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc107858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715530368:0@lo:400:kworker.0 00000100:00100000:2.0:1788201668.433756:0:109785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715530624 00000100:00100000:2.0:1788201668.433761:0:109785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715530624 00000100:00100000:2.0:1788201668.433797:0:109785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788201668.433814:0:109785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10785aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715530624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201668.433859:0:109785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10785aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715530624:12345-0@lo:400:kworker.0 Request processed in 46us (1760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201668.433866:0:109785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788201668.433888:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715530880 00000100:00100000:2.0:1788201668.433892:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715530880 00000100:00100000:2.0:1788201668.433921:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715531008 00000100:00100000:2.0:1788201668.433924:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715531008 00000100:00100000:2.0:1788201668.433944:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788201668.433950:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0071f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715530880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201668.433986:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0071f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715530880:12345-0@lo:400:kworker.0 Request processed in 36us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201668.433993:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788201668.434003:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788201668.434009:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0071f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715531008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201668.434060:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0071f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715531008:12345-0@lo:400:kworker.0 Request processed in 51us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201668.434073:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788201668.434093:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715529984 00000100:00100000:2.0:1788201668.434097:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715529984 00000100:00100000:2.0:1788201668.434122:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788201668.434127:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715529984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201668.434171:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715529984:12345-0@lo:400:kworker.0 Request processed in 43us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201668.434485:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1788201668.434525:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201668.434528:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201668.434551:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715529984:0@lo:400:kworker.0 00000100:00100000:2.0:1788201668.434562:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10785a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715531008:0@lo:400:kworker.0 00000100:00100000:2.0:1788201668.434570:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10785b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715530880:0@lo:400:kworker.0 00000100:00100000:2.0:1788201668.434598:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10785b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715530624:0@lo:400:kworker.0 00000100:00100000:1.0:1788201668.434877:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715531264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201668.434919:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201668.435310:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715531264 00000100:00100000:3.0:1788201668.435315:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715531264 00000100:00100000:1.0:1788201668.435522:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788201668.435530:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715531264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201668.435558:0:99776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444941824 avail 1298702336 00000100:00100000:1.0:1788201668.435613:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715531264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201668.435620:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788201668.435794:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715531264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201668.570928:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201668.571073:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201668.571209:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695603712 00000100:00100000:0.0:1788201668.571221:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695603712 00000100:00100000:0.0:1788201668.571307:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 108 00000100:00100000:0.0:1788201668.571318:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a7de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2400:x1875060695603712:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201668.571513:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a7de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2400:x1875060695603712:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 196us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201668.571522:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 108 00000100:00100000:3.0:1788201668.571745:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695603584 00000100:00100000:3.0:1788201668.571750:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695603584 00000100:00100000:3.0:1788201668.571826:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:3.0:1788201668.571834:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695603584:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201668.572652:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695603584:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 815us (1731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201668.572680:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 80 00000100:00100000:1.0:1788201668.572797:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201668.572900:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201668.572927:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201668.572949:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695603968 00000100:00100000:1.0:1788201668.572954:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695603968 00000100:00100000:1.0:1788201668.572991:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695604096 00000100:00100000:1.0:1788201668.572994:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695604096 00000100:00100000:1.0:1788201668.573042:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 228 00000100:00100000:1.0:1788201668.573051:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f457480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695603968:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201668.573098:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f457480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695603968:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 48us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201668.573105:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 228 00000100:00100000:1.0:1788201668.573118:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 229 00000100:00100000:1.0:1788201668.573124:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695604096:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201668.573148:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695604096:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 25us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201668.573154:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 229 00000100:00100000:1.0:1788201668.573247:0:109776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695603840 00000100:00100000:1.0:1788201668.573257:0:109776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695603840 00000100:00100000:1.0:1788201668.573289:0:109776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 109 00000100:00100000:1.0:1788201668.573296:0:109776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f454e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695603840:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201668.573328:0:109776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f454e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695603840:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 32us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201668.573334:0:109776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 109 00000100:00080000:2.0:1788201668.573591:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788201668.573596:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201668.573598:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201668.573600:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788201668.943570:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201668.943594:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715531392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201668.943683:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201668.943958:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715531392 00000100:00100000:1.0:1788201668.943967:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715531392 00000100:00100000:1.0:1788201668.944044:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788201668.944054:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc108cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715531392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201668.944075:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8664128 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201668.944134:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc108cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715531392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201668.944141:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788201668.944365:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715531392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788201668.944822:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788201668.944835:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a7ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715531520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788201668.944871:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201668.944983:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715531520 00000100:00100000:2.0:1788201668.944988:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715531520 00000100:00100000:2.0:1788201668.945042:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788201668.945050:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc107859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715531520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201668.945064:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635456 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201668.945178:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc107859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715531520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201668.945185:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788201668.950412:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a7ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715531520:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788201669.008768:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201670.031527:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201671.055292:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201672.079226:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201673.039374:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788201673.039400:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715531648:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201673.039475:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201673.039582:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715531648 00000100:00100000:1.0:1788201673.039591:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715531648 00000100:00100000:1.0:1788201673.039666:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788201673.039676:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0071f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715531648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788201673.039704:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8664128 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201673.039755:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0071f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715531648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201673.039762:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788201673.039808:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715531648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201673.040110:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788201673.040122:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc107858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715531776:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201673.040154:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201673.040195:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715531776 00000100:00100000:2.0:1788201673.040199:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715531776 00000100:00100000:2.0:1788201673.040231:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788201673.040239:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a7ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715531776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201673.040256:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635456 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201673.040290:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a7ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715531776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201673.040295:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788201673.040335:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc107858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715531776:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788201673.040455:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201673.040459:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788201673.103289:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201673.551243:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc107859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715532160:0@lo:400:kworker.0 00000100:00100000:0.0:1788201673.551336:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201673.551371:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc107858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715532672:0@lo:400:kworker.0 00000100:00100000:0.0:1788201673.551397:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201673.551414:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc107858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715533184:0@lo:400:kworker.0 00000100:00100000:0.0:1788201673.551432:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201673.551452:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788201673.551457:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc107858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715532288:0@lo:400:kworker.0 00000100:00100000:0.0:1788201673.551475:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201673.551487:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10785b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715532800:0@lo:400:kworker.0 00000100:00100000:0.0:1788201673.551506:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201673.551517:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc107859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715533312:0@lo:400:kworker.0 00000100:00100000:0.0:1788201673.551533:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201673.551559:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715532672 00000100:00100000:0.0:1788201673.551565:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715532672 00000100:00100000:0.0:1788201673.551613:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715533184 00000100:00100000:0.0:1788201673.551616:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715533184 00000100:00100000:0.0:1788201673.551640:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715532800 00000100:00100000:0.0:1788201673.551642:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715532800 00000100:00100000:0.0:1788201673.551655:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715533312 00000100:00100000:0.0:1788201673.551657:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715533312 00000100:00100000:0.0:1788201673.551677:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788201673.551693:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc106048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715532672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201673.551739:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc106048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715532672:12345-0@lo:400:kworker.0 Request processed in 47us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201673.551746:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788201673.551760:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788201673.551765:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715533184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201673.551786:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715533184:12345-0@lo:400:kworker.0 Request processed in 21us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201673.551791:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788201673.551799:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788201673.551804:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12bfd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715532800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201673.551821:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12bfd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715532800:12345-0@lo:400:kworker.0 Request processed in 18us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201673.551827:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788201673.551978:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788201673.551983:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715533312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201673.552004:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715533312:12345-0@lo:400:kworker.0 Request processed in 21us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201673.552009:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788201673.552051:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715532160 00000100:00100000:0.0:1788201673.552054:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715532160 00000100:00100000:0.0:1788201673.552075:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715532288 00000100:00100000:0.0:1788201673.552078:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715532288 00000100:00100000:0.0:1788201673.552093:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788201673.552100:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc10604a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715532160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201673.552128:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc10604a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715532160:12345-0@lo:400:kworker.0 Request processed in 29us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201673.552139:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788201673.552151:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788201673.552155:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715532288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201673.552179:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715532288:12345-0@lo:400:kworker.0 Request processed in 24us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201673.552184:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1788201673.552203:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201673.552207:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201673.552209:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788201673.552211:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201673.552241:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc107858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715532288:0@lo:400:kworker.0 00000100:00100000:0.0:1788201673.552251:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10785b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715532800:0@lo:400:kworker.0 00000100:00100000:0.0:1788201673.552260:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc107859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715533312:0@lo:400:kworker.0 00000100:00100000:0.0:1788201673.552268:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc107859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715532160:0@lo:400:kworker.0 00000100:00100000:0.0:1788201673.552275:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc107858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715532672:0@lo:400:kworker.0 00000100:00100000:0.0:1788201673.552282:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc107858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715533184:0@lo:400:kworker.0 00000100:00100000:1.0:1788201673.552564:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10785b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715532032:0@lo:400:kworker.0 00000100:00100000:1.0:1788201673.552607:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201673.552630:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc107859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715532544:0@lo:400:kworker.0 00000100:00100000:1.0:1788201673.552662:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201673.552682:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10785a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715533056:0@lo:400:kworker.0 00000100:00100000:1.0:1788201673.552700:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201673.552716:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788201673.552721:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10785ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715531904:0@lo:400:kworker.0 00000100:00100000:1.0:1788201673.552743:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201673.552765:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10785bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715532416:0@lo:400:kworker.0 00000100:00100000:1.0:1788201673.552781:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201673.552789:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc10785b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715532928:0@lo:400:kworker.0 00000100:00100000:1.0:1788201673.552803:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201673.552811:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc106048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715533440:0@lo:400:kworker.0 00000100:00100000:1.0:1788201673.552824:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201673.552846:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715532032 00000100:00100000:1.0:1788201673.552849:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715532032 00000100:00100000:1.0:1788201673.552873:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715532416 00000100:00100000:1.0:1788201673.552875:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715532416 00000100:00100000:1.0:1788201673.552885:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715532928 00000100:00100000:1.0:1788201673.552886:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715532928 00000100:00100000:1.0:1788201673.552895:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715533440 00000100:00100000:1.0:1788201673.552897:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715533440 00000100:00100000:1.0:1788201673.552907:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788201673.552912:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715532032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201673.552943:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875060715532032:12345-0@lo:400:kworker.0 Request processed in 31us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201673.552949:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788201673.552961:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788201673.552966:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715532416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201673.552995:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875060715532416:12345-0@lo:400:kworker.0 Request processed in 30us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201673.553001:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788201673.553011:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788201673.553034:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715532928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201673.553055:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875060715532928:12345-0@lo:400:kworker.0 Request processed in 40us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201673.553061:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788201673.553070:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788201673.553075:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715533440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201673.553098:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875060715533440:12345-0@lo:400:kworker.0 Request processed in 23us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201673.553104:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788201673.553150:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715532544 00000100:00100000:1.0:1788201673.553154:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715532544 00000100:00100000:1.0:1788201673.553175:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715533056 00000100:00100000:1.0:1788201673.553177:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715533056 00000100:00100000:1.0:1788201673.553186:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788201673.553191:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f457100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715532544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201673.553221:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f457100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715532544:12345-0@lo:400:kworker.0 Request processed in 29us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201673.553227:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788201673.553237:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788201673.553243:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f455500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715533056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201673.553279:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f455500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715533056:12345-0@lo:400:kworker.0 Request processed in 23us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201673.553294:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788201673.553325:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715531904 00000100:00100000:1.0:1788201673.553329:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715531904 00000100:00100000:1.0:1788201673.553354:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788201673.553360:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715531904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201673.553390:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:3658:x1875060715531904:12345-0@lo:400:kworker.0 Request processed in 30us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201673.553395:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1788201673.553424:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788201673.553428:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201673.553448:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10785ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715531904:0@lo:400:kworker.0 00000100:00100000:1.0:1788201673.553459:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10785bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3658:1875060715532416:0@lo:400:kworker.0 00000100:00100000:1.0:1788201673.553468:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10785b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875060715532928:0@lo:400:kworker.0 00000100:00100000:1.0:1788201673.553475:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc106048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875060715533440:0@lo:400:kworker.0 00000100:00100000:1.0:1788201673.553483:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10785b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3658:1875060715532032:0@lo:400:kworker.0 00000100:00100000:1.0:1788201673.553490:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc107859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715532544:0@lo:400:kworker.0 00000100:00100000:1.0:1788201673.553497:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc10785a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715533056:0@lo:400:kworker.0 00000100:00100000:1.0:1788201673.554496:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201673.554510:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715533568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201673.554552:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201673.554584:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715533568 00000100:00100000:1.0:1788201673.554589:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715533568 00000100:00100000:1.0:1788201673.554631:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788201673.554648:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715533568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201673.554674:0:99775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444941824 avail 1298702336 00000100:00100000:1.0:1788201673.554715:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715533568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201673.554721:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788201673.554755:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715533568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201673.564008:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0071f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715533696:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201673.564094:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201673.564151:0:109785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715533696 00000100:00100000:1.0:1788201673.564157:0:109785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715533696 00000100:00100000:1.0:1788201673.564199:0:109785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788201673.564208:0:109785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f457480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715533696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201673.564242:0:109785:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445376000 avail 1299136512 00000100:00100000:1.0:1788201673.564311:0:109785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f457480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715533696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201673.564319:0:109785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788201673.564369:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0071f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715533696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201673.689317:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201673.689362:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201673.689383:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201673.689418:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201673.689444:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201673.689558:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695604224 00000100:00100000:3.0:1788201673.689569:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695604224 00000100:00100000:3.0:1788201673.689620:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 82 00000100:00100000:3.0:1788201673.689630:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1201f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695604224:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201673.689697:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1201f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695604224:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 68us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201673.689705:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 82 00000100:00100000:1.0:1788201673.689948:0:109776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695604480 00000100:00100000:1.0:1788201673.689954:0:109776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695604480 00000100:00100000:1.0:1788201673.690008:0:109776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695604352 00000100:00100000:1.0:1788201673.690012:0:109776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695604352 00000100:00100000:1.0:1788201673.690059:0:109776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 116 00000100:00100000:1.0:1788201673.690066:0:109776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a7dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695604480:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201673.690104:0:109776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a7dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695604480:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 38us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201673.690129:0:109776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 116 00000100:00100000:1.0:1788201673.690145:0:109776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 117 00000100:00100000:1.0:1788201673.690152:0:109776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a7ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695604352:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201673.690178:0:109776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a7ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695604352:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 27us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201673.690184:0:109776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 117 00000100:00100000:1.0:1788201673.690271:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695604736 00000100:00100000:1.0:1788201673.690275:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695604736 00000100:00100000:1.0:1788201673.690311:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695604608 00000100:00100000:1.0:1788201673.690315:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695604608 00000100:00100000:1.0:1788201673.690338:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 234 00000100:00100000:1.0:1788201673.690344:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a7de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695604736:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201673.690377:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a7de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695604736:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 33us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201673.690383:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 234 00000100:00100000:1.0:1788201673.690395:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 235 00000100:00100000:1.0:1788201673.690401:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a7dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695604608:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201673.690423:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a7dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695604608:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 23us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201673.690429:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 235 00000100:00080000:2.0:1788201673.690552:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201673.690556:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201673.690558:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788201673.690561:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201674.064949:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788201674.064974:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715533824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201674.065337:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201674.065392:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715533824 00000100:00100000:1.0:1788201674.065406:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715533824 00000100:00100000:1.0:1788201674.065463:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788201674.065472:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715533824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201674.065495:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8664128 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201674.065543:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715533824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201674.065550:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788201674.065598:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715533824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201674.070219:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a7dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715533952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201674.070290:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201674.070365:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715533952 00000100:00100000:1.0:1788201674.070373:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715533952 00000100:00100000:1.0:1788201674.070420:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788201674.070429:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715533952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788201674.070451:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635456 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1788201674.070493:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715533952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201674.070499:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788201674.070544:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a7dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715533952:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788201674.127403:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201675.151223:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201676.033527:0:110739:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 200: Dropping one OBD_PING should not cause disconnect ========================================================== 14:41:14 (1788201674) 00010000:00010000:0.0:1788201676.177009:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201677.200535:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201677.729715:0:110787:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_200 Need remote client 00000100:00100000:3.0:1788201678.159427:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715534080:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201678.159498:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201678.159665:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715534080 00000100:00100000:2.0:1788201678.159688:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715534080 00000100:00100000:2.0:1788201678.159762:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788201678.159778:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0071f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715534080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201678.159809:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635456 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201678.159857:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0071f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715534080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201678.159865:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00080000:3.0:1788201678.160100:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201678.160136:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715534080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788201678.160329:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a7dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715534208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201678.160362:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201678.160609:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715534208 00000100:00100000:2.0:1788201678.160614:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715534208 00000100:00100000:2.0:1788201678.160662:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788201678.160671:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715534208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201678.160699:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8664128 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201678.160980:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715534208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 310us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201678.160988:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00080000:3.0:1788201678.161091:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201678.163663:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a7dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715534208:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788201678.230353:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201678.679406:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715534336:0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.679513:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201678.680736:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12f455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715534848:0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.680871:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201678.680903:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715535360:0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.680924:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201678.680940:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715535872:0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.680957:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201678.680992:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788201678.680998:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715534720:0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.681036:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201678.681052:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715535232:0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.681075:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201678.681093:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715535744:0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.681110:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201678.681142:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715534464:0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.681163:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201678.681173:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc137ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715534976:0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.681192:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201678.681207:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715535488:0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.681241:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201678.681259:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715536000:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201678.681279:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201678.681298:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788201678.681304:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715534592:0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.681329:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201678.681355:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715535104:0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.681379:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201678.681422:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715535616:0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.681441:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201678.681457:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715536128:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201678.681475:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201678.681506:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715534336 00000100:00100000:1.0:1788201678.681515:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715534336 00000100:00100000:3.0:1788201678.682804:0:109776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715534848 00000100:00100000:3.0:1788201678.682814:0:109776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715534848 00000100:00100000:3.0:1788201678.682881:0:109776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715535360 00000100:00100000:3.0:1788201678.682884:0:109776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715535360 00000100:00100000:3.0:1788201678.682896:0:109776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715535872 00000100:00100000:3.0:1788201678.682899:0:109776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715535872 00000100:00100000:3.0:1788201678.682908:0:109776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715534720 00000100:00100000:3.0:1788201678.682911:0:109776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715534720 00000100:00100000:3.0:1788201678.682921:0:109776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715534464 00000100:00100000:3.0:1788201678.682923:0:109776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715534464 00000100:00100000:3.0:1788201678.682933:0:109776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715534592 00000100:00100000:3.0:1788201678.682935:0:109776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715534592 00000100:00100000:3.0:1788201678.682951:0:109776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788201678.682961:0:109776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715534848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201678.683076:0:109776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1875060715534848:12345-0@lo:400:kworker.0 Request processed in 115us (2205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201678.683084:0:109776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788201678.683102:0:109776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788201678.683107:0:109776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715535360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201678.683131:0:109776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715535360:12345-0@lo:400:kworker.0 Request processed in 24us (2206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201678.683137:0:109776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788201678.683146:0:109776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788201678.683151:0:109776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715535872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201678.683171:0:109776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715535872:12345-0@lo:400:kworker.0 Request processed in 20us (2213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201678.683176:0:109776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788201678.683184:0:109776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788201678.683189:0:109776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715534720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201678.683209:0:109776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715534720:12345-0@lo:400:kworker.0 Request processed in 21us (2173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201678.683231:0:109776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788201678.683246:0:109776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788201678.683251:0:109776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715534464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201678.683289:0:109776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715534464:12345-0@lo:400:kworker.0 Request processed in 38us (2125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201678.683295:0:109776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788201678.683307:0:109776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788201678.683314:0:109776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715534592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201678.683341:0:109776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1875060715534592:12345-0@lo:400:kworker.0 Request processed in 29us (2012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201678.683347:0:109776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:3.0:1788201678.683363:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201678.683368:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788201678.683665:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788201678.683674:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715534336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.683711:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715534336:12345-0@lo:400:kworker.0 Request processed in 39us (4199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201678.683717:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788201678.683767:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715535232 00000100:00100000:1.0:1788201678.683772:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715535232 00000100:00100000:1.0:1788201678.684066:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715535744 00000100:00100000:1.0:1788201678.684070:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715535744 00000100:00100000:1.0:1788201678.684096:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715535104 00000100:00100000:1.0:1788201678.684098:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715535104 00000100:00100000:1.0:1788201678.684112:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715535616 00000100:00100000:1.0:1788201678.684114:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715535616 00000100:00100000:1.0:1788201678.684130:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788201678.684136:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715535232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.684172:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715535232:12345-0@lo:400:kworker.0 Request processed in 36us (3096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201678.684178:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788201678.684189:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788201678.684193:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715535744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.684249:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715535744:12345-0@lo:400:kworker.0 Request processed in 55us (3137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201678.684257:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788201678.684269:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788201678.684275:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715535104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.684301:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715535104:12345-0@lo:400:kworker.0 Request processed in 28us (2922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201678.684307:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788201678.684316:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788201678.684322:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715535616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.684349:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715535616:12345-0@lo:400:kworker.0 Request processed in 28us (2906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201678.684355:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788201678.684382:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715534976 00000100:00100000:1.0:1788201678.684386:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715534976 00000100:00100000:1.0:1788201678.684404:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715535488 00000100:00100000:1.0:1788201678.684408:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715535488 00000100:00100000:1.0:1788201678.684419:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715536000 00000100:00100000:1.0:1788201678.684423:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715536000 00000100:00100000:1.0:1788201678.684431:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715536128 00000100:00100000:1.0:1788201678.684434:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715536128 00000100:00100000:1.0:1788201678.684446:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788201678.684452:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715534976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.684488:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1875060715534976:12345-0@lo:400:kworker.0 Request processed in 36us (3294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201678.684494:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788201678.684506:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788201678.684518:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715535488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.685792:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1875060715535488:12345-0@lo:400:kworker.0 Request processed in 1260us (4537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201678.685803:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788201678.685828:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788201678.685837:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12efc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715536000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201678.685865:0:99776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445376000 avail 1299136512 00000100:00100000:1.0:1788201678.685896:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12efc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715536000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (4616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201678.685902:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788201678.685911:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788201678.685916:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715536128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788201678.685932:0:99776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444941824 avail 1298702336 00000100:00100000:1.0:1788201678.685955:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715536128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 39us (4480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201678.685961:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788201678.686253:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715534720:0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.686270:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715535232:0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.686284:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715535744:0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.686297:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715534336:0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.686309:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12f455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715534848:0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.686323:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715535360:0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.686351:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715535872:0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.686415:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3657:1875060715534592:0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.686427:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715535104:0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.686439:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715535616:0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.686455:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715536128:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201678.686467:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715534464:0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.686477:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc137ceca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715534976:0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.686486:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715535488:0@lo:400:kworker.0 00000100:00100000:1.0:1788201678.686495:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715536000:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1788201678.689828:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788201678.689840:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201678.806426:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201678.806555:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201678.806587:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201678.806652:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695604864 00000100:00100000:2.0:1788201678.806668:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695604864 00000100:00100000:2.0:1788201678.806735:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 84 00000100:00100000:2.0:1788201678.806746:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695604864:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201678.806824:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695604864:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 80us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201678.806832:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 84 00000100:00100000:3.0:1788201678.811388:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201678.811419:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201678.811686:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695605248 00000100:00100000:3.0:1788201678.811700:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695605248 00000100:00100000:3.0:1788201678.812312:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695605376 00000100:00100000:3.0:1788201678.812318:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695605376 00000100:00100000:3.0:1788201678.812349:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 240 00000100:00100000:3.0:1788201678.812361:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0071f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695605248:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201678.813273:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0071f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2403:x1875060695605248:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 796us (1783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201678.813304:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 240 00000100:00100000:3.0:1788201678.813337:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 241 00000100:00100000:3.0:1788201678.813348:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0071f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695605376:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201678.813385:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0071f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2402:x1875060695605376:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 40us (1966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201678.813432:0:109776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695604992 00000100:00100000:2.0:1788201678.813436:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695605120 00000100:00100000:0.0:1788201678.813440:0:109776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695604992 00000100:00100000:2.0:1788201678.813452:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695605120 00000100:00100000:0.0:1788201678.813508:0:109776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 124 00000100:00100000:3.0:1788201678.813594:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 241 00000100:00100000:2.0:1788201678.813619:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 125 00000100:00100000:2.0:1788201678.813633:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0071f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695605120:12345-192.168.201.20@tcp:400:kworker.0 00000100:00080000:3.0:1788201678.813638:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201678.813644:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201678.813647:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201678.813650:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788201678.813731:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0071f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2402:x1875060695605120:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 101us (7142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201678.813741:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 125 00000100:00100000:0.0:1788201678.814288:0:109776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0071f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695604992:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201678.814367:0:109776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0071f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695604992:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 850us (7955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201678.814377:0:109776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 124 00000100:00100000:1.0:1788201679.185456:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a7dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715536256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201679.185554:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201679.185690:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715536384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201679.185727:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201679.185774:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715536256 00000100:00100000:2.0:1788201679.185785:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715536256 00000100:00100000:2.0:1788201679.185857:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715536384 00000100:00100000:2.0:1788201679.185860:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715536384 00000100:00100000:2.0:1788201679.185879:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788201679.185891:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc120093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715536256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201679.185919:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635456 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201679.190148:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788201679.190178:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc005d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715536384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788201679.190224:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8664128 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788201679.190342:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc005d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715536384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 177us (4612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201679.190350:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788201679.192499:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc120093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715536256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6597us (6932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201679.192515:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788201679.192610:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715536384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788201679.197483:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a7dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715536256:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788201679.249283:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788201679.284431:0:110835:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 201: MDT umount cascading disconnects timeouts ========================================================== 14:41:17 (1788201677) 00010000:00010000:0.0:1788201680.271150:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788201681.295404:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201682.319226:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201683.279514:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201683.279536:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0071f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715536512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201683.279604:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201683.279643:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715536512 00000100:00100000:3.0:1788201683.279649:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715536512 00000100:00100000:3.0:1788201683.279692:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788201683.279698:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0071f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715536512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788201683.279722:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635456 pending 0 free 3922464768 avail 3690942464 00000100:00100000:3.0:1788201683.279760:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0071f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1875060715536512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201683.279765:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:3.0:1788201683.279781:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201683.279807:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0071f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715536512:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788201683.280368:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201683.280376:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc005d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715536640:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201683.280402:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201683.280425:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715536640 00000100:00100000:2.0:1788201683.280428:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715536640 00000100:00100000:2.0:1788201683.280447:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788201683.280452:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715536640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788201683.280468:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8664128 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201683.280522:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715536640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201683.280527:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788201683.280555:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc005d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715536640:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788201683.280640:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788201683.343192:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201683.793634:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00a7dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715536768:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201683.793712:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201683.793770:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715536768 00000100:00100000:1.0:1788201683.793778:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715536768 00000100:00100000:1.0:1788201683.793824:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788201683.793834:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc137ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715536768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788201683.793883:0:99776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445376000 avail 1299136512 00000100:00100000:1.0:1788201683.793930:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc137ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715536768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201683.793937:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788201683.793983:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00a7dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715536768:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201683.794155:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0071f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715536896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788201683.794181:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201683.794253:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715536896 00000100:00100000:3.0:1788201683.794258:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715536896 00000100:00100000:3.0:1788201683.794289:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788201683.794296:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00a7dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715536896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201683.794315:0:99775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444941824 avail 1298702336 00000100:00100000:3.0:1788201683.794350:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00a7dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1875060715536896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201683.794356:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788201683.794382:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0071f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715536896:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201683.794718:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715537024:0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.794749:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201683.794781:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715537536:0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.794805:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201683.794823:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715538048:0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.794846:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201683.794866:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788201683.794872:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715537152:0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.794891:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201683.794908:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715537664:0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.794939:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201683.794957:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715538176:0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.794978:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201683.795006:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715537536 00000100:00100000:3.0:1788201683.795010:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715537536 00000100:00100000:3.0:1788201683.795068:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715537152 00000100:00100000:3.0:1788201683.795071:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715537152 00000100:00100000:3.0:1788201683.795090:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788201683.795097:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0071f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715537536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.795147:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0071f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715537536:12345-0@lo:400:kworker.0 Request processed in 50us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201683.795154:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788201683.795166:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788201683.795173:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715537152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.795199:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715537152:12345-0@lo:400:kworker.0 Request processed in 27us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201683.795204:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788201683.795221:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715538048 00000100:00100000:3.0:1788201683.795224:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715538048 00000100:00100000:3.0:1788201683.795245:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715537664 00000100:00100000:3.0:1788201683.795247:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715537664 00000100:00100000:3.0:1788201683.795261:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715538176 00000100:00100000:3.0:1788201683.795263:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715538176 00000100:00100000:3.0:1788201683.795283:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788201683.795290:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715538048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.795318:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715538048:12345-0@lo:400:kworker.0 Request processed in 29us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201683.795332:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788201683.795342:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788201683.795348:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715537664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.795373:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715537664:12345-0@lo:400:kworker.0 Request processed in 26us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201683.795379:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788201683.795389:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788201683.795395:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715538176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.795419:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715538176:12345-0@lo:400:kworker.0 Request processed in 25us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201683.795424:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:3.0:1788201683.795449:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201683.795452:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201683.795454:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788201683.795456:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788201683.795480:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715537408:0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.795505:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201683.795521:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715537920:0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.795541:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201683.795557:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788201683.795562:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715537280:0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.795582:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201683.795597:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715537792:0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.795629:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201683.795648:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715538304:0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.795677:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201683.795701:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715537792 00000100:00100000:3.0:1788201683.795704:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715537792 00000100:00100000:3.0:1788201683.795728:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788201683.795734:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc008468a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715537792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.795763:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc008468a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715537792:12345-0@lo:400:kworker.0 Request processed in 29us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201683.795769:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788201683.795786:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715537408 00000100:00100000:3.0:1788201683.795789:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715537408 00000100:00100000:3.0:1788201683.795806:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715537920 00000100:00100000:3.0:1788201683.795808:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715537920 00000100:00100000:3.0:1788201683.795816:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715537280 00000100:00100000:3.0:1788201683.795818:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715537280 00000100:00100000:3.0:1788201683.795827:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715538304 00000100:00100000:3.0:1788201683.795829:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715538304 00000100:00100000:3.0:1788201683.795839:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788201683.795844:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715537408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.795871:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715537408:12345-0@lo:400:kworker.0 Request processed in 27us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201683.795877:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788201683.795887:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788201683.795892:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715537920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.795915:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1875060715537920:12345-0@lo:400:kworker.0 Request processed in 23us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201683.795920:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788201683.795932:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788201683.795938:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc14014c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715537280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.795967:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc14014c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1875060715537280:12345-0@lo:400:kworker.0 Request processed in 30us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201683.795973:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788201683.795984:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788201683.795990:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00846aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715538304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.796012:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00846aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715538304:12345-0@lo:400:kworker.0 Request processed in 23us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201683.796040:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1788201683.796057:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201683.796059:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201683.796081:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715537152:0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.796092:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715537664:0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.796101:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715538176:0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.796110:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715537536:0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.796119:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715538048:0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.796169:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3656:1875060715537280:0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.796177:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715537792:0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.796185:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715538304:0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.796193:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715537408:0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.796201:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3656:1875060715537920:0@lo:400:kworker.0 00000100:00100000:0.0:1788201683.796363:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715537024 00000100:00100000:0.0:1788201683.796368:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715537024 00000100:00100000:0.0:1788201683.796397:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788201683.796404:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715537024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201683.796452:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3657:x1875060715537024:12345-0@lo:400:kworker.0 Request processed in 48us (1702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201683.796458:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788201683.796521:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715537024:0@lo:400:kworker.0 00000100:00100000:3.0:1788201683.930760:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201683.930822:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201683.930845:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201683.930873:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201683.930911:0:109776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695605632 00000100:00100000:3.0:1788201683.930920:0:109776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695605632 00000100:00100000:3.0:1788201683.930974:0:109776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695605760 00000100:00100000:3.0:1788201683.930977:0:109776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695605760 00000100:00100000:3.0:1788201683.931000:0:109776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 132 00000100:00100000:3.0:1788201683.931010:0:109776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc008468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695605632:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201683.931116:0:109776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc008468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695605632:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 107us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201683.931136:0:109776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 132 00000100:00100000:3.0:1788201683.931153:0:109776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 133 00000100:00100000:3.0:1788201683.931161:0:109776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00846bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2400:x1875060695605760:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201683.931188:0:109776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00846bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2400:x1875060695605760:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 29us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201683.931195:0:109776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 133 00000100:00100000:3.0:1788201683.931213:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695606016 00000100:00100000:3.0:1788201683.931216:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695606016 00000100:00100000:3.0:1788201683.931245:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 246 00000100:00100000:3.0:1788201683.931251:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc008468000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695606016:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201683.931286:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc008468000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2400:x1875060695606016:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 35us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201683.931293:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 246 00000100:00080000:3.0:1788201683.931309:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201683.931314:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201683.931321:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788201683.931676:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695605504 00000100:00100000:2.0:1788201683.931681:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695605504 00000100:00100000:2.0:1788201683.931719:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00100000:2.0:1788201683.931727:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695605504:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201683.931764:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695605504:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 37us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201683.931770:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 86 00000100:00100000:1.0:1788201683.942225:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201683.942375:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695605888 00000100:00100000:2.0:1788201683.942385:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695605888 00000100:00100000:2.0:1788201683.942464:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 247 00000100:00100000:2.0:1788201683.942475:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12f455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695605888:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201683.942554:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12f455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2401:x1875060695605888:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 81us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201683.942561:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 247 00000100:00080000:0.0:1788201683.942618:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:0.0:1788201684.035322:0:111029:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1788201684.035367:0:111029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1f945 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f94c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201684.035378:0:111029:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1f945 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f94c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201684.035383:0:111029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1f945 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1f94c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201684.035387:0:111029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1f945 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1f94c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201684.035401:0:111029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788201684.035415:0:111029:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1788201684.035445:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788201684.035451:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1f945 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1f94c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201684.035458:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d58c00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:0.0:1788201684.035462:0:6521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1f945 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1f94c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201684.035470:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1f945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1f94c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788201684.035476:0:6521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1f945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1f94c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201684.035482:0:6521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788201684.035485:0:6521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788201684.035488:0:6521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788201684.035522:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1f945 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f94c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201684.035526:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788201684.035545:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1f945 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f94c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201684.035549:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc140d58c00/0x96d0c9b8c9a1f945 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f94c expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201684.035557:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201684.035558:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201684.035559:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788201684.035571:0:111029:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788201684.035578:0:111029:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788201684.035583:0:111029:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788201684.035592:0:111029:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788201684.036070:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201684.036085:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715538432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201684.036160:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201684.036182:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715538560:0@lo:39:umount.0 00000100:00100000:2.0:1788201684.036221:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201684.036498:0:109776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715538560 00000100:00100000:0.0:1788201684.036506:0:109776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715538560 00000100:00100000:0.0:1788201684.036542:0:109776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788201684.036548:0:109776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875060715538560:12345-0@lo:39:umount.0 00000001:00020000:0.0:1788201684.036559:0:109776:0:(tgt_handler.c:1143:tgt_disconnect()) cfs_fail_timeout id 245 sleeping for 8000ms 00000100:00100000:3.0:1788201684.037871:0:26213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715538432 00000100:00100000:3.0:1788201684.037881:0:26213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715538432 00000100:00100000:3.0:1788201684.037921:0:26213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:3.0:1788201684.037930:0:26213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c9b18af6-fecc-4172-82c2-66531890fe11+24:3655:x1875060715538432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201684.037945:0:26213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788201684.037963:0:26213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc108c74600/0x96d0c9b8c9a1f94c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f945 expref: 24 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201684.037981:0:26213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788201684.038059:0:26213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c9b18af6-fecc-4172-82c2-66531890fe11+23:3655:x1875060715538432:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (1898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201684.038066:0:26213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00100000:3.0:1788201684.038425:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715538432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788201684.303482:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201684.303506:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715538688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201684.303579:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201684.303740:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715538688 00000100:00100000:2.0:1788201684.303748:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715538688 00000100:00100000:2.0:1788201684.303808:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788201684.303820:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc008468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715538688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201684.303845:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8664128 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201684.303923:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc008468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715538688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201684.303930:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788201684.304211:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201684.304223:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715538816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201684.304257:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201684.304360:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715538688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201684.304424:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715538816 00000100:00100000:2.0:1788201684.304428:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715538816 00000100:00100000:2.0:1788201684.304469:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788201684.304477:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715538816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201684.304489:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635456 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201684.304531:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715538816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201684.304537:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788201684.304648:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715538816:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788201684.368198:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201685.391342:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201686.415543:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201687.439762:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201688.399336:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788201688.399360:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715538944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788201688.399434:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201688.400691:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788201688.400712:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715539072:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201688.400766:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201688.400857:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715538944 00000100:00100000:1.0:1788201688.400866:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715538944 00000100:00100000:1.0:1788201688.400935:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715539072 00000100:00100000:1.0:1788201688.400938:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715539072 00000100:00100000:1.0:1788201688.400965:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788201688.400976:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715538944:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788201688.401001:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00002000:00000024:1.0:1788201688.401007:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8664128 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201688.401010:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00846ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715539072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788201688.401057:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635456 pending 0 free 3922464768 avail 3690942464 00000100:00100000:1.0:1788201688.401088:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1875060715538944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (1655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201688.401090:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00846ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715539072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201688.401095:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788201688.401155:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3656:1875060715538944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201688.401155:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715539072:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788201688.401333:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201688.401338:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788201688.401645:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00010000:00010000:3.0:1788201688.466006:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201688.911403:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201688.911427:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715539200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788201688.911497:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201688.911707:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715539456:0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.911740:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201688.911760:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715539968:0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.911794:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201688.911810:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715540480:0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.911833:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201688.911850:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788201688.911856:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715539584:0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.911888:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201688.911906:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715540096:0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.911925:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201688.911940:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715540608:0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.911959:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201688.911967:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715539712:0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.911987:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715539456 00000100:00100000:1.0:1788201688.911995:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715539456 00000100:00100000:3.0:1788201688.911995:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201688.912006:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715540224:0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.912067:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715539584 00000100:00100000:1.0:1788201688.912070:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715539584 00000100:00100000:3.0:1788201688.912071:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201688.912084:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715540608 00000100:00100000:1.0:1788201688.912087:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715540608 00000100:00100000:3.0:1788201688.912090:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788201688.912095:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715539328:0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.912098:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715539712 00000100:00100000:1.0:1788201688.912100:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715539712 00000100:00100000:1.0:1788201688.912113:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788201688.912119:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201688.912121:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715539456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201688.912143:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715539840:0@lo:400:kworker.0 00000100:00100000:3.0:1788201688.912161:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201688.912171:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1875060715539456:12345-0@lo:400:kworker.0 Request processed in 51us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201688.912171:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715540352:0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.912179:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788201688.912189:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201688.912201:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715539840 00000100:00100000:1.0:1788201688.912204:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715539840 00000100:00100000:3.0:1788201688.912213:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788201688.912220:0:107403:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788201688.912220:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715539584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.912226:0:107403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1788201688.912249:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1875060715539584:12345-0@lo:400:kworker.0 Request processed in 30us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201688.912256:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788201688.912270:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788201688.912275:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715540608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201688.912298:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715540608:12345-0@lo:400:kworker.0 Request processed in 24us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201688.912303:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788201688.912312:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788201688.912317:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00846a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715539712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201688.912389:0:109785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715539200 00000100:00100000:2.0:1788201688.912395:0:109785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715539200 00000100:00100000:2.0:1788201688.912422:0:109785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715539968 00000100:00100000:2.0:1788201688.912426:0:109785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715539968 00000100:00100000:2.0:1788201688.912438:0:109785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788201688.912445:0:109785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715539200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788201688.912472:0:109785:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445376000 avail 1299136512 00000100:00100000:1.0:1788201688.912516:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3655:1875060715539584:0@lo:400:kworker.0 00000100:00100000:0.0:1788201688.912604:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788201688.912613:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00846a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715539840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201688.921223:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00846a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715539712:12345-0@lo:400:kworker.0 Request processed in 8893us (9214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201688.921241:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788201688.921310:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788201688.921328:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715539968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201688.921429:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715539968:12345-0@lo:400:kworker.0 Request processed in 109us (9633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201688.921436:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788201688.921463:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715540480 00000100:00100000:3.0:1788201688.921472:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715540480 00000100:00100000:3.0:1788201688.921513:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715540096 00000100:00100000:3.0:1788201688.921516:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715540096 00000100:00100000:3.0:1788201688.921529:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715540224 00000100:00100000:3.0:1788201688.921532:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715540224 00000100:00100000:3.0:1788201688.921554:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715540352 00000100:00100000:3.0:1788201688.921557:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715540352 00000100:00100000:3.0:1788201688.921581:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788201688.921587:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715540480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201688.921617:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715540480:12345-0@lo:400:kworker.0 Request processed in 31us (9783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201688.921623:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788201688.921634:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788201688.921639:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715540096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201688.921661:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3655:x1875060715540096:12345-0@lo:400:kworker.0 Request processed in 23us (9736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201688.921667:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788201688.921674:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788201688.921680:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc008469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715540224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201688.921706:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc008469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3657:x1875060715540224:12345-0@lo:400:kworker.0 Request processed in 27us (9634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201688.921712:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788201688.921721:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788201688.921733:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00846b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715540352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201688.921758:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00846b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715540352:12345-0@lo:400:kworker.0 Request processed in 26us (9568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201688.921764:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00080000:3.0:1788201688.921830:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201688.921834:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788201688.921837:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788201688.921839:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201688.921854:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715539328 00000100:00100000:3.0:1788201688.921858:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715539328 00000100:00100000:3.0:1788201688.921881:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788201688.921888:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:3657:x1875060715539328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201688.921917:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:3657:x1875060715539328:12345-0@lo:400:kworker.0 Request processed in 30us (9796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201688.921923:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788201688.921962:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788201688.921974:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc008469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715540736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201688.922005:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201688.922070:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715540736 00000100:00100000:3.0:1788201688.922074:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715540736 00000100:00100000:3.0:1788201688.922089:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788201688.922095:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00846b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715540736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788201688.922117:0:99775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444941824 avail 1298702336 00000100:00100000:3.0:1788201688.922152:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00846b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1875060715540736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201688.922159:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788201688.922193:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc008469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3658:1875060715540736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788201688.922229:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715539328:0@lo:400:kworker.0 00000100:00100000:3.0:1788201688.922242:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715540352:0@lo:400:kworker.0 00000100:00100000:3.0:1788201688.922253:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715539712:0@lo:400:kworker.0 00000100:00100000:3.0:1788201688.922262:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715540224:0@lo:400:kworker.0 00000100:00100000:2.0:1788201688.924152:0:109785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715539200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 11700us (12648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201688.924165:0:109785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788201688.926794:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715540608:0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.926822:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3655:1875060715539456:0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.926836:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715539968:0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.926847:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715540480:0@lo:400:kworker.0 00000100:00100000:1.0:1788201688.927146:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715540096:0@lo:400:kworker.0 00000100:00100000:0.0:1788201688.927326:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00846a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1875060715539840:12345-0@lo:400:kworker.0 Request processed in 14713us (15161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201688.927338:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788201688.927448:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3657:1875060715539840:0@lo:400:kworker.0 00000100:00100000:3.0:1788201688.927690:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715539200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201689.054900:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201689.055092:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695606528 00000100:00100000:3.0:1788201689.055103:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695606528 00000100:00100000:3.0:1788201689.055197:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 94 00000100:00100000:3.0:1788201689.055208:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2399:x1875060695606528:12345-192.168.201.20@tcp:9:kworker.0 00000001:00020000:3.0:1788201689.055225:0:101191:0:(tgt_handler.c:1143:tgt_disconnect()) cfs_fail_timeout id 245 sleeping for 8000ms 00000100:00080000:0.0:1788201689.055277:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201689.068211:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201689.068262:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201689.068313:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201689.068332:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695606144 00000100:00100000:3.0:1788201689.068352:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695606144 00000100:00100000:1.0:1788201689.068419:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201689.068455:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 88 00000100:00100000:1.0:1788201689.068469:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695606656 00000100:00100000:3.0:1788201689.068471:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695606144:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:1.0:1788201689.068485:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695606656 00000100:00100000:1.0:1788201689.068555:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 95 00000100:00100000:1.0:1788201689.068568:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+5:2399:x1875060695606656:12345-192.168.201.20@tcp:9:kworker.0 00000100:00100000:3.0:1788201689.068578:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2401:x1875060695606144:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 107us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201689.068589:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 88 00000001:00020000:1.0:1788201689.068591:0:100688:0:(tgt_handler.c:1143:tgt_disconnect()) cfs_fail_timeout id 245 sleeping for 8000ms 00000100:00100000:0.0:1788201689.068765:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695606400 00000100:00100000:0.0:1788201689.068771:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695606400 00000100:00100000:0.0:1788201689.068806:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695606272 00000100:00100000:0.0:1788201689.068809:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695606272 00000100:00100000:0.0:1788201689.068844:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 139 00000100:00100000:0.0:1788201689.068854:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695606400:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201689.068928:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e293f14-c501-4bc5-9dd4-a18ef02756b4+6:2401:x1875060695606400:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 75us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201689.068941:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 139 00000100:00100000:3.0:1788201689.068952:0:111030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 140 00000100:00100000:3.0:1788201689.068967:0:111030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc003a71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695606272:12345-192.168.201.20@tcp:400:kworker.0 00000100:00080000:0.0:1788201689.068969:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788201689.068974:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788201689.068977:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788201689.069373:0:111030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc003a71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2401:x1875060695606272:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 409us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201689.069382:0:111030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 140 00000100:00100000:1.0:1788201689.423355:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201689.423378:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715540864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201689.423443:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201689.423541:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715540864 00000100:00100000:2.0:1788201689.423549:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715540864 00000100:00100000:2.0:1788201689.423604:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788201689.423614:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715540864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788201689.423637:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635456 pending 0 free 3922464768 avail 3690942464 00000100:00100000:2.0:1788201689.423681:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715540864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201689.423688:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788201689.423778:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715540864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788201689.424444:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788201689.424454:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715540992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201689.424487:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201689.424558:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715540992 00000100:00100000:1.0:1788201689.424568:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715540992 00000100:00100000:1.0:1788201689.424605:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788201689.424612:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715540992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788201689.424626:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8664128 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201689.424663:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1875060715540992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201689.424669:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788201689.424700:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3656:1875060715540992:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788201689.489262:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201690.512139:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201691.535799:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:3.0:1788201692.055146:0:109776:0:(tgt_handler.c:1143:tgt_disconnect()) cfs_fail_timeout id 245 awake 00000020:00000080:3.0:1788201692.058807:0:109776:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1fa02 00000100:00080000:3.0:1788201692.058837:0:109776:0:(import.c:65:import_set_state_nolock()) ffff8dc001e2d000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788201692.058936:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201692.059106:0:109776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+1:3654:x1875060715538560:12345-0@lo:39:umount.0 Request processed in 8022550us (8022878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201692.059121:0:109776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000020:00000080:3.0:1788201692.059141:0:109776:0:(genops.c:885:class_export_put()) final put ffff8dc001e29000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788201692.059176:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc001e29000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788201692.059327:0:41592:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc001e2d000 for lustre-MDT0000 00000100:00080000:0.0:1788201692.059342:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788201692.059364:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715538560:0@lo:39:umount.0 00000100:00080000:1.0:1788201692.059399:0:111029:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788201692.059405:0:111029:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788201692.059412:0:111029:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788201692.063323:0:111029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59e00/0x96d0c9b8c9a1f961 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f968 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.063341:0:111029:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59e00/0x96d0c9b8c9a1f961 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f968 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.063349:0:111029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc140d59e00/0x96d0c9b8c9a1f961 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1f968 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.063356:0:111029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc140d59e00/0x96d0c9b8c9a1f961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1f968 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.063374:0:111029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788201692.063381:0:111029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1f953 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f95a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.063403:0:111029:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1f953 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f95a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.063408:0:111029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1f953 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1f95a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.063414:0:111029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1f953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1f95a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.063442:0:111029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788201692.063449:0:111029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6e00/0x96d0c9b8c9a1f97d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f984 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.063456:0:111029:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6e00/0x96d0c9b8c9a1f97d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f984 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.063461:0:111029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6e00/0x96d0c9b8c9a1f97d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1f984 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.063466:0:111029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6e00/0x96d0c9b8c9a1f97d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1f984 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.063489:0:111029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788201692.063495:0:111029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6000/0x96d0c9b8c9a1f96f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f976 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.063501:0:111029:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6000/0x96d0c9b8c9a1f96f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1f976 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.063515:0:111029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6000/0x96d0c9b8c9a1f96f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1f976 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.063522:0:111029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6000/0x96d0c9b8c9a1f96f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96d0c9b8c9a1f976 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.063537:0:111029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1788201692.063541:0:111029:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1788201692.063571:0:111029:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1788201692.063574:0:111029:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='FA') 00000020:00000080:1.0:1788201692.063578:0:111029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1788201692.063583:0:111029:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0001 00000004:00000080:1.0:1788201692.065051:0:111029:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0001: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00010000:00010000:1.0:1788201692.065183:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788201692.065190:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc140d59e00/0x96d0c9b8c9a1f961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1f968 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.065197:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59e00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201692.065201:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d59e00/0x96d0c9b8c9a1f961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1f968 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.065209:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc140d59e00/0x96d0c9b8c9a1f961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1f968 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201692.065216:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d59e00/0x96d0c9b8c9a1f961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1f968 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201692.065221:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201692.065223:0:13349:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:1.0:1788201692.065233:0:13349:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:1.0:1788201692.065266:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc140d59e00/0x96d0c9b8c9a1f961 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f968 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.065272:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201692.065291:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc140d59e00/0x96d0c9b8c9a1f961 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f968 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.065297:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc140d59e00/0x96d0c9b8c9a1f961 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f968 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.065310:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788201692.065312:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1f953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1f95a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.065317:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc108c74a00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201692.065320:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1f953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1f95a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.065326:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1f953 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1f95a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201692.065332:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1f953 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1f95a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201692.065337:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201692.065339:0:13349:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788201692.065341:0:13349:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788201692.065349:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1f953 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f95a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.065354:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201692.065372:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1f953 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f95a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.065379:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc108c74a00/0x96d0c9b8c9a1f953 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f95a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.065387:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201692.065390:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6e00/0x96d0c9b8c9a1f97d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1f984 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.065396:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6e00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201692.065399:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6e00/0x96d0c9b8c9a1f97d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1f984 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.065405:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6e00/0x96d0c9b8c9a1f97d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1f984 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201692.065410:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6e00/0x96d0c9b8c9a1f97d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1f984 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201692.065415:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788201692.065417:0:13349:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788201692.065418:0:13349:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788201692.065429:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6e00/0x96d0c9b8c9a1f97d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f984 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.065435:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201692.065440:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6e00/0x96d0c9b8c9a1f97d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f984 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.065446:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6e00/0x96d0c9b8c9a1f97d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f984 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.065464:0:13349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201692.065468:0:13349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6000/0x96d0c9b8c9a1f96f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1f976 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.065473:0:13349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6000 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201692.065476:0:13349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6000/0x96d0c9b8c9a1f96f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96d0c9b8c9a1f976 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.065483:0:13349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6000/0x96d0c9b8c9a1f96f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x96d0c9b8c9a1f976 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201692.065489:0:13349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6000/0x96d0c9b8c9a1f96f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x96d0c9b8c9a1f976 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201692.065494:0:13349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788201692.065495:0:13349:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788201692.065497:0:13349:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788201692.065509:0:13349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6000/0x96d0c9b8c9a1f96f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f976 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.065513:0:13349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201692.065519:0:13349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6000/0x96d0c9b8c9a1f96f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f976 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.065524:0:13349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6000/0x96d0c9b8c9a1f96f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x96d0c9b8c9a1f976 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201692.065531:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201692.065533:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201692.065539:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201692.065578:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715541120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201692.065642:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201692.065684:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788201692.065690:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715541504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201692.065712:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201692.065734:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715541248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201692.065756:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201692.065771:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201692.065775:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715541376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201692.065795:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788201692.066083:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788201692.066113:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715541120 00000100:00100000:2.0:1788201692.066120:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715541120 00000100:00100000:2.0:1788201692.066164:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715541504 00000100:00100000:2.0:1788201692.066167:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715541504 00000100:00100000:2.0:1788201692.066185:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715541248 00000100:00100000:2.0:1788201692.066187:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715541248 00000100:00100000:2.0:1788201692.066200:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715541376 00000100:00100000:2.0:1788201692.066203:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715541376 00000100:00100000:2.0:1788201692.066217:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:2.0:1788201692.066227:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+26:3656:x1875060715541120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201692.066239:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201692.066252:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc108c74c00/0x96d0c9b8c9a1f968 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f961 expref: 26 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201692.066263:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201692.066307:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+25:3656:x1875060715541120:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201692.066315:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000100:00100000:2.0:1788201692.066332:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:2.0:1788201692.066338:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715541504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201692.066346:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201692.066356:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc108c74000/0x96d0c9b8c9a1f976 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f96f expref: 24 pid: 109773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201692.066364:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201692.066383:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+23:3656:x1875060715541504:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201692.066388:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00000100:00100000:2.0:1788201692.066398:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:2.0:1788201692.066403:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+22:3657:x1875060715541248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201692.066410:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201692.066418:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0056d6200/0x96d0c9b8c9a1f95a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f953 expref: 22 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201692.066426:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201692.066451:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+21:3657:x1875060715541248:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201692.066456:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000100:00100000:2.0:1788201692.066468:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 795 00000100:00100000:2.0:1788201692.066475:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1059bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+20:3657:x1875060715541376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788201692.066483:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788201692.066491:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc140d59400/0x96d0c9b8c9a1f984 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f97d expref: 20 pid: 109772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201692.066505:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201692.066527:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1059bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c9b18af6-fecc-4172-82c2-66531890fe11+19:3657:x1875060715541376:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201692.066533:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 795 00000100:00100000:2.0:1788201692.066586:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715541504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201692.066594:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715541120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201692.066618:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715541376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788201692.066624:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c9b18af6-fecc-4172-82c2-66531890fe11:3657:1875060715541248:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788201692.066771:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201692.066861:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788201692.067384:0:111029:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 4/9 00000020:00080000:3.0:1788201692.067390:0:111029:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8dc0053a7000 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201692.067396:0:111029:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8dc13f839000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201692.067400:0:111029:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8dc13f83d800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201692.067407:0:111029:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8dc1341df000 6e293f14-c501-4bc5-9dd4-a18ef02756b4 192.168.201.20@tcp 5 (0 0 0) 0 0 0 0: 0000000000000000 85899345930 stale:0 00000020:00080000:3.0:1788201692.067411:0:111029:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8dc0040419b8) has exports, disconnecting them 00000020:00080000:3.0:1788201692.067415:0:111029:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8dc0053a7000), last request at 1788201647 00000020:00000080:3.0:1788201692.067422:0:111029:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1f89d 00000100:00080000:3.0:1788201692.067429:0:111029:0:(import.c:65:import_set_state_nolock()) ffff8dc0053a5000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788201692.067454:0:111029:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc0053a7000): rc 0 00000020:00000080:3.0:1788201692.067456:0:111029:0:(genops.c:885:class_export_put()) final put ffff8dc0053a7000/lustre-MDT0000-mdtlov_UUID 00000020:00080000:3.0:1788201692.067467:0:111029:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8dc13f839000), last request at 1788201688 00000020:00000080:3.0:1788201692.067470:0:111029:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1f34f 00000100:00080000:3.0:1788201692.067474:0:111029:0:(import.c:65:import_set_state_nolock()) ffff8dc13f83b000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788201692.067482:0:111029:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc13f839000): rc 0 00000020:00000080:3.0:1788201692.067484:0:111029:0:(genops.c:885:class_export_put()) final put ffff8dc13f839000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1788201692.067487:0:111029:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8dc13f83d800), last request at 1788201688 00000020:00000080:3.0:1788201692.067493:0:111029:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1f348 00000100:00080000:3.0:1788201692.067498:0:111029:0:(import.c:65:import_set_state_nolock()) ffff8dc13f83c800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788201692.067513:0:111029:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc13f83d800): rc 0 00000020:00000080:3.0:1788201692.067515:0:111029:0:(genops.c:885:class_export_put()) final put ffff8dc13f83d800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00080000:3.0:1788201692.067519:0:111029:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 192.168.201.20@tcp (ffff8dc1341df000), last request at 1788201689 00000020:00000080:3.0:1788201692.067522:0:111029:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1efdd 00000100:00080000:3.0:1788201692.067529:0:111029:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c5000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788201692.067535:0:111029:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.201.20@tcp (ffff8dc1341df000): rc 0 00000020:00000080:3.0:1788201692.067536:0:111029:0:(genops.c:885:class_export_put()) final put ffff8dc1341df000/6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000004:00000080:3.0:1788201692.067542:0:111029:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa0dd457d7ae0 00000100:00080000:3.0:1788201692.067557:0:111029:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201692.067560:0:111029:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 133143986193 gen 3 00010000:00010000:0.0:1788201692.068186:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201692.068192:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201692.068213:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788201692.068221:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0053a7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788201692.068261:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13f839000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1788201692.068278:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc13f83d800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1788201692.068293:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1341df000/6e293f14-c501-4bc5-9dd4-a18ef02756b4 for lustre-MDT0001 00000020:00000080:0.0:1788201692.068313:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc0053a5000 for lustre-MDT0001 00000020:00000080:0.0:1788201692.068317:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc13f83b000 for lustre-MDT0001 00000020:00000080:0.0:1788201692.068320:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc13f83c800 for lustre-MDT0001 00000020:00000080:0.0:1788201692.068331:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1401c5000 for lustre-MDT0001 00010000:00010000:0.0:1788201692.068349:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788201692.068602:0:111029:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788201692.068617:0:111029:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788201692.068665:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc008469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715541632:0@lo:39:umount.0 00000100:00100000:0.0:1788201692.068710:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201692.068743:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715541632 00000100:00100000:0.0:1788201692.068748:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715541632 00000100:00100000:0.0:1788201692.068786:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788201692.068793:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715541632:12345-0@lo:39:umount.0 00000001:00020000:0.0:1788201692.068806:0:99775:0:(tgt_handler.c:1143:tgt_disconnect()) cfs_fail_timeout id 245 sleeping for 8000ms 00000100:00080000:3.0:1788201692.070163:0:111029:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788201692.070166:0:111029:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901913 gen 3 00000004:00080000:3.0:1788201692.070177:0:111029:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788201692.070234:0:111029:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788201692.070246:0:111029:0:(import.c:65:import_set_state_nolock()) ffff8dc11d43c800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788201692.071309:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc008468e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715541760:0@lo:9:umount.0 00000100:00100000:1.0:1788201692.071355:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201692.071431:0:101188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715541760 00000100:00100000:2.0:1788201692.071437:0:101188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715541760 00000100:00100000:2.0:1788201692.071485:0:101188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788201692.071492:0:101188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1875060715541760:12345-0@lo:9:umount.0 00000001:00020000:2.0:1788201692.071503:0:101188:0:(tgt_handler.c:1143:tgt_disconnect()) cfs_fail_timeout id 245 sleeping for 8000ms 00000100:00080000:1.0:1788201692.071547:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788201692.071627:0:111029:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788201692.071630:0:111029:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934596 gen 3 00000004:00080000:3.0:1788201692.071668:0:111029:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788201692.071726:0:111029:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788201692.071737:0:111029:0:(import.c:65:import_set_state_nolock()) ffff8dc110730800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788201692.071789:0:111029:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8dc0040419b8) has no exports 00000100:00100000:1.0:1788201692.071844:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc008469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715541888:0@lo:9:umount.0 00000100:00100000:1.0:1788201692.071871:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201692.071998:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715541888 00000100:00100000:3.0:1788201692.072003:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715541888 00000100:00100000:3.0:1788201692.072062:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788201692.072069:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875060715541888:12345-0@lo:9:umount.0 00000001:00020000:3.0:1788201692.072077:0:99764:0:(tgt_handler.c:1143:tgt_disconnect()) cfs_fail_timeout id 245 sleeping for 8000ms 00000100:00080000:1.0:1788201692.072311:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1788201692.072622:0:111029:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000bd1:0x3:0x0] first idx 32, last_idx 34 00000040:00080000:3.0:1788201692.072666:0:111029:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000bd1:0x3:0x0] first idx 33, last_idx 34 00000020:00080000:3.0:1788201692.072923:0:111029:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8dc0040419b8) has no exports 00000020:01000000:2.0:1788201692.106737:0:111029:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc0055f8ba0 - data ffff8dc0020b85e8/ffff8dc13f805400 00000020:01000000:2.0:1788201692.106912:0:111029:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dc0055f8960 - data ffff8dc1338c9360/ffff8dc125dc3c00 00010000:00010000:0.0:1788201692.559352:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201693.519246:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:0:1875060715542016:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788201693.519259:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788201693.519281:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:0:1875060715542144:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788201693.583185:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788201694.031223:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc008469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:0:1875060715542528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201694.031239:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc1259b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715542272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788201694.031255:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715543040:0@lo:400:kworker.0 00000100:00100000:3.0:1788201694.031264:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715542656:0@lo:400:kworker.0 00000100:00100000:0.0:1788201694.031300:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715542400:0@lo:400:kworker.0 00000100:00100000:1.0:1788201694.031328:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201694.031329:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201694.031347:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201694.031366:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715542912:0@lo:400:kworker.0 00000100:00100000:3.0:1788201694.031381:0:109785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715542272 00000100:00100000:3.0:1788201694.031387:0:109785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715542272 00000100:00100000:0.0:1788201694.031392:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715542784:0@lo:400:kworker.0 00000100:00100000:1.0:1788201694.031395:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715543552:0@lo:400:kworker.0 00000100:00100000:2.0:1788201694.031403:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201694.031420:0:109785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788201694.031427:0:109785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3655:x1875060715542272:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788201694.031437:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715543424:0@lo:400:kworker.0 00000020:00080000:3.0:1788201694.031438:0:109785:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788201694.031443:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201694.031455:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715542400 00000100:00100000:1.0:1788201694.031460:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715542400 00000100:00100000:0.0:1788201694.031479:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715543296:0@lo:400:kworker.0 00000100:00100000:2.0:1788201694.031490:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201694.031494:0:109785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3655:x1875060715542272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (169us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788201694.031499:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788201694.031503:0:109785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788201694.031523:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:3658:x1875060715542400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201694.031528:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201694.031529:0:111030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715543040 00000100:00100000:3.0:1788201694.031534:0:111030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715543040 00000100:02020000:2.0:1788201694.031535:0:3655:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1788201694.031548:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-osp-MDT0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788201694.031553:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc10603c000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788201694.031559:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788201694.031561:0:111030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715542912 00000100:00080000:2.0:1788201694.031564:0:3655:0:(import.c:65:import_set_state_nolock()) ffff8dc10603c000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201694.031571:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 4499 00000100:00100000:3.0:1788201694.031573:0:111030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715542912 00000100:00080000:2.0:1788201694.031579:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8dc10603c000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201694.031585:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:3658:x1875060715542400:12345-0@lo:400:kworker.0 Request processed in 65us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201694.031589:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c9b18af6-fecc-4172-82c2-66531890fe11:3658:1875060715542400:0@lo:400:kworker.0 00000100:00100000:1.0:1788201694.031599:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788201694.031605:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004be6680 x1875060715543680/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201694.031615:0:111030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715542784 00000100:00100000:3.0:1788201694.031619:0:111030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715542784 00000100:00100000:0.0:1788201694.031626:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201694.031637:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201694.031644:0:111030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715542656 00000100:00100000:3.0:1788201694.031648:0:111030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715542656 00000100:00100000:2.0:1788201694.031653:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788201694.031654:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715543424 00000100:00100000:0.0:1788201694.031657:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:0:1875060715543168:0@lo:400:kworker.0 00000100:00100000:1.0:1788201694.031660:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715543424 00000100:00100000:2.0:1788201694.031669:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715542912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201694.031684:0:111030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788201694.031694:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201694.031695:0:101192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715543296 00000100:00100000:3.0:1788201694.031698:0:111030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715542656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201694.031700:0:101192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715543296 00000100:00100000:2.0:1788201694.031724:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1875060715542912:12345-0@lo:400:kworker.0 Request processed in 59us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201694.031730:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788201694.031737:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715543552 00000100:00100000:2.0:1788201694.031737:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788201694.031746:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715543424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201694.031756:0:111030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1875060715542656:12345-0@lo:400:kworker.0 Request processed in 61us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201694.031757:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715543552 00000100:00100000:2.0:1788201694.031762:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788201694.031772:0:111030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788201694.031773:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1875060715543040:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788201694.031782:0:107404:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788201694.031789:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715543424:12345-0@lo:400:kworker.0 Request processed in 49us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201694.031791:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788201694.031799:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788201694.031812:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715543552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201694.031812:0:111030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788201694.031821:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1875060715543040:12345-0@lo:400:kworker.0 Request processed in 48us (495us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788201694.031825:0:101192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788201694.031825:0:111030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1875060715542784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201694.031835:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000020:00080000:3.0:1788201694.031837:0:111030:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788201694.031840:0:101192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715543296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201694.031862:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715543552:12345-0@lo:400:kworker.0 Request processed in 55us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201694.031871:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788201694.031883:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715543552:0@lo:400:kworker.0 00000100:00100000:3.0:1788201694.031902:0:111030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1875060715542784:12345-0@lo:400:kworker.0 Request processed in 77us (462us total) trans 0 rc -107/-107 00000100:00080000:2.0:1788201694.031904:0:3656:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0001 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788201694.031905:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788201694.031906:0:101192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715543296:12345-0@lo:400:kworker.0 Request processed in 69us (383us total) trans 0 rc 0/0 00000100:00080000:0.0:1788201694.031911:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201694.031913:0:3656:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:00080000:0.0:1788201694.031917:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201694.031921:0:111030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788201694.031922:0:101192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:02000400:2.0:1788201694.031923:0:3656:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1788201694.031934:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715543680:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1788201694.031938:0:3656:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788201694.031963:0:3656:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 4436 00000100:00080000:2.0:1788201694.031968:0:3656:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8dc1401c2800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201694.031985:0:3656:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004be6a00 x1875060715543808/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201694.031989:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201694.031995:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3657:1875060715542656:0@lo:400:kworker.0 00000100:00100000:2.0:1788201694.032008:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3656:1875060715543040:0@lo:400:kworker.0 00000100:00100000:1.0:1788201694.032043:0:109785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715543680 00000100:00100000:1.0:1788201694.032047:0:109785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715543680 00000100:00080000:3.0:1788201694.032053:0:3658:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1788201694.032057:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715543808:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1788201694.032059:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788201694.032065:0:3658:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1788201694.032066:0:109785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1788201694.032071:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1788201694.032073:0:109785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715543680:12345-0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1788201694.032081:0:3658:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 4436 00000100:00100000:0.0:1788201694.032082:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201694.032086:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715543424:0@lo:400:kworker.0 00010000:02000000:1.0:1788201694.032089:0:109785:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1788201694.032092:0:3658:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8dc13f86f000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201694.032108:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715543808 00000100:00100000:0.0:1788201694.032113:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715543808 00000100:00100000:2.0:1788201694.032114:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3655:1875060715542912:0@lo:400:kworker.0 00000100:00100000:3.0:1788201694.032115:0:3658:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc00846b800 x1875060715543936/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788201694.032129:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788201694.032134:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715543808:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788201694.032137:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3658:1875060715542784:0@lo:400:kworker.0 00010000:02000000:0.0:1788201694.032145:0:107404:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788201694.032158:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715543296:0@lo:400:kworker.0 00000100:00100000:0.0:1788201694.032172:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3654:x1875060715543808:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 36us (90us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201694.032178:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:0.0:1788201694.032208:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201694.032213:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201694.032216:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715543808:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788201694.032231:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc00846b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715543936:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788201694.032253:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201694.032325:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715543936 00000100:00100000:2.0:1788201694.032330:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715543936 00000100:00100000:2.0:1788201694.032352:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788201694.032356:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715543936:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788201694.032366:0:107403:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788201694.032400:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715543936:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 42us (146us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201694.032407:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1788201694.032437:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201694.032442:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201694.032452:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc00846b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715543936:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788201694.035510:0:109785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715543680:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 3428us (3517us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201694.035525:0:109785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:0.0:1788201694.035535:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc10603c000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788201694.035548:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788201694.035551:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715543680:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788201694.163152:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201694.163201:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:3.0:1788201694.163216:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695606784 00000100:00100000:3.0:1788201694.163238:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695606784 00000100:00100000:1.0:1788201694.163269:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201694.163291:0:109776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695606912 00000100:00100000:0.0:1788201694.163308:0:109776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695606912 00000100:00100000:3.0:1788201694.163315:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 90 00000100:00100000:3.0:1788201694.163335:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695606784:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201694.163344:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695607040 00000100:00100000:2.0:1788201694.163350:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695607040 00000100:00100000:2.0:1788201694.163386:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 144 00000100:00100000:2.0:1788201694.163396:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2402:x1875060695606912:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201694.163412:0:109776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 103 00000100:00080000:1.0:1788201694.163416:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201694.163419:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2403:x1875060695606784:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 89us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201694.163436:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 90 00000100:00100000:0.0:1788201694.163439:0:109776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc1259b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875060695607040:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:2.0:1788201694.163441:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2402:x1875060695606912:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 45us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201694.163463:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 144 00000020:00080000:0.0:1788201694.163468:0:109776:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.201.20@tcp 00000100:00100000:0.0:1788201694.163529:0:109776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875060695607040:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 103us (261us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788201694.163538:0:109776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 103 00000100:00100000:0.0:1788201694.169721:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201694.169839:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695607168 00000100:00100000:2.0:1788201694.169853:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695607168 00000100:00100000:2.0:1788201694.169916:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 104 00000100:00100000:2.0:1788201694.169961:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695607168:12345-192.168.201.20@tcp:38:ptlrpcd_01_01.0 00010000:02000000:2.0:1788201694.169989:0:107403:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0001: Not available for connect from 192.168.201.20@tcp (stopping) 00000100:00100000:2.0:1788201694.170101:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695607168:12345-192.168.201.20@tcp:38:ptlrpcd_01_01.0 Request processed in 141us (398us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201694.170110:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 104 00000100:00100000:2.0:1788201694.543281:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715544192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201694.543281:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715544064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201694.543385:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201694.543424:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201694.543517:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715544192 00000100:00100000:0.0:1788201694.543527:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715544192 00000100:00100000:1.0:1788201694.543565:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715544064 00000100:00100000:1.0:1788201694.543572:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715544064 00000100:00100000:0.0:1788201694.543599:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788201694.543611:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788201694.543616:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715544192:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201694.543625:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc008469c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715544064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788201694.543658:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635456 pending 0 free 3922464768 avail 3690942464 00002000:00000024:1.0:1788201694.543659:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8664128 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788201694.543727:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc008469c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715544064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201694.543738:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788201694.543741:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1875060715544192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201694.543751:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788201694.543775:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715544064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201694.543803:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3658:1875060715544192:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788201694.607164:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201695.631162:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201696.655189:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:0.0:1788201697.079137:0:101191:0:(tgt_handler.c:1143:tgt_disconnect()) cfs_fail_timeout id 245 awake 00000020:00000080:0.0:1788201697.081487:0:101191:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1fc08 00000100:00080000:0.0:1788201697.081509:0:101191:0:(import.c:65:import_set_state_nolock()) ffff8dc10603a800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788201697.081587:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788201697.081599:0:101191:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901914 00000100:00100000:0.0:1788201697.081811:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6e293f14-c501-4bc5-9dd4-a18ef02756b4+2:2399:x1875060695606528:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 8026598us (8026914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201697.081824:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 94 00000001:00020000:3.0:1788201697.087136:0:100688:0:(tgt_handler.c:1143:tgt_disconnect()) cfs_fail_timeout id 245 awake 00000020:00000080:3.0:1788201697.087177:0:100688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1fc0f 00000100:00080000:3.0:1788201697.087194:0:100688:0:(import.c:65:import_set_state_nolock()) ffff8dc0053a2000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201697.087274:0:100688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934597 00010000:00010000:0.0:1788201697.087379:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201697.087489:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e293f14-c501-4bc5-9dd4-a18ef02756b4+2:2399:x1875060695606656:12345-192.168.201.20@tcp:9:kworker.0 Request processed in 8018917us (8019064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201697.087504:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 95 00010000:00010000:0.0:1788201697.679181:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201698.703178:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788201699.151149:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201699.151154:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788201699.151158:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201699.151165:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 4545 00000100:00080000:1.0:1788201699.151169:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1788201699.151174:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715544320:0@lo:400:kworker.0 00000100:00080000:1.0:1788201699.151177:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8dc13f86f000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201699.151195:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc13a91ed80 x1875060715544576/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201699.151207:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715544448:0@lo:400:kworker.0 00000100:00080000:1.0:1788201699.151254:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1788201699.151257:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715544704:0@lo:400:kworker.0 00000100:00080000:1.0:1788201699.151260:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788201699.151268:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788201699.151273:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788201699.151275:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 4545 00000100:00080000:1.0:1788201699.151280:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788201699.151298:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8dc1401c2800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:2.0:1788201699.151309:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201699.151319:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004b38700 x1875060715544832/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201699.151333:0:41592:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201699.151336:0:41592:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788201699.151339:0:41592:0:(import.c:65:import_set_state_nolock()) ffff8dc10603c000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788201699.151344:0:41592:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 4545 00000100:00080000:1.0:1788201699.151349:0:41592:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1788201699.151351:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715544576:0@lo:38:kworker.0 00000100:00080000:1.0:1788201699.151357:0:41592:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8dc10603c000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201699.151376:0:41592:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004b39500 x1875060715544960/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201699.151402:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201699.151427:0:109773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715544320 00000100:00100000:0.0:1788201699.151436:0:109773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715544320 00000100:00100000:2.0:1788201699.151449:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201699.151450:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201699.151458:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715545088:0@lo:400:kworker.0 00000100:00100000:1.0:1788201699.151482:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715544448 00000100:00100000:1.0:1788201699.151487:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715544448 00000100:00100000:3.0:1788201699.151501:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715544832:0@lo:38:kworker.0 00000100:00100000:0.0:1788201699.151515:0:109773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788201699.151516:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201699.151533:0:109773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:3655:x1875060715544320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201699.151536:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715544704 00000100:00100000:1.0:1788201699.151542:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715544704 00000100:00100000:3.0:1788201699.151555:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201699.151576:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715544576 00000100:00100000:2.0:1788201699.151581:0:107404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715544832 00000100:00100000:1.0:1788201699.151582:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715544576 00000100:00100000:2.0:1788201699.151591:0:107404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715544832 00000100:00100000:0.0:1788201699.151611:0:109773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c9b18af6-fecc-4172-82c2-66531890fe11+19:3655:x1875060715544320:12345-0@lo:400:kworker.0 Request processed in 79us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201699.151611:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788201699.151624:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715544960:0@lo:38:kworker.0 00000100:00100000:0.0:1788201699.151625:0:109773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788201699.151625:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715544448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201699.151643:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788201699.151665:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715544704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201699.151673:0:109776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788201699.151679:0:109776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc00846b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715544576:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788201699.151696:0:109776:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788201699.151702:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715544448:12345-0@lo:400:kworker.0 Request processed in 82us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201699.151722:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201699.151723:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788201699.151742:0:109776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc00846b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875060715544576:12345-0@lo:38:kworker.0 Request processed in 56us (295us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788201699.151745:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1875060715544704:12345-0@lo:400:kworker.0 Request processed in 88us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201699.151754:0:109776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788201699.151763:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788201699.151776:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788201699.151787:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc008469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715544832:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1788201699.151797:0:107405:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1788201699.151802:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201699.151813:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00080000:0.0:1788201699.151815:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201699.151824:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715544576:0@lo:38:kworker.0 00000100:00100000:2.0:1788201699.151842:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3657:1875060715544704:0@lo:400:kworker.0 00000100:00100000:1.0:1788201699.151845:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc008469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715544832:12345-0@lo:38:kworker.0 Request processed in 62us (295us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788201699.151854:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715545216:0@lo:400:kworker.0 00000100:00080000:3.0:1788201699.151868:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1788201699.151881:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1788201699.151881:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201699.151898:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715544832:0@lo:38:kworker.0 00000100:00100000:2.0:1788201699.151910:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715545344:0@lo:400:kworker.0 00000100:00100000:0.0:1788201699.151917:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201699.151938:0:101189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715545088 00000100:00100000:1.0:1788201699.151944:0:101189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715545088 00000100:00100000:3.0:1788201699.151973:0:99767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715545216 00000100:00100000:2.0:1788201699.151979:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201699.151982:0:99767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715545216 00000100:00100000:0.0:1788201699.151984:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c9b18af6-fecc-4172-82c2-66531890fe11:3655:1875060715544320:0@lo:400:kworker.0 00000100:00100000:1.0:1788201699.151998:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788201699.152010:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715545088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788201699.152090:0:99767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788201699.152098:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715544448:0@lo:400:kworker.0 00000100:00100000:0.0:1788201699.152101:0:109776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715545344 00000100:00100000:0.0:1788201699.152108:0:109776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715545344 00000100:00100000:3.0:1788201699.152110:0:99767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715545216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201699.152117:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715545088:12345-0@lo:400:kworker.0 Request processed in 108us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201699.152137:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788201699.152156:0:109776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1788201699.152167:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788201699.152173:0:109776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715545344:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788201699.152174:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788201699.152219:0:99767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1875060715545216:12345-0@lo:400:kworker.0 Request processed in 113us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201699.152228:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715545088:0@lo:400:kworker.0 00000100:00100000:3.0:1788201699.152235:0:99767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788201699.152245:0:109776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1875060715545344:12345-0@lo:400:kworker.0 Request processed in 73us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201699.152253:0:109776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788201699.152280:0:109785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715544960 00000100:00100000:1.0:1788201699.152286:0:109785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715544960 00000100:00100000:2.0:1788201699.152290:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3656:1875060715545344:0@lo:400:kworker.0 00000100:00100000:3.0:1788201699.152335:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3655:1875060715545216:0@lo:400:kworker.0 00000100:00100000:1.0:1788201699.152336:0:109785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788201699.152347:0:109785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715544960:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1788201699.152359:0:109785:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788201699.152393:0:109785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715544960:12345-0@lo:38:kworker.0 Request processed in 45us (685us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788201699.152401:0:109785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1788201699.152414:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc10603c000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788201699.152419:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788201699.152425:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715544960:0@lo:38:kworker.0 00000100:00100000:3.0:1788201699.283190:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201699.283275:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695607296 00000100:00100000:0.0:1788201699.283287:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695607296 00000100:00100000:0.0:1788201699.283366:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 92 00000100:00100000:0.0:1788201699.283382:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695607296:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:0.0:1788201699.283490:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2402:x1875060695607296:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 112us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201699.283499:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 92 00000100:00100000:1.0:1788201699.283877:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:1.0:1788201699.283917:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:2.0:1788201699.283941:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695607424 00000100:00100000:2.0:1788201699.283949:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695607424 00000100:00080000:1.0:1788201699.284003:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788201699.284045:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695607552 00000100:00100000:3.0:1788201699.284051:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695607552 00000100:00100000:0.0:1788201699.284056:0:107404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 148 00000100:00100000:0.0:1788201699.284065:0:107404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695607424:12345-192.168.201.20@tcp:400:kworker.0 00000100:00100000:3.0:1788201699.284090:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 107 00000100:00100000:3.0:1788201699.284098:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695607552:12345-192.168.201.20@tcp:38:kworker.0 00000100:00100000:0.0:1788201699.284110:0:107404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e293f14-c501-4bc5-9dd4-a18ef02756b4+7:2403:x1875060695607424:12345-192.168.201.20@tcp:400:kworker.0 Request processed in 47us (254us total) trans 0 rc 0/0 00010000:02000000:3.0:1788201699.284120:0:107403:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0001: Not available for connect from 192.168.201.20@tcp (stopping) 00000100:00100000:0.0:1788201699.284127:0:107404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 148 00000100:00100000:3.0:1788201699.284155:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875060695607552:12345-192.168.201.20@tcp:38:kworker.0 Request processed in 56us (237us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788201699.284164:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 107 00000100:00100000:3.0:1788201699.663235:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cd1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715545600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788201699.663314:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201699.663360:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788201699.663364:0:101832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715545600 00000100:00100000:3.0:1788201699.663365:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715545472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788201699.663377:0:101832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715545600 00000100:00100000:3.0:1788201699.663386:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201699.663426:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715545472 00000100:00100000:1.0:1788201699.663432:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715545472 00000100:00100000:2.0:1788201699.663442:0:101832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788201699.663458:0:101832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715545600:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788201699.663461:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788201699.663475:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715545472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788201699.663505:0:101832:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 3922464768 avail 3690942464 00002000:00000024:1.0:1788201699.663506:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788201699.663571:0:101832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715545600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201699.663578:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715545472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201699.663582:0:101832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788201699.663599:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788201699.663607:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715545472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788201699.663621:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cd1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715545600:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788201699.727199:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:0.0:1788201700.079123:0:101188:0:(tgt_handler.c:1143:tgt_disconnect()) cfs_fail_timeout id 245 awake 00000001:00020000:3.0:1788201700.079123:0:99764:0:(tgt_handler.c:1143:tgt_disconnect()) cfs_fail_timeout id 245 awake 00000020:00000080:3.0:1788201700.079172:0:99764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1f02a 00000100:00080000:3.0:1788201700.079187:0:99764:0:(import.c:65:import_set_state_nolock()) ffff8dc139bc4800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788201700.079246:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788201700.079252:0:99764:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934597 00000100:00100000:3.0:1788201700.079451:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3654:x1875060715541888:12345-0@lo:9:umount.0 Request processed in 8007377us (8007574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201700.079464:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1788201700.079493:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc110730800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788201700.079510:0:3654:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788201700.079513:0:3654:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788201700.079516:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc008469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715541888:0@lo:9:umount.0 00000020:00000080:0.0:1788201700.085303:0:101188:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1f00e 00000100:00080000:0.0:1788201700.085314:0:101188:0:(import.c:65:import_set_state_nolock()) ffff8dc11d438000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788201700.085355:0:101188:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 12884901914 00010000:00010000:1.0:1788201700.085356:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201700.085466:0:101188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc1259b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3654:x1875060715541760:12345-0@lo:9:umount.0 Request processed in 8013972us (8014109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201700.085473:0:101188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1788201700.085502:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11d43c800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788201700.085520:0:3654:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788201700.085521:0:3654:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201700.085524:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc008468e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715541760:0@lo:9:umount.0 00000001:00020000:3.0:1788201700.087054:0:99775:0:(tgt_handler.c:1143:tgt_disconnect()) cfs_fail_timeout id 245 awake 00000020:00000080:3.0:1788201700.087069:0:99775:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1f865 00000100:00080000:3.0:1788201700.087082:0:99775:0:(import.c:65:import_set_state_nolock()) ffff8dc11ccfc000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788201700.087106:0:99775:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 32, last_transno is 137438953472 00010000:00010000:0.0:1788201700.087119:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788201700.087209:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+3:3654:x1875060715541632:12345-0@lo:39:umount.0 Request processed in 8018417us (8018498us total) trans 137438953473 rc 0/0 00000100:00100000:3.0:1788201700.087217:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:2.0:1788201700.087249:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc11d439000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788201700.087263:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc008469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715541632:0@lo:39:umount.0 00000100:00080000:3.0:1788201700.087287:0:111029:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201700.087290:0:111029:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 133143986193 gen 4 00000100:00100000:3.0:1788201700.087297:0:111029:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8dc008469500 x1875060715541632/t137438953473(137438953473) o39->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 1 to 0 dl 1788201733 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788201700.087309:0:111029:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788201700.088188:0:111029:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788201700.088190:0:111029:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901913 gen 4 00000004:00080000:3.0:1788201700.088201:0:111029:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201700.088202:0:111029:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788201700.088349:0:107455:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788201700.088355:0:107455:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x50:0x0] index 1 count 1 00000040:00080000:0.0:1788201700.088370:0:107455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 20 count 2 00000100:00080000:3.0:1788201700.088770:0:111029:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788201700.088773:0:111029:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934596 gen 4 00000004:00080000:3.0:1788201700.088782:0:111029:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201700.088790:0:111029:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788201700.088939:0:107460:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788201700.088942:0:107460:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x52:0x0] index 1 count 1 00000040:00080000:0.0:1788201700.088949:0:107460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 20 count 2 00000020:00000080:3.0:1788201700.089455:0:111029:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1efa5 00000020:00000080:3.0:1788201700.089462:0:111029:0:(genops.c:885:class_export_put()) final put ffff8dc11cddd000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788201700.089500:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11cddd000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788201700.089908:0:111029:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1efba 00000020:00000080:3.0:1788201700.089913:0:111029:0:(genops.c:885:class_export_put()) final put ffff8dc0059d7000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788201700.089922:0:111029:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788201700.089928:0:111029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788201700.089940:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0059d7000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1788201700.089941:0:111029:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788201700.089945:0:111029:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8dc004043370) has no exports 00000004:01000000:3.0:1788201700.090115:0:111029:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788201700.090123:0:111029:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1f023 00000020:00000080:3.0:1788201700.090127:0:111029:0:(genops.c:885:class_export_put()) final put ffff8dc109810800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788201700.090136:0:111029:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788201700.090139:0:111029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201700.090148:0:111029:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00000080:1.0:1788201700.090151:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc109810800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00080000:3.0:1788201700.090151:0:111029:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8dc12f0c19b8) has no exports 00000020:00000080:3.0:1788201700.090156:0:111029:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1f01c 00000020:00000080:3.0:1788201700.090159:0:111029:0:(genops.c:885:class_export_put()) final put ffff8dc110736800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788201700.090171:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110736800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788201700.090446:0:111029:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788201700.090450:0:111029:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788201700.090452:0:111029:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934596 gen 5 00000004:00080000:3.0:1788201700.090456:0:111029:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201700.090458:0:111029:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788201700.090492:0:111029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788201700.090495:0:41592:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc110730800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788201700.090503:0:111029:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788201700.090507:0:111029:0:(genops.c:885:class_export_put()) final put ffff8dc110731800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788201700.090509:0:111029:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110731800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788201700.090513:0:111029:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788201700.090563:0:111029:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1f007 00000020:00000080:3.0:1788201700.090566:0:111029:0:(genops.c:885:class_export_put()) final put ffff8dc110737000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788201700.090574:0:111029:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788201700.090576:0:111029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201700.090585:0:111029:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788201700.090587:0:111029:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8dc0027d3370) has no exports 00000020:00000080:1.0:1788201700.090590:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110737000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788201700.090590:0:111029:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1f000 00000020:00000080:3.0:1788201700.090595:0:111029:0:(genops.c:885:class_export_put()) final put ffff8dc1401c4800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788201700.090609:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1401c4800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788201700.090854:0:111029:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788201700.090857:0:111029:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788201700.090859:0:111029:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901913 gen 5 00000004:00080000:3.0:1788201700.090861:0:111029:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788201700.090862:0:111029:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201700.090888:0:41592:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc11d43c800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788201700.090889:0:111029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201700.090897:0:111029:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788201700.090901:0:111029:0:(genops.c:885:class_export_put()) final put ffff8dc1401c7800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788201700.090902:0:111029:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1401c7800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788201700.090907:0:111029:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788201700.090942:0:111029:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788201700.090945:0:111029:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1eff2 00000020:00000080:3.0:1788201700.090948:0:111029:0:(genops.c:885:class_export_put()) final put ffff8dc1401c3000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788201700.090957:0:111029:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='') 00000020:00000080:3.0:1788201700.090960:0:111029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201700.090964:0:111029:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788201700.090966:0:111029:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8dc0027d0000) has no exports 00000020:00000080:3.0:1788201700.090970:0:111029:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1efeb 00000020:00000080:3.0:1788201700.090972:0:111029:0:(genops.c:885:class_export_put()) final put ffff8dc11d43b000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788201700.090984:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc1401c3000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788201700.090991:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d43b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788201700.091535:0:111029:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1788201700.091538:0:111029:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201700.091539:0:111029:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 133143986193 gen 5 00000100:00100000:3.0:1788201700.091542:0:111029:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201700.091573:0:41592:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc11d439000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788201700.091576:0:111029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201700.091586:0:111029:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788201700.091589:0:111029:0:(genops.c:885:class_export_put()) final put ffff8dc11d43d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788201700.091591:0:111029:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d43d800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788201700.091603:0:111029:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788201700.091654:0:111029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201700.091657:0:111029:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788201700.091659:0:111029:0:(genops.c:885:class_export_put()) final put ffff8dc002a56800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788201700.091660:0:111029:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc002a56800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788201700.091663:0:111029:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788201700.091696:0:111029:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1efc1 00000020:00000080:3.0:1788201700.091699:0:111029:0:(genops.c:885:class_export_put()) final put ffff8dc0059d5000/lustre-MDD0001_UUID 00000020:01000000:3.0:1788201700.091707:0:111029:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1788201700.091710:0:111029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201700.091714:0:111029:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788201700.091717:0:111029:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8dc004040000) has no exports 00000020:00000080:1.0:1788201700.091725:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0059d5000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788201700.091736:0:111029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201700.091740:0:111029:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1788201700.091742:0:111029:0:(genops.c:885:class_export_put()) final put ffff8dc002a54000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788201700.091744:0:111029:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc002a54000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788201700.091747:0:111029:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788201700.091773:0:111029:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1efc8 00000020:00000080:3.0:1788201700.091776:0:111029:0:(genops.c:885:class_export_put()) final put ffff8dc0059d2800/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1788201700.091788:0:111029:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc12f00a800 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1788201700.091792:0:111029:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc12f00a800 2 00000020:01000004:3.0:1788201700.091795:0:111029:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dc12f00a800 from lustre-MDT0001 00000020:00000080:1.0:1788201700.091799:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc0059d2800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788201700.091816:0:111029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201700.091820:0:111029:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1788201700.091824:0:111029:0:(genops.c:885:class_export_put()) final put ffff8dc11cddc000/lustre-MDT0001_UUID 00000020:00000080:3.0:1788201700.091826:0:111029:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11cddc000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1788201700.091832:0:111029:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1788201700.091871:0:111029:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:3.0:1788201700.091874:0:111029:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1788201700.091876:0:111029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201700.091880:0:111029:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788201700.091889:0:111029:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8dc11077f800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788201700.091893:0:111029:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8dc12ef64d28) has exports, disconnecting them 00000020:00080000:3.0:1788201700.091896:0:111029:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8dc11077f800), last request at 1788201576 00000020:00000080:3.0:1788201700.091900:0:111029:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1f069 00000020:00080000:3.0:1788201700.091905:0:111029:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dc11077f800): rc 0 00000020:00000080:3.0:1788201700.091908:0:111029:0:(genops.c:885:class_export_put()) final put ffff8dc11077f800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788201700.091933:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11077f800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788201700.092395:0:111029:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788201700.092398:0:111029:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788201700.092400:0:111029:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788201700.092403:0:111029:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788201700.092437:0:41592:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc1401c2000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788201700.092518:0:111029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788201700.092526:0:111029:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788201700.092528:0:111029:0:(genops.c:885:class_export_put()) final put ffff8dc110733000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788201700.092530:0:111029:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc110733000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788201700.092533:0:111029:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788201700.092563:0:111029:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc12f00a800 1 00000020:00000080:3.0:1788201700.092568:0:111029:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96d0c9b8c9a1ee55 00000020:00000080:3.0:1788201700.092572:0:111029:0:(genops.c:885:class_export_put()) final put ffff8dc005a4b800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788201700.092585:0:111029:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788201700.092589:0:111029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788201700.092592:0:111029:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788201700.092594:0:111029:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8dc12f30b370) has no exports 00000020:00000080:1.0:1788201700.092611:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc005a4b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788201700.105508:0:111029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788201700.105521:0:111029:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788201700.105526:0:111029:0:(genops.c:885:class_export_put()) final put ffff8dc12f00d000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788201700.105530:0:111029:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc12f00d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788201700.105536:0:111029:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788201700.105641:0:111029:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dc12f00c800 00000020:02000400:0.0:1788201700.105707:0:111029:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1788201700.751118:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201701.775218:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788201702.223965:0:100576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788201702.223973:0:100576:0:(genops.c:885:class_export_put()) final put ffff8dc139bc1800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788201702.223993:0:100576:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:2.0:1788201702.223996:0:100576:0:(genops.c:885:class_export_put()) final put ffff8dc001e2f800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:0.0:1788201702.224010:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc139bc1800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788201702.224070:0:41592:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc001e2f800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 for lustre-OST0001 00000020:00000080:0.0:1788201702.224095:0:41592:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc139bc4800 for lustre-OST0001 00000020:00000080:0.0:1788201702.224099:0:41592:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc0053a2000 for lustre-OST0001 00000001:00100000:2.0:1788201702.736138:0:99761:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788201702.736151:0:99761:0:(genops.c:885:class_export_put()) final put ffff8dc11d43f800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788201702.736179:0:99761:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:2.0:1788201702.736189:0:99761:0:(genops.c:885:class_export_put()) final put ffff8dc10603f800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 00000020:00000080:1.0:1788201702.736226:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc11d43f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788201702.736284:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc10603f800/6e293f14-c501-4bc5-9dd4-a18ef02756b4 for lustre-OST0000 00000020:00000080:1.0:1788201702.736304:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc11d438000 for lustre-OST0000 00000020:00000080:1.0:1788201702.736308:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc10603a800 for lustre-OST0000 00010000:00010000:1.0:1788201702.800134:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788201702.807236:0:111479:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788201702.807239:0:111479:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788201702.807240:0:111479:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788201702.807307:0:111479:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dc110732000 00000020:01000004:0.0:1788201702.807320:0:111479:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788201702.807330:0:111479:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788201702.807341:0:111479:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8dc0026419b8) 00000020:00000080:0.0:1788201702.807353:0:111479:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788201702.827974:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788201702.828644:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1788201702.829723:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788201702.830043:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788201702.830212:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788201702.830371:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788201702.830514:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788201702.830647:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788201702.830785:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788201702.830971:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788201702.831159:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788201702.831329:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788201702.831500:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788201702.831649:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788201702.832489:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788201702.832636:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788201702.832775:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788201702.832922:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788201702.833229:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788201702.833351:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788201702.833470:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788201702.833599:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788201702.833751:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788201702.833919:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788201702.834084:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788201702.834233:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788201702.834368:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788201702.834486:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788201702.834598:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1788201702.834714:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788201702.834836:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1788201702.834955:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788201702.835089:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788201702.835215:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788201702.835326:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788201702.835532:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1788201702.835662:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788201702.835779:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788201702.835914:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788201702.836065:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788201702.836200:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788201702.836320:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788201702.836436:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788201702.836554:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1788201702.836682:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788201702.836835:0:111479:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00080000:01000000:3.0:1788201702.838567:0:111479:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788201702.838715:0:111479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788201702.838721:0:111479:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788201702.838729:0:111479:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x96d0c9b8c9a1fc1d 00000020:01000004:3.0:1788201702.838735:0:111479:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788201702.838754:0:111479:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.120@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788201702.838756:0:111479:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788201702.838760:0:111479:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788201702.838778:0:111479:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788201702.838781:0:111479:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.120@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788201702.840934:0:111479:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.120@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788201702.840963:0:111479:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.120@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788201702.840967:0:111479:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788201702.840969:0:111479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788201702.840970:0:111479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201702.840976:0:111479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201702.840977:0:111479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201702.840978:0:111479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201702.840979:0:111479:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201702.840981:0:111479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201702.840982:0:111479:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788201702.840984:0:111479:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788201702.840986:0:111479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788201702.840987:0:111479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788201702.840988:0:111479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201702.840989:0:111479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201702.840990:0:111479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201702.840991:0:111479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201702.840992:0:111479:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201702.840993:0:111479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201702.840994:0:111479:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788201702.841039:0:111479:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788201702.841058:0:111479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715545728:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788201702.841125:0:111479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.841166:0:111479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f6df00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201702.841188:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715545728 00000100:00100000:0.0:1788201702.841195:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715545728 00000100:00100000:0.0:1788201702.841238:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788201702.841245:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:111479:x1875060715545728:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788201702.841268:0:109772:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788201702.841275:0:109772:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788201702.841281:0:109772:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000001:00100000:3.0:1788201702.841805:0:109767:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1788201702.841813:0:109767:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 137438953473 is committed 00000020:00000080:3.0:1788201702.841816:0:109767:0:(genops.c:885:class_export_put()) final put ffff8dc006e34800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788201702.841856:0:93109:0:(genops.c:844:class_export_destroy()) destroying export ffff8dc006e34800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000100:00100000:1.0:1788201702.841921:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:111479:x1875060715545728:12345-0@lo:253:mount.lustre.0 Request processed in 672us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201702.841931:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000020:00000080:0.0:1788201702.841935:0:93109:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dc11ccfc000 for lustre-MDT0000 00000100:00100000:3.0:1788201702.841935:0:111479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715545728:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788201702.841949:0:111479:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788201702.841951:0:111479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788201702.841952:0:111479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788201702.841953:0:111479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788201702.841954:0:111479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788201702.841955:0:111479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788201702.841956:0:111479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788201702.841958:0:111479:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788201702.841959:0:111479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788201702.841960:0:111479:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788201702.841980:0:111479:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dc110732000 from lustre-MDT0001 10000000:01000000:3.0:1788201702.841995:0:111479:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788201702.842000:0:111479:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788201702.842007:0:111479:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8dc12563cd28 local copy 00010000:00010000:3.0:1788201702.842029:0:111479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec800/0x96d0c9b8c9a1f9ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f9f4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201702.842077:0:111479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715545856:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201702.842097:0:111479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.842114:0:111479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fae13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201702.842133:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715545856 00000100:00100000:0.0:1788201702.842137:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715545856 00000100:00100000:0.0:1788201702.842166:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788201702.842171:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:111479:x1875060715545856:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201702.842228:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+19:111479:x1875060715545856:12345-0@lo:501:mount.lustre.0 Request processed in 57us (130us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788201702.842234:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788201702.842238:0:111479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715545856:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788201702.842250:0:111479:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788201702.842263:0:111479:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788201702.842267:0:111479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec800/0x96d0c9b8c9a1f9ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f9f4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201702.842272:0:111479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc1064ec800/0x96d0c9b8c9a1f9ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1f9f4 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201702.842293:0:111479:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dc110732000 10000000:01000000:3.0:1788201702.842296:0:111479:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788201702.842299:0:111479:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8dc110732000 10000000:01000000:3.0:1788201702.842300:0:111479:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788201702.842302:0:111479:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dc110732000 from 1 10000000:01000000:3.0:1788201702.842304:0:111479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788201702.842318:0:111479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74600/0x96d0c9b8c9a1fc24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201702.842323:0:111479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc108c74600/0x96d0c9b8c9a1fc24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201702.842338:0:111479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc108c74600/0x96d0c9b8c9a1fc24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201702.842345:0:111479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715545984:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201702.842371:0:111479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.842388:0:111479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fae13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201702.842408:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715545984 00000100:00100000:1.0:1788201702.842414:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715545984 00000100:00100000:1.0:1788201702.842448:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788201702.842454:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc002b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+19:111479:x1875060715545984:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201702.842460:0:109772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201702.842470:0:109772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0075ee000/0x96d0c9b8c9a1fc2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1fc24 expref: -99 pid: 109772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.842487:0:109772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0075ee000/0x96d0c9b8c9a1fc2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1fc24 expref: 20 pid: 109772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.842494:0:109772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0075ee000/0x96d0c9b8c9a1fc2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1fc24 expref: 20 pid: 109772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.842499:0:109772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0075ee000, rc 0) 00000100:00100000:1.0:1788201702.842524:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc002b3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+20:111479:x1875060715545984:12345-0@lo:101:mount.lustre.0 Request processed in 71us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201702.842529:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788201702.842536:0:111479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715545984:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201702.842547:0:111479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc108c74600/0x96d0c9b8c9a1fc24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1fc2b expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201702.842553:0:111479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc108c74600/0x96d0c9b8c9a1fc24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1fc2b expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201702.842563:0:111479:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788201702.842570:0:111479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c74600/0x96d0c9b8c9a1fc24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1fc2b expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201702.842574:0:111479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc108c74600/0x96d0c9b8c9a1fc24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1fc2b expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201702.842578:0:111479:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788201702.842581:0:111479:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788201702.842583:0:111479:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8dc110732000 10000000:01000000:3.0:1788201702.842585:0:111479:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788201702.842587:0:111479:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788201702.842588:0:111479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788201702.842595:0:111479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c75400/0x96d0c9b8c9a1fc32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201702.842604:0:111479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc108c75400/0x96d0c9b8c9a1fc32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201702.842608:0:111479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc108c75400/0x96d0c9b8c9a1fc32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201702.842615:0:111479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715546112:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201702.842632:0:111479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.842642:0:111479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fae13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201702.842662:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715546112 00000100:00100000:0.0:1788201702.842666:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715546112 00000100:00100000:0.0:1788201702.842688:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788201702.842694:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+20:111479:x1875060715546112:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788201702.842700:0:109774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788201702.842707:0:109774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0056d7e00/0x96d0c9b8c9a1fc39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1fc32 expref: -99 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201702.842718:0:109774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0056d7e00/0x96d0c9b8c9a1fc39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1fc32 expref: 21 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201702.842723:0:109774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0056d7e00/0x96d0c9b8c9a1fc39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1fc32 expref: 21 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201702.842728:0:109774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0056d7e00, rc 0) 00000100:00100000:0.0:1788201702.842754:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:111479:x1875060715546112:12345-0@lo:101:mount.lustre.0 Request processed in 61us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201702.842758:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788201702.842765:0:111479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715546112:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201702.842775:0:111479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc108c75400/0x96d0c9b8c9a1fc32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1fc39 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201702.842780:0:111479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc108c75400/0x96d0c9b8c9a1fc32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1fc39 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201702.843393:0:111479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x74:0x0] index 59 count 58 00000040:00080000:3.0:1788201702.843705:0:111479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201702.845859:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].1, 224 off8416 00000040:00080000:3.0:1788201702.845880:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].2, 136 off8552 00000040:00080000:3.0:1788201702.845888:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].3, 176 off8728 00000040:00080000:3.0:1788201702.845895:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].4, 224 off8952 00000040:00080000:3.0:1788201702.845902:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].5, 224 off9176 00000040:00080000:3.0:1788201702.845909:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].6, 120 off9296 00000040:00080000:3.0:1788201702.845916:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].7, 112 off9408 00000040:00080000:3.0:1788201702.845923:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].8, 160 off9568 00000040:00080000:3.0:1788201702.845929:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].9, 224 off9792 00000040:00080000:3.0:1788201702.845936:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].10, 224 off10016 00000040:00080000:3.0:1788201702.845949:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].11, 88 off10104 00000040:00080000:3.0:1788201702.845955:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].12, 144 off10248 00000040:00080000:3.0:1788201702.845962:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].13, 152 off10400 00000040:00080000:3.0:1788201702.845969:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].14, 168 off10568 00000040:00080000:3.0:1788201702.845975:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].15, 224 off10792 00000040:00080000:3.0:1788201702.845982:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].16, 224 off11016 00000040:00080000:3.0:1788201702.845990:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].17, 80 off11096 00000040:00080000:3.0:1788201702.846002:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].18, 224 off11320 00000040:00080000:3.0:1788201702.846033:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].19, 224 off11544 00000040:00080000:3.0:1788201702.846050:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].20, 160 off11704 00000040:00080000:3.0:1788201702.846058:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].21, 224 off11928 00000040:00080000:3.0:1788201702.846065:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].22, 224 off12152 00000040:00080000:3.0:1788201702.846072:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].23, 80 off12232 00000040:00080000:3.0:1788201702.846079:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].24, 224 off12456 00000040:00080000:3.0:1788201702.846086:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].25, 224 off12680 00000040:00080000:3.0:1788201702.846093:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].26, 88 off12768 00000040:00080000:3.0:1788201702.846100:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].27, 144 off12912 00000040:00080000:3.0:1788201702.846107:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].28, 152 off13064 00000040:00080000:3.0:1788201702.846113:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].29, 136 off13200 00000040:00080000:3.0:1788201702.846120:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].30, 224 off13424 00000040:00080000:3.0:1788201702.846127:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].31, 224 off13648 00000040:00080000:3.0:1788201702.846133:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].32, 80 off13728 00000040:00080000:3.0:1788201702.846142:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].33, 224 off13952 00000040:00080000:3.0:1788201702.846154:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].34, 224 off14176 00000040:00080000:3.0:1788201702.846167:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].35, 88 off14264 00000040:00080000:3.0:1788201702.846181:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].36, 144 off14408 00000040:00080000:3.0:1788201702.846189:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].37, 152 off14560 00000040:00080000:3.0:1788201702.846196:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].38, 136 off14696 00000040:00080000:3.0:1788201702.846204:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].39, 224 off14920 00000040:00080000:3.0:1788201702.846211:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].40, 224 off15144 00000040:00080000:3.0:1788201702.846218:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].41, 80 off15224 00000040:00080000:3.0:1788201702.846225:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].42, 224 off15448 00000040:00080000:3.0:1788201702.846231:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].43, 224 off15672 00000040:00080000:3.0:1788201702.846245:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].44, 120 off15792 00000040:00080000:3.0:1788201702.846252:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].45, 224 off16016 00000040:00080000:3.0:1788201702.846259:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].46, 224 off16240 00000040:00080000:3.0:1788201702.846267:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].47, 120 off16360 00000040:00080000:3.0:1788201702.846274:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].48, 24 off16384 00000040:00080000:3.0:1788201702.846337:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].49, 224 off16608 00000040:00080000:3.0:1788201702.846350:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].50, 224 off16832 00000040:00080000:3.0:1788201702.846357:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].51, 144 off16976 00000040:00080000:3.0:1788201702.846364:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].52, 224 off17200 00000040:00080000:3.0:1788201702.846371:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].53, 224 off17424 00000040:00080000:3.0:1788201702.846378:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].54, 144 off17568 00000040:00080000:3.0:1788201702.846384:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].55, 224 off17792 00000040:00080000:3.0:1788201702.846391:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].56, 224 off18016 00000040:00080000:3.0:1788201702.846398:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].57, 120 off18136 00000040:00080000:3.0:1788201702.846408:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x79:0x0].58, 224 off18360 00000040:00080000:3.0:1788201702.846411:0:111479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x74:0x0] index 58 count 58 00000100:00100000:3.0:1788201702.846463:0:111479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715546240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201702.846494:0:111479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.846519:0:111479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fae1780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201702.846543:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715546240 00000100:00100000:1.0:1788201702.846550:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715546240 00000100:00100000:1.0:1788201702.846587:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788201702.846593:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:111479:x1875060715546240:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201702.846669:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:111479:x1875060715546240:12345-0@lo:501:mount.lustre.0 Request processed in 77us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201702.846681:0:111479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715546240:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201702.846683:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788201702.846709:0:111479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715546368:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201702.846738:0:111479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.846750:0:111479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fae1780 going to sleep for 11 seconds 00000100:00100000:0.0:1788201702.846779:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715546368 00000100:00100000:0.0:1788201702.846785:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715546368 00000100:00100000:0.0:1788201702.846833:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788201702.846843:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:111479:x1875060715546368:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201702.846925:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:111479:x1875060715546368:12345-0@lo:503:mount.lustre.0 Request processed in 84us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201702.846932:0:111479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715546368:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788201702.846937:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000040:00080000:3.0:1788201702.847191:0:111479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201702.847227:0:111479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715546496:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201702.847253:0:111479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.847269:0:111479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fae13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201702.847285:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715546496 00000100:00100000:1.0:1788201702.847289:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715546496 00000100:00100000:1.0:1788201702.847316:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788201702.847323:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11073a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:111479:x1875060715546496:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201702.847638:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11073a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:111479:x1875060715546496:12345-0@lo:502:mount.lustre.0 Request processed in 316us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201702.847643:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788201702.847673:0:111479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715546496:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201702.847786:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].1, 224 off8416 00000040:00080000:3.0:1788201702.847819:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].2, 136 off8552 00000040:00080000:3.0:1788201702.847828:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].3, 176 off8728 00000040:00080000:3.0:1788201702.847836:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].4, 224 off8952 00000040:00080000:3.0:1788201702.847843:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].5, 224 off9176 00000040:00080000:3.0:1788201702.847850:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].6, 120 off9296 00000040:00080000:3.0:1788201702.847857:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].7, 112 off9408 00000040:00080000:3.0:1788201702.847863:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].8, 160 off9568 00000040:00080000:3.0:1788201702.847870:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].9, 224 off9792 00000040:00080000:3.0:1788201702.847877:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].10, 224 off10016 00000040:00080000:3.0:1788201702.847884:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].11, 88 off10104 00000040:00080000:3.0:1788201702.847892:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].12, 144 off10248 00000040:00080000:3.0:1788201702.847898:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].13, 152 off10400 00000040:00080000:3.0:1788201702.847906:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].14, 168 off10568 00000040:00080000:3.0:1788201702.847912:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].15, 224 off10792 00000040:00080000:3.0:1788201702.847919:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].16, 224 off11016 00000040:00080000:3.0:1788201702.847926:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].17, 80 off11096 00000040:00080000:3.0:1788201702.847933:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].18, 224 off11320 00000040:00080000:3.0:1788201702.847939:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].19, 224 off11544 00000040:00080000:3.0:1788201702.847946:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].20, 160 off11704 00000040:00080000:3.0:1788201702.847953:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].21, 224 off11928 00000040:00080000:3.0:1788201702.847961:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].22, 224 off12152 00000040:00080000:3.0:1788201702.847971:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].23, 80 off12232 00000040:00080000:3.0:1788201702.847979:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].24, 224 off12456 00000040:00080000:3.0:1788201702.847986:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].25, 224 off12680 00000040:00080000:3.0:1788201702.848002:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].26, 88 off12768 00000040:00080000:3.0:1788201702.848010:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].27, 144 off12912 00000040:00080000:3.0:1788201702.848050:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].28, 152 off13064 00000040:00080000:3.0:1788201702.848059:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].29, 136 off13200 00000040:00080000:3.0:1788201702.848065:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].30, 224 off13424 00000040:00080000:3.0:1788201702.848072:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].31, 224 off13648 00000040:00080000:3.0:1788201702.848086:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].32, 80 off13728 00000040:00080000:3.0:1788201702.848093:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].33, 224 off13952 00000040:00080000:3.0:1788201702.848099:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].34, 224 off14176 00000040:00080000:3.0:1788201702.848106:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].35, 88 off14264 00000040:00080000:3.0:1788201702.848113:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].36, 144 off14408 00000040:00080000:3.0:1788201702.848120:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].37, 152 off14560 00000040:00080000:3.0:1788201702.848126:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].38, 136 off14696 00000040:00080000:3.0:1788201702.848133:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].39, 224 off14920 00000040:00080000:3.0:1788201702.848140:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].40, 224 off15144 00000040:00080000:3.0:1788201702.848148:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].41, 80 off15224 00000040:00080000:3.0:1788201702.848154:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].42, 224 off15448 00000040:00080000:3.0:1788201702.848161:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].43, 224 off15672 00000040:00080000:3.0:1788201702.848168:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].44, 120 off15792 00000040:00080000:3.0:1788201702.848175:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].45, 224 off16016 00000040:00080000:3.0:1788201702.848182:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].46, 224 off16240 00000040:00080000:3.0:1788201702.848188:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].47, 120 off16360 00000040:00080000:3.0:1788201702.848196:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].48, 24 off16384 00000100:00100000:3.0:1788201702.848212:0:111479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715546624:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201702.848234:0:111479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.848249:0:111479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fae13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788201702.848267:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715546624 00000100:00100000:0.0:1788201702.848271:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715546624 00000100:00100000:0.0:1788201702.848293:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788201702.848298:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11073b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:111479:x1875060715546624:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201702.848501:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11073b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:111479:x1875060715546624:12345-0@lo:502:mount.lustre.0 Request processed in 202us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201702.848506:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788201702.848520:0:111479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715546624:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201702.848592:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].49, 224 off16608 00000040:00080000:3.0:1788201702.848605:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].50, 224 off16832 00000040:00080000:3.0:1788201702.848612:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].51, 144 off16976 00000040:00080000:3.0:1788201702.848619:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].52, 224 off17200 00000040:00080000:3.0:1788201702.848625:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].53, 224 off17424 00000040:00080000:3.0:1788201702.848632:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].54, 144 off17568 00000040:00080000:3.0:1788201702.848639:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].55, 224 off17792 00000040:00080000:3.0:1788201702.848645:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].56, 224 off18016 00000040:00080000:3.0:1788201702.848652:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].57, 120 off18136 00000100:00100000:3.0:1788201702.848663:0:111479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715546752:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201702.848687:0:111479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.848699:0:111479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc12fae13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788201702.848717:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715546752 00000100:00100000:1.0:1788201702.848721:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715546752 00000100:00100000:1.0:1788201702.848740:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788201702.848744:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11073b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:111479:x1875060715546752:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201702.848815:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11073b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+21:111479:x1875060715546752:12345-0@lo:502:mount.lustre.0 Request processed in 69us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201702.848822:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788201702.848831:0:111479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715546752:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201702.848861:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7a:0x0].58, 224 off18360 00000040:00080000:3.0:1788201702.848865:0:111479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 58 count 58 00000020:01000000:1.0:1788201702.849298:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201702.849308:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201702.849310:0:111483:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788201702.849316:0:111483:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788201702.849318:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201702.849331:0:111483:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8dc139bb8000) 00000020:00000080:1.0:1788201702.849348:0:111483:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1788201702.849352:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788201702.849415:0:111483:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788201702.849421:0:111483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x96d0c9b8c9a1fc47 00000020:00000080:1.0:1788201702.849577:0:111483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788201702.849581:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201702.849584:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201702.849589:0:111483:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788201702.849592:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201702.849594:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201702.849595:0:111483:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788201702.849597:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201702.849603:0:111483:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8dc139bbcd28) 00000020:00000080:1.0:1788201702.849611:0:111483:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788201702.849613:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788201702.849615:0:111483:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788201702.849617:0:111483:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788201702.849620:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788201702.849651:0:111483:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc110732000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788201702.849658:0:111483:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8dc139bb99b8) 00000020:00000080:1.0:1788201702.849665:0:111483:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788201702.849700:0:111483:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788201702.849703:0:111483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x96d0c9b8c9a1fc5c 00000020:00000080:1.0:1788201702.849764:0:111483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788201702.849769:0:111483:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788201702.849771:0:111483:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x96d0c9b8c9a1fc63 00080000:01000000:1.0:1788201702.849774:0:111483:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788201702.849777:0:111483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x96d0c9b8c9a1fc6a 00010000:00010000:1.0:1788201702.881428:0:111483:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-4 is initialized 00000001:00080000:1.0:1788201702.881809:0:111483:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 0 lr: 0 srv lr: 85899345930 lx: 0 gen 28 00000001:00080000:1.0:1788201702.881856:0:111483:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 6e293f14-c501-4bc5-9dd4-a18ef02756b4 idx: 2 lr: 81604378641 srv lr: 85899345930 lx: 0 gen 24 00000001:00000004:1.0:1788201702.881878:0:111483:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 21, last_transno is 85899345930 00000001:00080000:1.0:1788201702.882110:0:111483:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:1.0:1788201702.882164:0:111483:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0001: restore reply ffff8dc1065c7b40: xid 1875060695589888, transno 85899345930, client gen 24, slot idx 0 00000020:00000080:1.0:1788201702.883065:0:111483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788201702.883074:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201702.883078:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201702.883080:0:111483:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788201702.883088:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201702.883092:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201702.883093:0:111483:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788201702.883096:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788201702.883100:0:111483:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:00000080:1.0:1788201702.883122:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788201702.883134:0:111483:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8dc1060e4d28) 00000020:00000080:1.0:1788201702.883149:0:111483:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1788201702.883153:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788201702.883220:0:111483:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788201702.883227:0:111483:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788201702.883234:0:111483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x96d0c9b8c9a1fc86 00010000:00080000:1.0:1788201702.883269:0:111483:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc1257f4000@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.120@tcp at head 00010000:00010000:1.0:1788201702.884695:0:111483:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-9 is initialized 00000020:00000080:3.0:1788201702.885328:0:111483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788201702.885337:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788201702.885365:0:111483:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788201702.885383:0:111483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x96d0c9b8c9a1fc8d 00000100:00080000:3.0:1788201702.885391:0:111483:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788201702.885397:0:111483:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8dc1257f4000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:3.0:1788201702.885429:0:111483:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc007c34700 x1875060715546880/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788201702.885456:0:111483:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788201702.885479:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715546880:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788201702.885531:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201702.885534:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788201702.885537:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000020:01000000:3.0:1788201702.885537:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:0.0:1788201702.885544:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201702.885544:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:1.0:1788201702.885546:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 4550 00000020:00000080:3.0:1788201702.885546:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201702.885555:0:111483:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000100:00080000:1.0:1788201702.885557:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201702.885564:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8dc13f86f000 using connection 192.168.201.120@tcp/0@lo 00000020:01000000:3.0:1788201702.885564:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788201702.885570:0:111483:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000100:00100000:2.0:1788201702.885575:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715547008:0@lo:400:kworker.0 00000020:01000000:3.0:1788201702.885575:0:111483:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201702.885582:0:111483:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000100:00100000:1.0:1788201702.885583:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc004b38700 x1875060715547136/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:01000000:3.0:1788201702.885589:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788201702.885596:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201702.885599:0:111483:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788201702.885602:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201702.885608:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00080000:1.0:1788201702.885609:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000080:3.0:1788201702.885612:0:111483:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000100:00100000:0.0:1788201702.885614:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715547136:0@lo:38:kworker.0 00000100:00080000:1.0:1788201702.885614:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788201702.885617:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000020:00000080:3.0:1788201702.885622:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00080000:1.0:1788201702.885624:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 4550 00000100:00080000:1.0:1788201702.885627:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788201702.885629:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8dc1401c2800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201702.885645:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11cc45c00 x1875060715547392/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201702.885655:0:93109:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788201702.885660:0:93109:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788201702.885662:0:93109:0:(import.c:65:import_set_state_nolock()) ffff8dc10603c000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000004:01000000:3.0:1788201702.885666:0:111483:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788201702.885668:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201702.885677:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715546880 00000100:00080000:1.0:1788201702.885677:0:93109:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 4550 00000100:00080000:1.0:1788201702.885682:0:93109:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00100000:0.0:1788201702.885686:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715546880 00000100:00080000:1.0:1788201702.885686:0:93109:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8dc10603c000 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201702.885706:0:93109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11cc44380 x1875060715547520/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:01000000:3.0:1788201702.885712:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201702.885725:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:0.0:1788201702.885726:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000020:00000080:3.0:1788201702.885730:0:111483:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000100:00100000:0.0:1788201702.885739:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715546880:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788201702.885739:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715547264:0@lo:400:kworker.0 00000020:01000000:3.0:1788201702.885742:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788201702.885757:0:111483:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1788201702.885760:0:111483:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201702.885763:0:111483:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788201702.885768:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00010000:00080000:0.0:1788201702.885775:0:99776:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4554 last 0 00000100:00100000:1.0:1788201702.885778:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715547904:0@lo:400:kworker.0 00000100:00100000:3.0:1788201702.885788:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715547648:0@lo:400:kworker.0 00000100:00100000:2.0:1788201702.885806:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788201702.885831:0:99776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x96d0c9b8c9a1fc94 00000004:00100000:0.0:1788201702.885846:0:99776:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1788201702.885846:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.885871:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201702.885884:0:109776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715547008 00000100:00100000:2.0:1788201702.885893:0:109776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715547008 00000100:00100000:3.0:1788201702.885908:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788201702.885909:0:111030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715547264 00000100:00100000:1.0:1788201702.885917:0:111030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715547264 00000100:00100000:3.0:1788201702.885920:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715547776:0@lo:400:kworker.0 00000100:00080000:0.0:1788201702.885930:0:99776:0:(import.c:65:import_set_state_nolock()) ffff8dc110731000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788201702.885957:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201702.885979:0:109776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715547904 00000100:00100000:2.0:1788201702.885983:0:109776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715547904 00000100:00100000:1.0:1788201702.885989:0:111030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788201702.885996:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715546880:12345-0@lo:38:llog_process_th.0 Request processed in 260us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201702.886005:0:111030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715547008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201702.886012:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788201702.886057:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715547648 00000100:00100000:3.0:1788201702.886064:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715547648 00000100:00100000:2.0:1788201702.886069:0:109776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788201702.886083:0:109776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715547264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788201702.886090:0:111030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1875060715547008:12345-0@lo:400:kworker.0 Request processed in 89us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201702.886099:0:111030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788201702.886111:0:100688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715547776 00000100:00100000:3.0:1788201702.886117:0:100688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715547776 00000100:00100000:1.0:1788201702.886120:0:111030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788201702.886133:0:111030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715547904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788201702.886157:0:109776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1875060715547264:12345-0@lo:400:kworker.0 Request processed in 76us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201702.886171:0:109776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788201702.886171:0:100688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788201702.886182:0:111030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1875060715547904:12345-0@lo:400:kworker.0 Request processed in 49us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201702.886193:0:101189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788201702.886194:0:111030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788201702.886197:0:100688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715547648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788201702.886207:0:101189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715547776:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788201702.886220:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788201702.886227:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788201702.886231:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788201702.886245:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3655:1875060715547904:0@lo:400:kworker.0 00000100:00100000:3.0:1788201702.886296:0:100688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715547648:12345-0@lo:400:kworker.0 Request processed in 101us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201702.886302:0:101189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3657:x1875060715547776:12345-0@lo:400:kworker.0 Request processed in 94us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201702.886309:0:100688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788201702.886320:0:101189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788201702.886331:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.886357:0:107403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715547136 00000100:00100000:3.0:1788201702.886364:0:107403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715547136 00000100:00100000:2.0:1788201702.886379:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788201702.886388:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 32 00000100:00080000:2.0:1788201702.886394:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788201702.886401:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788201702.886404:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1257f4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788201702.886405:0:107403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788201702.886420:0:107403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cd1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715547136:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788201702.886434:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc007c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715546880:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788201702.886471:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715547392:0@lo:38:kworker.0 00000100:00100000:3.0:1788201702.886474:0:107403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cd1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3654:x1875060715547136:12345-0@lo:38:kworker.0 Request processed in 51us (149us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788201702.886485:0:107403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788201702.886496:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788201702.886506:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715548032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201702.886519:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.886530:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715547776:0@lo:400:kworker.0 00000100:00100000:0.0:1788201702.886539:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201702.886567:0:111030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715547392 00000100:00100000:1.0:1788201702.886573:0:111030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715547392 00000100:00100000:2.0:1788201702.886573:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715547520:0@lo:38:kworker.0 00000100:00100000:3.0:1788201702.886581:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3657:1875060715547648:0@lo:400:kworker.0 00000100:00100000:1.0:1788201702.886602:0:111030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788201702.886606:0:111030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc007c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715547392:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788201702.886621:0:99775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715548032 00000100:00100000:2.0:1788201702.886626:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.886629:0:99775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715548032 00000100:00100000:1.0:1788201702.886642:0:111030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc007c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3654:x1875060715547392:12345-0@lo:38:kworker.0 Request processed in 35us (127us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788201702.886648:0:111030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788201702.886684:0:109785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715547520 00000100:00100000:3.0:1788201702.886690:0:99775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788201702.886691:0:109785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715547520 00000100:00080000:2.0:1788201702.886693:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc13f86f000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788201702.886699:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788201702.886705:0:99775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715548032:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201702.886708:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3654:1875060715547136:0@lo:38:kworker.0 00000100:00100000:0.0:1788201702.886717:0:109785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788201702.886727:0:109785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc008469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715547520:12345-0@lo:38:kworker.0 00000100:00080000:2.0:1788201702.886747:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc1401c2800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000004:00000024:3.0:1788201702.886751:0:99775:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444941824 avail 1298702336 00000100:00080000:2.0:1788201702.886752:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788201702.886763:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3654:1875060715547392:0@lo:38:kworker.0 00000100:00100000:0.0:1788201702.886774:0:109785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc008469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3654:x1875060715547520:12345-0@lo:38:kworker.0 Request processed in 43us (151us total) trans 0 rc -11/-11 00000100:00080000:2.0:1788201702.886781:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc10603c000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1788201702.886788:0:109785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:2.0:1788201702.886803:0:3654:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788201702.886809:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3654:1875060715547520:0@lo:38:kworker.0 00000100:00100000:3.0:1788201702.886839:0:99775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3655:x1875060715548032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201702.886848:0:99775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788201702.886871:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3655:1875060715548032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788201702.886880:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3656:1875060715547264:0@lo:400:kworker.0 00000020:00000080:3.0:1788201702.886884:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201702.886888:0:111483:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788201702.886895:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:2.0:1788201702.886900:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3656:1875060715547008:0@lo:400:kworker.0 00000020:01000004:3.0:1788201702.886900:0:111483:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788201702.886914:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201702.886916:0:111483:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788201702.886922:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788201702.886926:0:111483:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:3.0:1788201702.886945:0:111483:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788201702.886948:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788201702.886959:0:111483:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8dc12ef64d28) 00000020:00000080:3.0:1788201702.886974:0:111483:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1788201702.886982:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788201702.887090:0:111483:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788201702.887096:0:111483:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788201702.887102:0:111483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x96d0c9b8c9a1fca2 00010000:00080000:3.0:1788201702.887159:0:111483:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc003956800@lustre-OST0000-osc-MDT0001: add connection 192.168.201.120@tcp at head 00010000:00010000:3.0:1788201702.887433:0:111483:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-10 is initialized 00000040:01000000:1.0:1788201702.887943:0:111483:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788201702.888064:0:111483:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788201702.888744:0:111483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201702.888937:0:111483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].21, 64 off9536 00000040:00080000:1.0:1788201702.889098:0:111483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x54:0x0].1, 64 off8256 00000040:00080000:1.0:1788201702.889295:0:111488:0:(llog.c:805:llog_process_thread()) index: 21, lh_last_idx: 21 synced_idx: 21 lgh_last_idx: 21 00000040:00080000:1.0:1788201702.889299:0:111488:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x54:0x0] at index 21 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788201702.889694:0:111483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788201702.889700:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788201702.889723:0:111483:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788201702.889734:0:111483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x96d0c9b8c9a1fca9 00000100:00080000:0.0:1788201702.889740:0:111483:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788201702.889744:0:111483:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8dc003956800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:0.0:1788201702.889759:0:111483:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc001e40a80 x1875060715548160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788201702.889776:0:111483:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788201702.889824:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:2.0:1788201702.889833:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715548160:0@lo:8:llog_process_th.0 00000020:00000080:0.0:1788201702.889835:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201702.889841:0:111483:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788201702.889849:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788201702.889851:0:111483:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1788201702.889853:0:111483:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788201702.889854:0:111483:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788201702.889855:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788201702.889859:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201702.889860:0:111483:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788201702.889863:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788201702.889865:0:111483:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788201702.889869:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788201702.889870:0:111483:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788201702.889873:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788201702.889876:0:111483:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.120@tcp to nid 0x20000c0a8c978 (192.168.201.120@tcp) 00000020:01000000:0.0:1788201702.889891:0:111483:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788201702.889893:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788201702.889901:0:111483:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8dc002643370) 00000100:00100000:2.0:1788201702.889902:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788201702.889916:0:111483:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1788201702.889921:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1788201702.889939:0:101191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715548160 00000100:00100000:1.0:1788201702.889945:0:101191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715548160 00000100:00100000:1.0:1788201702.889973:0:101191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000004:00080000:0.0:1788201702.889975:0:111483:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00000100:00100000:1.0:1788201702.889979:0:101191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc008468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3654:x1875060715548160:12345-0@lo:8:llog_process_th.0 00080000:01000000:0.0:1788201702.889981:0:111483:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788201702.889988:0:111483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x96d0c9b8c9a1fcb7 00010000:00080000:1.0:1788201702.889996:0:101191:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4554 last 0 00010000:00080000:0.0:1788201702.890013:0:111483:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc10bd94800@lustre-OST0001-osc-MDT0001: add connection 192.168.201.120@tcp at head 00000020:00000080:1.0:1788201702.890042:0:101191:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x96d0c9b8c9a1fcbe 00002000:00100000:1.0:1788201702.890052:0:101191:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8dc109811000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788201702.890058:0:101191:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1788201702.890061:0:101191:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788201702.890108:0:101191:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788201702.890122:0:101191:0:(import.c:65:import_set_state_nolock()) ffff8dc109810000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788201702.890179:0:101191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc008468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715548160:12345-0@lo:8:llog_process_th.0 Request processed in 200us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201702.890191:0:101191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788201702.890218:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00010000:00010000:0.0:1788201702.890224:0:111483:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000100:00080000:2.0:1788201702.890227:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 4 00000100:00080000:2.0:1788201702.890239:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788201702.890245:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788201702.890248:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc003956800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000040:01000000:0.0:1788201702.890265:0:111483:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000004:00080000:2.0:1788201702.890268:0:3654:0:(osp_dev.c:1648:osp_import_event()) got connected 00000040:01000000:0.0:1788201702.890272:0:111483:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1788201702.890278:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715548160:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1788201702.890282:0:111488:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788201702.890317:0:111488:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 4554362299964ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788201702.890321:0:111488:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788201702.890337:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715548288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788201702.890389:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201702.890447:0:99769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715548288 00000100:00100000:0.0:1788201702.890453:0:99769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715548288 00000100:00080000:3.0:1788201702.890490:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788201702.890520:0:99769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788201702.890533:0:99769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715548288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788201702.890553:0:99769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 3922464768 avail 3690942464 00000100:00100000:0.0:1788201702.890610:0:99769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715548288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201702.890616:0:99769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788201702.890643:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715548288:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1788201702.891602:0:111483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201702.891755:0:111483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].21, 64 off9536 00000004:00080000:2.0:1788201702.891858:0:111480:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000040:00080000:1.0:1788201702.891875:0:111483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x56:0x0].1, 64 off8256 00000040:00080000:1.0:1788201702.892134:0:111490:0:(llog.c:805:llog_process_thread()) index: 21, lh_last_idx: 21 synced_idx: 21 lgh_last_idx: 21 00000040:00080000:1.0:1788201702.892137:0:111490:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x56:0x0] at index 21 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788201702.892436:0:111483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788201702.892441:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788201702.892463:0:111483:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788201702.892473:0:111483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x96d0c9b8c9a1fcc5 00000100:00080000:1.0:1788201702.892477:0:111483:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201702.892480:0:111483:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8dc10bd94800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201702.892493:0:111483:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11cc46d80 x1875060715548416/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201702.892509:0:111483:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788201702.892544:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715548416:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1788201702.892548:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201702.892552:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201702.892555:0:111483:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788201702.892567:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201702.892573:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201702.892574:0:111483:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788201702.892578:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788201702.892579:0:111483:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788201702.892582:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201702.892584:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201702.892586:0:111483:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788201702.892587:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201702.892594:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201702.892596:0:111483:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788201702.892599:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788201702.892604:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201702.892607:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201702.892608:0:111483:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000020:01000000:1.0:1788201702.892609:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788201702.892611:0:111483:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #44 00000020:01000000:1.0:1788201702.892615:0:111483:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201702.892618:0:111483:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000100:00100000:2.0:1788201702.892623:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788201702.892629:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788201702.892633:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201702.892634:0:111483:0:(obd_config.c:1563:class_process_config()) marker 44 (0x6) lustre-MDT0001-m new lustre.pool_134 00000020:01000000:1.0:1788201702.892636:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788201702.892637:0:111483:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #47 00000020:01000000:1.0:1788201702.892638:0:111483:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201702.892639:0:111483:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788201702.892640:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788201702.892641:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201702.892643:0:111483:0:(obd_config.c:1563:class_process_config()) marker 47 (0x6) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000020:01000000:1.0:1788201702.892648:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201702.892650:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201702.892652:0:111483:0:(obd_config.c:1563:class_process_config()) marker 48 (0x1) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:1.0:1788201702.892657:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: ce022 00000100:00100000:3.0:1788201702.892660:0:99764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715548416 00000020:01000000:1.0:1788201702.892663:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:3.0:1788201702.892665:0:99764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715548416 00000020:00000080:1.0:1788201702.892666:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201702.892668:0:111483:0:(obd_config.c:1563:class_process_config()) marker 48 (0x2) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:01000000:1.0:1788201702.892672:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788201702.892675:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201702.892677:0:111483:0:(obd_config.c:1563:class_process_config()) marker 51 (0x1) lustre-MDT0001-m del lustre.pool_134 00000020:00000080:1.0:1788201702.892679:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: ce023 00000020:01000000:1.0:1788201702.892686:0:111483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788201702.892687:0:111483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788201702.892689:0:111483:0:(obd_config.c:1563:class_process_config()) marker 51 (0x2) lustre-MDT0001-m del lustre.pool_134 00000040:00080000:1.0:1788201702.892691:0:111483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x7a:0x0] index 59 count 58 00000100:00100000:3.0:1788201702.892695:0:99764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788201702.892704:0:99764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc008469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3654:x1875060715548416:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1788201702.892724:0:99764:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4554 last 0 00000020:00000080:3.0:1788201702.892744:0:99764:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x96d0c9b8c9a1fccc 00002000:00100000:3.0:1788201702.892754:0:99764:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8dc002a55800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 1 00000020:01000000:0.0:1788201702.892756:0:111479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-58 (rc=0) 00002000:00080000:3.0:1788201702.892758:0:99764:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788201702.892761:0:99764:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 10000000:01000000:0.0:1788201702.892809:0:111479:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00002000:00080000:3.0:1788201702.892812:0:99764:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00010000:00010000:0.0:1788201702.892824:0:111479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c75400/0x96d0c9b8c9a1fc32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1fc39 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788201702.892827:0:99764:0:(import.c:65:import_set_state_nolock()) ffff8dc002a56000 : changing import state from RECOVER to FULL 00010000:00010000:0.0:1788201702.892839:0:111479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc108c75400/0x96d0c9b8c9a1fc32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1fc39 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788201702.892847:0:111479:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dc110732000 from 1 10000000:01000000:0.0:1788201702.892850:0:111479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788201702.892872:0:111479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1fcd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201702.892879:0:111479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1fcd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201702.892882:0:99764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc008469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3654:x1875060715548416:12345-0@lo:8:llog_process_th.0 Request processed in 177us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201702.892894:0:99764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00010000:0.0:1788201702.892896:0:111479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1fcd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201702.892915:0:111479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc001e40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715548544:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788201702.892921:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788201702.892930:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788201702.892938:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788201702.892944:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788201702.892947:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc10bd94800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788201702.892954:0:111479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788201702.892977:0:3654:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788201702.892980:0:111479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc006e9a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201702.892985:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715548544 00000100:00100000:1.0:1788201702.892990:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715548544 00000100:00100000:2.0:1788201702.892991:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3654:1875060715548416:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788201702.893012:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788201702.893059:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715548672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201702.893063:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000004:00080000:2.0:1788201702.893078:0:111490:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788201702.893079:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11073b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+21:111479:x1875060715548544:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201702.893091:0:109774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1788201702.893095:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201702.893104:0:109774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0075ef600/0x96d0c9b8c9a1fcda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1fcd3 expref: -99 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.893124:0:109774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0075ef600/0x96d0c9b8c9a1fcda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1fcd3 expref: 22 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201702.893125:0:99768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715548672 00000100:00100000:0.0:1788201702.893130:0:99768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715548672 00010000:00010000:1.0:1788201702.893137:0:109774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0075ef600/0x96d0c9b8c9a1fcda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1fcd3 expref: 22 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.893145:0:109774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0075ef600, rc 0) 00000004:00080000:2.0:1788201702.893151:0:111490:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 4554365133367ns, next at 0ns, rc = 0 00000100:00080000:3.0:1788201702.893155:0:6528:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00080000:00080000:2.0:1788201702.893164:0:111490:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788201702.893172:0:99768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788201702.893186:0:99768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715548672:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788201702.893190:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11073b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:111479:x1875060715548544:12345-0@lo:101:mount.lustre.0 Request processed in 117us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201702.893199:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788201702.893203:0:111479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc001e40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715548544:0@lo:101:mount.lustre.0 00002000:00000024:0.0:1788201702.893214:0:99768:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 275520 pending 0 free 3923513344 avail 3691991040 00010000:00010000:3.0:1788201702.893217:0:111479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1fcd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1fcda expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201702.893226:0:111479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1fcd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1fcda expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201702.893254:0:99768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3657:x1875060715548672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201702.893259:0:99768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788201702.893286:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3657:1875060715548672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788201702.893702:0:111479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715548800:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788201702.893738:0:111479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.893766:0:111479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140024840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201702.893802:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715548800 00000100:00100000:1.0:1788201702.893807:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715548800 00000100:00100000:1.0:1788201702.893835:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788201702.893844:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:111479:x1875060715548800:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788201702.893858:0:109772:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788201702.893869:0:109772:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788201702.893872:0:109772:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788201702.893875:0:109772:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788201702.893878:0:109772:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788201702.893884:0:109772:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 144 00000100:00100000:1.0:1788201702.893982:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+22:111479:x1875060715548800:12345-0@lo:256:mount.lustre.0 Request processed in 138us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201702.893990:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788201702.894006:0:111479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715548800:0@lo:256:mount.lustre.0 00000004:00080000:2.0:1788201702.894068:0:111480:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 10000000:01000000:3.0:1788201702.894499:0:111479:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788201702.894511:0:111479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1fcd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1fcda expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201702.894516:0:111479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1fcd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1fcda expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788201702.894521:0:111479:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dc110732000 from 1 10000000:01000000:3.0:1788201702.894522:0:111479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788201702.894533:0:111479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c75600/0x96d0c9b8c9a1fce1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201702.894537:0:111479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc108c75600/0x96d0c9b8c9a1fce1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201702.894542:0:111479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc108c75600/0x96d0c9b8c9a1fce1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201702.894549:0:111479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715548928:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788201702.894567:0:111479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.894588:0:111479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140024840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201702.894590:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715548928 00000100:00100000:1.0:1788201702.894594:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715548928 00000100:00100000:1.0:1788201702.894614:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788201702.894619:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11073a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+22:111479:x1875060715548928:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201702.894624:0:109774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788201702.894629:0:109774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc0075eee00/0x96d0c9b8c9a1fce8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1fce1 expref: -99 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.894639:0:109774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0075eee00/0x96d0c9b8c9a1fce8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1fce1 expref: 23 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.894644:0:109774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc0075eee00/0x96d0c9b8c9a1fce8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1fce1 expref: 23 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.894648:0:109774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc0075eee00, rc 0) 00000100:00100000:1.0:1788201702.894671:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11073a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:111479:x1875060715548928:12345-0@lo:101:mount.lustre.0 Request processed in 52us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201702.894676:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788201702.894686:0:111479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715548928:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788201702.894702:0:111479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc108c75600/0x96d0c9b8c9a1fce1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1fce8 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788201702.894710:0:111479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc108c75600/0x96d0c9b8c9a1fce1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1fce8 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788201702.895238:0:111479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x76:0x0] index 7 count 7 00000040:00080000:3.0:1788201702.895374:0:111479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788201702.895478:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7b:0x0].1, 224 off8416 00000040:00080000:3.0:1788201702.895494:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7b:0x0].2, 112 off8528 00000040:00080000:3.0:1788201702.895501:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7b:0x0].3, 224 off8752 00000040:00080000:3.0:1788201702.895508:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7b:0x0].4, 224 off8976 00000040:00080000:3.0:1788201702.895515:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7b:0x0].5, 112 off9088 00000040:00080000:3.0:1788201702.895524:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7b:0x0].6, 224 off9312 00000040:00080000:3.0:1788201702.895527:0:111479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x76:0x0] index 6 count 7 00000100:00100000:3.0:1788201702.895556:0:111479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715549056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788201702.895573:0:111479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.895590:0:111479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140024780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201702.895599:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715549056 00000100:00100000:1.0:1788201702.895603:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715549056 00000100:00100000:1.0:1788201702.895622:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788201702.895625:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11073bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:111479:x1875060715549056:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201702.895684:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11073bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:111479:x1875060715549056:12345-0@lo:501:mount.lustre.0 Request processed in 58us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201702.895695:0:111479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715549056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201702.895696:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788201702.895726:0:111479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715549184:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201702.895761:0:111479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.895774:0:111479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140024780 going to sleep for 11 seconds 00000100:00100000:1.0:1788201702.895787:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715549184 00000100:00100000:1.0:1788201702.895800:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715549184 00000100:00100000:1.0:1788201702.895825:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788201702.895831:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110739850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:111479:x1875060715549184:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201702.895884:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110739850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:111479:x1875060715549184:12345-0@lo:503:mount.lustre.0 Request processed in 52us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201702.895891:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788201702.895899:0:111479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715549184:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788201702.896115:0:111479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201702.896141:0:111479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715549312:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201702.896164:0:111479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.896181:0:111479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004a95840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201702.896187:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715549312 00000100:00100000:1.0:1788201702.896191:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715549312 00000100:00100000:1.0:1788201702.896210:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788201702.896214:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11073ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:111479:x1875060715549312:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201702.896274:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11073ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:111479:x1875060715549312:12345-0@lo:502:mount.lustre.0 Request processed in 59us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201702.896281:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788201702.896285:0:111479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715549312:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201702.896369:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7c:0x0].1, 224 off8416 00000040:00080000:3.0:1788201702.896382:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7c:0x0].2, 112 off8528 00000040:00080000:3.0:1788201702.896389:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7c:0x0].3, 224 off8752 00000040:00080000:3.0:1788201702.896395:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7c:0x0].4, 224 off8976 00000040:00080000:3.0:1788201702.896403:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7c:0x0].5, 112 off9088 00000100:00100000:3.0:1788201702.896414:0:111479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715549440:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201702.896436:0:111479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.896448:0:111479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004a95840 going to sleep for 11 seconds 00000100:00100000:1.0:1788201702.896456:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715549440 00000100:00100000:1.0:1788201702.896460:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715549440 00000100:00100000:1.0:1788201702.896478:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788201702.896482:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc110738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:111479:x1875060715549440:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201702.896527:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc110738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+23:111479:x1875060715549440:12345-0@lo:502:mount.lustre.0 Request processed in 44us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201702.896532:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788201702.896551:0:111479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b635880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715549440:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788201702.896587:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7c:0x0].6, 224 off9312 00000040:00080000:3.0:1788201702.896593:0:111479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:3.0:1788201702.896903:0:111492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201702.896910:0:111492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201702.896912:0:111492:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788201702.896918:0:111492:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc110732000 00000020:00000080:3.0:1788201702.896920:0:111492:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788201702.896926:0:111492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201702.896929:0:111492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201702.896930:0:111492:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788201702.896932:0:111492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788201702.896935:0:111492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201702.896936:0:111492:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788201702.896939:0:111492:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dc110732000 00000020:00000080:3.0:1788201702.896941:0:111492:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788201702.896992:0:111492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788201702.896996:0:111492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788201702.896997:0:111492:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788201702.897000:0:111492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x7c:0x0] index 7 count 7 00000020:01000000:1.0:1788201702.897067:0:111479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1788201702.897094:0:111479:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788201702.897106:0:111479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc108c75600/0x96d0c9b8c9a1fce1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1fce8 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.897121:0:111479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc108c75600/0x96d0c9b8c9a1fce1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1fce8 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201702.897153:0:111479:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788201702.897155:0:111479:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dc110732000 10000000:01000000:1.0:1788201702.897157:0:111479:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dc110732000 10000000:01000000:1.0:1788201702.897160:0:111479:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788201702.897163:0:111479:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dc110732000 from 1 10000000:01000000:1.0:1788201702.897165:0:111479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788201702.897176:0:111479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee800/0x96d0c9b8c9a1fcef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.897180:0:111479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee800/0x96d0c9b8c9a1fcef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.897185:0:111479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee800/0x96d0c9b8c9a1fcef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201702.897195:0:111479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715549568:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788201702.897226:0:111479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201702.897256:0:111479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140c24600 going to sleep for 11 seconds 00000100:00100000:2.0:1788201702.897281:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715549568 00000100:00100000:2.0:1788201702.897289:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715549568 00000100:00100000:2.0:1788201702.897354:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788201702.897372:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0034cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+23:111479:x1875060715549568:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788201702.897386:0:109772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788201702.897403:0:109772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1fcf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x96d0c9b8c9a1fcef expref: -99 pid: 109772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201702.897428:0:109772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1fcf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1fcef expref: 24 pid: 109772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201702.897440:0:109772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dc12e6e2e00/0x96d0c9b8c9a1fcf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1fcef expref: 24 pid: 109772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788201702.897450:0:109772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dc12e6e2e00, rc 0) 00000100:00100000:2.0:1788201702.897509:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0034cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:111479:x1875060715549568:12345-0@lo:101:mount.lustre.0 Request processed in 145us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201702.897526:0:111479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715549568:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788201702.897542:0:111479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee800/0x96d0c9b8c9a1fcef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1fcf6 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788201702.897543:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00010000:1.0:1788201702.897560:0:111479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee800/0x96d0c9b8c9a1fcef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x96d0c9b8c9a1fcf6 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788201702.898289:0:111479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x78:0x0] index 64 count 63 00000040:00080000:1.0:1788201702.898417:0:111479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201702.898517:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].1, 224 off8416 00000040:00080000:1.0:1788201702.898533:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].2, 120 off8536 00000040:00080000:1.0:1788201702.898543:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].3, 168 off8704 00000040:00080000:1.0:1788201702.898551:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].4, 224 off8928 00000040:00080000:1.0:1788201702.898561:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].5, 224 off9152 00000040:00080000:1.0:1788201702.898570:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].6, 120 off9272 00000040:00080000:1.0:1788201702.898578:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].7, 168 off9440 00000040:00080000:1.0:1788201702.898586:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].8, 224 off9664 00000040:00080000:1.0:1788201702.898594:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].9, 224 off9888 00000040:00080000:1.0:1788201702.898606:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].10, 120 off10008 00000040:00080000:1.0:1788201702.898614:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].11, 224 off10232 00000040:00080000:1.0:1788201702.898623:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].12, 224 off10456 00000040:00080000:1.0:1788201702.898632:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].13, 88 off10544 00000040:00080000:1.0:1788201702.898641:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].14, 128 off10672 00000040:00080000:1.0:1788201702.898649:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].15, 144 off10816 00000040:00080000:1.0:1788201702.898657:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].16, 160 off10976 00000040:00080000:1.0:1788201702.898667:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].17, 224 off11200 00000040:00080000:1.0:1788201702.898675:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].18, 224 off11424 00000040:00080000:1.0:1788201702.898683:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].19, 80 off11504 00000040:00080000:1.0:1788201702.898691:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].20, 224 off11728 00000040:00080000:1.0:1788201702.898699:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].21, 224 off11952 00000040:00080000:1.0:1788201702.898707:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].22, 88 off12040 00000040:00080000:1.0:1788201702.898715:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].23, 128 off12168 00000040:00080000:1.0:1788201702.898723:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].24, 144 off12312 00000040:00080000:1.0:1788201702.898732:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].25, 160 off12472 00000040:00080000:1.0:1788201702.898744:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].26, 224 off12696 00000040:00080000:1.0:1788201702.898758:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].27, 224 off12920 00000040:00080000:1.0:1788201702.898773:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].28, 80 off13000 00000040:00080000:1.0:1788201702.898813:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].29, 224 off13224 00000040:00080000:1.0:1788201702.898830:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].30, 224 off13448 00000040:00080000:1.0:1788201702.898846:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].31, 88 off13536 00000040:00080000:1.0:1788201702.898863:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].32, 128 off13664 00000040:00080000:1.0:1788201702.898884:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].33, 144 off13808 00000040:00080000:1.0:1788201702.898901:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].34, 128 off13936 00000040:00080000:1.0:1788201702.898923:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].35, 224 off14160 00000040:00080000:1.0:1788201702.898946:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].36, 224 off14384 00000040:00080000:1.0:1788201702.898958:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].37, 80 off14464 00000040:00080000:1.0:1788201702.898966:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].38, 224 off14688 00000040:00080000:1.0:1788201702.898974:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].39, 224 off14912 00000040:00080000:1.0:1788201702.898988:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].40, 88 off15000 00000040:00080000:1.0:1788201702.899007:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].41, 128 off15128 00000040:00080000:1.0:1788201702.899046:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].42, 144 off15272 00000040:00080000:1.0:1788201702.899065:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].43, 128 off15400 00000040:00080000:1.0:1788201702.899086:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].44, 224 off15624 00000040:00080000:1.0:1788201702.899103:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].45, 224 off15848 00000040:00080000:1.0:1788201702.899112:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].46, 80 off15928 00000040:00080000:1.0:1788201702.899121:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].47, 224 off16152 00000040:00080000:1.0:1788201702.899129:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].48, 232 off16384 00000040:00080000:1.0:1788201702.899215:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].49, 224 off16608 00000040:00080000:1.0:1788201702.899239:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].50, 120 off16728 00000040:00080000:1.0:1788201702.899250:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].51, 224 off16952 00000040:00080000:1.0:1788201702.899260:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].52, 224 off17176 00000040:00080000:1.0:1788201702.899267:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].53, 112 off17288 00000040:00080000:1.0:1788201702.899280:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].54, 224 off17512 00000040:00080000:1.0:1788201702.899296:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].55, 224 off17736 00000040:00080000:1.0:1788201702.899310:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].56, 136 off17872 00000040:00080000:1.0:1788201702.899319:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].57, 224 off18096 00000040:00080000:1.0:1788201702.899327:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].58, 224 off18320 00000040:00080000:1.0:1788201702.899336:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].59, 136 off18456 00000040:00080000:1.0:1788201702.899344:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].60, 224 off18680 00000040:00080000:1.0:1788201702.899354:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].61, 224 off18904 00000040:00080000:1.0:1788201702.899376:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].62, 112 off19016 00000040:00080000:1.0:1788201702.899397:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7d:0x0].63, 224 off19240 00000040:00080000:1.0:1788201702.899402:0:111479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x78:0x0] index 63 count 63 00000100:00100000:1.0:1788201702.899439:0:111479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715549696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788201702.899466:0:111479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201702.899502:0:111479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140c24c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788201702.899518:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715549696 00000100:00100000:0.0:1788201702.899524:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715549696 00000100:00100000:0.0:1788201702.899567:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788201702.899580:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118102450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:111479:x1875060715549696:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201702.899662:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118102450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:111479:x1875060715549696:12345-0@lo:501:mount.lustre.0 Request processed in 86us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201702.899668:0:111479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715549696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788201702.899669:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788201702.899707:0:111479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715549824:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201702.899740:0:111479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201702.899758:0:111479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140c24c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788201702.899786:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715549824 00000100:00100000:3.0:1788201702.899809:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715549824 00000100:00100000:3.0:1788201702.899838:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788201702.899845:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:111479:x1875060715549824:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788201702.899920:0:111479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715549824:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788201702.899920:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118103050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:111479:x1875060715549824:12345-0@lo:503:mount.lustre.0 Request processed in 74us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201702.899935:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000040:00080000:1.0:1788201702.900203:0:111479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788201702.900231:0:111479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715549952:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201702.900259:0:111479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201702.900282:0:111479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140c24600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201702.900288:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715549952 00000100:00100000:0.0:1788201702.900293:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715549952 00000100:00100000:0.0:1788201702.900327:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788201702.900337:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc118101050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:111479:x1875060715549952:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201702.900407:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc118101050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:111479:x1875060715549952:12345-0@lo:502:mount.lustre.0 Request processed in 75us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201702.900413:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788201702.900426:0:111479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715549952:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201702.900531:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].1, 224 off8416 00000040:00080000:1.0:1788201702.900548:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].2, 120 off8536 00000040:00080000:1.0:1788201702.900556:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].3, 168 off8704 00000040:00080000:1.0:1788201702.900564:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].4, 224 off8928 00000040:00080000:1.0:1788201702.900575:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].5, 224 off9152 00000040:00080000:1.0:1788201702.900584:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].6, 120 off9272 00000040:00080000:1.0:1788201702.900598:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].7, 168 off9440 00000040:00080000:1.0:1788201702.900611:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].8, 224 off9664 00000040:00080000:1.0:1788201702.900622:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].9, 224 off9888 00000040:00080000:1.0:1788201702.900631:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].10, 120 off10008 00000040:00080000:1.0:1788201702.900641:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].11, 224 off10232 00000040:00080000:1.0:1788201702.900660:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].12, 224 off10456 00000040:00080000:1.0:1788201702.900670:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].13, 88 off10544 00000040:00080000:1.0:1788201702.900682:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].14, 128 off10672 00000040:00080000:1.0:1788201702.900693:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].15, 144 off10816 00000040:00080000:1.0:1788201702.900702:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].16, 160 off10976 00000040:00080000:1.0:1788201702.900715:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].17, 224 off11200 00000040:00080000:1.0:1788201702.900731:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].18, 224 off11424 00000040:00080000:1.0:1788201702.900742:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].19, 80 off11504 00000040:00080000:1.0:1788201702.900759:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].20, 224 off11728 00000040:00080000:1.0:1788201702.900778:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].21, 224 off11952 00000040:00080000:1.0:1788201702.900811:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].22, 88 off12040 00000040:00080000:1.0:1788201702.900834:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].23, 128 off12168 00000040:00080000:1.0:1788201702.900850:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].24, 144 off12312 00000040:00080000:1.0:1788201702.900859:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].25, 160 off12472 00000040:00080000:1.0:1788201702.900872:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].26, 224 off12696 00000040:00080000:1.0:1788201702.900881:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].27, 224 off12920 00000040:00080000:1.0:1788201702.900893:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].28, 80 off13000 00000040:00080000:1.0:1788201702.900907:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].29, 224 off13224 00000040:00080000:1.0:1788201702.900919:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].30, 224 off13448 00000040:00080000:1.0:1788201702.900929:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].31, 88 off13536 00000040:00080000:1.0:1788201702.900944:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].32, 128 off13664 00000040:00080000:1.0:1788201702.900954:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].33, 144 off13808 00000040:00080000:1.0:1788201702.900968:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].34, 128 off13936 00000040:00080000:1.0:1788201702.900980:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].35, 224 off14160 00000040:00080000:1.0:1788201702.901002:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].36, 224 off14384 00000040:00080000:1.0:1788201702.901051:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].37, 80 off14464 00000040:00080000:1.0:1788201702.901073:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].38, 224 off14688 00000040:00080000:1.0:1788201702.901094:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].39, 224 off14912 00000040:00080000:1.0:1788201702.901110:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].40, 88 off15000 00000040:00080000:1.0:1788201702.901120:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].41, 128 off15128 00000040:00080000:1.0:1788201702.901133:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].42, 144 off15272 00000040:00080000:1.0:1788201702.901145:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].43, 128 off15400 00000040:00080000:1.0:1788201702.901153:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].44, 224 off15624 00000040:00080000:1.0:1788201702.901172:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].45, 224 off15848 00000040:00080000:1.0:1788201702.901186:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].46, 80 off15928 00000040:00080000:1.0:1788201702.901204:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].47, 224 off16152 00000040:00080000:1.0:1788201702.901228:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].48, 232 off16384 00000100:00100000:1.0:1788201702.901266:0:111479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715550080:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201702.901298:0:111479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201702.901318:0:111479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140c24600 going to sleep for 11 seconds 00000100:00100000:3.0:1788201702.901326:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715550080 00000100:00100000:3.0:1788201702.901330:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715550080 00000100:00100000:3.0:1788201702.901355:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788201702.901363:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12bfd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:111479:x1875060715550080:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788201702.901428:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12bfd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:111479:x1875060715550080:12345-0@lo:502:mount.lustre.0 Request processed in 67us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201702.901433:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788201702.901443:0:111479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715550080:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201702.901542:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].49, 224 off16608 00000040:00080000:1.0:1788201702.901558:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].50, 120 off16728 00000040:00080000:1.0:1788201702.901567:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].51, 224 off16952 00000040:00080000:1.0:1788201702.901575:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].52, 224 off17176 00000040:00080000:1.0:1788201702.901588:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].53, 112 off17288 00000040:00080000:1.0:1788201702.901598:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].54, 224 off17512 00000040:00080000:1.0:1788201702.901608:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].55, 224 off17736 00000040:00080000:1.0:1788201702.901620:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].56, 136 off17872 00000040:00080000:1.0:1788201702.901629:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].57, 224 off18096 00000040:00080000:1.0:1788201702.901638:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].58, 224 off18320 00000040:00080000:1.0:1788201702.901653:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].59, 136 off18456 00000040:00080000:1.0:1788201702.901665:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].60, 224 off18680 00000040:00080000:1.0:1788201702.901678:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].61, 224 off18904 00000040:00080000:1.0:1788201702.901691:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].62, 112 off19016 00000100:00100000:1.0:1788201702.901706:0:111479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715550208:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788201702.901741:0:111479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788201702.901755:0:111479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140c24600 going to sleep for 11 seconds 00000100:00100000:0.0:1788201702.901774:0:109774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715550208 00000100:00100000:0.0:1788201702.901780:0:109774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715550208 00000100:00100000:0.0:1788201702.901815:0:109774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788201702.901822:0:109774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12bfd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:111479:x1875060715550208:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788201702.901879:0:109774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12bfd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c9b18af6-fecc-4172-82c2-66531890fe11+24:111479:x1875060715550208:12345-0@lo:502:mount.lustre.0 Request processed in 58us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201702.901887:0:109774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788201702.901891:0:111479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715550208:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788201702.901933:0:111479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7e:0x0].63, 224 off19240 00000040:00080000:1.0:1788201702.901938:0:111479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 00000020:01000004:1.0:1788201702.902292:0:111495:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788201702.902307:0:111495:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8dc1060e0000) 00000020:00000080:1.0:1788201702.902323:0:111495:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788201702.902386:0:111495:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dc110732000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788201702.902390:0:111495:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dc110732000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788201702.902393:0:111495:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dc110732000 3 00010000:00080000:1.0:1788201702.902431:0:111495:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dc005d76800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.120@tcp at head 00010000:00010000:1.0:1788201702.903724:0:111495:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-12 is initialized 00000020:00000080:1.0:1788201702.903912:0:111495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788201702.903939:0:111495:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788201702.903954:0:111495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x96d0c9b8c9a1fd04 00000100:00080000:1.0:1788201702.903960:0:111495:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788201702.903964:0:111495:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8dc005d76800 using connection 192.168.201.120@tcp/0@lo 00000100:00100000:1.0:1788201702.903983:0:111495:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dc11cc47800 x1875060715550336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788201702.904006:0:111495:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788201702.904079:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715550336:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788201702.904158:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788201702.904179:0:111495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x7e:0x0] index 64 count 63 00000100:00100000:2.0:1788201702.904264:0:107405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715550336 00000100:00100000:2.0:1788201702.904272:0:107405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715550336 00000100:00100000:2.0:1788201702.904325:0:107405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788201702.904335:0:107405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3654:x1875060715550336:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788201702.904364:0:107405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 4554 last 0 00000020:00000080:2.0:1788201702.904415:0:107405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x96d0c9b8c9a1fd0b 00000004:00100000:2.0:1788201702.904434:0:107405:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788201702.904471:0:107405:0:(import.c:65:import_set_state_nolock()) ffff8dc12f3a4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788201702.904531:0:107405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875060715550336:12345-0@lo:38:llog_process_th.0 Request processed in 197us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201702.904539:0:107405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000020:01000000:1.0:1788201702.905085:0:111479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:1.0:1788201702.905112:0:111479:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788201702.905125:0:111479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee800/0x96d0c9b8c9a1fcef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1fcf6 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.905136:0:111479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.120@tcp lock: ffff8dc0075ee800/0x96d0c9b8c9a1fcef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x96d0c9b8c9a1fcf6 expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788201702.905179:0:111479:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788201702.905181:0:111479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788201702.905182:0:111479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201702.905183:0:111479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201702.905184:0:111479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201702.905185:0:111479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201702.905186:0:111479:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201702.905192:0:111479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201702.905193:0:111479:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201702.905196:0:111479:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788201702.905198:0:111479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788201702.905199:0:111479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788201702.905200:0:111479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201702.905201:0:111479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788201702.905202:0:111479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788201702.905205:0:111479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788201702.905206:0:111479:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201702.905207:0:111479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201702.905208:0:111479:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788201702.905220:0:111479:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788201702.905229:0:111479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc44a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715550464:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788201702.905279:0:111479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201702.905284:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788201702.905296:0:3654:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 32 00000100:00100000:3.0:1788201702.905306:0:109772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715550464 00000100:00080000:2.0:1788201702.905311:0:3654:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00100000:3.0:1788201702.905313:0:109772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715550464 00000100:00100000:1.0:1788201702.905315:0:111479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140c24780 going to sleep for 11 seconds 00000100:00080000:2.0:1788201702.905324:0:3654:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788201702.905328:0:3654:0:(import.c:65:import_set_state_nolock()) ffff8dc005d76800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788201702.905340:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875060715550336:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788201702.905354:0:109772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788201702.905363:0:109772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12bfd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:111479:x1875060715550464:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788201702.905382:0:109772:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788201702.905391:0:109772:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1788201702.906554:0:109767:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788201702.906596:0:109772:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788201702.906614:0:109772:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788201702.906632:0:109777:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788201702.906636:0:109777:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788201702.906652:0:109777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dc0075eea00/0x96d0c9b8c9a1fd12 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.906666:0:109777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc0056d6600/0x96d0c9b8c9a1f91b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7870b4 expref: 9 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.906672:0:109777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1f93e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1f937 expref: 24 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.906676:0:109777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dc0075ef600/0x96d0c9b8c9a1fcda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96d0c9b8c9a1fcd3 expref: 24 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.906681:0:109777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dc0075eea00/0x96d0c9b8c9a1fd12 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.906706:0:109777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc0075ef600/0x96d0c9b8c9a1fcda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1fcd3 expref: 24 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.906727:0:109777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc0075ef600/0x96d0c9b8c9a1fcda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1fcd3 expref: 24 pid: 109774 timeout: 4654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201702.906737:0:109777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc46a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:109777:1875060715550592:0@lo:104: 00000100:00100000:1.0:1788201702.906779:0:109777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201702.906859:0:109777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1f93e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96d0c9b8c9a1f937 expref: 24 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.906871:0:109777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1f93e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1f937 expref: 24 pid: 109774 timeout: 4654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201702.906879:0:109777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc47480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:109777:1875060715550720:0@lo:104: 00000100:00100000:1.0:1788201702.906907:0:109777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201702.906938:0:109777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dc0056d6600/0x96d0c9b8c9a1f91b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7870b4 expref: 9 pid: 109774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.906947:0:109777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dc0056d6600/0x96d0c9b8c9a1f91b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7870b4 expref: 9 pid: 109774 timeout: 4654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201702.906957:0:109777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc47800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:109777:1875060715550848:192.168.201.20@tcp:104: 00000100:00100000:1.0:1788201702.907001:0:109777:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc140c24300 going to sleep for 11 seconds 00000100:00100000:1.0:1788201702.907066:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715550592 00000100:00100000:1.0:1788201702.907072:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715550592 00000100:00100000:1.0:1788201702.907122:0:19665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715550720 00000100:00100000:1.0:1788201702.907127:0:19665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715550720 00000100:00100000:1.0:1788201702.907172:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1788201702.907187:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+4:109777:x1875060715550592:12345-0@lo:104: 00010000:00010000:1.0:1788201702.907203:0:19665:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1fcd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1fcda expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.907278:0:19665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788201702.907284:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+4:109777:x1875060715550592:12345-0@lo:104: Request processed in 105us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201702.907291:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1788201702.907319:0:19665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788201702.907333:0:19665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc11cc45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+3:109777:x1875060715550720:12345-0@lo:104: 00010000:00010000:1.0:1788201702.907342:0:19665:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1f937 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1f93e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.907407:0:19665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788201702.907417:0:19665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc11cc45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c9b18af6-fecc-4172-82c2-66531890fe11+3:109777:x1875060715550720:12345-0@lo:104: Request processed in 89us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201702.907424:0:19665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00010000:00010000:1.0:1788201702.907459:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788201702.907464:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1fcd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1fcda expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.907471:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0056d6a00 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201702.907475:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1fcd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1fcda expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.907482:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1fcd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1fcda expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201702.907488:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1fcd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1fcda expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201702.907499:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201702.907528:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1fcd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1fcda expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.907532:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788201702.907553:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1fcd3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1fcda expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.907559:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc0056d6a00/0x96d0c9b8c9a1fcd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1fcda expref: -99 pid: 111479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.907569:0:24979:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788201702.907572:0:24979:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1f937 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96d0c9b8c9a1f93e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201702.907572:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1788201702.907578:0:24979:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc140d59600 already unused, calling callback (ffffffffc1280c20) 10000000:00010000:1.0:1788201702.907581:0:24979:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1f937 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96d0c9b8c9a1f93e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201702.907585:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715550976:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201702.907587:0:24979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1f937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96d0c9b8c9a1f93e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788201702.907595:0:24979:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1f937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96d0c9b8c9a1f93e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788201702.907599:0:24979:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788201702.907614:0:24979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1f937 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1f93e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.907618:0:24979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788201702.907621:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788201702.907631:0:24979:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1f937 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1f93e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788201702.907637:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.120@tcp lock: ffff8dc140d59600/0x96d0c9b8c9a1f937 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96d0c9b8c9a1f93e expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201702.907653:0:26215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715550976 00010000:00010000:1.0:1788201702.907655:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201702.907657:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788201702.907662:0:24979:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788201702.907663:0:26215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715550976 00000100:00100000:3.0:1788201702.907665:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc11cc44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715551104:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788201702.907670:0:13349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788201702.907690:0:26215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc0075ef600/0x96d0c9b8c9a1fcda lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1fcd3 expref: 25 pid: 109774 timeout: 4654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788201702.907710:0:109777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc46a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:109777:1875060715550592:0@lo:104: 00000100:00100000:3.0:1788201702.907716:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788201702.907720:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2640 00000100:00100000:0.0:1788201702.907733:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+25:3656:x1875060715550976:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788201702.907736:0:109777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc47480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:109777:1875060715550720:0@lo:104: 00010000:00010000:0.0:1788201702.907745:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201702.907750:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc0075ef600/0x96d0c9b8c9a1fcda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1fcd3 expref: 25 pid: 109774 timeout: 4654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201702.907765:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc0075ef600/0x96d0c9b8c9a1fcda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1fcd3 expref: 25 pid: 109774 timeout: 4654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201702.907783:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0075ef600/0x96d0c9b8c9a1fcda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1fcd3 expref: 25 pid: 109774 timeout: 4654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201702.907809:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788201702.907827:0:109772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12bfd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c9b18af6-fecc-4172-82c2-66531890fe11+24:111479:x1875060715550464:12345-0@lo:253:mount.lustre.0 Request processed in 2458us (2542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788201702.907835:0:111479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc44a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c9b18af6-fecc-4172-82c2-66531890fe11:111479:1875060715550464:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788201702.907844:0:111479:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788201702.907846:0:111479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788201702.907848:0:111479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788201702.907850:0:111479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788201702.907852:0:111479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:3.0:1788201702.907852:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715551104 00000020:01000004:1.0:1788201702.907859:0:111479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:2.0:1788201702.907859:0:109772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788201702.907861:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715551104 00000020:01000004:1.0:1788201702.907864:0:111479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000100:00100000:0.0:1788201702.907869:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+24:3656:x1875060715550976:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (241us total) trans 0 rc 0/0 00000020:01000004:1.0:1788201702.907869:0:111479:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788201702.907872:0:111479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788201702.907874:0:111479:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788201702.907883:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2640 00010000:00010000:3.0:1788201702.907885:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1f93e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1f937 expref: 24 pid: 109774 timeout: 4654 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:1.0:1788201702.907893:0:111479:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788201702.907914:0:26215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2641 00000100:00100000:0.0:1788201702.907925:0:26215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b635f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+23:3656:x1875060715551104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201702.907934:0:26215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201702.907939:0:26215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1f93e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1f937 expref: 23 pid: 109774 timeout: 4654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201702.907948:0:26215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1f93e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96d0c9b8c9a1f937 expref: 23 pid: 109774 timeout: 4654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788201702.907950:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715550976:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788201702.907966:0:26215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc108c75800/0x96d0c9b8c9a1f93e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96d0c9b8c9a1f937 expref: 23 pid: 109774 timeout: 4654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201702.907983:0:26215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201702.908054:0:26215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b635f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:c9b18af6-fecc-4172-82c2-66531890fe11+22:3656:x1875060715551104:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201702.908064:0:26215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2641 00000100:00100000:3.0:1788201702.908084:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c9b18af6-fecc-4172-82c2-66531890fe11:3656:1875060715551104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788201702.909089:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.20@tcp (source: 12345-192.168.201.20@tcp) 00000100:00100000:0.0:1788201702.909107:0:9535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060695607680 00000100:00100000:0.0:1788201702.909110:0:9535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060695607680 00010000:00010000:0.0:1788201702.909123:0:9535:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dc0056d6600/0x96d0c9b8c9a1f91b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7870b4 expref: 10 pid: 109774 timeout: 4654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201702.909141:0:9535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.20@tcp, seq: 2642 00000100:00100000:0.0:1788201702.909148:0:9535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc001e40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695607680:12345-192.168.201.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788201702.909157:0:9535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788201702.909161:0:9535:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dc0056d6600/0x96d0c9b8c9a1f91b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7870b4 expref: 10 pid: 109774 timeout: 4654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201702.909170:0:9535:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dc0056d6600/0x96d0c9b8c9a1f91b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7870b4 expref: 10 pid: 109774 timeout: 4654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201702.909186:0:9535:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dc0075eea00/0x96d0c9b8c9a1fd12 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201702.909191:0:9535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dc0075eea00/0x96d0c9b8c9a1fd12 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788201702.909200:0:9535:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.026071986s 00010000:00010000:0.0:1788201702.909203:0:9535:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc0075eea00/0x96d0c9b8c9a1fd12 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201702.909216:0:9535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dc0075eea00/0x96d0c9b8c9a1fd12 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201702.909220:0:9535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dc0075eea00/0x96d0c9b8c9a1fd12 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201702.909224:0:9535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dc0075eea00/0x96d0c9b8c9a1fd12 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201702.909227:0:9535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dc0075eea00 already unused, calling callback (ffffffffc0c83230) 00010000:00010000:0.0:1788201702.909230:0:9535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dc0075eea00/0x96d0c9b8c9a1fd12 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201702.909235:0:9535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dc0075eea00/0x96d0c9b8c9a1fd12 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201702.909240:0:9535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dc0075eea00/0x96d0c9b8c9a1fd12 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201702.909247:0:9535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788201702.909274:0:9535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc001e40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:93ba7067-43b5-4e46-8db7-27c040fa03d9+10:2400:x1875060695607680:12345-192.168.201.20@tcp:103:ldlm_bl.0 Request processed in 127us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788201702.909283:0:9535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.20@tcp, seq: 2642 00010000:00010000:0.0:1788201702.910096:0:109777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0056d6600/0x96d0c9b8c9a1f91b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.20@tcp remote: 0x64c4f98b7f7870b4 expref: 9 pid: 109774 timeout: 4654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788201702.910107:0:109777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc11cc47800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:109777:1875060715550848:192.168.201.20@tcp:104: 00010000:00010000:0.0:1788201702.910130:0:109777:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dc0075eea00/0x96d0c9b8c9a1fd12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201702.910150:0:109777:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dc0075eea00/0x96d0c9b8c9a1fd12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201702.910157:0:109777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dc0075eea00/0x96d0c9b8c9a1fd12 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788201702.910164:0:109777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dc0075eea00/0x96d0c9b8c9a1fd12 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788201702.913202:0:111479:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0001: committed batchid 81604378642 00000040:01000000:1.0:1788201702.913358:0:111479:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1788201702.913361:0:111500:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 81604378642 00000020:00080000:0.0:1788201702.913364:0:111500:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 81604378642 00000040:01000000:1.0:1788201702.913532:0:111501:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788201702.913544:0:111479:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1788201702.913838:0:111502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:111502:1875060715551232:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1788201702.913863:0:111479:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:3.0:1788201702.913881:0:111502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788201702.913892:0:111479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788201702.913904:0:111502:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004a95780 going to sleep for 50 seconds 00000100:00100000:2.0:1788201702.913932:0:109785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715551232 00000100:00100000:2.0:1788201702.913941:0:109785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715551232 00000100:00100000:2.0:1788201702.914000:0:109785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788201702.914065:0:109785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc12b634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:111502:x1875060715551232:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788201702.914166:0:109785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc12b634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:111502:x1875060715551232:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 158us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201702.914173:0:109785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788201702.914212:0:111502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:111502:1875060715551232:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788201702.914231:0:111502:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788201702.914249:0:111502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:111502:1875060715551360:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788201702.914282:0:111502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000080:0.0:1788201702.914294:0:111479:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788201702.914301:0:111479:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:3.0:1788201702.914305:0:111502:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004a95780 going to sleep for 50 seconds 00000100:00100000:2.0:1788201702.914324:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715551360 00000100:00100000:2.0:1788201702.914330:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715551360 00000040:00080000:0.0:1788201702.914334:0:111479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788201702.914364:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788201702.914371:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0086cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:111502:x1875060715551360:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788201702.914531:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0086cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:111502:x1875060715551360:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 158us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201702.914539:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788201702.914547:0:111502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc12b637480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:111502:1875060715551360:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788201702.914587:0:111502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0086cc700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:111502:1875060715551488:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788201702.914609:0:111502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.914625:0:111502:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004a959c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788201702.914647:0:107415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715551488 00000100:00100000:2.0:1788201702.914653:0:107415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715551488 00000100:00100000:2.0:1788201702.914682:0:107415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788201702.914689:0:107415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0086cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:111502:x1875060715551488:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788201702.914691:0:107416:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 2 min 2 max 256 00000100:00100000:3.0:1788201702.914698:0:107416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0002' 00000100:00100000:2.0:1788201702.914736:0:107415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0086cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:111502:x1875060715551488:12345-0@lo:900:lod0001_rec0000.0 Request processed in 42us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201702.914744:0:107415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788201702.914751:0:111502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0086cc700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:111502:1875060715551488:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788201702.914785:0:111502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0086cc700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:111502:1875060715551616:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788201702.914821:0:111502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.914839:0:111502:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004a95780 going to sleep for 50 seconds 00000100:00100000:2.0:1788201702.914853:0:109785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715551616 00000100:00100000:2.0:1788201702.914858:0:109785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715551616 00000100:00100000:2.0:1788201702.914879:0:109785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788201702.914885:0:109785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0086cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:111502:x1875060715551616:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788201702.914954:0:109785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0086cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:111502:x1875060715551616:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 67us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201702.914961:0:111502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0086cc700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:111502:1875060715551616:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788201702.914967:0:109785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788201702.915244:0:111502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0086cc700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:111502:1875060715551744:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788201702.915303:0:111502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.915320:0:111502:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004a95480 going to sleep for 50 seconds 00000100:00100000:2.0:1788201702.915329:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715551744 00000100:00100000:2.0:1788201702.915334:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715551744 00000100:00100000:2.0:1788201702.915356:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788201702.915361:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0086cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:111502:x1875060715551744:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788201702.916196:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0086cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:111502:x1875060715551744:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 834us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201702.916204:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788201702.916216:0:111502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0086cc700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:111502:1875060715551744:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788201702.916241:0:111502:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000bd1:0x3:0x0] first idx 32, last_idx 34 00000100:00100000:3.0:1788201702.916301:0:111502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0086cc700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:111502:1875060715551872:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788201702.916340:0:111502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.916357:0:111502:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004a95480 going to sleep for 50 seconds 00000100:00100000:2.0:1788201702.916368:0:109785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715551872 00000100:00100000:2.0:1788201702.916373:0:109785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715551872 00000100:00100000:2.0:1788201702.916397:0:109785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788201702.916403:0:109785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0086ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:111502:x1875060715551872:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788201702.916553:0:109785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0086ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:111502:x1875060715551872:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 147us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201702.916560:0:109785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788201702.916573:0:111502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0086cc700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:111502:1875060715551872:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788201702.916597:0:111502:0:(llog.c:805:llog_process_thread()) index: 33, lh_last_idx: 34 synced_idx: 0 lgh_last_idx: 34 00000040:00080000:3.0:1788201702.916600:0:111502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x20000ee61:0x1:0x0] at index 33 of catalog [0x200000bd1:0x3:0x0] 00000100:00100000:3.0:1788201702.916623:0:111502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0086cc700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:111502:1875060715552000:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788201702.916645:0:111502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.916659:0:111502:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004a95780 going to sleep for 50 seconds 00000100:00100000:2.0:1788201702.916670:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715552000 00000100:00100000:2.0:1788201702.916675:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715552000 00000100:00100000:2.0:1788201702.916694:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788201702.916701:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0086ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:111502:x1875060715552000:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788201702.916746:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0086ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:111502:x1875060715552000:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 43us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201702.916751:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788201702.916758:0:111502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0086cc700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:111502:1875060715552000:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788201702.916837:0:111502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0086cc700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:111502:1875060715552128:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788201702.916876:0:111502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.916890:0:111502:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004a95480 going to sleep for 50 seconds 00000100:00100000:2.0:1788201702.916904:0:109785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715552128 00000100:00100000:2.0:1788201702.916909:0:109785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715552128 00000100:00100000:2.0:1788201702.916936:0:109785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788201702.916942:0:109785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0086cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:111502:x1875060715552128:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788201702.917142:0:109785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0086cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:111502:x1875060715552128:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 200us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201702.917147:0:109785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788201702.917158:0:111502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0086cc700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:111502:1875060715552128:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788201702.917207:0:111502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0086cc700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:111502:1875060715552256:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788201702.917229:0:111502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.917246:0:111502:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004a953c0 going to sleep for 50 seconds 00000100:00100000:2.0:1788201702.917249:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715552256 00000100:00100000:2.0:1788201702.917253:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715552256 00000100:00100000:2.0:1788201702.917274:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788201702.917283:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0086ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:111502:x1875060715552256:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788201702.917347:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0086ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:111502:x1875060715552256:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 62us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788201702.917351:0:111502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0086cc700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:111502:1875060715552256:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788201702.917377:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000004:00080000:3.0:1788201702.917407:0:111502:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc004a959c0 with version 1 00000040:00080000:3.0:1788201702.917436:0:111502:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x200000bd1:0x3:0x0] first idx 33, last_idx 34 00000004:00080000:2.0:1788201702.917442:0:111486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc119a80cc0 version 1 rpc_version 1 00000004:00080000:3.0:1788201702.917454:0:111502:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc004a95480 with version 2 00000040:00080000:3.0:1788201702.917458:0:111502:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x20000ee61:0x1:0x0] at index 33 of catalog [0x200000bd1:0x3:0x0] 00000020:00100000:2.0:1788201702.917471:0:111486:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788201702.917481:0:111486:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc004b3a680 x1875060715552512/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201702.917500:0:111486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc004b3a680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:111486:1875060715552512:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788201702.917531:0:111486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.917557:0:109785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715552512 00000100:00100000:2.0:1788201702.917559:0:111486:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004f169c0 going to sleep for 50 seconds 00000100:00100000:3.0:1788201702.917563:0:109785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715552512 00000100:00100000:3.0:1788201702.917593:0:109785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788201702.917599:0:109785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc004b38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+5:111486:x1875060715552512:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201702.917752:0:109785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc004b38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:111486:x1875060715552512:12345-0@lo:1000:osp_up0-1.0 Request processed in 152us (219us total) trans 137438953474 rc 0/0 00000100:00100000:3.0:1788201702.917761:0:109785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788201702.917784:0:111486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc004b3a680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:111486:1875060715552512:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1788201702.917804:0:111486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc119a80cc0 version 2 rpc_version 2 00000020:00100000:2.0:1788201702.917815:0:111486:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788201702.917820:0:111486:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc13a91d880 x1875060715552768/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788201702.917829:0:111486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91d880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:111486:1875060715552768:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788201702.917857:0:111486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788201702.917877:0:111486:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004f169c0 going to sleep for 50 seconds 00000100:00100000:3.0:1788201702.917896:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715552768 00000100:00100000:3.0:1788201702.917901:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715552768 00000100:00100000:3.0:1788201702.917923:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788201702.917928:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:111486:x1875060715552768:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201702.918007:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:111486:x1875060715552768:12345-0@lo:1000:osp_up0-1.0 Request processed in 76us (147us total) trans 137438953475 rc 0/0 00000100:00100000:3.0:1788201702.918013:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788201702.918075:0:111486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91d880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:111486:1875060715552768:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201702.918106:0:111502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0086cc700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:111502:1875060715552896:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788201702.918143:0:111502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.918159:0:111502:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f6dcc0 going to sleep for 50 seconds 00000100:00100000:2.0:1788201702.918166:0:109785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715552896 00000100:00100000:2.0:1788201702.918170:0:109785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715552896 00000100:00100000:2.0:1788201702.918193:0:109785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788201702.918199:0:109785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0086cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:111502:x1875060715552896:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788201702.918344:0:109785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0086cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:111502:x1875060715552896:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 144us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201702.918356:0:109785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788201702.918356:0:111502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0086cc700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:111502:1875060715552896:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788201702.918397:0:111502:0:(llog.c:805:llog_process_thread()) index: 34, lh_last_idx: 34 synced_idx: 34 lgh_last_idx: 34 00000040:00080000:3.0:1788201702.918401:0:111502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x20000ee61:0x2:0x0] at index 34 of catalog [0x200000bd1:0x3:0x0] 00000100:00100000:3.0:1788201702.918434:0:111502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0086cc700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:111502:1875060715553024:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788201702.918460:0:111502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.918484:0:111502:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f6dcc0 going to sleep for 50 seconds 00000100:00100000:2.0:1788201702.918489:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715553024 00000100:00100000:2.0:1788201702.918493:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715553024 00000100:00100000:2.0:1788201702.918514:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788201702.918522:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0086cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:111502:x1875060715553024:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788201702.918570:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0086cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:111502:x1875060715553024:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 49us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788201702.918574:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788201702.918588:0:111502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0086cc700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:111502:1875060715553024:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788201702.918616:0:111502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788201702.918632:0:111502:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc004b1c840 with version 3 00000004:00080000:2.0:1788201702.918646:0:111486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc119a80cc0 version 3 rpc_version 3 00000004:00080000:3.0:1788201702.918657:0:111502:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8dc004b1c540 with version 4 00000020:00100000:2.0:1788201702.918660:0:111486:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000040:00080000:3.0:1788201702.918660:0:111502:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x20000ee61:0x2:0x0] at index 34 of catalog [0x200000bd1:0x3:0x0] 00000100:00100000:2.0:1788201702.918672:0:111486:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc13a91ed80 x1875060715553280/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:00080000:3.0:1788201702.918676:0:111502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000bd1:0x3:0x0] index 34 count 1 00000100:00100000:2.0:1788201702.918684:0:111486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc13a91ed80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:111486:1875060715553280:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788201702.918711:0:111486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788201702.918719:0:111502:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1788201702.918727:0:111486:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc004f169c0 going to sleep for 50 seconds 00000100:00100000:2.0:1788201702.918752:0:109785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715553280 00000100:00100000:2.0:1788201702.918754:0:109785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715553280 00000100:00100000:2.0:1788201702.918778:0:109785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788201702.918788:0:109785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc13a91df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:111486:x1875060715553280:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788201702.918945:0:109785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc13a91df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:111486:x1875060715553280:12345-0@lo:1000:osp_up0-1.0 Request processed in 159us (238us total) trans 137438953476 rc 0/0 00000100:00100000:2.0:1788201702.918953:0:109785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788201702.918981:0:111486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc13a91ed80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:111486:1875060715553280:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1788201702.918988:0:111486:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8dc119a80cc0 version 4 rpc_version 4 00000020:00100000:3.0:1788201702.918999:0:111486:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788201702.919003:0:111486:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8dc0086cc700 x1875060715553536/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 744/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788201702.919012:0:111486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dc0086cc700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:111486:1875060715553536:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1788201702.919058:0:111486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788201702.919072:0:111486:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dc121f6dcc0 going to sleep for 50 seconds 00000100:00100000:2.0:1788201702.919082:0:99776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060715553536 00000100:00100000:2.0:1788201702.919087:0:99776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060715553536 00000100:00100000:2.0:1788201702.919108:0:99776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788201702.919117:0:99776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dc0086cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:111486:x1875060715553536:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1788201702.919201:0:99776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dc0086cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:111486:x1875060715553536:12345-0@lo:1000:osp_up0-1.0 Request processed in 86us (141us total) trans 137438953477 rc 0/0 00000100:00100000:2.0:1788201702.919208:0:99776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788201702.919214:0:111486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dc0086cc700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:111486:1875060715553536:0@lo:1000:osp_up0-1.0 00000040:00080000:0.0:1788201702.921980:0:111479:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788201702.927365:0:111479:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788201702.927394:0:111479:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788201702.927456:0:111479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788201702.927835:0:111501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400013a0:0x3:0x0] index 261376 count 1 00080000:10000000:0.0:1788201702.927856:0:111479:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x42:0x0] (8/32) registered 00000004:00080000:1.0:1788201702.927875:0:111501:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788201702.927878:0:111501:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00080000:0.0:1788201702.928869:0:111479:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0001, 2 recoverable clients, last_transno 85899345930 00010000:00080000:0.0:1788201702.929526:0:111504:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0001: started recovery thread pid 111504 00010000:02000000:0.0:1788201702.929535:0:111504:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0001: in recovery but waiting for the first client to connect 00000020:01000004:1.0:1788201702.929589:0:111479:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788201702.929608:0:111479:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788201702.929631:0:111479:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788201702.929638:0:111479:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788201702.930600:0:111479:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788201702.930858:0:111479:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 Debug log: 124572 lines, 124572 kept, 0 dropped, 0 bad.